title: Quantifying Uncertainty for Temporal Motif Estimation in Graph Streams under Sampling

abstract: Dynamic networks, a.k.a. graph streams, consist of a set of vertices and a collection of timestamped interaction events (i.e., temporal edges) between vertices. Temporal motifs are defined as classes of (small) isomorphic induced subgraphs on graph streams, considering both edge ordering and duration. As with motifs in static networks, temporal motifs are the fundamental building blocks for temporal structures in dynamic networks. Several methods have been designed to count the occurrences of temporal motifs in graph streams, with recent work focusing on estimating the count under various sampling schemes along with concentration properties. However, little attention has been given to the problem of uncertainty quantification and the asymptotic statistical properties for such count estimators. In this work, we establish the consistency and the asymptotic normality of a certain Horvitz-Thompson type of estimator in an edge sampling framework for deterministic graph streams, which can be used to construct confidence intervals and conduct hypothesis testing for the temporal motif count under sampling. We also establish similar results under an analogous stochastic model. Our results are relevant to a wide range of applications in social, communication, biological, and brain networks, for tasks involving pattern discovery.


title: Complementary collider and astrophysical probes of multi-component Dark Matter

abstract: We study a new physics scenario with two inert and one active scalar doublets, hence a 3-Higgs Doublet Model (3HDM). We impose a $Z_2 \times Z'_2$ symmetry onto such a 3HDM with one inert doublet odd under the $Z_2$ transformation and the other odd under the $Z'_2$ one. Such a construction leads to a two-component Dark Matter (DM) model. It has been shown that, when there is a sufficient mass difference between the two DM candidates, it is possible to probe the light DM candidate in the nuclear recoil energy in direct detection experiments and the heavy DM component in the photon flux in indirect detection experiments. With the DM masses at the electroweak scale, we show that, independently of astrophysical probes, this model feature can be tested at the Large Hadron Collider via scalar cascade decays in $2 \ell + \cancel{E}_T$ final states. We study several observable distributions whose shapes hint at the presence of the two different DM candidates.


title: Graph Coloring and Semidefinite Rank

abstract: This paper considers the interplay between semidefinite programming, matrix rank, and graph coloring. Karger, Motwani, and Sudan \cite{KMS98} give a vector program for which a coloring of the graph can be encoded as a semidefinite matrix of low rank. By complementary slackness conditions of semidefinite programming, if an optimal dual solution has sufficiently high rank, any optimal primal solution must have low rank. We attempt to characterize graphs for which we can show that the corresponding dual optimal solution must have sufficiently high rank. In the case of the original Karger, Motwani, and Sudan vector program, we show that any graph which is a $k$-tree has sufficiently high dual rank, and we can extract the coloring from the corresponding low-rank primal solution. We can also show that if the graph is not uniquely colorable, then no sufficiently high rank dual optimal solution can exist. This allows us to completely characterize the planar graphs for which dual optimal solutions have sufficiently high dual rank. We then modify the semidefinite program to have an objective function with costs, and explore when we can create a cost function whose optimal dual solution has sufficiently high rank. We show that it is always possible to construct such a cost function given the graph coloring. The construction of the cost function gives rise to a heuristic for graph coloring which we show works well in the case of planar graphs. Our research was motivated by the Colin de Verdi\`ere graph invariant \cite{CDV90}(and a corresponding conjecture of Colin de Verdi\`ere), in which matrices that have some similarities to the dual feasible matrices must have high rank in the case that graphs are of a certain type. We explore the connection between the conjecture and the rank of the dual solutions.


title: Probing quantum devices with radio-frequency reflectometry

abstract: Many important phenomena in quantum devices are dynamic, meaning that they cannot be studied using time-averaged measurements alone. Experiments that measure such transient effects are collectively known as fast readout. One of the most useful techniques in fast electrical readout is radio-frequency reflectometry, which can measure changes in impedance (both resistive and reactive) even when their duration is extremely short, down to a microsecond or less. Examples of reflectometry experiments, some of which have been realised and others so far only proposed, include projective measurements of qubits and Majorana devices for quantum computing, real-time measurements of mechanical motion and detection of non-equilibrium temperature fluctuations. However, all of these experiments must overcome the central challenge of fast readout: the large mismatch between the typical impedance of quantum devices (set by the resistance quantum) and of transmission lines (set by the impedance of free space). Here, we review the physical principles of radio-frequency reflectometry and its close cousins, measurements of radio-frequency transmission and emission. We explain how to optimise the speed and sensitivity of a radio-frequency measurement, and how to incorporate new tools such as superconducting circuit elements and quantum-limited amplifiers into advanced radio-frequency experiments. Our aim is three-fold: to introduce the readers to the technique, to review the advances to date and to motivate new experiments in fast quantum device dynamics. Our intended audience includes experimentalists in the field of quantum electronics who want to implement radio-frequency experiments or improve them, together with physicists in related fields who want to understand how the most important radio-frequency measurements work.


title: Individualized PATE: Differentially Private Machine Learning with Individual Privacy Guarantees

abstract: Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at the cost of the resulting ML models' utility. One reason for this is that DP uses one uniform privacy budget epsilon for all training data points, which has to align with the strictest privacy requirement encountered among all data holders. In practice, different data holders have different privacy requirements and data points of data holders with lower requirements can contribute more information to the training process of the ML models. To account for this need, we propose two novel methods based on the Private Aggregation of Teacher Ensembles (PATE) framework to support the training of ML models with individualized privacy guarantees. We formally describe the methods, provide a theoretical analysis of their privacy bounds, and experimentally evaluate their effect on the final model's utility using the MNIST, SVHN, and Adult income datasets. Our empirical results show that the individualized privacy methods yield ML models of higher accuracy than the non-individualized baseline. Thereby, we improve the privacy-utility trade-off in scenarios in which different data holders consent to contribute their sensitive data at different individual privacy levels.


title: The Oscura Experiment

abstract: The Oscura experiment will lead the search for low-mass dark matter particles using a very large array of novel silicon Charge Coupled Devices (CCDs) with a threshold of two electrons and with a total exposure of 30 kg-yr. The R&D effort, which began in FY20, is currently entering the design phase with the goal of being ready to start construction in late 2024. Oscura will have unprecedented sensitivity to sub-GeV dark matter particles that interact with electrons, probing dark matter-electron scattering for masses down to 500 keV and dark matter being absorbed by electrons for masses down to 1 eV. The Oscura R&D effort has made some significant progress on the main technical challenges of the experiment, of which the most significant are engaging new foundries for the fabrication of the CCD sensors, developing a cold readout solution, and understanding the experimental backgrounds.


title: FRB 121102: drastic changes in the burst polarization contrasts with the stability of the persistent emission

abstract: We study milliarcsecond-scale properties of the persistent radio counterpart to FRB 121102 and investigate the spectro-polarimetric properties of a bright burst. For the former, we use European VLBI Network (EVN) observations in 2017 at 1.7 and 4.8 GHz. For the latter, we re-analyse the 1.7-GHz data from the 100-m Effelseberg telescope taken in 2016. These observations predate other polarimetric studies of FRB 121102, and yield the highest burst Faraday rotation measure (RM) to date, RM = 1.27*10^5 rad m^-2, consistent with the decreasing RM trend. The fractional polarization of the burst emission is 15% at 1.7 GHz. This can be reconciled with the high fractional polarization at higher frequencies if the Faraday width of the burst environment is 150 rad m^-2 - a bare 0.1% of the total Faraday rotation. The width may originate from minor non-uniformities in the Faraday screen, or from effects in the emitting region itself. The upper limit on the persistent source size is 1 pc, barely consistent with a young supernova (SN) scenario. The flux variability limit of <10% is not in favor of the young SN scenario, and challenges other interpretations as well. The fractional polarization of the faint persistent source is constrained at <25% at 4.8 GHz ruling out a common origin with the highly polarized individual bursts.


title: Making Data Tangible: A Cross-disciplinary Design Space for Data Physicalization

abstract: Designing a data physicalization requires a myriad of different considerations. Despite the cross-disciplinary nature of these considerations, research currently lacks a synthesis across the different communities data physicalization sits upon, including their approaches, theories, and even terminologies. To bridge these communities synergistically, we present a design space that describes and analyzes physicalizations according to three facets: context (end-user considerations), structure (the physical structure of the artifact), and interactions (interactions with both the artifact and data). We construct this design space through a systematic review of 47 physicalizations and analyze the interrelationships of key factors when designing a physicalization. This design space cross-pollinates knowledge from relevant HCI communities, providing a cohesive overview of what designers should consider when creating a data physicalization while suggesting new design possibilities. We analyze the design decisions present in current physicalizations, discuss emerging trends, and identify underlying open challenges.


title: Multi-dimensional Besicovitch almost periodic type functions and applications

abstract: In this paper, we analyze multi-dimensional Besicovitch almost periodic type functions. We clarify the main structural properties for the introduced classes of Besicovitch almost periodic type functions, explore the notion of Besicovitch-Doss almost periodicity in the multi-dimensional setting, and provide some applications of our results to the abstract Volterra integro-differential equations and the partial differential equations.


title: Non-Volatile Memory Accelerated Posterior Estimation

abstract: Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their predictions are wrong. To use more learnable parameter combinations efficiently, these samples must be drawn from the posterior distribution. Unfortunately computing the posterior directly is infeasible, so often researchers approximate it with a well known distribution such as a Gaussian. In this paper, we show that through the use of high-capacity persistent storage, models whose posterior distribution was too big to approximate are now feasible, leading to improved predictions in downstream tasks.


title: Semi-Implicit Hybrid Gradient Methods with Application to Adversarial Robustness

abstract: Adversarial examples, crafted by adding imperceptible perturbations to natural inputs, can easily fool deep neural networks (DNNs). One of the most successful methods for training adversarially robust DNNs is solving a nonconvex-nonconcave minimax problem with an adversarial training (AT) algorithm. However, among the many AT algorithms, only Dynamic AT (DAT) and You Only Propagate Once (YOPO) guarantee convergence to a stationary point. In this work, we generalize the stochastic primal-dual hybrid gradient algorithm to develop semi-implicit hybrid gradient methods (SI-HGs) for finding stationary points of nonconvex-nonconcave minimax problems. SI-HGs have the convergence rate $O(1/K)$, which improves upon the rate $O(1/K^{1/2})$ of DAT and YOPO. We devise a practical variant of SI-HGs, and show that it outperforms other AT algorithms in terms of convergence speed and robustness.


title: Standard Model prediction for paramagnetic EDMs

abstract: Standard Model $CP$ violation associated with the phase of the Cabibbo-Kobayashi-Maskawa quark mixing matrix is known to give small answers for the EDM observables. Moreover, predictions for the EDMs of neutrons and diamagnetic atoms suffer from considerable uncertainties. We point out that the $CP$-violating observables associated with the electron spin (paramagnetic EDMs) are dominated by the combination of the electroweak penguin diagrams and $\Delta I =1/2$ weak transitions in the baryon sector, and are calculable within chiral perturbation theory. The predicted size of the semileptonic operator $C_S$ is $7\times 10^{-16}$ which corresponds to the equivalent electron EDM $d_e^{\rm eq} = 1.0 \times 10^{-35}e\,{\rm cm}$. While still far from the current observational limits, this result is three orders of magnitude larger than previously believed.


title: A Probabilistic Approach to The Perfect Sum Problem

abstract: The subset sum problem is known to be an NP-hard problem in the field of computer science with the fastest known approach having a run-time complexity of $O(2^{0.3113n})$. A modified version of this problem is known as the perfect sum problem and extends the subset sum idea further. This extension results in additional complexity, making it difficult to compute for a large input. In this paper, I propose a probabilistic approach which approximates the solution to the perfect sum problem by approximating the distribution of potential sums. Since this problem is an extension of the subset sum, our approximation also grants some probabilistic insight into the solution for the subset sum problem. We harness distributional approximations to model the number of subsets which sum to a certain size. These distributional approximations are formulated in two ways: using bounds to justify normal approximation, and approximating the empirical distribution via density estimation. These approximations can be computed in $O(n)$ complexity, and can increase in accuracy with the size of the input data making it useful for large-scale combinatorial problems. Code is available at https://github.com/KristofPusztai/PerfectSum.


title: Virial-like Thermodynamic Uncertainty Relation in the Tight-Binding Regime

abstract: We presented a methodology to approximate the entropy production for Brownian motion in a tilted periodic potential. The approximation stems from the well known thermodynamic uncertainty relation. By applying a virial-like expansion, we provided a tighter lower limit solely in terms of the drift velocity and diffusion. The approach presented is systematically analysed in the tight-binding regime. We also provide a relatively simple rule to validate using the tight-binding approach based on drift and diffusion relations rather than energy barriers and forces. We also discuss the implications of our results outside the tight-binding regime.


title: Loop unrolling of UCA models: distance labeling

abstract: A proper circular-arc (PCA) model is a pair $M = (C, A)$ where $C$ is a circle and $A$ is a family of inclusion-free arcs on $C$ whose extremes are pairwise different. The model $M$ represents a digraph $D$ that has one vertex $v(a)$ for each $a \in A$ and one edge $v(a) \to v(b)$ for each pair of arcs $a,b \in A(M)$ such that the beginning point of $b$ belongs to $a$. For $k \geq 0$, the $k$-th power $D^k$ of $D$ has the same vertices as $D$ and $v(a) \to v(b)$ is an edge of $D^k$ when $a\neq b$ and the distance from $v(a)$ to $v(b)$ in $D$ is at most $k$. A unit circular-arc (UCA) model is a PCA model $U = (C,A)$ in which all the arcs have the same length $\ell+1$. If $\ell$, the length $c$ of $C$, and the extremes of the arcs of $A$ are integer, then $U$ is a $(c,\ell)$-CA model. For $i \geq 0$, the model $i \times U$ of $U$ is obtained by replacing each arc $(s,s+\ell+1)$ with the arc $(s,s+i\ell+1)$. If $U$ represents a digraph $D$, then $U$ is $k$-multiplicative when $i \times U$ represents $D^i$ for every $0 \leq i \leq k$. In this article we design a linear time algorithm to decide if a PCA model $M$ is equivalent to a $k$-multiplicative UCA model when $k$ is given as input. The algorithm either outputs a $k$-multiplicative UCA model $U$ equivalent to $M$ or a negative certificate that can be authenticated in linear time. Our main technical tool is a new characterization of those PCA models that are equivalent to $k$-multiplicative UCA models. For $k=1$, this characterization yields a new algorithm for the classical representation problem that is simpler than the previously known algorithms.


title: On the vanishing of Green's function, desingularization and Carleman's method

abstract: The subject of the present paper is the phenomenon of vanishing of the Green function of the operator $-\Delta + V$ on $\mathbb R^3$ at the points where a potential $V$ has positive critical singularities. More precisely, imposing minimal assumptions on $V$ (i.e. the form-boundedness), we obtain an upper bound on the order of vanishing of the Green function. As a by-product of our proof, we improve the existing results on the strong unique continuation for eigenfunctions of $-\Delta + V$ in dimension $d=3$.


title: NP-Hardness of a 2D, a 2.5D, and a 3D Puzzle Game

abstract: In this paper, we give simple NP-hardness reductions for three popular video games. The first is Baba Is You, an award winning 2D block puzzle game with the key premise being the ability to rewrite the rules of the game. The second is Fez, a puzzle platformer whose main draw is the ability to swap between four different 2-dimensional views of the player's position. The final is Catherine, a 3-dimensional puzzle game where the player must climb a tower of rearrangeable blocks.


title: A geometric study of circle packings and ideal class groups

abstract: A family of fractal arrangements of circles is introduced for each imaginary quadratic field $K$. Collectively, these arrangements contain (up to an affine transformation) every set of circles in the extended complex plane with integral curvatures and Zariski dense symmetry group. When that set is a circle packing, we show how the ambient structure of our arrangement gives a geometric criterion for satisfying the almost local-global principle. Connections to the class group of $K$ are also explored. Among them is a geometric property that guarantees certain ideal classes are group generators.


title: Oscillating singular integral operators on compact Lie groups revisited

abstract: In [24, Theorem 2'] Charles Fefferman has proved the weak (1,1) boundedness for a class of oscillating singular integrals that includes the oscillating spectral multipliers of the Euclidean Laplacian $\Delta,$ namely, operators of the form \begin{equation} T_{\theta}(-\Delta):= (1-\Delta)^{-\frac{n\theta}{4}}e^{i (1-\Delta)^{\frac{\theta}{2}}},\,0\leq \theta <1. \end{equation} The aim of this work is to extend Fefferman's result to oscillating singular integrals on any arbitrary compact Lie group. Applications to oscillating spectral multipliers of the Laplace-Beltrami operator are also considered. The proof of our main theorem illustrates the delicate relationship between the condition on the kernel of the operator, its Fourier transform (defined in terms of the representation theory of the group) and the microlocal/geometric properties of the group.


title: Metamorphic dynamical quantum phase transition in double-quench processes at finite temperatures

abstract: By deriving a general framework and analyzing concrete examples, we demonstrate a class of dynamical quantum phase transitions (DQPTs) in one-dimensional two-band systems going through double-quench processes. When this type of DQPT occurs, the Loschmidt amplitude vanishes and the rate function remains singular after the second quench, meaning the final state continually has no overlap with the initial state. This type of DQPT is named metamorphic DQPT to differentiate it from ordinary DQPTs that only exhibit zero Loschmidt amplitude and singular rate function at discrete time points. The metamorphic DQPTs occur at zero as well as finite temperatures. Our examples of the Su-Schrieffer-Heeger (SSH) model and Kitaev chain illustrate the conditions and behavior of the metamorphic DQPT. Since ordinary DQPTs have been experimentally realized in many systems, similar setups with double quenches will demonstrate the metamorphic DQPT. Our findings thus provide additional controls of dynamical evolution of quantum systems.


title: Dynamic Sampling Rate: Harnessing Frame Coherence in Graphics Applications for Energy-Efficient GPUs

abstract: In real-time rendering, a 3D scene is modelled with meshes of triangles that the GPU projects to the screen. They are discretized by sampling each triangle at regular space intervals to generate fragments which are then added texture and lighting effects by a shader program. Realistic scenes require detailed geometric models, complex shaders, high-resolution displays and high screen refreshing rates, which all come at a great compute time and energy cost. This cost is often dominated by the fragment shader, which runs for each sampled fragment. Conventional GPUs sample the triangles once per pixel, however, there are many screen regions containing low variation that produce identical fragments and could be sampled at lower than pixel-rate with no loss in quality. Additionally, as temporal frame coherence makes consecutive frames very similar, such variations are usually maintained from frame to frame. This work proposes Dynamic Sampling Rate (DSR), a novel hardware mechanism to reduce redundancy and improve the energy efficiency in graphics applications. DSR analyzes the spatial frequencies of the scene once it has been rendered. Then, it leverages the temporal coherence in consecutive frames to decide, for each region of the screen, the lowest sampling rate to employ in the next frame that maintains image quality. We evaluate the performance of a state-of-the-art mobile GPU architecture extended with DSR for a wide variety of applications. Experimental results show that DSR is able to remove most of the redundancy inherent in the color computations at fragment granularity, which brings average speedups of 1.68x and energy savings of 40%.


title: Tracer particles sense local stresses in an evolving multicellular spheroid without affecting the anomalous dynamics of the cancer cells

abstract: Measurements of local stresses on the cancer cells (CCs), inferred by embedding inert compressible tracer particles (TPs) in a growing multicellular spheroid (MCS), show that pressure decreases monotonically as the distance from the core of the MCS increases. How faithfully do the TPs report the local stresses in the CCs is an important question because pressure buildup in the MCS is dynamically generated due to CC division, which implies that the CC dynamics should be minimally altered by the TPs. Here using theory and simulations, we show that although the TP dynamics is unusual, exhibiting sub-diffusive behavior on times less than the CC division times and hyper-diffusive dynamics on in the long-time limit, they do not affect the long-time CC dynamics or the local CC stress distributions. The CC pressure profile within the MCS, which decays from a high value at the core to the periphery, is almost identical with and without the TPs. That the TPs have insignificant effect on the local stresses in the MCS implies that they are reliable reporters of the CC microenvironment.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph q-bio.CB


title: Role of rotations in Stern-Gerlach interferometry with massive objects

abstract: Realizing a spatial superposition with massive objects is one of the most fundamental challenges, as it will test quantum theory in new regimes, probe quantum-gravity, and enable to test exotic theories like gravitationally induced collapse. A natural extension of the successful implementation of an atomic Stern-Gerlach interferometer (SGI), is a SGI with a nano-diamond (ND) in which a single spin is embedded in the form of a nitrogen-vacancy center (NV). As the ND rotation, and with it the rotation of the NV spin direction, may inhibit such a realization, both in terms of Newtonian trajectories and quantum phases, we analyze here the role of rotations in the SGI. We take into account fundamental limits, such as those imposed by the quantum angular uncertainty relation and thermal fluctuations. We provide a detailed recipe for which a superposition of massive objects is enabled. This may open the door not only to fundamental tests, but also to new forms of quantum technology.


title: Spanish and English Phoneme Recognition by Training on Simulated Classroom Audio Recordings of Collaborative Learning Environments

abstract: Audio recordings of collaborative learning environments contain a constant presence of cross-talk and background noise. Dynamic speech recognition between Spanish and English is required in these environments. To eliminate the standard requirement of large-scale ground truth, the thesis develops a simulated dataset by transforming audio transcriptions into phonemes and using 3D speaker geometry and data augmentation to generate an acoustic simulation of Spanish and English speech. The thesis develops a low-complexity neural network for recognizing Spanish and English phonemes (available at github.com/muelitas/keywordRec). When trained on 41 English phonemes, 0.099 PER is achieved on Speech Commands. When trained on 36 Spanish phonemes and tested on real recordings of collaborative learning environments, a 0.7208 LER is achieved. Slightly better than Google's Speech-to-text 0.7272 LER, which used anywhere from 15 to 1,635 times more parameters and trained on 300 to 27,500 hours of real data as opposed to 13 hours of simulated audios.


title: Nature vs. Nurture: Investigating the Effects of Measurement Uncertainties in the Assessment of Potential Trends Between Planetary and Stellar Properties

abstract: Correlations between planetary and stellar properties, particularly age, can provide insight on planetary formation and evolution processes. However, the underlying source of such trends can be unclear, and measurement uncertainties and small sample sizes can leave doubt as to whether an observed trend truly exists. We use a Bayesian framework to examine how uncertainties in measured parameters influence the odds ratios of competing hypotheses for the source of an observed trend. We analyze three reported trends from the literature. In each application, while uncertainties do affect the numerical value of the odds ratios, our conclusions remain the same whether or not uncertainties are taken into account: hot Jupiter eccentricities are circularized over time, obliquities of hot Jupiter hosts are driven by stellar temperature, and there is not enough evidence to favor a trend of 2:1 orbital resonances with age over a chance relation. Updated samples for the 2:1 resonances and obliquities cases do not change the original conclusions. Simulated 2:1 resonance data show that sample size may be more important than measurement precision for drawing a firm conclusion. However, if 2:1 resonances get disrupted on a wide range of timescales, an age trend will be inherently difficult to confirm over a chance relation, even with a large sample. For some applications, full incorporation of measurement uncertainties may be too computationally expensive, making it preferable to use the framework without uncertainties and perform additional tests to examine the effects of highly uncertain measurements.


title: Sharpened Quasi-Newton Methods: Faster Superlinear Rate and Larger Local Convergence Neighborhood

abstract: Non-asymptotic analysis of quasi-Newton methods have gained traction recently. In particular, several works have established a non-asymptotic superlinear rate of $\mathcal{O}((1/\sqrt{t})^t)$ for the (classic) BFGS method by exploiting the fact that its error of Newton direction approximation approaches zero. Moreover, a greedy variant of BFGS was recently proposed which accelerates its convergence by directly approximating the Hessian, instead of the Newton direction, and achieves a fast local quadratic convergence rate. Alas, the local quadratic convergence of Greedy-BFGS requires way more updates compared to the number of iterations that BFGS requires for a local superlinear rate. This is due to the fact that in Greedy-BFGS the Hessian is directly approximated and the Newton direction approximation may not be as accurate as the one for BFGS. In this paper, we close this gap and present a novel BFGS method that has the best of both worlds in that it leverages the approximation ideas of both BFGS and Greedy-BFGS to properly approximate the Newton direction and the Hessian matrix simultaneously. Our theoretical results show that our method out-performs both BFGS and Greedy-BFGS in terms of convergence rate, while it reaches its quadratic convergence rate with fewer steps compared to Greedy-BFGS. Numerical experiments on various datasets also confirm our theoretical findings.


title: Low-Metallicity Globular Clusters in the Low-Mass Isolated Spiral Galaxy NGC 2403

abstract: The globular cluster (GC) systems of low-mass late-type galaxies, such as NGC 2403, have been poorly studied to date. As a low mass galaxy (M$_{\ast}$ = 7 $\times$ 10$^{9}$ M$_{\odot}$), cosmological simulations predict NGC 2403 to contain few, if any, accreted GCs. It is also isolated, with a remarkably undisturbed HI disk. Based on candidates from the literature, Sloan Digital Sky Survey and Hyper Suprime-Cam imaging, we selected several GCs for follow-up spectroscopy using the Keck Cosmic Web Imager. From their radial velocities, and other properties, we identify 8 bona-fide GCs associated with either the inner halo or the disk of this bulgeless galaxy. A stellar population analysis suggests a wide range of GC ages from shortly after the Big Bang until the present day. We find all of the old GCs to be metal-poor with [Fe/H] $\le$ --1. The age--metallicity relation for the observed GCs suggests that they were formed over many Gyr from gas with a low effective yield, similar to that observed in the SMC. Outflows of enriched material may have contributed to the low yield. With a total system of $\sim$50 GCs expected, our study is the first step in fully mapping the star cluster history of NGC 2403 in both space and time.


title: From inconsistency to incompatibility

abstract: The aim of this article is to generalize logics of formal inconsistency ($\textbf{LFI}$s) to systems dealing with the concept of incompatibility, expressed by means of a binary connective. The basic idea is that having two incompatible formulas to hold trivializes a deduction, and as a special case, a formula becomes consistent (in the sense of $\textbf{LFI}$s) when it is incompatible with its own negation. We show how this notion extends that of consistency in a non-trivial way, presenting conservative translations for many simple $\textbf{LFI}$s into some of the most basic logics of incompatibility, what evidences in a precise way how the notion of incompatibility generalizes that of consistency. We provide semantics for the new logics, as well as decision procedures, based on restricted non-deterministic matrices. The use of non-deterministic semantics with restrictions is justified by the fact that, as proved here, these systems are not algebraizable according to Blok-Pigozzi nor are they characterizable by finite Nmatrices. Finally, we briefly compare our logics to other systems focused on treating incompatibility, specially those pioneered by Brandom and further developed by Peregrin.


title: Online Learning for Orchestration of Inference in Multi-User End-Edge-Cloud Networks

abstract: Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness, and reliability. Resource-constrained end-devices must be carefully managed in order to meet the latency and energy requirements of computationally-intensive deep learning services. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency that can address application requirements through computation offloading. The decision to offload computation is a communication-computation co-optimization problem that varies with both system parameters (e.g., network condition) and workload characteristics (e.g., inputs). On the other hand, deep learning model optimization provides another source of tradeoff between latency and model accuracy. An end-to-end decision-making solution that considers such computation-communication problem is required to synergistically find the optimal offloading policy and model for deep learning services. To this end, we propose a reinforcement-learning-based computation offloading solution that learns optimal offloading policy considering deep learning model selection techniques to minimize response time while providing sufficient accuracy. We demonstrate the effectiveness of our solution for edge devices in an end-edge-cloud system and evaluate with a real-setup implementation using multiple AWS and ARM core configurations. Our solution provides 35% speedup in the average response time compared to the state-of-the-art with less than 0.9% accuracy reduction, demonstrating the promise of our online learning framework for orchestrating DL inference in end-edge-cloud systems.


title: Cell-Free Massive MIMO with Finite Fronthaul Capacity: A Stochastic Geometry Perspective

abstract: In this work, we analyze the downlink performance of a cell-free massive multiple-input-multiple-output system with finite capacity fronthaul links between the centralized baseband units and the access point (APs). Conditioned on the user and AP locations, we first derive an achievable rate for a randomly selected user in the network that captures the effect of finite fronthaul capacity. Further, we present the performance analysis for two different types of network architecture, namely the traditional and the user-centric. For the traditional architecture, where each user is served by all the APs in the network, we derive the user rate coverage using statistical properties of the binomial point process. For the user-centric architecture, where each user is served by a specified number of its nearest APs, we derive the rate coverage for the typical user using statistical properties of the Poisson point process. In addition, we statistically characterize the number of users per AP that is necessary for coverage analysis. From the system analyses, we conclude that for the traditional architecture the average system sum-rate is a quasi-concave function of the number of users. Further, for the user-centric architecture, there exists an optimal number of serving APs that maximizes the average user rate.


title: Don't be a Victim During a Pandemic! Analysing Security and Privacy Threats in Twitter During COVID-19

abstract: There has been a huge spike in the usage of social media platforms during the COVID-19 lockdowns. These lockdown periods have resulted in a set of new cybercrimes, thereby allowing attackers to victimise social media users with a range of threats. This paper performs a large-scale study to investigate the impact of a pandemic and the lockdown periods on the security and privacy of social media users. We analyse 10.6 Million COVID-related tweets from 533 days of data crawling and investigate users' security and privacy behaviour in three different periods (i.e., before, during, and after the lockdown). Our study shows that users unintentionally share more personal identifiable information when writing about the pandemic situation (e.g., sharing nearby coronavirus testing locations) in their tweets. The privacy risk reaches 100% if a user posts three or more sensitive tweets about the pandemic. We investigate the number of suspicious domains shared on social media during different phases of the pandemic. Our analysis reveals an increase in the number of suspicious domains during the lockdown compared to other lockdown phases. We observe that IT, Search Engines, and Businesses are the top three categories that contain suspicious domains. Our analysis reveals that adversaries' strategies to instigate malicious activities change with the country's pandemic situation.


title: Exploration of the spin-phonon coupling in the noncollinear antiferromagnetic antiperovskite Mn$_3$NiN

abstract: Antiferromagnetic antiperovskites, of the form Mn$_3B$N ($B$ = Ni, Cu, Zn, Sn, Ir, and Pt), have shown an outstanding behavior in which, giant negative thermal expansion and chiral magnetic structures are intertwined. As such, aiming to shed light on the magnetostructural behavior, related to the magnetic ordering and structure of this type of materials, we studied by theoretical first-principles calculations the spin-phonon coupling in the Manganese-based antiperovskite Mn$_3$NiN, as a prototype in the Mn$_3B$N family. We found a strong spin-lattice coupling by means of the understanding of the phonon-dispersion curves obtained when including the chiral noncollinear magnetic structure. To do so, we highlight the importance of the exchange-correlation scheme selected and its influence on the electronic, structural, and vibrational degrees of freedom. Finally, we found two unstable vibrational modes at the $M$- and $R$-points when the magnetic ordering is switched to ferromagnetic from the chiral $\Gamma_{4g}$ and $\Gamma_{5g}$. The latter coupling was observed as a key signature of the strong spin-lattice interaction.


title: ReViVD: Exploration and Filtering of Trajectories in an Immersive Environment using 3D Shapes

abstract: We present ReViVD, a tool for exploring and filtering large trajectory-based datasets using virtual reality. ReViVD's novelty lies in using simple 3D shapes -- such as cuboids, spheres and cylinders -- as queries for users to select and filter groups of trajectories. Building on this simple paradigm, more complex queries can be created by combining previously made selection groups through a system of user-created Boolean operations. We demonstrate the use of ReViVD in different application domains, from GPS position tracking to simulated data (e.g., turbulent particle flows and traffic simulation). Our results show the ease of use and expressiveness of the 3D geometric shapes in a broad range of exploratory tasks. ReViVD was found to be particularly useful for progressively refining selections to isolate outlying behaviors. It also acts as a powerful communication tool for conveying the structure of normally abstract datasets to an audience.


title: Privacy Leakage of Adversarial Training Models in Federated Learning Systems

abstract: Adversarial Training (AT) is crucial for obtaining deep neural networks that are robust to adversarial attacks, yet recent works found that it could also make models more vulnerable to privacy attacks. In this work, we further reveal this unsettling property of AT by designing a novel privacy attack that is practically applicable to the privacy-sensitive Federated Learning (FL) systems. Using our method, the attacker can exploit AT models in the FL system to accurately reconstruct users' private training images even when the training batch size is large. Code is available at https://github.com/zjysteven/PrivayAttack_AT_FL.


title: Multilayer Random Sequential Adsorption

abstract: In this work, we present a variant of the multilayer random sequential adsorption (RSA) process that is inspired by orthogonal resource sharing in wireless communication networks. In the one-dimensional (1D) version of this variant, the deposition of overlapping rods is allowed only if they are assigned two different colors, where colors are symbolic of orthogonal resources, such as frequency bands, in communication networks. Owing to a strong spatial coupling among the deposited rods of different colors, finding an exact solution for the density of deposited rods of a given color as a function of time seems intractable. Hence, we propose two useful approximations to obtain the time-varying density of rods of a given color. The first approximation is based on the recursive use of the known monolayer RSA result for the indirect estimation of the density of rods for the multilayer version. The second approximation, which is more accurate but computationally intensive, involves accurate characterization of the time evolution of the gap density function. This gap density function is subsequently used to estimate the density of rods of a given color. We also consider the two-dimensional (2D) version of this problem, where we estimate the time-varying density of deposited circles of a given color as a function of time by extending the first approximation approach developed for the 1D case. The accuracy of all the results is validated through extensive Monte Carlo simulations.


title: Communication-Efficient Algorithms for Solving Pressure Poisson Equation for Multiphase Flows using Parallel Computers

abstract: Numerical solution of partial differential equations on parallel computers using domain decomposition usually requires synchronization and communication among the processors. These operations often have a significant overhead in terms of time and energy. In this paper, we propose communication-efficient parallel algorithms for solving partial differential equations that alleviate this overhead. First, we describe an asynchronous algorithm that removes the requirement of synchronization and checks for termination in a distributed fashion while maintaining the provision to restart iterations if necessary. Then, we build on the asynchronous algorithm to propose an event-triggered communication algorithm that communicates the boundary values to neighboring processors only at certain iterations, thereby reducing the number of messages while maintaining similar accuracy of solution. We demonstrate our algorithms on a successive over-relaxation solver for the Pressure Poisson equation arising from variable density incompressible multiphase flows in 3-D and show that our algorithms improve time and energy efficiency.


title: On the stability of nonlinear sampled-data systems and their continuous-time limits

abstract: This work deals with the stability analysis of nonlinear sampled-data systems under nonuniform sampling. It establishes novel relationships between the stability property of the exact discrete-time model for a given sequence of (aperiodic) sampling instants and the stability property of the continuous-time system when the maximum admissible sampling period converges to zero. These results can be used to infer stability properties for the sampled-data system by direct inspection of the stability of the mentioned continuous-time system, a task which is typically easier than the analysis of the closed-loop sampled-data system. Compared to the literature, our results allow to prove stronger (asymptotic) sampled-data stability properties for nonlinear systems in cases for which existing results only guarantee practical stability.


title: Imbalanced Classification via Explicit Gradient Learning From Augmented Data

abstract: Learning from imbalanced data is one of the most significant challenges in real-world classification tasks. In such cases, neural networks performance is substantially impaired due to preference towards the majority class. Existing approaches attempt to eliminate the bias through data re-sampling or re-weighting the loss in the learning process. Still, these methods tend to overfit the minority samples and perform poorly when the structure of the minority class is highly irregular. Here, we propose a novel deep meta-learning technique to augment a given imbalanced dataset with new minority instances. These additional data are incorporated in the classifier's deep-learning process, and their contributions are learned explicitly. The advantage of the proposed method is demonstrated on synthetic and real-world datasets with various imbalance ratios.


title: Geometry-Aware Planar Embedding of Treelike Structures

abstract: The growing complexity of spatial and structural information in 3D data makes data inspection and visualization a challenging task. We describe a method to create a planar embedding of 3D treelike structures using their skeleton representations. Our method maintains the original geometry, without overlaps, to the best extent possible, allowing exploration of the topology within a single view. We present a novel camera view generation method which maximizes the visible geometric attributes (segment shape and relative placement between segments). Camera views are created for individual segments and are used to determine local bending angles at each node by projecting them to 2D. The final embedding is generated by minimizing an energy function (the weights of which are user adjustable) based on branch length and the 2D angles, while avoiding intersections. The user can also interactively modify segment placement within the 2D embedding, and the overall embedding will update accordingly. A global to local interactive exploration is provided using hierarchical camera views that are created for subtrees within the structure. We evaluate our method both qualitatively and quantitatively and demonstrate our results by constructing planar visualizations of line data (traced neurons) and volume data (CT vascular and bronchial data


title: Qualitative Behavior of a Metabolic Pathway with Hybrid Feedback

abstract: We study the qualitative behavior of a model to represent local regulation in a metabolic network. The model is based on the end-product control structure introduced in [A. Goelzer, F. Bekkal Brikci, I. Martin-Verstraete et al., BMC Syst Biol 2 (2008), pp. 1--18]. In this class of regulation, the metabolite effector is the end-product of a metabolic pathway. We suppose the input to the pathway to switch between zero and a positive value according to the concentration of the metabolite effector. Considering the switched system as a differential inclusion, we prove that it converges to a globally uniformly asymptotically stable equilibrium point, reaches the sliding mode or oscillates around the sliding mode depending on the positive value of the input. Finally, we show that in any case the solution of the switched system is the limit of solutions of equation sequences with smooth or piecewise linear inputs.


title: Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysis

abstract: Explainable artificial intelligence (XAI) is essential for enabling clinical users to get informed decision support from AI and comply with evidence-based medical practice. Applying XAI in clinical settings requires proper evaluation criteria to ensure the explanation technique is both technically sound and clinically useful, but specific support is lacking to achieve this goal. To bridge the research gap, we propose the Clinical XAI Guidelines that consist of five criteria a clinical XAI needs to be optimized for. The guidelines recommend choosing an explanation form based on Guideline 1 (G1) Understandability and G2 Clinical relevance. For the chosen explanation form, its specific XAI technique should be optimized for G3 Truthfulness, G4 Informative plausibility, and G5 Computational efficiency. Following the guidelines, we conducted a systematic evaluation on a novel problem of multi-modal medical image explanation with two clinical tasks, and proposed new evaluation metrics accordingly. Sixteen commonly-used heatmap XAI techniques were evaluated and found to be insufficient for clinical use due to their failure in G3 and G4. Our evaluation demonstrated the use of Clinical XAI Guidelines to support the design and evaluation of clinically viable XAI.


title: Ensemble Learning techniques for object detection in high-resolution satellite images

abstract: Ensembling is a method that aims to maximize the detection performance by fusing individual detectors. While rarely mentioned in deep-learning articles applied to remote sensing, ensembling methods have been widely used to achieve high scores in recent data science com-petitions, such as Kaggle. The few remote sensing articles mentioning ensembling mainly focus on mid resolution images and earth observation applications such as land use classification, but never on Very High Resolution (VHR) images for defense-related applications or object detection.This study aims at reviewing the most relevant ensembling techniques to be used for object detection on very high resolution imagery and shows an example of the value of such techniques on a relevant operational use-case (vehicle detection in desert areas).


title: Effective Training Strategies for Deep-learning-based Precipitation Nowcasting and Estimation

abstract: Deep learning has been successfully applied to precipitation nowcasting. In this work, we propose a pre-training scheme and a new loss function for improving deep-learning-based nowcasting. First, we adapt U-Net, a widely-used deep-learning model, for the two problems of interest here: precipitation nowcasting and precipitation estimation from radar images. We formulate the former as a classification problem with three precipitation intervals and the latter as a regression problem. For these tasks, we propose to pre-train the model to predict radar images in the near future without requiring ground-truth precipitation, and we also propose the use of a new loss function for fine-tuning to mitigate the class imbalance problem. We demonstrate the effectiveness of our approach using radar images and precipitation datasets collected from South Korea over seven years. It is highlighted that our pre-training scheme and new loss function improve the critical success index (CSI) of nowcasting of heavy rainfall (at least 10 mm/hr) by up to 95.7% and 43.6%, respectively, at a 5-hr lead time. We also demonstrate that our approach reduces the precipitation estimation error by up to 10.7%, compared to the conventional approach, for light rainfall (between 1 and 10 mm/hr). Lastly, we report the sensitivity of our approach to different resolutions and a detailed analysis of four cases of heavy rainfall.


title: Nano-Trap Engineering in MOF Microenvironment for Ultratrace Iodine Sensors

abstract: Ultra-sensitive and highly selective iodine gas sensors play a crucial role during the nuclear radiation leak for a timely detection and mitigation of pollution, ensuring the safety of a vast number of operators and subsequent integrity of the facility. Herein, we rationally designed a metal-organic framework (MOF) that exhibits an outstanding performance with an almost billion-fold enhancement in the electrical response due to its optimized hydrophobicity, which allows the easy migration of iodine molecules though the channels and the presence of suitable interaction sites, temporarily anchoring the target molecule for ultra-trace sensing. The prototype sensor tested in demanding environments demonstrates its high selectivity, ultra-trace parts per billion (ppb)-level sensitivity, good reversibility, and a very fast response time even at high frequencies compared to existing adsorbents, including commercially available materials. Further, the iodine sensing at the atomic level was studied in detail by measuring the electrical response of a single crystal and, the optimal thickness of the MOF layer was identified for an industrially-viable prototype sensor by using inkjet printing. In a wider perspective, we propose a general strategy towards electrically efficient sensing materials with hybrid functionalities for engineering high-sensitivity iodine sensors for a safe and sustainable future.


title: Temperature-independent optical cavities for laser frequency stabilization

abstract: We propose a method for thermal expansion compensation of reference monolithic optical cavities for laser frequency stabilization. Two schemes of optical cavities are considered: a Fabry-Perot interferometer with a crimp ring and a whispering-gallery-mode cavity with a clamp. In each scheme, thermal expansion compensation is achieved due to the strained connection of the cavity with an element made of a material with a high coefficient of thermal expansion. The temperature region of the cavities' optical length stabilization is estimated.


title: GAN-DUF: Hierarchical Deep Generative Models for Design Under Free-Form Geometric Uncertainty

abstract: Deep generative models have demonstrated effectiveness in learning compact and expressive design representations that significantly improve geometric design optimization. However, these models do not consider the uncertainty introduced by manufacturing or fabrication. Past work that quantifies such uncertainty often makes simplifying assumptions on geometric variations, while the "real-world", "free-form" uncertainty and its impact on design performance are difficult to quantify due to the high dimensionality. To address this issue, we propose a Generative Adversarial Network-based Design under Uncertainty Framework (GAN-DUF), which contains a deep generative model that simultaneously learns a compact representation of nominal (ideal) designs and the conditional distribution of fabricated designs given any nominal design. This opens up new possibilities of 1)~building a universal uncertainty quantification model compatible with both shape and topological designs, 2)~modeling free-form geometric uncertainties without the need to make any assumptions on the distribution of geometric variability, and 3)~allowing fast prediction of uncertainties for new nominal designs. We can combine the proposed deep generative model with robust design optimization or reliability-based design optimization for design under uncertainty. We demonstrated the framework on two real-world engineering design examples and showed its capability of finding the solution that possesses better performances after fabrication.


title: Magnetic field induced corrections to the NJL model coupling constant from vacuum polarization

abstract: Magnetic field dependent corrections for the coupling constant of the Nambu-Jona-Lasinio model are calculated by considering the one-loop background field method. These coupling constants turn out to break chiral and flavor symmetries and they lead to a slight improvement of the numerical values of the up and down quark condensates when compared to results from lattice QCD. The corresponding magnetic field dependencies of the neutral pion and kaon masses are also presented and compared with available lattice QCD calculations. The resulting magnetic field correction to the $\eta-\eta'$ mixing angle is also estimated.


title: Moment Matching Deep Contrastive Latent Variable Models

abstract: In the contrastive analysis (CA) setting, machine learning practitioners are specifically interested in discovering patterns that are enriched in a target dataset as compared to a background dataset generated from sources of variation irrelevant to the task at hand. For example, a biomedical data analyst may seek to understand variations in genomic data only present among patients with a given disease as opposed to those also present in healthy control subjects. Such scenarios have motivated the development of contrastive latent variable models to isolate variations unique to these target datasets from those shared across the target and background datasets, with current state of the art models based on the variational autoencoder (VAE) framework. However, previously proposed models do not explicitly enforce the constraints on latent variables underlying CA, potentially leading to the undesirable leakage of information between the two sets of latent variables. Here we propose the moment matching contrastive VAE (MM-cVAE), a reformulation of the VAE for CA that uses the maximum mean discrepancy to explicitly enforce two crucial latent variable constraints underlying CA. On three challenging CA tasks we find that our method outperforms the previous state-of-the-art both qualitatively and on a set of quantitative metrics.


title: Approximations of the Set of Trajectories and Integral Funnel of the Nonlinear Control Systems with Limited Control Resources

abstract: In this paper approximations of the set of trajectories and integral funnel of the control system described by nonlinear ordinary differential equation with integral constraint on the control functions are considered. The set of admissible control functions is replaced by a set, consisting of a finite number of piecewise-constant control functions. It is shown that the set of trajectories generated by a finite number of piecewise-constant control functions is an internal approximation of the set of trajectories. Further, each trajectory generated by a piecewise-constant control function is substituted by appropriate Euler's broken line and it is proved that the set consisting of a finite number of Euler's broken lines is an approximation of the set of trajectories of given control system. An approximation of the system's integral funnel by a set consisting of a finite number of points is obtained.


title: CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulator

abstract: With the prevalence of wearable devices, inertial measurement unit (IMU) data has been utilized in monitoring and assessment of human mobility such as human activity recognition (HAR). Training deep neural network (DNN) models for these tasks require a large amount of labeled data, which are hard to acquire in uncontrolled environments. To mitigate the data scarcity problem, we design CROMOSim, a cross-modality sensor simulator that simulates high fidelity virtual IMU sensor data from motion capture systems or monocular RGB cameras. It utilizes a skinned multi-person linear model (SMPL) for 3D body pose and shape representations, to enable simulation from arbitrary on-body positions. A DNN model is trained to learn the functional mapping from imperfect trajectory estimations in a 3D SMPL body tri-mesh due to measurement noise, calibration errors, occlusion and other modeling artifacts, to IMU data. We evaluate the fidelity of CROMOSim simulated data and its utility in data augmentation on various HAR datasets. Extensive experiment results show that the proposed model achieves a 6.7% improvement over baseline methods in a HAR task.


title: Heuristic Sensing Schemes for Four-Target Detection in Time-Constrained Vector Poisson and Gaussian Channels

abstract: In this work, we investigate the different sensing schemes for the detection of four targets as observed through a vector Poisson and Gaussian channels when the sensing time resource is limited and the source signals can be observed through a variety of sum combinations during that fixed time. For this purpose, we can maximize the mutual information or the detection probability with respect to the time allocated to different sum combinations, for a given total fixed time. It is observed that for both Poisson and Gaussian channels; mutual information and Bayes risk with $0-1$ cost are not necessarily consistent with each other. Concavity of mutual information between input and output, for certain sensing schemes, in Poisson channel and Gaussian channel is shown to be concave w.r.t given times as linear time constraint is imposed. No optimal sensing scheme for any of the two channels is investigated in this work.


title: Human-in-the-loop Machine Learning: A Macro-Micro Perspective

abstract: Though technical advance of artificial intelligence and machine learning has enabled many promising intelligent systems, many computing tasks are still not able to be fully accomplished by machine intelligence. Motivated by the complementary nature of human and machine intelligence, an emerging trend is to involve humans in the loop of machine learning and decision-making. In this paper, we provide a macro-micro review of human-in-the-loop machine learning. We first describe major machine learning challenges which can be addressed by human intervention in the loop. Then we examine closely the latest research and findings of introducing humans into each step of the lifecycle of machine learning. Finally, we analyze current research gaps and point out future research directions.


title: t-METASET: Tailoring Property Bias of Large-Scale Metamaterial Datasets through Active Learning

abstract: Inspired by the recent achievements of machine learning in diverse domains, data-driven metamaterials design has emerged as a compelling paradigm that can unlock the potential of multiscale architectures. The model-centric research trend, however, lacks principled frameworks dedicated to data acquisition, whose quality propagates into the downstream tasks. Often built by naive space-filling design in shape descriptor space, metamaterial datasets suffer from property distributions that are either highly imbalanced or at odds with design tasks of interest. To this end, we present t-METASET: an active-learning-based data acquisition framework aiming to guide both diverse and task-aware data generation. Distinctly, we seek a solution to a commonplace yet frequently overlooked scenario at early stages of data-driven design of metamaterials: when a massive (~O(10^4 )) shape-only library has been prepared with no properties evaluated. The key idea is to harness a data-driven shape descriptor learned from generative models, fit a sparse regressor as a start-up agent, and leverage metrics related to diversity to drive data acquisition to areas that help designers fulfill design goals. We validate the proposed framework in three deployment cases, which encompass general use, task-specific use, and tailorable use. Two large-scale mechanical metamaterial datasets are used to demonstrate the efficacy. Applicable to general image-based design representations, t-METASET could boost future advancements in data-driven design.


title: Efficient Massive Machine Type Communication (mMTC) via AMP

abstract: We propose efficient and low-complexity multiuser detection (MUD) algorithms for Gaussian multiple access channel (G-MAC) for short-packet transmission in massive machine type communications. To do so, we first formulate the G-MAC MUD problem as a sparse signal recovery problem and obtain the exact and approximate joint prior distribution of the sparse vector to be recovered. Then, we employ the Bayesian approximate message passing (AMP) algorithms with the optimal separable and non-separable minimum mean squared error (MMSE) denoisers for soft decoding of the sparse vector. The effectiveness of the proposed MUD algorithms for a large number of devices is supported by simulation results. For packets of 8 information bits, while the state-of-the-art AMP with soft-threshold denoising achieves 8/100 of the upper bound at Eb/N0 = 4 dB, the proposed algorithms reach 4/7 and 1/2 of the upper bound.


title: Excitation of absorbing exceptional points in the time domain

abstract: We analyze the time-domain dynamics of resonators supporting exceptional points (EPs), at which both the eigenfrequencies and the eigenmodes associated with perfect capture of an input wave coalesce. We find that a time-domain signature of the EP is an expansion of the class of waveforms which can be perfectly captured. We show that such resonators have improved performance for storage or transduction of energy. They also can be used to convert between waveforms within this class. We analytically derive these features and demonstrate them for several examples of coupled optical resonator systems.


title: Recurrence for semi-decompositions

abstract: This paper constructs a foundation to analyze semi-group actions, group actions, filtrations, and decompositions in a unified manner. In fact, though the studies of decomposition can be applied to foliated spaces and group actions, they can not be applied to semi-group actions and filtrations in general because filtration and the set of orbits of a semi-group need not be decompositions of the base spaces. To analyze these concepts in a unified manner, we introduce a concept of a semi-decomposition which is a natural generalization of these concepts because similar relations among recurrence and their variants to group actions and decompositions hold for semi-decompositions. On the other hand, we demonstrate the difference between the recurrent concepts for group actions and those even for semi-group actions.


title: Geostatistical Model Resolution Enhancement in the Context of Multiple-Point Statistics

abstract: Current multiple-point based simulations implementations generate geostatistical models at the scale of the training image; there is an assumption that the categories are exclusive at smaller scales. The goal of this paper is to generate models with multiple-point statistics (MPS) at a higher resolution than that of the available training image. This paper addresses model resolution enhancement by studying the scale-dependence of spatial structure in MPS based models -- extrapolating the smaller scale MPS from the larger scale MPS, and (2) rescaling the training image directly to the smaller scale. The first approach investigates the MPS probabilities. A number of challenges in characterizing smaller scale variability using high-order statistics are documented. The paper concludes by advocating the direct rescaling of the training image to generate models at higher resolution.


title: Energy-Efficient Respiratory Anomaly Detection in Premature Newborn Infants

abstract: Precise monitoring of respiratory rate in premature infants is essential to initiate medical interventions as required. Wired technologies can be invasive and obtrusive to the patients. We propose a Deep Learning enabled wearable monitoring system for premature newborn infants, where respiratory cessation is predicted using signals that are collected wirelessly from a non-invasive wearable Bellypatch put on infant's body. We propose a five-stage design pipeline involving data collection and labeling, feature scaling, model selection with hyperparameter tuning, model training and validation, model testing and deployment. The model used is a 1-D Convolutional Neural Network (1DCNN) architecture with 1 convolutional layer, 1 pooling layer and 3 fully-connected layers, achieving 97.15% accuracy. To address energy limitations of wearable processing, several quantization techniques are explored and their performance and energy consumption are analyzed. We propose a novel Spiking-Neural-Network(SNN) based respiratory classification solution, which can be implemented on event-driven neuromorphic hardware. We propose an approach to convert the analog operations of our baseline 1DCNN to their spiking equivalent. We perform a design-space exploration using the parameters of the converted SNN to generate inference solutions having different accuracy and energy footprints. We select a solution that achieves 93.33% accuracy with 18 times lower energy compared with baseline 1DCNN model. Additionally the proposed SNN solution achieves similar accuracy but with 4 times less energy.


title: Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks

abstract: In the deep learning era, long video generation of high-quality still remains challenging due to the spatio-temporal complexity and continuity of videos. Existing prior works have attempted to model video distribution by representing videos as 3D grids of RGB values, which impedes the scale of generated videos and neglects continuous dynamics. In this paper, we found that the recent emerging paradigm of implicit neural representations (INRs) that encodes a continuous signal into a parameterized neural network effectively mitigates the issue. By utilizing INRs of video, we propose dynamics-aware implicit generative adversarial network (DIGAN), a novel generative adversarial network for video generation. Specifically, we introduce (a) an INR-based video generator that improves the motion dynamics by manipulating the space and time coordinates differently and (b) a motion discriminator that efficiently identifies the unnatural motions without observing the entire long frame sequences. We demonstrate the superiority of DIGAN under various datasets, along with multiple intriguing properties, e.g., long video synthesis, video extrapolation, and non-autoregressive video generation. For example, DIGAN improves the previous state-of-the-art FVD score on UCF-101 by 30.7% and can be trained on 128 frame videos of 128x128 resolution, 80 frames longer than the 48 frames of the previous state-of-the-art method.


title: Ghost projection. II. Beam shaping using realistic spatially-random masks

abstract: Spatial light modulation is important for many scientific and industrial applications. The spatial light modulator and optical data projector both rely on precisely configurable optical elements to shape a light beam. Here we explore an image-projection approach which does not require a configurable beam-shaping element. We term this approach ghost projection on account of its conceptual relation to computational ghost imaging. Instead of a configurable beam shaping element, the method transversely displaces a single illuminated mask, such as a spatially-random screen, to create specified distributions of radiant exposure. The method has potential applicability to image projection employing a variety of radiation and matter wave fields, such as hard x rays, neutrons, muons, atomic beams and molecular beams. Building on our previous theoretical and computational studies, we here seek to understand the effects, sensitivity, and tolerance of some key experimental limitations of the method. Focusing on the case of hard x rays, we employ experimentally acquired masks to numerically study the deleterious effects of photon shot noise, inaccuracies in random-mask exposure time, and inaccuracies in mask positioning, as well as adapting to spatially non-uniform illumination. Understanding the influence of these factors will assist in optimizing experimental design and work towards achieving ghost projection in practice.


title: Deep Iterative Phase Retrieval for Ptychography

abstract: One of the most prominent challenges in the field of diffractive imaging is the phase retrieval (PR) problem: In order to reconstruct an object from its diffraction pattern, the inverse Fourier transform must be computed. This is only possible given the full complex-valued diffraction data, i.e. magnitude and phase. However, in diffractive imaging, generally only magnitudes can be directly measured while the phase needs to be estimated. In this work we specifically consider ptychography, a sub-field of diffractive imaging, where objects are reconstructed from multiple overlapping diffraction images. We propose an augmentation of existing iterative phase retrieval algorithms with a neural network designed for refining the result of each iteration. For this purpose we adapt and extend a recently proposed architecture from the speech processing field. Evaluation results show the proposed approach delivers improved convergence rates in terms of both iteration count and algorithm runtime.


title: A Multi-Agent Reinforcement Learning Framework for Off-Policy Evaluation in Two-sided Markets

abstract: The two-sided markets such as ride-sharing companies often involve a group of subjects who are making sequential decisions across time and/or location. With the rapid development of smart phones and internet of things, they have substantially transformed the transportation landscape of human beings. In this paper we consider large-scale fleet management in ride-sharing companies that involve multiple units in different areas receiving sequences of products (or treatments) over time. Major technical challenges, such as policy evaluation, arise in those studies because (i) spatial and temporal proximities induce interference between locations and times; and (ii) the large number of locations results in the curse of dimensionality. To address both challenges simultaneously, we introduce a multi-agent reinforcement learning (MARL) framework for carrying policy evaluation in these studies. We propose novel estimators for mean outcomes under different products that are consistent despite the high-dimensionality of state-action space. The proposed estimator works favorably in simulation experiments. We further illustrate our method using a real dataset obtained from a two-sided marketplace company to evaluate the effects of applying different subsidizing policies. A Python implementation of our proposed method is available at https://github.com/RunzheStat/CausalMARL.


title: Characterizing Error in Noncommutative Geometric Gait Analysis

abstract: A key problem in robotic locomotion is in finding optimal shape changes to effectively displace systems through the world. Variational techniques for gait optimization require estimates of body displacement per gait cycle; however, these estimates introduce error due to unincluded high order terms. In this paper, we formulate existing estimates for displacement, and describe the contribution of low order terms to these estimates. We additionally describe the magnitude of higher (third) order effects, and identify that choice of body coordinate, gait diameter, and starting phase influence these effects. We demonstrate that variation of such parameters on two example systems (the differential drive car and Purcell swimmer) effectively manages third order contributions.


title: Unveiling the Main Sequence to Starburst Transition Region with a Sample of Intermediate Redshift Luminous Infrared Galaxies

abstract: We present a CO(3-2) study of four systems composed of six (ultra) luminous infrared galaxies (U/LIRGs), located at 0.28 < z < 0.44, that straddle the transition region between regular star forming galaxies and starbursts. These galaxies benefit from previous multi-wavelength analysis allowing in depth exploration of an understudied population of U/LIRGs at a time when the universe is experiencing a rapid decline in star formation rate density. We detect CO(3-2) emission in four targets and these galaxies fall between the loci of regular star forming galaxies and starbursts on the Kennicutt-Schmidtt relation. Compared to low luminosity LIRGs and high luminosity ULIRGs at similar redshifts, we find they all have similar molecular gas budgets with the difference in their star formation rates (SFR) driven by the star formation efficiency (SFE). This suggests that at these redshifts large molecular gas reservoirs must coincide with an increased SFE to transition a galaxy into the starburst regime. We studied the structure and kinematics and found our four detections are either interacting or have disturbed morphology which may be driving the SFE. One of the CO(3-2) non-detections has a strong continuum detection, and has been previously observed in H$\alpha$, suggesting an unusual interstellar medium for a ULIRG. We conclude that our sample of transitioning U/LIRGs fill the gap between regular star forming galaxies and starbursts, suggest a continuous change in SFE between these two populations and the increased SFE may be driven by morphology and differing stages of interaction.


title: Quantifying the role of antiferromagnetic fluctuations in the superconductivity of the doped Hubbard model

abstract: We study the contribution of the electron-spin fluctuation coupling to the superconducting state of the two dimensional Hubbard model within dynamical cluster approximation (DCA) using a numerical exact continuous time Monte Carlo solver. By analyzing the frequency dependence of the self energy, we show that only about half of the superconductivity can be attributed to a "pairing glue" arising from treating spin fluctuations as a pairing boson in the standard one-loop theory.


title: Solutions of Poisson's Equation for Stochastically Monotone Markov Chains

abstract: Stochastically monotone Markov chains arise in many applied domains, especially in the setting of queues and storage systems. Poisson's equation is a key tool for analyzing additive functionals of such models, such as cumulative sums of waiting times or sums of rewards. In this paper, we show that when the reward function for such a Markov chain is monotone, the solution of Poisson's equation is monotone. This implies that the value function associated with infinite horizon average reward is monotone in the state when the reward is monotone.


title: Fast Semantic-Assisted Outlier Removal for Large-scale Point Cloud Registration

abstract: With current trends in sensors (cheaper, more volume of data) and applications (increasing affordability for new tasks, new ideas in what 3D data could be useful for); there is corresponding increasing interest in the ability to automatically, reliably, and cheaply, register together individual point clouds. The volume of data to handle, and still elusive need to have the registration occur fully reliably and fully automatically, mean there is a need to innovate further. One largely untapped area of innovation is that of exploiting the {\em semantic information} of the points in question. Points on a tree should match points on a tree, for example, and not points on car. Moreover, such a natural restriction is clearly human-like - a human would generally quickly eliminate candidate regions for matching based on semantics. Employing semantic information is not only efficient but natural. It is also timely - due to the recent advances in semantic classification capabilities. This paper advances this theme by demonstrating that state of the art registration techniques, in particular ones that rely on "preservation of length under rigid motion" as an underlying matching consistency constraint, can be augmented with semantic information. Semantic identity is of course also preserved under rigid-motion, but also under wider motions present in a scene. We demonstrate that not only the potential obstacle of cost of semantic segmentation, and the potential obstacle of the unreliability of semantic segmentation; are both no impediment to achieving both speed and accuracy in fully automatic registration of large scale point clouds.


title: Benchmarking missing-values approaches for predictive models on health databases

abstract: BACKGROUND: As databases grow larger, it becomes harder to fully control their collection, and they frequently come with missing values: incomplete observations. These large databases are well suited to train machine-learning models, for instance for forecasting or to extract biomarkers in biomedical settings. Such predictive approaches can use discriminative -- rather than generative -- modeling, and thus open the door to new missing-values strategies. Yet existing empirical evaluations of strategies to handle missing values have focused on inferential statistics. RESULTS: Here we conduct a systematic benchmark of missing-values strategies in predictive models with a focus on large health databases: four electronic health record datasets, a population brain imaging one, a health survey and two intensive care ones. Using gradient-boosted trees, we compare native support for missing values with simple and state-of-the-art imputation prior to learning. We investigate prediction accuracy and computational time. For prediction after imputation, we find that adding an indicator to express which values have been imputed is important, suggesting that the data are missing not at random. Elaborate missing values imputation can improve prediction compared to simple strategies but requires longer computational time on large data. Learning trees that model missing values-with missing incorporated attribute-leads to robust, fast, and well-performing predictive modeling. CONCLUSIONS: Native support for missing values in supervised machine learning predicts better than state-of-the-art imputation with much less computational cost. When using imputation, it is important to add indicator columns expressing which values have been imputed.


title: Unleashing the Power of Transformer for Graphs

abstract: Despite recent successes in natural language processing and computer vision, Transformer suffers from the scalability problem when dealing with graphs. The computational complexity is unacceptable for large-scale graphs, e.g., knowledge graphs. One solution is to consider only the near neighbors, which, however, will lose the key merit of Transformer to attend to the elements at any distance. In this paper, we propose a new Transformer architecture, named dual-encoding Transformer (DET). DET has a structural encoder to aggregate information from connected neighbors and a semantic encoder to focus on semantically useful distant nodes. In comparison with resorting to multi-hop neighbors, DET seeks the desired distant neighbors via self-supervised training. We further find these two encoders can be incorporated to boost each others' performance. Our experiments demonstrate DET has achieved superior performance compared to the respective state-of-the-art methods in dealing with molecules, networks and knowledge graphs with various sizes.


title: Debiasing Backdoor Attack: A Benign Application of Backdoor Attack in Eliminating Data Bias

abstract: Backdoor attack is a new AI security risk that has emerged in recent years. Drawing on the previous research of adversarial attack, we argue that the backdoor attack has the potential to tap into the model learning process and improve model performance. Based on Clean Accuracy Drop (CAD) in backdoor attack, we found that CAD came out of the effect of pseudo-deletion of data. We provided a preliminary explanation of this phenomenon from the perspective of model classification boundaries and observed that this pseudo-deletion had advantages over direct deletion in the data debiasing problem. Based on the above findings, we proposed Debiasing Backdoor Attack (DBA). It achieves SOTA in the debiasing task and has a broader application scenario than undersampling.


title: MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learned

abstract: Reinforcement learning competitions advance the field by providing appropriate scope and support to develop solutions toward a specific problem. To promote the development of more broadly applicable methods, organizers need to enforce the use of general techniques, the use of sample-efficient methods, and the reproducibility of the results. While beneficial for the research community, these restrictions come at a cost -- increased difficulty. If the barrier for entry is too high, many potential participants are demoralized. With this in mind, we hosted the third edition of the MineRL ObtainDiamond competition, MineRL Diamond 2021, with a separate track in which we permitted any solution to promote the participation of newcomers. With this track and more extensive tutorials and support, we saw an increased number of submissions. The participants of this easier track were able to obtain a diamond, and the participants of the harder track progressed the generalizable solutions in the same task.


title: DeepSketch: A New Machine Learning-Based Reference Search Technique for Post-Deduplication Delta Compression

abstract: Data reduction in storage systems is becoming increasingly important as an effective solution to minimize the management cost of a data center. To maximize data-reduction efficiency, existing post-deduplication delta-compression techniques perform delta compression along with traditional data deduplication and lossless compression. Unfortunately, we observe that existing techniques achieve significantly lower data-reduction ratios than the optimal due to their limited accuracy in identifying similar data blocks. In this paper, we propose DeepSketch, a new reference search technique for post-deduplication delta compression that leverages the learning-to-hash method to achieve higher accuracy in reference search for delta compression, thereby improving data-reduction efficiency. DeepSketch uses a deep neural network to extract a data block's sketch, i.e., to create an approximate data signature of the block that can preserve similarity with other blocks. Our evaluation using eleven real-world workloads shows that DeepSketch improves the data-reduction ratio by up to 33% (21% on average) over a state-of-the-art post-deduplication delta-compression technique.


title: Variational Neural Temporal Point Process

abstract: A temporal point process is a stochastic process that predicts which type of events is likely to happen and when the event will occur given a history of a sequence of events. There are various examples of occurrence dynamics in the daily life, and it is important to train the temporal dynamics and solve two different prediction problems, time and type predictions. Especially, deep neural network based models have outperformed the statistical models, such as Hawkes processes and Poisson processes. However, many existing approaches overfit to specific events, instead of learning and predicting various event types. Therefore, such approaches could not cope with the modified relationships between events and fail to predict the intensity functions of temporal point processes very well. In this paper, to solve these problems, we propose a variational neural temporal point process (VNTPP). We introduce the inference and the generative networks, and train a distribution of latent variable to deal with stochastic property on deep neural network. The intensity functions are computed using the distribution of latent variable so that we can predict event types and the arrival times of the events more accurately. We empirically demonstrate that our model can generalize the representations of various event types. Moreover, we show quantitatively and qualitatively that our model outperforms other deep neural network based models and statistical processes on synthetic and real-world datasets.


title: Dynamic Relation Discovery and Utilization in Multi-Entity Time Series Forecasting

abstract: Time series forecasting plays a key role in a variety of domains. In a lot of real-world scenarios, there exist multiple forecasting entities (e.g. power station in the solar system, stations in the traffic system). A straightforward forecasting solution is to mine the temporal dependency for each individual entity through 1d-CNN, RNN, transformer, etc. This approach overlooks the relations between these entities and, in consequence, loses the opportunity to improve performance using spatial-temporal relation. However, in many real-world scenarios, beside explicit relation, there could exist crucial yet implicit relation between entities. How to discover the useful implicit relation between entities and effectively utilize the relations for each entity under various circumstances is crucial. In order to mine the implicit relation between entities as much as possible and dynamically utilize the relation to improve the forecasting performance, we propose an attentional multi-graph neural network with automatic graph learning (A2GNN) in this work. Particularly, a Gumbel-softmax based auto graph learner is designed to automatically capture the implicit relation among forecasting entities. We further propose an attentional relation learner that enables every entity to dynamically pay attention to its preferred relations. Extensive experiments are conducted on five real-world datasets from three different domains. The results demonstrate the effectiveness of A2GNN beyond several state-of-the-art methods.


title: Knowledge-informed Molecular Learning: A Survey on Paradigm Transfer

abstract: Machine learning, notably deep learning, has significantly propelled molecular investigations within the biochemical sphere. Traditionally, modeling for such research has centered around a handful of paradigms. For instance, the prediction paradigm is frequently deployed for tasks such as molecular property prediction. To enhance the generation and decipherability of purely data-driven models, scholars have integrated biochemical domain knowledge into these molecular study models. This integration has sparked a surge in paradigm transfer, which is solving one molecular learning task by reformulating it as another one. With the emergence of Large Language Models, these paradigms have demonstrated an escalating trend towards harmonized unification. In this work, we delineate a literature survey focused on knowledge-informed molecular learning from the perspective of paradigm transfer. We classify the paradigms, scrutinize their methodologies, and dissect the contribution of domain knowledge. Moreover, we encapsulate prevailing trends and identify intriguing avenues for future exploration in molecular learning.


title: Cyber Loss Model Risk Translates to Premium Mispricing and Risk Sensitivity

abstract: We focus on model risk and risk sensitivity when addressing the insurability of cyber risk. The standard statistical approaches to assessment of insurability and potential mispricing are enhanced in several aspects involving consideration of model risk. Model risk can arise from model uncertainty, and parameters uncertainty. We demonstrate how to quantify the effect of model risk in this analysis by incorporating various robust estimators for key model parameter estimates that apply in both marginal and joint cyber risk loss process modelling. We contrast these robust techniques with standard methods previously used in studying insurabilty of cyber risk. This allows us to accurately assess the critical impact that robust estimation can have on tail index estimation for heavy tailed loss models, as well as the effect of robust dependence analysis when quantifying joint loss models and insurance portfolio diversification. We argue that the choice of such methods is akin to a form of model risk and we study the risk sensitivity that arise from choices relating to the class of robust estimation adopted and the impact of the settings associated with such methods on key actuarial tasks such as premium calculation in cyber insurance. Through this analysis we are able to address the question that, to the best of our knowledge, no other study has investigated in the context of cyber risk: is model risk present in cyber risk data, and how does is it translate into premium mispricing? We believe our findings should complement existing studies seeking to explore insurability of cyber losses. In order to ensure our findings are based on realistic industry informed loss data, we have utilised one of the leading industry cyber loss datasets obtained from Advisen, which represents a comprehensive data set on cyber monetary losses, from which we form our analysis and conclusions.


title: Off-Policy Confidence Interval Estimation with Confounded Markov Decision Process

abstract: This paper is concerned with constructing a confidence interval for a target policy's value offline based on a pre-collected observational data in infinite horizon settings. Most of the existing works assume no unmeasured variables exist that confound the observed actions. This assumption, however, is likely to be violated in real applications such as healthcare and technological industries. In this paper, we show that with some auxiliary variables that mediate the effect of actions on the system dynamics, the target policy's value is identifiable in a confounded Markov decision process. Based on this result, we develop an efficient off-policy value estimator that is robust to potential model misspecification and provide rigorous uncertainty quantification. Our method is justified by theoretical results, simulated and real datasets obtained from ridesharing companies. A Python implementation of the proposed procedure is available at https://github.com/Mamba413/cope.


title: Online Caching with Optimistic Learning

abstract: The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for tackling this problem through the lens of optimistic online learning. We build upon the Follow-the-Regularized-Leader (FTRL) framework which is developed further here to include predictions for the file requests, and we design online caching algorithms for bipartite networks with fixed-size caches or elastic leased caches subject to time-average budget constraints. The predictions are provided by a content recommendation system that influences the users viewing activity, and hence can naturally reduce the caching network's uncertainty about future requests. We prove that the proposed optimistic learning caching policies can achieve sub-zero performance loss (regret) for perfect predictions, and maintain the best achievable regret bound $O(\sqrt T)$ even for arbitrary-bad predictions. The performance of the proposed algorithms is evaluated with detailed trace-driven numerical tests.


title: Weyl Laws for Open Quantum Maps

abstract: We find Weyl upper bounds for the quantum open baker's map in the semiclassical limit. For the number of eigenvalues in an annulus, we derive the asymptotic upper bound $\mathcal O(N^\delta)$ where $\delta$ is the dimension of the trapped set of the baker's map and $(2 \pi N)^{-1}$ is the semiclassical parameter, which improves upon the previous result of $\mathcal O(N^{\delta + \epsilon})$. Furthermore, we derive a Weyl upper bound with explicit dependence on the inner radius of the annulus for quantum open baker's maps with Gevrey cutoffs.


title: A Strong Minimum principle and Large Time Asymptotics for viscosity solutions to a class of doubly nonlinear possibly degenerate parabolic equations

abstract: We study a version of the strong minimum principle, and large time asymptotics of positive viscosity solutions to classes of doubly nonlinear parabolic equations of the form $$ H(Du,D^2u)-u^{k-1}u_t=0,\;\;k\geq 1,\quad\mbox{in $\Omega\times [0,T)$},$$ where $\Omega\subset \mathbb{R}^n$ is a bounded domain and $0<T\leq \infty$. The spatial operator $H$ is homogeneous with power $k$.


title: VADOI:Voice-Activity-Detection Overlapping Inference For End-to-end Long-form Speech Recognition

abstract: While end-to-end models have shown great success on the Automatic Speech Recognition task, performance degrades severely when target sentences are long-form. The previous proposed methods, (partial) overlapping inference are shown to be effective on long-form decoding. For both methods, word error rate (WER) decreases monotonically when overlapping percentage decreases. Setting aside computational cost, the setup with 50% overlapping during inference can achieve the best performance. However, a lower overlapping percentage has an advantage of fast inference speed. In this paper, we first conduct comprehensive experiments comparing overlapping inference and partial overlapping inference with various configurations. We then propose Voice-Activity-Detection Overlapping Inference to provide a trade-off between WER and computation cost. Results show that the proposed method can achieve a 20% relative computation cost reduction on Librispeech and Microsoft Speech Language Translation long-form corpus while maintaining the WER performance when comparing to the best performing overlapping inference algorithm. We also propose Soft-Match to compensate for similar words mis-aligned problem.