title: Supporting search engines with knowledge and context

abstract: Search engines leverage knowledge to improve information access. In order to effectively leverage knowledge, search engines should account for context, i.e., information about the user and query. In this thesis, we aim to support search engines in leveraging knowledge while accounting for context. In the first part of this thesis, we study how to make structured knowledge more accessible to the user when the search engine proactively provides such knowledge as context to enrich search results. As a first task, we study how to retrieve descriptions of knowledge facts from a text corpus. Next, we study how to automatically generate knowledge fact descriptions. And finally, we study how to contextualize knowledge facts, that is, to automatically find facts related to a query fact. In the second part of this thesis, we study how to improve interactive knowledge gathering. We focus on conversational search, where the user interacts with the search engine to gather knowledge over large unstructured knowledge repositories. We focus on multi-turn passage retrieval as an instance of conversational search. We propose to model query resolution as a term classification task and propose a method to address it. In the final part of this thesis, we focus on search engine support for professional writers in the news domain. We study how to support such writers create event-narratives by exploring knowledge from a corpus of news articles. We propose a dataset construction procedure for this task that relies on existing news articles to simulate incomplete narratives and relevant articles. We study the performance of multiple rankers, lexical and semantic, and provide insights into the characteristics of this task.


title: Feasibility Study of Microsecond Pulsed Microwave Ablation using a Minimally Invasive Antenna

abstract: In this study we established the feasibility of producing localized ablation zones using microsecond pulsed microwave ablation (MWA) as an alternative to conventional continuous wave (CW) MWA. We verified that a thin floating-sleeve dipole ablation probe can withstand pulsed power delivery with peak powers as high as 25 kW, with pulse widths on the order of 1 us. We conducted MWA experiments in egg white using CW and pulsed modes of operation and found that ablation zones achieved via pulsed MWA are comparable in dimension to those created via CW MWA when the average power and procedure duration are equivalent. Finally, we performed pulsed MWA experiments in bovine liver and confirmed that pulsed MWA consistently produces large, localized ablation zones and temperatures that exceed 100{\deg}C. Establishing the feasibility of pulsed MWA opens the opportunity for developing a coupled MWA treatment and imaging system using pulsed MWA and microwave-induced thermoacoustic signals for real-time monitoring of MWA.


title: Technical Challenges for Training Fair Neural Networks

abstract: As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To respond to these concerns, the community has proposed and formalized various notions of fairness as well as methods for rectifying unfair behavior. While fairness constraints have been studied extensively for classical models, the effectiveness of methods for imposing fairness on deep neural networks is unclear. In this paper, we observe that these large models overfit to fairness objectives, and produce a range of unintended and undesirable consequences. We conduct our experiments on both facial recognition and automated medical diagnosis datasets using state-of-the-art architectures.


title: Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learning

abstract: Data driven approaches for decision making applied to automated driving require appropriate generalization strategies, to ensure applicability to the world's variability. Current approaches either do not generalize well beyond the training data or are not capable to consider a variable number of traffic participants. Therefore we propose an invariant environment representation from the perspective of the ego vehicle. The representation encodes all necessary information for safe decision making. To assess the generalization capabilities of the novel environment representation, we train our agents on a small subset of scenarios and evaluate on the entire diverse set of scenarios. Here we show that the agents are capable to generalize successfully to unseen scenarios, due to the abstraction. In addition we present a simple occlusion model that enables our agents to navigate intersections with occlusions without a significant change in performance.


title: Electric field effect on the thermal conductivity of wurtzite GaN

abstract: Gallium nitride (GaN), a wide band-gap semiconductor, has been broadly used in power electronic devices due to its high electron mobility and high breakdown voltage. Its relatively high thermal conductivity makes GaN a favorable material for such applications, where heat dissipation is a major concern for device efficiency and long-term stability. However, in GaN-based transistors, where the active region can withstand extremely strong electric fields, the field effect on the thermal transport properties has drawn little attention so far. In this work, we apply first-principles methods to investigate phonon properties of wurtzite GaN in the presence of a near-breakdown electric field applied along different crystallographic directions. We find that the electric field changes thermal conductivity considerably via impacting the bond stiffness and ionicity as well as the crystal symmetry, although it has little effect on phonon dispersions. The presence of an out-of-plane electric field increases (decreases) the thermal conductivity parallel (perpendicular) to the electric field, which is attributed to different changes of the Ga-N bond stiffness and ionicity. When an in-plane electric field is applied, the sizable decrease of thermal conductivities along all directions is attributed to the crystal symmetry breaking that enhances the phonon-phonon scattering. Our study provides insights into the effect of extreme external electric fields on phonon transport properties in wide-gap semiconductors.


title: General Relativistic Neutrino-Driven Turbulence in One-Dimensional Core-Collapse Supernovae

abstract: Convection and turbulence in core-collapse supernovae (CCSNe) are inherently three-dimensional in nature. However, 3D simulations of CCSNe are computationally demanding. Thus, it is valuable to modify simulations in spherical symmetry to incorporate 3D effects using some parametric model. In this paper, we report on the formulation and implementation of general relativistic (GR) neutrino-driven turbulent convection in the spherically symmetric core-collapse supernova code \texttt{GR1D}. This is based upon the recently proposed method of Supernova Turbulence in Reduced-dimensionality (\textit{STIR}) in Newtonian simulations from \cite{Couch2020_STIR}. When the parameters of this model are calibrated to 3D simulations, we find that our GR formulation of \textit{STIR} requires larger turbulent eddies to achieve a shock evolution similar to the original \textit{STIR} model. We also find that general relativity may alter the correspondence between progenitor mass and successful vs.~failed explosions.


title: Persistent topology of protein space

abstract: Protein fold classification is a classic problem in structural biology and bioinformatics. We approach this problem using persistent homology. In particular, we use alpha shape filtrations to compare a topological representation of the data with a different representation that makes use of knot-theoretic ideas. We use the statistical method of Angle-based Joint and Individual Variation Explained (AJIVE) to understand similarities and differences between these representations.


title: The space-time Talbot effect

abstract: The Talbot effect, epitomized by periodic revivals of a freely evolving periodic field structure, has been observed with waves of diverse physical nature in space and separately in time, whereby diffraction underlies the former and dispersion the latter. To date, a combined spatio-temporal Talbot effect has not been realized in any wave field because diffraction and dispersion are independent physical phenomena, typically unfolding at incommensurable length scales. Here we report the observation of an optical 'space-time' Talbot effect, whereby a spatio-temporal optical lattice structure undergoes periodic revivals after suffering the impact of both diffraction and dispersion. The discovered space-time revivals are governed by a single self-imaging length scale, which encompasses both spatial and temporal degrees of freedom. Key to this effect is the identification of a unique pulsed optical field structure, which we refer to as a V-wave, that is endowed with intrinsically equal diffraction and dispersion lengths in free space, thereby enabling self-imaging to proceed in lockstep in space and time.


title: Statistical Power for Estimating Treatment Effects Using Difference-in-Differences and Comparative Interrupted Time Series Designs with Variation in Treatment Timing

abstract: This article develops new closed-form variance expressions for power analyses for commonly used difference-in-differences (DID) and comparative interrupted time series (CITS) panel data estimators. The main contribution is to incorporate variation in treatment timing into the analysis. The power formulas also account for other key design features that arise in practice: autocorrelated errors, unequal measurement intervals, and clustering due to the unit of treatment assignment. We consider power formulas for both cross-sectional and longitudinal models and allow for covariates. An illustrative power analysis provides guidance on appropriate sample sizes. The key finding is that accounting for treatment timing increases required sample sizes. Further, DID estimators have considerably more power than standard CITS and ITS estimators. An available Shiny R dashboard performs the sample size calculations for the considered estimators.


title: A look into homomorphisms between uniform algebras over a Hilbert space

abstract: We study the vector-valued spectrum $\mathcal{M}_{u,\infty}(B_{\ell_2},B_{\ell_2})$ which is the set of nonzero algebra homomorphisms from $\mathcal{A}_u(B_{\ell_2})$ (the algebra of uniformly continuous holomorphic functions on $B_{\ell_2}$) to $\mathcal {H}^\infty(B_{\ell_2})$ (the algebra of bounded holomorphic functions on $B_{\ell_2}$). This set is naturally projected onto the closed unit ball of $\mathcal {H}^\infty(B_{\ell_2}, \ell_2)$ giving rise to an associated fibering. Extending the classical notion of cluster sets introduced by I. J. Schark (1961) to the vector-valued spectrum we define vector-valued cluster sets. The aim of the article is to look at the relationship between fibers and cluster sets obtaining results regarding the existence of analytic balls into these sets.


title: Channel Estimation and Hybrid Combining for Wideband Terahertz Massive MIMO Systems

abstract: Terahertz (THz) communication is widely considered as a key enabler for future 6G wireless systems. However, THz links are subject to high propagation losses and inter-symbol interference due to the frequency selectivity of the channel. Massive multiple-input multiple-output (MIMO) along with orthogonal frequency division multiplexing (OFDM) can be used to deal with these problems. Nevertheless, when the propagation delay across the base station (BS) antenna array exceeds the symbol period, the spatial response of the BS array varies across the OFDM subcarriers. This phenomenon, known as beam squint, renders narrowband combining approaches ineffective. Additionally, channel estimation becomes challenging in the absence of combining gain during the training stage. In this work, we address the channel estimation and hybrid combining problems in wideband THz massive MIMO with uniform planar arrays. Specifically, we first introduce a low-complexity beam squint mitigation scheme based on true-time-delay. Next, we propose a novel variant of the popular orthogonal matching pursuit (OMP) algorithm to accurately estimate the channel with low training overhead. Our channel estimation and hybrid combining schemes are analyzed both theoretically and numerically. Moreover, the proposed schemes are extended to the multi-antenna user case. Simulation results are provided showcasing the performance gains offered by our design compared to standard narrowband combining and OMP-based channel estimation.


title: $C_5$ is almost a fractalizer

abstract: We determine the maximum number of induced copies of a 5-cycle in a graph on $n$ vertices for every $n$. Every extremal construction is a balanced iterated blow-up of the 5-cycle with the possible exception of the smallest level where for $n=8$, the M\"obius ladder achieves the same number of induced 5-cycles as the blow-up of a 5-cycle on 8 vertices. This result completes work of Balogh, Hu, Lidick\'y, and Pfender [Eur. J. Comb. 52 (2016)] who proved an asymptotic version of the result. Similarly to their result, we also use the flag algebra method but we extend its use to small graphs.


title: Presenting a Method for Improving Echo Hiding

abstract: In this article, one of the most important methods of steganography on VoIP called echo hiding is improved. This method has advantages in maintaining the statistical and perceptual characteristics of audio signals as well as security against the sensitivity of the human audio system (HAS). However, it has lots of errors in detecting coded and hidden messages, which is detectable using existing steganalysis methods. The percentage of extracting messages in these improved methods of echo hiding is high, but they lower the security of the method. In this article, a method is presented to improve the method of extracting echo hiding, and enhance its security through a combined method based on spread spectrum. To improve the extraction, a wrong hypothesis is corrected and substituted. To improve security using a pseudo-random key generation algorithm, spread spectrum and echo hiding methods are used randomly. To evaluate the proposed extraction, numerous extraction tests are carried out in the normal state and in the event of attacks. A steganalyser has also been used to assess security improvements. The results gained through different experiments on the security of steganography indicate a 3-percent increase in steganalysis errors. The proposed extraction method was modified based on the main method and resulted in more than 10% improvement.


title: Eigenvalue spectrum and scaling dimension of lattice $\mathcal{N} = 4$ supersymmetric Yang-Mills

abstract: We investigate the lattice regularization of $\mathcal{N} = 4$ supersymmetric Yang-Mills theory, by stochastically computing the eigenvalue mode number of the fermion operator. This provides important insight into the non-perturbative renormalization group flow of the lattice theory, through the definition of a scale-dependent effective mass anomalous dimension. While this anomalous dimension is expected to vanish in the conformal continuum theory, the finite lattice volume and lattice spacing generically lead to non-zero values, which we use to study the approach to the continuum limit. Our numerical results, comparing multiple lattice volumes, 't Hooft couplings, and numbers of colors, confirm convergence towards the expected continuum result, while quantifying the increasing significance of lattice artifacts at larger couplings.


title: $^{210}$Pb measurements at the Andr\'e E. Lalonde AMS Laboratory for the radioassay of materials used in rare event search detectors

abstract: Naturally occurring radionuclide $^{210}$Pb ($T_{1/2}$=22.2 y) is an important source of background in rare event searches, such as neutrinoless double-$\beta$ decay and dark matter direct detection experiments. When a sample mass of hundreds of grams is available, $\gamma$-counting measurements can be performed. However, there are other cases where only grams of sample can be used. For these cases, better sensitivities are required. In this paper, in collaboration with the Astroparticle Physics group at Carleton University, the capabilities of the A.E. Lalonde AMS Laboratory at the University of Ottawa for $^{210}$Pb measurements are discussed. PbF$_{2}$ and PbO targets were used, selecting in the low energy sector, respectively, (PbF$_{3}$)$^{-}$ or (PbO$_{2}$)$^{-}$ ions. For fluoride targets, the blank $^{210}$Pb/$^{206}$Pb ratio was in the 10$^{-14}$ to 10$^{-13}$ range, but current output was lower and less stable. For oxide targets, current output showed better stability, despite a significant difference in current output for commercial PbO and processed samples, and background studies suggested a background not much higher than that of the fluoride targets. Both target materials showed, therefore, good performance for $^{210}$Pb AMS assay. Measurements of Kapton films, an ultra-thin polymer material, where masses available are typically just several grams, were performed. 90% C.L. upper limits for the $^{210}$Pb specific activity in the range of 0.74-2.8 Bq/kg were established for several Kapton HN films.


title: INSTA-YOLO: Real-Time Instance Segmentation

abstract: Instance segmentation has gained recently huge attention in various computer vision applications. It aims at providing different IDs to different objects of the scene, even if they belong to the same class. Instance segmentation is usually performed as a two-stage pipeline. First, an object is detected, then semantic segmentation within the detected box area is performed which involves costly up-sampling. In this paper, we propose Insta-YOLO, a novel one-stage end-to-end deep learning model for real-time instance segmentation. Instead of pixel-wise prediction, our model predicts instances as object contours represented by 2D points in Cartesian space. We evaluate our model on three datasets, namely, Carvana,Cityscapes and Airbus. We compare our results to the state-of-the-art models for instance segmentation. The results show our model achieves competitive accuracy in terms of mAP at twice the speed on GTX-1080 GPU.


title: Distributed Event-Triggered Algorithms for Finite-Time Privacy-Preserving Quantized Average Consensus

abstract: In this paper, we consider the problem of privacy preservation in the average consensus problem when communication among nodes is quantized. More specifically, we consider a setting where some nodes in the network are curious but not malicious and they try to identify the initial states of other nodes based on the data they receive during their operation (without interfering in the computation in any other way), while some nodes in the network want to ensure that their initial states cannot be inferred exactly by the curious nodes. We propose two privacy-preserving event-triggered quantized average consensus algorithms that can be followed by any node wishing to maintain its privacy and not reveal the initial state it contributes to the average computation. Every node in the network (including the curious nodes) is allowed to execute a privacy-preserving algorithm or its underlying average consensus algorithm. Under certain topological conditions, both algorithms allow the nodes who adopt privacypreserving protocols to preserve the privacy of their initial quantized states and at the same time to obtain, after a finite number of steps, the exact average of the initial states.


title: Machine Learning for Mechanical Ventilation Control

abstract: We consider the problem of controlling an invasive mechanical ventilator for pressure-controlled ventilation: a controller must let air in and out of a sedated patient's lungs according to a trajectory of airway pressures specified by a clinician. Hand-tuned PID controllers and similar variants have comprised the industry standard for decades, yet can behave poorly by over- or under-shooting their target or oscillating rapidly. We consider a data-driven machine learning approach: First, we train a simulator based on data we collect from an artificial lung. Then, we train deep neural network controllers on these simulators.We show that our controllers are able to track target pressure waveforms significantly better than PID controllers. We further show that a learned controller generalizes across lungs with varying characteristics much more readily than PID controllers do.


title: Newton Method over Networks is Fast up to the Statistical Precision

abstract: We propose a distributed cubic regularization of the Newton method for solving (constrained) empirical risk minimization problems over a network of agents, modeled as undirected graph. The algorithm employs an inexact, preconditioned Newton step at each agent's side: the gradient of the centralized loss is iteratively estimated via a gradient-tracking consensus mechanism and the Hessian is subsampled over the local data sets. No Hessian matrices are thus exchanged over the network. We derive global complexity bounds for convex and strongly convex losses. Our analysis reveals an interesting interplay between sample and iteration/communication complexity: statistically accurate solutions are achievable in roughly the same number of iterations of the centralized cubic Newton method, with a communication cost per iteration of the order of $\widetilde{\mathcal{O}}\big(1/\sqrt{1-\rho}\big)$, where $\rho$ characterizes the connectivity of the network. This demonstrates a significant communication saving with respect to that of existing, statistically oblivious, distributed Newton-based methods over networks.


title: Topological Wannier excitons in bismuth chalcogenide nanosheets I: Single-particle properties

abstract: We analyze the topology and dispersion of bulk Wannier excitons in nanosheets of topological insulators in the family of bismuth chalcogenides. Our main finding is that excitons also inherit the topology of the electronic bands, quantified by the skyrmion winding numbers of the constituent electron and hole pseudospins as a function of the total exciton momentum. We furthermore show that every $s$-wave exciton state consists of a quartet with a degenerate and quadratically dispersing nonchiral doublet, and a chiral doublet with one linearly dispersing mode as in transition metal dichalcogenides. We also demonstrate the existence of topological edge states of chiral excitons arising from the bulk-boundary correspondence.


title: Q-Value Weighted Regression: Reinforcement Learning with Limited Data

abstract: Sample efficiency and performance in the offline setting have emerged as significant challenges of deep reinforcement learning. We introduce Q-Value Weighted Regression (QWR), a simple RL algorithm that excels in these aspects. QWR is an extension of Advantage Weighted Regression (AWR), an off-policy actor-critic algorithm that performs very well on continuous control tasks, also in the offline setting, but has low sample efficiency and struggles with high-dimensional observation spaces. We perform an analysis of AWR that explains its shortcomings and use these insights to motivate QWR. We show experimentally that QWR matches the state-of-the-art algorithms both on tasks with continuous and discrete actions. In particular, QWR yields results on par with SAC on the MuJoCo suite and - with the same set of hyperparameters - yields results on par with a highly tuned Rainbow implementation on a set of Atari games. We also verify that QWR performs well in the offline RL setting.


title: The Complexity of Transitively Orienting Temporal Graphs

abstract: In a temporal network with discrete time-labels on its edges, entities and information can only "flow" along sequences of edges whose time-labels are non-decreasing (resp. increasing), i.e. along temporal (resp. strict temporal) paths. Nevertheless, in the model for temporal networks of [Kempe et al., JCSS, 2002], the individual time-labeled edges remain undirected: an edge $e=\{u,v\}$ with time-label $t$ specifies that "$u$ communicates with $v$ at time $t$". This is a symmetric relation between $u$ and $v$, and it can be interpreted that the information can flow in either direction. In this paper we make a first attempt to understand how the direction of information flow on one edge can impact the direction of information flow on other edges. More specifically, we introduce the notion of a temporal transitive orientation and we systematically investigate its algorithmic behavior in various situations. An orientation of a temporal graph is called temporally transitive if, whenever $u$ has a directed edge towards $v$ with time-label $t_1$ and $v$ has a directed edge towards $w$ with time-label $t_2\geq t_1$, then $u$ also has a directed edge towards $w$ with some time-label $t_3\geq t_2$. If we just demand that this implication holds whenever $t_2 > t_1$, the orientation is called strictly temporally transitive. Our main result is a conceptually simple, yet technically quite involved, polynomial-time algorithm for recognizing whether a given temporal graph $\mathcal{G}$ is transitively orientable. In wide contrast we prove that, surprisingly, it is NP-hard to recognize whether $\mathcal{G}$ is strictly transitively orientable. Additionally we introduce and investigate further related problems to temporal transitivity, notably among them the temporal transitive completion problem, for which we prove both algorithmic and hardness results.


title: Sylow branching coefficients and a conjecture of Malle and Navarro

abstract: We prove that a finite group $G$ has a normal Sylow $p$-subgroup $P$ if, and only if, every irreducible character of $G$ appearing in the permutation character $({\bf 1}_P)^G$ with multiplicity coprime to $p$ has degree coprime to $p$. This confirms a prediction by Malle and Navarro from 2012. Our proof of the above result depends on a reduction to simple groups and ultimately on a combinatorial analysis of the properties of Sylow branching coefficients for symmetric groups.


title: Breakup of a Long-Period Comet as the Origin of the Dinosaur Extinction

abstract: The origin of the Chicxulub impactor, which is attributed as the cause of the K/T mass extinction event, is an unsolved puzzle. The background impact rates of main-belt asteroids and long-period comets have been previously dismissed as being too low to explain the Chicxulub impact event. Here, we show that a fraction of long-period comets are tidally disrupted after passing close to the Sun, each producing a collection of smaller fragments that cross the orbit of Earth. This population could increase the impact rate of long-period comets capable of producing Chicxulub impact events by an order of magnitude. This new rate would be consistent with the age of the Chicxulub impact crater, thereby providing a satisfactory explanation for the origin of the impactor. Our hypothesis explains the composition of the largest confirmed impact crater in Earth's history as well as the largest one within the last million years. It predicts a larger proportion of impactors with carbonaceous chondritic compositions than would be expected from meteorite falls of main-belt asteroids.


title: ordpy: A Python package for data analysis with permutation entropy and ordinal network methods

abstract: Since Bandt and Pompe's seminal work, permutation entropy has been used in several applications and is now an essential tool for time series analysis. Beyond becoming a popular and successful technique, permutation entropy inspired a framework for mapping time series into symbolic sequences that triggered the development of many other tools, including an approach for creating networks from time series known as ordinal networks. Despite the increasing popularity, the computational development of these methods is fragmented, and there were still no efforts focusing on creating a unified software package. Here we present ordpy, a simple and open-source Python module that implements permutation entropy and several of the principal methods related to Bandt and Pompe's framework to analyze time series and two-dimensional data. In particular, ordpy implements permutation entropy, Tsallis and R\'enyi permutation entropies, complexity-entropy plane, complexity-entropy curves, missing ordinal patterns, ordinal networks, and missing ordinal transitions for one-dimensional (time series) and two-dimensional (images) data as well as their multiscale generalizations. We review some theoretical aspects of these tools and illustrate the use of ordpy by replicating several literature results.


title: High Order Control Lyapunov-Barrier Functions for Temporal Logic Specifications

abstract: Recent work has shown that stabilizing an affine control system to a desired state while optimizing a quadratic cost subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control Barrier Functions (CBFs) and Control Lyapunov Functions (CLFs). In our own recent work, we defined High Order CBFs (HOCBFs) for systems and constraints with arbitrary relative degrees. In this paper, in order to accommodate initial states that do not satisfy the state constraints and constraints with arbitrary relative degree, we generalize HOCBFs to High Order Control Lyapunov-Barrier Functions (HOCLBFs). We also show that the proposed HOCLBFs can be used to guarantee the Boolean satisfaction of Signal Temporal Logic (STL) formulae over the state of the system. We illustrate our approach on a safety-critical optimal control problem (OCP) for a unicycle.


title: They, Them, Theirs: Rewriting with Gender-Neutral English

abstract: Responsible development of technology involves applications being inclusive of the diverse set of users they hope to support. An important part of this is understanding the many ways to refer to a person and being able to fluently change between the different forms as needed. We perform a case study on the singular they, a common way to promote gender inclusion in English. We define a re-writing task, create an evaluation benchmark, and show how a model can be trained to produce gender-neutral English with <1% word error rate with no human-labeled data. We discuss the practical applications and ethical considerations of the task, providing direction for future work into inclusive natural language systems.


title: Spatial Interpolation-based Learned Index for Range and kNN Queries

abstract: A corpus of recent work has revealed that the learned index can improve query performance while reducing the storage overhead. It potentially offers an opportunity to address the spatial query processing challenges caused by the surge in location-based services. Although several learned indexes have been proposed to process spatial data, the main idea behind these approaches is to utilize the existing one-dimensional learned models, which requires either converting the spatial data into one-dimensional data or applying the learned model on individual dimensions separately. As a result, these approaches cannot fully utilize or take advantage of the information regarding the spatial distribution of the original spatial data. To this end, in this paper, we exploit it by using the spatial (multi-dimensional) interpolation function as the learned model, which can be directly employed on the spatial data. Specifically, we design an efficient SPatial inteRpolation functIon based Grid index (SPRIG) to process the range and kNN queries. Detailed experiments are conducted on real-world datasets, and the results indicate that our proposed learned index can significantly improve the performance in comparison with the traditional spatial indexes and a state-of-the-art multi-dimensional learned index.


title: A Unified Lottery Ticket Hypothesis for Graph Neural Networks

abstract: With graphs rapidly growing in size and deeper graph neural networks (GNNs) emerging, the training and inference of GNNs become increasingly expensive. Existing network weight pruning algorithms cannot address the main space and computational bottleneck in GNNs, caused by the size and connectivity of the graph. To this end, this paper first presents a unified GNN sparsification (UGS) framework that simultaneously prunes the graph adjacency matrix and the model weights, for effectively accelerating GNN inference on large-scale graphs. Leveraging this new tool, we further generalize the recently popular lottery ticket hypothesis to GNNs for the first time, by defining a graph lottery ticket (GLT) as a pair of core sub-dataset and sparse sub-network, which can be jointly identified from the original GNN and the full dense graph by iteratively applying UGS. Like its counterpart in convolutional neural networks, GLT can be trained in isolation to match the performance of training with the full model and graph, and can be drawn from both randomly initialized and self-supervised pre-trained GNNs. Our proposal has been experimentally verified across various GNN architectures and diverse tasks, on both small-scale graph datasets (Cora, Citeseer and PubMed), and large-scale datasets from the challenging Open Graph Benchmark (OGB). Specifically, for node classification, our found GLTs achieve the same accuracies with 20%~98% MACs saving on small graphs and 25%~85% MACs saving on large ones. For link prediction, GLTs lead to 48%~97% and 70% MACs saving on small and large graph datasets, respectively, without compromising predictive performance. Codes available at https://github.com/VITA-Group/Unified-LTH-GNN.


title: Wrapped sheaves

abstract: We construct a sheaf-theoretic analogue of the wrapped Fukaya category in Lagrangian Floer theory, by localizing a category of sheaves microsupported away from some given $\Lambda \subset S^*M$ along continuation maps constructed using the Guillermou-Kashiwara-Schapira sheaf quantization. When $\Lambda$ is a subanalytic singular isotropic, we also construct a comparison map to the category of compact objects in the category of unbounded sheaves microsupported in $\Lambda$, and show that it is an equivalence. The last statement can be seen as a sheaf theoretical incarnation of the sheaf-Fukaya comparison theorem of Ganatra-Pardon-Shende.


title: VIPPrint: A Large Scale Dataset of Printed and Scanned Images for Synthetic Face Images Detection and Source Linking

abstract: The possibility of carrying out a meaningful forensics analysis on printed and scanned images plays a major role in many applications. First of all, printed documents are often associated with criminal activities, such as terrorist plans, child pornography pictures, and even fake packages. Additionally, printing and scanning can be used to hide the traces of image manipulation or the synthetic nature of images, since the artifacts commonly found in manipulated and synthetic images are gone after the images are printed and scanned. A problem hindering research in this area is the lack of large scale reference datasets to be used for algorithm development and benchmarking. Motivated by this issue, we present a new dataset composed of a large number of synthetic and natural printed face images. To highlight the difficulties associated with the analysis of the images of the dataset, we carried out an extensive set of experiments comparing several printer attribution methods. We also verified that state-of-the-art methods to distinguish natural and synthetic face images fail when applied to print and scanned images. We envision that the availability of the new dataset and the preliminary experiments we carried out will motivate and facilitate further research in this area.


title: Unanswerable Questions about Images and Texts

abstract: Questions about a text or an image that cannot be answered raise distinctive issues for an AI. This note discusses the problem of unanswerable questions in VQA (visual question answering), in QA (visual question answering), and in AI generally.


title: Extending Lagrangian and Hamiltonian Neural Networks with Differentiable Contact Models

abstract: The incorporation of appropriate inductive bias plays a critical role in learning dynamics from data. A growing body of work has been exploring ways to enforce energy conservation in the learned dynamics by encoding Lagrangian or Hamiltonian dynamics into the neural network architecture. These existing approaches are based on differential equations, which do not allow discontinuity in the states and thereby limit the class of systems one can learn. However, in reality, most physical systems, such as legged robots and robotic manipulators, involve contacts and collisions, which introduce discontinuities in the states. In this paper, we introduce a differentiable contact model, which can capture contact mechanics: frictionless/frictional, as well as elastic/inelastic. This model can also accommodate inequality constraints, such as limits on the joint angles. The proposed contact model extends the scope of Lagrangian and Hamiltonian neural networks by allowing simultaneous learning of contact and system properties. We demonstrate this framework on a series of challenging 2D and 3D physical systems with different coefficients of restitution and friction. The learned dynamics can be used as a differentiable physics simulator for downstream gradient-based optimization tasks, such as planning and control.


title: Invariant measures for interval maps without Lyapunov exponents

abstract: We construct an invariant measure for a piecewise analytic interval map whose Lyapunov exponent is not defined. Moreover, for a set of full measure, the pointwise Lyapunov exponent is not defined. This map has a Lorenz-like singularity and non-flat critical points.


title: An accreting stellar binary model for active periodic fast radio bursts

abstract: In this work, we propose an accreting stellar binary model for understanding the active periodic fast radio bursts (FRBs). The system consists of a stellar compact object (CO) and a donor star (DS) companion in an eccentric orbit, where the DS fills its own Roche lobe near the periastron. The CO accretes the material from the DS and then drive relativistic magnetic blobs. The interaction between the magnetic blobs and the stellar wind of the DS produces a pair of shocks. We find that both of the reverse shock and the forward shock are likely to produce FRBs via synchrotron maser mechanism. We show that this system can in principle sufficiently produce highly active FRBs with a long lifetime, and also can naturally explain the periodicity and the duty cycle of the activity as appeared in FRBs 180916 and 121102. The radio nebula excited by the long-term injection of magnetic blobs into the surrounding environment may account for the associated persistent radio source. In addiction, we discuss the possible multi-wavelength counterparts of FRB 180916 in the context of this model. Finally, we encourage the search for FRBs in the ultraluminous X-ray sources.


title: Hadronic resonance production and interaction in p-Pb collisions at LHC energies in EPOS3

abstract: Using the EPOS3 model with UrQMD to describe the hadronic phase, we study the production of short-lived hadronic resonances and the modification of their yields and $p_{T}$ spectra in p-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV. High-multiplicity p-Pb collisions exhibit similar behavior to mid-peripheral Pb-Pb collisions at LHC energies, and we find indications of a short-lived hadronic phase in p-Pb collisions that can modify resonance yields and $p_{T}$ spectra through scattering processes. The evolution of resonance production is investigated as a function of the system size, which is related to the lifetime of the hadronic phase, in order to study the onset of collective effects in p-Pb collisions. We also study hadron production separately in the core and corona parts of these collisions, and explore how this division affects the total particle yields as the system size increases.


title: Co-lexicographically Ordering Automata and Regular Languages -- Part II

abstract: In the present work, we tackle the regular language indexing problem by first studying the hierarchy of $p$-sortable languages: regular languages accepted by automata of width $p$. We show that the hierarchy is strict and does not collapse, and provide (exponential in $p$) upper and lower bounds relating the minimum widths of equivalent NFAs and DFAs. Our bounds indicate the importance of being able to index NFAs, as they enable indexing regular languages with much faster and smaller indexes. Our second contribution solves precisely this problem, optimally: we devise a polynomial-time algorithm that indexes any NFA with the optimal value $p$ for its width, without explicitly computing $p$ (NP-hard to find). In particular, this implies that we can index in polynomial time the well-studied case $p=1$ (Wheeler NFAs). More in general, in polynomial time we can build an index breaking the worst-case conditional lower bound of $\Omega(|P| m)$, whenever the input NFA's width is $p \in o(\sqrt{m})$.


title: Boundary electromagnetic duality from homological edge modes

abstract: Recent years have seen a renewed interest in using `edge modes' to extend the pre-symplectic structure of gauge theory on manifolds with boundaries. Here we further the investigation undertaken in \cite{FP2018} by using the formalism of homotopy pullback and Deligne-Beilinson cohomology to describe an electromagnetic (EM) duality on the boundary of $M=B^{3}\times\mathbb{R}$. Upon breaking a generalized global symmetry, the duality is implemented by a BF-like topological boundary term. We then introduce Wilson line singularities on $\partial M$ and show that these induce the existence of dual edge modes, which we identify as connections over a $\left(-1\right)$-gerbe. We derive the pre-symplectic structure that yields the central charge in \cite{FP2018} and show that the central charge is related to a non-trivial class of the $\left(-1\right)$-gerbe.


title: Reinforcement Learning For Data Poisoning on Graph Neural Networks

abstract: Adversarial Machine Learning has emerged as a substantial subfield of Computer Science due to a lack of robustness in the models we train along with crowdsourcing practices that enable attackers to tamper with data. In the last two years, interest has surged in adversarial attacks on graphs yet the Graph Classification setting remains nearly untouched. Since a Graph Classification dataset consists of discrete graphs with class labels, related work has forgone direct gradient optimization in favor of an indirect Reinforcement Learning approach. We will study the novel problem of Data Poisoning (training time) attack on Neural Networks for Graph Classification using Reinforcement Learning Agents.


title: Stochastic Convergence Rates and Applications of Adaptive Quadrature in Bayesian Inference

abstract: We provide the first stochastic convergence rates for a family of adaptive quadrature rules used to normalize the posterior distribution in Bayesian models. Our results apply to the uniform relative error in the approximate posterior density, the coverage probabilities of approximate credible sets, and approximate moments and quantiles, therefore guaranteeing fast asymptotic convergence of approximate summary statistics used in practice. The family of quadrature rules includes adaptive Gauss-Hermite quadrature, and we apply this rule in two challenging low-dimensional examples. Further, we demonstrate how adaptive quadrature can be used as a crucial component of a modern approximate Bayesian inference procedure for high-dimensional additive models. The method is implemented and made publicly available in the aghq package for the R language, available on CRAN.


title: Blind stain separation using model-aware generative learning and its applications on fluorescence microscopy images

abstract: Multiple stains are usually used to highlight biological substances in biomedical image analysis. To decompose multiple stains for co-localization quantification, blind source separation is usually performed. Prior model-based stain separation methods usually rely on stains' spatial distributions over an image and may fail to solve the co-localization problem. With the advantage of machine learning, deep generative models are used for this purpose. Since prior knowledge of imaging models is ignored in purely data-driven solutions, these methods may be sub-optimal. In this study, a novel learning-based blind source separation framework is proposed, where the physical model of biomedical imaging is incorporated to regularize the learning process. The introduced model-relevant adversarial loss couples all generators in the framework and limits the capacities of the generative models. Further more, a training algorithm is innovated for the proposed framework to avoid inter-generator confusion during learning. This paper particularly takes fluorescence unmixing in fluorescence microscopy images as an application example of the proposed framework. Qualitative and quantitative experimentation on a public fluorescence microscopy image set demonstrates the superiority of the proposed method over both prior model-based approaches and learning-based methods.


title: Accurate Determination of an alkali-inert gas diffusion coefficient using coherent transient emission from a density grating

abstract: We demonstrate a new technique for the accurate measurement of diffusion coefficients for alkali vapor in an inert buffer gas. The measurement was performed by establishing a spatially periodic density grating in isotopically pure $^{87}$Rb vapor and observing the decaying coherent emission from the grating due to the diffusive motion of the vapor through N$_2$ buffer gas. We obtain a diffusion coefficient of $0.245 \pm0.002 ~\textrm{cm}^{2}/\textrm{s}$ at 50$\degree$C and 564~Torr. Scaling to atmospheric pressure, we obtain $D_0 = 0.1819 \pm 0.0024~\textrm{cm}^2/\textrm{s}$. To the best of our knowledge, this represents the most accurate determination of the Rb--N$_2$ diffusion coefficient to date. Our measurements can be extended to different buffer gases and alkali vapors used for magnetometry and can be used to constrain theoretical diffusion models for these systems.


title: Asynchronous Gossip in Smartphone Peer-to-Peer Networks

abstract: In this paper, we study gossip algorithms in communication models that describe the peer-to-peer networking functionality included in most standard smartphone operating systems. We begin by describing and analyzing a new synchronous gossip algorithm in this setting that features both a faster round complexity and simpler operation than the best-known existing solutions. We also prove a new lower bound on the rounds required to solve gossip that resolves a minor open question by establishing that existing synchronous solutions are within logarithmic factors of optimal. We then adapt our synchronous algorithm to produce a novel gossip strategy for an asynchronous model that directly captures the interface of a standard smartphone peer-to-peer networking library (enabling algorithms described in this model to be easily implemented on real phones). Using new analysis techniques, we prove that this asynchronous strategy efficiently solves gossip. This is the first known efficient asynchronous information dissemination result for the smartphone peer-to-peer setting. We argue that our new strategy can be used to implement effective information spreading subroutines in real world smartphone peer-to-peer network applications, and that the analytical tools we developed to analyze it can be leveraged to produce other broadly useful algorithmic strategies for this increasingly important setting.


title: The Structure of Minimum Vertex Cuts

abstract: In this paper we continue a long line of work on representing the cut structure of graphs. We classify the types minimum vertex cuts, and the possible relationships between multiple minimum vertex cuts. As a consequence of these investigations, we exhibit a simple $O(\kappa n)$-space data structure that can quickly answer pairwise $(\kappa+1)$-connectivity queries in a $\kappa$-connected graph. We also show how to compute the "closest" $\kappa$-cut to every vertex in near linear $\tilde{O}(m+poly(\kappa)n)$ time.


title: Parameter-free Locally Accelerated Conditional Gradients

abstract: Projection-free conditional gradient (CG) methods are the algorithms of choice for constrained optimization setups in which projections are often computationally prohibitive but linear optimization over the constraint set remains computationally feasible. Unlike in projection-based methods, globally accelerated convergence rates are in general unattainable for CG. However, a very recent work on Locally accelerated CG (LaCG) has demonstrated that local acceleration for CG is possible for many settings of interest. The main downside of LaCG is that it requires knowledge of the smoothness and strong convexity parameters of the objective function. We remove this limitation by introducing a novel, Parameter-Free Locally accelerated CG (PF-LaCG) algorithm, for which we provide rigorous convergence guarantees. Our theoretical results are complemented by numerical experiments, which demonstrate local acceleration and showcase the practical improvements of PF-LaCG over non-accelerated algorithms, both in terms of iteration count and wall-clock time.


title: Learning Software Quality Assurance with Bricks

abstract: Software Quality Assurance (SQA) and Software Process Improvement (SPI) are topics of crucial importance for software engineers; however, teaching them in a lecture room comes with several limitations due to lack of practical experience. With that in mind, we created KUALI-Brick, a LEGO(R)-based activity that brings SQA and SPI concepts together applying them in order to successfully build a LEGO city. This hands-on activity has been carried out in a fourth-year Software Engineering course at the University of Canterbury, with current results showing high levels of fun, increased engagement and an improved learning experience. We present a step-by-step guide to replicate the activity as well as lessons learned after conducting the activity for three consecutive years.


title: Planning and Learning Using Adaptive Entropy Tree Search

abstract: Recent breakthroughs in Artificial Intelligence have shown that the combination of tree-based planning with deep learning can lead to superior performance. We present Adaptive Entropy Tree Search (ANTS) - a novel algorithm combining planning and learning in the maximum entropy paradigm. Through a comprehensive suite of experiments on the Atari benchmark we show that ANTS significantly outperforms PUCT, the planning component of the state-of-the-art AlphaZero system. ANTS builds upon recent work on maximum entropy planning methods - which however, as we show, fail in combination with learning. ANTS resolves this issue to reach state-of-the-art performance. We further find that ANTS exhibits superior robustness to different hyperparameter choices, compared to the previous algorithms. We believe that the high performance and robustness of ANTS can bring tree search planning one step closer to wide practical adoption.


title: From perspective maps to epigraphical projections

abstract: The projection onto the epigraph or a level set of a closed proper convex function can be achieved by finding a root of a scalar equation that involves the proximal operator as a function of the proximal parameter. This paper develops the variational analysis of this scalar equation. The approach is based on a study of the variational-analytic properties of general convex optimization problems that are (partial) infimal projections of the the sum of the function in question and the perspective map of a convex kernel. When the kernel is the Euclidean norm squared, the solution map corresponds to the proximal map, and thus the variational properties derived for the general case apply to the proximal case. Properties of the value function and the corresponding solution map -- including local Lipschitz continuity, directional differentiability, and semismoothness -- are derived. An SC$^1$ optimization framework for computing epigraphical and level-set projections is thus established. Numerical experiments on 1-norm projection illustrate the effectiveness of the approach as compared with specialized algorithms


title: Understanding self-supervised Learning Dynamics without Contrastive Pairs

abstract: While contrastive approaches of self-supervised learning (SSL) learn representations by minimizing the distance between two augmented views of the same data point (positive pairs) and maximizing views from different data points (negative pairs), recent \emph{non-contrastive} SSL (e.g., BYOL and SimSiam) show remarkable performance {\it without} negative pairs, with an extra learnable predictor and a stop-gradient operation. A fundamental question arises: why do these methods not collapse into trivial representations? We answer this question via a simple theoretical study and propose a novel approach, DirectPred, that \emph{directly} sets the linear predictor based on the statistics of its inputs, without gradient training. On ImageNet, it performs comparably with more complex two-layer non-linear predictors that employ BatchNorm and outperforms a linear predictor by $2.5\%$ in 300-epoch training (and $5\%$ in 60-epoch). DirectPred is motivated by our theoretical study of the nonlinear learning dynamics of non-contrastive SSL in simple linear networks. Our study yields conceptual insights into how non-contrastive SSL methods learn, how they avoid representational collapse, and how multiple factors, like predictor networks, stop-gradients, exponential moving averages, and weight decay all come into play. Our simple theory recapitulates the results of real-world ablation studies in both STL-10 and ImageNet. Code is released https://github.com/facebookresearch/luckmatters/tree/master/ssl.


title: Intrinsic fractional noise in nanopores: The effect of reservoirs

abstract: Fluctuations affect nanoporous transport in complex and intricate ways, making optimization of signal-to-noise in artificial designs challenging. Here we focus on the simplest nanopore system, where non-interacting particles diffuse through a pore separating reservoirs. We find that the concentration difference between both sides (akin to the osmotic pressure drop) exhibits fractional noise in time $t$ with mean square average that grows as $t^{1/2}$. This originates from the diffusive exchange of particles from one region to another. We fully rationalize this effect, with particle simulations and analytic solutions. We further infer the parameters (pore radius, pore thickness) that control this exotic behavior. As a consequence, we show that the number of particles within the pore also exhibits fractional noise. Such fractional noise is responsible for noise spectral density scaling as $1/f^{3/2}$ with frequency $f$, and we quantify its amplitude. Our theoretical approach is applicable to more complex nanoporous systems (for example with adsorption within the pore) and drastically simplifies both particle simulations and analytic calculus.


title: Polariton lasing and energy-degenerate parametric scattering in non-resonantly driven coupled planar microcavities

abstract: Multi-level exciton-polariton systems offer an attractive platform for studies of non-linear optical phenomena. However, studies of such consequential non-linear phenomena as polariton condensation and lasing in planar microcavities have so far been limited to two-level systems, where the condensation takes place in the lowest attainable state. Here, we report non-equilibrium Bose-Einstein condensation of exciton-polaritons and low threshold, dual-wavelength polariton lasing in vertically coupled, double planar microcavities. Moreover, we find that the presence of the non-resonantly driven condensate triggers interbranch exciton-polariton transfer in the form of energy-degenerate parametric scattering. Such an effect has so far been observed only under excitation that is strictly resonant in terms of the energy and incidence angle. We describe theoretically our time-integrated and time-resolved photoluminescence investigations by a set of rate equations involving an open-dissipative Gross-Pitaevskii equation. Our platform's inherent tunability is promising for construction of planar lattices, enabling three-dimensional polariton hopping and realization of photonic devices, such as two-qubit polariton-based logic gates.


title: Empirical performance bounds for quantum approximate optimization

abstract: The quantum approximate optimization algorithm (QAOA) is a variational method for noisy, intermediate-scale quantum computers to solve combinatorial optimization problems. Quantifying performance bounds with respect to specific problem instances provides insight into when QAOA may be viable for solving real-world applications. Here, we solve every instance of MaxCut on non-isomorphic unweighted graphs with nine or fewer vertices by numerically simulating the pure-state dynamics of QAOA. Testing up to three layers of QAOA depth, we find that distributions of the approximation ratio narrow with increasing depth while the probability of recovering the maximum cut generally broadens. We find QAOA exceeds the Goemans-Williamson approximation ratio bound for most graphs. We also identify consistent patterns within the ensemble of optimized variational circuit parameters that offer highly efficient heuristics for solving MaxCut with QAOA. The resulting data set is presented as a benchmark for establishing empirical bounds on QAOA performance that may be used to test on-going experimental realizations.


title: Efficient Selection Between Hierarchical Cognitive Models: Cross-validation With Variational Bayes

abstract: Model comparison is the cornerstone of theoretical progress in psychological research. Common practice overwhelmingly relies on tools that evaluate competing models by balancing in-sample descriptive adequacy against model flexibility, with modern approaches advocating the use of marginal likelihood for hierarchical cognitive models. Cross-validation is another popular approach but its implementation has remained out of reach for cognitive models evaluated in a Bayesian hierarchical framework, with the major hurdle being prohibitive computational cost. To address this issue, we develop novel algorithms that make variational Bayes (VB) inference for hierarchical models feasible and computationally efficient for complex cognitive models of substantive theoretical interest. It is well known that VB produces good estimates of the first moments of the parameters which gives good predictive densities estimates. We thus develop a novel VB algorithm with Bayesian prediction as a tool to perform model comparison by cross-validation, which we refer to as CVVB. In particular, the CVVB can be used as a model screening device that quickly identifies bad models. We demonstrate the utility of CVVB by revisiting a classic question in decision making research: what latent components of processing drive the ubiquitous speed-accuracy tradeoff? We demonstrate that CVVB strongly agrees with model comparison via marginal likelihood yet achieves the outcome in much less time. Our approach brings cross-validation within reach of theoretically important psychological models, and makes it feasible to compare much larger families of hierarchically specified cognitive models than has previously been possible.


title: Exploring Classic and Neural Lexical Translation Models for Information Retrieval: Interpretability, Effectiveness, and Efficiency Benefits

abstract: We study the utility of the lexical translation model (IBM Model 1) for English text retrieval, in particular, its neural variants that are trained end-to-end. We use the neural Model1 as an aggregator layer applied to context-free or contextualized query/document embeddings. This new approach to design a neural ranking system has benefits for effectiveness, efficiency, and interpretability. Specifically, we show that adding an interpretable neural Model 1 layer on top of BERT-based contextualized embeddings (1) does not decrease accuracy and/or efficiency; and (2) may overcome the limitation on the maximum sequence length of existing BERT models. The context-free neural Model 1 is less effective than a BERT-based ranking model, but it can run efficiently on a CPU (without expensive index-time precomputation or query-time operations on large tensors). Using Model 1 we produced best neural and non-neural runs on the MS MARCO document ranking leaderboard in late 2020.


title: Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR

abstract: We present a bidirectional unsupervised model pre-training (UPT) method and apply it to children's automatic speech recognition (ASR). An obstacle to improving child ASR is the scarcity of child speech databases. A common approach to alleviate this problem is model pre-training using data from adult speech. Pre-training can be done using supervised (SPT) or unsupervised methods, depending on the availability of annotations. Typically, SPT performs better. In this paper, we focus on UPT to address the situations when pre-training data are unlabeled. Autoregressive predictive coding (APC), a UPT method, predicts frames from only one direction, limiting its use to uni-directional pre-training. Conventional bidirectional UPT methods, however, predict only a small portion of frames. To extend the benefits of APC to bi-directional pre-training, Bi-APC is proposed. We then use adaptation techniques to transfer knowledge learned from adult speech (using the Librispeech corpus) to child speech (OGI Kids corpus). LSTM-based hybrid systems are investigated. For the uni-LSTM structure, APC obtains similar WER improvements to SPT over the baseline. When applied to BLSTM, however, APC is not as competitive as SPT, but our proposed Bi-APC has comparable improvements to SPT.


title: Fast Non-Asymptotic Testing And Support Recovery For Large Sparse Toeplitz Covariance Matrices

abstract: We consider $n$ independent $p$-dimensional Gaussian vectors with covariance matrix having Toeplitz structure. We test that these vectors have independent components against a stationary distribution with sparse Toeplitz covariance matrix, and also select the support of non-zero entries. We assume that the non-zero values can occur in the recent past (time-lag less than $p/2$). We build test procedures that combine a sum and a scan-type procedures, but are computationally fast, and show their non-asymptotic behaviour in both one-sided (only positive correlations) and two-sided alternatives, respectively. We also exhibit a selector of significant lags and bound the Hamming-loss risk of the estimated support. These results can be extended to the case of nearly Toeplitz covariance structure and to sub-Gaussian vectors. Numerical results illustrate the excellent behaviour of both test procedures and support selectors - larger the dimension $p$, faster are the rates.


title: Smoothed-adaptive perturbed inverse iteration for elliptic eigenvalue problems

abstract: We present a perturbed subspace iteration algorithm to approximate the lowermost eigenvalue cluster of an elliptic eigenvalue problem. As a prototype, we consider the Laplace eigenvalue problem posed in a polygonal domain. The algorithm is motivated by the analysis of inexact (perturbed) inverse iteration algorithms in numerical linear algebra. We couple the perturbed inverse iteration approach with mesh refinement strategy based on residual estimators. We demonstrate our approach on model problems in two and three dimensions.


title: Matrix factorizations with more than two factors

abstract: Given an element $f$ in a regular local ring, we study matrix factorizations of $f$ with $d \ge 2$ factors, that is, we study tuples of square matrices $(\varphi_1,\varphi_2,\dots,\varphi_d)$ such that their product is $f$ times an identity matrix of the appropriate size. Several well known properties of matrix factorizations with $2$ factors extend to the case of arbitrarily many factors. For instance, we show that the stable category of matrix factorizations with $d\ge 2$ factors is naturally triangulated and we give explicit formula for the relevant suspension functor. We also extend results of Kn\"orrer and Solberg which identify the category of matrix factorizations with the full subcategory of maximal Cohen-Macaulay modules over a certain non-commutative algebra $\Gamma$. As a consequence of our findings, we observe that the ring $\Gamma$ behaves, homologically, like a "non-commutative hypersurface ring" in the sense that every finitely generated module over $\Gamma$ has an eventually $2$-periodic projective resolution.


title: Characterizing English Variation across Social Media Communities with BERT

abstract: Much previous work characterizing language variation across Internet social groups has focused on the types of words used by these groups. We extend this type of study by employing BERT to characterize variation in the senses of words as well, analyzing two months of English comments in 474 Reddit communities. The specificity of different sense clusters to a community, combined with the specificity of a community's unique word types, is used to identify cases where a social group's language deviates from the norm. We validate our metrics using user-created glossaries and draw on sociolinguistic theories to connect language variation with trends in community behavior. We find that communities with highly distinctive language are medium-sized, and their loyal and highly engaged users interact in dense networks.


title: Heat transfer augmentation by recombination reactions in turbulent reacting boundary layers at elevated pressures

abstract: A study of a reacting boundary layer flow with heat transfer at conditions typical for configurations at elevated pressures has been performed using a set of direct numerical simulations. Effects of wall temperatures are investigated, representative for cooled walls of gas turbines and sub-scale rocket engines operating with hydrocarbon as fuels. The results show that exothermic chemical reactions induced by the low-enthalpy in the boundary layer take place predominantly in the logarthimic sub-layer. The majority of the heat release is attributed to the exothermic recombination of OH and CO to produce CO2 and H2O. The recombination reactions result in an increase of the wall heat loads by up to 20% compared to the inert flow. The gas composition experiences strong deviations from the chemical equilibrium conditions. In fact, a quenching of the major species is observed within the viscous sub-layer and the transition region. Analysis of chemical time-scales shows that the location of quenched composition coincides with the region where the Damkoehler number decreases below unity. Within the viscous sub-layer, a secondary reaction zone is detected, involving the production of formyl and formaldehyde radicals that provide an additional source of energy release. The analysis of the reaction paths showed that reactions with zero activation energy are responsible for this change in gas composition, which also account for the initial branching of hydrocarbon fuels decomposition according to previous auto-ignition studies. The effect of the secondary recombination reactions is more prominent for the lower wall temperature case. Finally, the role of turbulent fluctuations on the species net chemical production rates is evaluated, showing a strong correlation between species and temperature fluctuations.


title: Demystifying Inductive Biases for $\beta$-VAE Based Architectures

abstract: The performance of $\beta$-Variational-Autoencoders ($\beta$-VAEs) and their variants on learning semantically meaningful, disentangled representations is unparalleled. On the other hand, there are theoretical arguments suggesting the impossibility of unsupervised disentanglement. In this work, we shed light on the inductive bias responsible for the success of VAE-based architectures. We show that in classical datasets the structure of variance, induced by the generating factors, is conveniently aligned with the latent directions fostered by the VAE objective. This builds the pivotal bias on which the disentangling abilities of VAEs rely. By small, elaborate perturbations of existing datasets, we hide the convenient correlation structure that is easily exploited by a variety of architectures. To demonstrate this, we construct modified versions of standard datasets in which (i) the generative factors are perfectly preserved; (ii) each image undergoes a mild transformation causing a small change of variance; (iii) the leading \textbf{VAE-based disentanglement architectures fail to produce disentangled representations whilst the performance of a non-variational method remains unchanged}. The construction of our modifications is nontrivial and relies on recent progress on mechanistic understanding of $\beta$-VAEs and their connection to PCA. We strengthen that connection by providing additional insights that are of stand-alone interest.


title: $\mu$SE: Mutation-based Evaluation of Security-focused Static Analysis Tools for Android

abstract: This demo paper presents the technical details and usage scenarios of $\mu$SE: a mutation-based tool for evaluating security-focused static analysis tools for Android. Mutation testing is generally used by software practitioners to assess the robustness of a given test-suite. However, we leverage this technique to systematically evaluate static analysis tools and uncover and document soundness issues. $\mu$SE's analysis has found 25 previously undocumented flaws in static data leak detection tools for Android. $\mu$SE offers four mutation schemes, namely Reachability, Complex-reachability, TaintSink, and ScopeSink, which determine the locations of seeded mutants. Furthermore, the user can extend $\mu$SE by customizing the API calls targeted by the mutation analysis. $\mu$SE is also practical, as it makes use of filtering techniques based on compilation and execution criteria that reduces the number of ineffective mutations.


title: Introducing Physical Warp Drives

abstract: The Alcubierre warp drive is an exotic solution in general relativity. It allows for superluminal travel at the cost of enormous amounts of matter with negative mass density. For this reason, the Alcubierre warp drive has been widely considered unphysical. In this study, we develop a model of a general warp drive spacetime in classical relativity that encloses all existing warp drive definitions and allows for new metrics without the most serious issues present in the Alcubierre solution. We present the first general model for subluminal positive-energy, spherically symmetric warp drives; construct superluminal warp-drive solutions which satisfy quantum inequalities; provide optimizations for the Alcubierre metric that decrease the negative energy requirements by two orders of magnitude; and introduce a warp drive spacetime in which space capacity and the rate of time can be chosen in a controlled manner. Conceptually, we demonstrate that any warp drive, including the Alcubierre drive, is a shell of regular or exotic material moving inertially with a certain velocity. Therefore, any warp drive requires propulsion. We show that a class of subluminal, spherically symmetric warp drive spacetimes, at least in principle, can be constructed based on the physical principles known to humanity today.


title: A Bounded-Confidence Model of Opinion Dynamics on Hypergraphs

abstract: People's opinions evolve over time as they interact with their friends, family, colleagues, and others. In the study of opinion dynamics on networks, one often encodes interactions between people in the form of dyadic relationships, but many social interactions in real life are polyadic (i.e., they involve three or more people). In this paper, we extend an asynchronous bounded-confidence model (BCM) on graphs, in which nodes are connected pairwise by edges, to an asynchronous BCM on hypergraphs, in which arbitrarily many nodes can be connected by a single hyperedge. We show that our hypergraph BCM converges to consensus under a wide range of initial conditions for the opinions of the nodes, including for non-uniform and asymmetric initial opinion distributions. We also show that, under suitable conditions, echo chambers can form on hypergraphs with community structure. We demonstrate that the opinions of individuals can sometimes jump from one opinion cluster to another in a single time step, a phenomenon (which we call ``opinion jumping'') that is not possible in standard dyadic BCMs. Additionally, we observe that there is a phase transition in the convergence time on {a complete hypergraph} when the variance $\sigma^2$ of the initial opinion distribution equals the confidence bound $c$. We prove that the convergence time grows at least exponentially fast with the number of nodes when $\sigma^2 > c$ and the initial opinions are normally distributed. Therefore, to determine the convergence properties of our hypergraph BCM when the variance and the number of hyperedges are both large, it is necessary to use analytical methods instead of relying only on Monte Carlo simulations.

categories: cs.SI math.CO math.DS nlin.AO physics.soc-ph


title: Hiding Data Hiding

abstract: Data hiding is the art of hiding secret data into a cover object such as digital image for covert communication. In this paper, we make the first step towards hiding ``data hiding'', which is totally different from many conventional works that directly embed secret data in a given cover object. In detail, we propose a novel method to disguise data hiding tools, including a data embedding tool and a data extraction tool, as a deep neural network (DNN) with an ordinary task (i.e., style transfer). After training the DNN for both style transfer and data hiding, while the DNN can transfer the style of an image to the target one, it can also hide secret data into a cover image or extract secret data from a stego image. In other words, the tools of data hiding are hidden to avoid arousing suspicion. Experimental results and analysis have shown the feasibility, applicability and superiority of the proposed method.


title: COMET: A Domain-Specific Compilation of High-Performance Computational Chemistry

abstract: The computational power increases over the past decades havegreatly enhanced the ability to simulate chemical reactions andunderstand ever more complex transformations. Tensor contractions are the fundamental computational building block of these simulations. These simulations have often been tied to one platform and restricted in generality by the interface provided to the user. The expanding prevalence of accelerators and researcher demands necessitate a more general approach which is not tied to specific hardware or requires contortion of algorithms to specific hardware platforms. In this paper we present COMET, a domain-specific programming language and compiler infrastructure for tensor contractions targeting heterogeneous accelerators. We present a system of progressive lowering through multiple layers of abstraction and optimization that achieves up to 1.98X speedup for 30 tensor contractions commonly used in computational chemistry and beyond.


title: Domain Adaptation for Time Series Forecasting via Attention Sharing

abstract: Recently, deep neural networks have gained increasing popularity in the field of time series forecasting. A primary reason for their success is their ability to effectively capture complex temporal dynamics across multiple related time series. The advantages of these deep forecasters only start to emerge in the presence of a sufficient amount of data. This poses a challenge for typical forecasting problems in practice, where there is a limited number of time series or observations per time series, or both. To cope with this data scarcity issue, we propose a novel domain adaptation framework, Domain Adaptation Forecaster (DAF). DAF leverages statistical strengths from a relevant domain with abundant data samples (source) to improve the performance on the domain of interest with limited data (target). In particular, we use an attention-based shared module with a domain discriminator across domains and private modules for individual domains. We induce domain-invariant latent features (queries and keys) and retrain domain-specific features (values) simultaneously to enable joint training of forecasters on source and target domains. A main insight is that our design of aligning keys allows the target domain to leverage source time series even with different characteristics. Extensive experiments on various domains demonstrate that our proposed method outperforms state-of-the-art baselines on synthetic and real-world datasets, and ablation studies verify the effectiveness of our design choices.


title: Systematic Mutation-based Evaluation of the Soundness of Security-focused Android Static Analysis Techniques

abstract: Mobile application security has been a major area of focus for security research over the course of the last decade. Numerous application analysis tools have been proposed in response to malicious, curious, or vulnerable apps. However, existing tools, and specifically, static analysis tools, trade soundness of the analysis for precision and performance and are hence soundy. Unfortunately, the specific unsound choices or flaws in the design of these tools is often not known or well-documented, leading to misplaced confidence among researchers, developers, and users. This paper describes the Mutation-based Soundness Evaluation ($\mu$SE) framework, which systematically evaluates Android static analysis tools to discover, document, and fix flaws, by leveraging the well-founded practice of mutation analysis. We implemented $\mu$SE and applied it to a set of prominent Android static analysis tools that detect private data leaks in apps. In a study conducted previously, we used $\mu$SE to discover $13$ previously undocumented flaws in FlowDroid, one of the most prominent data leak detectors for Android apps. Moreover, we discovered that flaws also propagated to other tools that build upon the design or implementation of FlowDroid or its components. This paper substantially extends our $\mu$SE framework and offers an new in-depth analysis of two more major tools in our 2020 study, we find $12$ new, undocumented flaws and demonstrate that all $25$ flaws are found in more than one tool, regardless of any inheritance-relation among the tools. Our results motivate the need for systematic discovery and documentation of unsound choices in soundy tools and demonstrate the opportunities in leveraging mutation testing in achieving this goal.


title: The Minimal Flavor Structure from Decomposition of the Fermion Mass Matrix

abstract: The minimal flavor structures for both quarks and leptons are proposed to address fermion mass hierarchy and flavor mixings by bi-unitary decomposition of the fermion mass matrix. The real matrix ${\bf M}_0^f$ is completely responsive to family mass hierarchy, which is expressed by a close-to-flat matrix structure. The left-handed unitary phase ${\bf F}_L^f$ provides the origin of CP violation in quark and lepton mixings, which can be explained as a quantum effect between Yukawa interaction states and weak gauge states. The minimal flavor structure is realized by just 10 parameters without any redundancy, corresponding to 6 fermion masses, 3 mixing angles and 1 CP violation in the quark/lepton sector. This approach provides a general flavor structure independent of the specific quark or lepton flavor data. We verify the validation of the flavor structure by reproducing quark/lepton masses and mixings. Some possible scenarios that yield the flavor structure are also discussed.


title: Bibliometric analysis on mathematics, 3 snapshots: 2005, 2010, 2015

abstract: We carry out a thorough bibliometric analysis of recent publications in mathematics based on the database Web of Science. The individual relations between various features and the citations are provided, and the importance of the features is investigated with decision trees. The evolution of the features over a period of 10 years is also studied. National and international collaborations are scrutinized, but personal information are fully disregarded.


title: Multiplicity and stability of closed characteristics on compact convex P-cyclic symmetric hypersurfaces in ${\bf R}^{2n}$

abstract: Let $\Sigma$ be a compact convex hypersurface in ${\bf R}^{2n}$ which is P-cyclic symmetric, i.e., $x\in \Sigma$ implies $Px\in\Sigma$ with P being a $2n\times2n$ symplectic orthogonal matrix and satisfying $P^k=I_{2n}$, $ker(P^l-I_{2n})=0$ for $1\leq l< k$, where $n, k\geq2$. In this paper, we prove that there exist at least $n$ geometrically distinct closed characteristics on $\Sigma$, which solves a longstanding conjecture about the multiplicity of closed characteristics for a broad class of compact convex hypersurfaces with symmetries(cf.,Page 235 of \cite{Eke1}). Based on the proof, we further prove that if the number of geometrically distinct closed characteristics on $\Sigma$ is finite, then at least $2[\frac{n}{2}]$ of them are non-hyperbolic; and if the number of geometrically distinct closed characteristics on $\Sigma$ is exactly $n$ and $k\geq3$, then all of them are P-cyclic symmetric, where a closed characteristic $(\tau, y)$ on $\Sigma$ is called P-cyclic symmetric if $y({\bf R})=Py({\bf R})$.


title: Interactive quantum advantage with noisy, shallow Clifford circuits

abstract: Recent work by Bravyi et al. constructs a relation problem that a noisy constant-depth quantum circuit (QNC$^0$) can solve with near certainty (probability $1 - o(1)$), but that any bounded fan-in constant-depth classical circuit (NC$^0$) fails with some constant probability. We show that this robustness to noise can be achieved in the other low-depth quantum/classical circuit separations in this area. In particular, we show a general strategy for adding noise tolerance to the interactive protocols of Grier and Schaeffer. As a consequence, we obtain an unconditional separation between noisy QNC$^0$ circuits and AC$^0[p]$ circuits for all primes $p \geq 2$, and a conditional separation between noisy QNC$^0$ circuits and log-space classical machines under a plausible complexity-theoretic conjecture. A key component of this reduction is showing average-case hardness for the classical simulation tasks -- that is, showing that a classical simulation of the quantum interactive task is still powerful even if it is allowed to err with constant probability over a uniformly random input. We show that is true even for quantum tasks which are $\oplus$L-hard to simulate. To do this, we borrow techniques from randomized encodings used in cryptography.


title: ADEPT: A Socio-Technical Theory of Continuous Integration

abstract: Continuous practices that rely on automation in the software development workflow have been widely adopted by industry for over a decade. Despite this widespread use, software development remains a primarily human-driven activity that is highly creative and collaborative. There has been extensive research on how continuous practices rely on automation and its impact on software quality and development velocity, but relatively little has been done to understand how automation impacts developer behavior and collaboration. In this paper, we introduce a socio-technical theory about continuous practices. The ADEPT theory combines constructs that include humans, processes, documentation, automation and the project environment, and describes propositions that relate these constructs. The theory was derived from phenomena observed in previous empirical studies. We show how the ADEPT theory can explain and describe existing continuous practices in software development, and how it can be used to generate new propositions for future studies to understand continuous practices and their impact on the social and technical aspects of software development.


title: $L^2$ estimates for commutators of the Dirichlet-to-Neumann Map associated to elliptic operators with complex-valued bounded measurable coefficients on $\mathbb{R}^{n+1}_+$

abstract: In this paper we establish commmutator estimates for the Dirichlet-to-Neumann Map associated to a divergence form elliptic operator in the upper half-space $\mathbb{R}^{n+1}_+:=\{(x,t)\in \mathbb{R}^n \times (0,\infty)\}$, with uniformly complex elliptic, $L^{\infty}$, $t$-independent coefficients. By a standard pull-back mechanism, these results extend corresponding results of Kenig, Lin and Shen for the Laplacian in a Lipschitz domain, which have application to the theory of homogenization.


title: Pulse of the Pandemic: Iterative Topic Filtering for Clinical Information Extraction from Social Media

abstract: The rapid evolution of the COVID-19 pandemic has underscored the need to quickly disseminate the latest clinical knowledge during a public-health emergency. One surprisingly effective platform for healthcare professionals (HCPs) to share knowledge and experiences from the front lines has been social media (for example, the "#medtwitter" community on Twitter). However, identifying clinically-relevant content in social media without manual labeling is a challenge because of the sheer volume of irrelevant data. We present an unsupervised, iterative approach to mine clinically relevant information from social media data, which begins by heuristically filtering for HCP-authored texts and incorporates topic modeling and concept extraction with MetaMap. This approach identifies granular topics and tweets with high clinical relevance from a set of about 52 million COVID-19-related tweets from January to mid-June 2020. We also show that because the technique does not require manual labeling, it can be used to identify emerging topics on a week-to-week basis. Our method can aid in future public-health emergencies by facilitating knowledge transfer among healthcare workers in a rapidly-changing information environment, and by providing an efficient and unsupervised way of highlighting potential areas for clinical research.


title: Learning Speech-driven 3D Conversational Gestures from Video

abstract: We propose the first approach to automatically and jointly synthesize both the synchronous 3D conversational body and hand gestures, as well as 3D face and head animations, of a virtual character from speech input. Our algorithm uses a CNN architecture that leverages the inherent correlation between facial expression and hand gestures. Synthesis of conversational body gestures is a multi-modal problem since many similar gestures can plausibly accompany the same input speech. To synthesize plausible body gestures in this setting, we train a Generative Adversarial Network (GAN) based model that measures the plausibility of the generated sequences of 3D body motion when paired with the input audio features. We also contribute a new way to create a large corpus of more than 33 hours of annotated body, hand, and face data from in-the-wild videos of talking people. To this end, we apply state-of-the-art monocular approaches for 3D body and hand pose estimation as well as dense 3D face performance capture to the video corpus. In this way, we can train on orders of magnitude more data than previous algorithms that resort to complex in-studio motion capture solutions, and thereby train more expressive synthesis algorithms. Our experiments and user study show the state-of-the-art quality of our speech-synthesized full 3D character animations.


title: Learning Variable Impedance Control via Inverse Reinforcement Learning for Force-Related Tasks

abstract: Many manipulation tasks require robots to interact with unknown environments. In such applications, the ability to adapt the impedance according to different task phases and environment constraints is crucial for safety and performance. Although many approaches based on deep reinforcement learning (RL) and learning from demonstration (LfD) have been proposed to obtain variable impedance skills on contact-rich manipulation tasks, these skills are typically task-specific and could be sensitive to changes in task settings. This paper proposes an inverse reinforcement learning (IRL) based approach to recover both the variable impedance policy and reward function from expert demonstrations. We explore different action space of the reward functions to achieve a more general representation of expert variable impedance skills. Experiments on two variable impedance tasks (Peg-in-Hole and Cup-on-Plate) were conducted in both simulations and on a real FANUC LR Mate 200iD/7L industrial robot. The comparison results with behavior cloning and force-based IRL proved that the learned reward function in the gain action space has better transferability than in the force space. Experiment videos are available at https://msc.berkeley.edu/research/impedance-irl.html.


title: Fluctuation-response theorem for Kullback-Leibler divergences to quantify causation

abstract: We define a new measure of causation from a fluctuation-response theorem for Kullback-Leibler divergences, based on the information-theoretic cost of perturbations. This information response has both the invariance properties required for an information-theoretic measure and the physical interpretation of a propagation of perturbations. In linear systems, the information response reduces to the transfer entropy, providing a connection between Fisher and mutual information.


title: Ab initio electron-phonon interactions in correlated electron systems

abstract: Electron-phonon ($e$-ph) interactions are pervasive in condensed matter, governing phenomena such as transport, superconductivity, charge-density waves, polarons and metal-insulator transitions. First-principles approaches enable accurate calculations of $e$-ph interactions in a wide range of solids. However, they remain an open challenge in correlated electron systems (CES), where density functional theory often fails to describe the ground state. Therefore reliable $e$-ph calculations remain out of reach for many transition metal oxides, high-temperature superconductors, Mott insulators, planetary materials and multiferroics. Here we show first-principles calculations of $e$-ph interactions in CES, using the framework of Hubbard-corrected density functional theory (DFT+$U$ ) and its linear response extension (DFPT+$U$), which can describe the electronic structure and lattice dynamics of many CES. We showcase the accuracy of this approach for a prototypical Mott system, CoO, carrying out a detailed investigation of its $e$-ph interactions and electron spectral functions. While standard DFPT gives unphysically divergent and short-ranged $e$-ph interactions, DFPT+$U$ is shown to remove the divergences and properly account for the long-range Fr\"ohlich interaction, allowing us to model polaron effects in a Mott insulator. Our work establishes a broadly applicable and affordable approach for quantitative studies of e-ph interactions in CES, a novel theoretical tool to interpret experiments in this broad class of materials.


title: Collaborative Intelligence: Challenges and Opportunities

abstract: This paper presents an overview of the emerging area of collaborative intelligence (CI). Our goal is to raise awareness in the signal processing community of the challenges and opportunities in this area of growing importance, where key developments are expected to come from signal processing and related disciplines. The paper surveys the current state of the art in CI, with special emphasis on signal processing-related challenges in feature compression, error resilience, privacy, and system-level design.


title: Explaining and Fixing DFT Failures for Torsional Barriers

abstract: Most torsional barriers are predicted to high accuracy (about 1kJ/mol) by standard semilocal functionals, but a small subset has been found to have much larger errors. We create a database of almost 300 carbon-carbon torsional barriers, including 12 poorly behaved barriers, all stemming from Y=C-X group, where X is O or S, and Y is a halide. Functionals with enhanced exchange mixing (about 50%) work well for all barriers. We find that poor actors have delocalization errors caused by hyperconjugation. These problematic calculations are density sensitive (i.e., DFT predictions change noticeably with the density), and using HF densities (HF-DFT) fixes these issues. For example, conventional B3LYP performs as accurately as exchange-enhanced functionals if the HF density is used. For long-chain conjugated molecules, HF-DFT can be much better than exchange-enhanced functionals. We suggest that HF-PBE0 has the best overall performance.


title: Extremely broad Lyman-alpha line emission from the molecular intra-group medium in Stephan's Quintet: evidence for a turbulent cascade in a highly clumpy multi-phase medium?

abstract: We present Hubble Space Telescope Cosmic Origin Spectrograph (COS) UV line spectroscopy and integral-field unit (IFU) observations of the intra-group medium in Stephan's Quintet (SQ). SQ hosts a 30 kpc long shocked ridge triggered by a galaxy collision at a relative velocity of 1000 km/s, where large amounts of molecular gas coexist with a hot, X-ray emitting, plasma. COS spectroscopy at five positions sampling the diverse environments of the SQ intra-group medium reveals very broad (2000 km/s) Ly$\alpha$ line emission with complex line shapes. The Ly$\alpha$ line profiles are similar to or much broader than those of H$\beta$, [CII]$\lambda157.7\mu$m and CO~(1-0) emission. The extreme breadth of the Ly$\alpha$ emission, compared with H$\beta$, implies resonance scattering within the observed structure. Scattering indicates that the neutral gas of the intra-group medium is clumpy, with a significant surface covering factor. We observe significant variations in the Ly$\alpha$/H$\beta$ flux ratio between positions and velocity components. From the mean line ratio averaged over positions and velocities, we estimate the effective escape fraction of Ly$\alpha$ photons to be 10-30%. Remarkably, over more than four orders of magnitude in temperature, the powers radiated by X-rays, Ly$\alpha$, H$_2$, [CII] are comparable within a factor of a few, assuming that the ratio of the Ly$\alpha$ to H$_2$ fluxes over the whole shocked intra-group medium stay in line with those observed at those five positions. Both shocks and mixing layers could contribute to the energy dissipation associated with a turbulent energy cascade. Our results may be relevant for the cooling of gas at high redshifts, where the metal content is lower than in this local system, and a high amplitude of turbulence is more common.


title: On the role of vorticity stretching and strain self-amplification in the turbulence energy cascade

abstract: The tendency of turbulent flows to produce fine-scale motions from large-scale energy injection is often viewed as a scale-wise cascade of kinetic energy driven by vorticity stretching. This has been recently evaluated by an exact, spatially-local relationship [Johnson, P. L. 2020, Phys. Rev. Lett., \textbf{124}, 104501], which also highlights the contribution of strain self-amplification. In this paper, the role of these two mechanisms is explored in more detail. Vorticity stretching and strain amplification interactions between velocity gradients filtered at the same scale account for about half of the energy cascade rate, directly connecting restricted Euler dynamics to the energy cascade. Multiscale strain amplification and vorticity stretching are equally important, however, and more closely resemble eddy viscosity physics. Moreover, ensuing evidence of a power-law decay of energy transfer contributions from disparate scales supports the notion of an energy cascade, albeit a `leaky' one. Besides vorticity stretching and strain self-amplification, a third mechanism of energy transfer is introduced and related to the vortex thinning mechanism important for the inverse cascade in two dimensions. Simulation results indicate this mechanism also provides a net source of backscatter in three-dimensional turbulence, in the range of scales associated with the bottleneck effect. Taken together, these results provide a rich set of implications for large-eddy simulation modeling.


title: General Total Variation Regularized Sparse Bayesian Learning for Robust Block-Sparse Signal Recovery

abstract: Block-sparse signal recovery without knowledge of block sizes and boundaries, such as those encountered in multi-antenna mmWave channel models, is a hard problem for compressed sensing (CS) algorithms. We propose a novel Sparse Bayesian Learning (SBL) method for block-sparse recovery based on popular CS based regularizers with the function input variable related to total variation (TV). Contrary to conventional approaches that impose the regularization on the signal components, we regularize the SBL hyperparameters. This iterative TV-regularized SBL algorithm employs a majorization-minimization approach and reduces each iteration to a convex optimization problem, enabling a flexible choice of numerical solvers. The numerical results illustrate that the TV-regularized SBL algorithm is robust to the nature of the block structure and able to recover signals with both block-patterned and isolated components, proving useful for various signal recovery systems.