title: Correlation Sketches for Approximate Join-Correlation Queries

abstract: The increasing availability of structured datasets, from Web tables and open-data portals to enterprise data, opens up opportunities~to enrich analytics and improve machine learning models through relational data augmentation. In this paper, we introduce a new class of data augmentation queries: join-correlation queries. Given a column $Q$ and a join column $K_Q$ from a query table $\mathcal{T}_Q$, retrieve tables $\mathcal{T}_X$ in a dataset collection such that $\mathcal{T}_X$ is joinable with $\mathcal{T}_Q$ on $K_Q$ and there is a column $C \in \mathcal{T}_X$ such that $Q$ is correlated with $C$. A na\"ive approach to evaluate these queries, which first finds joinable tables and then explicitly joins and computes correlations between $Q$ and all columns of the discovered tables, is prohibitively expensive. To efficiently support correlated column discovery, we 1) propose a sketching method that enables the construction of an index for a large number of tables and that provides accurate estimates for join-correlation queries, and 2) explore different scoring strategies that effectively rank the query results based on how well the columns are correlated with the query. We carry out a detailed experimental evaluation, using both synthetic and real data, which shows that our sketches attain high accuracy and the scoring strategies lead to high-quality rankings.


title: Prism: Private Verifiable Set Computation over Multi-Owner Outsourced Databases

abstract: This paper proposes Prism, a secret sharing based approach to compute private set operations (i.e., intersection and union), as well as aggregates over outsourced databases belonging to multiple owners. Prism enables data owners to pre-load the data onto non-colluding servers and exploits the additive and multiplicative properties of secret-shares to compute the above-listed operations in (at most) two rounds of communication between the servers (storing the secret-shares) and the querier, resulting in a very efficient implementation. Also, Prism does not require communication among the servers and supports result verification techniques for each operation to detect malicious adversaries. Experimental results show that Prism scales both in terms of the number of data owners and database sizes, to which prior approaches do not scale.


title: Value of information in networked control systems subject to delay

abstract: In this paper, we study the trade-off between the transmission cost and the control performance of the multi-loop networked control system subject to network-induced delay. Within the linear-quadratic-Gaussian (LQG) framework, the joint design of control policy and networking strategy is decomposed into separation optimization problems. Based on the trade-off analysis, a scalable, delay-dependent Value-of-Information (VoI) based scheduling policy is constructed to quantify the value of transmitting the data packet, and enables the decision-makers embedded in subsystems to determine the transmission policy. The proposed scalable VoI inherits the task criticality of the previous VoI metric meanwhile is sensitive to the system parameters such as information freshness and network delays. The VoI-based scheduling policy is proved to outperform the periodical triggering policy and existing Age-of-Information (AoI) based policy for network control system under transmission delay. The effectiveness of the constructed VoI with arbitrary network delay is validated through numerical simulations.


title: Universal Spectral Adversarial Attacks for Deformable Shapes

abstract: Machine learning models are known to be vulnerable to adversarial attacks, namely perturbations of the data that lead to wrong predictions despite being imperceptible. However, the existence of "universal" attacks (i.e., unique perturbations that transfer across different data points) has only been demonstrated for images to date. Part of the reason lies in the lack of a common domain, for geometric data such as graphs, meshes, and point clouds, where a universal perturbation can be defined. In this paper, we offer a change in perspective and demonstrate the existence of universal attacks for geometric data (shapes). We introduce a computational procedure that operates entirely in the spectral domain, where the attacks take the form of small perturbations to short eigenvalue sequences; the resulting geometry is then synthesized via shape-from-spectrum recovery. Our attacks are universal, in that they transfer across different shapes, different representations (meshes and point clouds), and generalize to previously unseen data.


title: Whispering gallery orbits in Sinai oscillator trap

abstract: Experimental realizations of trapping Bose Einstein condensate lead to a Hamiltonian system of a classical particle bouncing off a convex scatterer in the field of an attracting potential. It is shown by application of KAM theory that under some natural conditions there exists positive measure of quasiperiodic solutions near the boundary.


title: Multiplicative Functions on Shifted Primes

abstract: Let $f$ be a positive multiplicative function and let $k\geq 2$ be an integer. We prove that if the prime values $f(p)$ converge to $1$ sufficiently slowly as $p\rightarrow +\infty$, in the sense that $\sum_{p}|f(p)-1|=\infty$, there exists a real number $c>0$ such that the $k$-tuples $(f(p+1),\ldots,f(p+k))$ are dense in the hypercube $[0,c]^k$ or in $[c,+\infty)^k$. In particular, the values $f(p+1),\ldots,f(p+k)$ can be put in any increasing order infinitely often. Our work generalises previous results of De Koninck and Luca.


title: Bounds on degrees of covers with injective monodromy in iterated Kodaira Fibrations

abstract: Let $\pi:X\to Y$ be an $n$-dimensional iterated Kodaira fibration with fiber of genus $g$ and injective monodromy. Llosa Isenrich and Py proved that we can pass to a finite index subgroup of $\pi_1(X)$ to get the base space of an n+1-dimensional iterated Kodaira fibration with injective monodromy and they asked about bounding the index of such a group. We provide a bound on this index.


title: Reversing Lindblad Dynamics via Continuous Petz Recovery Map

abstract: An important issue in developing quantum technology is that quantum states are so sensitive to noise. We propose a protocol that introduces reverse dynamics, in order to precisely control quantum systems against noise described by the Lindblad master equation. The reverse dynamics can be obtained by constructing the Petz recovery map in continuous time. By providing the exact form of the Hamiltonian and jump operators for the reverse dynamics, we explore the potential of utilizing the near-optimal recovery of the Petz map in controlling noisy quantum dynamics. While time-dependent dissipation engineering enables us to fully recover a single quantum trajectory, we also design a time-independent recovery protocol to protect encoded quantum information against decoherence. Our protocol can efficiently suppress only the noise part of dynamics thereby providing an effective unitary evolution of the quantum system.


title: Monitoring Social-distance in Wide Areas during Pandemics: a Density Map and Segmentation Approach

abstract: With the relaxation of the containment measurements around the globe, monitoring the social distancing in crowded public places is of grate importance to prevent a new massive wave of COVID-19 infections. Recent works in that matter have limited themselves by detecting social distancing in corridors up to small crowds by detecting each person individually considering the full body in the image. In this work, we propose a new framework for monitoring the social-distance using end-to-end Deep Learning, to detect crowds violating the social-distance in wide areas where important occlusions may be present. Our framework consists in the creation of a new ground truth based on the ground truth density maps and the proposal of two different solutions, a density-map-based and a segmentation-based, to detect the crowds violating the social-distance constrain. We assess the results of both approaches by using the generated ground truth from the PET2009 and CityStreet datasets. We show that our framework performs well at providing the zones where people are not following the social-distance even when heavily occluded or far away from one camera.


title: SOLD2: Self-supervised Occlusion-aware Line Description and Detection

abstract: Compared to feature point detection and description, detecting and matching line segments offer additional challenges. Yet, line features represent a promising complement to points for multi-view tasks. Lines are indeed well-defined by the image gradient, frequently appear even in poorly textured areas and offer robust structural cues. We thus hereby introduce the first joint detection and description of line segments in a single deep network. Thanks to a self-supervised training, our method does not require any annotated line labels and can therefore generalize to any dataset. Our detector offers repeatable and accurate localization of line segments in images, departing from the wireframe parsing approach. Leveraging the recent progresses in descriptor learning, our proposed line descriptor is highly discriminative, while remaining robust to viewpoint changes and occlusions. We evaluate our approach against previous line detection and description methods on several multi-view datasets created with homographic warps as well as real-world viewpoint changes. Our full pipeline yields higher repeatability, localization accuracy and matching metrics, and thus represents a first step to bridge the gap with learned feature points methods. Code and trained weights are available at https://github.com/cvg/SOLD2.


title: Optimal ventilation rate for effective displacement ventilation

abstract: Indoor ventilation is essential for a healthy and comfortable living environment. A key issue is to discharge anthropogenic air contamination such as CO2 gas or, more seriously, airborne respiratory droplets. Here, by employing direct numerical simulations, we study the mechanical displacement ventilation with the realistic range of air changes per hour (ACH) from 1 to 10. For this ventilation scheme, a cool lower zone is established beneath the warm upper zone with the interface height h depending on ACH. For weak ventilation, we find the scalings relation of the interface height h ~ ACH^{3/5}, as suggested by Hunt & Linden (Build. Environ., vol. 34, 1999, pp. 707-720). Also, the CO2 concentration decreases with ACH within this regime. However, for too strong ventilation, the interface height h becomes insensitive to ACH, and the CO2 concentration remains unchanged. Our results are in contrast to the general belief that stronger flow is more helpful to remove contaminants. We work out the physical mechanism governing the transition between the low ACH and the high ACH regimes. It is determined by the relative strength of the kinetic energy from the inflow, potential energy from the stably-stratified layers, and energy loss due to drag. Our findings provide a physics-based guideline to optimize displacement ventilation.


title: EXPATS: A Toolkit for Explainable Automated Text Scoring

abstract: Automated text scoring (ATS) tasks, such as automated essay scoring and readability assessment, are important educational applications of natural language processing. Due to their interpretability of models and predictions, traditional machine learning (ML) algorithms based on handcrafted features are still in wide use for ATS tasks. Practitioners often need to experiment with a variety of models (including deep and traditional ML ones), features, and training objectives (regression and classification), although modern deep learning frameworks such as PyTorch require deep ML expertise to fully utilize. In this paper, we present EXPATS, an open-source framework to allow its users to develop and experiment with different ATS models quickly by offering flexible components, an easy-to-use configuration system, and the command-line interface. The toolkit also provides seamless integration with the Language Interpretability Tool (LIT) so that one can interpret and visualize models and their predictions. We also describe two case studies where we build ATS models quickly with minimal engineering efforts. The toolkit is available at \url{https://github.com/octanove/expats}.


title: Binary pathways to SLSNe-I: SN 2017gci

abstract: Some hydrogen poor superluminous supernovae (SLSNe) exhibit bumps in the tails of their light-curves associated with hydrogen features in their late time spectra. Here we use the explosion parameters of one such SLSN -- SN 2017gci -- to search the stellar models of the Binary Population And Spectral Synthesis (BPASS) code for potential progenitors. We find good matches for a 30 $M_{\odot}$ progenitor star in a binary system and no matches from single star models. Common envelope and mass transfer after the giant branch, combined with increased mass loss from strong stellar winds immediately before death, allow the progenitor to lose its hydrogen envelope decades before the explosion. This results in a hydrogen poor SLSN and allows for delayed interaction of the ejecta with the lost stellar material


title: An Object Detection based Solver for Google's Image reCAPTCHA v2

abstract: Previous work showed that reCAPTCHA v2's image challenges could be solved by automated programs armed with Deep Neural Network (DNN) image classifiers and vision APIs provided by off-the-shelf image recognition services. In response to emerging threats, Google has made significant updates to its image reCAPTCHA v2 challenges that can render the prior approaches ineffective to a great extent. In this paper, we investigate the robustness of the latest version of reCAPTCHA v2 against advanced object detection based solvers. We propose a fully automated object detection based system that breaks the most advanced challenges of reCAPTCHA v2 with an online success rate of 83.25%, the highest success rate to date, and it takes only 19.93 seconds (including network delays) on average to crack a challenge. We also study the updated security features of reCAPTCHA v2, such as anti-recognition mechanisms, improved anti-bot detection techniques, and adjustable security preferences. Our extensive experiments show that while these security features can provide some resistance against automated attacks, adversaries can still bypass most of them. Our experimental findings indicate that the recent advances in object detection technologies pose a severe threat to the security of image captcha designs relying on simple object detection as their underlying AI problem.


title: $(g-2)_\mu$ in the 2HDM and slightly beyond -- an updated view

abstract: The recent measurement of the muon $g - 2$ anomaly continues to defy a Standard Model explanation, but can be accommodated within the framework of two Higgs doublet models. If one further includes extra fermion content in the form of a generation of vector like leptons, the allowed parameter range that explains the anomaly is even further extended, and thorny issues of perturbativity and clashes with $B$-decay constraints avoided. We will show how the muon magnetic moment anomaly can be fit within these models, under the assumption that the vector-like leptons do not mix with the muon. We update previous analyses and include all theoretical and experimental constraints, including searches for extra scalars. It is shown that the inclusion of vector-like fermions allows the lepton-specific and muon-specific models to perform much better in fitting the muon's $g - 2$. These fits do require the Yukawa coupling between the Higgs and the vector-like leptons to be large, causing potential problems with perturbativity and unitarity, and thus models in which the vector-like leptons mix with the muon may be preferred.


title: Exploring Task Placement for Edge-to-Cloud Applications using Emulation

abstract: A vast and growing number of IoT applications connect physical devices, such as scientific instruments, technical equipment, machines, and cameras, across heterogenous infrastructure from the edge to the cloud to provide responsive, intelligent services while complying with privacy and security requirements. However, the integration of heterogeneous IoT, edge, and cloud technologies and the design of end-to-end applications that seamlessly work across multiple layers and types of infrastructures is challenging. A significant issue is resource management and the need to ensure that the right type and scale of resources is allocated on every layer to fulfill the application's processing needs. As edge and cloud layers are increasingly tightly integrated, imbalanced resource allocations and sub-optimally placed tasks can quickly deteriorate the overall system performance. This paper proposes an emulation approach for the investigation of task placements across the edge-to-cloud continuum. We demonstrate that emulation can address the complexity and many degrees-of-freedom of the problem, allowing us to investigate essential deployment patterns and trade-offs. We evaluate our approach using a machine learning-based workload, demonstrating the validity by comparing emulation and real-world experiments. Further, we show that the right task placement strategy has a significant impact on performance -- in our experiments, between 5% and 65% depending on the scenario.


title: Asymmetric cooperative motion in one dimension

abstract: We prove distributional convergence for a family of random processes on $\mathbb{Z}$, which we call asymmetric cooperative motions. The model generalizes the "totally asymmetric hipster random walk" introduced in [Addario-Berry, Cairns, Devroye, Kerriou and Mitchell, 2020]. We present a novel approach based on connecting a temporal recurrence relation satisfied by the cumulative distribution functions of the process to the theory of finite difference schemes for Hamilton-Jacobi equations [Crandall and Lyons, 1984]. We also point out some surprising lattice effects that can persist in the distributional limit, and propose several generalizations and directions for future research.


title: Spontaneous imbibition in porous media: from pore scale to Darcy scale

abstract: Spontaneous imbibition has been receiving much attention due to its significance in many subsurface and industrial applications. Unveiling pore-scale wetting dynamics, and particularly its upscaling to the Darcy scale are still unresolved. In this work, we conduct image-based pore-network modeling of cocurrent spontaneous imbibition and the corresponding quasi-static imbibition, in homogeneous sintered glass beads as well as heterogeneous Estaillades. A wide range of viscosity ratios and wettability conditions are taken into account. Based on our pore-scale results, we show the influence of pore-scale heterogeneity on imbibition dynamics and nonwetting entrapment. We elucidate different pore-filling mechanisms in imbibition, which helps us understand wetting dynamics. Most importantly, we develop a non-equilibrium model for relative permeability of the wetting phase, which adequately incorporates wetting dynamics. This is crucial to the final goal of developing a two-phase imbibition model with measurable material properties such as capillary pressure and relative permeability. Finally, we propose some future work on both numerical and experimental verifications of the developed non-equilibrium permeability model.


title: On Leibniz algebras with maximal cyclic subalgebras

abstract: We begin to study the structure of Leibniz algebras having maximal cyclic subalgebras


title: Lower Bounds from Fitness Levels Made Easy

abstract: One of the first and easy to use techniques for proving run time bounds for evolutionary algorithms is the so-called method of fitness levels by Wegener. It uses a partition of the search space into a sequence of levels which are traversed by the algorithm in increasing order, possibly skipping levels. An easy, but often strong upper bound for the run time can then be derived by adding the reciprocals of the probabilities to leave the levels (or upper bounds for these). Unfortunately, a similarly effective method for proving lower bounds has not yet been established. The strongest such method, proposed by Sudholt (2013), requires a careful choice of the viscosity parameters $\gamma_{i,j}$, $0 \le i < j \le n$. In this paper we present two new variants of the method, one for upper and one for lower bounds. Besides the level leaving probabilities, they only rely on the probabilities that levels are visited at all. We show that these can be computed or estimated without greater difficulties and apply our method to reprove the following known results in an easy and natural way. (i) The precise run time of the (1+1) EA on \textsc{LeadingOnes}. (ii) A lower bound for the run time of the (1+1) EA on \textsc{OneMax}, tight apart from an $O(n)$ term. (iii) A lower bound for the run time of the (1+1) EA on long $k$-paths. We also prove a tighter lower bound for the run time of the (1+1) EA on jump functions by showing that, regardless of the jump size, only with probability $O(2^{-n})$ the algorithm can avoid to jump over the valley of low fitness.


title: Gate-induced decoupling of surface and bulk state properties in selectively-deposited Bi$_2$Te$_3$ nanoribbons

abstract: Three-dimensional topological insulators (TIs) host helical Dirac surface states at the interface with a trivial insulator. In quasi-one-dimensional TI nanoribbon structures the wave function of surface charges extends phase-coherently along the perimeter of the nanoribbon, resulting in a quantization of transverse surface modes. Furthermore, as the inherent spin-momentum locking results in a Berry phase offset of $\pi$ of self-interfering charge carriers an energy gap within the surface state dispersion appears and all states become spin-degenerate. We investigate and compare the magnetic field dependent surface state dispersion in selectively deposited Bi$_2$Te$_3$ TI micro- and nanoribbon structures by analysing the gate voltage dependent magnetoconductance at cryogenic temperatures. While in wide microribbon devices the field effect mainly changes the amount of bulk charges close to the top surface we identify coherent transverse surface states along the perimeter of the nanoribbon devices responding to a change in top gate potential. We quantify the energetic spacing in between these quantized transverse subbands by using an electrostatic model that treats an initial difference in charge carrier densities on the top and bottom surface as well as remaining bulk charges. In the gate voltage dependent transconductance we find oscillations that change their relative phase by $\pi$ at half-integer values of the magnetic flux quantum applied coaxial to the nanoribbon, which is a signature for a magnetic flux dependent topological phase transition in narrow, selectively deposited TI nanoribbon devices.


title: Pilot-Edge: Distributed Resource Management Along the Edge-to-Cloud Continuum

abstract: Many science and industry IoT applications necessitate data processing across the edge-to-cloud continuum to meet performance, security, cost, and privacy requirements. However, diverse abstractions and infrastructures for managing resources and tasks across the edge-to-cloud scenario are required. We propose Pilot-Edge as a common abstraction for resource management across the edge-to-cloud continuum. Pilot-Edge is based on the pilot abstraction, which decouples resource and workload management, and provides a Function-as-a-Service (FaaS) interface for application-level tasks. The abstraction allows applications to encapsulate common functions in high-level tasks that can then be configured and deployed across the continuum. We characterize Pilot-Edge on geographically distributed infrastructures using machine learning workloads (e.g., k-means and auto-encoders). Our experiments demonstrate how Pilot-Edge manages distributed resources and allows applications to evaluate task placement based on multiple factors (e.g., model complexities, throughput, and latency).


title: Approximately controllable finite-dimensional bilinear systems are controllable

abstract: We show that a bilinear control system is approximately controllable if and only if it is controllable in $\mathbb{R}^{n}\setminus\{0\}$. We approach this problem by looking at the foliation made by the orbits of the system, and by showing that there does not exist a codimension-one foliation in $\mathbb{R}^{n}\setminus\{0\}$ with dense leaves that are everywhere transversal to the radial direction. The proposed geometric approach allows to extend the results to homogeneous systems that are angularly controllable.


title: Improved Nondestructive Isotopic Analysis with Practical Microcalorimeter Gamma Spectrometers

abstract: Advances in both instrumentation and data analysis software are now enabling the first ultra-high-resolution microcalorimeter gamma spectrometers designed for implementation in nuclear facilities and analytical laboratories. With approximately ten times better energy resolution than high-purity germanium detectors, these instruments can overcome important uncertainty limits. Microcalorimeter gamma spectroscopy is intended to provide nondestructive isotopic analysis capabilities with sufficient precision and accuracy to reduce the need for sampling, chemical separations, and mass spectrometry to meet safeguards and security goals. Key milestones were the development of the SOFIA instrument (Spectrometer Optimized for Facility Integrated Applications) and the SAPPY software (Spectral Analysis Program in PYthon). SOFIA is a compact instrument that combines advances in large multiplexed transition-edge sensor arrays with optimized cryogenic performance to overcome many practical limitations of previous systems. With a 256-pixel multiplexed detector array capable of 5000 counts per second, measurement time can be comparable to high-purity germanium detectors. SAPPY was developed to determine isotopic ratios in data from SOFIA and other microcalorimeter instruments with an approach similar to the widely-used FRAM software. SAPPY provides a flexible framework with rigorous uncertainty analysis for both microcalorimeter and HPGe data, allowing direct comparison. We present current results from the SOFIA instrument, preliminary isotopic analysis using SAPPY, and describe how the technology is being used to explore uncertainty limits of nondestructive isotopic characterization, inform safeguards models, and extract improved nuclear data including gamma-ray branching ratios.


title: Prime ideals and Noetherian properties in vector lattices

abstract: In this paper we study the set of prime ideals in vector lattices and how the properties of the prime ideals structure the vector lattice in question. The different properties that will be considered are firstly, that all or none of the prime ideals are order dense, secondly, that there are only finitely many prime ideals, thirdly, that every prime ideal is principal, and lastly, that every ascending chain of prime ideals is stationary (a property that we refer to as prime Noetherian). We also completely characterize the prime ideals in vector lattices of piecewise polynomials, which turns out to be an interesting class of vector lattices for studying principal prime ideals and ascending chains of prime ideals.


title: A simple and robust method for noise variance estimation for time-varying signals

abstract: In this brief paper, we present a simple approach to estimate the variance of measurement noise with time-varying 1-D signals. The proposed approach exploits the relationship between the noise variance and the variance of the prediction errors (or innovation sequence) of a linear estimator, the idea that was pioneered by [9] and [2]. Compared with the classic and more recent methods in the same category, the proposed method can render more robust estimates with the presence of unmodelled dynamics and outliers in the measurement.


title: Reexamining a Geometric Theory of Biological Growth

abstract: A first principles approach to the theoretical description of the development of biological forms, from a fertilized egg to a functioning embryo, remains a central challenge to applied physics and theoretical biology. Rather than refer to principles of self-organization and non-equilibrium statistical mechanics to describe a developing embryo from its active cellular constituents, a purely geometric theory is constructed that references the properties of the ambient space that the embryo occupies. In 1975 the Fields laureate Ren\'{e} Thom developed a system of techniques and local dynamical models that are capable of reconstructing the local dynamic of an embryo at each new growth event of the system. Each new growth event (the development of a limb, for example) is a topological change in the dynamic of the system that can be classified only according to the properties of space. The local models can be non-conservative flows with robust attractor behavior that serve as organizing centers for systems development. Hamiltonian flows can also be considered with novel, self-reproducing vague attractor behavior. The set of growth events become an unfolding space related to the differentiable manifold of states. The set of growth events, which Thom refers to as the catastrophe set, has special algebraic properties which permit these models to be low dimensional--the local model contains few parameters. We present Thom's work as a research program outlining a framework for the construction of these local models, and, ultimately, the synthesis of these models into a full theoretical description of a developing biological organism. We give examples of the application of selected models to key growth events in the process of gastrulation.


title: Steklov Eigenvalues of Nearly Spherical Domains

abstract: We consider Steklov eigenvalues of three-dimensional, nearly-spherical domains. In previous work, we have shown that the Steklov eigenvalues are analytic functions of the domain perturbation parameter. Here, we compute the first-order term of the asymptotic expansion, which can explicitly be written in terms of the Wigner 3-jsymbols. We analyze the asymptotic expansion and prove the isoperimetric result that, if l is a square integer, the volume-normalized l-th Steklov eigenvalue is stationary for a ball.


title: The Trouble with "Puddle Thinking": A User's Guide to the Anthropic Principle

abstract: Are some cosmologists trying to return human beings to the centre of the cosmos? In the view of some critics, the so-called "anthropic principle" is a desperate attempt to salvage a scrap of dignity for our species after a few centuries of demotion at the hands of science. It is all things archaic and backwards - teleology, theology, religion, anthropocentrism - trying to sneak back in scientific camouflage. We argue that this is a mistake. The anthropic principle is not mere human arrogance, nor is it religion in disguise. It is a necessary part of the science of the universe.


title: Extreme UV quiet Sun brightenings observed by Solar Orbiter/EUI

abstract: The goal of this paper is to study the smallest brightening events observed in the EUV quiet Sun. We use commissioning data taken by the EUI instrument onboard the recently launched Solar Orbiter mission. On 2020 May 30, EUI was situated at 0.556AU from the Sun. Its HRIEUV telescope 17.4nm passband reached an exceptionally high two-pixel spatial resolution of 400km. The size and duration of small-scale structures is determined in the HRIEUV data, while their height is estimated from triangulation with the simultaneous SDO/AIA data. This is the first stereoscopy of small scale brightenings at high resolution. We observed small localised brightenings ("campfires") in a quiet Sun region with lengthscales between 400km and 4000km and durations between 10 and 200s. The smallest and weakest of these HRIEUV brightenings have not been observed before. Simultaneous HRILYA observations do not show localised brightening events, but the locations of the HRIEUV events correspond clearly to the chromospheric network. Comparison with simultaneous AIA images shows that most events can also be identified in the 17.1nm, 19.3nm, 21.1nm, and 30.4nm passbands of AIA, although they appear weaker and blurred. DEM analysis indicates coronal temperatures peaking at log(T)~6.1-6.15. We determined the height of a few campfires, which is between 1000 and 5000km above the photosphere. We conclude that "campfires" are mostly coronal in nature and are rooted in the magnetic flux concentrations of the chromospheric network. We interpret these events as a new extension to the flare/microflare/nanoflare family. Given their low height, the EUI "campfires" could be a new element of the fine structure of the transition region/low corona: apexes of small-scale loops that are internally heated to coronal temperatures.


title: A tale of two kinds of exceptional point in a hydrogen molecule

abstract: We study the parity and time-reversal ($\mathcal{PT}$) symmetric quantum physics in a non-Hermitian non-relativistic hydrogen molecule with local (Hubbard type) Coulomb interaction. We consider non-Hermiticity generated from both kinetic and orbital energies of the atoms and encounter the existence of two different types of exceptional points (EPs) in pairs. These two kinds of EP are characteristically different and depend differently on the interaction strength. Our discovery may open the gates of a rich physics emerging out of a simple Hamiltonian resembling a two-site Hubbard model.


title: Ensemble Inference Methods for Models With Noisy and Expensive Likelihoods

abstract: The increasing availability of data presents an opportunity to calibrate unknown parameters which appear in complex models of phenomena in the biomedical, physical and social sciences. However, model complexity often leads to parameter-to-data maps which are expensive to evaluate and are only available through noisy approximations. This paper is concerned with the use of interacting particle systems for the solution of the resulting inverse problems for parameters. Of particular interest is the case where the available forward model evaluations are subject to rapid fluctuations, in parameter space, superimposed on the smoothly varying large scale parametric structure of interest. {A motivating example from climate science is presented, and ensemble Kalman methods (which do not use the derivative of the parameter-to-data map) are shown, empirically, to perform well. Multiscale analysis is then used to analyze the behaviour of interacting particle system algorithms when rapid fluctuations, which we refer to as noise, pollute the large scale parametric dependence of the parameter-to-data map. Ensemble Kalman methods and Langevin-based methods} (the latter use the derivative of the parameter-to-data map) are compared in this light. The ensemble Kalman methods are shown to behave favourably in the presence of noise in the parameter-to-data map, whereas Langevin methods are adversely affected. On the other hand, Langevin methods have the correct equilibrium distribution in the setting of noise-free forward models, whilst ensemble Kalman methods only provide an uncontrolled approximation, except in the linear case. Therefore a new class of algorithms, ensemble Gaussian process samplers, which combine the benefits of both ensemble Kalman and Langevin methods, are introduced and shown to perform favourably.


title: Primary decomposition of modules: a computational differential approach

abstract: We study primary submodules and primary decompositions from a differential and computational point of view. Our main theoretical contribution is a general structure theory and a representation theorem for primary submodules of an arbitrary finitely generated module over a polynomial ring. We characterize primary submodules in terms of differential operators and punctual Quot schemes. Moreover, we introduce and implement an algorithm that computes a minimal differential primary decomposition for a module.


title: Ricci Flow with Ricci Curvature and Volume Bounded Below

abstract: We show that a simply-connected closed four-dimensional Ricci flow whose Ricci curvature is uniformly bounded below and whose volume does not approach zero must converge to a $C^{0}$ orbifold at any finite-time singularity, so has an extension through the singularity via orbifold Ricci flow. Moreover, a Type-I blowup of the flow based at any orbifold point converges to a flat cone in the Gromov-Hausdorff sense, without passing to a subsequence. In addition, we prove $L^{p}$ bounds for the curvature tensor on time-slices for any $p<2$. In higher dimensions, we show that every singular point of the flow is a Type-II point, and that any tangent flow at a singular point is a static flow corresponding to a Ricci flat cone.


title: Bulk modulus of soft particle assemblies under compression

abstract: Using a numerical approach based on the coupling of the discrete and finite element methods, we explore the variation of the bulk modulus K of soft particle assemblies undergoing isotropic compression. As the assemblies densify under pressure-controlled boundary conditions, we show that the non-linearities of K rapidly deviate from predictions standing on a small-strain framework or the Equivalent Medium Theory (EMT). Using the granular stress tensor and extracting the bulk properties of single representative grains under compression, we propose a model to predict the evolution of K as a function of the sample's solid fraction and a reference state as the applied pressure P tends to zero. The model closely reproduces the trends observed in our numerical experiments confirming the behavior scalability of soft particle assemblies from the individual particle scale. Finally, we present the effect of the interparticle friction on K's evolution and how our model easily adapts to such a mechanical constraint.


title: DJXPerf: Identifying Memory Inefficiencies via Object-centric Profiling for Java

abstract: Java is the "go-to" programming language choice for developing scalable enterprise cloud applications. In such systems, even a few percent CPU time savings can offer a significant competitive advantage and cost saving. Although performance tools abound in Java, those that focus on the data locality in the memory hierarchy are rare. In this paper, we present DJXPerf, a lightweight, object-centric memory profiler for Java, which associates memory-hierarchy performance metrics (e.g., cache/TLB misses) with Java objects. DJXPerf uses statistical sampling of hardware performance monitoring counters to attribute metrics to not only source code locations but also Java objects. DJXPerf presents Java object allocation contexts combined with their usage contexts and presents them ordered by the poor locality behaviors. DJXPerf's performance measurement, object attribution, and presentation techniques guide optimizing object allocation, layout, and access patterns. DJXPerf incurs only ~8% runtime overhead and ~5% memory overhead on average, requiring no modifications to hardware, OS, Java virtual machine, or application source code, which makes it attractive to use in production. Guided by DJXPerf, we study and optimize a number of Java and Scala programs, including well-known benchmarks and real-world applications, and demonstrate significant speedups.


title: Indirect stability of a multidimensional coupled wave equations with one locally boundary fractional damping

abstract: In this work, we consider a system of multidimensional wave equations coupled by velocities with one localized fractional boundary damping. First, using a general criteria of Arendt- Batty, by assuming that the boundary control region satisfy some geometric conditions, under the equality speed propagation and the coupling parameter of the two equations is small enough, we show the strong stability of our system in the absence of the compactness of the resolvent. Our system is not uniformly stable in general since it is the case of the interval. Hence, we look for a polynomial decay rate for smooth initial data for our system by applying a frequency domain approach combining with a multiplier method. Indeed, by assuming that the boundary control region satisfy some geometric conditions and the waves propagate with equal speed and the coupling parameter term is small enough, we establish a polynomial energy decay rate for smooth solutions, which depends on the order of the fractional derivative.


title: Geometrically Induced Selectivity and Unidirectional Electroosmosis in Uncharged Nanopores

abstract: Selectivity towards positive and negative ions in nanopores is often associated with electroosmotic flow, the control of which is pivotal in several micro-nanofluidic technologies. Selectivity is traditionally understood to be a consequence of surface charges that alter the ion distribution in the pore lumen. Here we present a purely geometrical mechanism to induce ionic selectivity and electroosmotic flow in uncharged nanopores and we tested it via molecular dynamics simulations. Our approach exploits the accumulation of charges, driven by an external electric field, in a coaxial cavity that decorates the membrane close to the pore entrance. The selectivity was shown to depend on the applied voltage and results to be completely inverted when reverting the voltage. The simultaneous inversion of ionic selectivity and electric field direction causes a unidirectional electroosmotic flow. We developed a quantitatively accurate theoretical model for designing pore geometry to achieve the desired electroosmotic velocity. Finally, we demonstrate that unidirectional electroosmosis also occurs for a biological pore whose structure presents a coaxial cavity surrounding the pore constriction. The capability to induce ion selectivity without altering the pore lumen shape or the surface charge may open the way to a more flexible design of selective membranes.


title: Interpreting Verbal Metaphors by Paraphrasing

abstract: Metaphorical expressions are difficult linguistic phenomena, challenging diverse Natural Language Processing tasks. Previous works showed that paraphrasing a metaphor as its literal counterpart can help machines better process metaphors on downstream tasks. In this paper, we interpret metaphors with BERT and WordNet hypernyms and synonyms in an unsupervised manner, showing that our method significantly outperforms the state-of-the-art baseline. We also demonstrate that our method can help a machine translation system improve its accuracy in translating English metaphors to 8 target languages.


title: Edsger W. Dijkstra: a Commemoration

abstract: This article is a multiauthored portrait of Edsger Wybe Dijkstra that consists of testimonials written by several friends, colleagues, and students of his. It provides unique insights into his personality, working style and habits, and his influence on other computer scientists, as a researcher, teacher, and mentor.


title: Contour Proposal Networks for Biomedical Instance Segmentation

abstract: We present a conceptually simple framework for object instance segmentation called Contour Proposal Network (CPN), which detects possibly overlapping objects in an image while simultaneously fitting closed object contours using an interpretable, fixed-sized representation based on Fourier Descriptors. The CPN can incorporate state of the art object detection architectures as backbone networks into a single-stage instance segmentation model that can be trained end-to-end. We construct CPN models with different backbone networks, and apply them to instance segmentation of cells in datasets from different modalities. In our experiments, we show CPNs that outperform U-Nets and Mask R-CNNs in instance segmentation accuracy, and present variants with execution times suitable for real-time applications. The trained models generalize well across different domains of cell types. Since the main assumption of the framework are closed object contours, it is applicable to a wide range of detection problems also outside the biomedical domain. An implementation of the model architecture in PyTorch is freely available.


title: A bivariate likelihood approach for estimation of a pooled continuous effect size from a heteroscedastic meta-analysis study

abstract: The DerSimonian-Laird (DL) weighted average method has been widely used for estimation of a pooled effect size from an aggregated data meta-analysis study. It is mainly criticized for its underestimation of the standard error of the pooled effect size in the presence of heterogeneous study effect sizes. The uncertainty in the estimation of the between-study variance is not accounted for in the calculation of this standard error. Due to this negative property, many alternative estimation approaches have been proposed in literature. One approach was developed by Hardy and Thompson (HT), who implemented a profile likelihood approach instead of the moment-based approach of DL. Others have further extended the likelihood approach and proposed higher-order likelihood inferences (e.g., Bartlett-type corrections). Likelihood-based methods better address the uncertainty in estimating the between-study variance than the DL method, but all these methods assume that the within-study standard deviations are known and equal to the observed standard error of the study effect sizes. Here we treat the observed standard errors as estimators for the within-study variability and we propose a bivariate likelihood approach that jointly estimates the pooled effect size, the between-study variance, and the potentially heteroscedastic within-study variances. We study the performance of the proposed method by means of simulation, and compare it to DL, HT, and the higher-order likelihood methods. Our proposed approach appears to be less sensitive to the number of studies, and less biased in case of heteroscedasticity.


title: Bayesian estimation of dynamic weights in Gaussian mixture models

abstract: This paper proposes a generalization of Gaussian mixture models, where the mixture weight is allowed to behave as an unknown function of time. This model is capable of successfully capturing the features of the data, as demonstrated by simulated and real datasets. It can be useful in studies such as clustering, change-point and process control. In order to estimate the mixture weight function, we propose two new Bayesian nonlinear dynamic approaches for polynomial models, that can be extended to other problems involving polynomial nonlinear dynamic models. One of the methods, called here component-wise Metropolis-Hastings, apply the Metropolis-Hastings algorithm to each local level component of the state equation. It is more general and can be used in any situation where the observation and state equations are nonlinearly connected. The other method tends to be faster, but is applied specifically to binary data (using the probit link function). The performance of these methods of estimation, in the context of the proposed dynamic Gaussian mixture model, is evaluated through simulated datasets. Also, an application to an array Comparative Genomic Hybridization (aCGH) dataset from glioblastoma cancer illustrates our proposal, highlighting the ability of the method to detect chromosome aberrations.


title: Polynomials associated to non-convex bodies

abstract: Polynomial spaces associated to a convex body $C$ in $({\bf R}^+)^d$ have been the object of recent studies. In this work, we consider polynomial spaces associated to non-convex $C$. We develop some basic pluripotential theory including notions of $C-$extremal plurisubharmonic functions $V_{C,K}$ for $K\subset {\bf C}^d$ compact. Using this, we discuss Bernstein-Walsh type polynomial approximation results and asymptotics of random polynomials in this non-convex setting.


title: Equivariant Estimation of Fr\'echet Means

abstract: The Fr\'echet mean generalizes the concept of a mean to a metric space setting. In this work we consider equivariant estimation of Fr\'echet means for parametric models on metric spaces that are Riemannian manifolds. The geometry and symmetry of such a space is encoded by its isometry group. Estimators that are equivariant under the isometry group take into account the symmetry of the metric space. For some models there exists an optimal equivariant estimator, which necessarily will perform as well or better than other common equivariant estimators, such as the maximum likelihood estimator or the sample Fr\'echet mean. We derive the general form of this minimum risk equivariant estimator and in a few cases provide explicit expressions for it. In other models the isometry group is not large enough relative to the parametric family of distributions for there to exist a minimum risk equivariant estimator. In such cases, we introduce an adaptive equivariant estimator that uses the data to select a submodel for which there is an MRE. Simulations results show that the adaptive equivariant estimator performs favorably relative to alternative estimators.


title: Adaptive treatment allocation and selection in multi-arm clinical trials: a Bayesian perspective

abstract: Clinical trials are an instrument for making informed decisions based on evidence from well-designed experiments. Here we consider adaptive designs mainly from the perspective of multi-arm Phase II clinical trials, in which one or more experimental treatments are compared to a control. Treatment allocation of individual trial participants is assumed to take place according to a fixed block randomization, albeit with an important twist: The performance of each treatment arm is assessed after every measured outcome, in terms of the posterior distribution of a corresponding model parameter. Different treatments arms are then compared to each other, according to pre-defined criteria and using the joint posterior as the basis for such assessment. If a treatment is found to be sufficiently clearly inferior to the currently best candidate, it can be closed off either temporarily or permanently from further participant accrual. The latter possibility provides a method for adaptive treatment selection, including early stopping of the trial. The main development in the paper is in terms of binary outcomes, but some extensions, notably for handling time-to-event data, are discussed as well. The presentation is to a large extent comparative and expository.


title: Theory of tunneling spectra for a few-electron bilayer graphene quantum dot

abstract: The tuneability and control of quantum nanostructures in two-dimensional materials offer promising perspectives for their use in future electronics. It is hence necessary to analyze quantum transport in such nanostructures. Material properties such as a complex dispersion, topology, and charge carriers with multiple degrees of freedom, are appealing for novel device functionalities but complicate their theoretical description. Here, we study quantum tunnelling transport across a few-electron bilayer graphene quantum dot. We demonstrate how to uniquely identify single- and two-electron dot states' orbital, spin, and valley composition from differential conductance in a finite magnetic field. Furthermore, we show that the transport features manifest splittings in the dot's spin and valley multiplets induced by interactions and magnetic field (the latter splittings being a consequence of bilayer graphene's Berry curvature). Our results elucidate spin- and valley-dependent tunnelling mechanisms and will help to utilize bilayer graphene quantum dots, e.g., as spin and valley qubits.


title: Testing photoevaporation and MHD disk wind models through future high-angular resolution radio observations: the case of TW Hydrae

abstract: We present theoretical predictions for the free-free emission at cm wavelengths obtained from photoevaporation and MHD wind disk models adjusted to the case of the TW Hydrae young stellar object. For this system, disk photoevaporation with heating due to the high-energy photons from the star has been proposed as a possible mechanism to open the gap observed in the dust emission with ALMA. We show that the photoevaporation disk model predicts a radial profile for the free-free emission that is made of two main spatial components, one originated from the bound disk atmosphere at 0.5-1 au from the star, and another more extended component from the photoevaporative wind at larger disk radii. We also show that the stellar X-ray luminosity has a significant impact on both these components. The predicted radio emission from the MHD wind model has a smoother radial distribution which extends to closer distances to the star than the photoevaporation case. We also show that a future radio telescope such as the \textit{Next Generation Very Large Array} (ngVLA) would have enough sensitivity and angular resolution to spatially resolve the main structures predicted by these models.


title: Hybrid design of spectral splitters and concentrators of light for solar cells using iterative search and neural networks

abstract: The need for optically multi-functional micro- and nano-structures is growing in various fields. Designing such structures is impeded by the lack of computationally low-cost algorithms. In this study, we present a hybrid design scheme, which relies on a deep learning model and the local search optimization algorithm, to optimize a diffractive optical element that performs spectral splitting and spatial concentration of broadband light for solar cells. Using generated data set during optimization of a diffractive optical element, which is a one-time effort, we design topography of diffractive optical elements by using a deep learning-based inverse design scheme. We show that further iterative optimization of the reconstructed diffractive optical elements increases amount of spatially concentrated and spectrally split light. Our joint design approach both speeds up optimization of diffractive optical elements as well as providing better performance at least 57% excess light concentration with spectral splitting. The algorithm that we develop here will enable advanced and efficient design of multi-functional phase plates in various fields besides the application that we target in solar energy. The algorithm that we develop is openly available to contribute to other applications that rely on phase plates.


title: A review on arbitrarily regular conforming virtual element methods for elliptic partial differential equations

abstract: The Virtual Element Method is well suited to the formulation of arbitrarily regular Galerkin approximations of elliptic partial differential equations of order $2p_1$, for any integer $p_1\geq 1$. In fact, the virtual element paradigm provides a very effective design framework for conforming, finite dimensional subspaces of $H^{p_2}(\Omega)$, $\Omega$ being the computational domain and $p_2\geq p_1$ another suitable integer number. In this study, we first present an abstract setting for such highly regular approximations and discuss the mathematical details of how we can build conforming approximation spaces with a global high-order continuity on $\Omega$. Then, we illustrate specific examples in the case of second- and fourth-order partial differential equations, that correspond to the cases $p_1=1$ and $2$, respectively. Finally, we investigate numerically the effect on the approximation properties of the conforming highly-regular method that results from different choices of the degree of continuity of the underlying virtual element spaces and how different stabilization strategies may impact on convergence.


title: Triplot: model agnostic measures and visualisations for variable importance in predictive models that take into account the hierarchical correlation structure

abstract: One of the key elements of explanatory analysis of a predictive model is to assess the importance of individual variables. Rapid development of the area of predictive model exploration (also called explainable artificial intelligence or interpretable machine learning) has led to the popularization of methods for local (instance level) and global (dataset level) methods, such as Permutational Variable Importance, Shapley Values (SHAP), Local Interpretable Model Explanations (LIME), Break Down and so on. However, these methods do not use information about the correlation between features which significantly reduce the explainability of the model behaviour. In this work, we propose new methods to support model analysis by exploiting the information about the correlation between variables. The dataset level aspect importance measure is inspired by the block permutations procedure, while the instance level aspect importance measure is inspired by the LIME method. We show how to analyze groups of variables (aspects) both when they are proposed by the user and when they should be determined automatically based on the hierarchical structure of correlations between variables. Additionally, we present the new type of model visualisation, triplot, which exploits a hierarchical structure of variable grouping to produce a high information density model visualisation. This visualisation provides a consistent illustration for either local or global model and data exploration. We also show an example of real-world data with 5k instances and 37 features in which a significant correlation between variables affects the interpretation of the effect of variable importance. The proposed method is, to our knowledge, the first to allow direct use of the correlation between variables in exploratory model analysis.


title: Bootstrapping of memetic from genetic evolution via inter-agent selection pressures

abstract: We create an artificial system of agents (attention-based neural networks) which selectively exchange messages with each-other in order to study the emergence of memetic evolution and how memetic evolutionary pressures interact with genetic evolution of the network weights. We observe that the ability of agents to exert selection pressures on each-other is essential for memetic evolution to bootstrap itself into a state which has both high-fidelity replication of memes, as well as continuing production of new memes over time. However, in this system there is very little interaction between this memetic 'ecology' and underlying tasks driving individual fitness - the emergent meme layer appears to be neither helpful nor harmful to agents' ability to learn to solve tasks. Sourcecode for these experiments is available at https://github.com/GoodAI/memes


title: Rational approximations to two irrational numbers

abstract: For real $\xi$ we consider the irrationality measure function $\psi_\xi(t) = \min_{1\leqslant q \leqslant t, q\in\mathbb{Z}} || q\xi ||$, where $||\cdot||$ - distance to the nearest integer. We prove that in the case $\alpha\pm\beta\notin\mathbb{Z}$ there exist arbitrary large values of $t$ with $$\Bigl | \frac{1}{\psi_\alpha(t)} - \frac{1}{\psi_\beta(t)} \Bigl | \geqslant \sqrt5\left(1-\sqrt{\frac{\sqrt5-1}{2}}\right)t.$$ The constant on the right-hand side is optimal.


title: Evolutionary rates of information gain and decay in fluctuating environments

abstract: In this paper, we wish to investigate the dynamics of information transfer in evolutionary dynamics. We use information theoretic tools to track how much information an evolving population has obtained and managed to retain about different environments that it is exposed to. By understanding the dynamics of information gain and loss in a static environment, we predict how that same evolutionary system would behave when the environment is fluctuating. Specifically, we anticipate a cross-over between the regime in which fluctuations improve the ability of the evolutionary system to capture environmental information and the regime in which the fluctuations inhibit it, governed by a cross-over in the timescales of information gain and decay.


title: The Impact of Tomographic Redshift Bin Width Errors on Cosmological Probes

abstract: Systematic errors in the galaxy redshift distribution $n(z)$ can propagate to systematic errors in the derived cosmology. We characterize how the degenerate effects in tomographic bin widths and galaxy bias impart systematic errors on cosmology inference using observational data from the Deep Lens Survey. For this we use a combination of galaxy clustering and galaxy-galaxy lensing. We present two end-to-end analyses from the catalogue level to parameter estimation. We produce an initial cosmological inference using fiducial tomographic redshift bins derived from photometric redshifts, then compare this with a result where the redshift bins are empirically corrected using a set of spectroscopic redshifts. We find that the derived parameter $S_8 \equiv \sigma_8 (\Omega_m/.3)^{1/2}$ goes from $.841^{+0.062}_{-.061}$ to $.739^{+.054}_{-.050}$ upon correcting the n(z) errors in the second method.


title: Nanosecond machine learning event classification with boosted decision trees in FPGA for high energy physics

abstract: We present a novel implementation of classification using the machine learning / artificial intelligence method called boosted decision trees (BDT) on field programmable gate arrays (FPGA). The firmware implementation of binary classification requiring 100 training trees with a maximum depth of 4 using four input variables gives a latency value of about 10 ns, independent of the clock speed from 100 to 320 MHz in our setup. The low timing values are achieved by restructuring the BDT layout and reconfiguring its parameters. The FPGA resource utilization is also kept low at a range from 0.01% to 0.2% in our setup. A software package called fwXmachina achieves this implementation. Our intended user is an expert of custom electronics-based trigger systems in high energy physics experiments or anyone that needs decisions at the lowest latency values for real-time event classification. Two problems from high energy physics are considered, in the separation of electrons vs. photons and in the selection of vector boson fusion-produced Higgs bosons vs. the rejection of the multijet processes.


title: A systematic variational approach to band theory in a quantum computer

abstract: Quantum computers promise to revolutionize our ability to simulate molecules, and cloud-based hardware is becoming increasingly accessible to a wide body of researchers. Algorithms such as Quantum Phase Estimation and the Variational Quantum Eigensolver are being actively developed and demonstrated in small systems. However, extremely limited qubit count and low fidelity seriously limit useful applications, especially in the crystalline phase, where compact orbital bases are difficult to develop. To address this difficulty, we present a hybrid quantum-classical algorithm to solve the band structure of any periodic system described by an adequate tight-binding model. We showcase our algorithm by computing the band structure of a simple-cubic crystal with one $s$ and three $p$ orbitals per site (a simple model for Polonium) using simulators with increasingly realistic levels of noise and culminating with calculations on IBM quantum computers. Our results show that the algorithm is reliable in a low-noise device, functional with low precision on present-day noisy quantum computers, and displays a complexity that scales as $\Omega(M^3)$ with the number $M$ of tight-binding orbitals per unit-cell, similarly to its classical counterparts. Our simulations offer a new insight into the ``quantum'' mindset and demonstrate how the algorithms under active development today can be optimized in special cases, such as band structure calculations.


title: Potential theory with multivariate kernels

abstract: In the present paper we develop the theory of minimization for energies with multivariate kernels, i.e. energies, in which pairwise interactions are replaced by interactions between triples or, more generally, $n$-tuples of particles. Such objects, which arise naturally in various fields, present subtle differences and complications when compared to the classical two-input case. We introduce appropriate analogues of conditionally positive definite kernels, establish a series of relevant results in potential theory, explore rotationally invariant energies on the sphere, and present a variety of interesting examples, in particular, some optimization problems in probabilistic geometry which are related to multivariate versions of the Riesz energies.


title: A New Blind Asteroid Detection Scheme

abstract: As astronomical photometric surveys continue to tile the sky repeatedly, the potential to pushdetection thresholds to fainter limits increases; however, traditional digital-tracking methods cannotachieve this efficiently beyond time scales where motion is approximately linear. In this paper weprototype an optimal detection scheme that samples under a user defined prior on a parameterizationof the motion space, maps these sampled trajectories to the data space, and computes an optimalsignal-matched filter for computing the signal to noise ratio of trial trajectories. We demonstrate thecapability of this method on a small test data set from the Dark Energy Camera. We recover themajority of asteroids expected to appear and also discover hundreds of new asteroids with only a fewhours of observations. We conclude by exploring the potential for extending this scheme to larger datasets that cover larger areas of the sky over longer time baselines.


title: Leaderless collective motions in affine formation control

abstract: This paper proposes a novel distributed technique to induce collective motions in affine formation control. Instead of the traditional leader-follower strategy, we propose modifying the original weights that build the Laplacian matrix so that a designed steady-state motion of the desired shape emerges from the agents' local interactions. The proposed technique allows a rich collection of collective motions such as rotations around the centroid, translations, scalings, and shearings of a reference shape. These motions can be applied in useful collective behaviors such as \emph{shaped} consensus (the rendezvous with a particular shape), escorting one of the team agents, or area coverage. We prove the global stability and effectiveness of our proposed technique rigorously, and we provide some illustrative numerical simulations.


title: Rethinking the Backdoor Attacks' Triggers: A Frequency Perspective

abstract: Backdoor attacks have been considered a severe security threat to deep learning. Such attacks can make models perform abnormally on inputs with predefined triggers and still retain state-of-the-art performance on clean data. While backdoor attacks have been thoroughly investigated in the image domain from both attackers' and defenders' sides, an analysis in the frequency domain has been missing thus far. This paper first revisits existing backdoor triggers from a frequency perspective and performs a comprehensive analysis. Our results show that many current backdoor attacks exhibit severe high-frequency artifacts, which persist across different datasets and resolutions. We further demonstrate these high-frequency artifacts enable a simple way to detect existing backdoor triggers at a detection rate of 98.50% without prior knowledge of the attack details and the target model. Acknowledging previous attacks' weaknesses, we propose a practical way to create smooth backdoor triggers without high-frequency artifacts and study their detectability. We show that existing defense works can benefit by incorporating these smooth triggers into their design consideration. Moreover, we show that the detector tuned over stronger smooth triggers can generalize well to unseen weak smooth triggers. In short, our work emphasizes the importance of considering frequency analysis when designing both backdoor attacks and defenses in deep learning.


title: PrivateSNN: Privacy-Preserving Spiking Neural Networks

abstract: How can we bring both privacy and energy-efficiency to a neural system? In this paper, we propose PrivateSNN, which aims to build low-power Spiking Neural Networks (SNNs) from a pre-trained ANN model without leaking sensitive information contained in a dataset. Here, we tackle two types of leakage problems: 1) Data leakage is caused when the networks access real training data during an ANN-SNN conversion process. 2) Class leakage is caused when class-related features can be reconstructed from network parameters. In order to address the data leakage issue, we generate synthetic images from the pre-trained ANNs and convert ANNs to SNNs using the generated images. However, converted SNNs remain vulnerable to class leakage since the weight parameters have the same (or scaled) value with respect to ANN parameters. Therefore, we encrypt SNN weights by training SNNs with a temporal spike-based learning rule. Updating weight parameters with temporal data makes SNNs difficult to be interpreted in the spatial domain. We observe that the encrypted PrivateSNN eliminates data and class leakage issues with a slight performance drop (less than ~2) and significant energy-efficiency gain (about 55x) compared to the standard ANN. We conduct extensive experiments on various datasets including CIFAR10, CIFAR100, and TinyImageNet, highlighting the importance of privacy-preserving SNN training.


title: Transients from ONe White-Dwarf - Neutron-Star/Black-Hole Mergers

abstract: We conduct the first 3D hydrodynamic simulations of oxygen-neon white dwarf-neutron star/black hole mergers (ONe WD-NS/BH mergers). Such mergers constitute a significant fraction, and may even dominate, the inspiral rates of all WD-NS binaries. We post-process our simulations to obtain the nuclear evolution of these systems and couple the results to a supernova spectral synthesis code to obtain the first light curves and spectra for these transients. We find that the amount of $^{56}$Ni synthesised in these mergers grows as a strong function of the WD mass, reaching typically $0.05$ and up to $0.1\,{\rm M}_\odot$ per merger. Photodisintegration leads to similar amounts of $^4$He and about a ten times smaller amount of $^1$H. The nuclear yields from these mergers, in particular those of $^{55}$Mn, may contribute significantly to Galactic chemical evolution. The transients expected from ONe WD-NS mergers are dominantly red/infrared, evolve on month-long timescales and reach bolometric magnitudes of up to -16.5. The current surveys must have already detected these transients or are, alternatively, putting strong constraints on merger scenarios. The properties of the expected transients from WD-NS mergers best agree with faint type Iax supernovae. The Vera Rubin Observatory (LSST) will be detecting up to thousands of merging ONe WD-NS systems per year. We simulate a subset of our models with 2D axisymmetric FLASH code to investigate why they have been challenging for previous studies. We find that the likely main challenge has been effectively modelling the nuclear statistical equilibrium regime in such mergers.


title: Pushing the Limits of Non-Autoregressive Speech Recognition

abstract: We combine recent advancements in end-to-end speech recognition to non-autoregressive automatic speech recognition. We push the limits of non-autoregressive state-of-the-art results for multiple datasets: LibriSpeech, Fisher+Switchboard and Wall Street Journal. Key to our recipe, we leverage CTC on giant Conformer neural network architectures with SpecAugment and wav2vec2 pre-training. We achieve 1.8%/3.6% WER on LibriSpeech test/test-other sets, 5.1%/9.8% WER on Switchboard, and 3.4% on the Wall Street Journal, all without a language model.


title: Spectral statistics of high dimensional sample covariance matrix with unbounded population spectral norm

abstract: In this paper, we establish some new central limit theorems for certain spectral statistics of a high-dimensional sample covariance matrix under a divergent spectral norm population model. This model covers the divergent spiked population model as a special case. Meanwhile, the number of the spiked eigenvalues can either be fixed or grow to infinity. It is seen from our theorems that the divergence of population spectral norm affects the fluctuations of the linear spectral statistics in a fickle way, depending on the divergence rate.


title: Quantum Enhanced Filter: QFilter

abstract: Convolutional Neural Networks (CNN) are used mainly to treat problems with many images characteristic of Deep Learning. In this work, we propose a hybrid image classification model to take advantage of quantum and classical computing. The method will use the potential that convolutional networks have shown in artificial intelligence by replacing classical filters with variational quantum filters. Similarly, this work will compare with other classification methods and the system's execution on different servers. The algorithm's quantum feasibility is modelled and tested on Amazon Braket Notebook instances and experimented on the Pennylane's philosophy and framework.


title: Towards On-Device Face Recognition in Body-worn Cameras

abstract: Face recognition technology related to recognizing identities is widely adopted in intelligence gathering, law enforcement, surveillance, and consumer applications. Recently, this technology has been ported to smartphones and body-worn cameras (BWC). Face recognition technology in body-worn cameras is used for surveillance, situational awareness, and keeping the officer safe. Only a handful of academic studies exist in face recognition using the body-worn camera. A recent study has assembled BWCFace facial image dataset acquired using a body-worn camera and evaluated the ResNet-50 model for face identification. However, for real-time inference in resource constraint body-worn cameras and privacy concerns involving facial images, on-device face recognition is required. To this end, this study evaluates lightweight MobileNet-V2, EfficientNet-B0, LightCNN-9 and LightCNN-29 models for face identification using body-worn camera. Experiments are performed on a publicly available BWCface dataset. The real-time inference is evaluated on three mobile devices. The comparative analysis is done with heavy-weight VGG-16 and ResNet-50 models along with six hand-crafted features to evaluate the trade-off between the performance and model size. Experimental results suggest the difference in maximum rank-1 accuracy of lightweight LightCNN-29 over best-performing ResNet-50 is \textbf{1.85\%} and the reduction in model parameters is \textbf{23.49M}. Most of the deep models obtained similar performances at rank-5 and rank-10. The inference time of LightCNNs is 2.1x faster than other models on mobile devices. The least performance difference of \textbf{14\%} is noted between LightCNN-29 and Local Phase Quantization (LPQ) descriptor at rank-1. In most of the experimental settings, lightweight LightCNN models offered the best trade-off between accuracy and the model size in comparison to most of the models.


title: On-FPGA Training with Ultra Memory Reduction: A Low-Precision Tensor Method

abstract: Various hardware accelerators have been developed for energy-efficient and real-time inference of neural networks on edge devices. However, most training is done on high-performance GPUs or servers, and the huge memory and computing costs prevent training neural networks on edge devices. This paper proposes a novel tensor-based training framework, which offers orders-of-magnitude memory reduction in the training process. We propose a novel rank-adaptive tensorized neural network model, and design a hardware-friendly low-precision algorithm to train this model. We present an FPGA accelerator to demonstrate the benefits of this training method on edge devices. Our preliminary FPGA implementation achieves $59\times$ speedup and $123\times$ energy reduction compared to embedded CPU, and $292\times$ memory reduction over a standard full-size training.


title: Toward the detection of moving separation in unsteady flows

abstract: In many engineering systems operating with a working fluid, the best efficiency is reached close to a condition of flow separation, which makes its prediction very crucial in industry. Providing that wall-based quantities can be measured, we know today how to obtain good predictions for two and three-dimensional steady and periodic flows. In these flows, the separation is defined on a fixed line attached to a material surface. The last case to elucidate is the one where this line is no longer attached to the wall but on the contrary is contained within the flow. This moving separation is probably, however, the most common case of separation in natural flows and industrial applications. Since this case has received less attention during the past few years, we propose in this study to examine some properties of moving separation in two-dimensional, unsteady flows where the separation does not leave a signature on the wall. Since in this framework separation can be extracted by using a Lagrangian frame where the separation profile can be viewed as a hyperbolic unstable manifold, we propose a method to extract the separation point defined by the Lagrangian saddle point that belongs to this unstable manifold. In practice, the separation point and profile are initially extracted by detecting the most attracting Lagrangian coherent structure near the wall, and can then be advected in time for following instants. It is found that saddle points, which initially act as separation points in the viscous wall flow region, remarkably preserve their hyperbolicity even if they are ejected from the wall toward the inviscid region. Two test cases are studied, the creeping flow of a rotating and translating cylinder close to a wall, and the unsteady separation in the boundary layer generated by a planar jet impinging onto a plane wall.


title: Importance of tidal resonances in extreme-mass-ratio inspirals

abstract: Extreme mass ratio inspirals (EMRIs) will be important sources for future space-based gravitational-wave detectors. In recent work, tidal resonances in binary orbital evolution induced by the tidal field of nearby stars or black holes have been identified as being potentially significant in the context of extreme mass-ratio inspirals. These resonances occur when the three orbital frequencies describing the orbit are commensurate. During the resonance, the orbital parameters of the small body experience a jump leading to a shift in the phase of the gravitational waveform. In this paper, we treat the tidal perturber as stationary and restricted to the equatorial plane, and present a first study of how common and important such resonances are over the entire orbital parameter space. We find that a large proportion of inspirals encounter a low-order resonance in the observationally important regime. While the instantaneous effect of a tidal resonance is small, its effect on the accumulated phase of the gravitational waveform of an EMRI system can be significant due to its many cycles in band; we estimate that the effect is detectable for a significant fraction of sources. We also provide fitting formulae for the induced change in the constants of motion of the orbit due to the tidal resonance for several low-order resonances.


title: Polynomial log-volume growth in slow dynamics and the GK-dimensions of twisted homogeneous coordinate rings

abstract: Let f be a zero entropy automorphism of a compact K\"ahler manifold X. We study the polynomial log-volume growth Plov(f) of f in light of the dynamical filtrations introduced in our previous work with T.-C. Dinh. We obtain new upper bounds and lower bounds of Plov(f). As a corollary, we completely determine Plov(f) when dim X = 3, extending a result of Artin--Van den Bergh for surfaces. When X is projective, Plov(f) + 1 coincides with the Gelfand--Kirillov dimensions GKdim(X,f) of the twisted homogeneous coordinate rings associated to (X,f). Reformulating these results for GKdim(X,f), we improve Keeler's bounds of GKdim(X,f) and provide effective upper bounds of GKdim(X,f) which only depend on dim X.


title: Track, Check, Repeat: An EM Approach to Unsupervised Tracking

abstract: We propose an unsupervised method for detecting and tracking moving objects in 3D, in unlabelled RGB-D videos. The method begins with classic handcrafted techniques for segmenting objects using motion cues: we estimate optical flow and camera motion, and conservatively segment regions that appear to be moving independently of the background. Treating these initial segments as pseudo-labels, we learn an ensemble of appearance-based 2D and 3D detectors, under heavy data augmentation. We use this ensemble to detect new instances of the "moving" type, even if they are not moving, and add these as new pseudo-labels. Our method is an expectation-maximization algorithm, where in the expectation step we fire all modules and look for agreement among them, and in the maximization step we re-train the modules to improve this agreement. The constraint of ensemble agreement helps combat contamination of the generated pseudo-labels (during the E step), and data augmentation helps the modules generalize to yet-unlabelled data (during the M step). We compare against existing unsupervised object discovery and tracking methods, using challenging videos from CATER and KITTI, and show strong improvements over the state-of-the-art.


title: Maximal and minimal dynamic Petri net slicing

abstract: Context: Petri net slicing is a technique to reduce the size of a Petri net to ease the analysis or understanding of the original Petri net. Objective: Presenting two new Petri net slicing algorithms to isolate those places and transitions of a Petri net (the slice) that may contribute tokens to one or more places given (the slicing criterion). Method: The two algorithms proposed are formalized. The maximality of the first algorithm and the minimality of the second algorithm are formally proven. Both algorithms, together with three other state-of-the-art algorithms, have been implemented and integrated into a single tool so that we have been able to carry out a fair empirical evaluation. Results: Besides the two new Petri net slicing algorithms, a public, free, and open-source implementation of five algorithms is reported. The results of an empirical evaluation of the new algorithms and the slices they produce are also presented. Conclusions: The first algorithm collects all places and transitions that may contribute tokens (in any computation) to the slicing criterion, while the second algorithm collects the places and transitions needed to fire the shortest transition sequence that contributes tokens to some place in the slicing criterion. Therefore, the net computed by the first algorithm can reproduce any computation that contributes tokens to any place of interest. In contrast, the second algorithm loses this possibility, but it often produces a much more reduced subnet (which still can reproduce some computations that contribute tokens to some places of interest). The first algorithm is proven maximal, and the second one is proven minimal.


title: Analytical solution of stochastic resonance in the nonadiabatic regime

abstract: We generalize stochastic resonance to the nonadiabatic limit by treating the double-well potential using two quadratic potentials. We use a singular perturbation method to determine an approximate analytical solution for the probability density function that asymptotically connects local solutions in boundary layers near the two minima with those in the region of the maximum that separates them. The validity of the analytical solution is confirmed numerically. Free from the constraints of the adiabatic limit, the approach allows us to predict the escape rate from one stable basin to another for systems experiencing a more complex periodic forcing.


title: FatNet: A Feature-attentive Network for 3D Point Cloud Processing

abstract: The application of deep learning to 3D point clouds is challenging due to its lack of order. Inspired by the point embeddings of PointNet and the edge embeddings of DGCNNs, we propose three improvements to the task of point cloud analysis. First, we introduce a novel feature-attentive neural network layer, a FAT layer, that combines both global point-based features and local edge-based features in order to generate better embeddings. Second, we find that applying the same attention mechanism across two different forms of feature map aggregation, max pooling and average pooling, gives better performance than either alone. Third, we observe that residual feature reuse in this setting propagates information more effectively between the layers, and makes the network easier to train. Our architecture achieves state-of-the-art results on the task of point cloud classification, as demonstrated on the ModelNet40 dataset, and an extremely competitive performance on the ShapeNet part segmentation challenge.


title: Generating Multi-type Temporal Sequences to Mitigate Class-imbalanced Problem

abstract: From the ad network standpoint, a user's activity is a multi-type sequence of temporal events consisting of event types and time intervals. Understanding user patterns in ad networks has received increasing attention from the machine learning community. Particularly, the problems of fraud detection, Conversion Rate (CVR), and Click-Through Rate (CTR) prediction are of interest. However, the class imbalance between major and minor classes in these tasks can bias a machine learning model leading to poor performance. This study proposes using two multi-type (continuous and discrete) training approaches for GANs to deal with the limitations of traditional GANs in passing the gradient updates for discrete tokens. First, we used the Reinforcement Learning (RL)-based training approach and then, an approximation of the multinomial distribution parameterized in terms of the softmax function (Gumble-Softmax). Our extensive experiments based on synthetic data have shown the trained generator can generate sequences with desired properties measured by multiple criteria.


title: Central extensions of 3-dimensional Zinbiel algebras

abstract: We describe all central extensions of all $3$-dimensional non-zero complex Zinbiel algebras. As a corollary, we have a full classification of $4$-dimensional non-trivial complex Zinbiel algebras and a full classification of $5$-dimensional non-trivial complex Zinbiel algebras with $2$-dimensional annihilator, which gives the principal step in the algebraic classification of $5$-dimensional Zinbiel algebras.


title: The double hypergeometric series for the partition function of the 2D anisotropic Ising model

abstract: In 1944 Lars Onsager published the exact partition function of the ferromagnetic Ising model on the infinite square lattice in terms of a definite integral. Only in the literature of the last decade, however, has it been recast in terms of special functions. Until now all known formulas for the partition function in terms of special functions have been restricted to the important special case of the isotropic Ising model with symmetric couplings. Indeed, the anisotropic model is more challenging because there are two couplings and hence two reduced temperatures, one for each of the two axes of the square lattice. Hence, standard special functions of one variable are inadequate to the task. Here, we reformulate the partition function of the anisotropic Ising model in terms of the Kamp\'e de F\'eriet function, which is a double hypergeometric function in two variables that is more general than the Appell hypergeometric functions. Finally, we present hypergeometric formulas for the generating function of multipolygons of given length on the infinite square lattice, for isotropic as well as anisotropic edge weights. For the isotropic case, the results allow easy calculation, to arbitrary order, of the celebrated series found by Cyril Domb.


title: Recent developments of the Uniform Mordell-Lang Conjecture

abstract: This expository survey is based on my online talk at the ICCM 2020. It aims to sketch key steps of the recent proof of the uniform Mordell-Lang conjecture for curves embedded into Jacobians (a question of Mazur). The full version of this conjecture is proved by combining Dimitrov-Gao-Habegger (https://annals.math.princeton.edu/articles/17715) and K\"{u}hne (arXiv:2101.10272). We include in this survey a detailed proof on how to combine these two results, which was implicitly done in another short paper of Dimitrov-Gao-Habegger (arXiv:2009.08505) but not explicitly written in existing literature. At the end of the survey we state some future aspects.


title: The Low-redshift Lyman-continuum Survey: [S II]-deficiency and the leakage of ionizing radiation

abstract: The relationship between galaxy characteristics and the reionization of the universe remains elusive, mainly due to the observational difficulty in accessing the Lyman continuum (LyC) at these redshifts. It is thus important to identify low-redshift LyC-leaking galaxies that can be used as laboratories to investigate the physical processes that allow LyC photons to escape. The weakness of the [S II] nebular emission lines relative to typical star-forming galaxies has been proposed as a LyC predictor. In this paper, we show that the [S II]-deficiency is an effective method to select LyC-leaking candidates using data from the Low-redshift LyC Survey, which has detected flux below the Lyman edge in 35 out of 66 star-forming galaxies with the Cosmic Origins Spectrograph onboard the Hubble Space Telescope. We show that LyC leakers tend to be more [S II]-deficient and that the fraction of their detections increases as [S II]-deficiency becomes more prominent. Correlational studies suggest that [S II]-deficiency complements other LyC diagnostics (such as strong Lyman-$\alpha$ emission and high [O III]/[O II]). Our results verify an additional technique by which reionization-era galaxies could be studied.


title: Mixed Characteristic Artin Schreier Polynomials

abstract: We present here a version of the Artin-Schreier polynomial that works in any characteristic. Let $C_p$ be the cyclic group of prime order $p$. Equivalently, we prove one can lift degree $p$ cyclic $C_p$ extensions over local rings $R,M$ where $R/M$ has characteristic $p$ and $R$ has arbitrary characterstic. Let $\rho \in \Bbb C$ be a primitive $p$ root of one. We first consider the case $R$ has a primitive $p$ root of one, by which we mean that there is a given homomorphism $f: \Bbb Z[\rho] \to R$. In this context we can write a specific polynomial which generalizes the Artin-Schreier polynomial. We next consider arbtitrary $R$ and construct a mixed characteristic "generic" Galois extension that proves the lifting result, but here we do not supply a polynomial. It is useful to view these results in terms of Galois actions. If $C_p$ is generated by $\sigma$, then Artin-Schreier polynomials describe $C_p$ Galois extensions generated by elements $\theta$ where $\sigma(\theta) = \theta + 1$. If $\rho' = f(\rho)$, then our lifted Galois action is $\sigma(\theta) = \rho'\theta + 1$. In section two we descend this extension to rings without root of one. In section three we use this new description of cyclic extensions, give the obvious description of the corresponding cyclic algebras, and then define a new algebra which specializes to general differential crossed products in characteristic $p$ but which are cyclic in characteristic not $p$. The algebra in question is generated by $x,y$ subject to the relation $xy - \rho{yx} = 1$.


title: Deterministic ill-posedness and probabilistic well-posedness of the viscous nonlinear wave equation describing fluid-structure interaction

abstract: We study low regularity behavior of the nonlinear wave equation in $\mathbb{R}^2$ augmented by the viscous dissipative effects described by the Dirichlet-Neumann operator. Problems of this type arise in fluid-structure interaction where the Dirichlet-Neumann operator models the coupling between a viscous, incompressible fluid and an elastic structure. We show that despite the viscous regularization, the Cauchy problem with initial data $(u,u_t)$ in $H^s(\mathbb{R}^2)\times H^{s-1}(\mathbb{R}^2)$, is ill-posed whenever ${{0 < s < s_{cr}}}$, where the critical exponent $s_{cr}$ depends on the degree of nonlinearity. In particular, for the quintic nonlinearity $u^5$, the critical exponent in $\mathbb{R}^2$ is $s_{cr} = 1/2$, which is the same as the critical exponent for the associated nonlinear wave equation without the viscous term. We then show that if the initial data is perturbed using a Wiener randomization, which perturbs initial data in the frequency space, then the Cauchy problem for the quintic nonlinear viscous wave equation is well-posed almost surely for the supercritical exponents $s$ such that $-1/6 < s \le s_{cr} = 1/2$. To the best of our knowledge, this is the first result showing ill-posedness and probabilistic well-posedness for the nonlinear viscous wave equation arising in fluid-structure interaction.


title: Multimodal Fusion Refiner Networks

abstract: Tasks that rely on multi-modal information typically include a fusion module that combines information from different modalities. In this work, we develop a Refiner Fusion Network (ReFNet) that enables fusion modules to combine strong unimodal representation with strong multimodal representations. ReFNet combines the fusion network with a decoding/defusing module, which imposes a modality-centric responsibility condition. This approach addresses a big gap in existing multimodal fusion frameworks by ensuring that both unimodal and fused representations are strongly encoded in the latent fusion space. We demonstrate that the Refiner Fusion Network can improve upon performance of powerful baseline fusion modules such as multimodal transformers. The refiner network enables inducing graphical representations of the fused embeddings in the latent space, which we prove under certain conditions and is supported by strong empirical results in the numerical experiments. These graph structures are further strengthened by combining the ReFNet with a Multi-Similarity contrastive loss function. The modular nature of Refiner Fusion Network lends itself to be combined with different fusion architectures easily, and in addition, the refiner step can be applied for pre-training on unlabeled datasets, thus leveraging unsupervised data towards improving performance. We demonstrate the power of Refiner Fusion Networks on three datasets, and further show that they can maintain performance with only a small fraction of labeled data.


title: Synthetic Likelihood in Misspecified Models: Consequences and Corrections

abstract: We analyse the behaviour of the synthetic likelihood (SL) method when the model generating the simulated data differs from the actual data generating process. One of the most common methods to obtain SL-based inferences is via the Bayesian posterior distribution, with this method often referred to as Bayesian synthetic likelihood (BSL). We demonstrate that when the model is misspecified, the BSL posterior can be poorly behaved, placing significant posterior mass on values of the model parameters that do not represent the true features observed in the data. Theoretical results demonstrate that in misspecified models the BSL posterior can display a wide range of behaviours depending on the level of model misspecification, including being asymptotically non-Gaussian. Our results suggest that a recently proposed robust BSL approach can ameliorate this behavior and deliver reliable posterior inference under model misspecification. We document all theoretical results using a simple running example.


title: CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Clouds

abstract: In this work, we tackle the problem of category-level online pose tracking of objects from point cloud sequences. For the first time, we propose a unified framework that can handle 9DoF pose tracking for novel rigid object instances as well as per-part pose tracking for articulated objects from known categories. Here the 9DoF pose, comprising 6D pose and 3D size, is equivalent to a 3D amodal bounding box representation with free 6D pose. Given the depth point cloud at the current frame and the estimated pose from the last frame, our novel end-to-end pipeline learns to accurately update the pose. Our pipeline is composed of three modules: 1) a pose canonicalization module that normalizes the pose of the input depth point cloud; 2) RotationNet, a module that directly regresses small interframe delta rotations; and 3) CoordinateNet, a module that predicts the normalized coordinates and segmentation, enabling analytical computation of the 3D size and translation. Leveraging the small pose regime in the pose-canonicalized point clouds, our method integrates the best of both worlds by combining dense coordinate prediction and direct rotation regression, thus yielding an end-to-end differentiable pipeline optimized for 9DoF pose accuracy (without using non-differentiable RANSAC). Our extensive experiments demonstrate that our method achieves new state-of-the-art performance on category-level rigid object pose (NOCS-REAL275) and articulated object pose benchmarks (SAPIEN, BMVC) at the fastest FPS ~12.


title: Convolutional Neural Network Pruning with Structural Redundancy Reduction

abstract: Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to achieve compact architectures. In this study, we claim that identifying structural redundancy plays a more essential role than finding unimportant filters, theoretically and empirically. We first statistically model the network pruning problem in a redundancy reduction perspective and find that pruning in the layer(s) with the most structural redundancy outperforms pruning the least important filters across all layers. Based on this finding, we then propose a network pruning approach that identifies structural redundancy of a CNN and prunes filters in the selected layer(s) with the most redundancy. Experiments on various benchmark network architectures and datasets show that our proposed approach significantly outperforms the previous state-of-the-art.