title: Code Comparison in Galaxy Scale Simulations with Resolved Supernova Feedback: Lagrangian vs. Eulerian Methods

abstract: We present a suite of high-resolution simulations of an isolated dwarf galaxy using four different hydrodynamical codes: {\sc Gizmo}, {\sc Arepo}, {\sc Gadget}, and {\sc Ramses}. All codes adopt the same physical model which includes radiative cooling, photoelectric heating, star formation, and supernova (SN) feedback. Individual SN explosions are directly resolved without resorting to sub-grid models, eliminating one of the major uncertainties in cosmological simulations. We find reasonable agreement on the time-averaged star formation rates as well as the joint density-temperature distributions between all codes. However, the Lagrangian codes show significantly burstier star formation, larger supernova-driven bubbles, and stronger galactic outflows compared to the Eulerian code. This is caused by the behavior in the dense, collapsing gas clouds when the Jeans length becomes unresolved: gas in Lagrangian codes collapses to much higher densities than in Eulerian codes, as the latter is stabilized by the minimal cell size. Therefore, more of the gas cloud is converted to stars and SNe are much more clustered in the Lagrangian models, amplifying their dynamical impact. The differences between Lagrangian and Eulerian codes can be reduced by adopting a higher star formation efficiency in Eulerian codes, which significantly enhances SN clustering in the latter. Adopting a zero SN delay time reduces burstiness in all codes, resulting in vanishing outflows as SN clustering is suppressed.


title: Evidence of Deep Mixing in IRS 7, a Cool Massive Supergiant Member of the Galactic Nuclear Star Cluster

abstract: The center of the Milky Way contains stellar populations spanning a range in age and metallicity, with a recent star formation burst producing young and massive stars. Chemical abundances in the most luminous stellar member of the Nuclear Star Cluster (NSC), IRS 7, are presented for $^{19}$F, $^{12}$C, $^{13}$C, $^{14}$N, $^{16}$O, $^{17}$O, and Fe from an LTE analysis based on spherical modeling and radiative transfer with a 25M$_{\odot}$ model atmosphere, whose chemistry was tailored to the derived photospheric abundances. We find IRS 7 to be depleted heavily in both $^{12}$C (~-0.8 dex) and $^{16}$O (~-0.4 dex), while exhibiting an extremely enhanced $^{14}$N abundance (~+1.1 dex), which are isotopic signatures of the deep mixing of CNO-cycled material to the stellar surface. The $^{19}$F abundance is also heavily depleted by ~1 dex relative to the baseline fluorine of the Nuclear Star Cluster, providing evidence that fluorine along with carbon constrain the nature of the deep mixing in this very luminous supergiant. The abundances of the minor isotopes $^{13}$C and $^{17}$O are also derived, with ratios of $^{12}$C/$^{13}$C~5.3 and $^{16}$O/$^{17}$O~525. The derived abundances for IRS 7, in conjunction with previous abundance results for massive stars in the NSC, are compared with rotating and non-rotating models of massive stars and it is found that the IRS 7 abundances overall follow the behavior predicted by stellar models. The depleted fluorine abundance in IRS 7 illustrates, for the first time, the potential of using the $^{19}$F abundance as a mixing probe in luminous red giants.


title: Smoothness Analysis for Probabilistic Programs with Application to Optimised Variational Inference

abstract: We present a static analysis for discovering differentiable or more generally smooth parts of a given probabilistic program, and show how the analysis can be used to improve the pathwise gradient estimator, one of the most popular methods for posterior inference and model learning. Our improvement increases the scope of the estimator from differentiable models to non-differentiable ones without requiring manual intervention of the user; the improved estimator automatically identifies differentiable parts of a given probabilistic program using our static analysis, and applies the pathwise gradient estimator to the identified parts while using a more general but less efficient estimator, called score estimator, for the rest of the program. Our analysis has a surprisingly subtle soundness argument, partly due to the misbehaviours of some target smoothness properties when viewed from the perspective of program analysis designers. For instance, some smoothness properties are not preserved by function composition, and this makes it difficult to analyse sequential composition soundly without heavily sacrificing precision. We formulate five assumptions on a target smoothness property, prove the soundness of our analysis under those assumptions, and show that our leading examples satisfy these assumptions. We also show that by using information from our analysis instantiated for differentiability, our improved gradient estimator satisfies an important differentiability requirement and thus computes the correct estimate on average (i.e., returns an unbiased estimate) under a regularity condition. Our experiments with representative probabilistic programs in the Pyro language show that our static analysis is capable of identifying smooth parts of those programs accurately, and making our improved pathwise gradient estimator exploit all the opportunities for high performance in those programs.


title: RAIN: RegulArization on Input and Network for Black-Box Domain Adaptation

abstract: Source-Free domain adaptation transits the source-trained model towards target domain without exposing the source data, trying to dispel these concerns about data privacy and security. However, this paradigm is still at risk of data leakage due to adversarial attacks on the source model. Hence, the Black-Box setting only allows to use the outputs of source model, but still suffers from overfitting on the source domain more severely due to source model's unseen weights. In this paper, we propose a novel approach named RAIN (RegulArization on Input and Network) for Black-Box domain adaptation from both input-level and network-level regularization. For the input-level, we design a new data augmentation technique as Phase MixUp, which highlights task-relevant objects in the interpolations, thus enhancing input-level regularization and class consistency for target models. For network-level, we develop a Subnetwork Distillation mechanism to transfer knowledge from the target subnetwork to the full target network via knowledge distillation, which thus alleviates overfitting on the source domain by learning diverse target representations. Extensive experiments show that our method achieves state-of-the-art performance on several cross-domain benchmarks under both single- and multi-source black-box domain adaptation.


title: CLASS: Coronal Line Activity Spectroscopic Survey

abstract: We conduct the first systematic survey of a comprehensive set of the twenty optical coronal lines in the spectra of nearly 1 million galaxies observed by the Sloan Digital Sky Survey (SDSS) Data Release 8 catalog. This includes often overlooked high ionization-potential (IP) lines such as [Ar X] $\lambda$5533, [S XII] $\lambda$7609, [Fe XI] $\lambda$7892, and [Fe XIV] $\lambda$5303. We find that, given the limited sensitivity of SDSS, strong coronal line emission is extremely rare, with only $\sim 0.03$% of the sample showing at least one coronal line, significantly lower than the fraction of galaxies showing optical narrow line ratios ($\sim 17$%) or mid-infrared colors ($\sim 2$%) indicative of nuclear activity. The coronal line luminosities exhibit a large dynamic range, with values ranging from $\sim10^{34}$ to $10^{42}$ erg s$^{-1}$. We find that a vast majority ($\sim 80$%) of coronal line emitters in dwarf galaxies ($M_* < {9.6} \times 10^9$ M$_\odot$) do not display optical narrow line ratios indicative of nuclear activity, in contrast to higher mass galaxies ($\sim 17$%). Moreover, we find that the highest ionization potential lines are preferentially found in lower mass galaxies. These findings are consistent with the theory that lower mass black holes found in lower mass galaxies produce a hotter accretion disk, which in turn enhances the higher ionization coronal line spectrum. Future coronal line searches with 30 m class telescopes or JWST may provide a pathway into uncovering the intermediate mass black hole population.


title: Some Supervision Required: Incorporating Oracle Policies in Reinforcement Learning via Epistemic Uncertainty Metrics

abstract: An inherent problem of reinforcement learning is performing exploration of an environment through random actions, of which a large portion can be unproductive. Instead, exploration can be improved by initializing the learning policy with an existing (previously learned or hard-coded) oracle policy, offline data, or demonstrations. In the case of using an oracle policy, it can be unclear how best to incorporate the oracle policy's experience into the learning policy in a way that maximizes learning sample efficiency. In this paper, we propose a method termed Critic Confidence Guided Exploration (CCGE) for incorporating such an oracle policy into standard actor-critic reinforcement learning algorithms. More specifically, CCGE takes in the oracle policy's actions as suggestions and incorporates this information into the learning scheme when uncertainty is high, while ignoring it when the uncertainty is low. CCGE is agnostic to methods of estimating uncertainty, and we show that it is equally effective with two different techniques. Empirically, we evaluate the effect of CCGE on various benchmark reinforcement learning tasks, and show that this idea can lead to improved sample efficiency and final performance. Furthermore, when evaluated on sparse reward environments, CCGE is able to perform competitively against adjacent algorithms that also leverage an oracle policy. Our experiments show that it is possible to utilize uncertainty as a heuristic to guide exploration using an oracle in reinforcement learning. We expect that this will inspire more research in this direction, where various heuristics are used to determine the direction of guidance provided to learning.


title: The EBLM project X. Benchmark masses, radii and temperatures for two fully convective M-dwarfs using K2

abstract: M-dwarfs are the most abundant stars in the galaxy and popular targets for exoplanet searches. However, their intrinsic faintness and complex spectra inhibit precise characterisation. We only know of dozens of M-dwarfs with fundamental parameters of mass, radius and effective temperature characterised to better than a few per cent. Eclipsing binaries remain the most robust means of stellar characterisation. Here we present two targets from the Eclipsing Binary Low Mass (EBLM) survey that were observed with K2: EBLM J0055-00 and EBLM J2217-04. Combined with HARPS and CORALIE spectroscopy, we measure M-dwarf masses with precisions better than 5%, radii better than 3% and effective temperatures on order 1%. However, our fits require invoking a model to derive parameters for the primary star. By investigating three popular models, we determine that the model uncertainty is of similar magnitude to the statistical uncertainty in the model fits. Therefore, whilst these can be considered benchmark M-dwarfs, we caution the community to consider model uncertainty when pushing the limits of precise stellar characterisation.


title: An Alternative Approach to Quantum Imaginary Time Evolution

abstract: There is increasing interest in quantum algorithms that are based on the imaginary-time evolution (ITE), a successful classical numerical approach to obtain ground states. However, most of the proposals so far require heavy post-processing computational steps on a classical computer, such as solving linear equations. Here we provide an alternative approach to implement ITE. A key feature in our approach is the use of an orthogonal basis set: the propagated state is efficiently expressed in terms of orthogonal basis states at every step of the evolution. We argue that the number of basis states needed at those steps to achieve an accurate solution can be kept of the order of $n$, the number of qubits, by controlling the precision (number of significant digits) and the imaginary-time increment. The number of quantum gates per imaginary-time step is estimated to be polynomial in $n$. Additionally, while in many QAs the locality of the Hamiltonian is a key assumption, in our algorithm this restriction is not required. This characteristic of our algorithm renders it useful for studying highly nonlocal systems, such as the occupation-representation nuclear shell model. We illustrate our algorithm through numerical implementation on an IBM quantum simulator.


title: A Meta-Analysis of Solar Forecasting Based on Skill Score

abstract: We conduct the first comprehensive meta-analysis of deterministic solar forecasting based on skill score, screening 1,447 papers from Google Scholar and reviewing the full texts of 320 papers for data extraction. A database of 4,687 points was built and analyzed with multivariate adaptive regression spline modelling, partial dependence plots, and linear regression. The marginal impacts on skill score of ten factors were quantified. The analysis shows the non-linearity and complex interaction between variables in the database. Forecast horizon has a central impact and dominates other factors' impacts. Therefore, the analysis of solar forecasts should be done separately for each horizon. Climate zone variables have statistically significant correlation with skill score. Regarding inputs, historical data and spatial temporal information are highly helpful. For intra-day, sky and satellite images show the most importance. For day-ahead, numerical weather predictions and locally measured meteorological data are very efficient. All forecast models were compared. Ensemble-hybrid models achieve the most accurate forecasts for all horizons. Hybrid models show superiority for intra-hour while image-based methods are the most efficient for intra-day forecasts. More training data can enhance skill score. However, over-fitting is observed when there is too much training data (longer than 2000 days). There has been a substantial improvement in solar forecast accuracy, especially in recent years. More improvement is observed for intra-hour and intra-day than day-ahead forecasts. By controlling for the key differences between forecasts, including location variables, our findings can be applied globally.


title: Digraph Networks and Groupoids

abstract: We answer a question posed by Dougherty and Faber in [3], "Network routing on regular directed graphs from spanning factorizations." We prove that every vertex transitive digraph has a spanning factorization; in fact, this is a necessary and sufficient condition. We show that 1-factorization of a regular digraph is closely related to the notion of a Cayley graph of a groupoid and as such, the theorem we prove on spanning factorizations can be translated to a 2006 theorem of Mwambene [4; Theorem 9] on groupoids. We also show that groupoids are a powerful tool for examining network routing on general regular digraphs. We show there is a 1-1 relation between regular connected digraphs of degree d and the Cayley graphs of groupoids (not necessarily associative but with left identity and right cancellation) with d generators. This enables us to provide compact algebraic definitions for some important graphs that are either given as explicit edge lists or as the Cayley coset graphs of groups larger than the graph. One such example is a single expression for the Hoffman-Singleton graph.


title: 2D tunable all-solid-state random laser in the visible

abstract: A two-dimensional (2D) solid-state random laser emitting in the visible is demonstrated, in which optical feedback is provided by a controlled disordered arrangement of air-holes in a dye-doped polymer film. We find an optimal scatterer density for which threshold is minimum and scattering is the strongest. We show that the laser emission can be red-shifted by either decreasing scatterer density or increasing pump area. We show that spatial coherence is easily controlled by varying pump area. Such a 2D random laser provides with a compact on-chip tunable laser source and a unique platform to explore non-Hermitian photonics in the visible


title: Towards a Constructive Framework for Stabilization and Control of Nonlinear Systems: Passivity and Immersion (P\&I) Approach

abstract: The varied and complex dynamics of real-world systems challenge the formulation of a systematic strategy for designing a stabilizing feedback law. Rather than taking a universal approach, the control strategies developed thus far to handle this problem are specific to the inherent structure of the system under consideration. Therefore, this paper attempts to develop a generalized theory for the design of the stabilizing feedback law wherever possible for a general class of systems, including the systems in standard structured and unstructured forms discussed in the existing literature. The theory behind this general controller design theory utilizes the idea of an invariant target manifold giving rise to a non-degenerate two form, through which the definition of certain passive outputs and storage functions leads to a generation of control law for stabilizing the system. Because the above concepts are linked with the Immersion and Invariance (I&I) design policy and the passivity theory of controller design, the proposed methodology is labeled as the "Passivity and Immersion (P&I) approach". Furthermore, being a constructive methodology, the various worked examples in this paper exemplify and demonstrate the various design paradigms such as Backstepping, Incremental Backstepping, Forwarding, I&I, and the techniques based on the generation of Control Contraction Metrics (CCM) can be unified in the P&I methodology.


title: Fast Updating the STBC Decoder Matrices in the Uplink of a Massive MIMO System

abstract: Reducing computational complexity of the modern wireless communication systems such as massive Multiple-Input Multiple-Output (MIMO) configurations is of utmost interest. In this paper, we propose new algorithm that can be used to accelerate matrix inversion in the decoding of space-time block codes (STBC) in the uplink of dynamic massive MIMO systems. A multi-user system in which the base station is equipped with a large number of antennas and each user has two antennas is considered. In addition, users can enter or exit the system dynamically. For a given space-time block coding/decoding scheme the computational complexity of the receiver will be significantly reduced when a user is added to or removed from the system by employing the proposed method. In the proposed scheme, the matrix inversion for zero-forcing (ZF) as well as minimum mean square error (MMSE) decoding is derived from the inverse of a partitioned matrix and the Woodbury matrix identity. Furthermore, the suggested technique can be utilized when the number of users is fixed but the channel estimate changes for a particular user. The mathematical equations for updating the inverse of the decoding matrices are derived and its complexity is compared to the direct way of computing the inverse. Evaluations confirm the effectiveness of the proposed approach.


title: On a Bernstein inequality for eigenfunctions

abstract: Let $\varphi_{\lambda}$ be an eigenfunction of the Laplace-Beltrami operator on a smooth compact Riemannian manifold $(M,g)$, i.e., $\Delta_g \varphi_{\lambda} + \lambda \varphi_{\lambda}=0$. We show that $\varphi_{\lambda}$ satisfies a local Bernstein inequality, namely for any geodesic ball $B_g(x,r)$ in $M$ there holds: $\sup_{B_g(x,r)}|\nabla\varphi_{\lambda}|\leq C_{\delta}\max\left\{\frac{\sqrt{\lambda}\log^{2+\delta}\lambda}{r},\lambda\log^{2+\delta}\lambda\right\}\sup_{B_g(x,r)}|\varphi_{\lambda}|$. We also prove analogous inequalities for solutions of elliptic PDEs in terms of the frequency function.


title: Solvable model of deep thermalization with distinct design times

abstract: We study the emergence over time of a universal, uniform distribution of quantum states supported on a finite subsystem, induced by projectively measuring the rest of the system. Dubbed deep thermalization, this phenomenon represents a form of equilibration in quantum many-body systems stronger than regular thermalization, which only constrains the ensemble-averaged values of observables. While there exist quantum circuit models of dynamics in one dimension where this phenomenon can be shown to arise exactly, these are special in that deep thermalization occurs at precisely the same time as regular thermalization. Here, we present an exactly-solvable model of chaotic dynamics where the two processes can be shown to occur over different time scales. The model is composed of a finite subsystem coupled to an infinite random-matrix bath through a small constriction, and highlights the role of locality and imperfect thermalization in constraining the formation of such universal wavefunction distributions. We test our analytical predictions against exact numerical simulations, finding excellent agreement.


title: Data Visualization of Traffic Violations in Maryland, U.S

abstract: Nowadays, car use has become so common and inevitable that with a high approximation, it can be said that every family has at least one car. This has caused an increase in accidents and, subsequently, road injuries. About 1.2 million people die from road injuries yearly, and 20 to 50 million live with non-fatal injuries. Investigation of this issue is essential, considering that traffic violations have become a global concern. There, a dataset published by the Montgomery County government was analyzed using R and Python, only Maryland crimes. The highest number of deaths is in young men, which shows an increase in traffic accident injuries in the third decade of life, and a reduction of victims of different ages was observed as a result. Factors affecting the occurrence of injuries caused by road traffic were also extracted. This can be useful in providing programs to reduce traffic violations.


title: The Value of AI Guidance in Human Examination of Synthetically-Generated Faces

abstract: Face image synthesis has progressed beyond the point at which humans can effectively distinguish authentic faces from synthetically generated ones. Recently developed synthetic face image detectors boast "better-than-human" discriminative ability, especially those guided by human perceptual intelligence during the model's training process. In this paper, we investigate whether these human-guided synthetic face detectors can assist non-expert human operators in the task of synthetic image detection when compared to models trained without human-guidance. We conducted a large-scale experiment with more than 1,560 subjects classifying whether an image shows an authentic or synthetically-generated face, and annotate regions that supported their decisions. In total, 56,015 annotations across 3,780 unique face images were collected. All subjects first examined samples without any AI support, followed by samples given (a) the AI's decision ("synthetic" or "authentic"), (b) class activation maps illustrating where the model deems salient for its decision, or (c) both the AI's decision and AI's saliency map. Synthetic faces were generated with six modern Generative Adversarial Networks. Interesting observations from this experiment include: (1) models trained with human-guidance offer better support to human examination of face images when compared to models trained traditionally using cross-entropy loss, (2) binary decisions presented to humans offers better support than saliency maps, (3) understanding the AI's accuracy helps humans to increase trust in a given model and thus increase their overall accuracy. This work demonstrates that although humans supported by machines achieve better-than-random accuracy of synthetic face detection, the ways of supplying humans with AI support and of building trust are key factors determining high effectiveness of the human-AI tandem.


title: Information-theoretical analysis of the neural code for decoupled face representation

abstract: Processing faces accurately and efficiently is a key capability of humans and other animals that engage in sophisticated social tasks. Recent studies reported a decoupled coding for faces in the primate inferotemporal cortex, with two separate neural populations coding for the geometric position of (texture-free) facial landmarks and for the image texture at fixed landmark positions, respectively. Here, we formally assess the efficiency of this decoupled coding by appealing to the information-theoretic notion of description length, which quantifies the amount of information that is saved when encoding novel facial images, with a given precision. We show that despite decoupled coding describes the facial images in terms of two sets of principal components (of landmark shape and image texture), it is more efficient (i.e., yields more information compression) than the encoding in terms of the image principal components only, which corresponds to the widely used eigenface method. The advantage of decoupled coding over eigenface coding increases with image resolution and is especially prominent when coding variants of training set images that only differ in facial expressions. Moreover, we demonstrate that decoupled coding entails better performance in three different tasks: the representation of facial images, the (daydream) sampling of novel facial images, and the recognition of facial identities and gender. In summary, our study provides a first principle perspective on the efficiency and accuracy of the decoupled coding of facial stimuli reported in the primate inferotemporal cortex.


title: Preservation of Quadratic Invariants by Semiexplicit Symplectic Integrators for Non-separable Hamiltonian Systems

abstract: We prove that the recently developed semiexplicit symplectic integrators for non-separable Hamiltonian systems preserve any linear and quadratic invariants possessed by the Hamiltonian systems. This is in addition to being symmetric and symplectic as shown in our previous work; hence it shares the crucial structure-preserving properties with some of the well-known symplectic Runge--Kutta methods such as the Gauss--Legendre methods. The proof follows two steps: First we show how the extended Hamiltonian system proposed by Pihajoki inherits linear and quadratic invariants in the extended phase space from the original Hamiltonian system. Then we show that this inheritance in turn implies that our integrator preserves the original linear and quadratic invariants in the original phase space. We also analyze preservation/non-preservation of these invariants by Tao's extended Hamiltonian system and the extended phase space integrators of Pihajoki and Tao. The paper concludes with numerical demonstrations of our results using a simple test case and a system of point vortices.


title: InstanceFormer: An Online Video Instance Segmentation Framework

abstract: Recent transformer-based offline video instance segmentation (VIS) approaches achieve encouraging results and significantly outperform online approaches. However, their reliance on the whole video and the immense computational complexity caused by full Spatio-temporal attention limit them in real-life applications such as processing lengthy videos. In this paper, we propose a single-stage transformer-based efficient online VIS framework named InstanceFormer, which is especially suitable for long and challenging videos. We propose three novel components to model short-term and long-term dependency and temporal coherence. First, we propagate the representation, location, and semantic information of prior instances to model short-term changes. Second, we propose a novel memory cross-attention in the decoder, which allows the network to look into earlier instances within a certain temporal window. Finally, we employ a temporal contrastive loss to impose coherence in the representation of an instance across all frames. Memory attention and temporal coherence are particularly beneficial to long-range dependency modeling, including challenging scenarios like occlusion. The proposed InstanceFormer outperforms previous online benchmark methods by a large margin across multiple datasets. Most importantly, InstanceFormer surpasses offline approaches for challenging and long datasets such as YouTube-VIS-2021 and OVIS. Code is available at https://github.com/rajatkoner08/InstanceFormer.


title: Flopping-mode electron dipole spin resonance in the strong-driving regime

abstract: Achieving high fidelity control of spin qubits with conventional electron dipole spin resonance (EDSR) requires large magnetic field gradients of about 1 mT/nm, which also couple the qubit to charge noise, and large drive amplitudes of order 1 mV. The flopping-mode is an alternative method to drive EDSR of an electron in a double quantum dot, where the large displacement between both dots increases the driving efficiency. We propose to operate the flopping-mode in the strong-driving regime to use the full magnetic field difference between the two dots. In simulations, the reduced required magnetic field gradients suppress the infidelity contribution of charge noise by more than two orders of magnitude, while providing Rabi frequencies of up to 60 MHz. However, the near degeneracy of the conduction band in silicon introduces a valley degree of freedom that can degrade the performance of the strong-driving mode. This necessitates a valley-dependent pulse optimization and makes operation to the strong-driving regime questionable.


title: Delay-dependent LMI-based stability criterion for distributed optimization problem in heterogeneous linear multi-agent systems over random digraphs

abstract: This work studies the problem of distributed optimization in heterogeneous linear multi-agent systems. Instead of relying on a perfect communication network as in many existing distributed optimization approaches, we considered two important issues related to communication networks. First, assumed that communication delays exist when each agent receives information from its neighbors. Further, since communications networks are generally unreliable, we assumed each agent interacted with the other agents through random digraphs. Finally, to prove convergence to optimal solutions, delay-dependent sufficient conditions are derived in the form of linear matrix inequality. An analysis of numerical simulation results is presented to demonstrate the effectiveness of the introduced approach.


title: Atrial Fibrillation Recurrence Risk Prediction from 12-lead ECG Recorded Pre- and Post-Ablation Procedure

abstract: Introduction: 12-lead electrocardiogram (ECG) is recorded during atrial fibrillation (AF) catheter ablation procedure (CAP). It is not easy to determine if CAP was successful without a long follow-up assessing for AF recurrence (AFR). Therefore, an AFR risk prediction algorithm could enable a better management of CAP patients. In this research, we extracted features from 12-lead ECG recorded before and after CAP and train an AFR risk prediction machine learning model. Methods: Pre- and post-CAP segments were extracted from 112 patients. The analysis included a signal quality criterion, heart rate variability and morphological biomarkers engineered from the 12-lead ECG (804 features overall). 43 out of the 112 patients (n) had AFR clinical endpoint available. These were utilized to assess the feasibility of AFR risk prediction, using either pre or post CAP features. A random forest classifier was trained within a nested cross validation framework. Results: 36 features were found statistically significant for distinguishing between the pre and post surgery states (n=112). For the classification, an area under the receiver operating characteristic (AUROC) curve was reported with AUROC_pre=0.64 and AUROC_post=0.74 (n=43). Discussion and conclusions: This preliminary analysis showed the feasibility of AFR risk prediction. Such a model could be used to improve CAP management.


title: The conjugate uniformization via 1-motives

abstract: We use the $p$-divisible group attached to a 1-motive to generalize the conjugate $p$-adic uniformization of Iovita--Morrow--Zaharescu to arbitrary $p$-adic formal semi-abelian schemes or $p$-divisible groups over the ring of integers in a $p$-adic field. This mirrors a mixed Hodge theory construction of the inverse uniformization map for complex semi-abelian varieties. We also highlight the geometric structure of the target of the conjugate uniformization map, which is an \'{e}tale cover of a negative Banach--Colmez space in the sense of Fargues--Scholze.


title: SpeedFolding: Learning Efficient Bimanual Folding of Garments

abstract: Folding garments reliably and efficiently is a long standing challenge in robotic manipulation due to the complex dynamics and high dimensional configuration space of garments. An intuitive approach is to initially manipulate the garment to a canonical smooth configuration before folding. In this work, we develop SpeedFolding, a reliable and efficient bimanual system, which given user-defined instructions as folding lines, manipulates an initially crumpled garment to (1) a smoothed and (2) a folded configuration. Our primary contribution is a novel neural network architecture that is able to predict pairs of gripper poses to parameterize a diverse set of bimanual action primitives. After learning from 4300 human-annotated and self-supervised actions, the robot is able to fold garments from a random initial configuration in under 120s on average with a success rate of 93%. Real-world experiments show that the system is able to generalize to unseen garments of different color, shape, and stiffness. While prior work achieved 3-6 Folds Per Hour (FPH), SpeedFolding achieves 30-40 FPH.


title: Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentation

abstract: Split learning (SL) has been proposed to train deep learning models in a decentralized manner. For decentralized healthcare applications with vertical data partitioning, SL can be beneficial as it allows institutes with complementary features or images for a shared set of patients to jointly develop more robust and generalizable models. In this work, we propose "Split-U-Net" and successfully apply SL for collaborative biomedical image segmentation. Nonetheless, SL requires the exchanging of intermediate activation maps and gradients to allow training models across different feature spaces, which might leak data and raise privacy concerns. Therefore, we also quantify the amount of data leakage in common SL scenarios for biomedical image segmentation and provide ways to counteract such leakage by applying appropriate defense strategies.


title: On a conjecture about Higgs bundles for rank 2 and some inequalities

abstract: We briefly review an open conjecture about Higgs bundles that are semistable with after pulling back to any curve, and prove it in the rank 2 case. We also prove a set of inequalities holding for H-nef Higgs bundles that generalize some of the Fulton-Lazarsfeld inequalities for numerically effective vector bundles.


title: CADOps-Net: Jointly Learning CAD Operation Types and Steps from Boundary-Representations

abstract: 3D reverse engineering is a long sought-after, yet not completely achieved goal in the Computer-Aided Design (CAD) industry. The objective is to recover the construction history of a CAD model. Starting from a Boundary Representation (B-Rep) of a CAD model, this paper proposes a new deep neural network, CADOps-Net, that jointly learns the CAD operation types and the decomposition into different CAD operation steps. This joint learning allows to divide a B-Rep into parts that were created by various types of CAD operations at the same construction step; therefore providing relevant information for further recovery of the design history. Furthermore, we propose the novel CC3D-Ops dataset that includes over $37k$ CAD models annotated with CAD operation type labels and step labels. Compared to existing datasets, the complexity and variety of CC3D-Ops models are closer to those used for industrial purposes. Our experiments, conducted on the proposed CC3D-Ops and the publicly available Fusion360 datasets, demonstrate the competitive performance of CADOps-Net with respect to state-of-the-art, and confirm the importance of the joint learning of CAD operation types and steps.


title: L-theory of $C^*$-algebras

abstract: We establish a formula for the L-theory spectrum of real $C^*$-algebras from which we deduce a presentation of the L-groups in terms of the topological K-groups, extending all previously known results of this kind. Along the way, we extend the integral comparison map $\tau\colon \mathrm{k} \to \mathrm{L}$ obtained in previous work by the first two authors to real $C^*$-algebras and interpret it using topological Grothendieck-Witt theory. Finally, we use our results to give an integral comparison between the Baum-Connes conjecture and the L-theoretic Farrell-Jones conjecture, and discuss our comparison map $\tau$ in terms of the signature operator on oriented manifolds.


title: On the characteristic polynomial of the $A_\alpha$-matrix for some operations of graphs

abstract: Let G be a graph of order $n$ with adjacency matrix $A(G)$ and diagonal matrix of degree $D(G)$. For every $\alpha \in [0,1]$, Nikiforov \cite{VN17} defined the matrix $A_\alpha(G) = \alpha D(G) + (1-\alpha)A(G)$. In this paper we present the $A_{\alpha}(G)$-characteristic polynomial when $G$ is obtained by coalescing two graphs, and if $G$ is a semi-regular bipartite graph we obtain the $A_{\alpha}$-characteristic polynomial of the line graph associated to $G$. Moreover, if $G$ is a regular graph we exhibit the $A_{\alpha}$-characteristic polynomial for the graphs obtained from some operations.


title: On the clique number of noisy random geometric graphs

abstract: Let $G_n$ be a random geometric graph, and then for $q,p \in [0,1)$ we construct a "$(q,p)$-perturbed noisy random geometric graph" $G_n^{q,p}$ where each existing edge in $G_n$ is removed with probability $q$, while and each non-existent edge in $G_n$ is inserted with probability $p$. We give asymptotically tight bounds on the clique number $\omega\left(G_n^{q,p}\right)$ for several regimes of parameter.


title: Transductive Decoupled Variational Inference for Few-Shot Classification

abstract: The versatility to learn from a handful of samples is the hallmark of human intelligence. Few-shot learning is an endeavour to transcend this capability down to machines. Inspired by the promise and power of probabilistic deep learning, we propose a novel variational inference network for few-shot classification (coined as TRIDENT) to decouple the representation of an image into semantic and label latent variables, and simultaneously infer them in an intertwined fashion. To induce task-awareness, as part of the inference mechanics of TRIDENT, we exploit information across both query and support images of a few-shot task using a novel built-in attention-based transductive feature extraction module (we call AttFEX). Our extensive experimental results corroborate the efficacy of TRIDENT and demonstrate that, using the simplest of backbones, it sets a new state-of-the-art in the most commonly adopted datasets miniImageNet and tieredImageNet (offering up to 4% and 5% improvements, respectively), as well as for the recent challenging cross-domain miniImagenet --> CUB scenario offering a significant margin (up to 20% improvement) beyond the best existing cross-domain baselines. Code and experimentation can be found in our GitHub repository: https://github.com/anujinho/trident


title: Constraining effective neutrino species with bispectrum of large scale structures

abstract: Relativistic and free-streaming particles like neutrinos leave imprints in large scale structures (LSS), providing probes of the effective number of neutrino species $N_{\rm eff}$. In this paper, we use the Fisher formalism to forecast $N_{\rm eff}$ constraints from the bispectrum (B) of LSS for current and future galaxy redshift surveys, specifically using information from the baryon acoustic oscillations (BAOs). Modeling the galaxy bispectrum at the tree-level, we find that adding the bispectrum constraints to current CMB constraints from Planck can improve upon the Planck-only constraints on $N_{\rm eff}$ by about 10\% -- 40\% depending on the survey. Compared to the Planck + power spectrum (P) constraints previously explored in the literature, using Planck+P+B provides a further improvement of about 5\% -- 30\%. Besides using BAO wiggles alone, we also explore using the total information which includes both the wiggles and the broadband information (which is subject to systematics challenges), generally yielding better results. Finally, we exploit the interference feature of the BAOs in the bispectrum to select a subset of triangles with the most information on $N_{\rm eff}$. This allows for the reduction of computational cost while keeping most of the information, as well as for circumventing some of the shortcomings of applying directly to the bispectrum the current wiggle extraction algorithm valid for the power spectrum. In sum, our study validates that the current Planck constraint on $N_{\rm eff}$ can be significantly improved with the aid of galaxy surveys before the next-generation CMB experiments like CMB-Stage 4.


title: Unification of the first law of quantum thermodynamics

abstract: Underlying the classical thermodynamic principles are analogous microscopic laws, arising from the fundamental axioms of quantum mechanics. These define quantum thermodynamic variables such as quantum work and heat and characterize the possible transformations of open quantum systems. The foremost quantum thermodynamic law is a simple statement concerning the conservation of energy. Nevertheless, there exist ambiguity and disagreement regarding the precise partition of a quantum system's energy change to work and heat. By treating quantum mechanics as a comprehensive theory, applicable to both the micro and macroscopic domains, and employing dynamical symmetries, we bridge the gaps between five popular thermodynamic approaches to the first law. These include both autonomous and semi-classical formulations, which define work in terms of an ensemble average, as well as the single shot paradigm, where work is defined as a deterministic quantity.


title: Dirac observables in the 4-dimensional phase space of Ashtekar's variables and spherically symmetric loop quantum black holes

abstract: In this paper, we study a proposal put forward recently by Bodendorfer, Mele and M\"unch and Garc\'\i{}a-Quismondo and Marug\'an, in which the two polymerization parameters of spherically symmetric black hole spacetimes are the Dirac observables of the four-dimensional Ashtekar's variables. In this model, black and white hole horizons in general exist and naturally divide the spacetime into the external and internal regions. In the external region, the spacetime can be made asymptotically flat by properly choosing the dependence of the two polymerization parameters on the Ashtekar variables. Then, we find that the asymptotical behavior of the spacetime is universal, and, to the leading order, the curvature invariants are independent of the mass parameter $m$. For example, the Kretschmann scalar approaches zero as $K \simeq A_0r^{-4}$ asymptotically, where $A_0$ is generally a non-zero constant and independent of $m$, and $r$ the geometric radius of the two-spheres. In the internal region, all the physical quantities are finite, and the Schwarzschild black hole singularity is replaced by a transition surface whose radius is always finite and non-zero. The quantum gravitational effects are negligible near the black hole horizon for very massive black holes. However, the behavior of the spacetime across the transition surface is significantly different from all loop quantum black holes studied so far. In particular, the location of the maximum amplitude of the curvature scalars is displaced from the transition surface and depends on $m$, so does the maximum amplitude. In addition, the radius of the white hole is much smaller than that of the black hole, and its exact value sensitively depends on $m$, too.


title: Focal-plane wavefront sensing with photonic lanterns I: theoretical framework

abstract: The photonic lantern (PL) is a tapered waveguide that can efficiently couple light into multiple single-mode optical fibers. Such devices are currently being considered for a number of tasks, including the coupling of telescopes and high-resolution, fiber-fed spectrometers, coherent detection, nulling interferometry, and vortex-fiber nulling (VFN). In conjunction with these use cases, PLs can simultaneously perform low-order focal-plane wavefront sensing. In this work, we provide a mathematical framework for the analysis of the photonic lantern wavefront sensor (PLWFS), deriving linear and higher-order reconstruction models as well as metrics through which sensing performance -- both in the linear and nonlinear regimes -- can be quantified. This framework can be extended to account for additional optics such as beam-shaping optics and vortex masks, and is generalizable to other wavefront sensing architectures. Lastly, we provide initial numerical verification of our mathematical models, by simulating a 6-port PLWFS. In a companion paper, we provide a more comprehensive numerical characterization of few-port PLWFSs, and consider how the sensing properties of these devices can be controlled and optimized.


title: State Of The Art In Open-Set Iris Presentation Attack Detection

abstract: Research in presentation attack detection (PAD) for iris recognition has largely moved beyond evaluation in "closed-set" scenarios, to emphasize ability to generalize to presentation attack types not present in the training data. This paper offers several contributions to understand and extend the state-of-the-art in open-set iris PAD. First, it describes the most authoritative evaluation to date of iris PAD. We have curated the largest publicly-available image dataset for this problem, drawing from 26 benchmarks previously released by various groups, and adding 150,000 images being released with the journal version of this paper, to create a set of 450,000 images representing authentic iris and seven types of presentation attack instrument (PAI). We formulate a leave-one-PAI-out evaluation protocol, and show that even the best algorithms in the closed-set evaluations exhibit catastrophic failures on multiple attack types in the open-set scenario. This includes algorithms performing well in the most recent LivDet-Iris 2020 competition, which may come from the fact that the LivDet-Iris protocol emphasizes sequestered images rather than unseen attack types. Second, we evaluate the accuracy of five open-source iris presentation attack algorithms available today, one of which is newly-proposed in this paper, and build an ensemble method that beats the winner of the LivDet-Iris 2020 by a substantial margin. This paper demonstrates that closed-set iris PAD, when all PAIs are known during training, is a solved problem, with multiple algorithms showing very high accuracy, while open-set iris PAD, when evaluated correctly, is far from being solved. The newly-created dataset, new open-source algorithms, and evaluation protocol, made publicly available with the journal version of this paper, provide the experimental artifacts that researchers can use to measure progress on this important problem.


title: Flipping Heegaard splittings of Seifert fibered spaces

abstract: A Heegaard splitting of a $3$-manifold is flippable if there is an isotopy that interchanges the two sides of the Heegaard splitting. We explore which Heegaard splittings of Seifert fibered spaces are flippable.


title: Laboratory modelling of solar wind interaction with Lunar Magnetic Anomalies

abstract: The paper presents results of laboratory experiment modeling the interaction between Lunar magnetic anomalies and Solar wind. To model the LMA we use quadrupole magnetic field. The main dimentionless parameter of the problem, the ion inertia length relative to the mini-magnetosphere size, well corresponds between experiment and LMA conditions. The main result is measurement of the magnetically reflected proton fluxes, which show qualitative agreement to available satellite data.


title: Out of this world neutrino oscillations

abstract: We study how vacuum neutrino oscillations can be affected by a causal, nonlinear and state-dependent modification of quantum field theory that may be interpreted using the many-worlds formulation of quantum mechanics. The effect is induced by a Higgs-neutrino Yukawa interaction that causes a nonlinear interference between the neutrino mass eigenstates. This leads to a tiny change in the oscillation pattern of light, active neutrinos without altering the oscillation frequencies. At large baselines where the oscillations disappear, the nonlinear effect is also suppressed and does not source correlations between the mass eigenstates once they are entangled with the environment. Our example provides a way to compute effects of nonlinear quantum mechanics and field theory that may probe the possible physical reality of many worlds.


title: Quantifying uncertainties due to irreducible three-body forces in deuteron-nucleus reactions

abstract: \noindent{\bf Background:} Deuteron-induced nuclear reactions are an essential tool for probing the structure of nuclei as well as astrophysical information such as $(n,\gamma)$ cross sections. The deuteron-nucleus system is typically described within a Faddeev three-body model consisting of a neutron ($n$), a proton ($p$), and the target nucleus ($A$) interacting through pairwise phenomenological potentials. While Faddeev techniques enable the exact description of the three-body dynamics, their predictive power is limited in part by the omission of irreducible neutron-proton-nucleus three-body force ($n$-$p$-$A$ 3BF). {\bf Results:} By comparing the Faddeev and NCSM/RGM results, we show that the irreducible $n$-$p$-$\alpha$ 3BF has a non-negligible effect on bound state and scattering observables alike. Specifically, the Faddeev approach %are yields a $^6$Li ground state that is approximately $600$~keV shallower than the one obtained with the NCSM/RGM. Additionally, the Faddeev calculations for $d$+$\alpha$ scattering yield a $3^+$ resonance that is located approximately $400$~keV higher in energy compared to the NCSM/RGM result. The shape of the $d$+$\alpha$ angular distributions computed using the two approaches also differ, owing to the discrepancy in the predictions of the $3^+$ resonance energy.


title: Underwater Messaging Using Mobile Devices

abstract: Since its inception, underwater digital acoustic communication has required custom hardware that neither has the economies of scale nor is pervasive. We present the first acoustic system that brings underwater messaging capabilities to existing mobile devices like smartphones and smart watches. Our software-only solution leverages audio sensors, i.e., microphones and speakers, ubiquitous in today's devices to enable acoustic underwater communication between mobile devices. To achieve this, we design a communication system that in real-time adapts to differences in frequency responses across mobile devices, changes in multipath and noise levels at different locations and dynamic channel changes due to mobility. We evaluate our system in six different real-world underwater environments with depths of 2-15 m in the presence of boats, ships and people fishing and kayaking. Our results show that our system can in real-time adapt its frequency band and achieve bit rates of 100 bps to 1.8 kbps and a range of 30 m. By using a lower bit rate of 10-20 bps, we can further increase the range to 100 m. As smartphones and watches are increasingly being used in underwater scenarios, our software-based approach has the potential to make underwater messaging capabilities widely available to anyone with a mobile device. Project page with open-source code and data can be found here: https://underwatermessaging.cs.washington.edu/


title: Semi-Supervised Manifold Learning with Complexity Decoupled Chart Autoencoders

abstract: Autoencoding is a popular method in representation learning. Conventional autoencoders employ symmetric encoding-decoding procedures and a simple Euclidean latent space to detect hidden low-dimensional structures in an unsupervised way. This work introduces a chart autoencoder with an asymmetric encoding-decoding process that can incorporate additional semi-supervised information such as class labels. Besides enhancing the capability for handling data with complicated topological and geometric structures, these models can successfully differentiate nearby but disjoint manifolds and intersecting manifolds with only a small amount of supervision. Moreover, this model only requires a low complexity encoder, such as local linear projection. We discuss the theoretical approximation power of such networks that essentially depends on the intrinsic dimension of the data manifold and not the dimension of the observations. Our numerical experiments on synthetic and real-world data verify that the proposed model can effectively manage data with multi-class nearby but disjoint manifolds of different classes, overlapping manifolds, and manifolds with non-trivial topology.


title: Analytic reparametrizations of translation toral flows with countable Lebesgue spectrum

abstract: We give an example of a real analytic reparametrization of a minimal translation flow on $\mathbb{T}^{5}$ that has a Lebesgue spectrum with infinite multiplicity.


title: Balanced supersaturation and Turan numbers in random graphs

abstract: In a ground-breaking paper solving a conjecture of Erd\H{o}s on the number of $n$-vertex graphs not containing a given even cycle, Morris and Saxton \cite{MS} made a broad conjecture on so-called balanced supersaturation property of a bipartite graph $H$. Ferber, McKinley, and Samotij \cite{FMS} established a weaker version of this conjecture and applied it to derive far-reaching results on the enumeration problem of $H$-free graphs. In this paper, we show that Morris and Saxton's conjecture holds under a very mild assumption about $H$, which is widely believed to hold whenever $H$ contains a cycle. We then use our theorem to obtain enumeration results and general upper bounds on the Tur\'an number of a bipartite $H$ in the random graph $G(n,p)$, the latter being first of its kind.


title: Densities of Codes of Various Linearity Degrees in Translation-Invariant Metric Spaces

abstract: We investigate the asymptotic density of error-correcting codes with good distance properties and prescribed linearity degree, including sublinear and nonlinear codes. We focus on the general setting of finite translation-invariant metric spaces, and then specialize our results to the Hamming metric, to the rank metric, and to the sum-rank metric. Our results show that the asymptotic density of codes heavily depends on the imposed linearity degree and the chosen metric.


title: The Many Inconsistencies of the Purity-Mixture Distinction in Standard Quantum Mechanics

abstract: The distinction between pure states and mixed states is a kernel ingredient of what is considered to be the standard formulation of quantum mechanics and plays today a kernel role in foundational debates about the meaning of quantum probability, the separability of quantum systems, the definition and measure of entanglement, etc. In this work we attempt to expose the many inconsistencies introduced by this distinction and the serious consequences this has for many ongoing research programs which apply these notions uncritically.


title: Laminar model for the joint development of ocular dominance columns and CO blobs in V1

abstract: In this paper, we present a multi--layer, activity--dependent model for the joint development of ocular dominance (OD) columns and cytochrome oxidase (CO) blobs in primate primary visual cortex (V1). For simplicity, we focus on layers 4C and 2/3 with both layers receiving direct thalamic inputs and layer 4C sending vertical projections to layer 2/3. Both the thalamic and the vertical connections are taken to be modifiable by activity. Using a correlation--based Hebbian learning rule with subtractive normalization, we show how the formation of an OD map in layer 4C is inherited by layer 2/3 via the vertical projections. Competition between these feedforward projections and the direct thalamic input to layer 2/3 then results in the formation of CO blobs superimposed upon the ocular dominance map. The spacing of the OD columns is determined by the spatial profile of the intralaminar connections within layer 4, while the spacing of CO blobs depends both on the width of the OD columns inherited from layer 4 and the spatial distribution of intralaminar connections within the superficial layer. The resulting CO blob distribution is shown to be consistent with experimental data. In addition, we numerically simulate monocular deprivation and find that while the CO blob distribution is unaltered, the OD pattern undergoes modification. The OD stripes of the deprived eye narrow, whereas the OD stripes for the remaining open eye widen.


title: Different Spectral Representations in Optimized Artificial Neural Networks and Brains

abstract: Recent studies suggest that artificial neural networks (ANNs) that match the spectral properties of the mammalian visual cortex -- namely, the $\sim 1/n$ eigenspectrum of the covariance matrix of neural activities -- achieve higher object recognition performance and robustness to adversarial attacks than those that do not. To our knowledge, however, no previous work systematically explored how modifying the ANN's spectral properties affects performance. To fill this gap, we performed a systematic search over spectral regularizers, forcing the ANN's eigenspectrum to follow $1/n^\alpha$ power laws with different exponents $\alpha$. We found that larger powers (around 2--3) lead to better validation accuracy and more robustness to adversarial attacks on dense networks. This surprising finding applied to both shallow and deep networks and it overturns the notion that the brain-like spectrum (corresponding to $\alpha \sim 1$) always optimizes ANN performance and/or robustness. For convolutional networks, the best $\alpha$ values depend on the task complexity and evaluation metric: lower $\alpha$ values optimized validation accuracy and robustness to adversarial attack for networks performing a simple object recognition task (categorizing MNIST images of handwritten digits); for a more complex task (categorizing CIFAR-10 natural images), we found that lower $\alpha$ values optimized validation accuracy whereas higher $\alpha$ values optimized adversarial robustness. These results have two main implications. First, they cast doubt on the notion that brain-like spectral properties ($\alpha \sim 1$) \emph{always} optimize ANN performance. Second, they demonstrate the potential for fine-tuned spectral regularizers to optimize a chosen design metric, i.e., accuracy and/or robustness.


title: Dynamical dark energy can explain the anomalous matter density fluctuation at $z\sim4$

abstract: Recently, under the standard cosmological model, a new growth tension between the Planck-2018 observation and the combined observation of cosmic microwave background lensing and galaxy clustering at $z\sim4$ emerges over the $1\,\sigma$ confidence level. We demonstrate that dynamical dark energy can well solve this tension within the $1\,\sigma$ confidence level. This implies that the new measurement of large scale structure at high redshift may give the evidence of evolution of dark energy over time.


title: Simpler and Better Cardinality Estimators for HyperLogLog and PCSA

abstract: \emph{Cardinality Estimation} (aka \emph{Distinct Elements}) is a classic problem in sketching with many industrial applications. Although sketching \emph{algorithms} are fairly simple, analyzing the cardinality \emph{estimators} is notoriously difficult, and even today the state-of-the-art sketches such as HyperLogLog and (compressed) \PCSA{} are not covered in graduate level Big Data courses. In this paper we define a class of \emph{generalized remaining area} (\tGRA) estimators, and observe that HyperLogLog, LogLog, and some estimators for PCSA are merely instantiations of \tGRA{} for various integral values of $\tau$. We then analyze the limiting relative variance of \tGRA{} estimators. It turns out that the standard estimators for HyperLogLog and PCSA can be improved by choosing a \emph{fractional} value of $\tau$. The resulting estimators come \emph{very} close to the Cram\'{e}r-Rao lower bounds for HyperLogLog{} and PCSA derived from their Fisher information. Although the Cram\'{e}r-Rao lower bound \emph{can} be achieved with the Maximum Likelihood Estimator (MLE), the MLE is cumbersome to compute and dynamically update. In contrast, \tGRA{} estimators are trivial to update in constant time. Our presentation assumes only basic calculus and probability, not any complex analysis~\cite{FlajoletM85,DurandF03,FlajoletFGM07}.


title: Transversality and framed cobordism

abstract: Ren\'e Thom's remarkable and far-reaching concept of transversality has found numerous powerful applications. Most importantly, it allowed Thom to develop cobordism theory, which led to a piercing insight into the topology of smooth manifolds, when he generalized Lev Pontryagin's earlier concept of framed cobordism. For his profound findings, in 1958 he was awarded the Fields Medal. The present paper provides a down-to-earth approach to transversality theory which only assumes basic knowledge about smooth manifolds. Following an idea of Andrew Putman, we then use transversality to give a novel and detailed proof of an isomorphism theorem of Pontryagin about homotopy groups of spheres whose original proof is generally believed to be rather hard to access.


title: Robotic Perception in Agri-food Manipulation: A Review

abstract: To better optimise the global food supply chain, robotic solutions are needed to automate tasks currently completed by humans. Namely, phenotyping, quality analysis and harvesting are all open problems in the field of agricultural robotics. Robotic perception is a key challenge for autonomous solutions to such problems as scene understanding and object detection are vital prerequisites to any grasping tasks that a robot may undertake. This work conducts a brief review of modern robot perception models and discusses their efficacy within the agri-food domain.


title: EBSnoR: Event-Based Snow Removal by Optimal Dwell Time Thresholding

abstract: We propose an Event-Based Snow Removal algorithm called EBSnoR. We developed a technique to measure the dwell time of snowflakes on a pixel using event-based camera data, which is used to carry out a Neyman-Pearson hypothesis test to partition event stream into snowflake and background events. The effectiveness of the proposed EBSnoR was verified on a new dataset called UDayton22EBSnow, comprised of front-facing event-based camera in a car driving through snow with manually annotated bounding boxes around surrounding vehicles. Qualitatively, EBSnoR correctly identifies events corresponding to snowflakes; and quantitatively, EBSnoR-preprocessed event data improved the performance of event-based car detection algorithms.


title: Percolation through Voids around Toroidal Inclusions

abstract: In the case of media comprised of impermeable particles, fluid flows through voids around impenetrable grains. For sufficiently low concentrations of the latter, spaces around grains join to allow transport on macroscopic scales, whereas greater impenetrable inclusion densities disrupt void networks and block macroscopic fluid flow. A critical grain concentration $\rho_{c}$ marks the percolation transition or phase boundary separating these two regimes. With a dynamical infiltration technique in which virtual tracer particles explore void spaces, we calculate critical grain concentrations for randomly placed interpenetrating impermeable toroidal inclusions; the latter consist of surfaces of revolution with circular and square cross sections. In this manner, we study for the first time continuum percolation transitions involving non-convex grains. As the radius of revolution increases relative to the length scale of the torus cross section, the tori develop a central hole, a topological transition accompanied by a cusp in the critical porosity for percolation. With a further increase in the radius of revolution, as constituent grains become more ring-like in appearance, we find that the critical porosity converges to that of high aspect ratio cylindrical counterparts only for randomly oriented grains.


title: Improving Sample Efficiency in Evolutionary RL Using Off-Policy Ranking

abstract: Evolution Strategy (ES) is a powerful black-box optimization technique based on the idea of natural evolution. In each of its iterations, a key step entails ranking candidate solutions based on some fitness score. For an ES method in Reinforcement Learning (RL), this ranking step requires evaluating multiple policies. This is presently done via on-policy approaches: each policy's score is estimated by interacting several times with the environment using that policy. This leads to a lot of wasteful interactions since, once the ranking is done, only the data associated with the top-ranked policies is used for subsequent learning. To improve sample efficiency, we propose a novel off-policy alternative for ranking, based on a local approximation for the fitness function. We demonstrate our idea in the context of a state-of-the-art ES method called the Augmented Random Search (ARS). Simulations in MuJoCo tasks show that, compared to the original ARS, our off-policy variant has similar running times for reaching reward thresholds but needs only around 70% as much data. It also outperforms the recent Trust Region ES. We believe our ideas should be extendable to other ES methods as well.


title: An Intense, Continuous Cold Atom Source

abstract: We demonstrate an intense, continuous cold atom beam generated via post nozzle seeding of a supersonic helium jet with $^7$Li atoms. The nozzle is cooled to about 4.4 K to reduce the forward velocity of the atoms. The atomic beam is brought to a focus 175 cm from the nozzle by a 10 cm bore diameter magnetic hexapole lens. Absorption and fluorescence imaging of the focus show a flux of $2.3(4) \times 10^{12}$ atoms/s, brightness of $4.1(7)\times 10^{19}$ $\textrm{m}^{-2}\textrm{s}^{-1}\textrm{sr}^{-1}$, forward velocity of 211(2) m/s, and longitudinal temperature of 7(3) mK. Results agree with a Monte Carlo simulation of the seeding dynamics and a particle tracing simulation of the atom lens. We project that 10 times higher flux would be possible with improved vacuum system design. Our method should provide a useful high-brightness source for atom-optical and other atomic and molecular physics applications.


title: Observation of dense collisional soliton complexes in a two-component Bose-Einstein condensate

abstract: Solitons are nonlinear solitary waves which maintain their shape over time and through collisions, occurring in a variety of nonlinear media from plasmas to optics. We present an experimental and theoretical study of hydrodynamic phenomena in a two-component atomic Bose-Einstein condensate where a soliton array emerges from the imprinting of a periodic spin pattern by a microwave pulse-based winding technique. We observe the ensuing dynamics which include shape deformations, the emergence of dark-antidark solitons, apparent spatial frequency tripling, and decay and revival of contrast related to soliton collisions. For the densest arrays, we obtain soliton complexes where solitons undergo continued collisions for long evolution times providing an avenue towards the investigation of soliton gases in atomic condensates.


title: Inference for Joint Quantile and Expected Shortfall Regression

abstract: Quantiles and expected shortfalls are commonly used risk measures in financial risk management. The two measurements are correlated while have distinguished features. In this project, our primary goal is to develop stable and practical inference method for conditional expected shortfall. To facilitate the statistical inference procedure, we consider the joint modeling of conditional quantile and expected shortfall. While the regression coefficients can be estimated jointly by minimizing a class of strictly consistent joint loss functions, the computation is challenging especially when the dimension of parameters is large since the loss functions are neither differentiable nor convex. To reduce the computational effort, we propose a two-step estimation procedure by first estimating the quantile regression parameters with standard quantile regression. We show that the two-step estimator has the same asymptotic properties as the joint estimator, but the former is numerically more efficient. We further develop a score-type inference method for hypothesis testing and confidence interval construction. Compared to the Wald-type method, the score method is robust against heterogeneity and is superior in finite samples, especially for cases with a large number of confounding factors. We demonstrate the advantages of the proposed methods over existing approaches through numerical studies.


title: Three-body scattering and quantization conditions from $S$ matrix unitarity

abstract: Two methodologies have been presented in the literature which connect relativistic three-particle scattering amplitudes with lattice QCD spectra -- the ``relativistic effective field theory'' approach and the ``finite-volume unitarity'' method. While both methods have been shown to be equivalent in various works, it has not been shown how to arrive at the relativistic effective field theory results directly from $S$ matrix unitarity. In this work, we provide a simple proof of the relativistic effective field theory form of the scattering equations directly from unitarity. Motivated by the finite-volume unitarity approach, we then postulate a set of quantization conditions which relate the finite-volume energy spectra to the $K$ matrices which drive the short-distance physics in the scattering equations, obtaining all previously known results for three identical particles. This work also presents new relations which provide a new pathway to generalize the results to arbitrary systems.


title: Widely-Linear MMSE Estimation of Complex-Valued Graph Signals

abstract: In this paper, we consider the problem of recovering random graph signals with complex values. For general Bayesian estimation of complex-valued vectors, it is known that the widely-linear minimum mean-squared-error (WLMMSE) estimator can achieve a lower mean-squared-error (MSE) than that of the linear minimum MSE (LMMSE) estimator. Inspired by the WLMMSE estimator, in this paper we develop the graph signal processing (GSP)-WLMMSE estimator, which minimizes the MSE among estimators that are represented as a two-channel output of a graph filter, i.e. widely-linear GSP estimators. We discuss the properties of the proposed GSP-WLMMSE estimator. In particular, we show that the MSE of the GSP-WLMMSE estimator is always equal to or lower than the MSE of the GSP-LMMSE estimator. The GSP-WLMMSE estimator is based on diagonal covariance matrices in the graph frequency domain, and thus has reduced complexity compared with the WLMMSE estimator. This property is especially important when using the sample-mean versions of these estimators that are based on a training dataset. We then state conditions under which the low-complexity GSP-WLMMSE estimator coincides with the WLMMSE estimator. In the simulations, we investigate two synthetic estimation problems (with linear and nonlinear models) and the problem of state estimation in power systems. For these problems, it is shown that the GSP-WLMMSE estimator outperforms the GSP-LMMSE estimator and achieves similar performance to that of the WLMMSE estimator.


title: A note on $3d$-monochromatic random waves and cancellation

abstract: In this note we prove that the asymptotic variance of the nodal length of complex-valued monochromatic random waves restricted to an increasing domain in $\R^3$ is linear in the volume of the domain. Put together with previous results this shows that a Central Limit Theorem holds true for $3$-dimensional monochromatic random waves. We compare with the variance of the nodal length of the real-valued $2$-dimensional monochromatic random waves where a faster divergence rate is observed, this fact is connected with Berry's cancellation phenomenon. Moreover, we show that a concentration phenomenon takes place.


title: A Survey and Framework of Cooperative Perception: From Heterogeneous Singleton to Hierarchical Cooperation

abstract: Perceiving the environment is one of the most fundamental keys to enabling Cooperative Driving Automation (CDA), which is regarded as the revolutionary solution to addressing the safety, mobility, and sustainability issues of contemporary transportation systems. Although an unprecedented evolution is now happening in the area of computer vision for object perception, state-of-the-art perception methods are still struggling with sophisticated real-world traffic environments due to the inevitably physical occlusion and limited receptive field of single-vehicle systems. Based on multiple spatially separated perception nodes, Cooperative Perception (CP) is born to unlock the bottleneck of perception for driving automation. In this paper, we comprehensively review and analyze the research progress on CP and, to the best of our knowledge, this is the first time to propose a unified CP framework. Architectures and taxonomy of CP systems based on different types of sensors are reviewed to show a high-level description of the workflow and different structures for CP systems. Node structure, sensor modality, and fusion schemes are reviewed and analyzed with comprehensive literature to provide detailed explanations of specific methods. A Hierarchical CP framework is proposed, followed by a review of existing Datasets and Simulators to sketch an overall landscape of CP. Discussion highlights the current opportunities, open challenges, and anticipated future trends.


title: Automated Temporal Segmentation of Orofacial Assessment Videos

abstract: Computer vision techniques can help automate or partially automate clinical examination of orofacial impairments to provide accurate and objective assessments. Towards the development of such automated systems, we evaluated two approaches to detect and temporally segment (parse) repetitions in orofacial assessment videos. Recorded videos of participants with amyotrophic lateral sclerosis (ALS) and healthy control (HC) individuals were obtained from the Toronto NeuroFace Dataset. Two approaches for repetition detection and parsing were examined: one based on engineered features from tracked facial landmarks and peak detection in the distance between the vermilion-cutaneous junction of the upper and lower lips (baseline analysis), and another using a pre-trained transformer-based deep learning model called RepNet (Dwibedi et al, 2020), which automatically detects periodicity, and parses periodic and semi-periodic repetitions in video data. In experimental evaluation of two orofacial assessments tasks, - repeating maximum mouth opening (OPEN) and repeating the sentence "Buy Bobby a Puppy" (BBP) - RepNet provided better parsing than the landmark-based approach, quantified by higher mean intersection-over-union (IoU) with respect to ground truth manual parsing. Automated parsing using RepNet also clearly separated HC and ALS participants based on the duration of BBP repetitions, whereas the landmark-based method could not.


title: DIDER: Discovering Interpretable Dynamically Evolving Relations

abstract: Effective understanding of dynamically evolving multiagent interactions is crucial to capturing the underlying behavior of agents in social systems. It is usually challenging to observe these interactions directly, and therefore modeling the latent interactions is essential for realizing the complex behaviors. Recent work on Dynamic Neural Relational Inference (DNRI) captures explicit inter-agent interactions at every step. However, prediction at every step results in noisy interactions and lacks intrinsic interpretability without post-hoc inspection. Moreover, it requires access to ground truth annotations to analyze the predicted interactions, which are hard to obtain. This paper introduces DIDER, Discovering Interpretable Dynamically Evolving Relations, a generic end-to-end interaction modeling framework with intrinsic interpretability. DIDER discovers an interpretable sequence of inter-agent interactions by disentangling the task of latent interaction prediction into sub-interaction prediction and duration estimation. By imposing the consistency of a sub-interaction type over an extended time duration, the proposed framework achieves intrinsic interpretability without requiring any post-hoc inspection. We evaluate DIDER on both synthetic and real-world datasets. The experimental results demonstrate that modeling disentangled and interpretable dynamic relations improves performance on trajectory forecasting tasks.


title: Performance Modeling Sparse MTTKRP Using Optical Static Random Access Memory on FPGA

abstract: Electrical static random memory (E-SRAM) is the current standard for internal static memory in Field Programmable Gate Array (FPGA). Despite the dramatic improvement in E-SRAM technology over the past decade, the goal of ultra-fast, energy-efficient static random memory has yet to be achieved with E-SRAM technology. However, preliminary research into optical static random access memory (O-SRAM) has shown promising results in creating energy-efficient ultra-fast static memories. This paper investigates the advantage of O-SRAM over E-SRAM in access speed and energy performance while executing sparse Matricized Tensor Times Khatri-Rao Product (spMTTKRP). spMTTKRP is an essential component of tensor decomposition algorithms which is heavily used in data science applications. The evaluation results show O-SRAMs can achieve speeds of 1.1x - 2.9x while saving 2.8x - 8.1x energy compared to conventional E-SRAM technology.


title: Anisotropic star models in the context of vanishing complexity

abstract: We use the definition of complexity for static and self--gravitating objects to build up three physical general relativistic anisotropic models fulfilling the vanishing complexity condition which serves to provide the extra information needed to close the system of Einstein field equations. We evaluate the physical acceptability of these models by testing some of the conditions that the geometric and material sector must satisfy in order to be considered as reasonable realistic models. We present the results of this analysis by asserting that the studied cases demonstrate to be feasible and stable under the chosen set of parameters. Furthermore, the $P_{\perp}=0$ and the Consenza's anisotropy models that seem not satisfying the expect conditions are also discussed.


title: Smooth limits of plane curves of prime degree and Markov numbers

abstract: For prime degree hypersurfaces of dimension at least 3, Mori asked if every smooth proper limit is still a hypersurface. Interestingly in dimensions 1 and 2, this is not the case. For example, Griffin constructed explicit families of quintic curves that give counterexamples in dimension 1 (Horikawa constructed similar examples for quintics in dimension 2). In this paper we propose a conjecture explaining these examples using Hacking and Prokhorov's work on Q-Gorenstein limits of the projective plane. In particular, if p is a prime number that is not a Markov number, we conjecture that any smooth projective limit of plane curves of degree p is a plane curve. The main results are to prove this conjecture for degree 7 curves and to extend Griffin's counterexamples to all prime numbers that are also Markov numbers.


title: Systematic strain-induced bandgap tuning in binary III-V semiconductors from density functional theory

abstract: The modification of the nature and size of bandgaps for III-V semiconductors is of strong interest for optoelectronic applications. Strain can be used to systematically tune the bandgap over a wide range of values and induce indirect-to-direct (IDT), direct-to-indirect (DIT), and other changes in bandgap nature. Here, we establish a predictive ab initio approach, based on density functional theory, to analyze the effect of uniaxial, biaxial, and isotropic strain on the bandgap. We show that systematic variation is possible. For GaAs, DITs were observed at 1.52% isotropic compressive strain and 3.52% tensile strain, while for GaP an IDT was found at 2.63% isotropic tensile strain. We additionally propose a strategy for the realization of direct-indirect transition by combining biaxial strain with uniaxial strain. Further transition points were identified for strained GaSb, InP, InAs, and InSb and compared to the elemental semiconductor silicon. Our analyses thus provide a systematic and predictive approach to strain-induced bandgap tuning in binary III-V semiconductors.


title: Concurrent Validity of Automatic Speech and Pause Measures During Passage Reading in ALS

abstract: The analysis of speech measures in individuals with amyotrophic lateral sclerosis (ALS) can provide essential information for early diagnosis and tracking disease progression. However, current methods for extracting speech and pause features are manual or semi-automatic, which makes them time-consuming and labour-intensive. The advent of speech-text alignment algorithms provides an opportunity for inexpensive, automated, and accurate analysis of speech measures in individuals with ALS. There is a need to validate speech and pause features calculated by these algorithms against current gold standard methods. In this study, we extracted 8 speech/pause features from 646 audio files of individuals with ALS and healthy controls performing passage reading. Two pretrained forced alignment models - one using transformers and another using a Gaussian mixture / hidden Markov architecture - were used for automatic feature extraction. The results were then validated against semi-automatic speech/pause analysis software, with further subgroup analyses based on audio quality and disease severity. Features extracted using transformer-based forced alignment had the highest agreement with gold standards, including in terms of audio quality and disease severity. This study lays the groundwork for future intelligent diagnostic support systems for clinicians, and for novel methods of tracking disease progression remotely from home.


title: Detect Hate Speech in Unseen Domains using Multi-Task Learning: A Case Study of Political Public Figures

abstract: Automatic identification of hateful and abusive content is vital in combating the spread of harmful online content and its damaging effects. Most existing works evaluate models by examining the generalization error on train-test splits on hate speech datasets. These datasets often differ in their definitions and labeling criteria, leading to poor model performance when predicting across new domains and datasets. In this work, we propose a new Multi-task Learning (MTL) pipeline that utilizes MTL to train simultaneously across multiple hate speech datasets to construct a more encompassing classification model. We simulate evaluation on new previously unseen datasets by adopting a leave-one-out scheme in which we omit a target dataset from training and jointly train on the other datasets. Our results consistently outperform a large sample of existing work. We show strong results when examining generalization error in train-test splits and substantial improvements when predicting on previously unseen datasets. Furthermore, we assemble a novel dataset, dubbed PubFigs, focusing on the problematic speech of American Public Political Figures. We automatically detect problematic speech in the $305,235$ tweets in PubFigs, and we uncover insights into the posting behaviors of public figures.


title: Comparison of Quantum PUF models

abstract: Physical unclonable functions (PUFs) are hardware structures in a physical system (e.g. semiconductor, crystals etc.) that are used to enable unique identification of the semiconductor or to secure keys for cryptographic processes. A PUF thus generates a noisy secret reproducible at runtime. This secret can either be used to authenticate the chip, or it is available as a cryptographic key after removing the noise. Latest advancements in the field of quantum hardware, in some cases claiming to achieve quantum supremacy, highly target the fragility of current RSA type classical cryptosystems. As a solution, one would like to develop Quantum PUFs to mitigate such problem. There are several approaches for this technology. In our work we compare these different approaches and introduce the requirements for QTOKSim, a quantum token based authentication simulator testing its performance on a multi-factor authentication protocol.


title: OPE-based Methods in Nonperturbative QCD

abstract: I describe the inception and development of nonperturbative OPE-based methods in hadronic physics, such as the SVZ sum rules, inverse heavy quark mass expansion (IHQME) and so on and related topics.


title: Deriving time-averaged active inference from control principles

abstract: Active inference offers a principled account of behavior as minimizing average sensory surprise over time. Applications of active inference to control problems have heretofore tended to focus on finite-horizon or discounted-surprise problems, despite deriving from the infinite-horizon, average-surprise imperative of the free-energy principle. Here we derive an infinite-horizon, average-surprise formulation of active inference from optimal control principles. Our formulation returns to the roots of active inference in neuroanatomy and neurophysiology, formally reconnecting active inference to optimal feedback control. Our formulation provides a unified objective functional for sensorimotor control and allows for reference states to vary over time.


title: ABL: An original active blacklist based on a modification of the SMTP

abstract: This paper presents a novel Active Blacklist (ABL) based on a modification of the Simple Mail Transfer Protocol (SMTP). ABL was implemented in the Mail Transfer Agent (MTA) Postfix of the e-mail server Zimbra and assessed exhaustively in a series of experiments. The modified server Zimbra showed computational performance and costs similar to those of the original server Zimbra when receiving legitimate e-mails. When receiving spam, however, it showed better computing performance and costs than the original Zimbra. Moreover, there was a considerable computational cost on the spammer's server when it sent spam e-mails. ABL was assessed at the Federal University of Itajub\'{a}, Brazil, during a period of sixty-one days. It was responsible for rejecting a percentage of 20.94% of the spam e-mails received by the university during this period. After this period, it was deployed and remained in use, from July-2015 to July-2019, at the university. ABL is part of the new Open Machine-Learning-Based Anti-Spam (Open-MaLBAS). Both ABL and Open-MaLBAS are freely available on GitHub.


title: Exploring Interactions with Printed Data Visualizations in Augmented Reality

abstract: This paper presents a design space of interaction techniques to engage with visualizations that are printed on paper and augmented through Augmented Reality. Paper sheets are widely used to deploy visualizations and provide a rich set of tangible affordances for interactions, such as touch, folding, tilting, or stacking. At the same time, augmented reality can dynamically update visualization content to provide commands such as pan, zoom, filter, or detail on demand. This paper is the first to provide a structured approach to mapping possible actions with the paper to interaction commands. This design space and the findings of a controlled user study have implications for future designs of augmented reality systems involving paper sheets and visualizations. Through workshops (N=20) and ideation, we identified 81 interactions that we classify in three dimensions: 1) commands that can be supported by an interaction, 2) the specific parameters provided by an (inter)action with paper, and 3) the number of paper sheets involved in an interaction. We tested user preference and viability of 11 of these interactions with a prototype implementation in a controlled study (N=12, HoloLens 2) and found that most of the interactions are intuitive and engaging to use. We summarized interactions (e.g., tilt to pan) that have strong affordance to complement "point" for data exploration, physical limitations and properties of paper as a medium, cases requiring redundancy and shortcuts, and other implications for design.


title: Product-free sets in approximate subgroups of distal groups

abstract: Recall that a subset $X$ of a group $G$ is 'product-free' if $X^2\cap X=\varnothing$, ie if $xy\notin X$ for all $x,y\in X$. Let $G$ be a group definable in a distal structure. We prove there are constants $c>0$ and $\delta\in(0,1)$ such that every finite subset $X\subseteq G$ distinct from $\{1\}$ contains a product-free subset of size at least $\delta|X|^{c+1}/|X^2|^c$. In particular, every finite $k$-approximate subgroup of $G$ distinct from $\{1\}$ contains a product-free subset of density at least $\delta/k^c$. The proof is short, and follows quickly from Ruzsa calculus and an iterated application of Chernikov and Starchenko's distal regularity lemma.


title: SoK: Explainable Machine Learning for Computer Security Applications

abstract: Explainable Artificial Intelligence (XAI) aims to improve the transparency of machine learning (ML) pipelines. We systematize the increasingly growing (but fragmented) microcosm of studies that develop and utilize XAI methods for defensive and offensive cybersecurity tasks. We identify 3 cybersecurity stakeholders, i.e., model users, designers, and adversaries, who utilize XAI for 4 distinct objectives within an ML pipeline, namely 1) XAI-enabled user assistance, 2) XAI-enabled model verification, 3) explanation verification & robustness, and 4) offensive use of explanations. Our analysis of the literature indicates that many of the XAI applications are designed with little understanding of how they might be integrated into analyst workflows -- user studies for explanation evaluation are conducted in only 14% of the cases. The security literature sometimes also fails to disentangle the role of the various stakeholders, e.g., by providing explanations to model users and designers while also exposing them to adversaries. Additionally, the role of model designers is particularly minimized in the security literature. To this end, we present an illustrative tutorial for model designers, demonstrating how XAI can help with model verification. We also discuss scenarios where interpretability by design may be a better alternative. The systematization and the tutorial enable us to challenge several assumptions, and present open problems that can help shape the future of XAI research within cybersecurity.


title: LEAPER: Fast and Accurate FPGA-based System Performance Prediction via Transfer Learning

abstract: Machine learning has recently gained traction as a way to overcome the slow accelerator generation and implementation process on an FPGA. It can be used to build performance and resource usage models that enable fast early-stage design space exploration. First, training requires large amounts of data (features extracted from design synthesis and implementation tools), which is cost-inefficient because of the time-consuming accelerator design and implementation process. Second, a model trained for a specific environment cannot predict performance or resource usage for a new, unknown environment. In a cloud system, renting a platform for data collection to build an ML model can significantly increase the total-cost-ownership (TCO) of a system. Third, ML-based models trained using a limited number of samples are prone to overfitting. To overcome these limitations, we propose LEAPER, a transfer learning-based approach for prediction of performance and resource usage in FPGA-based systems. The key idea of LEAPER is to transfer an ML-based performance and resource usage model trained for a low-end edge environment to a new, high-end cloud environment to provide fast and accurate predictions for accelerator implementation. Experimental results show that LEAPER (1) provides, on average across six workloads and five FPGAs, 85% accuracy when we use our transferred model for prediction in a cloud environment with 5-shot learning and (2) reduces design-space exploration time for accelerator implementation on an FPGA by 10x, from days to only a few hours.


title: Individual Tree Detection in Large-Scale Urban Environments using High-Resolution Multispectral Imagery

abstract: We introduce a novel deep learning method for detection of individual trees in urban environments using high-resolution multispectral aerial imagery. We use a convolutional neural network to regress a confidence map indicating the locations of individual trees, which are localized using a peak finding algorithm. Our method provides complete spatial coverage by detecting trees in both public and private spaces, and can scale to very large areas. We performed a thorough evaluation of our method, supported by a new dataset of over 1,500 images and almost 100,000 tree annotations, covering eight cities, six climate zones, and three image capture years. We trained our model on data from Southern California, and achieved a precision of 73.6% and recall of 73.3% using test data from this region. We generally observed similar precision and slightly lower recall when extrapolating to other California climate zones and image capture dates. We used our method to produce a map of trees in the entire urban forest of California, and estimated the total number of urban trees in California to be about 43.5 million. Our study indicates the potential for deep learning methods to support future urban forestry studies at unprecedented scales.


title: RIBAC: Towards Robust and Imperceptible Backdoor Attack against Compact DNN

abstract: Recently backdoor attack has become an emerging threat to the security of deep neural network (DNN) models. To date, most of the existing studies focus on backdoor attack against the uncompressed model; while the vulnerability of compressed DNNs, which are widely used in the practical applications, is little exploited yet. In this paper, we propose to study and develop Robust and Imperceptible Backdoor Attack against Compact DNN models (RIBAC). By performing systematic analysis and exploration on the important design knobs, we propose a framework that can learn the proper trigger patterns, model parameters and pruning masks in an efficient way. Thereby achieving high trigger stealthiness, high attack success rate and high model efficiency simultaneously. Extensive evaluations across different datasets, including the test against the state-of-the-art defense mechanisms, demonstrate the high robustness, stealthiness and model efficiency of RIBAC. Code is available at https://github.com/huyvnphan/ECCV2022-RIBAC


title: Global Concept-Based Interpretability for Graph Neural Networks via Neuron Analysis

abstract: Graph neural networks (GNNs) are highly effective on a variety of graph-related tasks; however, they lack interpretability and transparency. Current explainability approaches are typically local and treat GNNs as black-boxes. They do not look inside the model, inhibiting human trust in the model and explanations. Motivated by the ability of neurons to detect high-level semantic concepts in vision models, we perform a novel analysis on the behaviour of individual GNN neurons to answer questions about GNN interpretability, and propose new metrics for evaluating the interpretability of GNN neurons. We propose a novel approach for producing global explanations for GNNs using neuron-level concepts to enable practitioners to have a high-level view of the model. Specifically, (i) to the best of our knowledge, this is the first work which shows that GNN neurons act as concept detectors and have strong alignment with concepts formulated as logical compositions of node degree and neighbourhood properties; (ii) we quantitatively assess the importance of detected concepts, and identify a trade-off between training duration and neuron-level interpretability; (iii) we demonstrate that our global explainability approach has advantages over the current state-of-the-art -- we can disentangle the explanation into individual interpretable concepts backed by logical descriptions, which reduces potential for bias and improves user-friendliness.