title: Non-hermitian time evolution: from static to parametric instability

abstract: Eigenmode coalescence imparts remarkable properties to non-hermitian time evolution, culminating in a purely non-hermitian spectral degeneracy known as an exceptional point (EP). Here, we revisit time evolution at the EP and classify two-level non-hermitian Hamiltonians in terms of the M\"obius group. We then leverage that classification to study dynamical EP encircling, by applying it to periodically-modulated (Floquet) Hamiltonians. This reveals that Floquet non-hermitian systems exhibit rich physics whose complexity is not captured by an EP-encircling rule. For example, Floquet EPs can occur without encircling and vice-versa. Instead, we show that the elaborate interplay between non-hermitian and modulation instabilities is better understood through the lens of parametric resonance.


title: Robust Audio-Visual Instance Discrimination

abstract: We present a self-supervised learning method to learn audio and video representations. Prior work uses the natural correspondence between audio and video to define a standard cross-modal instance discrimination task, where a model is trained to match representations from the two modalities. However, the standard approach introduces two sources of training noise. First, audio-visual correspondences often produce faulty positives since the audio and video signals can be uninformative of each other. To limit the detrimental impact of faulty positives, we optimize a weighted contrastive learning loss, which down-weighs their contribution to the overall loss. Second, since self-supervised contrastive learning relies on random sampling of negative instances, instances that are semantically similar to the base instance can be used as faulty negatives. To alleviate the impact of faulty negatives, we propose to optimize an instance discrimination loss with a soft target distribution that estimates relationships between instances. We validate our contributions through extensive experiments on action recognition tasks and show that they address the problems of audio-visual instance discrimination and improve transfer learning performance.


title: Restricted Boltzmann Machines as Models of Interacting Variables

abstract: We study the type of distributions that Restricted Boltzmann Machines (RBMs) with different activation functions can express by investigating the effect of the activation function of the hidden nodes on the marginal distribution they impose on observed binary nodes. We report an exact expression for these marginals in the form of a model of interacting binary variables with the explicit form of the interactions depending on the hidden node activation function. We study the properties of these interactions in detail and evaluate how the accuracy with which the RBM approximates distributions over binary variables depends on the hidden node activation function and on the number of hidden nodes. When the inferred RBM parameters are weak, an intuitive pattern is found for the expression of the interaction terms which reduces substantially the differences across activation functions. We show that the weak parameter approximation is a good approximation for different RBMs trained on the MNIST dataset. Interestingly, in these cases, the mapping reveals that the inferred models are essentially low order interaction models.

categories: stat.ML cond-mat.dis-nn cs.LG physics.data-an


title: MISA: Online Defense of Trojaned Models using Misattributions

abstract: Recent studies have shown that neural networks are vulnerable to Trojan attacks, where a network is trained to respond to specially crafted trigger patterns in the inputs in specific and potentially malicious ways. This paper proposes MISA, a new online approach to detect Trojan triggers for neural networks at inference time. Our approach is based on a novel notion called misattributions, which captures the anomalous manifestation of a Trojan activation in the feature space. Given an input image and the corresponding output prediction, our algorithm first computes the model's attribution on different features. It then statistically analyzes these attributions to ascertain the presence of a Trojan trigger. Across a set of benchmarks, we show that our method can effectively detect Trojan triggers for a wide variety of trigger patterns, including several recent ones for which there are no known defenses. Our method achieves 96% AUC for detecting images that include a Trojan trigger without any assumptions on the trigger pattern.


title: Modelling Heterogeneity Using Bayesian Structured Sparsity

abstract: How to estimate heterogeneity, e.g. the effect of some variable differing across observations, is a key question in political science. Methods for doing so make simplifying assumptions about the underlying nature of the heterogeneity to draw reliable inferences. This paper allows a common way of simplifying complex phenomenon (placing observations with similar effects into discrete groups) to be integrated into regression analysis. The framework allows researchers to (i) use their prior knowledge to guide which groups are permissible and (ii) appropriately quantify uncertainty. The paper does this by extending work on "structured sparsity" from a traditional penalized likelihood approach to a Bayesian one by deriving new theoretical results and inferential techniques. It shows that this method outperforms state-of-the-art methods for estimating heterogeneous effects when the underlying heterogeneity is grouped and more effectively identifies groups of observations with different effects in observational data.


title: Posets with $k$-outerplanar cover graphs have bounded dimension

abstract: In 2015, Felsner, Trotter, and Wiechert showed that posets with outerplanar cover graphs have bounded dimension. We generalise this result to posets with $k$-outerplanar cover graphs. Namely, we show that posets with $k$-outerplanar cover graph have dimension $\mathcal{O}(k^3)$. As a consequence, we show that every poset with a planar cover graph and height $h$ has dimension $\mathcal{O}(h^3)$. This improves the previously best known bound of $\mathcal{O}(h^6)$ by Kozik, Micek and Trotter.


title: On the multiscale behaviour of stellar activity and rotation of the planet host Kepler-30

abstract: Kepler-30 is a unique target to study stellar activity and rotation in a young solar-like star accompanied by a compact planetary system. We use about 4 years of high-precision photometry collected by the Kepler mission to investigate the fluctuations caused by photospheric convection, stellar rotation, and starspot evolution as a function of the timescale. Our main goal is to apply methods for the analysis of timeseries to find the timescales of the phenomena that affect the light variations. We correlate those timescales with periodicities in the star as well as in the planetary system. We model the flux rotational modulation induced by active regions using spot modelling and apply the MFDMA in standard and multiscale versions for analysing the behaviour of variability and light fluctuations that can be associated with stellar convection and the evolution of magnetic fields on timescales ranging from less than 1 day up to about 35 days. The light fluctuations produced by stellar activity can be described by the multifractal Hurst index that provides a measure of their persistence. The spot modeling indicates a lower limit to the relative surface differential rotation of $\Delta \Omega/\Omega\sim 0.02\pm 0.01$ and suggests a short-term cyclic variation in the starspot area with a period of $\sim 34$ days, virtually close to the synodic period of 35.2 days of the planet Kepler-30b. By subtracting the two timeseries of the SAP and PDC Kepler pipelines, we reduce the rotational modulation and find a 23.1-day period close to the synodic period of Kepler-30c. This period also appears in the multifractal analysis as a crossover of the fluctuation functions associated with the characteristic evolutionary timescales of the active regions in Kepler-30 as confirmed by spot modelling. These procedures and methods may be greatly useful for analysing current TESS and future PLATO data.


title: GGA-Level Subsystem DFT Achieves Sub-kcal/mol Accuracy Intermolecular Interactions by Mimicking Nonlocal Functionals

abstract: The key feature of nonlocal kinetic energy functionals is their ability to reduce to the Thomas-Fermi functional in the regions of high density and to the von Weizs\"acker functional in the region of low density/high density gradient. This behavior is crucial when these functionals are employed in subsystem DFT simulations to approximate the nonadditive kinetic energy. We propose a GGA nonadditive kinetic energy functional which mimics the good behavior of nonlocal functionals retaining the computational complexity of typical semilocal functionals. The new functional reproduces Kohn-Sham DFT and benchmark CCSD(T) interaction energies of weakly interacting dimers in the S22-5 and S66 test sets with a mean absolute deviation well below 1 kcal/mol.

categories: cond-mat.mtrl-sci physics.chem-ph physics.comp-ph quant-ph


title: Floquet Engineering of Lie Algebraic Quantum Systems

abstract: We propose a `Floquet engineering' formalism to systematically design a periodic driving protocol in order to stroboscopically realize the desired system starting from a given static Hamiltonian. The formalism is applicable to quantum systems which have an underlying closed Lie-algebraic structure, for example, solid-state systems with noninteracting particles moving on a lattice or its variant described by the ultra-cold atoms moving on an optical lattice. Unlike previous attempts at Floquet engineering, our method produces the desired Floquet Hamiltonian at any driving frequency and is not restricted to the fast or slow driving regimes. The approach is based on Wei-Norman ansatz, which was originally proposed to construct a time-evolution operator for any arbitrary driving. Here, we apply this ansatz to the micro-motion dynamics, defined within one period of the driving, and obtain the driving protocol by fixing the gauge of the micro-motion. To illustrate our idea, we use a two-band system or the systems consisting of two sub-lattices as a testbed. Particularly, we focus on engineering the cross-stitched lattice model that has been a paradigmatic flat-band model.


title: How Far Can We Go in Compute-less Networking: Computation Correctness and Accuracy

abstract: Emerging applications such as augmented reality and tactile Internet are compute-intensive and latency-sensitive, which hampers their running in constrained end devices alone or in the distant cloud. The stringent requirements of such application drove to the realization of Edge computing in which computation is offloaded near to users. Compute-less networking is an extension of edge computing that aims at reducing computation and abridging communication by adopting in-network computing and computation reuse. Computation reuse aims to cache the result of computations and use them to perform similar tasks in the future and, therefore, avoid redundant calculations and optimize the use of resources. In this paper, we focus on the correctness of the final output produced by computation reuse. Since the input might not be identical but similar, the reuse of previous computation raises questions about the accuracy of the final results. To this end, we implement a proof of concept to study and gauge the effectiveness and efficiency of computation reuse. We are able to reduce task completion time by up to 80% while ensuring high correctness. We further discuss open challenges and highlight future research directions.


title: Joint Nonanticipative Rate Distortion Function for a Tuple of Random Processes with Individual Fidelity Criteria

abstract: The joint nonanticipative rate distortion function (NRDF) for a tuple of random processes with individual fidelity criteria is considered. Structural properties of optimal test channel distributions are derived. Further, for the application example of the joint NRDF of a tuple of jointly multivariate Gaussian Markov processes with individual square-error fidelity criteria, a realization of the reproduction processes which induces the optimal test channel distribution is derived, and the corresponding joint NRDF is characterized. The analysis of the simplest example, of a tuple of scalar correlated Markov processes, illustrates many of the challenging aspects of such problems.


title: Interpolation by decomposable univariate polynomials

abstract: The usual univariate interpolation problem of finding a monic polynomial f of degree n that interpolates n given values is well understood. This paper studies a variant where f is required to be composite, say, a composition of two polynomials of degrees d and e, respectively, with de=n, and therefore d+e-1 given values. Some special cases are easy to solve, and for the general case, we construct a homotopy between it and a special case. We compute a geometric solution of the algebraic curve presenting this homotopy, and this also provides an answer to the interpolation task. The computing time is polynomial in the geometric data, like the degree, of this curve. A consequence is that for almost all inputs, a decomposable interpolation polynomial exists.


title: Explaining a Neural Attention Model for Aspect-Based Sentiment Classification Using Diagnostic Classification

abstract: Many high performance machine learning models for Aspect-Based Sentiment Classification (ABSC) produce black box models, and therefore barely explain how they classify a certain sentiment value towards an aspect. In this paper, we propose explanation models, that inspect the internal dynamics of a state-of-the-art neural attention model, the LCR-Rot-hop, by using a technique called Diagnostic Classification. Our diagnostic classifier is a simple neural network, which evaluates whether the internal layers of the LCR-Rot-hop model encode useful word information for classification, i.e., the part of speech, the sentiment value, the presence of aspect relation, and the aspect-related sentiment value of words. We conclude that the lower layers in the LCR-Rot-hop model encode the part of speech and the sentiment value, whereas the higher layers represent the presence of a relation with the aspect and the aspect-related sentiment value of words.


title: Hybrid Power-Law Models of Network Traffic

abstract: The availability of large scale streaming network data has reinforced the ubiquity of power-law distributions in observations and enabled precision measurements of the distribution parameters. The increased accuracy of these measurements allows new underlying generative network models to be explored. The preferential attachment model is a natural starting point for these models. This work adds additional model components to account for observed phenomena in the distributions. In this model, preferential attachment is supplemented to provide a more accurate theoretical model of network traffic. Specifically, a probabilistic complex network model is proposed using preferential attachment as well as additional parameters to describe the newly observed prevalence of leaves and unattached nodes. Example distributions from this model are generated by considering random sampling of the networks created by the model in such a way that replicates the current data collection methods.


title: Distributed Learning Consensus Control for Unknown Nonlinear Multi-Agent Systems based on Gaussian Processes

abstract: In this paper, a distributed learning leader-follower consensus protocol based on Gaussian process regression for a class of nonlinear multi-agent systems with unknown dynamics is designed. We propose a distributed learning approach to predict the residual dynamics for each agent. The stability of the consensus protocol using the data-driven model of the dynamics is shown via Lyapunov analysis. The followers ultimately synchronize to the leader with guaranteed error bounds by applying the proposed control law with a high probability. The effectiveness and the applicability of the developed protocol are demonstrated by simulation examples.


title: Hydrodynamic model of skyrmions and vorticities in the spin-1 Bose-Einstein condensate in ferromagnetic phase at finite temperatures

abstract: Quantum hydrodynamic of skyrmions in spinor ultracold bosons at the finite temperature is described. The limit regime of BEC appearing at the zero temperature is discussed either. The skyrmions are found as the solution of the spin evolution equation for the ferromagnetic phase of spin-1 ultracold bosons. It is demonstrated that the quantum part of the spin current gives major contribution in the formation of the skyrmions. The interplay between the quantum (spin) vorticity and the classic vorticity is considered for the finite temperatures. Bosons are presented as two fluids associated with the Bose-Einstein condensate and the normal fluid. All effects are considered for the ferromagnetic phase.


title: Beta functions for the duality-invariant sigma model

abstract: The $O(d,d)$ invariant worldsheet theory for bosonic string theory with $d$ abelian isometries is employed to compute the beta functions and Weyl anomaly at one-loop. We show that vanishing of the Weyl anomaly coefficients implies the equations of motion of the Maharana-Schwarz action. We give a self-contained introduction into the required techniques, including beta functions, the Weyl anomaly for two-dimensional sigma models and the background field method. This sets the stage for a sequel to this paper on generalizations to higher loops and $\alpha'$ corrections.


title: Comparison between the Cauchy problem and the scattering problem for the Landau damping in the Vlasov-HMF equation

abstract: We analyze the analytic Landau damping problem for the Vlasov-HMF equation, by fixing the asymptotic behavior of the solution. We use a new method for this "scattering problem", closer to the one used for the Cauchy problem. In this way we are able to compare the two results, emphasizing the different influence of the plasma echoes in the two approaches. In particular, we prove a non-perturbative result for the scattering problem.


title: Learning Under Adversarial and Interventional Shifts

abstract: Machine learning models are often trained on data from one distribution and deployed on others. So it becomes important to design models that are robust to distribution shifts. Most of the existing work focuses on optimizing for either adversarial shifts or interventional shifts. Adversarial methods lack expressivity in representing plausible shifts as they consider shifts to joint distributions in the data. Interventional methods allow more expressivity but provide robustness to unbounded shifts, resulting in overly conservative models. In this work, we combine the complementary strengths of the two approaches and propose a new formulation, RISe, for designing robust models against a set of distribution shifts that are at the intersection of adversarial and interventional shifts. We employ the distributionally robust optimization framework to optimize the resulting objective in both supervised and reinforcement learning settings. Extensive experimentation with synthetic and real world datasets from healthcare demonstrate the efficacy of the proposed approach.


title: Visuality in a Cross-disciplinary Battleground: Analysis of Inscriptions in Digital Humanities Journal Publications

abstract: Like the old saying, "a graph is worth a thousand words," the non-verbal language, encapsulated in the concept of inscription, is a fundamental rhetorical device in the construction of knowledge represented by research outputs. As many inscriptions are deeply situated in a scientific and data-driven research paradigm, they can be used to understand the relationships between research traditions involved in the field of digital humanities (DH), a highly cross-disciplinary field that is frequently regarded as a battleground between these distinct research traditions, especially the humanities and STEM fields. This paper presents a quantitative, community-focused examination of how inscriptions are used in English-language research articles in DH journals. We randomly selected 252 articles published between 2011 and 2020 from a representative DH journal list, and manually coded and classified inscriptions and author domains in these publications. We found that inscriptions have been increasingly used during the past decade and their uses are more intensive in publications led by STEM authors comparing to other domains. This study offers a timely survey of the disciplinary landscape of DH from the perspective of inscriptions and sheds light on how different research approaches collaborated and combated in the field of DH.


title: The improved inverted AlGaAs/GaAs interface: its relevance for high-mobility quantum wells and hybrid systems

abstract: Two dimensional electron gases (2DEGs) realized at GaAs/AlGaAs single interfaces by molecular-beam epitaxy (MBE) reach mobilities of about 15 million cm^2/Vs if the AlGaAs alloy is grown after the GaAs. Surprisingly, the mobilities may drop to a few millions for the identical but inverted AlGaAs/GaAs interface, i.e. reversed layering. Here we report on a series of inverted heterostructures with varying growth parameters including temperature, doping, and composition. Minimizing the segregation of both dopants and background impurities leads to mobilities of 13 million cm^2/Vs for inverted structures. The dependence of the mobility on electron density tunes by a gate or by illumination is found to be the identical if no doping layers exist between the 2DEG and the respective gate. Otherwise, it differs significantly compared to normal interface structures. Reducing the distance of the 2DEG to the surface down to 50nm requires an additional doping layer between 2DEG and surface in order to compensate for the surface-Schottky barrier. The suitability of such shallow inverted structures for future semiconductor-superconductor hybrid systems is discussed. Lastly, our understanding of the improved inverted interface enables us to produce optimized double-sided doped quantum wells exhibiting an electron mobility of 40 million cm^2/Vs at 1K.


title: Narrowing of d bands of FeCo layers intercalated under graphene

abstract: We report on the electronic properties of an artificial system obtained by the intercalation of equiatomic FeCo layers under graphene grown on Ir(111). Upon intercalation, the FeCo film grows epitaxially on Ir(111), resulting in a lattice-mismatched system. By performing Density Functional Theory calculations, we show that the intercalated FeCo layer leads to a pronounced corrugation of the graphene film. At the same time, the FeCo intercalated layers induce a clear transition from a nearly undisturbed to a strongly hybridized graphene {\pi}-band, as measured by angle-resolved photoemission spectroscopy. A comparison of experimental results with the computed band structure and the projected density of states unveils a spin-selective hybridization between the {\pi} band of graphene and FeCo-3d states. Our results demonstrate that the reduced dimensionality, as well as the hybridization within the FeCo layers, induce a narrowing and a clear splitting of Fe 3d-up and Fe 3d-down spin bands of the confined FeCo layers with respect to bulk Fe and Co.


title: Topological phase transition in chiral graphene nanoribbons: from edge bands to end states

abstract: Precise control over the size and shape of graphene nanostructures allows engineering spin-polarized edge and topological states, representing a novel source of non-conventional $\pi$-magnetism with promising applications in quantum spintronics. A prerequisite for their emergence is the existence of robust gapped phases, which are difficult to find in extended graphene systems: only armchair graphene nanoribbons (GNRs) show a band gap that, however, closes for any other GNR orientation. Here we show that semi-metallic chiral GNRs (chGNRs) narrowed down to nanometer widths undergoes a topological phase transition, becoming first topological insulators, and transforming then into trivial band insulators for the narrowest chGNRs. We fabricated atomically precise chGNRs of different chirality and size by on surface synthesis using predesigned molecular precursors. Combining scanning tunnelling microscopy (STM) measurements and theory simulations, we follow the evolution of topological properties and bulk band gap depending on the width, length, and chirality of chGNRs. The first emerging gapped phases are topological, protected by a chiral interaction pattern between edges. For narrower ribbons, the symmetry of the interaction pattern changes, and the topological gap closes and re-opens again as a trivial band insulator. Our findings represent a new platform for producing topologically protected spin states and demonstrates the potential of connecting chiral edge and defect structure with band engineering.


title: Safe Model-based Control from Signal Temporal Logic Specifications Using Recurrent Neural Networks

abstract: We propose a policy search approach to learn controllers from specifications given as Signal Temporal Logic (STL) formulae. The system model, which is unknown but assumed to be an affine control system, is learned together with the control policy. The model is implemented as two feedforward neural networks (FNNs) - one for the drift, and one for the control directions. To capture the history dependency of STL specifications, we use a recurrent neural network (RNN) to implement the control policy. In contrast to prevalent model-free methods, the learning approach proposed here takes advantage of the learned model and is more efficient. We use control barrier functions (CBFs) with the learned model to improve the safety of the system. We validate our algorithm via simulations and experiments. The results show that our approach can satisfy the given specification within very few system runs, and can be used for on-line control.


title: A Simple Approach for Zero-Shot Learning based on Triplet Distribution Embeddings

abstract: Given the semantic descriptions of classes, Zero-Shot Learning (ZSL) aims to recognize unseen classes without labeled training data by exploiting semantic information, which contains knowledge between seen and unseen classes. Existing ZSL methods mainly use vectors to represent the embeddings to the semantic space. Despite the popularity, such vector representation limits the expressivity in terms of modeling the intra-class variability for each class. We address this issue by leveraging the use of distribution embeddings. More specifically, both image embeddings and class embeddings are modeled as Gaussian distributions, where their similarity relationships are preserved through the use of triplet constraints. The key intuition which guides our approach is that for each image, the embedding of the correct class label should be closer than that of any other class label. Extensive experiments on multiple benchmark data sets show that the proposed method achieves highly competitive results for both traditional ZSL and more challenging Generalized Zero-Shot Learning (GZSL) settings.


title: Representation range needs for 16-bit neural network training

abstract: Deep learning has grown rapidly thanks to its state-of-the-art performance across a wide range of real-world applications. While neural networks have been trained using IEEE-754 binary32 arithmetic, the rapid growth of computational demands in deep learning has boosted interest in faster, low precision training. Mixed-precision training that combines IEEE-754 binary16 with IEEE-754 binary32 has been tried, and other $16$-bit formats, for example Google's bfloat16, have become popular. In floating-point arithmetic there is a tradeoff between precision and representation range as the number of exponent bits changes; denormal numbers extend the representation range. This raises questions of how much exponent range is needed, of whether there is a format between binary16 (5 exponent bits) and bfloat16 (8 exponent bits) that works better than either of them, and whether or not denormals are necessary. In the current paper we study the need for denormal numbers for mixed-precision training, and we propose a 1/6/9 format, i.e., 6-bit exponent and 9-bit explicit mantissa, that offers a better range-precision tradeoff. We show that 1/6/9 mixed-precision training is able to speed up training on hardware that incurs a performance slowdown on denormal operations or eliminates the need for denormal numbers altogether. And, for a number of fully connected and convolutional neural networks in computer vision and natural language processing, 1/6/9 achieves numerical parity to standard mixed-precision.


title: Shaping Advice in Deep Multi-Agent Reinforcement Learning

abstract: Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the quality of actions that they take, thereby affecting learning of policies. In this paper, we propose a method called Shaping Advice in deep Multi-agent reinforcement learning (SAM) to augment the reward signal from the environment with an additional reward termed shaping advice. The shaping advice is given by a difference of potential functions at consecutive time-steps. Each potential function is a function of observations and actions of the agents. The shaping advice needs to be specified only once at the start of training, and can be easily provided by non-experts. We show through theoretical analyses and experimental validation that shaping advice provided by SAM does not distract agents from completing tasks specified by the environment reward. Theoretically, we prove that convergence of policy gradients and value functions when using SAM implies convergence of these quantities in the absence of SAM. Experimentally, we evaluate SAM on three tasks in the multi-agent Particle World environment that have sparse rewards. We observe that using SAM results in agents learning policies to complete tasks faster, and obtain higher rewards than: i) using sparse rewards alone; ii) a state-of-the-art reward redistribution method.


title: DP-Sync: Hiding Update Patterns in Secure Outsourced Databases with Differential Privacy

abstract: In this paper, we have introduced a new type of leakage associated with modern encrypted databases called update pattern leakage. We formalize the definition and security model of DP-Sync with DP update patterns. We also proposed the framework DP-Sync, which extends existing encrypted database schemes to DP-Sync with DP update patterns. DP-Sync guarantees that the entire data update history over the outsourced data structure is protected by differential privacy. This is achieved by imposing differentially-private strategies that dictate the data owner's synchronization of local~data.


title: Orientation stabilization in a bioinspired bat-robot using integrated mechanical intelligence and control

abstract: Our goal in this work is to expand the theory and practice of robot locomotion by addressing critical challenges associated with the robotic biomimicry of bat aerial locomotion. Bats wings exhibit fast wing articulation and can mobilize as many as 40 joints within a single wingbeat. Mimicking bat flight can be a significant ordeal and the current design paradigms have failed as they assume only closed-loop feedback roles through sensors and conventional actuators while ignoring the computational role carried by morphology. In this paper, we propose a design framework called Morphing via Integrated Mechanical Intelligence and Control (MIMIC) which integrates small and low energy actuators to control the robot through a change in morphology. In this paper, using the dynamic model of Northeastern University's Aerobat, which is designed to test the effectiveness of the MIMIC framework, it will be shown that computational structures and closed-loop feedback can be successfully used to mimic bats stable flight apparatus.


title: Coherent Hopping Transport and Giant Negative Magnetoresistance in Epitaxial CsSnBr$_{3}$

abstract: Single-crystal inorganic halide perovskites are attracting interest for quantum device applications. Here we present low-temperature quantum magnetotransport measurements on thin film devices of epitaxial single-crystal CsSnBr$_{3}$, which exhibit two-dimensional Mott variable range hopping (VRH) and giant negative magnetoresistance. These findings are described by a model for quantum interference between different directed hopping paths and we extract the temperature-dependent hopping length of charge carriers, their localization length, and a lower bound for their phase coherence length of ~100 nm at low temperatures. These observations demonstrate that epitaxial halide perovskite devices are emerging as a material class for low-dimensional quantum coherent transport devices.


title: Guidance Mechanism for Flexible Wing Aircraft Using Measurement-Interfaced Machine Learning Platform

abstract: The autonomous operation of flexible-wing aircraft is technically challenging and has never been presented within literature. The lack of an exact modeling framework is due to the complex nonlinear aerodynamic relationships governed by the deformations in the flexible-wing shape, which in turn complicates the controls and instrumentation setup of the navigation system. This urged for innovative approaches to interface affordable instrumentation platforms to autonomously control this type of aircraft. This work leverages ideas from instrumentation and measurements, machine learning, and optimization fields in order to develop an autonomous navigation system for a flexible-wing aircraft. A novel machine learning process based on a guiding search mechanism is developed to interface real-time measurements of wing-orientation dynamics into control decisions. This process is realized using an online value iteration algorithm that decides on two improved and interacting model-free control strategies in real-time. The first strategy is concerned with achieving the tracking objectives while the second supports the stability of the system. A neural network platform that employs adaptive critics is utilized to approximate the control strategies while approximating the assessments of their values. An experimental actuation system is utilized to test the validity of the proposed platform. The experimental results are shown to be aligned with the stability features of the proposed model-free adaptive learning approach.


title: Quantum version of Prisoners' Dilemma under Interacting Environment

abstract: Quantum game theory is a rapidly evolving subject that extends beyond physics. In this research work, a schematic picture of quantum game theory has been provided with the help of the famous game Prisoners' Dilemma. It has been considered that the shared qubits of the prisoners may interact with the environment which is a bath of simple harmonic oscillators. This interaction introduces decoherence and this model has been compared with phase damping. Calculation of the decoherence factor shows that decoherence reduces the payoff of the prisoners. The factor has been calculated based on whether the decoherence occurred once or twice. A comparative discussion establishes that the process of decoherence is faster for the case when it occurs twice. It needs to be mentioned here that the total time of decoherence is the same in both cases.


title: Federated Learning with Taskonomy for Non-IID Data

abstract: Classical federated learning approaches incur significant performance degradation in the presence of non-IID client data. A possible direction to address this issue is forming clusters of clients with roughly IID data. Most solutions following this direction are iterative and relatively slow, also prone to convergence issues in discovering underlying cluster formations. We introduce federated learning with taskonomy (FLT) that generalizes this direction by learning the task-relatedness between clients for more efficient federated aggregation of heterogeneous data. In a one-off process, the server provides the clients with a pretrained (and fine-tunable) encoder to compress their data into a latent representation, and transmit the signature of their data back to the server. The server then learns the task-relatedness among clients via manifold learning, and performs a generalization of federated averaging. FLT can flexibly handle a generic client relatedness graph, when there are no explicit clusters of clients, as well as efficiently decompose it into (disjoint) clusters for clustered federated learning. We demonstrate that FLT not only outperforms the existing state-of-the-art baselines in non-IID scenarios but also offers improved fairness across clients.


title: Mechanical design and fabrication of a kinetic sculpture with application to bioinspired drone design

abstract: Biologically-inspired robots are a very interesting and difficult branch of robotics dues to its very rich dynamical and morphological complexities. Among them, flying animals, such as bats, have been among the most difficult to take inspiration from as they exhibit complex wing articulation. We attempt to capture several of the key degrees-of-freedom that are present in the natural flapping gait of a bat. In this work, we present the mechanical design and analysis of our flapping wing robot, the Aerobat, where we capture the plunging and flexion-extension in the bat's flapping modes. This robot utilizes gears, cranks, and four-bar linkage mechanisms to actuate the arm-wing structure composed of rigid and flexible components monolithically fabricated using PolyJet 3D printing. The resulting robot exhibits wing expansion and retraction during the downstroke and upstroke respectively which minimizes the negative lift and results in a more efficient flapping gait.


title: Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors

abstract: Transformer networks have revolutionized NLP representation learning since they were introduced. Though a great effort has been made to explain the representation in transformers, it is widely recognized that our understanding is not sufficient. One important reason is that there lack enough visualization tools for detailed analysis. In this paper, we propose to use dictionary learning to open up these "black boxes" as linear superpositions of transformer factors. Through visualization, we demonstrate the hierarchical semantic structures captured by the transformer factors, e.g., word-level polysemy disambiguation, sentence-level pattern formation, and long-range dependency. While some of these patterns confirm the conventional prior linguistic knowledge, the rest are relatively unexpected, which may provide new insights. We hope this visualization tool can bring further knowledge and a better understanding of how transformer networks work. The code is available at https://github.com/zeyuyun1/TransformerVis


title: Entity Context Graph: Learning Entity Representations fromSemi-Structured Textual Sources on the Web

abstract: Knowledge is captured in the form of entities and their relationships and stored in knowledge graphs. Knowledge graphs enhance the capabilities of applications in many different areas including Web search, recommendation, and natural language understanding. This is mainly because, entities enable machines to understand things that go beyond simple tokens. Many modern algorithms use learned entity embeddings from these structured representations. However, building a knowledge graph takes time and effort, hence very costly and nontrivial. On the other hand, many Web sources describe entities in some structured format and therefore, finding ways to get them into useful entity knowledge is advantageous. We propose an approach that processes entity centric textual knowledge sources to learn entity embeddings and in turn avoids the need for a traditional knowledge graph. We first extract triples into the new representation format that does not use traditional complex triple extraction methods defined by pre-determined relationship labels. Then we learn entity embeddings through this new type of triples. We show that the embeddings learned from our approach are: (i) high quality and comparable to a known knowledge graph-based embeddings and can be used to improve them further, (ii) better than a contextual language model-based entity embeddings, and (iii) easy to compute and versatile in domain-specific applications where a knowledge graph is not readily available


title: Dynamic Autonomous Surface Vehicle Control and Applications in Environmental Monitoring

abstract: This paper addresses the problem of robotic operations in the presence of adversarial forces. We presents a complete framework for survey operations: waypoint generation,modelling of forces and tuning the control. In many applications of environmental monitoring, search and exploration, and bathymetric mapping, the vehicle has to traverse in straight lines parallel to each other, ensuring there are no gaps and no redundant coverage. During operations with an Autonomous Surface Vehicle (ASV) however, the presence of wind and/or currents produces external forces acting on the vehicle which quite often divert it from its intended path. Similar issues have been encountered during aerial or underwater operations. By measuring these phenomena, wind and current, and modelling their impact on the vessel, actions can be taken to alleviate their effect and ensure the correct trajectory is followed.


title: Rough-Terrain Locomotion and Unilateral Contact Force Regulations With a Multi-Modal Legged Robot

abstract: Despite many accomplishments by legged robot designers, state-of-the-art bipedal robots are prone to falling over, cannot negotiate extremely rough terrains and cannot directly regulate unilateral contact forces. Our objective is to integrate merits of legged and aerial robots in a single platform. We will show that the thrusters in a bipedal legged robot called Harpy can be leveraged to stabilize the robot's frontal dynamics and permit jumping over large obstacles which is an unusual capability not reported before. In addition, we will capitalize on the thrusters action in Harpy and will show that one can avoid using costly optimization-based schemes by directly regulating contact forces using an Reference Governor (RGs). We will resolve gait parameters and re-plan them during gait cycles by only assuming well-tuned supervisory controllers. Then, we will focus on RG-based fine-tuning of the joints desired trajectories to satisfy unilateral contact force constraints.


title: TREC 2020 Podcasts Track Overview

abstract: The Podcast Track is new at the Text Retrieval Conference (TREC) in 2020. The podcast track was designed to encourage research into podcasts in the information retrieval and NLP research communities. The track consisted of two shared tasks: segment retrieval and summarization, both based on a dataset of over 100,000 podcast episodes (metadata, audio, and automatic transcripts) which was released concurrently with the track. The track generated considerable interest, attracted hundreds of new registrations to TREC and fifteen teams, mostly disjoint between search and summarization, made final submissions for assessment. Deep learning was the dominant experimental approach for both search experiments and summarization. This paper gives an overview of the tasks and the results of the participants' experiments. The track will return to TREC 2021 with the same two tasks, incorporating slight modifications in response to participant feedback.


title: DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentation

abstract: Recently, neural architecture search (NAS) has been applied to automatically search high-performance networks for medical image segmentation. The NAS search space usually contains a network topology level (controlling connections among cells with different spatial scales) and a cell level (operations within each cell). Existing methods either require long searching time for large-scale 3D image datasets, or are limited to pre-defined topologies (such as U-shaped or single-path). In this work, we focus on three important aspects of NAS in 3D medical image segmentation: flexible multi-path network topology, high search efficiency, and budgeted GPU memory usage. A novel differentiable search framework is proposed to support fast gradient-based search within a highly flexible network topology search space. The discretization of the searched optimal continuous model in differentiable scheme may produce a sub-optimal final discrete model (discretization gap). Therefore, we propose a topology loss to alleviate this problem. In addition, the GPU memory usage for the searched 3D model is limited with budget constraints during search. Our Differentiable Network Topology Search scheme (DiNTS) is evaluated on the Medical Segmentation Decathlon (MSD) challenge, which contains ten challenging segmentation tasks. Our method achieves the state-of-the-art performance and the top ranking on the MSD challenge leaderboard.


title: Surface NMR using quantum sensors in diamond

abstract: Characterization of the molecular properties of surfaces under ambient or chemically reactive conditions is a fundamental scientific challenge. Moreover, many traditional analytical techniques used for probing surfaces often lack dynamic or molecular selectivity, which limits their applicability for mechanistic and kinetic studies under realistic chemical conditions. Nuclear magnetic resonance spectroscopy (NMR) is a widely used technique and would be ideal for probing interfaces due to the molecular information it provides noninvasively. However, it lacks the sensitivity to probe the small number of spins at surfaces. Here, we use nitrogen vacancy (NV) centers in diamond as quantum sensors to optically detect nuclear magnetic resonance signals from chemically modified aluminum oxide surfaces, prepared with atomic layer deposition (ALD). With the surface NV-NMR technique, we are able to monitor in real-time the formation kinetics of a self assembled monolayer (SAM) based on phosphonate anchoring chemistry to the surface. This demonstrates the capability of quantum sensors as a new surface-sensitive tool with sub-monolayer sensitivity for in-situ NMR analysis with the additional advantage of a strongly reduced technical complexity.


title: Variational quantum algorithms to estimate rank, quantum entropies, fidelity and Fisher information via purity minimization

abstract: Variational quantum algorithms (VQAs) that estimate values of widely used physical quantities such as the rank, quantum entropies, the Bures fidelity and the quantum Fisher information of mixed quantum states are developed. In addition, variations of these VQAs are also adapted to perform other useful functions such as quantum state learning and approximate fractional inverses. The common theme shared by the proposed algorithms is that their cost functions are all based on minimizing the quantum purity of a quantum state. Strategies to mitigate or avoid the problem of exponentially vanishing cost function gradients are also discussed.


title: Primordial black hole formation in $\alpha$-attractor models: an analysis using optimized peaks theory

abstract: In this paper, the formation of primordial black holes (PBHs) is reinvestigated using inflationary $\alpha$-attractors. Instead of using the conventional Press-Schechter theory to compute the abundance, the optimized peaks theory is used, which was developed in Ref. \cite{Yoo:2018kvb,Yoo:2020dkz}. This method takes into account how curvature perturbations play a r\^{o}le in modifying the mass of primordial black holes. Analyzing the model proposed in \cite{Mahbub:2019uhl} it is seen that the horizon mass of the collapsed Hubble patch is larger by $\mathcal{O}(10)$ compared to the usual computation. Moreover, PBHs can be formed from curvature power spectrum, $\mathcal{P}_{\zeta}(k)$, peaked at lower values using numerically favored threshold overdensities. As a result of the generally larger masses predicted, the peak of the power spectrum can be placed at larger $k$ modes than that is typical with which potential future constraints on the primordial power spectrum through gravitational waves (GWs) can be evaded.


title: Sequential stub matching for uniform generation of directed graphs with a given degree sequence

abstract: Uniform sampling of simple graphs having a given degree sequence is a known problem with exponential complexity in the square of the mean degree. For undirected graphs, randomised approximation algorithms have nonetheless been shown to achieve almost linear expected complexity for this problem. Here we discuss the sequential stub matching for directed graphs and show that this process can be mould to sample simple digraphs with asymptotically equal probability. The process starts with an empty edge set and repeatedly adds edges to it with a certain state-dependent bias until the desired degree sequence is fulfilled, while avoiding placement of a double edge or self loop. We show that uniform sampling is achieved in the sparse regime, when the maximum degree $d_\text{max}$ is asymptotically dominated by $m^{1/4}$, where $m$ is the number of edges. The proof is based on deriving various combinatorial estimates related to the number of digraphs with a given directed degree sequence and controlling concentration of these estimates in large digraphs. This suggests that the sequential stub matching can be viewed as a practical algorithm for almost uniform sampling of digraphs, and we show that this algorithm can be implemented to feature linear expected runtime $O(m)$.


title: Landau level spectroscopy of PbSnSe topological crystalline insulator

abstract: We report on an infrared magneto-spectroscopy study of Pb$_{1-x}$Sn$_x$Se, a topological crystalline insulator. We have examined a set of samples, all in the inverted regime of electronic bands, with the tin composition varying from $x=0.2$ to $0.33$. Our analysis shows that the observed response, composed of a series of interband inter-Landau level excitations, can be interpreted and modelled using the relativistic-like Hamiltonian for three-dimensional massive Dirac electrons, expanded to include diagonal quadratic terms that impose band inversion. In our data, we have not found any clear signature of massless electron states that are present on the surface of Pb$_{1-x}$Sn$_x$Se crystals in the inverted regime. Reasons for this unexpected result are discussed.


title: Demonstrating Analog Inference on the BrainScaleS-2 Mobile System

abstract: We present the BrainScaleS-2 mobile system as a compact analog inference engine based on the BrainScaleS-2 ASIC and demonstrate its capabilities at classifying a medical electrocardiogram dataset. The analog network core of the ASIC is utilized to perform the multiply-accumulate operations of a convolutional deep neural network. At a system power consumption of 5.6W, we measure a total energy consumption of 192uJ for the ASIC and achieve a classification time of 276us per electrocardiographic patient sample. Patients with atrial fibrillation are correctly identified with a detection rate of (93.7${\pm}$0.7)% at (14.0${\pm}$1.0)% false positives. The system is directly applicable to edge inference applications due to its small size, power envelope, and flexible I/O capabilities. It has enabled the BrainScaleS-2 ASIC to be operated reliably outside a specialized lab setting. In future applications, the system allows for a combination of conventional machine learning layers with online learning in spiking neural networks on a single neuromorphic platform.


title: Feedback theory approach to positivity and stability of evolution equations

abstract: In this paper, we study the positivity and (uniform) exponential stability of a large class of perturbed semigroups. Our approach is essentially based on the feedback theory of infinite-dimensional linear systems. The obtained results are applied to the stability of hyperbolic systems including those with a delay at the boundary conditions.


title: Distribution of the reduced quadratic irrationals arising from the odd continued fraction expansion

abstract: This paper investigates the quadratic irrationals that arise as periodic points of the Gauss type shift associated to the odd continued fraction expansion. It is shown that these numbers, which we call O-reduced, when ordered by the length of the associated closed primitive geodesic on some modular surface $\Gamma \backslash \mathbb{H}$, are equidistributed with respect to the Lebesgue absolutely continuous invariant probability measure of the Odd Gauss shift.


title: Contextual Text Embeddings for Twi

abstract: Transformer-based language models have been changing the modern Natural Language Processing (NLP) landscape for high-resource languages such as English, Chinese, Russian, etc. However, this technology does not yet exist for any Ghanaian language. In this paper, we introduce the first of such models for Twi or Akan, the most widely spoken Ghanaian language. The specific contribution of this research work is the development of several pretrained transformer language models for the Akuapem and Asante dialects of Twi, paving the way for advances in application areas such as Named Entity Recognition (NER), Neural Machine Translation (NMT), Sentiment Analysis (SA) and Part-of-Speech (POS) tagging. Specifically, we introduce four different flavours of ABENA -- A BERT model Now in Akan that is fine-tuned on a set of Akan corpora, and BAKO - BERT with Akan Knowledge only, which is trained from scratch. We open-source the model through the Hugging Face model hub and demonstrate its use via a simple sentiment classification example.


title: Heavy+light pseudoscalar meson semileptonic transitions

abstract: A symmetry-preserving regularisation of a vector$\times$vector contact interaction (SCI) is used to deliver a unified treatment of semileptonic transitions involving $\pi$, $K$, $D_{(s)}$, $B_{(s,c)}$ initial states. The framework is characterised by algebraic simplicity, few parameters, and the ability to simultaneously treat systems from Nambu-Goldstone modes to heavy+heavy mesons. Although the SCI form factors are typically somewhat stiff, the results are comparable with experiment and rigorous theory results. Hence, predictions for the five unmeasured $B_{s,c}$ branching fractions should be a reasonable guide. The analysis provides insights into the effects of Higgs boson couplings via current-quark masses on the transition form factors; and results on $B_{(s)}\to D_{(s)}$ transitions yield a prediction for the Isgur-Wise function in fair agreement with contemporary data.


title: Strong Optimal Classification Trees

abstract: Decision trees are among the most popular machine learning models and are used routinely in applications ranging from revenue management and medicine to bioinformatics. In this paper, we consider the problem of learning optimal binary classification trees with univariate splits. Literature on the topic has burgeoned in recent years, motivated both by the empirical suboptimality of heuristic approaches and the tremendous improvements in mixed-integer optimization (MIO) technology. Yet, existing MIO-based approaches from the literature do not leverage the power of MIO to its full extent: they rely on weak formulations, resulting in slow convergence and large optimality gaps. To fill this gap in the literature, we propose an intuitive flow-based MIO formulation for learning optimal binary classification trees. Our formulation can accommodate side constraints to enable the design of interpretable and fair decision trees. Moreover, we show that our formulation has a stronger linear optimization relaxation than existing methods in the case of binary data. We exploit the decomposable structure of our formulation and max-flow/min-cut duality to derive a Benders' decomposition method to speed-up computation. We propose a tailored procedure for solving each decomposed subproblem that provably generates facets of the feasible set of the MIO as constraints to add to the main problem. We conduct extensive computational experiments on standard benchmark datasets on which we show that our proposed approaches are 29 times faster than state-of-the-art MIO-based techniques and improve out-of-sample performance by up to 8%.


title: Modeling Graph Node Correlations with Neighbor Mixture Models

abstract: We propose a new model, the Neighbor Mixture Model (NMM), for modeling node labels in a graph. This model aims to capture correlations between the labels of nodes in a local neighborhood. We carefully design the model so it could be an alternative to a Markov Random Field but with more affordable computations. In particular, drawing samples and evaluating marginal probabilities of single labels can be done in linear time. To scale computations to large graphs, we devise a variational approximation without introducing extra parameters. We further use graph neural networks (GNNs) to parameterize the NMM, which reduces the number of learnable parameters while allowing expressive representation learning. The proposed model can be either fit directly to large observed graphs or used to enable scalable inference that preserves correlations for other distributions such as deep generative graph models. Across a diverse set of node classification, image denoising, and link prediction tasks, we show our proposed NMM advances the state-of-the-art in modeling real-world labeled graphs.


title: Detecting and Mapping Trees in Unstructured Environments with a Stereo Camera and Pseudo-Lidar

abstract: We present a method for detecting and mapping trees in noisy stereo camera point clouds, using a learned 3-D object detector. Inspired by recent advancements in 3-D object detection using a pseudo-lidar representation for stereo data, we train a PointRCNN detector to recognize trees in forest-like environments. We generate detector training data with a novel automatic labeling process that clusters a fused global point cloud. This process annotates large stereo point cloud training data sets with minimal user supervision, and unlike previous pseudo-lidar detection pipelines, requires no 3-D ground truth from other sensors such as lidar. Our mapping system additionally uses a Kalman filter to associate detections and consistently estimate the positions and sizes of trees. We collect a data set for tree detection consisting of 8680 stereo point clouds, and validate our method on an outdoors test sequence. Our results demonstrate robust tree recognition in noisy stereo data at ranges of up to 7 meters, on 720p resolution images from a Stereolabs ZED 2 camera. Code and data are available at https://github.com/brian-h-wang/pseudolidar-tree-detection.


title: Joint Resource Allocation and Transceiver Design for Sum-Rate Maximization under Latency Constraints in Multicell MU-MIMO Systems

abstract: Due to the continuous advancements of orthogonal frequency division multiplexing (OFDM) and multiple antenna techniques, multiuser multiple input multiple output (MU-MIMO) OFDM is a key enabler of both fourth and fifth generation networks. In this paper, we consider the problem of weighted sum-rate maximization under latency constraints in finite buffer multicell MU-MIMO OFDM systems. Unlike previous works, the optimization variables include the transceiver beamforming vectors, the scheduled packet size and the resources in the frequency and power domains. This problem is motivated by the observation that multicell MU-MIMO OFDM systems serve multiple quality of service classes and the system performance depends critically on both the transceiver design and the scheduling algorithm. Since this problem is non-convex, we resort to the max-plus queuing method and successive convex approximation. We propose both centralized and decentralized solutions, in which practical design aspects, such as signaling overhead, are considered. Finally, we compare the proposed framework with state-of-the-art algorithms in relevant scenarios, assuming a realistic channel model with space, frequency and time correlations. Numerical results indicate that our design provides significant gains over designs based on the wide-spread saturated buffers assumption, while also outperforming algorithms that consider a finite-buffer model.


title: eWake: A Novel Architecture for Semi-Active Wake-Up Radios Attaining Ultra-High Sensitivity at Extremely-Low Consumption

abstract: In this work we propose a new scheme for semi-passive Wake-Up Receiver circuits that exhibits remarkable sensitivity beyond -70 dBm, while state-of-the-art receivers illustrate sensitivity of up to -55 dBm. The receiver employs the typical principle of an envelope detector that harvests RF energy from its antenna, while it employs a nano-power operation amplifier to intensify the obtained signal prior to the final decoding that is realized with the aid of a comparator circuit. It operates at the 868 MHz ISM band using OOK signals propagated through LoRa transceivers, while also supporting addressing capabilities in order to awake only the specified network's nodes. The power expenditure of the developed receiver is as low as 580 nA, remaining at the same power consumption levels as the state-of-the-art implementations.


title: Does it work outside this benchmark? Introducing the Rigid Depth Constructor tool, depth validation dataset construction in rigid scenes for the masses

abstract: We present a protocol to construct your own depth validation dataset for navigation. This protocol, called RDC for Rigid Depth Constructor, aims at being more accessible and cheaper than already existing techniques, requiring only a camera and a Lidar sensor to get started. We also develop a test suite to get insightful information from the evaluated algorithm. Finally, we take the example of UAV videos, on which we test two depth algorithms that were initially tested on KITTI and show that the drone context is dramatically different from in-car videos. This shows that a single context benchmark should not be considered reliable, and when developing a depth estimation algorithm, one should benchmark it on a dataset that best fits one's particular needs, which often means creating a brand new one. Along with this paper we provide the tool with an open source implementation and plan to make it as user-friendly as possible, to make depth dataset creation possible even for small teams. Our key contributions are the following: We propose a complete, open-source and almost fully automatic software application for creating validation datasets with densely annotated depth, adaptable to a wide variety of image, video and range data. It includes selection tools to adapt the dataset to specific validation needs, and conversion tools to other dataset formats. Using this application, we propose two new real datasets, outdoor and indoor, readily usable in UAV navigation context. Finally as examples, we show an evaluation of two depth prediction algorithms, using a collection of comprehensive (e.g. distribution based) metrics.


title: Doubling the mobility of InAs/InGaAs selective area grown nanowires

abstract: Selective area growth (SAG) of nanowires and networks promise a route toward scalable electronics, photonics and quantum devices based on III-V semiconductor materials. The potential of high-mobility SAG nanowires however is not yet fully realized, since interfacial roughness, misfit dislocations at the nanowire/substrate interface and non-uniform composition due to material intermixing all scatter electrons. Here, we explore SAG of highly lattice-mismatched InAs nanowires on insulating GaAs(001) substrates and address these key challenges. Atomically smooth nanowire/substrate interfaces are achieved with the use of atomic hydrogen (a-H) as an alternative to conventional thermal annealing for the native oxide removal. The problem of high lattice mismatch is addressed through an In$_x$Ga$_{1-x}$As buffer layer introduced between the InAs transport channel and the GaAs substrate. The Ga-In material intermixing observed in both the buffer layer and the channel is inhibited via careful tuning of the growth temperature. Performing scanning transmission electron microscopy and x-ray diffraction analysis along with low-temperature transport measurements we show that optimized In-rich buffer layers promote high quality InAs transport channels with the field-effect electron mobility over~10000~cm$^2$V$^{-1}$s$^{-1}$. This is twice as high as for non-optimized samples and among the highest reported for InAs selective area grown nanostructures.


title: Deep Compression for PyTorch Model Deployment on Microcontrollers

abstract: Neural network deployment on low-cost embedded systems, hence on microcontrollers (MCUs), has recently been attracting more attention than ever. Since MCUs have limited memory capacity as well as limited compute-speed, it is critical that we employ model compression, which reduces both memory and compute-speed requirements. In this paper, we add model compression, specifically Deep Compression, and further optimize Unlu's earlier work on arXiv, which efficiently deploys PyTorch models on MCUs. First, we prune the weights in convolutional and fully connected layers. Secondly, the remaining weights and activations are quantized to 8-bit integers from 32-bit floating-point. Finally, forward pass functions are compressed using special data structures for sparse matrices, which store only nonzero weights (without impacting performance and accuracy). In the case of the LeNet-5 model, the memory footprint was reduced by 12.45x, and the inference speed was boosted by 2.57x.


title: Adaptive Pseudo-Label Refinement by Negative Ensemble Learning for Source-Free Unsupervised Domain Adaptation

abstract: The majority of existing Unsupervised Domain Adaptation (UDA) methods presumes source and target domain data to be simultaneously available during training. Such an assumption may not hold in practice, as source data is often inaccessible (e.g., due to privacy reasons). On the contrary, a pre-trained source model is always considered to be available, even though performing poorly on target due to the well-known domain shift problem. This translates into a significant amount of misclassifications, which can be interpreted as structured noise affecting the inferred target pseudo-labels. In this work, we cast UDA as a pseudo-label refinery problem in the challenging source-free scenario. We propose a unified method to tackle adaptive noise filtering and pseudo-label refinement. A novel Negative Ensemble Learning technique is devised to specifically address noise in pseudo-labels, by enhancing diversity in ensemble members with different stochastic (i) input augmentation and (ii) feedback. In particular, the latter is achieved by leveraging the novel concept of Disjoint Residual Labels, which allow diverse information to be fed to the different members. A single target model is eventually trained with the refined pseudo-labels, which leads to a robust performance on the target domain. Extensive experiments show that the proposed method, named Adaptive Pseudo-Label Refinement, achieves state-of-the-art performance on major UDA benchmarks, such as Digit5, PACS, Visda-C, and DomainNet, without using source data at all.


title: Domain-robust VQA with diverse datasets and methods but no target labels

abstract: The observation that computer vision methods overfit to dataset specifics has inspired diverse attempts to make object recognition models robust to domain shifts. However, similar work on domain-robust visual question answering methods is very limited. Domain adaptation for VQA differs from adaptation for object recognition due to additional complexity: VQA models handle multimodal inputs, methods contain multiple steps with diverse modules resulting in complex optimization, and answer spaces in different datasets are vastly different. To tackle these challenges, we first quantify domain shifts between popular VQA datasets, in both visual and textual space. To disentangle shifts between datasets arising from different modalities, we also construct synthetic shifts in the image and question domains separately. Second, we test the robustness of different families of VQA methods (classic two-stream, transformer, and neuro-symbolic methods) to these shifts. Third, we test the applicability of existing domain adaptation methods and devise a new one to bridge VQA domain gaps, adjusted to specific VQA models. To emulate the setting of real-world generalization, we focus on unsupervised domain adaptation and the open-ended classification task formulation.


title: Platform for Situated Intelligence

abstract: We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems. The framework provides infrastructure for sensing, fusing, and making inferences from temporal streams of data across different modalities, a set of tools that enable visualization and debugging, and an ecosystem of components that encapsulate a variety of perception and processing technologies. These assets jointly provide the means for rapidly constructing and refining multimodal, integrative-AI systems, while retaining the efficiency and performance characteristics required for deployment in open-world settings.


title: Density Estimation by Monte Carlo and Quasi-Monte Carlo

abstract: Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods include histograms and kernel density estimators. In this review paper, we are interested instead in the situation where the observations are generated by Monte Carlo simulation from a model. Then, one can take advantage of variance reduction methods such as stratification, conditional Monte Carlo, and randomized quasi-Monte Carlo (RQMC), and obtain a more accurate density estimator than with standard Monte Carlo for a given computing budget. We discuss several ways of doing this, proposed in recent papers, with a focus on methods that exploit RQMC. A first idea is to directly combine RQMC with a standard kernel density estimator. Another one is to adapt a simulation-based derivative estimation method such as smoothed perturbation analysis or the likelihood ratio method to obtain a continuous estimator of the cdf, whose derivative is an unbiased estimator of the density. This can then be combined with RQMC. We summarize recent theoretical results with these approaches and give numerical illustrations of how they improve the convergence of the mean square integrated error.


title: Flow-based Kernel Prior with Application to Blind Super-Resolution

abstract: Kernel estimation is generally one of the key problems for blind image super-resolution (SR). Recently, Double-DIP proposes to model the kernel via a network architecture prior, while KernelGAN employs the deep linear network and several regularization losses to constrain the kernel space. However, they fail to fully exploit the general SR kernel assumption that anisotropic Gaussian kernels are sufficient for image SR. To address this issue, this paper proposes a normalizing flow-based kernel prior (FKP) for kernel modeling. By learning an invertible mapping between the anisotropic Gaussian kernel distribution and a tractable latent distribution, FKP can be easily used to replace the kernel modeling modules of Double-DIP and KernelGAN. Specifically, FKP optimizes the kernel in the latent space rather than the network parameter space, which allows it to generate reasonable kernel initialization, traverse the learned kernel manifold and improve the optimization stability. Extensive experiments on synthetic and real-world images demonstrate that the proposed FKP can significantly improve the kernel estimation accuracy with less parameters, runtime and memory usage, leading to state-of-the-art blind SR results.


title: Phase Diagram for the Methane-Ethane System and its Implications for Titan's Lakes

abstract: On Titan, methane (CH4) and ethane (C2H6) are the dominant species found in the lakes and seas. In this study, we have combined laboratory work and modeling to refine the methane-ethane binary phase diagram at low temperatures and probe how the molecules interact at these conditions. We used visual inspection for the liquidus and Raman spectroscopy for the solidus. Through these methods we determined a eutectic point of 71.15$\pm$0.5 K at a composition of 0.644$\pm$0.018 methane - 0.356$\pm$0.018 ethane mole fraction from the liquidus data. Using the solidus data, we found a eutectic isotherm temperature of 72.2 K with a standard deviation of 0.4 K. In addition to mapping the binary system, we looked at the solid-solid transitions of pure ethane and found that, when cooling, the transition of solid I-III occurred at 89.45$\pm$0.2 K. The warming sequence showed transitions of solid III-II occurring at 89.85$\pm$0.2 K and solid II-I at 89.65$\pm$0.2 K. Ideal predictions were compared to molecular dynamics simulations to reveal that the methane-ethane system behaves almost ideally, and the largest deviations occur as the mixing ratio approaches the eutectic composition.


title: Ultra-Sparse View Reconstruction for Flash X-Ray Imaging using Consensus Equilibrium

abstract: A growing number of applications require the reconstructionof 3D objects from a very small number of views. In this research, we consider the problem of reconstructing a 3D object from only 4 Flash X-ray CT views taken during the impact of a Kolsky bar. For such ultra-sparse view datasets, even model-based iterative reconstruction (MBIR) methods produce poor quality results. In this paper, we present a framework based on a generalization of Plug-and-Play, known as Multi-Agent Consensus Equilibrium (MACE), for incorporating complex and nonlinear prior information into ultra-sparse CT reconstruction. The MACE method allows any number of agents to simultaneously enforce their own prior constraints on the solution. We apply our method on simulated and real data and demonstrate that MACE reduces artifacts, improves reconstructed image quality, and uncovers image features which were otherwise indiscernible.


title: A tutorial on $\mathbf{SE}(3)$ transformation parameterizations and on-manifold optimization

abstract: An arbitrary rigid transformation in $\mathbf{SE}(3)$ can be separated into two parts, namely, a translation and a rigid rotation. This technical report reviews, under a unifying viewpoint, three common alternatives to representing the rotation part: sets of three (yaw-pitch-roll) Euler angles, orthogonal rotation matrices from $\mathbf{SO}(3)$ and quaternions. It will be described: (i) the equivalence between these representations and the formulas for transforming one to each other (in all cases considering the translational and rotational parts as a whole), (ii) how to compose poses with poses and poses with points in each representation and (iii) how the uncertainty of the poses (when modeled as Gaussian distributions) is affected by these transformations and compositions. Some brief notes are also given about the Jacobians required to implement least-squares optimization on manifolds, an very promising approach in recent engineering literature. The text reflects which MRPT C++ library functions implement each of the described algorithms. All formulas and their implementation have been thoroughly validated by means of unit testing and numerical estimation of the Jacobians


title: Unification of topological invariants in Dirac models

abstract: Topological phases of materials are characterized by topological invariants that are conventionally calculated by different means according to the dimension and symmetry class of the system. For topological materials described by Dirac models, we introduce a wrapping number as a unified approach to obtain the topological invariants in arbitrary dimensions and symmetry classes. Given a unit vector that parametrizes the momentum-dependence of the Dirac model, the wrapping number describes the degree of the map from the Brillouin zone torus to the sphere formed by the unit vector that we call Dirac sphere. This method is gauge-invariant and originates from the intrinsic features of the Dirac model, and moreover places all known topological invariants, such as Chern number, winding number, Pfaffian, etc, on equal footing.


title: TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformations

abstract: Image inpainting is the task of plausibly restoring missing pixels within a hole region that is to be removed from a target image. Most existing technologies exploit patch similarities within the image, or leverage large-scale training data to fill the hole using learned semantic and texture information. However, due to the ill-posed nature of the inpainting task, such methods struggle to complete larger holes containing complicated scenes. In this paper, we propose TransFill, a multi-homography transformed fusion method to fill the hole by referring to another source image that shares scene contents with the target image. We first align the source image to the target image by estimating multiple homographies guided by different depth levels. We then learn to adjust the color and apply a pixel-level warping to each homography-warped source image to make it more consistent with the target. Finally, a pixel-level fusion module is learned to selectively merge the different proposals. Our method achieves state-of-the-art performance on pairs of images across a variety of wide baselines and color differences, and generalizes to user-provided image pairs.


title: Frobenius allowable gaps of Generalized Numerical Semigroups

abstract: A generalised numerical semigroup (GNS) is a submonoid $S$ of $\mathbb{N}^d$ for which the complement $\mathbb{N}^d\setminus S$ is finite. The points in the complement $\mathbb{N}^d\setminus S$ are called gaps. A gap $F$ is considered Frobenius allowable if there is some relaxed monomial ordering on $\mathbb{N}^d$ with respect to which $F$ is the largest gap. We characterise the Frobenius allowable gaps of a GNS. A GNS that has only one Frobenius allowable gap is called a Frobenius GNS. We estimate the number of Frobenius GNS with a given Frobenius gap $F=(F^{(1)},\dots,F^{(d)})\in\mathbb{N}^d$ and show that it is close to $\sqrt{3}^{(F^{(1)}+1)\cdots (F^{(d)}+1)}$ for large $d$. We define notions of quasi-irreducibility and quasi-symmetry for GNS. While in the case of $d=1$ these notions coincide with irreducibility and symmetry of GNS, they are distinct in higher dimensions.


title: The Endpoint Theorem

abstract: The Endpoint Theorem links the existence of a sequence (curve), without accumulation points, in a manifold to the existence of an open embedding of that manifold so that the image of the given sequence (curve) has a unique endpoint. It plays a fundamental role in the theory of the Abstract Boundary as it implies that there is always an Abstract Boundary boundary point to represent the endpoint of such sequences and curves. The Endpoint Theorem will be of interest to researchers analysing specific spacetimes as it shows how to construct a chart in the original manifold which contains the sequence (curve). In particular, it has application to the study of singularities predicted by the singularity theorems.


title: Saddle Point Optimization with Approximate Minimization Oracle

abstract: A major approach to saddle point optimization $\min_x\max_y f(x, y)$ is a gradient based approach as is popularized by generative adversarial networks (GANs). In contrast, we analyze an alternative approach relying only on an oracle that solves a minimization problem approximately. Our approach locates approximate solutions $x'$ and $y'$ to $\min_{x'}f(x', y)$ and $\max_{y'}f(x, y')$ at a given point $(x, y)$ and updates $(x, y)$ toward these approximate solutions $(x', y')$ with a learning rate $\eta$. On locally strong convex--concave smooth functions, we derive conditions on $\eta$ to exhibit linear convergence to a local saddle point, which reveals a possible shortcoming of recently developed robust adversarial reinforcement learning algorithms. We develop a heuristic approach to adapt $\eta$ derivative-free and implement zero-order and first-order minimization algorithms. Numerical experiments are conducted to show the tightness of the theoretical results as well as the usefulness of the $\eta$ adaptation mechanism.


title: Tigris: a DSL and Framework for Monitoring Software Systems at Runtime

abstract: The understanding of the behavioral aspects of a software system is an essential enabler for many software engineering activities, such as adaptation. This involves collecting runtime data from the system so that it is possible to analyze the collected data to guide actions upon the system. Consequently, software monitoring imposes practical challenges because it is often done by intercepting the system execution and recording gathered information. Such monitoring may degrade the performance and disrupt the system execution to unacceptable levels. In this paper, we introduce a two-phase monitoring approach to support the monitoring step in adaptive systems. The first phase collects lightweight coarse-grained information and identifies relevant parts of the software that should be monitored in detail based on a provided domain-specific language. This language is informed by a systematic literature review. The second phase collects relevant and fine-grained information needed for deciding whether and how to adapt the managed system. Our approach is implemented as a framework, called Tigris, that can be seamlessly integrated into existing software systems to support monitoring-based activities. To validate our proposal, we instantiated Tigris to support an application-level caching approach, which adapts caching decisions of a software system at runtime to improve its performance.


title: PLAN-B: Predicting Likely Alternative Next Best Sequences for Action Prediction

abstract: Action prediction focuses on anticipating actions before they happen. Recent works leverage probabilistic approaches to describe future uncertainties and sample future actions. However, these methods cannot easily find all alternative predictions, which are essential given the inherent unpredictability of the future, and current evaluation protocols do not measure a system's ability to find such alternatives. We re-examine action prediction in terms of its ability to predict not only the top predictions, but also top alternatives with the accuracy@k metric. In addition, we propose Choice F1: a metric inspired by F1 score which evaluates a prediction system's ability to find all plausible futures while keeping only the most probable ones. To evaluate this problem, we present a novel method, Predicting the Likely Alternative Next Best, or PLAN-B, for action prediction which automatically finds the set of most likely alternative futures. PLAN-B consists of two novel components: (i) a Choice Table which ensures that all possible futures are found, and (ii) a "Collaborative" RNN system which combines both action sequence and feature information. We demonstrate that our system outperforms state-of-the-art results on benchmark datasets.


title: Stability of Contraction-Driven Cell Motion

abstract: We consider motility of keratocyte cells driven by myosin contraction and introduce a 2D free boundary model for such motion. This model generalizes a 1D model from [12] by combining a 2D Keller-Segel model and a Hele-Shaw type boundary condition with the Young-Laplace law resulting in a boundary curvature term which provides a regularizing effect. We show that this model has a family of traveling solutions with constant shape and velocity which bifurcates from a family of radially symmetric stationary states. Our goal is to establish observable steady motion of the cell with constant velocity. Mathematically, this amounts to establishing stability of the traveling solutions. Our key result is an explicit asymptotic formula for the stability-determining eigenvalue of the linearized problem. This formula greatly simplifies the task of numerically computing the sign of this eigenvalue and reveals the physical mechanisms of stability. The derivation of this formula is based on a special ansatz for the corresponding eigenvector which exhibits an interesting singular behavior such that it asymptotically (in the small-velocity limit) becomes parallel to another eigenvector. This reflects the non-self-adjoint nature of the linearized problem, a signature of living systems. Finally, our results describe the onset of motion via a transition from unstable radial stationary solutions to stable asymmetric traveling solutions.


title: Complexity of a Projected Newton-CG Method for Optimization with Bounds

abstract: This paper describes a method for solving smooth nonconvex minimization problems subject to bound constraints with good worst-case complexity guarantees and practical performance. The method contains elements of two existing methods: the classical gradient projection approach for bound-constrained optimization and a recently proposed Newton-conjugate gradient algorithm for unconstrained nonconvex optimization. Using a new definition of approximate second-order optimality parametrized by some tolerance $\epsilon$ (which is compared with related definitions from previous works), we derive complexity bounds in terms of $\epsilon$ for both the number of iterations required and the total amount of computation. The latter is measured by the number of gradient evaluations or Hessian-vector products. We also describe illustrative computational results on several test problems from low-rank matrix optimization.


title: An Overview of Human Activity Recognition Using Wearable Sensors: Healthcare and Artificial Intelligence

abstract: With the rapid development of the internet of things (IoT) and artificial intelligence (AI) technologies, human activity recognition (HAR) has been applied in a variety of domains such as security and surveillance, human-robot interaction, and entertainment. Even though a number of surveys and review papers have been published, there is a lack of HAR overview papers focusing on healthcare applications that use wearable sensors. Therefore, we fill in the gap by presenting this overview paper. In particular, we present our projects to illustrate the system design of HAR applications for healthcare. Our projects include early mobility identification of human activities for intensive care unit (ICU) patients and gait analysis of Duchenne muscular dystrophy (DMD) patients. We cover essential components of designing HAR systems including sensor factors (e.g., type, number, and placement location), AI model selection (e.g., classical machine learning models versus deep learning models), and feature engineering. In addition, we highlight the challenges of such healthcare-oriented HAR systems and propose several research opportunities for both the medical and the computer science community.


title: Scaling overhead of embedding optimization problems in quantum annealing

abstract: In order to treat all-to-all connected quadratic binary optimization problems (QUBO) with hardware quantum annealers, an embedding of the original problem is required due to the sparsity of the hardware's topology. Embedding fully-connected graphs - typically found in industrial applications - incurs a quadratic space overhead and thus a significant overhead in the time to solution. Here we investigate this embedding penalty of established planar embedding schemes such as minor embedding on a square lattice, minor embedding on a Chimera graph, and the Lechner-Hauke-Zoller scheme using simulated quantum annealing on classical hardware. Large-scale quantum Monte Carlo simulation suggest a polynomial time-to-solution overhead. Our results demonstrate that standard analog quantum annealing hardware is at a disadvantage in comparison to classical digital annealers, as well as gate-model quantum annealers and could also serve as benchmark for improvements of the standard quantum annealing protocol.


title: A Multiplexed Network for End-to-End, Multilingual OCR

abstract: Recent advances in OCR have shown that an end-to-end (E2E) training pipeline that includes both detection and recognition leads to the best results. However, many existing methods focus primarily on Latin-alphabet languages, often even only case-insensitive English characters. In this paper, we propose an E2E approach, Multiplexed Multilingual Mask TextSpotter, that performs script identification at the word level and handles different scripts with different recognition heads, all while maintaining a unified loss that simultaneously optimizes script identification and multiple recognition heads. Experiments show that our method outperforms the single-head model with similar number of parameters in end-to-end recognition tasks, and achieves state-of-the-art results on MLT17 and MLT19 joint text detection and script identification benchmarks. We believe that our work is a step towards the end-to-end trainable and scalable multilingual multi-purpose OCR system. Our code and model will be released.


title: A Proximal Quasi-Newton Trust-Region Method for Nonsmooth Regularized Optimization

abstract: We develop a trust-region method for minimizing the sum of a smooth term $f$ and a nonsmooth term $h$), both of which can be nonconvex. Each iteration of our method minimizes a possibly nonconvex model of $f + h$ in a trust region. The model coincides with $f + h$ in value and subdifferential at the center. We establish global convergence to a first-order stationary point when $f$ satisfies a smoothness condition that holds, in particular, when it has Lipschitz-continuous gradient, and $h$ is proper and lower semi-continuous. The model of $h$ is required to be proper, lower-semi-continuous and prox-bounded. Under these weak assumptions, we establish a worst-case $O(1/\epsilon^2)$ iteration complexity bound that matches the best known complexity bound of standard trust-region methods for smooth optimization. We detail a special instance, named TR-PG, in which we use a limited-memory quasi-Newton model of $f$ and compute a step with the proximal gradient method, resulting in a practical proximal quasi-Newton method. We establish similar convergence properties and complexity bound for a quadratic regularization variant, named R2, and provide an interpretation as a proximal gradient method with adaptive step size for nonconvex problems. R2 may also be used to compute steps inside the trust-region method, resulting in an implementation named TR-R2. We describe our Julia implementations and report numerical results on inverse problems from sparse optimization and signal processing. Both TR-PG and TR-R2 exhibit promising performance and compare favorably with two linesearch proximal quasi-Newton methods based on convex models.


title: Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing

abstract: Sample-based approximate query processing (AQP) suffers from many pitfalls such as the inability to answer very selective queries and unreliable confidence intervals when sample sizes are small. Recent research presented an intriguing solution of combining materialized, pre-computed aggregates with sampling for accurate and more reliable AQP. We explore this solution in detail in this work and propose an AQP physical design called PASS, or Precomputation-Assisted Stratified Sampling. PASS builds a tree of partial aggregates that cover different partitions of the dataset. The leaf nodes of this tree form the strata for stratified samples. Aggregate queries whose predicates align with the partitions (or unions of partitions) are exactly answered with a depth-first search, and any partial overlaps are approximated with the stratified samples. We propose an algorithm for optimally partitioning the data into such a data structure with various practical approximation techniques.


title: 6-DoF Contrastive Grasp Proposal Network

abstract: Proposing grasp poses for novel objects is an essential component for any robot manipulation task. Planning six degrees of freedom (DoF) grasps with a single camera, however, is challenging due to the complex object shape, incomplete object information, and sensor noise. In this paper, we present a 6-DoF contrastive grasp proposal network (CGPN) to infer 6-DoF grasps from a single-view depth image. First, an image encoder is used to extract the feature map from the input depth image, after which 3-DoF grasp regions are proposed from the feature map with a rotated region proposal network. Feature vectors that within the proposed grasp regions are then extracted and refined to 6-DoF grasps. The proposed model is trained offline with synthetic grasp data. To improve the robustness in reality and bridge the simulation-to-real gap, we further introduce a contrastive learning module and variant image processing techniques during the training. CGPN can locate collision-free grasps of an object using a single-view depth image within 0.5 seconds. Experiments on a physical robot further demonstrate the effectiveness of the algorithm.


title: Minimum complexity interpolation in random features models

abstract: Despite their many appealing properties, kernel methods are heavily affected by the curse of dimensionality. For instance, in the case of inner product kernels in $\mathbb{R}^d$, the Reproducing Kernel Hilbert Space (RKHS) norm is often very large for functions that depend strongly on a small subset of directions (ridge functions). Correspondingly, such functions are difficult to learn using kernel methods. This observation has motivated the study of generalizations of kernel methods, whereby the RKHS norm -- which is equivalent to a weighted $\ell_2$ norm -- is replaced by a weighted functional $\ell_p$ norm, which we refer to as $\mathcal{F}_p$ norm. Unfortunately, tractability of these approaches is unclear. The kernel trick is not available and minimizing these norms requires to solve an infinite-dimensional convex problem. We study random features approximations to these norms and show that, for $p>1$, the number of random features required to approximate the original learning problem is upper bounded by a polynomial in the sample size. Hence, learning with $\mathcal{F}_p$ norms is tractable in these cases. We introduce a proof technique based on uniform concentration in the dual, which can be of broader interest in the study of overparametrized models. For $p= 1$, our guarantees for the random features approximation break down. We prove instead that learning with the $\mathcal{F}_1$ norm is $\mathsf{NP}$-hard under a randomized reduction based on the problem of learning halfspaces with noise.


title: Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedures

abstract: Image-based tracking of laparoscopic instruments plays a fundamental role in computer and robotic-assisted surgeries by aiding surgeons and increasing patient safety. Computer vision contests, such as the Robust Medical Instrument Segmentation (ROBUST-MIS) Challenge, seek to encourage the development of robust models for such purposes, providing large, diverse, and annotated datasets. To date, most of the existing models for instance segmentation of medical instruments were based on two-stage detectors, which provide robust results but are nowhere near to the real-time (5 frames-per-second (fps)at most). However, in order for the method to be clinically applicable, real-time capability is utmost required along with high accuracy. In this paper, we propose the addition of attention mechanisms to the YOLACT architecture that allows real-time instance segmentation of instrument with improved accuracy on the ROBUST-MIS dataset. Our proposed approach achieves competitive performance compared to the winner ofthe 2019 ROBUST-MIS challenge in terms of robustness scores,obtaining 0.313 MI_DSC and 0.338 MI_NSD, while achieving real-time performance (37 fps)


title: Revealing the chemical bonding in adatoms arrays via machine learning of 3D scanning tunneling spectroscopy data

abstract: The adatom arrays on surfaces offer an ideal playground to explore the mechanisms of chemical bonding via changes in the local electronic tunneling spectra. While this information is readily available in hyperspectral scanning tunneling spectroscopy data, its analysis has been considerably impeded by a lack of suitable analytical tools. Here we develop a machine learning based workflow combining supervised feature identification in the spatial domain and un-supervised clustering in the energy domain to reveal the details of structure-dependent changes of the electronic structure in adatom arrays on the Co3Sn2S2 cleaved surface. This approach, in combination with first-principles calculations, provides insight for using artificial neural networks to detect adatoms and classifies each based on their local neighborhood comprised of other adatoms. These structurally classified adatoms are further spectrally deconvolved. The unexpected inhomogeneity of electronic structures among adatoms in similar configurations is unveiled using this method, suggesting there is not a single atomic species of adatoms, but rather multiple types of adatoms on the Co3Sn2S2 surface. This is further supported by a slight contrast difference in the images (or slight size variation) of the topography of the adatoms.