title: ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference

abstract: Neural language representation models such as BERT, pre-trained on large-scale unstructured corpora lack explicit grounding to real-world commonsense knowledge and are often unable to remember facts required for reasoning and inference. Natural Language Inference (NLI) is a challenging reasoning task that relies on common human understanding of language and real-world commonsense knowledge. We introduce a new model for NLI called External Knowledge Enhanced BERT (ExBERT), to enrich the contextual representation with real-world commonsense knowledge from external knowledge sources and enhance BERT's language understanding and reasoning capabilities. ExBERT takes full advantage of contextual word representations obtained from BERT and employs them to retrieve relevant external knowledge from knowledge graphs and to encode the retrieved external knowledge. Our model adaptively incorporates the external knowledge context required for reasoning over the inputs. Extensive experiments on the challenging SciTail and SNLI benchmarks demonstrate the effectiveness of ExBERT: in comparison to the previous state-of-the-art, we obtain an accuracy of 95.9% on SciTail and 91.5% on SNLI.


title: Temperature Steerable Flows and Boltzmann Generators

abstract: Boltzmann generators approach the sampling problem in many-body physics by combining a normalizing flow and a statistical reweighting method to generate samples in thermodynamic equilibrium. The equilibrium distribution is usually defined by an energy function and a thermodynamic state. Here we propose temperature-steerable flows (TSF) which are able to generate a family of probability densities parametrized by a choosable temperature parameter. TSFs can be embedded in generalized ensemble sampling frameworks to sample a physical system across multiple thermodynamic states.


title: The application of artificial intelligence in software engineering: a review challenging conventional wisdom

abstract: The field of artificial intelligence (AI) is witnessing a recent upsurge in research, tools development, and deployment of applications. Multiple software companies are shifting their focus to developing intelligent systems; and many others are deploying AI paradigms to their existing processes. In parallel, the academic research community is injecting AI paradigms to provide solutions to traditional engineering problems. Similarly, AI has evidently been proved useful to software engineering (SE). When one observes the SE phases (requirements, design, development, testing, release, and maintenance), it becomes clear that multiple AI paradigms (such as neural networks, machine learning, knowledge-based systems, natural language processing) could be applied to improve the process and eliminate many of the major challenges that the SE field has been facing. This survey chapter is a review of the most commonplace methods of AI applied to SE. The review covers methods between years 1975-2017, for the requirements phase, 46 major AI-driven methods are found, 19 for design, 15 for development, 68 for testing, and 15 for release and maintenance. Furthermore, the purpose of this chapter is threefold; firstly, to answer the following questions: is there sufficient intelligence in the SE lifecycle? What does applying AI to SE entail? Secondly, to measure, formulize, and evaluate the overlap of SE phases and AI disciplines. Lastly, this chapter aims to provide serious questions to challenging the current conventional wisdom (i.e., status quo) of the state-of-the-art, craft a call for action, and to redefine the path forward.


title: The history and future prospects of open data and open source software

abstract: Open data for all New Yorkers is the tagline on New York City's open data website. Open government is being promoted at most countries of the western world. Government transparency levels are being measured by the amount of data they share through their online public repositories. Additionally, open source software is promoted at governments, academia, and the industry. This is the new digital story of this century, and the new testament between the Gods of technology and there users. Data and software openness will redefine the path forward and aim to rekindle our collective intelligence. Data and software openness can redefine Data Democracy and be the catalyst for its progress. This chapter provides a historical insight into data and software openness, the beginnings, the heroes, prospects for the future, and all things we cannot afford to negotiate or lose.


title: SwarmPlay: Interactive Tic-tac-toe Board Game with Swarm of Nano-UAVs driven by Reinforcement Learning

abstract: Reinforcement learning (RL) methods have been actively applied in the field of robotics, allowing the system itself to find a solution for a task otherwise requiring a complex decision-making algorithm. In this paper, we present a novel RL-based Tic-tac-toe scenario, i.e. SwarmPlay, where each playing component is presented by an individual drone that has its own mobility and swarm intelligence to win against a human player. Thus, the combination of challenging swarm strategy and human-drone collaboration aims to make the games with machines tangible and interactive. Although some research on AI for board games already exists, e.g., chess, the SwarmPlay technology has the potential to offer much more engagement and interaction with the user as it proposes a multi-agent swarm instead of a single interactive robot. We explore user's evaluation of RL-based swarm behavior in comparison with the game theory-based behavior. The preliminary user study revealed that participants were highly engaged in the game with drones (70% put a maximum score on the Likert scale) and found it less artificial compared to the regular computer-based systems (80%). The affection of the user's game perception from its outcome was analyzed and put under discussion. User study revealed that SwarmPlay has the potential to be implemented in a wider range of games, significantly improving human-drone interactivity.


title: An Entropic Approach To Classical Density Functional Theory

abstract: The classical Density Functional Theory (DFT) is introduced as an application of entropic inference for inhomogeneous fluids at thermal equilibrium. It is shown that entropic inference reproduces the variational principle of DFT when information about expected density of particles is imposed. This process introduces an intermediate family of trial density-parametrized probability distributions, and consequently an intermediate entropy, from which the preferred one is found using the method of Maximum Entropy (MaxEnt). As an application, the DFT model for slowly varying density is provided, and its approximation scheme is discussed.

categories: cond-mat.stat-mech physics.comp-ph physics.data-an physics.flu-dyn


title: Extending a Physics-Based Constitutive Model using Genetic Programming

abstract: In material science, models are derived to predict emergent material properties (e.g. elasticity, strength, conductivity) and their relations to processing conditions. A major drawback is the calibration of model parameters that depend on processing conditions. Currently, these parameters must be optimized to fit measured data since their relations to processing conditions (e.g. deformation temperature, strain rate) are not fully understood. We present a new approach that identifies the functional dependency of calibration parameters from processing conditions based on genetic programming. We propose two (explicit and implicit) methods to identify these dependencies and generate short interpretable expressions. The approach is used to extend a physics-based constitutive model for deformation processes. This constitutive model operates with internal material variables such as a dislocation density and contains a number of parameters, among them three calibration parameters. The derived expressions extend the constitutive model and replace the calibration parameters. Thus, interpolation between various processing parameters is enabled. Our results show that the implicit method is computationally more expensive than the explicit approach but also produces significantly better results.


title: Extrapolation of Hubble Curves

abstract: We present exact solutions to the Friedmann equation in coordinate time and conformal time in elliptic Legendre integrals. Both approaches describe the modern Hubble diagram with the same accuracy. Hubble curves are extrapolated for large redshift values.


title: Weak stablity and closure in turbulence

abstract: We survey recent results in the mathematical literature on the equations of incompressible fluid dynamics, highlighting common themes and how they might contribute to the understanding of some phenomena in the theory of fully developed turbulence.


title: Secure and Efficient Blockchain based Knowledge Sharing for Intelligent Connected Vehicles

abstract: The emergence of Intelligent Connected Vehicles (ICVs) shows great potential for future intelligent traffic systems, enhancing both traffic safety and road efficiency. However, the ICVs relying on data driven perception and driving models face many challenges, including the lack of comprehensive knowledge to deal with complicated driving context. In this paper, we are motivated to investigate cooperative knowledge sharing for ICVs. We propose a secure and efficient directed acyclic graph (DAG) blockchain based knowledge sharing framework, aiming to cater for the micro-transaction based vehicular networks. The framework can realize both local and cross-regional knowledge sharing. Then, the framework is applied to autonomous driving applications, wherein machine learning based models for autonomous driving control can be shared. A lightweight tip selection algorithm (TSA) is proposed for the DAG based knowledge sharing framework to achieve consensus and identity verification for cross-regional vehicles. To enhance model accuracy as well as minimizing bandwidth consumption, an adaptive asynchronous distributed learning (ADL) based scheme is proposed for model uploading and downloading. Experiment results show that the blockchain based knowledge sharing is secure, and it can resist attacks from malicious users. In addition, the proposed adaptive ADL scheme can enhance driving safety related performance compared to several existing algorithms.


title: A Gaze Data-based Comparative Study to Build a Trustworthy Human-AI Collaboration in Crash Anticipation

abstract: Vehicles with a safety function for anticipating crashes in advance can enhance drivers' ability to avoid crashes. As dashboard cameras have become a low-cost sensor device accessible to almost every vehicle, deep neural networks for crash anticipation from a dashboard camera are receiving growing interest. However, drivers' trust in the Artificial Intelligence (AI)-enabled safety function is built on the validation of its safety enhancement toward zero deaths. This paper is motivated to establish a method that uses gaze data and corresponding measures to evaluate human drivers' ability to anticipate crashes. A laboratory experiment is designed and performed, wherein a screen-based eye tracker collects the gaze data of six volunteers while watching 100 driving videos that include both normal and crash scenarios. Statistical analyses of the experimental data show that, on average, drivers can anticipate a crash up to 2.61 seconds before it occurs in this pilot study. The chance that drivers have successfully anticipated crashes before they occur is 92.8%. A state-of-the-art AI model can anticipate crashes 1.02 seconds earlier than drivers on average. The study finds that crash-involving traffic agents in the driving videos can vary drivers' instant attention level, average attention level, and spatial attention distribution. This finding supports the development of a spatial-temporal attention mechanism for AI models to strengthen their ability to anticipate crashes. Results from the comparison also suggest the development of collaborative intelligence that keeps human-in-the-loop of AI models to further enhance the reliability of AI-enabled safety functions.


title: Cross-correlation of DES Y3 lensing and ACT/${\it Planck}$ thermal Sunyaev Zel'dovich Effect I: Measurements, systematics tests, and feedback model constraints

abstract: We present a tomographic measurement of the cross-correlation between thermal Sunyaev-Zeldovich (tSZ) maps from ${\it Planck}$ and the Atacama Cosmology Telescope (ACT) and weak galaxy lensing shears measured during the first three years of observations of the Dark Energy Survey (DES Y3). This correlation is sensitive to the thermal energy in baryons over a wide redshift range, and is therefore a powerful probe of astrophysical feedback. We detect the correlation at a statistical significance of $21\sigma$, the highest significance to date. We examine the tSZ maps for potential contaminants, including cosmic infrared background (CIB) and radio sources, finding that CIB has a substantial impact on our measurements and must be taken into account in our analysis. We use the cross-correlation measurements to test different feedback models. In particular, we model the tSZ using several different pressure profile models calibrated against hydrodynamical simulations. Our analysis marginalises over redshift uncertainties, shear calibration biases, and intrinsic alignment effects. We also marginalise over $\Omega_{\rm m}$ and $\sigma_8$ using ${\it Planck}$ or DES priors. We find that the data prefers the model with a low amplitude of the pressure profile at small scales, compatible with a scenario with strong AGN feedback and ejection of gas from the inner part of the halos. When using a more flexible model for the shear profile, constraints are weaker, and the data cannot discriminate between different baryonic prescriptions.


title: Cross-correlation of DES Y3 lensing and ACT/${\it Planck}$ thermal Sunyaev Zel'dovich Effect II: Modeling and constraints on halo pressure profiles

abstract: Hot, ionized gas leaves an imprint on the cosmic microwave background via the thermal Sunyaev Zel'dovich (tSZ) effect. The cross-correlation of gravitational lensing (which traces the projected mass) with the tSZ effect (which traces the projected gas pressure) is a powerful probe of the thermal state of ionized baryons throughout the Universe, and is sensitive to effects such as baryonic feedback. In a companion paper (Gatti et al. 2021), we present tomographic measurements and validation tests of the cross-correlation between galaxy shear measurements from the first three years of observations of the Dark Energy Survey, and tSZ measurements from a combination of Atacama Cosmology Telescope and ${\it Planck}$ observations. In this work, we use the same measurements to constrain models for the pressure profiles of halos across a wide range of halo mass and redshift. We find evidence for reduced pressure in low mass halos, consistent with predictions for the effects of feedback from active galactic nuclei. We infer the hydrostatic mass bias ($B \equiv M_{500c}/M_{\rm SZ}$) from our measurements, finding $B = 1.8\pm0.1$ when adopting the ${\it Planck}$-preferred cosmological parameters. We additionally find that our measurements are consistent with a non-zero redshift evolution of $B$, with the correct sign and sufficient magnitude to explain the mass bias necessary to reconcile cluster count measurements with the ${\it Planck}$-preferred cosmology. Our analysis introduces a model for the impact of intrinsic alignments (IA) of galaxy shapes on the shear-tSZ correlation. We show that IA can have a significant impact on these correlations at current noise levels.


title: Plasmonic crystals with highly ordered lattice geometries using continuous metal films on diatom bio-silica as both scaffolds and sources of tuneability

abstract: Diatoms are microscopic algae found in all of Earths water courses. They produce frustules, porous silica exoskeletons, grown by precipitation of silicic acid from water. Frustule components, known as girdles, from some diatom species also feature highly periodic pore arrays with properties on the same scale and quality of ordering as manufactured photonic crystals. Here, the girdles of two diatom species with various lattice constants are used as bio-silica scaffolds for plasmonic crystals, combined with metals chosen for spectral agreement between permittivity and photonic crystal properties. The use of frustules as scaffolds for plasmonic application has been tested earlier, as nano-porous features can enhance scattering and local hotspots, useful for sensing application or SERS. However, both the use of girdles and of continuous metal films are new approaches offering previously unseen plasmonic effects. Angularly resolved dispersions from reflection Fourier spectroscopy are provided for Coscinodiscus granii girdles, forming well-ordered square lattices, and Coscinodiscus wailesii, forming ordered hexagonal lattices, covered with a 40 nm film of silver or with 40 nm of gold, respectively. These were confirmed with optical modelling of the 3D systems, including both metal surface layers and internal frustule structures, allowing for the calculation of dispersions and electric fields. Measurements are further compared with structures produced via Focused Ion Beam microscopy, demonstrating the advantages of girdles as photonic crystal scaffolds and as an alternative to conventional plasmonic crystal fabrication. The results demonstrate that high-quality plasmonic crystal scaffolds from diatoms are available in nature, and their natural diversity can be applied in a controlled way to obtain plasmonic crystals with a wide range of behaviours and spectral responses.


title: Full-Text and URL Search Over Web Archives

abstract: Web archives are a historically valuable source of information. In some respects, web archives are the only record of the evolution of human society in the last two decades. They preserve a mix of personal and collective memories, the importance of which tends to grow as they age. However, the value of web archives depends on their users being able to search and access the information they require in efficient and effective ways. Without the possibility of exploring and exploiting the archived contents, web archives are useless. Web archive access functionalities range from basic browsing to advanced search and analytical services, accessed through user-friendly interfaces. Full-text and URL search have become the predominant and preferred forms of information discovery in web archives, fulfilling user needs and supporting search APIs that feed complex applications. Both full-text and URL search are based on the technology developed for modern web search engines, since the Web is the main resource targeted by both systems. However, while web search engines enable searching over the most recent web snapshot, web archives enable searching over multiple snapshots from the past. This means that web archives have to deal with a temporal dimension that is the cause of new challenges and opportunities, discussed throughout this chapter.


title: Linking Uranus' temperature profile to wind-induced magnetic fields

abstract: The low luminosity of Uranus is still a puzzling phenomenon and has key implications for the thermal and compositional gradients within the planet. Recent studies have shown that planetary volatiles become ionically conducting under conditions that are present in the ice giants. Rapidly growing electrical conductivity with increasing depth would couple zonal flows to the background magnetic field in the planets, inducing poloidal and toroidal field perturbations $\mathbf{B}^{\omega} = \mathbf{B}^{\omega}_P + \mathbf{B}^{\omega}_T$ via the $\omega$-effect. Toroidal perturbations $\mathbf{B}^{\omega}_T$ are expected to diffuse downwards and produce poloidal fields $\mathbf{B}^{\alpha}_P$ through turbulent convection via the $\alpha$-effect, comparable in strength to those of the $\omega$-effect; $\mathbf{B}^{\omega}_P$. To estimate the strength of poloidal field perturbations for various Uranus models in the literature, we generate wind decay profiles based on Ohmic dissipation constraints assuming an ionically conducting H$_2$-He-H$_2$O interior. Due to the higher metallicities in outer regions of hot Uranus models, zonal winds need to decay to $\sim$0.1% of their surface values in the outer 1% of Uranus to admit decay solutions in the Ohmic framework. Our estimates suggest that colder Uranus models could potentially have poloidal field perturbations that reach up to $\mathcal{O}(0.1)$ of the background magnetic field in the most extreme case. The possible existence of poloidal field perturbations spatially correlated with Uranus' zonal flows could be used to constrain Uranus' interior structure, and presents a further case for the $\textit{in situ}$ exploration of Uranus.


title: Big Data Science Over the Past Web

abstract: Web archives preserve unique and historically valuable information. They hold a record of past events and memories published by all kinds of people, such as journalists, politicians and ordinary people who have shared their testimony and opinion on multiple subjects. As a result, researchers such as historians and sociologists have used web archives as a source of information to understand the recent past since the early days of the World Wide Web. The typical way to extract knowledge from a web archive is by using its search functionalities to find and analyse historical content. This can be a slow and superficial process when analysing complex topics, due to the huge amount of data that web archives have been preserving over time. Big data science tools can cope with this order of magnitude, enabling researchers to automatically extract meaningful knowledge from the archived data. This knowledge helps not only to explain the past but also to predict the future through the computational modelling of events and behaviours. Currently, there is an immense landscape of big data tools, machine learning frameworks and deep learning algorithms that significantly increase the scalability and performance of several computational tasks, especially over text, image and audio. Web archives have been taking advantage of this panoply of technologies to provide their users with more powerful tools to explore and exploit historical data. This chapter presents several examples of these tools and gives an overview of their application to support longitudinal studies over web archive collections.


title: Optical vortex coronagraph imaging of a laser-induced plasma filament

abstract: A high contrast imaging technique based on an optical vortex coronagraph (OVC) is used to measure the spatial phase profile induced by an air plasma generated by a femtosecond laser pulse. The sensitivity of the OVC method significantly surpassed both in-line holographic and direct imaging methods based on air plasma fluorescence. The estimated phase sensitivity of 0.046 waves provides opportunities for OVC applications in areas such as bioimaging, material characterization, as well as plasma diagnostics.


title: Nonlinear diffusion of gluons

abstract: It is proposed to consider the fast thermalization of gluons in relativistic heavy-ion collisions as a diffusion process in momentum space. Closed-form analytical solutions of a nonlinear boson diffusion equation (NBDE) with constant drift and diffusion coefficients v, D and boundary conditions at the singularity are derived. The time evolution towards local central temperatures T< 600 MeV through inelastic gluon scatterings in heavy-ion collisions is calculated for under- and overoccupied systems in the full momentum range. The results are consistent with QCD-based numerical calculations for gluon thermalization via inelastic gluon collisions.


title: Scheduling Aerial Vehicles in an Urban Air Mobility Scheme

abstract: Highly populated cities face several challenges, one of them being the intense traffic congestion. In recent years, the concept of Urban Air Mobility has been put forward by large companies and organizations as a way to address this problem, and this approach has been rapidly gaining ground. This disruptive technology involves aerial vehicles (AVs) for hire than can be utilized by customers to travel between locations within large cities. This concept has the potential to drastically decrease traffic congestion and reduce air pollution, since these vehicles typically use electric motors powered by batteries. This work studies the problem of scheduling the assignment of AVs to customers, having as a goal to maximize the serviced customers and minimize the energy consumption of the AVs by forcing them to fly at the lowest possible altitude. Initially, an Integer Linear Program (ILP) formulation is presented, that is solved offline and optimally, followed by a near-optimal algorithm, that solves the problem incrementally, one AV at a time, to address scalability issues, allowing scheduling in problems involving large numbers of locations, AVs, and customer requests.


title: Reduced order model approach for imaging with waves

abstract: We introduce a novel, computationally inexpensive approach for imaging with an active array of sensors, which probe an unknown medium with a pulse and measure the resulting waves. The imaging function uses a data driven estimate of the "internal wave" originating from the vicinity of the imaging point and propagating to the sensors through the unknown medium. We explain how this estimate can be obtained using a reduced order model (ROM) for the wave propagation. We analyze the imaging function, connect it to the time reversal process and describe how its resolution depends on the aperture of the array, the bandwidth of the probing pulse and the medium through which the waves propagate. We also show how the internal wave can be used for selective focusing of waves at points in the imaging region. This can be implemented experimentally and can be used for pixel scanning imaging. We assess the performance of the imaging methods with numerical simulations and compare them to the conventional reverse-time migration method and the "backprojection" method introduced recently as an application of the same ROM.


title: Towards Substructural Property-Based Testing

abstract: We propose to extend property-based testing to substructural logics to overcome the current lack of reasoning tools in the field. We take the first step by implementing a property-based testing system for specifications written in the linear logic programming language Lolli. We employ the foundational proof certificates architecture to model various data generation strategies. We validate our approach by encoding a model of a simple imperative programming language and its compilation and by testing its meta-theory via mutation analysis.


title: Facial structure of matrix convex sets

abstract: This article investigates the notions of exposed points and (exposed) faces in the matrix convex setting. Matrix exposed points in finite dimensions were first defined by Kriel in 2019. Here this notion is extended to matrix convex sets in infinite-dimensional vector spaces. Then a connection between matrix exposed points and matrix extreme points is established: a matrix extreme point is ordinary exposed if and only if it is matrix exposed. This leads to a Krein-Milman type result for matrix exposed points that is due to Straszewicz-Klee in classical convexity: a compact matrix convex set is the closed matrix convex hull of its matrix exposed points. Several notions of a fixed-level as well as a multicomponent matrix face and matrix exposed face are introduced to extend the concepts of a matrix extreme point and a matrix exposed point, respectively. Their properties resemble those of (exposed) faces in the classical sense, e.g., it is shown that the $C^\ast$-extreme (matrix extreme) points of a matrix face (matrix multiface) of a matrix convex set $K$ are matrix extreme in $K$. As in the case of extreme points, any fixed-level matrix face is ordinary exposed if and only if it is a matrix exposed face. From this it follows that every fixed-level matrix face of a free spectrahedron is matrix exposed. On the other hand, matrix multifaces give rise to the noncommutative counterpart of the classical theory connecting (archimedean) faces of compact convex sets and (archimedean) order ideals of the corresponding function systems.


title: An Efficient Digital Watermarking Algorithm Based on DCT and BCH Error Correcting Code

abstract: Watermarking is a technique for hiding of data in a medium coverage so that its presence is not detectable by a human eye and is recoverable only by the authorized recipient. Two of the most important features of watermarked image are transparency and robustness which are largely related to the security of watermarking algorithms. In this paper, an image watermarking scheme based on BCH error correction code in Discrete Cosine Transformation (DCT) domain is considered. Before embedding process, the watermark is encoded through BCH coding. Then it is embedded into the Discrete Cosine Transformation (DCT) coefficients of cover image. In order to decrease embedding complexity and speed up the process of finding the best position to insert a watermark signal, lookup table method is utilized. The key features of proposed method include the reduction of time required in the process embedding of information, security and ability to correct the error caused by variety of attacks and destructions as well. Watermarked image robustness has been investigated against different kinds attacks and the simulation results indicate that the proposed algorithm outperforms the existing methods in terms of imperceptibility, robustness and security.


title: Persistent homology method to detect block structures in weighted networks

abstract: Unravelling the block structure of a network is critical for studying macroscopic features and community-level dynamics. The weighted stochastic block model (WSBM), a variation of the traditional stochastic block model, is designed for weighted networks, but it is not always optimal. We introduce a novel topological method to study the block structure of weighted networks by comparing their persistence diagrams. We found persistence diagrams of networks with different block structures show distinct features, sufficient to distinguish. Moreover, the overall characteristics are preserved even with more stochastic examples or modified hyperparameters. Finally, when random graphs whose latent block structure is unknown are tested, results from persistence diagram analysis are consistent with their weighted stochastic block model. Although this topological method cannot completely replace the original WSBM method for some reasons, it is worth to be investigated further.


abstract: Domain adaptation (DA) aims to transfer the knowledge learned from a source domain to an unlabeled target domain. Some recent works tackle source-free domain adaptation (SFDA) where only a source pre-trained model is available for adaptation to the target domain. However, those methods do not consider keeping source performance which is of high practical value in real world applications. In this paper, we propose a new domain adaptation paradigm called Generalized Source-free Domain Adaptation (G-SFDA), where the learned model needs to perform well on both the target and source domains, with only access to current unlabeled target data during adaptation. First, we propose local structure clustering (LSC), aiming to cluster the target features with its semantically similar neighbors, which successfully adapts the model to the target domain in the absence of source data. Second, we propose sparse domain attention (SDA), it produces a binary domain specific attention to activate different feature channels for different domains, meanwhile the domain attention will be utilized to regularize the gradient during adaptation to keep source information. In the experiments, for target performance our method is on par with or better than existing DA and SFDA methods, specifically it achieves state-of-the-art performance (85.4%) on VisDA, and our method works well for all domains after adapting to single or multiple target domains. Code is available in https://github.com/Albert0147/G-SFDA.


title: Accelerating the Adoption of Disruptive Technologies: The Impact of COVID-19 on Intentions to Use Autonomous Vehicles

abstract: One of the most notable global transportation trends is the accelerated pace of development in vehicle automation technologies. Uncertainty surrounds the future of automated mobility as there is no clear consensus on potential adoption patterns, ownership versus shared use status and travel impacts. Adding to this uncertainty is the impact of the COVID-19 pandemic that has triggered profound changes in mobility behaviors as well as accelerated adoption of new technologies at an unprecedented rate. Accordingly, this study examines the impact of the COVID-19 pandemic on willingness to adopt the emerging technology of autonomous vehicles (AVs). Using data from a survey disseminated in June 2020 to 700 respondents in the United States, we perform a difference-in-difference regression to analyze the shift in willingness to use autonomous vehicles as part of a shared fleet before and during the pandemic. The results reveal that the COVID-19 pandemic has a positive and highly significant impact on the consideration of using autonomous vehicles. This shift is present regardless of tech-savviness, gender or urban/rural household location. Individuals who are younger, left-leaning and frequent users of shared modes of travel are expected to become more likely to use autonomous vehicles once offered. Understanding the effects of these attributes on the increase in consideration of AVs is important for policy making, as these effects provide a guide to predicting adoption of autonomous vehicles - once available - and to identify segments of the population likely to be more resistant to adopting AVs.


title: Non-intrusive polynomial chaos expansion for topology optimization using polygonal meshes

abstract: This paper deals with the applications of stochastic spectral methods for structural topology optimization in the presence of uncertainties. A non-intrusive polynomial chaos expansion is integrated into a topology optimization algorithm to calculate low-order statistical moments of the mechanical-mathematical model response. This procedure, known as robust topology optimization, can optimize the mean of the compliance while simultaneously minimizing its standard deviation. In order to address possible variabilities in the loads applied to the mechanical system of interest, magnitude and direction of the external forces are assumed to be uncertain. In this probabilistic framework, forces are described as a random field or a set of random variables. Representation of the random objects and propagation of load uncertainties through the model are efficiently done through Karhunen-Lo\`{e}ve and polynomial chaos expansions. We take advantage of using polygonal elements, which have been shown to be effective in suppressing checkerboard patterns and reducing mesh dependency in the solution of topology optimization problems. Accuracy and applicability of the proposed methodology are demonstrated by means of several topology optimization examples. The obtained results, which are in excellent agreement with reference solutions computed via Monte Carlo method, show that load uncertainties play an important role in optimal design of structural systems, so that they must be taken into account to ensure a reliable optimization process.

categories: cs.CE cs.NA math.NA math.OC stat.CO stat.ME


title: The macroeconomic cost of climate volatility

abstract: We study the impact of climate volatility on economic growth exploiting data on 133 countries between 1960 and 2019. We show that the conditional (ex ante) volatility of annual temperatures increased steadily over time, rendering climate conditions less predictable across countries, with important implications for growth. Controlling for concomitant changes in temperatures, a +1 degree C increase in temperature volatility causes on average a 0.3 percent decline in GDP growth and a 0.7 percent increase in the volatility of GDP. Unlike changes in average temperatures, changes in temperature volatility affect both rich and poor countries.


title: Concerning the stability of hybrid biexcitons in organic polymer aggregates

abstract: Frenkel excitons are the primary photoexcitations in organic semiconductors and are ultimately responsible for the optical properties of such materials. They are also predicted to form \emph{bound} exciton pairs, termed biexcitons, which are consequential intermediates in a wide range of photophysical processes. Generally, we think of bound states as arising from an attractive interaction. However, here we report on our recent theoretical analysis predicting the formation of stable biexciton states in a conjugated polymer material arising from both attractive and repulsive interactions. We show that in J-aggregate systems, JJ-biexcitons can arise from repulsive dipolar interactions with energies $E_{JJ}> 2E_J$ while in H-aggregates, HH-biexciton states $E_{HH} < 2E_H$ corresponding to attractive dipole exciton/exciton interactions. These predictions are corroborated by using ultrafast double-quantum coherence spectroscopy on a PBTTT material that exhibits both J- and H-like excitonic behavior.


title: Pion photoproduction in chiral perturbation theory with explicit treatment of the $\Delta(1232)$ resonance

abstract: We study the reaction of pion photoproduction on the nucleon in the framework of chiral perturbation theory with explicit $\Delta(1232)$ degrees of freedom. In the covariant approach, we give results up to order $\epsilon^3$ in the small scale expansion scheme. Furthermore, we provide $\Delta$-less and $\Delta$-full results obtained in the heavy-baryon scheme to analyze the differences to the covariant approach. Low energy constants are fitted to multipole amplitudes using theoretical truncation errors estimated by a Bayesian approach. We also compare our findings to data of neutral pion production cross sections and polarization asymmetries. The description of the reaction is clearly improved by the explicit treatment of the $\Delta(1232)$ resonance.


title: Stochastic gene transcription with non-competitive transcription regulatory architecture

abstract: The transcription factors, such as activators and repressors, can interact with the promoter of gene either in a competitive or non-competitive way. In this paper, we construct a stochastic model with non-competitive transcriptional regulatory architecture and develop an analytical theory that re-establishes the experimental results with an improved data fitting. The analytical expressions in the theory allow us to study the nature of the system corresponding to any of its parameters, and hence enable us to find out the factors that govern the regulation of gene expression for that architecture. We notice that, along with transcriptional reinitiation and repressors, there are other parameters that can control the noisiness of this network. We also observe that, the Fano factor (at mRNA level) varies from sub-Poissonian regime to superPoissonian regime. In addition to the aforementioned properties, we observe some anomalous characteristics of the Fano factor (at mRNA level) and that of the variance of protein at lower activator concentrations in presence of repressor molecules. This model is useful to understand the architecture of interactions which may buffer the stochasticity inherent to gene transcription.

categories: q-bio.MN cond-mat.soft cond-mat.stat-mech physics.bio-ph


title: Domain Generalization via Gradient Surgery

abstract: In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at training, we incur in a domain generalization problem. Methods to address this issue learn a model using data from multiple source domains, and then apply this model to the unseen target domain. Our hypothesis is that when training with multiple domains, conflicting gradients within each mini-batch contain information specific to the individual domains which is irrelevant to the others, including the test domain. If left untouched, such disagreement may degrade generalization performance. In this work, we characterize the conflicting gradients emerging in domain shift scenarios and devise novel gradient agreement strategies based on gradient surgery to alleviate their effect. We validate our approach in image classification tasks with three multi-domain datasets, showing the value of the proposed agreement strategy in enhancing the generalization capability of deep learning models in domain shift scenarios.


title: The Boundary for Quantum Advantage in Gaussian Boson Sampling

abstract: Identifying the boundary beyond which quantum machines provide a computational advantage over their classical counterparts is a crucial step in charting their usefulness. Gaussian Boson Sampling (GBS), in which photons are measured from a highly entangled Gaussian state, is a leading approach in pursuing quantum advantage. State-of-the-art quantum photonics experiments that, once programmed, run in minutes, would require 600 million years to simulate using the best pre-existing classical algorithms. Here, we present substantially faster classical GBS simulation methods, including speed and accuracy improvements to the calculation of loop hafnians, the matrix function at the heart of GBS. We test these on a $\sim \! 100,000$ core supercomputer to emulate a range of different GBS experiments with up to 100 modes and up to 92 photons. This reduces the run-time of classically simulating state-of-the-art GBS experiments to several months -- a nine orders of magnitude improvement over previous estimates. Finally, we introduce a distribution that is efficient to sample from classically and that passes a variety of GBS validation methods, providing an important adversary for future experiments to test against.


title: Del-Net: A Single-Stage Network for Mobile Camera ISP

abstract: The quality of images captured by smartphones is an important specification since smartphones are becoming ubiquitous as primary capturing devices. The traditional image signal processing (ISP) pipeline in a smartphone camera consists of several image processing steps performed sequentially to reconstruct a high quality sRGB image from the raw sensor data. These steps consist of demosaicing, denoising, white balancing, gamma correction, colour enhancement, etc. Since each of them are performed sequentially using hand-crafted algorithms, the residual error from each processing module accumulates in the final reconstructed signal. Thus, the traditional ISP pipeline has limited reconstruction quality in terms of generalizability across different lighting conditions and associated noise levels while capturing the image. Deep learning methods using convolutional neural networks (CNN) have become popular in solving many image-related tasks such as image denoising, contrast enhancement, super resolution, deblurring, etc. Furthermore, recent approaches for the RAW to sRGB conversion using deep learning methods have also been published, however, their immense complexity in terms of their memory requirement and number of Mult-Adds make them unsuitable for mobile camera ISP. In this paper we propose DelNet - a single end-to-end deep learning model - to learn the entire ISP pipeline within reasonable complexity for smartphone deployment. Del-Net is a multi-scale architecture that uses spatial and channel attention to capture global features like colour, as well as a series of lightweight modified residual attention blocks to help with denoising. For validation, we provide results to show the proposed Del-Net achieves compelling reconstruction quality.


title: Large-Scale Differentially Private BERT

abstract: In this work, we study the large-scale pretraining of BERT-Large with differentially private SGD (DP-SGD). We show that combined with a careful implementation, scaling up the batch size to millions (i.e., mega-batches) improves the utility of the DP-SGD step for BERT; we also enhance its efficiency by using an increasing batch size schedule. Our implementation builds on the recent work of [SVK20], who demonstrated that the overhead of a DP-SGD step is minimized with effective use of JAX [BFH+18, FJL18] primitives in conjunction with the XLA compiler [XLA17]. Our implementation achieves a masked language model accuracy of 60.5% at a batch size of 2M, for $\epsilon = 5.36$. To put this number in perspective, non-private BERT models achieve an accuracy of $\sim$70%.


title: From augmented microscopy to the topological transformer: a new approach in cell image analysis for Alzheimer's research

abstract: Cell image analysis is crucial in Alzheimer's research to detect the presence of A$\beta$ protein inhibiting cell function. Deep learning speeds up the process by making only low-level data sufficient for fruitful inspection. We first found Unet is most suitable in augmented microscopy by comparing performance in multi-class semantics segmentation. We develop the augmented microscopy method to capture nuclei in a brightfield image and the transformer using Unet model to convert an input image into a sequence of topological information. The performance regarding Intersection-over-Union is consistent concerning the choice of image preprocessing and ground-truth generation. Training model with data of a specific cell type demonstrates transfer learning applies to some extent. The topological transformer aims to extract persistence silhouettes or landscape signatures containing geometric information of a given image of cells. This feature extraction facilitates studying an image as a collection of one-dimensional data, substantially reducing computational costs. Using the transformer, we attempt grouping cell images by their cell type relying solely on topological features. Performances of the transformers followed by SVM, XGBoost, LGBM, and simple convolutional neural network classifiers are inferior to the conventional image classification. However, since this research initiates a new perspective in biomedical research by combining deep learning and topology for image analysis, we speculate follow-up investigation will reinforce our genuine regime.

categories: eess.IV cs.CV cs.LG math.AT math.ST stat.TH


title: CPPNet: A Coverage Path Planning Network

abstract: This paper presents a deep-learning based CPP algorithm, called Coverage Path Planning Network (CPPNet). CPPNet is built using a convolutional neural network (CNN) whose input is a graph-based representation of the occupancy grid map while its output is an edge probability heat graph, where the value of each edge is the probability of belonging to the optimal TSP tour. Finally, a greedy search is used to select the final optimized tour. CPPNet is trained and comparatively evaluated against the TSP tour. It is shown that CPPNet provides near-optimal solutions while requiring significantly less computational time, thus enabling real-time coverage path planning in partially unknown and dynamic environments.


title: Multi-Frequency GPR Microwave Imaging of Sparse Targets Through a Multi-Task Bayesian Compressive Sensing Approach

abstract: An innovative inverse scattering (IS) method is proposed for the quantitative imaging of pixel-sparse scatterers buried within a lossy half-space. On the one hand, such an approach leverages on the wide-band nature of ground penetrating radar (GPR) data by jointly processing the multi-frequency (MF) spectral components of the collected radargrams. On the other hand, it enforces sparsity priors on the problem unknowns to yield regularized solutions of the fully non-linear scattering equations. Towards this end, a multi-task Bayesian Compressive Sensing (MT-BCS) methodology is adopted and suitably customized to take full advantage of the available frequency diversity and of the a-priori information on the class of imaged targets. Representative results are reported to assess the proposed MF-MT-BCS strategy also in comparison with competitive state-of-the-art alternatives.


title: A Game-Theoretic Framework for Controlled Islanding in the Presence of Adversaries

abstract: Controlled islanding effectively mitigates cascading failures by partitioning the power system into a set of disjoint islands. In this paper, we study the controlled islanding problem of a power system under disturbances introduced by a malicious adversary. We formulate the interaction between the grid operator and adversary using a game-theoretic framework. The grid operator first computes a controlled islanding strategy, along with the power generation for the post-islanding system to guarantee stability. The adversary observes the strategies of the grid operator. The adversary then identifies critical substations of the power system to compromise and trips the transmission lines that are connected with compromised substations. For our game formulation, we propose a double oracle algorithm based approach that solves the best response for each player. We show that the best responses for the grid operator and adversary can be formulated as mixed integer linear programs. In addition, the best response of the adversary is equivalent to a submodular maximization problem under a cardinality constraint, which can be approximated up to a $(1-\frac{1}{e})$ optimality bound in polynomial time. We compare the proposed approach with a baseline where the grid operator computes an islanding strategy by minimizing the power flow disruption without considering the possible response from the adversary. We evaluate both approaches using IEEE 9-bus, 14-bus, 30-bus, 39-bus, 57-bus, and 118-bus power system case study data. Our proposed approach achieves better performance than the baseline in about $44\%$ of test cases, and on average it incurs about 12.27 MW less power flow disruption.


title: An approach to universality using Weyl m-functions

abstract: We describe an approach to universality limits for orthogonal polynomials on the real line which is completely local and uses only the boundary behavior of the Weyl m-function at the point. We show that bulk universality of the Christoffel-Darboux kernel holds for any point where the imaginary part of the m-function has a positive finite nontangential limit. This approach is based on studying a matrix version of the Christoffel-Darboux kernel and the realization that bulk universality for this kernel at a point is equivalent to the fact that the corresponding m-function has normal limits at the same point. Our approach automatically applies to other self-adjoint systems with $2\times 2$ transfer matrices such as continuum Schr\"odinger and Dirac operators. We also obtain analogous results for orthogonal polynomials on the unit circle.


title: Antiproton-deuteron hydrogenic states in optical models

abstract: By solving the Faddeev equations for the \={p}pn system, we compute the antiproton-deuteron level shifts and widths for the lowest hydrogenic states as well as the corresponding \={p}d scattering lengths and volumes. The \={p}d annihilation densities are obtained and compared to the nuclear density of deuterium. The validity of the Trueman relation for composite particles is studied. The strong part of \={N}N interaction is described by two different optical models, including the \={p}p-\={n}n coupling and n-p mass difference, while for NN several realistic interactions are used.


title: Structural properties of nuclei with semi-magic number N(Z)=40

abstract: Various ground state properties are explored for full isotonic(isotopic) chain of neutron number N(proton number Z)$=$40 using different families of Relativistic Mean-Field theory. Several properties such as nucleon separation energies, pairing energies, deformation, radii and nucleon density distributions are evaluated and compared with the experimental data as well as those from other microscopic and macroscopic models. N$=$40 isotonic chain presents ample of support for the neutron magicity and articulates double magicity in recently discovered $^{60}$Ca and $^{68}$Ni. Our results are in close conformity with recently measured value of charge radius of $^{68}$Ni [S. Kaufmann \textit{et al.}, Phys. Rev. Lett. 124, 132502 (2020)] which supports the N$=$40 magicity. Contrarily, Zr isotopes (Z$=$40) display variety of shapes leading to the phenomenon of shape transitions and shape co-existence. The role of 3s$_{1/2}$ state, which leads to central depletion if unoccupied, is also investigated. $^{56}_{16}$S and $^{122}_{40}$Zr are found to be doubly bubble nuclei.


title: An Interpretable Music Similarity Measure Based on Path Interestingness

abstract: We introduce a novel and interpretable path-based music similarity measure. Our similarity measure assumes that items, such as songs and artists, and information about those items are represented in a knowledge graph. We find paths in the graph between a seed and a target item; we score those paths based on their interestingness; and we aggregate those scores to determine the similarity between the seed and the target. A distinguishing feature of our similarity measure is its interpretability. In particular, we can translate the most interesting paths into natural language, so that the causes of the similarity judgements can be readily understood by humans. We compare the accuracy of our similarity measure with other competitive path-based similarity baselines in two experimental settings and with four datasets. The results highlight the validity of our approach to music similarity, and demonstrate that path interestingness scores can be the basis of an accurate and interpretable similarity measure.


title: Reducing Linear Hadwiger's Conjecture to Coloring Small Graphs

abstract: In 1943, Hadwiger conjectured that every graph with no $K_t$ minor is $(t-1)$-colorable for every $t\ge 1$. In the 1980s, Kostochka and Thomason independently proved that every graph with no $K_t$ minor has average degree $O(t\sqrt{\log t})$ and hence is $O(t\sqrt{\log t})$-colorable. Recently, Norin, Song and the second author showed that every graph with no $K_t$ minor is $O(t(\log t)^{\beta})$-colorable for every $\beta > 1/4$, making the first improvement on the order of magnitude of the $O(t\sqrt{\log t})$ bound. The first main result of this paper is that every graph with no $K_t$ minor is $O(t\log\log t)$-colorable. This is a corollary of our main technical result that the chromatic number of a $K_t$-minor-free graph is bounded by $O(t(1+f(G,t)))$ where $f(G,t)$ is the maximum of $\frac{\chi(H)}{a}$ over all $a\ge \frac{t}{\sqrt{\log t}}$ and $K_a$-minor-free subgraphs $H$ of $G$ that are small (i.e. $O(a\log^4 a)$ vertices). This has a number of interesting corollaries. First as mentioned, using the current best-known bounds on coloring small $K_t$-minor-free graphs, we show that $K_t$-minor-free graphs are $O(t\log\log t)$-colorable. Second, it shows that proving Linear Hadwiger's Conjecture (that $K_t$-minor-free graphs are $O(t)$-colorable) reduces to proving it for small graphs. Third, we prove that $K_t$-minor-free graphs with clique number at most $\sqrt{\log t}/ (\log \log t)^2$ are $O(t)$-colorable. This implies our final corollary that Linear Hadwiger's Conjecture holds for $K_r$-free graphs for every fixed $r$. One key to proving the main theorem is a new standalone result that every $K_t$-minor-free graph of average degree $d=\Omega(t)$ has a subgraph on $O(t \log^3 t)$ vertices with average degree $\Omega(d)$.


title: Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation

abstract: In this paper, we tackle the detection of out-of-distribution (OOD) objects in semantic segmentation. By analyzing the literature, we found that current methods are either accurate or fast but not both which limits their usability in real world applications. To get the best of both aspects, we propose to mitigate the common shortcomings by following four design principles: decoupling the OOD detection from the segmentation task, observing the entire segmentation network instead of just its output, generating training data for the OOD detector by leveraging blind spots in the segmentation network and focusing the generated data on localized regions in the image to simulate OOD objects. Our main contribution is a new OOD detection architecture called ObsNet associated with a dedicated training scheme based on Local Adversarial Attacks (LAA). We validate the soundness of our approach across numerous ablation studies. We also show it obtains top performances both in speed and accuracy when compared to ten recent methods of the literature on three different datasets.


title: Isomeric Ratio of the $^{181}\rm{Ta}(\gamma,3n)^{178m,g}\rm{Ta}$ Reaction Products at Energy $E_{\rm{\gamma max}}$ up to 95 MeV

abstract: The photoneutron reaction $^{181}\rm{Ta}(\gamma,3n)^{178m,g}\rm{Ta}$ was investigated with the beam from the NSC KIPT electron linear accelerator LUE-40. The measurements were performed using the residual $\gamma$-activity method. The bremsstrahlung flux-averaged cross-sections $\langle{\sigma(E_{\rm{\gamma max}})}\rangle$, $\langle{\sigma(E_{\rm{\gamma max}})}\rangle_{\rm{m}}$, $\langle{\sigma(E_{\rm{\gamma max}})}\rangle_{\rm{g}}$ and the isomeric ratio of the reaction products $d(E_{\rm{\gamma max}})$ have been measured. Theoretical values of averaged cross-sections and isomeric ratio were calculated using partial cross-sections from the TALYS1.95 code for different level density models $LD$ 1-6. The obtained experimental $d(E_{\rm{\gamma max}})$ agree with the literature data, but differ from the theoretical values in absolute magnitude and the behavior of the energy dependence. A comparison of the found averaged cross-sections with the calculated ones showed the best agreement for the case of the $LD$ 5 model.


title: On the martensitic transformation in Fe$_{x}$Mn$_{80-x}$Co$_{10}$Cr$_{10}$ high-entropy alloy

abstract: High-entropy alloys (HEAs), and even medium-entropy alloys (MEAs), are an intriguing class of materials in that structure and property relations can be controlled via alloying and chemical disorder over wide ranges in the composition space. Employing density-functional theory combined with the coherent-potential approximation to average over all chemical configurations, we tune free energies between face-centered-cubic (fcc) and hexagonal-close-packed (hcp) phases in Fe$_{x}$Mn$_{80-x}$Co$_{10}$Cr$_{10}$ systems.~Within Fe-Mn-based alloys, we show that the martensitic transformation and chemical short-range order directly correlate with the fcc-hcp energy difference and stacking-fault energies, which are in quantitative agreement with recent experiments on a $x$=40~at.\% polycrystalline HEA/MEA. Our predictions are further confirmed by single-crystal measurements on a$x$=40at.\% using transmission-electron microscopy, selective-area diffraction, and electron-backscattered-diffraction mapping. The results herein offer an understanding of transformation-induced/twinning-induced plasticity (TRIP/TWIP) in this class of HEAs and a design guide for controlling the physics behind the TRIP effect at the electronic level.


title: A Unifying Framework to Construct QC-LDPC Tanner Graphs of Desired Girth

abstract: This paper presents a unifying framework to construct low-density parity-check (LDPC) codes with associated Tanner graphs of desired girth. Towards this goal, we highlight the role that a certain square matrix that appears in the product of the parity-check matrix with its transpose has in the construction of codes with graphs of desired girth and further explore it in order to generate the set of necessary and sufficient conditions for a Tanner graph to have a given girth between 6 and 12. For each such girth, we present algorithms to construct codes of the desired girth and we show how to use them to compute the minimum necessary value of the lifting factor. For girth larger than 12, we show how to use multi-step graph lifting methods to deterministically modify codes in order to increase their girth. We also give a new perspective on LDPC protograph-based parity-check matrices by viewing them as rows of a parity-check matrix equal to the sum of certain permutation matrices and obtain an important connection between all protographs and those with variable nodes of degree 2. We also show that the results and methodology that we develop for the all-one protograph can be used and adapted to analyze the girth of the Tanner graph of any parity-check matrix and demonstrate how this can be done using a well-known irregular, multi-edge protograph specified by the NASA Consultative Committee for Space Data Systems (CCSDS). Throughout the paper, we exemplify our theoretical results with constructions of LDPC codes with Tanner graphs of any girth between 6 and 14 and give sufficient conditions for a multi-step lifted parity-check matrix to have girth between 14 and 22.


title: Bishop-Phelps-Bollob\'as property for positive operators when the domain is $C_0(L) $

abstract: Recently it was introduced the so-called Bishop-Phelps-Bollob{\'a}s property for positive operators between Banach lattices. In this paper we prove that the pair $(C_0(L), Y) $ has the Bishop-Phelps--Bollob{\'a}s property for positive operators, for any locally compact Hausdorff topological space $L$, whenever $Y$ is a uniformly monotone Banach lattice with a weak unit. In case that the space $C_0(L)$ is separable, the same statement holds for any uniformly monotone Banach lattice $Y .$ We also show the following partial converse of the main result. In case that $Y$ is a strictly monotone Banach lattice, $L$ is a locally compact Hausdorff topological space that contains at least two elements and the pair $(C_0(L), Y )$ has the Bishop-Phelps--Bollob{\'a}s property for positive operators then $Y$ is uniformly monotone.


title: $ \infty $-category and some applications on orbifolds

abstract: This paper is mainly about an early result that the orbifold stack is globally representable via some $ \infty $-categorical techniques.


title: Automatic classification of eclipsing binary stars using deep learning methods

abstract: In the last couple of decades, tremendous progress has been achieved in developing robotic telescopes and, as a result, sky surveys (both terrestrial and space) have become the source of a substantial amount of new observational data. These data contain a lot of information about binary stars, hidden in their light curves. With the huge amount of astronomical data gathered, it is not reasonable to expect all the data to be manually processed and analyzed. Therefore, in this paper, we focus on the automatic classification of eclipsing binary stars using deep learning methods. Our classifier provides a tool for the categorization of light curves of binary stars into two classes: detached and over-contact. We used the ELISa software to obtain synthetic data, which we then used for the training of the classifier. For evaluation purposes, we collected 100 light curves of observed binary stars, in order to evaluate a number of classifiers. We evaluated semi-detached eclipsing binary stars as detached. The best-performing classifier combines bidirectional Long Short-Term Memory (LSTM) and a one-dimensional convolutional neural network, which achieved 98% accuracy on the evaluation set. Omitting semi-detached eclipsing binary stars, we could obtain 100% accuracy in classification.


title: Observations of the Bright Star in the Globular Cluster 47 Tucanae (NGC 104)

abstract: The Bright Star in the globular cluster 47 Tucanae (NGC 104) is a post-AGB star of spectral type B8 III. The ultraviolet spectra of late-B stars exhibit a myriad of absorption features, many due to species unobservable from the ground. The Bright Star thus represents a unique window into the chemistry of 47 Tuc. We have analyzed observations obtained with the Far Ultraviolet Spectroscopic Explorer (FUSE), the Cosmic Origins Spectrograph (COS) aboard the Hubble Space Telescope, and the MIKE Spectrograph on the Magellan Telescope. By fitting these data with synthetic spectra, we determine various stellar parameters (T_eff = 10,850 +/- 250 K, log g = 2.20 +/- 0.13) and the photospheric abundances of 26 elements, including Ne, P, Cl, Ga, Pd, In, Sn, Hg, and Pb, which have not previously been published for this cluster. Abundances of intermediate-mass elements (Mg through Ga) generally scale with Fe, while the heaviest elements (Pd through Pb) have roughly solar abundances. Its low C/O ratio indicates that the star did not undergo third dredge-up and suggests that its heavy elements were made by a previous generation of stars. If so, this pattern should be present throughout the cluster, not just in this star. Stellar-evolution models suggest that the Bright Star is powered by a He-burning shell, having left the AGB during or immediately after a thermal pulse. Its mass (0.54 +/- 0.16 M_sun) implies that single stars in 47 Tuc lose 0.1--0.2 M_sun on the AGB, only slightly less than they lose on the RGB.


title: Separating topological recurrence from measurable recurrence: exposition and extension of Kriz's example

abstract: We prove that for every infinite set $E\subset \mathbb Z$, there is a set $S\subset E-E$ which is a set of topological recurrence and not a set of measurable recurrence. This extends a result of Igor Kriz, proving that there is a set of topological recurrence which is not a set of measurable recurrence. Our construction follows Kriz's closely, and this paper can be considered an exposition of the original argument.


title: Progressive Transmission using Recurrent Neural Networks

abstract: In this paper, we investigate a new machine learning-based transmission strategy called progressive transmission or ProgTr. In ProgTr, there are b variables that should be transmitted using at most T channel uses. The transmitter aims to send the data to the receiver as fast as possible and with as few channel uses as possible (as channel conditions permit) while the receiver refines its estimate after each channel use. We use recurrent neural networks as the building block of both the transmitter and receiver where the SNR is provided as an input that represents the channel conditions. To show how ProgTr works, the proposed scheme was simulated in different scenarios including single/multi-user settings, different channel conditions, and for both discrete and continuous input data. The results show that ProgTr can achieve better performance compared to conventional modulation methods. In addition to performance metrics such as BER, bit-wise mutual information is used to provide some interpretation to how the transmitter and receiver operate in ProgTr.


title: The Devil is in the GAN: Backdoor Attacks and Defenses in Deep Generative Models

abstract: Deep Generative Models (DGMs) are a popular class of deep learning models which find widespread use because of their ability to synthesize data from complex, high-dimensional manifolds. However, even with their increasing industrial adoption, they haven't been subject to rigorous security and privacy analysis. In this work we examine one such aspect, namely backdoor attacks on DGMs which can significantly limit the applicability of pre-trained models within a model supply chain and at the very least cause massive reputation damage for companies outsourcing DGMs form third parties. While similar attacks scenarios have been studied in the context of classical prediction models, their manifestation in DGMs hasn't received the same attention. To this end we propose novel training-time attacks which result in corrupted DGMs that synthesize regular data under normal operations and designated target outputs for inputs sampled from a trigger distribution. These attacks are based on an adversarial loss function that combines the dual objectives of attack stealth and fidelity. We systematically analyze these attacks, and show their effectiveness for a variety of approaches like Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), as well as different data domains including images and audio. Our experiments show that - even for large-scale industry-grade DGMs (like StyleGAN) - our attacks can be mounted with only modest computational effort. We also motivate suitable defenses based on static/dynamic model and output inspections, demonstrate their usefulness, and prescribe a practical and comprehensive defense strategy that paves the way for safe usage of DGMs.


title: mmWave Simultaneous Localization and Mapping Using a Computationally Efficient EK-PHD Filter

abstract: Future cellular networks that utilize millimeter wave signals provide new opportunities in positioning and situational awareness. Large bandwidths combined with large antenna arrays provide unparalleled delay and angle resolution, allowing high accuracy localization but also building up a map of the environment. Even the most basic filter intended for simultaneous localization and mapping exhibits high computational overhead since the methods rely on sigma point or particle-based approximations. In this paper, a first order Taylor series based Gaussian approximation of the filtering distribution is used and it is demonstrated that the developed extended Kalman probability hypothesis density filter is computationally very efficient. In addition, the results imply that efficiency does not come with the expense of estimation accuracy since the method nearly achieves the position error bound.


title: Fault-tolerant operation of a logical qubit in a diamond quantum processor

abstract: Solid-state spin qubits are a promising platform for quantum computation and quantum networks. Recent experiments have demonstrated high-quality control over multi-qubit systems, elementary quantum algorithms and non-fault-tolerant error correction. Large-scale systems will require using error-corrected logical qubits that are operated fault-tolerantly, so that reliable computation is possible despite noisy operations. Overcoming imperfections in this way remains a major outstanding challenge for quantum science. Here, we demonstrate fault-tolerant operations on a logical qubit using spin qubits in diamond. Our approach is based on the 5-qubit code with a recently discovered flag protocol that enables fault-tolerance using a total of seven qubits. We encode the logical qubit using a novel protocol based on repeated multi-qubit measurements and show that it outperforms non-fault-tolerant encoding schemes. We then fault-tolerantly manipulate the logical qubit through a complete set of single-qubit Clifford gates. Finally, we demonstrate flagged stabilizer measurements with real-time processing of the outcomes. Such measurements are a primitive for fault-tolerant quantum error correction. While future improvements in fidelity and the number of qubits will be required, our realization of fault-tolerant protocols on the logical-qubit level is a key step towards large-scale quantum information processing based on solid-state spins.


title: Bootstrapping Fermionic Rational CFTs with Three Characters

abstract: Recently, the modular linear differential equation (MLDE) for level-two congruence subgroups $\Gamma_\theta, \Gamma^{0}(2)$ and $\Gamma_0(2)$ of $\text{SL}_2(\mathbb{Z})$ was developed and used to classify the fermionic rational conformal field theories (RCFT). Two character solutions of the second-order fermionic MLDE without poles were found and their corresponding CFTs are identified. Here we extend this analysis to explore the landscape of three character fermionic RCFTs obtained from the third-order fermionic MLDE without poles. Especially, we focus on a class of the fermionic RCFTs whose Neveu-Schwarz sector vacuum character has no free-fermion currents and Ramond sector saturates the bound $h^{\text{R}} \ge \frac{c}{24}$, which is the unitarity bound for the supersymmetric case. Most of the solutions can be mapped to characters of the fermionized WZW models. We find the pairs of fermionic CFTs whose characters can be combined to produce $K(\tau)$, the character of the $c=12$ fermionic CFT for $\text{Co}_0$ sporadic group.


title: Laboratory model of electrovortex flow with thermal gradients, for liquid metal batteries

abstract: We present a novel laboratory setup for studying the fluid dynamics in liquid metal batteries (LMBs). LMBs are a promising technology suited for grid-scale energy storage, but flows remain a confounding factor in determining their viability. Two important drivers of flow are thermal gradients, caused by internal heating during operation, and electrovortex flow (EVF), induced by diverging current densities. Our setup explores thermal gradients and electrovortex flow separately and in combination in a cylindrical layer of liquid gallium, simulating the behavior in a single layer of an LMB. In this work, we discuss the design principles underlying our choices of materials, thermal control, and current control. We also detail our diagnostic tools - thermocouple measurements for temperature and Ultrasonic Doppler Velocimetry (UDV) probes for velocities - and the design principles which go into choosing their placement on the setup. We also include a discussion of our post-processing tools for quantifying and visualizing the flow. Finally, we validate convection and EVF in our setup: we show that scaling relationships between the nondimensional parameters produced by our data agree well with theory and previous studies.


title: Classical observables from coherent-spin amplitudes

abstract: The quantum field-theoretic approach to classical observables due to Kosower, Maybee and O'Connell provides a rigorous pathway from on-shell scattering amplitudes to classical perturbation theory. In this paper, we promote this formalism to describe general classical spinning objects by using coherent spin states. Our approach is fully covariant with respect to the massive little group ${\rm SU}(2)$ and is therefore completely synergistic with the massive spinor-helicity formalism. We apply this approach to classical two-body scattering due gravitational interaction. Starting from the coherent-spin elastic-scattering amplitude, we derive the classical impulse and spin kick observables to first post-Minkowskian order but to all orders in the angular momenta of the massive spinning objects. From the same amplitude, we also extract an effective two-body Hamiltonian, which can be used beyond the scattering setting. As a cross-check, we rederive the classical observables in the center-of-mass frame by integrating the Hamiltonian equations of motion to the leading order in Newton's constant.


title: Application of Hardy inequalities for some singular parabolic equations

abstract: Boundary value problems for non-linear parabolic equations with singular potentials are considered. Existence and non-existence results as an application of different Hardy inequalities are proved. Blow-up conditions are investigated too.


title: An Impossibility Result on Strong Linearizability in Message-Passing Systems

abstract: We prove that in asynchronous message-passing systems where at most one process may crash, there is no lock-free strongly linearizable implementation of a weak object that we call Test-or-Set (ToS). This object allows a single distinguished process to apply the set operation once, and a different distinguished process to apply the test operation also once. Since this weak object can be directly implemented by a single-writer single-reader (SWSR) register (and other common objects such as max-register, snapshot and counter), this result implies that there is no $1$-resilient lock-free strongly linearizable implementation of a SWSR register (and of these other objects) in message-passing systems. We also prove that there is no $1$-resilient lock-free \emph{write} strongly-linearizable implementation of a 2-writer 1-reader (2W1R) register in asynchronous message-passing systems.


title: Realization of arbitrary doubly-controlled quantum phase gates

abstract: Developing quantum computers for real-world applications requires understanding theoretical sources of quantum advantage and applying those insights to design more powerful machines. Toward that end, we introduce a high-fidelity gate set inspired by a proposal for near-term quantum advantage in optimization problems. By orchestrating coherent, multi-level control over three transmon qutrits, we synthesize a family of deterministic, continuous-angle quantum phase gates acting in the natural three-qubit computational basis (CCPHASE$(\theta)$). We estimate the process fidelity for this scheme via Cycle Benchmarking of $\mathcal{F}=87.1\pm0.8\%$, higher than reference two-qubit gate decompositions. CCPHASE$(\theta)$ is anticipated to have broad experimental implications, and we report a blueprint demonstration for solving a class of binary constraint satisfaction problems whose construction is consistent with a path to quantum advantage.


title: Computation of Gravitational Particle Production Using Adiabatic Invariants

abstract: Analytic and numerical techniques are presented for computing gravitational production of scalar particles in the limit that the inflaton mass is much larger than the Hubble expansion rate at the end of inflation. These techniques rely upon adiabatic invariants and time modeling of a typical inflaton field which has slow and fast time variation components. A faster computation time for numerical integration is achieved via subtraction of slowly varying components that are ultimately exponentially suppressed. The fast oscillatory remnant results in production of scalar particles with a mass larger than the inflationary Hubble expansion rate through a mechanism analogous to perturbative particle scattering. An improved effective Boltzmann collision equation description of this particle production mechanism is developed. This model allows computation of the spectrum using only adiabatic invariants, avoiding the need to explicitly solve the inflaton equations of motion.


title: Comparison of modern open-source visual SLAM approaches

abstract: SLAM is one of the most fundamental areas of research in robotics and computer vision. State of the art solutions has advanced significantly in terms of accuracy and stability. Unfortunately, not all the approaches are available as open-source solutions and free to use. The results of some of them are difficult to reproduce, and there is a lack of comparison on common datasets. In our work, we make a comparative analysis of state of the art open-source methods. We assess the algorithms based on accuracy, computational performance, robustness, and fault tolerance. Moreover, we present a comparison of datasets as well as an analysis of algorithms from a practical point of view. The findings of the work raise several crucial questions for SLAM researchers.


title: Spontaneous symmetry breaking in a coherently driven nanophotonic Bose-Hubbard dimer

abstract: We report on the first experimental observation of spontaneous mirror symmetry breaking (SSB) in coherently driven-dissipative coupled optical cavities. SSB is observed as the breaking of the spatial or mirror Z2 symmetry between two symmetrically pumped and evanescently coupled photonic crystal nanocavities, and manifests itself as random intensity localization in one of the two cavities. We show that, in a system featuring repulsive boson interactions (U > 0), the observation of a pure pitchfork bifurcation requires negative photon hopping energies (J < 0), which we have realized in our photonic crystal molecule. SSB is observed over a wide range of the two-dimensional parameter space of driving intensity and detuning, where we also find a region that exhibits bistable symmetric behavior. Our results pave the way for the experimental study of limit cycles and deterministic chaos arising from SSB, as well as the study of nonclassical photon correlations close to SSB transitions.


title: Open Set Wireless Standard Classification Using Convolutional Neural Networks

abstract: In congested electromagnetic environments, cognitive radios require knowledge about other emitters in order to optimize their dynamic spectrum access strategy. Deep learning classification algorithms have been used to recognize the wireless signal standards of emitters with high accuracy, but are limited to classifying signal classes that appear in their training set. This diminishes the performance of deep learning classifiers deployed in the field because they cannot accurately identify signals from classes outside of the training set. In this paper, a convolution neural network based open set classifier is proposed with the ability to detect if signals are not from known classes by thresholding the output sigmoid activation. The open set classifier was trained on 4G LTE, 5G NR, IEEE 802.11ax, Bluetooth Low Energy 5.0, and Narrowband Internet-of-Things signals impaired with Rayleigh or Rician fading, AWGN, frequency offsets, and in-phase/quadrature imbalances. Then, the classifier was tested on OFDM, SC-FDMA, SC, AM, and FM signals, which did not appear in the training set classes. The closed set classifier achieves an average accuracy of 94.5% for known signals with SNR's greater than 0 dB, but by design, has a 0% accuracy detecting signals from unknown classes. On the other hand, the open set classifier retains an 86% accuracy for known signal classes, but can detect 95.5% of signals from unknown classes with SNR's greater than 0 dB.


title: A Heterogeneous Schelling Model for Wealth Disparity and its Effect on Segregation

abstract: The Schelling model of segregation was introduced in economics to show how micro-motives can influence macro-behavior. Agents on a lattice have two colors and try to move to a different location if the number of their neighbors with a different color exceeds some threshold. Simulations reveal that even such mild local color preferences, or homophily, are sufficient to cause segregation. In this work, we propose a stochastic generalization of the Schelling model, based on both race and wealth, to understand how carefully architected placement of incentives, such as urban infrastructure, might affect segregation. In our model, each agent is assigned one of two colors along with a label, rich or poor. Further, we designate certain vertices on the lattice as "urban sites," providing civic infrastructure that most benefits the poorer population, thus incentivizing the occupation of such vertices by poor agents of either color. We look at the stationary distribution of a Markov process reflecting these preferences to understand the long-term effects. We prove that when incentives are large enough, we will have "urbanization of poverty," an observed effect whereby poor people tend to congregate on urban sites. Moreover, even when homophily preferences are very small, if the incentives are large and there is income inequality in the two-color classes, we can get racial segregation on urban sites but integration on non-urban sites. In contrast, we find overall mitigation of segregation when the urban sites are distributed throughout the lattice and the incentives for urban sites exceed the homophily biases. We prove that in this case, no matter how strong homophily preferences are, it will be exponentially unlikely that a configuration chosen from stationarity will have large, homogeneous clusters of agents of either color, suggesting we will have racial integration with high probability.


title: Brane quantization of toric Poisson varieties

abstract: In this paper we propose a noncommutative generalization of the relationship between compact K\"ahler manifolds and complex projective algebraic varieties. Beginning with a prequantized K\"ahler structure, we use a holomorphic Poisson tensor to deform the underlying complex structure into a generalized complex structure, such that the prequantum line bundle and its tensor powers deform to a sequence of generalized complex branes. Taking homomorphisms between the resulting branes, we obtain a noncommutative deformation of the homogeneous coordinate ring. As a proof of concept, this is implemented for all compact toric K\"ahler manifolds equipped with an R-matrix holomorphic Poisson structure, resulting in what could be called noncommutative toric varieties. To define the homomorphisms between generalized complex branes, we propose a method which involves lifting each pair of generalized complex branes to a single coisotropic A-brane in the real symplectic groupoid of the underlying Poisson structure, and compute morphisms in the A-model between the Lagrangian identity bisection and the lifted coisotropic brane. This is done with the use of a multiplicative holomorphic Lagrangian polarization of the groupoid.


title: Image Augmentation Using a Task Guided Generative Adversarial Network for Age Estimation on Brain MRI

abstract: Brain age estimation based on magnetic resonance imaging (MRI) is an active research area in early diagnosis of some neurodegenerative diseases (e.g. Alzheimer, Parkinson, Huntington, etc.) for elderly people or brain underdevelopment for the young group. Deep learning methods have achieved the state-of-the-art performance in many medical image analysis tasks, including brain age estimation. However, the performance and generalisability of the deep learning model are highly dependent on the quantity and quality of the training data set. Both collecting and annotating brain MRI data are extremely time-consuming. In this paper, to overcome the data scarcity problem, we propose a generative adversarial network (GAN) based image synthesis method. Different from the existing GAN-based methods, we integrate a task-guided branch (a regression model for age estimation) to the end of the generator in GAN. By adding a task-guided loss to the conventional GAN loss, the learned low-dimensional latent space and the synthesised images are more task-specific. It helps to boost the performance of the down-stream task by combining the synthesised images and real images for model training. The proposed method was evaluated on a public brain MRI data set for age estimation. Our proposed method outperformed (statistically significant) a deep convolutional neural network based regression model and the GAN-based image synthesis method without the task-guided branch. More importantly, it enables the identification of age-related brain regions in the image space. The code is available on GitHub (https://github.com/ruizhe-l/tgb-gan).


title: Graph Neural Networks With Lifting-based Adaptive Graph Wavelets

abstract: Spectral-based graph neural networks (SGNNs) have been attracting increasing attention in graph representation learning. However, existing SGNNs are limited in implementing graph filters with rigid transforms (e.g., graph Fourier or predefined graph wavelet transforms) and cannot adapt to signals residing on graphs and tasks at hand. In this paper, we propose a novel class of graph neural networks that realizes graph filters with adaptive graph wavelets. Specifically, the adaptive graph wavelets are learned with neural network-parameterized lifting structures, where structure-aware attention-based lifting operations (i.e., prediction and update operations) are developed to jointly consider graph structures and node features. We propose to lift based on diffusion wavelets to alleviate the structural information loss induced by partitioning non-bipartite graphs. By design, the locality and sparsity of the resulting wavelet transform as well as the scalability of the lifting structure are guaranteed. We further derive a soft-thresholding filtering operation by learning sparse graph representations in terms of the learned wavelets, yielding a localized, efficient, and scalable wavelet-based graph filters. To ensure that the learned graph representations are invariant to node permutations, a layer is employed at the input of the networks to reorder the nodes according to their local topology information. We evaluate the proposed networks in both node-level and graph-level representation learning tasks on benchmark citation and bioinformatics graph datasets. Extensive experiments demonstrate the superiority of the proposed networks over existing SGNNs in terms of accuracy, efficiency, and scalability.


title: Grounding Representation Similarity with Statistical Testing

abstract: To understand neural network behavior, recent works quantitatively compare different networks' learned representations using canonical correlation analysis (CCA), centered kernel alignment (CKA), and other dissimilarity measures. Unfortunately, these widely used measures often disagree on fundamental observations, such as whether deep networks differing only in random initialization learn similar representations. These disagreements raise the question: which, if any, of these dissimilarity measures should we believe? We provide a framework to ground this question through a concrete test: measures should have sensitivity to changes that affect functional behavior, and specificity against changes that do not. We quantify this through a variety of functional behaviors including probing accuracy and robustness to distribution shift, and examine changes such as varying random initialization and deleting principal components. We find that current metrics exhibit different weaknesses, note that a classical baseline performs surprisingly well, and highlight settings where all metrics appear to fail, thus providing a challenge set for further improvement.


title: Uniform Sampling over Episode Difficulty

abstract: Episodic training is a core ingredient of few-shot learning to train models on tasks with limited labelled data. Despite its success, episodic training remains largely understudied, prompting us to ask the question: what is the best way to sample episodes? In this paper, we first propose a method to approximate episode sampling distributions based on their difficulty. Building on this method, we perform an extensive analysis and find that sampling uniformly over episode difficulty outperforms other sampling schemes, including curriculum and easy-/hard-mining. As the proposed sampling method is algorithm agnostic, we can leverage these insights to improve few-shot learning accuracies across many episodic training algorithms. We demonstrate the efficacy of our method across popular few-shot learning datasets, algorithms, network architectures, and protocols.


title: Optimal multifrequency weighting for CMB lensing

abstract: Extragalactic foregrounds in Cosmic Microwave Background (CMB) temperature maps lead to significant biases in CMB lensing reconstruction if not properly accounted for. Combinations of multi-frequency data have been used to minimize the overall map variance (internal linear combination, or ILC), or specifically null a given foreground, but these are not tailored to CMB lensing. In this paper, we derive an optimal multi-frequency combination to jointly minimize CMB lensing noise and bias. We focus on the standard lensing quadratic estimator, as well as the "shear-only" and source-hardened estimators, whose responses to foregrounds differ. We show that an optimal multi-frequency combination is a compromise between the ILC and joint deprojection, which nulls the thermal Sunyaev-Zel'dovich (tSZ) and Cosmic Infrared Background (CIB) contributions. In particular, for a Simons Observatory-like experiment with $\ell_{\text{max},T}=3000$, we find that profile hardening alone (with the standard ILC) reduces the bias to the lensing power amplitude by $40\%$, at a $20\%$ cost in noise, while the bias to the cross-correlation with a LSST-like sample is reduced by nearly an order of magnitude at a $10\%$ noise cost, relative to the standard quadratic estimator. With a small amount of joint deprojection the bias to the profile hardened estimator can be further reduced to less than half the statistical uncertainty on the respective amplitudes, at a $20\%$ and $5\%$ noise cost for the auto- and cross-correlation respectively, relative to the profile hardened estimator with the standard ILC weights. Finally, we explore possible improvements with more aggressive masking and varying $\ell_{\text{max,}T}$.


title: Phonon spectrum of Pr$_2$Zr$_2$O$_7$ and Pr$_2$Ir$_2$O$_7$ as an evidence of coupling of the lattice with electronic and magnetic degrees of freedom

abstract: Magnetic materials with pyrochlore crystal structure form exotic magnetic states due to the high lattice frustration. In this work we follow the effects of coupling of the lattice and electronic and magnetic degrees of freedom in two Praseodymium-based pyrochlores Pr$_2$Zr$_2$O$_7$ and Pr$_2$Ir$_2$O$_7$. In both materials the presence of magnetic interactions does not lead to magnetically ordered low temperature states, however their electronic properties are different. A comparison of Raman phonon spectra of Pr$_2$Zr$_2$O$_7$ and Pr$_2$Ir$_2$O$_7$ allows us to identify magneto-elastic coupling in Pr$_2$Zr$_2$O$_7$ that elucidates its magnetic properties at intermediate temperatures, and allows us to characterize phonon-electron coupling in the semimetallic Pr$_2$Ir$_2$O$_7$. We also show that the effects of random disorder on the Raman phonon spectra is small.


title: Efficient Neural Network Approximation of Robust PCA for Automated Analysis of Calcium Imaging Data

abstract: Calcium imaging is an essential tool to study the activity of neuronal populations. However, the high level of background fluorescence in images hinders the accurate identification of neurons and the extraction of neuronal activities. While robust principal component analysis (RPCA) is a promising method that can decompose the foreground and background in such images, its computational complexity and memory requirement are prohibitively high to process large-scale calcium imaging data. Here, we propose BEAR, a simple bilinear neural network for the efficient approximation of RPCA which achieves an order of magnitude speed improvement with GPU acceleration compared to the conventional RPCA algorithms. In addition, we show that BEAR can perform foreground-background separation of calcium imaging data as large as tens of gigabytes. We also demonstrate that two BEARs can be cascaded to perform simultaneous RPCA and non-negative matrix factorization for the automated extraction of spatial and temporal footprints from calcium imaging data. The source code used in the paper is available at https://github.com/NICALab/BEAR.


title: Complementary Fourier single-pixel imaging

abstract: Single-pixel imaging, with the advantages of a wide spectrum, beyond-visual-field imaging, and robustness to light scattering, has attracted increasing attention in recent years. Fourier single-pixel imaging (FSI) can reconstruct sharp images under sub-Nyquist sampling. However, the conventional FSI has difficulty with balancing the imaging quality and efficiency. To overcome this issue, we proposed a novel approach called complementary Fourier single-pixel imaging (CFSI) to reduce measurements while retaining its robustness. The complementary nature of Fourier patterns based on a four-step phase-shift algorithm is combined with the complementary nature of a digital micromirror device. CFSI only requires two phase-shifted patterns to obtain one Fourier spectral value. Four light intensity values are obtained by load the two patterns, and the spectral value is calculated through differential measurement, which has good robustness to noise. The proposed method is verified by simulations and experiments compared with FSI based on two-, three-, and four-step phase shift algorithms. CFSI performed better than the other methods under the condition that the best imaging quality of CFSI is not reached. The reported technique provides an alternative approach to realize real-time and high-quality imaging.


title: Optimization of retina-like illumination patterns in ghost imaging

abstract: Ghost imaging (GI) reconstructs images using a single-pixel or bucket detector, which has the advantages of scattering robustness, wide spectrum and beyond-visual-field imaging. However, this technique needs large amount of measurements to obtain a sharp image. There have been a lot of methods proposed to overcome this disadvantage. Retina-like patterns, as one of the compressive sensing approaches, enhance the imaging quality of region of interest (ROI) while not increase measurements. The design of the retina-like patterns determines the performance of the ROI in the reconstructed image. Unlike the conventional method to fill in ROI with random patterns, we propose to optimize retina-like patterns by filling in the ROI with the patterns containing the sparsity prior of objects. This proposed method is verified by simulations and experiments compared with conventional GI, retina-like GI and GI using patterns optimized by principal component analysis. The method using optimized retina-like patterns obtain the best imaging quality in ROI than other methods. Meanwhile, the good generalization ability of the optimized retina-like pattern is also verified. While designing the size and position of the ROI of retina-like pattern, the feature information of the target can be obtained to optimize the pattern of ROI. This proposed method paves the way for realizing high-quality GI.