title: Sludge for Good: Slowing and Imposing Costs on Cyber Attackers

abstract: Choice architecture describes the design by which choices are presented to people. Nudges are an aspect intended to make "good" outcomes easy, such as using password meters to encourage strong passwords. Sludge, on the contrary, is friction that raises the transaction cost and is often seen as a negative to users. Turning this concept around, we propose applying sludge for positive cybersecurity outcomes by using it offensively to consume attackers' time and other resources. To date, most cyber defenses have been designed to be optimally strong and effective and prohibit or eliminate attackers as quickly as possible. Our complimentary approach is to also deploy defenses that seek to maximize the consumption of the attackers' time and other resources while causing as little damage as possible to the victim. This is consistent with zero trust and similar mindsets which assume breach. The Sludge Strategy introduces cost-imposing cyber defense by strategically deploying friction for attackers before, during, and after an attack using deception and authentic design features. We present the characteristics of effective sludge, and show a continuum from light to heavy sludge. We describe the quantitative and qualitative costs to attackers and offer practical considerations for deploying sludge in practice. Finally, we examine real-world examples of U.S. government operations to frustrate and impose cost on cyber adversaries.


title: The structure of the density-potential mapping. Part I: Standard density-functional theory

abstract: The Hohenberg-Kohn theorem of density-functional theory (DFT) is broadly considered the conceptual basis for a full characterization of an electronic system in its ground state by just the one-body particle density. Part I of this review aims at clarifying the status of the Hohenberg-Kohn theorem within DFT and Part II at different extensions of the theory that include magnetic fields. We collect evidence that the Hohenberg-Kohn theorem does not so much form the basis of DFT, but is rather the consequence of a more comprehensive mathematical framework. Such results are especially useful when it comes to the construction of generalized DFTs.


title: A consistent volume-of-fluid approach for direct numerical simulation of the aerodynamic breakup of a vaporizing drop

abstract: A novel simulation framework has been developed in this study for the direct numerical simulation of the aerodynamic breakup of a vaporizing drop. The interfacial multiphase flow with phase change is resolved using a consistent geometric volume-of-fluid method. The bulk fluids are viscous and incompressible with surface tension at the interface. The newly-developed numerical methods have been implemented in the Basilisk solver, in which the adaptive octree/quadtree mesh is used for spatial discretization, allowing flexibility in dynamically refining the mesh in a user-defined region. The simulation framework is extensively validated by a series of benchmark cases, including the 1D Stefan and sucking problems, the growth of a 3D spherical bubble in a superheated liquid, and a 2D film boiling problem. The simulation results agree very well with the exact solution and previous numerical studies. 2D axisymmetric simulations were performed to resolve the vaporization of a moving drop with a low Weber number in a high-temperature free stream. The computed rate of volume loss agrees well with the empirical model of drop evaporation. Finally, the validated solver is used to simulate the aerodynamic breakup of an acetone drop at a high Weber number. A fully 3D simulation is performed and the morphological evolution of the drop is accurately resolved. The rate of vaporization is found to be significantly enhanced due to the drop deformation and breakup. The drop volume decreases nonlinearly in time and at a much higher rate than the empirical correlation for a spherical drop.


title: Understanding Complex Patterns in Social, Geographic, and Economic Inequities in COVID-19 Mortality at the County Level in the US Using Generalized Additive Models

abstract: I present three types of applications of generalized additive models (GAMs) to COVID-19 mortality rates in the US for the purpose of advancing methods to document inequities with respect to which communities suffered disproportionate COVID-19 mortality rates at specific times during the first three years of the pandemic. First, GAMs can be used to describe the changing relationship between COVID-19 mortality and county-level covariates (sociodemographic, economic, and political metrics) over time. Second, GAMs can be used to perform spatiotemporal smoothing that pools information over time and space to address statistical instability due to small population counts or stochasticity resulting in a smooth, dynamic latent risk surface summarizing the mortality risk associated with geographic locations over time. Third, estimation of COVID-19 mortality associations with county-level covariates conditional on a smooth spatiotemporal risk surface allows for more rigorous consideration of how socio-environmental contexts and policies may have impacted COVID-19 mortality. Each of these approaches provides a valuable perspective to documenting inequities in COVID-19 mortality by addressing the question of which populations have suffered the worst burden of COVID-19 mortality taking into account the nonlinear spatial, temporal, and social patterning of disease.


title: DINER: Depth-aware Image-based NEural Radiance fields

abstract: We present Depth-aware Image-based NEural Radiance fields (DINER). Given a sparse set of RGB input views, we predict depth and feature maps to guide the reconstruction of a volumetric scene representation that allows us to render 3D objects under novel views. Specifically, we propose novel techniques to incorporate depth information into feature fusion and efficient scene sampling. In comparison to the previous state of the art, DINER achieves higher synthesis quality and can process input views with greater disparity. This allows us to capture scenes more completely without changing capturing hardware requirements and ultimately enables larger viewpoint changes during novel view synthesis. We evaluate our method by synthesizing novel views, both for human heads and for general objects, and observe significantly improved qualitative results and increased perceptual metrics compared to the previous state of the art. The code is publicly available for research purposes.


title: Every Node Counts: Improving the Training of Graph Neural Networks on Node Classification

abstract: Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for only a fraction of the nodes. Typically, the optimization process, through the objective function, considers only labelled nodes while ignoring the rest. In this paper, we propose novel objective terms for the training of GNNs for node classification, aiming to exploit all the available data and improve accuracy. Our first term seeks to maximize the mutual information between node and label features, considering both labelled and unlabelled nodes in the optimization process. Our second term promotes anisotropic smoothness in the prediction maps. Lastly, we propose a cross-validating gradients approach to enhance the learning from labelled data. Our proposed objectives are general and can be applied to various GNNs and require no architectural modifications. Extensive experiments demonstrate our approach using popular GNNs like GCN, GAT and GCNII, reading a consistent and significant accuracy improvement on 10 real-world node classification datasets.


title: Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics

abstract: Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most occasions, only slide-level labels are available, and only a tiny region of the WSI is disease-positive area. However, WSI representation learning still remains an open problem due to: (1) patch sampling on a higher resolution may be incapable of depicting microenvironment information such as the relative position between the tumor cells and surrounding tissues, while patches at lower resolution lose the fine-grained detail; (2) extracting patches from giant WSI results in large bag size, which tremendously increases the computational cost. To solve the problems, this paper proposes a hierarchical-based multimodal transformer framework that learns a hierarchical mapping between pathology images and corresponding genes. Precisely, we randomly extract instant-level patch features from WSIs with different magnification. Then a co-attention mapping between imaging and genomics is learned to uncover the pairwise interaction and reduce the space complexity of imaging features. Such early fusion makes it computationally feasible to use MIL Transformer for the survival prediction task. Our architecture requires fewer GPU resources compared with benchmark methods while maintaining better WSI representation ability. We evaluate our approach on five cancer types from the Cancer Genome Atlas database and achieved an average c-index of $0.673$, outperforming the state-of-the-art multimodality methods.


title: Collaborative learning model predictive control for repetitive tasks

abstract: This paper presents a cloud-based learning model predictive controller that integrates three interacting components: a set of agents, which must learn to perform a finite set of tasks with the minimum possible local cost; a coordinator, which assigns the tasks to the agents; and the cloud, which stores data to facilitate the agents' learning. The tasks consist in traveling repeatedly between a set of target states while satisfying input and state constraints. In turn, the state constraints may change in time for each of the possible tasks. To deal with it, different modes of operation, which establish different restrictions, are defined. The agents' inputs are found by solving local model predictive control (MPC) problems where the terminal set and cost are defined from previous trajectories. The data collected by each agent is uploaded to the cloud and made accessible to all their peers. Likewise, similarity between tasks is exploited to accelerate the learning process. The applicability of the proposed approach is illustrated by simulation results.


title: SPARTAN: Sparse Hierarchical Memory for Parameter-Efficient Transformers

abstract: Fine-tuning pre-trained language models (PLMs) achieves impressive performance on a range of downstream tasks, and their sizes have consequently been getting bigger. Since a different copy of the model is required for each task, this paradigm is infeasible for storage-constrained edge devices like mobile phones. In this paper, we propose SPARTAN, a parameter efficient (PE) and computationally fast architecture for edge devices that adds hierarchically organized sparse memory after each Transformer layer. SPARTAN freezes the PLM parameters and fine-tunes only its memory, thus significantly reducing storage costs by re-using the PLM backbone for different tasks. SPARTAN contains two levels of memory, with only a sparse subset of parents being chosen in the first level for each input, and children cells corresponding to those parents being used to compute an output representation. This sparsity combined with other architecture optimizations improves SPARTAN's throughput by over 90% during inference on a Raspberry Pi 4 when compared to PE baselines (adapters) while also outperforming the latter by 0.1 points on the GLUE benchmark. Further, it can be trained 34% faster in a few-shot setting, while performing within 0.9 points of adapters. Qualitative analysis shows that different parent cells in SPARTAN specialize in different topics, thus dividing responsibility efficiently.


title: SPICE PSF Correction: General Framework and Capability Demonstration

abstract: We present a new method of removing PSF artifacts and improving the resolution of multidimensional data sources including imagers and spectrographs. Rather than deconvolution, which is translationally invariant, this method is based on sparse matrix solvers. This allows it to be applied to spatially varying PSFs and also to combining observations from instruments with radically different spatial, spectral, or thermal response functions (e.g., SDO/AIA and RHESSI). It was developed to correct PSF artifacts in Solar Orbiter SPICE, so the motivation, presentation of the method, and the results revolve around that application. However, it can also be used as a more robust (e.g., WRT a varying PSFs) alternative to deconvolution of 2D image data and similar problems, and is relevant to more general linear inversion problems.


title: Iterative Scene Graph Generation with Generative Transformers

abstract: Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering, captioning, and even object detection, to name a few. Current approaches take a generation-by-classification approach where the scene graph is generated through labeling of all possible edges between objects in a scene, which adds computational overhead to the approach. This work introduces a generative transformer-based approach to generating scene graphs beyond link prediction. Using two transformer-based components, we first sample a possible scene graph structure from detected objects and their visual features. We then perform predicate classification on the sampled edges to generate the final scene graph. This approach allows us to efficiently generate scene graphs from images with minimal inference overhead. Extensive experiments on the Visual Genome dataset demonstrate the efficiency of the proposed approach. Without bells and whistles, we obtain, on average, 20.7% mean recall (mR@100) across different settings for scene graph generation (SGG), outperforming state-of-the-art SGG approaches while offering competitive performance to unbiased SGG approaches.


title: Correlation inequalities for linear extensions

abstract: We employ the combinatorial atlas technology to prove new correlation inequalities for the number of linear extensions of finite posets. These include the approximate independence of probabilities and expectations of values of random linear extensions, closely related to Stanley's inequality. We also give applications to the numbers of standard Young tableaux and to Euler numbers.


title: On the dynamics of mortality and the ephemeral nature of mammalian megafauna

abstract: Energy flow through consumer-resource interactions is largely determined by body size. Allometric relationships govern the dynamics of populations by impacting rates of reproduction, as well as alternative sources of mortality, which have differential impacts on smaller to larger organisms. Here we derive and investigate the timescales associated with four alternative sources of mortality for terrestrial mammals: mortality from starvation, mortality associated with aging, mortality from consumption by predators, and mortality introduced by anthropogenic subsidized harvest. The incorporation of these allometric relationships into a minimal consumer-resource model illuminates central constraints that may contribute to the structure of mammalian communities. Our framework reveals that while starvation largely impacts smaller-bodied species, the allometry of senescence is expected to be more difficult to observe. In contrast, external predation and subsidized harvest have greater impacts on the populations of larger-bodied species. Moreover, the inclusion of predation mortality reveals mass thresholds for mammalian herbivores, where dynamic instabilities may limit the feasibility of megafaunal populations. We show how these thresholds vary with alternative predator-prey mass relationships, which are not well understood within terrestrial systems. Finally, we use our framework to predict the harvest pressure required to induce mass-specific extinctions, which closely align with previous estimates of anthropogenic megafaunal exploitation in both paleontological and historical contexts. Together our results underscore the tenuous nature of megafaunal populations, and how different sources of mortality may contribute to their ephemeral nature over evolutionary time.


title: A groupoid approach to transitive differential geometry

abstract: This work is a spin-off of an on-going programme which aims at revisiting the original studies of Lie and Cartan on pseudogroups and geometric structures from a modern perspective. We encode geometric structures induced by transitive Lie pseudogroups into principal $G$-bundles equipped with a transversally parallelisable foliation generated by a subalgebra of $\mathfrak{g}$, called Cartan bundles. Our approach is complementary to arXiv:1911.13147 and is based on Morita equivalence of Lie groupoids. After identifying the main examples and properties, we develop a notion of flatness with respect to a Lie algebra, which encompasses the classical integrability of $G$-structures, the flatness of Cartan geometries, as well as the integrability of contact structures.


title: Unitary Howe dualities for fermionic and bosonic algebras and related Dirac operators

abstract: In this paper we use the canonical complex structure $\mathbb{J}$ on $\mathbb{R}^{2n}$ to introduce a twist of the symplectic Dirac operator. As a matter of fact, these operators can be interpreted as the bosonic analogues of the Dirac operators on a Hermitian manifold. Moreover, we prove that the algebra of these symplectic Dirac operators is isomorphic to the Lie algebra $\mathfrak{su}(1,2)$ which leads to the Howe dual pair $(\mathsf{U}(n),\mathfrak{su}(1,2))$.


title: Predicting China's CPI by Scanner Big Data

abstract: Scanner big data has potential to construct Consumer Price Index (CPI). This work utilizes the scanner data of supermarket retail sales, which are provided by China Ant Business Alliance (CAA), to construct the Scanner-data Food Consumer Price Index (S-FCPI) in China, and the index reliability is verified by other macro indicators, especially by China's CPI. And not only that, we build multiple machine learning models based on S-FCPI to quantitatively predict the CPI growth rate in months, and qualitatively predict those directions and levels. The prediction models achieve much better performance than the traditional time series models in existing research. This work paves the way to construct and predict price indexes through using scanner big data in China. S-FCPI can not only reflect the changes of goods prices in higher frequency and wider geographic dimension than CPI, but also provide a new perspective for monitoring macroeconomic operation, predicting inflation and understanding other economic issues, which is beneficial supplement to China's CPI.


title: Persistent Cup Product Structures and Related Invariants

abstract: One-dimensional persistent homology is arguably the most important and heavily used computational tool in topological data analysis. Additional information can be extracted from datasets by studying multi-dimensional persistence modules and by utilizing cohomological ideas, e.g.~the cohomological cup product. In this work, given a single parameter filtration, we investigate a certain 2-dimensional persistence module structure associated with persistent cohomology, where one parameter is the cup-length $\ell\geq0$ and the other is the filtration parameter. This new persistence structure, called the persistent cup module, is induced by the cohomological cup product and adapted to the persistence setting. Furthermore, we show that this persistence structure is stable. By fixing the cup-length parameter $\ell$, we obtain a 1-dimensional persistence module, called the persistent $\ell$-cup module, and again show it is stable in the interleaving distance sense, and study their associated generalized persistence diagrams. In addition, we consider a generalized notion of a persistent invariant, which extends both the rank invariant (also referred to as persistent Betti number), Puuska's rank invariant induced by epi-mono-preserving invariants of abelian categories, and the recently-defined persistent cup-length invariant, and we establish their stability. This generalized notion of persistent invariant also enables us to lift the Lyusternik-Schnirelmann (LS) category of topological spaces to a novel stable persistent invariant of filtrations, called the persistent LS-category invariant.


title: Security Issuance, Institutional Investors and Quid Pro Quo

abstract: Security issuance through intermediaries is subject to informational and agency-related frictions. However, separating their effects on securities has been difficult. We estimate those effects separately using SPAC data. To that end, we identify "premium" investors who produce value-relevant information. Their participation is associated with lower liquidation risk and higher returns. In contrast, "non-premium" investors engage only in quid pro quo arrangements. They receive high returns from an intermediary (quid) for participating in weaker future deals initiated by that intermediary (quo). Thus, quid pro quo is not pure agency cost; it includes transfers enabling more firms to go public.


title: Black Hole Horizon Edge Partition Functions

abstract: We extend a formula for 1-loop black hole determinants by Denef, Hartnoll, and Sachdev (DHS) to spinning fields on any $(d+1)$-dimensional static spherically symmetric black hole. By carefully analyzing the regularity condition imposed on the Euclidean eigenfunctions, we reveal an unambiguous bulk-edge split in the 1-loop Euclidean partition function for tensor fields of arbitrary integer spin: the bulk part captures the "renormalized" thermal canonical partition function recently discussed in arXiv:2207.07024; the edge part is related to quasinormal modes (QNMs) that fail to analytically continue to a subset of Euclidean modes with enhanced fall-offs near the origin. Since the edge part takes the form of a path integral on $S^{d-1}$, this suggests that these are associated with degrees of freedom living on the bifurcation surface in the Lorentzian two-sided black hole geometry. For massive higher spin on static BTZ and massive vector on Nariai black holes, we find that the edge partition function is related to the QNMs with lowest overtone numbers.


title: Asymmetric Dependence Measurement and Testing

abstract: Measuring the (causal) direction and strength of dependence between two variables (events), Xi and Xj , is fundamental for all science. Our survey of decades-long literature on statistical dependence reveals that most assume symmetry in the sense that the strength of dependence of Xi on Xj exactly equals the strength of dependence of Xj on Xi. However, we show that such symmetry is often untrue in many real-world examples, being neither necessary nor sufficient. Vinod's (2014) asymmetric matrix R* in [-1, 1] of generalized correlation coefficients provides intuitively appealing, readily interpretable, and superior measures of dependence. This paper proposes statistical inference for R* using Taraldsen's (2021) exact sampling distribution of correlation coefficients and the bootstrap. When the direction is known, proposed asymmetric (one-tail) tests have greater power.


title: Progressive Knowledge Transfer Based on Human Visual Perception Mechanism for Perceptual Quality Assessment of Point Clouds

abstract: With the wide applications of colored point cloud in many fields, point cloud perceptual quality assessment plays a vital role in the visual communication systems owing to the existence of quality degradations introduced in various stages. However, the existing point cloud quality assessments ignore the mechanism of human visual system (HVS) which has an important impact on the accuracy of the perceptual quality assessment. In this paper, a progressive knowledge transfer based on human visual perception mechanism for perceptual quality assessment of point clouds (PKT-PCQA) is proposed. The PKT-PCQA merges local features from neighboring regions and global features extracted from graph spectrum. Taking into account the HVS properties, the spatial and channel attention mechanism is also considered in PKT-PCQA. Besides, inspired by the hierarchical perception system of human brains, PKT-PCQA adopts a progressive knowledge transfer to convert the coarse-grained quality classification knowledge to the fine-grained quality prediction task. Experiments on three large and independent point cloud assessment datasets show that the proposed no reference PKT-PCQA network achieves better of equivalent performance comparing with the state-of-the-art full reference quality assessment methods, outperforming the existed no reference quality assessment network.


title: Ultrafast learning of 4-node hybridization cycles in phylogenetic networks using algebraic invariants

abstract: Motivation: The abundance of gene flow in the Tree of Life challenges the notion that evolution can be represented with a fully bifurcating process, as this process cannot capture important biological realities like hybridization, introgression, or horizontal gene transfer. Coalescent-based network methods are increasingly popular, yet not scalable for big data, because they need to perform a heuristic search in the space of networks as well as numerical optimization that can be NP-hard. Results: Here, we introduce a novel method to reconstruct phylogenetic networks based on algebraic invariants. While there is a long tradition of using algebraic invariants in phylogenetics, our work is the first to define phylogenetic invariants on concordance factors (frequencies of 4-taxon splits in the input gene trees) to identify level-1 phylogenetic networks under the multispecies coalescent model. Our novel inference methodology is optimization-free as it only requires the evaluation of polynomial equations, and as such, it bypasses the traversal of network space, yielding a computational speed at least 10 times faster than the fastest-to-date network methods. We illustrate the accuracy and speed of our new method on a variety of simulated scenarios as well as in the estimation of a phylogenetic network for the genus Canis. Availability and Implementation: We implement our novel theory on an open-source publicly available Julia package PhyloDiamond.jl available at https://github.com/solislemuslab/PhyloDiamond.jl with broad applicability within the evolutionary biology community. Contact: solislemus@wisc.edu


title: COMET: A Comprehensive Cluster Design Methodology for Distributed Deep Learning Training

abstract: Modern Deep Learning (DL) models have grown to sizes requiring massive clusters of specialized, high-end nodes to train. Designing such clusters to maximize both performance and utilization--to amortize their steep cost--is a challenging task requiring careful balance of compute, memory, and network resources. Moreover, a plethora of each model's tuning knobs drastically affect the performance, with optimal values often depending on the underlying cluster's characteristics, which necessitates a complex cluster-workload co-design process. To facilitate the design space exploration of such massive DL training clusters, we introduce COMET, a holistic cluster design methodology and workflow to jointly study the impact of parallelization strategies and key cluster resource provisioning on the performance of distributed DL training. We develop a step-by-step process to establish a reusable and flexible methodology, and demonstrate its application with case studies of training large models on cluster configurations of variable compute, memory, and network resources. Our case studies demonstrate COMET's utility in identifying promising architectural optimization directions and guiding system designers in configuring key model and cluster parameters. To illustrate, cluster configuration comparisons identify performance differences of up to 7.7x and highlight performance optimization opportunities of up to 1.4x when employing memory expansion as an optimization technique.


title: CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation

abstract: Household environments are visually diverse. Embodied agents performing Vision-and-Language Navigation (VLN) in the wild must be able to handle this diversity, while also following arbitrary language instructions. Recently, Vision-Language models like CLIP have shown great performance on the task of zero-shot object recognition. In this work, we ask if these models are also capable of zero-shot language grounding. In particular, we utilize CLIP to tackle the novel problem of zero-shot VLN using natural language referring expressions that describe target objects, in contrast to past work that used simple language templates describing object classes. We examine CLIP's capability in making sequential navigational decisions without any dataset-specific finetuning, and study how it influences the path that an agent takes. Our results on the coarse-grained instruction following task of REVERIE demonstrate the navigational capability of CLIP, surpassing the supervised baseline in terms of both success rate (SR) and success weighted by path length (SPL). More importantly, we quantitatively show that our CLIP-based zero-shot approach generalizes better to show consistent performance across environments when compared to SOTA, fully supervised learning approaches when evaluated via Relative Change in Success (RCS).


title: The H$\alpha$ and [O III] $\lambda 5007$ Luminosity Functions of $1.2<z<1.9$ Emission-Line Galaxies from HST Grism Spectroscopy

abstract: Euclid and the Roman Space Telescope (Roman) will soon use grism spectroscopy to detect millions of galaxies via H$\alpha$ and [O III] $\lambda 5007$ emission. To better constrain the expected galaxy counts from these instruments, we use a vetted sample of 4,239 emission-line galaxies from the 3D-HST survey to measure the H$\alpha$ and [O III] $\lambda 5007$ luminosity functions between $1.16<z<1.90$; this sample is $\sim 4$ times larger than previous studies at this redshift. We find very good agreement with previous measurements for H$\alpha$, but for [O III], we predict a higher number of intermediate-luminosity galaxies than previous works. We find that for both lines, the characteristic luminosity, $\mathcal{L}_*$, increases monotonically with redshift, and use the H$\alpha$ luminosity function to calculate the epoch's cosmic star formation rate density. We find that H$\alpha$-visible galaxies account for $\sim 81\%$ of the epoch's total star formation rate, and this value changes very little over the $1.16<z<1.56$ redshift range. Finally, we derive the surface density of galaxies as a function of limiting flux and find that previous predictions for galaxy counts for the Euclid Wide Survey are unchanged, but there may be more [O III] galaxies in the Roman High Latitude Survey than previously estimated.


title: Supercurrent-induced Anomalous Thermal Hall Effect as a New Probe to Superconducting Gap Anisotropy

abstract: Two-dimensional superconductors have been realized in various atomically thin films such as the twisted bilayer graphene, some of which are anticipated to involve unconventional pairing mechanism. Due to their low dimensionality, experimental probes of the exact nature of superconductivity in these systems have been limited. We propose, by applying a \emph{vertical} supercurrent to a bilayer superconductor where the mirror symmetry is naturally broken by the twisting, there will be anomalous thermal Hall effect induced by the supercurrent that can serve as a sharp probe for the \emph{in-plane} anisotropy of the superconducting gap function. This effect occurs in the \emph{absence} of an external magnetic field and spontaneous breaking of the time-reversal symmetry in the ground state. We derive explicit formulas for the induced thermal Hall conductivity and show them to be significant in the examples of twisted cuprates and twisted FeSe where monolayer superconductivity have already been observed. Though technical challenges still exist, we propose this to be a generic probe of the gap anisotropy in a twisted bilayer superconductor.


title: Canards in a bottleneck

abstract: In this paper we investigate the stationary profiles of a nonlinear Fokker-Planck equation with small diffusion and nonlinear in- and outflow boundary conditions. We consider corridors with a bottleneck whose width has a global nondegenerate minimum in the interior. In the small diffusion limit the profiles are obtained constructively by using methods from geometric singular perturbation theory (GSPT). We identify three main types of profiles corresponding to: (i) high density in the domain and a boundary layer at the entrance, (ii) low density in the domain and a boundary layer at the exit, and (iii) transitions from high density to low density inside the bottleneck with boundary layers at the entrance and exit. Interestingly, solutions of the last type involve canard solutions generated at the narrowest point of the bottleneck. We obtain a detailed bifurcation diagram of these solutions in terms of the in- and outflow rates. The analytic results based on GSPT are further corroborated by computational experiments investigating corridors with bottlenecks of variable width.


title: CRU: A Novel Neural Architecture for Improving the Predictive Performance of Time-Series Data

abstract: The time-series forecasting (TSF) problem is a traditional problem in the field of artificial intelligence. Models such as Recurrent Neural Network (RNN), Long Short Term Memory (LSTM), and GRU (Gate Recurrent Units) have contributed to improving the predictive accuracy of TSF. Furthermore, model structures have been proposed to combine time-series decomposition methods, such as seasonal-trend decomposition using Loess (STL) to ensure improved predictive accuracy. However, because this approach is learned in an independent model for each component, it cannot learn the relationships between time-series components. In this study, we propose a new neural architecture called a correlation recurrent unit (CRU) that can perform time series decomposition within a neural cell and learn correlations (autocorrelation and correlation) between each decomposition component. The proposed neural architecture was evaluated through comparative experiments with previous studies using five univariate time-series datasets and four multivariate time-series data. The results showed that long- and short-term predictive performance was improved by more than 10%. The experimental results show that the proposed CRU is an excellent method for TSF problems compared to other neural architectures.


title: Stochastic Parameterization of Column Physics using Generative Adversarial Networks

abstract: We demonstrate the use of a probabilistic machine learning technique to develop stochastic parameterizations of atmospheric column-physics. After suitable preprocessing of NASA's Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA2) data to minimize the effects of high-frequency, high-wavenumber component of MERRA2 estimate of vertical velocity, we use generative adversarial networks to learn the probability distribution of vertical profiles of diabatic sources conditioned on vertical profiles of temperature and humidity. This may be viewed as an improvement over previous similar but deterministic approaches that seek to alleviate both, shortcomings of human-designed physics parameterizations, and the computational demand of the "physics" step in climate models.


title: High order asymptotic preserving finite difference WENO schemes with constrained transport for MHD equations in all sonic Mach numbers

abstract: In this paper, a high-order semi-implicit (SI) asymptotic preserving (AP) and divergence-free finite difference weighted essentially nonoscillatory (WENO) scheme is proposed for magnetohydrodynamic (MHD) equations. We consider the sonic Mach number $\varepsilon$ ranging from $0$ to $\mathcal{O}(1)$. High-order accuracy in time is obtained by SI implicit-explicit Runge-Kutta (IMEX-RK) time discretization. High-order accuracy in space is achieved by finite difference WENO schemes with characteristic-wise reconstructions. A constrained transport method is applied to maintain a discrete divergence-free condition. We formally prove that the scheme is AP. Asymptotic accuracy (AA) in the incompressible MHD limit is obtained if the implicit part of the SI IMEX-RK scheme is stiffly accurate. Numerical experiments are provided to validate the AP, AA, and divergence-free properties of our proposed approach. Besides, the scheme can well capture discontinuities such as shocks in an essentially non-oscillatory fashion in the compressible regime, while it is also a good incompressible solver with uniform large-time step conditions in the low sonic Mach limit.


title: An Integrated Ride-Matching Model for Shared Mobility on Demand Services

abstract: Shared mobility on demand (MoD) services are receiving increased attention as many high volume ride-hailing companies are offering shared services (e.g. UberPool, LyftLine) at an increasing rate. Also, the advent of autonomous vehicles (AVs) promises further operational opportunities to benefit from these developments as AVs enable a centrally operated and fully connected fleet. There are two fundamental tasks for a shared MoD service: ride-matching and vehicle rebalancing. Traditionally, these two functions are performed sequentially and independently. In this paper, we propose and formulate an integrated ride-matching problem which aims to integrate ride-matching and rebalancing into a single formulation. The integrated problem benefits from interactions between these two tasks. We also propose a methodology to solve the integrated shared ride-matching problem by using supply level information based on a grid representation of the city network. We demonstrate the effectiveness of the proposed methodology through a comparative case study using a benchmark sequential approach and an open source data set. Our results show that the integrated model is able to serve at least the same amount of passengers with significant gains in terms of level of service and sustainability metrics.


title: Task-Driven Hybrid Model Reduction for Dexterous Manipulation

abstract: In contact-rich tasks, like dexterous manipulation, the hybrid nature of making and breaking contact creates challenges for model representation and control. For example, choosing and sequencing contact locations for in-hand manipulation, where there are thousands of potential hybrid modes, is not generally tractable. In this paper, we are inspired by the observation that far fewer modes are actually necessary to accomplish many tasks. Building on our prior work learning hybrid models, represented as linear complementarity systems, we find a reduced-order hybrid model requiring only a limited number of task-relevant modes. This simplified representation, in combination with model predictive control, enables real-time control yet is sufficient for achieving high performance. We demonstrate the proposed method first on synthetic hybrid systems, reducing the mode count by multiple orders of magnitude while achieving task performance loss of less than 5%. We also apply the proposed method to a three-fingered robotic hand manipulating a previously unknown object. With no prior knowledge, we achieve state-of-the-art closed-loop performance within a few minutes of online learning, by collecting only a few thousand environment samples.


title: Quantum light from lossy semiconductor Rydberg excitons

abstract: The emergence of photonic quantum correlations is typically associated with emitters strongly coupled to a photonic mode. Here, we show that semiconductor Rydberg excitons, which are only weakly coupled to a free-space light mode can produce strongly antibunched fields, i.e. quantum light. This effect is fueled by micron-scale excitation blockade between Rydberg excitons inducing pair-wise polariton scattering events. Photons incident on an exciton resonance are scatted into blue- and red-detuned pairs, which enjoy relative protection from absorption and thus dominate the transmitted light. We demonstrate that this effect persists in the presence of additional phonon coupling, strong non-radiative decay and across a wide range of experimental parameters. Our results pave the way for the observation of quantum statistics from weakly coupled semiconductor excitons.


title: Dynamics in the outskirts of four Milky Way globular clusters: it's the tides that dominate

abstract: We present the results of a spectroscopic survey of the outskirts of 4 globular clusters -- NGC 1261, NGC 4590, NGC 1904, and NGC 1851 -- covering targets within 1 degree from the cluster centres, with 2dF/AAOmega on the Anglo-Australian Telescope (AAT) and FLAMES on the Very Large Telescope (VLT). We extracted chemo-dynamical information for individual stars, from which we estimated the velocity dispersion profile and the rotation of each cluster. The observations are compared to direct $N$-body simulations and appropriate {\sc limepy}/{\sc spes} models for each cluster to interpret the results. In NGC 1851, the detected internal rotation agrees with existing literature, and NGC 1261 shows some rotation signal beyond the truncation radius, likely coming from the escaped stars. We find that the dispersion profiles for both the observations and the simulations for NGC 1261, NGC 1851, and NGC 1904 do not decrease as the {\sc limepy}/{\sc spes} models predict beyond the truncation radius, where the $N$-body simulations show that escaped stars dominate; the dispersion profile of NGC 4590 follows the predictions of the {\sc limepy}/{\sc spes} models, though the data do not effectively extend beyond the truncation radius. The increasing/flat dispersion profiles in the outskirts of NGC 1261, NGC 1851 and NGC 1904, are reproduced by the simulations. Hence, the increasing/flat dispersion profiles of the clusters in question can be explained by the tidal interaction with the Galaxy without introducing dark matter.


title: Approximating binary longest common subsequence in almost-linear time

abstract: The Longest Common Subsequence (LCS) is a fundamental string similarity measure, and computing the LCS of two strings is a classic algorithms question. A textbook dynamic programming algorithm gives an exact algorithm in quadratic time, and this is essentially best possible under plausible fine-grained complexity assumptions, so a natural problem is to find faster approximation algorithms. When the inputs are two binary strings, there is a simple $\frac{1}{2}$-approximation in linear time: compute the longest common all-0s or all-1s subsequence. It has been open whether a better approximation is possible even in truly subquadratic time. Rubinstein and Song showed that the answer is yes under the assumption that the two input strings have equal lengths. We settle the question, generalizing their result to unequal length strings, proving that, for any $\varepsilon>0$, there exists $\delta>0$ and a $(\frac{1}{2}+\delta)$-approximation algorithm for binary LCS that runs in $n^{1+\varepsilon}$ time. As a consequence of our result and a result of Akmal and Vassilevska-Williams, for any $\varepsilon>0$, there exists a $(\frac{1}{q}+\delta)$-approximation for LCS over $q$-ary strings in $n^{1+\varepsilon}$ time. Our techniques build on the recent work of Guruswami, He, and Li who proved new bounds for error-correcting codes tolerating deletion errors. They prove a combinatorial "structure lemma" for strings which classifies them according to their oscillation patterns. We prove and use an algorithmic generalization of this structure lemma, which may be of independent interest.


title: Some Comments on Unitary Qubit Lattice Algorithms for Classical Problems

abstract: $\bf{Abstract}$: A qubit lattice algorithm (QLA), which consists of a set of interleaved unitary collision-streaming operators, is developed for electromagnetic wave propagation in tensor dielectric media. External potential operators are required to handle gradients in the refractive indices, and these operators are typically non-unitary. A similar problem arises in the QLA for the Korteweg-de Vries equation, as the potential operator that models the KdV nonlinear term is also non-unitary. Several QLAs are presented here that avoid the need of this non-unitary potential operator by perturbing the collision operator. These QLAs are fully unitary.


title: A Blockchain-based Semantic Exchange Framework for Web 3.0 toward Participatory Economy

abstract: Web 3.0 is the next-generation Internet that enables participants to read, write, and own contents in a decentralized manner. It is mainly driven by blockchain, semantic communication, edge computing, and artificial intelligence, which can construct value networks to achieve participatory economics based on participatory decision making. Web 3.0 can capture the characteristics of blockchain, semantic extraction, and communication to achieve decentralized semantic sharing and transfer information precisely. However, current Web 3.0 solutions focus on the blockchain while overlooking other new technologies' roles in Web 3.0. To further unleash the advantages of semantic extraction and communication in Web 3.0, in this paper, we propose a blockchain-based semantic exchange framework to realize fair and efficient interactions. In this framework, we first attempt to tokenize semantic information into Non-Fungible Token (NFT) for semantic exchange. Then we utilize a Stackelberg game to maximize buying and pricing strategies for semantic trading. We also leverage Zero-Knowledge Proof to share authentic semantic information without publishing it before receiving payments, which can achieve a fair and privacy-preserving trading compared with current NFT marketplaces. A case study about urban planning is given to show clearly the proposed mechanisms. Finally, several challenges and opportunities are identified.


title: Geoclidean: Few-Shot Generalization in Euclidean Geometry

abstract: Euclidean geometry is among the earliest forms of mathematical thinking. While the geometric primitives underlying its constructions, such as perfect lines and circles, do not often occur in the natural world, humans rarely struggle to perceive and reason with them. Will computer vision models trained on natural images show the same sensitivity to Euclidean geometry? Here we explore these questions by studying few-shot generalization in the universe of Euclidean geometry constructions. We introduce Geoclidean, a domain-specific language for Euclidean geometry, and use it to generate two datasets of geometric concept learning tasks for benchmarking generalization judgements of humans and machines. We find that humans are indeed sensitive to Euclidean geometry and generalize strongly from a few visual examples of a geometric concept. In contrast, low-level and high-level visual features from standard computer vision models pretrained on natural images do not support correct generalization. Thus Geoclidean represents a novel few-shot generalization benchmark for geometric concept learning, where the performance of humans and of AI models diverge. The Geoclidean framework and dataset are publicly available for download.


title: Exotic Dehn twists on sums of two contact 3-manifolds

abstract: We exhibit the first examples of exotic contactomorphisms with infinite order as elements of the contact mapping class group. These are given by certain Dehn twists on the separating sphere in a connected sum of two closed contact 3-manifolds. The tools used to detect these combine an invariant for families of contact structures which generalises the Kronheimer-Mrowka contact invariant in monopole Floer homology, together with an h-principle for families of convex spheres in tight contact 3-manifolds. As a further application, we also exhibit some exotic 1-parametric phenomena in overtwisted contact 3-manifolds.


title: 3D fictitious wave domain CSEM inversion by adjoint source estimation

abstract: Marine controlled-source electromagnetic (CSEM) method has proved its potential in detecting highly resistive hydrocarbon bearing formations. A novel frequency domain CSEM inversion approach using fictitious wave domain time stepping modelling is presented. Using Lagrangian-based adjoint state method, the inversion gradient with respect to resistivity can be computed by the product between the forward and adjoint fields. Simulation of the adjoint field using the same modelling engine is challenging as it requires time domain adjoint source time functions while only a few discrete frequencies of the data residual are available for the inversion. A regularized linear inverse problem is formulated in order to estimate a long time series from very few frequency samples. It can then be solved using linear optimization technique, yielding a matrix-free implementation. Instead of computing adjoint source time function one by one at each receiver location, a basis function implementation has been developed such that the inverse problem can be solved only once and reused every time to construct all time-domain adjoint sources. The method allows computing all frequencies of the EM fields in one go without heavy memory and computational overhead, making efficient 3D CSEM inversion feasible. Numerical examples are employed to demonstrate the application of our method.


title: Secrecy Rate Maximization of RIS-assisted SWIPT Systems: A Two-Timescale Beamforming Design Approach

abstract: Reconfigurable intelligent surfaces (RISs) achieve high passive beamforming gains for signal enhancement or interference nulling by dynamically adjusting their reflection coefficients. Their employment is particularly appealing for improving both the wireless security and the efficiency of radio frequency (RF)-based wireless power transfer. Motivated by this, we conceive and investigate a RIS-assisted secure simultaneous wireless information and power transfer (SWIPT) system designed for information and power transfer from a base station (BS) to an information user (IU) and to multiple energy users (EUs), respectively. Moreover, the EUs are also potential eavesdroppers that may overhear the communication between the BS and IU. We adopt two-timescale transmission for reducing the signal processing complexity as well as channel training overhead, and aim for maximizing the average worst-case secrecy rate achieved by the IU. This is achieved by jointly optimizing the short-term transmit beamforming vectors at the BS as well as the long-term phase shifts at the RIS, under the energy harvesting constraints considered at the EUs and the power constraint at the BS. The stochastic optimization problem formulated is non-convex with intricately coupled variables, and is non-smooth due to the existence of multiple EUs/eavesdroppers. No standard optimization approach is available for this challenging scenario. To tackle this challenge, we propose a smooth approximation aided stochastic successive convex approximation (SA-SSCA) algorithm. Furthermore, a low-complexity heuristic algorithm is proposed for reducing the computational complexity without unduly eroding the performance. Simulation results show the efficiency of the RIS in securing SWIPT systems. The significant performance gains achieved by our proposed algorithms over the relevant benchmark schemes are also demonstrated.


title: Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off

abstract: Over-parameterization of deep neural networks (DNNs) has shown high prediction accuracy for many applications. Although effective, the large number of parameters hinders its popularity on resource-limited devices and has an outsize environmental impact. Sparse training (using a fixed number of nonzero weights in each iteration) could significantly mitigate the training costs by reducing the model size. However, existing sparse training methods mainly use either random-based or greedy-based drop-and-grow strategies, resulting in local minimal and low accuracy. In this work, we consider the dynamic sparse training as a sparse connectivity search problem and design an exploitation and exploration acquisition function to escape from local optima and saddle points. We further design an acquisition function and provide the theoretical guarantees for the proposed method and clarify its convergence property. Experimental results show that sparse models (up to 98\% sparsity) obtained by our proposed method outperform the SOTA sparse training methods on a wide variety of deep learning tasks. On VGG-19 / CIFAR-100, ResNet-50 / CIFAR-10, ResNet-50 / CIFAR-100, our method has even higher accuracy than dense models. On ResNet-50 / ImageNet, the proposed method has up to 8.2\% accuracy improvement compared to SOTA sparse training methods.


title: Identities of the Fractional Fourier Transform and the Versor Transform

abstract: We provide an introduction to the Fractional Fourier Transform $\mathcal{F}_{\theta}$ and draw a connection between it and the unit complex number $e^{i\theta}$. Motivated by this, we define an entirely new object associated with any unit quaternion $e^{i\xi_{1}}\cos\eta+e^{i\xi_{2}}j\sin\eta$, which we call the Versor Transform $\mathcal{V}_{(\xi_{1},\eta,\xi_{2})}$. This transform, which has both the Fourier and Laplace Transforms as special cases, encourages an alternate view of the relationship between them. We also derive several identities for both $\mathcal{F}_{\theta}$ and $\mathcal{V}_{(\xi_{1},\eta,\xi_{2})}$.


title: FedGPO: Heterogeneity-Aware Global Parameter Optimization for Efficient Federated Learning

abstract: Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the raw on-device training data with the cloud. However, efficient edge deployment of FL is challenging because of the system/data heterogeneity and runtime variance. This paper optimizes the energy-efficiency of FL use cases while guaranteeing model convergence, by accounting for the aforementioned challenges. We propose FedGPO based on a reinforcement learning, which learns how to identify optimal global parameters (B, E, K) for each FL aggregation round adapting to the system/data heterogeneity and stochastic runtime variance. In our experiments, FedGPO improves the model convergence time by 2.4 times, and achieves 3.6 times higher energy efficiency over the baseline settings, respectively.


title: Regret Pruning for Learning Equilibria in Simulation-Based Games

abstract: In recent years, empirical game-theoretic analysis (EGTA) has emerged as a powerful tool for analyzing games in which an exact specification of the utilities is unavailable. Instead, EGTA assumes access to an oracle, i.e., a simulator, which can generate unbiased noisy samples of players' unknown utilities, given a strategy profile. Utilities can thus be empirically estimated by repeatedly querying the simulator. Recently, various progressive sampling (PS) algorithms have been proposed, which aim to produce PAC-style learning guarantees (e.g., approximate Nash equilibria with high probability) using as few simulator queries as possible. One recent work introduces a pruning technique called regret-pruning which further minimizes the number of simulator queries placed in PS algorithms which aim to learn pure Nash equilibria. In this paper, we address a serious limitation of this original regret pruning approach -- it is only able to guarantee that true pure Nash equilibria of the empirical game are approximate equilibria of the true game, and is unable to provide any strong guarantees regarding the efficacy of approximate pure Nash equilibria. This is a significant limitation since in many games, pure Nash equilibria are computationally intractable to find, or even non-existent. We introduce three novel regret pruning variations. The first two variations generalize the original regret pruning approach to yield guarantees for approximate pure Nash equilibria of the empirical game. The third variation goes further to even yield strong guarantees for all approximate mixed Nash equilibria of the empirical game. We use these regret pruning variations to design two novel progressive sampling algorithms, PS-REG+ and PS-REG-M, which experimentally outperform the previous state-of-the-art algorithms for learning pure and mixed equilibria, respectively, of simulation-based games.


title: Domain Mismatch Doesn't Always Prevent Cross-Lingual Transfer Learning

abstract: Cross-lingual transfer learning without labeled target language data or parallel text has been surprisingly effective in zero-shot cross-lingual classification, question answering, unsupervised machine translation, etc. However, some recent publications have claimed that domain mismatch prevents cross-lingual transfer, and their results show that unsupervised bilingual lexicon induction (UBLI) and unsupervised neural machine translation (UNMT) do not work well when the underlying monolingual corpora come from different domains (e.g., French text from Wikipedia but English text from UN proceedings). In this work, we show that a simple initialization regimen can overcome much of the effect of domain mismatch in cross-lingual transfer. We pre-train word and contextual embeddings on the concatenated domain-mismatched corpora, and use these as initializations for three tasks: MUSE UBLI, UN Parallel UNMT, and the SemEval 2017 cross-lingual word similarity task. In all cases, our results challenge the conclusions of prior work by showing that proper initialization can recover a large portion of the losses incurred by domain mismatch.


title: Double layers in the Earth's bow shock

abstract: We present Magnetospheric Multiscale observations of electrostatic double layers in quasi-perpendicular Earth's bow shock. These double layers have predominantly parallel electric field with amplitudes up to 100 mV/m, spatial widths of 50-700 m, and plasma frame speeds within 100 km/s. The potential drop across a single double layer is 2-7% of the cross-shock potential in the de Hoffmann-Teller frame and occurs over the spatial scale of ten Debye lengths or one tenth of electron inertial length. Some double layers can have spatial width of 70 Debye lengths and potential drop up to 30% of the cross-shock potential. The electron temperature variation observed across double layers is roughly consistent with their potential drop. While electron heating in the Earth's bow shock occurs predominantly due to the quasi-static electric field in the de Hoffmann-Teller frame, these observations show that electron temperature can also increase across Debye-scale electrostatic structures.


title: High order asymptotic preserving well-balanced finite difference WENO schemes for all Mach full Euler equations with gravity

abstract: In this paper, we propose a high order semi-implicit well-balanced finite difference scheme for all Mach Euler equations with a gravitational source term. To obtain the asymptotic preserving property, we start from the conservative form of full compressible Euler equations and add the evolution equation of the perturbation of potential temperature. The resulting system is then split into a (non-stiff) nonlinear low dynamic material wave to be treated explicitly, and (stiff) fast acoustic and gravity waves to be treated implicitly. With the aid of explicit time evolution for the perturbation of potential temperature, we design a novel well-balanced finite difference WENO scheme for the conservative variables, which can be proven to be both asymptotic preserving and asymptotically accurate in the incompressible limit. Extensive numerical experiments were provided to validate these properties.


title: Template bank for compact binary mergers in the fourth observing run of Advanced LIGO, Advanced Virgo, and KAGRA

abstract: Matched-filtering gravitational wave search pipelines identify gravitational wave signals by computing correlations, i.e., signal-to-noise ratios, between gravitational wave detector data and gravitational wave template waveforms. Intrinsic parameters, the component masses and spins, of the gravitational wave waveforms are often stored in "template banks", and the construction of a densely populated template bank is essential for some gravitational wave search pipelines. This paper presents a template bank that is currently being used by the GstLAL-based compact binary search pipeline in the fourth observing run of the LIGO, Virgo, and KAGRA collaboration, and was generated with a new binary tree approach of placing templates, {\fontfamily{qcr}\selectfont manifold}. The template bank contains $1.8 \times 10^6$ sets of template parameters covering plausible neutron star and black hole systems up to a total mass of $400$ $M_\odot$ with component masses between $1$-$200$ $M_\odot$ and mass ratios between $1$ and $20$ under the assumption that each component object's angular momentum is aligned with the orbital angular momentum. We validate the template bank generated with our new method, {\fontfamily{qcr}\selectfont manifold}, by comparing it with a template bank generated with the previously used stochastic template placement method. We show that both template banks have similar effectualness. The {\fontfamily{qcr}\selectfont GstLAL} search pipeline performs singular value decomposition (SVD) on the template banks to reduce the number of filters used. We describe a new grouping of waveforms that improves the computational efficiency of SVD by nearly $5$ times as compared to previously reported SVD sorting schemes.


title: ShaDocNet: Learning Spatial-Aware Tokens in Transformer for Document Shadow Removal

abstract: Shadow removal improves the visual quality and legibility of digital copies of documents. However, document shadow removal remains an unresolved subject. Traditional techniques rely on heuristics that vary from situation to situation. Given the quality and quantity of current public datasets, the majority of neural network models are ill-equipped for this task. In this paper, we propose a Transformer-based model for document shadow removal that utilizes shadow context encoding and decoding in both shadow and shadow-free regions. Additionally, shadow detection and pixel-level enhancement are included in the whole coarse-to-fine process. On the basis of comprehensive benchmark evaluations, it is competitive with state-of-the-art methods.


title: Robust Learning of Nonlinear Dynamical Systems with Safety and Stability Properties

abstract: The paper presents a robust parameter learning methodology for identification of nonlinear dynamical system from data while satisfying safety and stability constraints in the context of learning from demonstration (LfD) methods. Extreme Learning Machines (ELM) is used to approximate the system model, whose parameters are learned subject to the safety and stability constraints obtained using zeroing barrier and Lyapunov-based stability analysis in the presence of model uncertainties and external disturbances. A constrained Quadratic Program (QP) is developed, which accounts for the ELM function reconstruction error, to estimate the ELM parameters. Furthermore, a robustness lemma is presented, which proves that the learned system model guarantees safety and stability in the presence of disturbances. The method is tested in simulations. Trajectory reconstruction accuracy of the method is compared against state-of-the-art LfD methods using swept error area (SEA) metric. Robustness of the learned model is tested by conducting Monte Carlo tests. The proposed method is implemented on a Baxter robot for a pick-and-place task where the robot is constrained to an ellipsoidal safety region.


title: 3D Neural Field Generation using Triplane Diffusion

abstract: Diffusion models have emerged as the state-of-the-art for image generation, among other tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural fields. Our approach pre-processes training data, such as ShapeNet meshes, by converting them to continuous occupancy fields and factoring them into a set of axis-aligned triplane feature representations. Thus, our 3D training scenes are all represented by 2D feature planes, and we can directly train existing 2D diffusion models on these representations to generate 3D neural fields with high quality and diversity, outperforming alternative approaches to 3D-aware generation. Our approach requires essential modifications to existing triplane factorization pipelines to make the resulting features easy to learn for the diffusion model. We demonstrate state-of-the-art results on 3D generation on several object classes from ShapeNet.


title: FREDSR: Fourier Residual Efficient Diffusive GAN for Single Image Super Resolution

abstract: FREDSR is a GAN variant that aims to outperform traditional GAN models in specific tasks such as Single Image Super Resolution with extreme parameter efficiency at the cost of per-dataset generalizeability. FREDSR integrates fast Fourier transformation, residual prediction, diffusive discriminators, etc to achieve strong performance in comparisons to other models on the UHDSR4K dataset for Single Image 3x Super Resolution from 360p and 720p with only 37000 parameters. The model follows the characteristics of the given dataset, resulting in lower generalizeability but higher performance on tasks such as real time up-scaling.


title: Trace the Accretion Geometry of H 1743--322 with Type C Quasi-periodic Oscillations in Multiple Outbursts

abstract: We present a systematic analysis of type C quasi-periodic oscillation (QPO) observations of H 1743--322 throughout the Rossi X-ray Timing Explorer (RXTE) era. We find that, while different outbursts have significant flux differences, they show consistent positive correlations between the QPO fractional root-mean-square (rms) amplitude and non-thermal fraction of the emission, which indicate an independence of the intrinsic QPO rms on individual outburst brightness in H 1743--322. However, the dependence of the QPO rms on frequency is different between the outburst rise and decay phases, where QPO fractional rms of the decay phase is significantly lower than that of the rise phase at low frequencies. The spectral analysis also reveals different ranges of coronal temperature between the two outburst stages. A semi-quantitative analysis shows that the Lense-Thirring precession model could be responsible for the QPO rms differences, requiring a variable coronal geometric shape. However, the variable-Comptonization model could also account for the findings. The fact that the rms differences and the hysteresis traces in the hardness-intensity diagram (HID) accompany each other indicates a connection between the two phenomena. By correlating the findings with QPO phase lags and the quasi-simultaneous radio flux previously published, we propose there could be corona-jet transitions in H 1743--322 similar to those that have been recently reported in GRS 1915+105.


title: A new class of solutions to the van Dantzig problem, the Lee-Yang property, and the Riemann hypothesis

abstract: The purpose of this paper is to carry out an in-depth analysis of the intriguing van Dantzig problem which consists on characterizing the set $\mathbb{D}$ of analytic characteristic functions $\mathcal{F}$ which remains stable by the action of the mapping $V\mathcal{F}(t)=1/\mathcal{F}(it)$, $t\in\mathbb{R}$. % is also a characteristic function. We start by observing that the celebrated Lee-Yang property, appearing in statistical mechanics and quantum field theory, and the Riemann hypothesis can be both rephrased in terms of the van Dantzig problem, and, more specifically, in terms of the set $\mathbb{D}_L \subset \mathbb{D}$ of real-valued characteristic functions that belong to the Laguerre-P\'olya class. Motivated by these facts, we proceed by identifying several non-trivial closure properties of the set $\mathbb{D}$ and $\mathbb{D}_L$. This not only revisits but also, by means of probabilistic techniques, deepens the fascinating studies of the set of even characteristic functions in the Laguerre-P\'olya class carried out by P\'olya, de Bruijn, Lukacs, Newman and more recently by Newman and Wu, among others. We continue by providing a new class of entire functions that belong to the set $\mathbb{D}$ but not necessarily to $\mathbb{D}_L$, offering the first examples outside the set $\mathbb{D}_L$. This class, which is derived from some entire functions introduced by the second author, is in bijection with a subset of continuous negative-definite functions and includes several notable generalized hypergeometric-type functions. Besides identifying the characteristic functions, we also manage to characterize the pair of the corresponding van Dantzig random variables revealing that one of them is infinitely divisible. Finally, we investigate the possibility that the Riemann $\xi$ function belongs to this class.


title: Biomarker-guided heterogeneity analysis of genetic regulations via multivariate sparse fusion

abstract: Heterogeneity is a hallmark of many complex diseases. There are multiple ways of defining heterogeneity, among which the heterogeneity in genetic regulations, for example GEs (gene expressions) by CNVs (copy number variations) and methylation, has been suggested but little investigated. Heterogeneity in genetic regulations can be linked with disease severity, progression, and other traits and is biologically important. However, the analysis can be very challenging with the high dimensionality of both sides of regulation as well as sparse and weak signals. In this article, we consider the scenario where subjects form unknown subgroups, and each subgroup has unique genetic regulation relationships. Further, such heterogeneity is "guided" by a known biomarker. We develop an MSF (Multivariate Sparse Fusion) approach, which innovatively applies the penalized fusion technique to simultaneously determine the number and structure of subgroups and regulation relationships within each subgroup. An effective computational algorithm is developed, and extensive simulations are conducted. The analysis of heterogeneity in the GE-CNV regulations in melanoma and GE-methylation regulations in stomach cancer using the TCGA data leads to interesting findings.


title: Randomized block subsampling Kaczmarz-Motzkin method

abstract: By introducing a subsampling strategy, we propose a randomized block Kaczmarz-Motzkin method for solving linear systems. Such strategy not only determines the block size, but also combines and extends two famous strategies, i.e., randomness and greed, and hence can inherit their advantages. Theoretical analysis shows that the proposed method converges linearly in expectation to the least-Euclidean-norm solution. Several numerical examples are reported to verify the efficiency and feasibility of the new method.


title: Subsampling for tensor least squares: Optimization and statistical perspectives

abstract: In this paper, we investigate the random subsampling method for tensor least squares problem with respect to the popular t-product. From the optimization perspective, we present the error bounds in the sense of probability for the residual and solution obtained by the proposed method. From the statistical perspective, we derive the expressions of the conditional and unconditional expectations and variances for the solution, where the unconditional ones combine the model noises. Moreover, based on the unconditional variance, an optimal subsampling probability distribution is also found. Finally, the feasibility and effectiveness of the proposed method and the correctness of the theoretical results are verified by numerical experiments.


title: Capturing long-range interaction with reciprocal space neural network

abstract: Machine Learning (ML) interatomic models and potentials have been widely employed in simulations of materials. Long-range interactions often dominate in some ionic systems whose dynamics behavior is significantly influenced. However, the long-range effect such as Coulomb and Van der Wales potential is not considered in most ML interatomic potentials. To address this issue, we put forward a method that can take long-range effects into account for most ML local interatomic models with the reciprocal space neural network. The structure information in real space is firstly transformed into reciprocal space and then encoded into a reciprocal space potential or a global descriptor with full atomic interactions. The reciprocal space potential and descriptor keep full invariance of Euclidean symmetry and choice of the cell. Benefiting from the reciprocal-space information, ML interatomic models can be extended to describe the long-range potential including not only Coulomb but any other long-range interaction. A model NaCl system considering Coulomb interaction and the GaxNy system with defects are applied to illustrate the advantage of our approach. At the same time, our approach helps to improve the prediction accuracy of some global properties such as the band gap where the full atomic interaction beyond local atomic environments plays a very important role. In summary, our work has expanded the ability of current ML interatomic models and potentials when dealing with the long-range effect, hence paving a new way for accurate prediction of global properties and large-scale dynamic simulations of systems with defects.

categories: cond-mat.mtrl-sci cs.LG physics.chem-ph physics.comp-ph


title: High-Throughput $\textit{Ab Initio}$ Design of Atomic Interfaces using InterMatch

abstract: Forming a hetero-interface is a materials-design strategy that can access an astronomically large phase space. However, the immense phase space necessitates a high-throughput approach for optimal interface design. Here we introduce a high-throughput computational framework, InterMatch, for efficiently predicting charge transfer, strain, and superlattice structure of an interface by leveraging the databases of individual bulk materials. Specifically, the algorithm reads in the lattice vectors, density of states, and the stiffness tensors for each material in their isolated form from the Materials Project. From these bulk properties, InterMatch estimates the interfacial properties. We benchmark InterMatch predictions for the charge transfer against experimental measurements and supercell density-functional theory calculations. We then use InterMatch to predict promising interface candidates for doping transition metal dichalcogenide MoSe$_2$. Finally, we explain experimental observation of factor of 10 variation in the supercell periodicity within a few microns in graphene/$\alpha$-RuCl$_3$ by exploring low energy superlattice structures as a function of twist angle using InterMatch. We anticipate our open-source InterMatch algorithm accelerating and guiding ever-growing interfacial design efforts. Moreover, the interface database resulting from the InterMatch searches presented in this paper can be readily accessed through https://contribs.materialsproject.org/projects/intermatch/ .


title: All About the Neutron from Lattice QCD

abstract: I describe how simulations of lattice QCD using the path integral formulation provide the two basic quantum mechanical properties of QCD, its ground state in which correlation functions are calculated, and Fock state wavefunctions between which matrix elements of operators are calculated. Both constructs are stochastic, so unfortunately one gets no intuitive picture or even a qualitative understanding of what they look like, nevertheless they contain and display all the subtleties of the quantum field theory. Today, these simulations provide many quantities that are impacting phenomenology and experiments. I illustrate the methods and the steps in the analysis using, as examples, three observables: the isovector charges of the nucleon, the contribution of the quark's intrinsic spin to the nucleon spin, and the pion-nucleon sigma term.


title: Automatic Discovery of Multi-perspective Process Model using Reinforcement Learning

abstract: Process mining is a methodology for the derivation and analysis of process models based on the event log. When process mining is employed to analyze business processes, the process discovery step, the conformance checking step, and the enhancements step are repeated. If a user wants to analyze a process from multiple perspectives (such as activity perspectives, originator perspectives, and time perspectives), the above procedure, inconveniently, has to be repeated over and over again. Although past studies involving process mining have applied detailed stepwise methodologies, no attempt has been made to incorporate and optimize multi-perspective process mining procedures. This paper contributes to developing a solution approach to this problem. First, we propose an automatic discovery framework of a multi-perspective process model based on deep Q-Learning. Our Dual Experience Replay with Experience Distribution (DERED) approach can automatically perform process model discovery steps, conformance check steps, and enhancements steps. Second, we propose a new method that further optimizes the experience replay (ER) method, one of the key algorithms of deep Q-learning, to improve the learning performance of reinforcement learning agents. Finally, we validate our approach using six real-world event datasets collected in port logistics, steel manufacturing, finance, IT, and government administration. We show that our DERED approach can provide users with multi-perspective, high-quality process models that can be employed more conveniently for multi-perspective process mining.


title: Neutron-skin values and matter and neutron radii determined from reaction cross sections of proton scattering on $^{12}$C, $^{40,48}$Ca, $^{58}$Ni, $^{208}$Pb

abstract: Very lately, the PREX and the CREX collaboration present skin values, $r_{\rm skin}^{208}({\rm newPREX2}) =0.278 \pm 0.078\ {\rm (exp)} \pm 0.012\ {\rm (theor.)}\,{\rm fm}$ and $r_{\rm skin}^{48}=0.121 \pm 0.026\ {\rm (exp)} \pm 0.024\ {\rm (model)}$, respectively. We recently determined a neutron-skin value $r_{\rm skin}^{208}=0.278 \pm 0.035$fm from measured reaction cross sections $\sigma_{\rm R}({\rm exp})$ of p+$^{208}$Pb scattering in a range of incident energies $10 \lsim E_{\rm in} \lsim 100$ MeV where the chiral (Kyushu) $g$-matrix folding model is reliable for $^{12}$C+$^{12}$C scattering. The data $\sigma_{\rm R}({\rm exp})$ are available for proton scattering on $^{58}$Ni, $^{40,48}$Ca, $^{12}$C targets. Our first aim is to test the Kyushu $g$-matrix folding model for p+$^{208}$Pb scattering in $20 \lsim E_{\rm in} \lsim 180$ MeV. Our second aim is to determine skin values $r_{\rm skin}$ and matter and neutron radii, $r_{\rm m}$ and $r_{\rm n}$, for $^{208}$Pb, $^{58}$Ni, $^{40,48}$Ca, $^{12}$C from the $\sigma_{\rm R}({\rm exp})$. Our method is the Kyushu $g$-matrix folding model with the densities scaled from the D1S-GHFB+AMP densities, where D1S-GHFB+AMP stands for Gogny-D1S HFB (GHFB) with the angular momentum projection (AMP). As for proton scattering, we find that our model is reliable in $20 \lsim E_{\rm in} \lsim 180$ MeV. For $^{208}$Pb, the skin value deduced from $\sigma_{\rm R}({\rm exp})$ in $20 \lsim E_{\rm in} \lsim 180$ MeV is $r_{\rm skin}^{208}(\sigma_{\rm R})=0.299 \pm 0.020$ fm. Our results on $r_{\rm skin}$ are compared with the previous works. Our result $r_{\rm skin}^{208}(\sigma_{\rm R}) = 0.299 \pm 0.020$ fm agrees with $r_{\rm skin}^{208}({\rm PREX2}) = 0.283\pm 0.071$ fm. In addition, our result $r_{\rm skin}^{48}=0.103 \pm 0.022$ fm is consistent with the CREX value.


title: A Node-collaboration-informed Graph Convolutional Network for Precise Representation to Undirected Weighted Graphs

abstract: An undirected weighted graph (UWG) is frequently adopted to describe the interactions among a solo set of nodes from real applications, such as the user contact frequency from a social network services system. A graph convolutional network (GCN) is widely adopted to perform representation learning to a UWG for subsequent pattern analysis tasks such as clustering or missing data estimation. However, existing GCNs mostly neglects the latent collaborative information hidden in its connected node pairs. To address this issue, this study proposes to model the node collaborations via a symmetric latent factor analysis model, and then regards it as a node-collaboration module for supplementing the collaboration loss in a GCN. Based on this idea, a Node-collaboration-informed Graph Convolutional Network (NGCN) is proposed with three-fold ideas: a) Learning latent collaborative information from the interaction of node pairs via a node-collaboration module; b) Building the residual connection and weighted representation propagation to obtain high representation capacity; and c) Implementing the model optimization in an end-to-end fashion to achieve precise representation to the target UWG. Empirical studies on UWGs emerging from real applications demonstrate that owing to its efficient incorporation of node-collaborations, the proposed NGCN significantly outperforms state-of-the-art GCNs in addressing the task of missing weight estimation. Meanwhile, its good scalability ensures its compatibility with more advanced GCN extensions, which will be further investigated in our future studies.


title: Electronic Origin of Half-metal to Semiconductor Transition and Colossal Magnetoresistance in Spinel HgCr2Se4

abstract: Half-metals are ferromagnets hosting spin-polarized conducting carriers and crucial for spintronics applications. The chromium spinel HgCr2Se4 represents a unique type of half-metal, which features a half-metal to semiconductor transition (HMST) and exhibits colossal magnetoresistance (CMR) across the ferromagnetic-paramagnetic (FM-PM) transition. Using angle-resolved photoemission spectroscopy (ARPES), we find that the Fermi surface of n-type HgCr2Se4 (n-HgCr2Se4) consists of a single electron pocket which moves above the Fermi level (EF) upon the FM-PM transition, leading to the HMST. Such a Lifshitz transition manifests a giant band splitting which originates from the exchange interaction unveiled with a specific chemical nonstoichiometry. The exchange band splitting and the chemical nonstoichiometry are two key ingredients to the HMST and CMR, consistent with our ab-initio calculation. Our findings provide spectroscopic evidences of the electronic origin of the anomalous properties of HgCr2Se4, which address the unique phase transition in half-metals.


title: Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

abstract: Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert knowledge of the system often allows us to design simple rules we expect good policies to follow at all times. In this work, we hence propose a simple yet effective modification of continuous actor-critic frameworks to incorporate such rules and avoid regions of the state-action space that are known to be suboptimal, thereby significantly accelerating the convergence of RL agents. Concretely, we saturate the actions chosen by the agent if they do not comply with our intuition and, critically, modify the gradient update step of the policy to ensure the learning process is not affected by the saturation step. On a room temperature control case study, it allows agents to converge to well-performing policies up to 6-7x faster than classical agents without computational overhead and while retaining good final performance.


title: ACFlow: An open source toolkit for analytical continuation of quantum Monte Carlo data

abstract: The purpose of analytical continuation is to establish a real frequency spectral representation of single-particle or two-particle correlation function (such as Green's function, self-energy function, and dynamical susceptibilities) from noisy data generated in finite temperature quantum Monte Carlo simulations. It requires numerical solutions of a family of Fredholm integral equations of the first kind, which is indeed a challenging task. In this paper, an open source toolkit (dubbed ACFlow) for analytical continuation of quantum Monte Carlo data is presented. We at first give a short introduction to the analytical continuation problem. Next, three primary analytical continuation algorithms, including maximum entropy method, stochastic analytical continuation, and stochastic optimization method, as implemented in this toolkit are reviewed. And then we elaborate major features, implementation details, and basic usage of this toolkit. Finally, four representative examples are shown to demonstrate usefulness and flexibility of the ACFlow toolkit.


title: Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds

abstract: The accurate detection and grasping of transparent objects are challenging but of significance to robots. Here, a visual-tactile fusion framework for transparent object grasping under complex backgrounds and variant light conditions is proposed, including the grasping position detection, tactile calibration, and visual-tactile fusion based classification. First, a multi-scene synthetic grasping dataset generation method with a Gaussian distribution based data annotation is proposed. Besides, a novel grasping network named TGCNN is proposed for grasping position detection, showing good results in both synthetic and real scenes. In tactile calibration, inspired by human grasping, a fully convolutional network based tactile feature extraction method and a central location based adaptive grasping strategy are designed, improving the success rate by 36.7% compared to direct grasping. Furthermore, a visual-tactile fusion method is proposed for transparent objects classification, which improves the classification accuracy by 34%. The proposed framework synergizes the advantages of vision and touch, and greatly improves the grasping efficiency of transparent objects.


title: MSV Challenge 2022: NPU-HC Speaker Verification System for Low-resource Indian Languages

abstract: This report describes the NPU-HC speaker verification system submitted to the O-COCOSDA Multi-lingual Speaker Verification (MSV) Challenge 2022, which focuses on developing speaker verification systems for low-resource Asian languages. We participate in the I-MSV track, which aims to develop speaker verification systems for various Indian languages. In this challenge, we first explore different neural network frameworks for low-resource speaker verification. Then we leverage vanilla fine-tuning and weight transfer fine-tuning to transfer the out-domain pre-trained models to the in-domain Indian dataset. Specifically, the weight transfer fine-tuning aims to constrain the distance of the weights between the pre-trained model and the fine-tuned model, which takes advantage of the previously acquired discriminative ability from the large-scale out-domain datasets and avoids catastrophic forgetting and overfitting at the same time. Finally, score fusion is adopted to further improve performance. Together with the above contributions, we obtain 0.223% EER on the public evaluation set, ranking 2nd place on the leaderboard. On the private evaluation set, the EER of our submitted system is 2.123% and 0.630% for the constrained and unconstrained sub-tasks of the I-MSV track, leading to the 1st and 3rd place in the ranking, respectively.


title: A fully asymptotic preserving decomposed multi-group method for the frequency-dependent radiative transfer equations

abstract: The opacity of FRTE depends on not only the material temperature but also the frequency, whose values may vary several orders of magnitude for different frequencies. The gray radiation diffusion and frequency-dependent diffusion equations are two simplified models that can approximate the solution to FRTE in the thick opacity regime. The frequency discretization for the two limit models highly affects the numerical accuracy. However, classical frequency discretization for FRTE considers only the absorbing coefficient. In this paper, we propose a new decomposed multi-group method for frequency discretization that is not only AP in both gray radiation diffusion and frequency-dependent diffusion limits, but also the frequency discretization of the limiting models can be tuned. Based on the decomposed multi-group method, a full AP scheme in frequency, time, and space is proposed. Several numerical examples are used to verify the performance of the proposed scheme.


title: Automated anomaly-aware 3D segmentation of bones and cartilages in knee MR images from the Osteoarthritis Initiative

abstract: In medical image analysis, automated segmentation of multi-component anatomical structures, which often have a spectrum of potential anomalies and pathologies, is a challenging task. In this work, we develop a multi-step approach using U-Net-based neural networks to initially detect anomalies (bone marrow lesions, bone cysts) in the distal femur, proximal tibia and patella from 3D magnetic resonance (MR) images of the knee in individuals with varying grades of osteoarthritis. Subsequently, the extracted data are used for downstream tasks involving semantic segmentation of individual bone and cartilage volumes as well as bone anomalies. For anomaly detection, the U-Net-based models were developed to reconstruct the bone profiles of the femur and tibia in images via inpainting so anomalous bone regions could be replaced with close to normal appearances. The reconstruction error was used to detect bone anomalies. A second anomaly-aware network, which was compared to anomaly-na\"ive segmentation networks, was used to provide a final automated segmentation of the femoral, tibial and patellar bones and cartilages from the knee MR images containing a spectrum of bone anomalies. The anomaly-aware segmentation approach provided up to 58% reduction in Hausdorff distances for bone segmentations compared to the results from the anomaly-na\"ive segmentation networks. In addition, the anomaly-aware networks were able to detect bone lesions in the MR images with greater sensitivity and specificity (area under the receiver operating characteristic curve [AUC] up to 0.896) compared to the anomaly-na\"ive segmentation networks (AUC up to 0.874).


title: SGDraw: Scene Graph Drawing Interface Using Object-Oriented Representation

abstract: Scene understanding is an essential and challenging task in computer vision. To provide the visually fundamental graphical structure of an image, the scene graph has received increased attention due to its powerful semantic representation. However, it is difficult to draw a proper scene graph for image retrieval, image generation, and multi-modal applications. The conventional scene graph annotation interface is not easy to use in image annotations, and the automatic scene graph generation approaches using deep neural networks are prone to generate redundant content while disregarding details. In this work, we propose SGDraw, a scene graph drawing interface using object-oriented scene graph representation to help users draw and edit scene graphs interactively. For the proposed object-oriented representation, we consider the objects, attributes, and relationships of objects as a structural unit. SGDraw provides a web-based scene graph annotation and generation tool for scene understanding applications. To verify the effectiveness of the proposed interface, we conducted a comparison study with the conventional tool and the user experience study. The results show that SGDraw can help generate scene graphs with richer details and describe the images more accurately than traditional bounding box annotations. We believe the proposed SGDraw can be useful in various vision tasks, such as image retrieval and generation.


title: Malle's conjecture with multiple invariants

abstract: We define invariants $\operatorname{inv}_1,\dots,\operatorname{inv}_m$ of Galois extensions of number fields with a fixed Galois group. Then, we propose a heuristic in the spirit of Malle's conjecture which asymptotically predicts the number of extensions that satisfy $\operatorname{inv}_i\leq X_i$ for all $X_i$. The resulting conjecture is proved for abelian Galois groups. We also describe refined Artin conductors that carry essentially the same information as the invariants $\operatorname{inv}_1,\dots,\operatorname{inv}_m$.


title: Interpretability and accessibility of machine learning in selected food processing, agriculture and health applications

abstract: Artificial Intelligence (AI) and its data-centric branch of machine learning (ML) have greatly evolved over the last few decades. However, as AI is used increasingly in real world use cases, the importance of the interpretability of and accessibility to AI systems have become major research areas. The lack of interpretability of ML based systems is a major hindrance to widespread adoption of these powerful algorithms. This is due to many reasons including ethical and regulatory concerns, which have resulted in poorer adoption of ML in some areas. The recent past has seen a surge in research on interpretable ML. Generally, designing a ML system requires good domain understanding combined with expert knowledge. New techniques are emerging to improve ML accessibility through automated model design. This paper provides a review of the work done to improve interpretability and accessibility of machine learning in the context of global problems while also being relevant to developing countries. We review work under multiple levels of interpretability including scientific and mathematical interpretation, statistical interpretation and partial semantic interpretation. This review includes applications in three areas, namely food processing, agriculture and health.


title: AirCon: Over-the-Air Consensus for Wireless Blockchain Networks

abstract: Blockchain has been deemed as a promising solution for providing security and privacy protection in the next-generation wireless networks. Large-scale concurrent access for massive wireless devices to accomplish the consensus procedure may consume prohibitive communication and computing resources, and thus may limit the application of blockchain in wireless conditions. As most existing consensus protocols are designed for wired networks, directly apply them for wireless users may exhaust their scarce spectrum and computing resources. In this paper, we propose AirCon, a byzantine fault-tolerant (BFT) consensus protocol for wireless users via the over-the-air computation. The novelty of AirCon is to take advantage of the intrinsic characteristic of the wireless channel and automatically achieve the consensus in the physical layer while receiving from the end users, which greatly reduces the communication and computational cost that would be caused by traditional consensus protocols. We implement the AirCon protocol integrated into an LTE system and provide solutions to the critical issues for over-the-air consensus implementation. Experimental results are provided to show the feasibility of the proposed protocol, and simulation results to show the performance of the AirCon protocol under different wireless conditions.


title: Conservative-Progressive Collaborative Learning for Semi-supervised Semantic Segmentation

abstract: Pseudo supervision is regarded as the core idea in semi-supervised learning for semantic segmentation, and there is always a tradeoff between utilizing only the high-quality pseudo labels and leveraging all the pseudo labels. Addressing that, we propose a novel learning approach, called Conservative-Progressive Collaborative Learning (CPCL), among which two predictive networks are trained in parallel, and the pseudo supervision is implemented based on both the agreement and disagreement of the two predictions. One network seeks common ground via intersection supervision and is supervised by the high-quality labels to ensure a more reliable supervision, while the other network reserves differences via union supervision and is supervised by all the pseudo labels to keep exploring with curiosity. Thus, the collaboration of conservative evolution and progressive exploration can be achieved. To reduce the influences of the suspicious pseudo labels, the loss is dynamic re-weighted according to the prediction confidence. Extensive experiments demonstrate that CPCL achieves state-of-the-art performance for semi-supervised semantic segmentation.