title: Exploring the Design Space of Static and Incremental Graph Connectivity Algorithms on GPUs

abstract: Connected components and spanning forest are fundamental graph algorithms due to their use in many important applications, such as graph clustering and image segmentation. GPUs are an ideal platform for graph algorithms due to their high peak performance and memory bandwidth. While there exist several GPU connectivity algorithms in the literature, many design choices have not yet been explored. In this paper, we explore various design choices in GPU connectivity algorithms, including sampling, linking, and tree compression, for both the static as well as the incremental setting. Our various design choices lead to over 300 new GPU implementations of connectivity, many of which outperform state-of-the-art. We present an experimental evaluation, and show that we achieve an average speedup of 2.47x speedup over existing static algorithms. In the incremental setting, we achieve a throughput of up to 48.23 billion edges per second. Compared to state-of-the-art CPU implementations on a 72-core machine, we achieve a speedup of 8.26--14.51x for static connectivity and 1.85--13.36x for incremental connectivity using a Tesla V100 GPU.


title: Out-of-sample error estimate for robust M-estimators with convex penalty

abstract: A generic out-of-sample error estimate is proposed for robust $M$-estimators regularized with a convex penalty in high-dimensional linear regression where $(X,y)$ is observed and $p,n$ are of the same order. If $\psi$ is the derivative of the robust data-fitting loss $\rho$, the estimate depends on the observed data only through the quantities $\hat\psi = \psi(y-X\hat\beta)$, $X^\top \hat\psi$ and the derivatives $(\partial/\partial y) \hat\psi$ and $(\partial/\partial y) X\hat\beta$ for fixed $X$. The out-of-sample error estimate enjoys a relative error of order $n^{-1/2}$ in a linear model with Gaussian covariates and independent noise, either non-asymptotically when $p/n\le \gamma$ or asymptotically in the high-dimensional asymptotic regime $p/n\to\gamma'\in(0,\infty)$. General differentiable loss functions $\rho$ are allowed provided that $\psi=\rho'$ is 1-Lipschitz. The validity of the out-of-sample error estimate holds either under a strong convexity assumption, or for the $\ell_1$-penalized Huber M-estimator if the number of corrupted observations and sparsity of the true $\beta$ are bounded from above by $s_*n$ for some small enough constant $s_*\in(0,1)$ independent of $n,p$. For the square loss and in the absence of corruption in the response, the results additionally yield $n^{-1/2}$-consistent estimates of the noise variance and of the generalization error. This generalizes, to arbitrary convex penalty, estimates that were previously known for the Lasso.


title: On the Optimality of Vagueness: "Around", "Between", and the Gricean Maxims

abstract: Why is ordinary language vague? We argue that in contexts in which a cooperative speaker is not perfectly informed about the world, the use of vague expressions can offer an optimal tradeoff between truthfulness (Gricean Quality) and informativeness (Gricean Quantity). Focusing on expressions of approximation such as "around", which are semantically vague, we show that they allow the speaker to convey indirect probabilistic information, in a way that can give the listener a more accurate representation of the information available to the speaker than any more precise expression would (intervals of the form "between"). That is, vague sentences can be more informative than their precise counterparts. We give a probabilistic treatment of the interpretation of "around", and offer a model for the interpretation and use of "around"-statements within the Rational Speech Act (RSA) framework. In our account the shape of the speaker's distribution matters in ways not predicted by the Lexical Uncertainty model standardly used in the RSA framework for vague predicates. We use our approach to draw further lessons concerning the semantic flexibility of vague expressions and their irreducibility to more precise meanings.


title: Tabular Structure Detection from Document Images for Resource Constrained Devices Using A Row Based Similarity Measure

abstract: Tabular structures are used to present crucial information in a structured and crisp manner. Detection of such regions is of great importance for proper understanding of a document. Tabular structures can be of various layouts and types. Therefore, detection of these regions is a hard problem. Most of the existing techniques detect tables from a document image by using prior knowledge of the structures of the tables. However, these methods are not applicable for generalized tabular structures. In this work, we propose a similarity measure to find similarities between pairs of rows in a tabular structure. This similarity measure is utilized to identify a tabular region. Since the tabular regions are detected exploiting the similarities among all rows, the method is inherently independent of layouts of the tabular regions present in the training data. Moreover, the proposed similarity measure can be used to identify tabular regions without using large sets of parameters associated with recent deep learning based methods. Thus, the proposed method can easily be used with resource constrained devices such as mobile devices without much of an overhead.


title: Learning about the QCD medium using electromagnetic and weak probes

abstract: Recent theoretical developments concerning radiation of electromagnetic and weak probes in ultra-relativistic heavy-ion collisions is overviewed. These proceedings focus on electromagnetic probes and briefly cover weak probes. An outlook regarding the future use of electromagnetic probes is formulated whereby a quantitative Bayesian comparison, simultaneously employing electromagnetic and hadronic calculations of experimental observables against data, is highlighted as a path towards a better understanding of the properties of the QCD medium.


title: Argo Lite: Open-Source Interactive Graph Exploration and Visualization in Browsers

abstract: Graph data have become increasingly common. Visualizing them helps people better understand relations among entities. Unfortunately, existing graph visualization tools are primarily designed for single-person desktop use, offering limited support for interactive web-based exploration and online collaborative analysis. To address these issues, we have developed Argo Lite, a new in-browser interactive graph exploration and visualization tool. Argo Lite enables users to publish and share interactive graph visualizations as URLs and embedded web widgets. Users can explore graphs incrementally by adding more related nodes, such as highly cited papers cited by or citing a paper of interest in a citation network. Argo Lite works across devices and platforms, leveraging WebGL for high-performance rendering. Argo Lite has been used by over 1,000 students at Georgia Tech's Data and Visual Analytics class. Argo Lite may serve as a valuable open-source tool for advancing multiple CIKM research areas, from data presentation, to interfaces for information systems and more.


title: FCN Approach for Dynamically Locating Multiple Speakers

abstract: In this paper, we present a deep neural network-based online multi-speaker localisation algorithm. Following the W-disjoint orthogonality principle in the spectral domain, each time-frequency (TF) bin is dominated by a single speaker, and hence by a single direction of arrival (DOA). A fully convolutional network is trained with instantaneous spatial features to estimate the DOA for each TF bin. The high resolution classification enables the network to accurately and simultaneously localize and track multiple speakers, both static and dynamic. Elaborated experimental study using both simulated and real-life recordings in static and dynamic scenarios, confirms that the proposed algorithm outperforms both classic and recent deep-learning-based algorithms.


title: NASirt: AutoML based learning with instance-level complexity information

abstract: Designing adequate and precise neural architectures is a challenging task, often done by highly specialized personnel. AutoML is a machine learning field that aims to generate good performing models in an automated way. Spectral data such as those obtained from biological analysis have generally a lot of important information, and these data are specifically well suited to Convolutional Neural Networks (CNN) due to their image-like shape. In this work we present NASirt, an AutoML methodology based on Neural Architecture Search (NAS) that finds high accuracy CNN architectures for spectral datasets. The proposed methodology relies on the Item Response Theory (IRT) for obtaining characteristics from an instance level, such as discrimination and difficulty, and it is able to define a rank of top performing submodels. Several experiments are performed in order to demonstrate the methodology's performance with different spectral datasets. Accuracy results are compared to other benchmarks methods, such as a high performing, manually crafted CNN and the Auto-Keras AutoML tool. The results show that our method performs, in most cases, better than the benchmarks, achieving average accuracy as high as 97.40%.


title: The Scale of Superpartner Masses and Electroweakino Searches at the High-Luminosity LHC

abstract: Searches for weakly interacting particles is one of the main goals of the high luminosity LHC run. In this work we study the well motivated cases of electroweakinos with mostly Wino and Bino components. We show the relevance of squark induced t-channel production in defining the production cross section and hence the LHC reach. Moreover, a realistic evaluation of the decay branching ratios show a strong dependence on the sign of $\mu$ and, for negative values of $\mu$, on the relative size of the ratio of $\mu$ to the gaugino masses compared with tan$\beta$. Overall, unless it is kinematically suppressed, or specific conditions are fulfilled, the Higgs decay channel is the most significant one, and the trilepton channel becomes subdominant with respect to final states including bottom quarks. Although the properties are different than in the Higgsino-Bino case, also in this case the discovery reach extends to mass values that are significantly larger than the ones probed at current luminosities, leading to a strong motivation for the search for electroweakinos in the high luminosity LHC run.


title: Existence, continuation, persistence and dynamics of solutions for a generalized 0-Holm-Staley equation

abstract: We consider a family of non-local evolution equations including the $0-$Holm-Staley equation. We show that the family considered does not posses compactly supported solutions as long as the initial data is non-trivial. Also, we prove different unique continuation results for the solutions of the family studied. In addition, some special solutions, such as peakons and kinks, are studied and their dynamics are analyzed. Persistence properties of the solutions are also investigated as well as we describe the scenario for the global existence of solutions of the $0-$Holm-Staley equation. In particular, the prove of global existence of solutions as well as our demonstrations for unique continuation results of solutions partially answer some questions pointed out in [A. A. Himonas and R. C. Thompson, Persistence properties and unique continuation for a generalized Camassa-Holm equation, J. Math. Phys., vol. 55, paper 091503, (2014)].


title: SparseRT: Accelerating Unstructured Sparsity on GPUs for Deep Learning Inference

abstract: In recent years, there has been a flurry of research in deep neural network pruning and compression. Early approaches prune weights individually. However, it is difficult to take advantage of the resulting unstructured sparsity patterns on modern hardware like GPUs. As a result, pruning strategies which impose sparsity structures in the weights have become more popular. However,these structured pruning approaches typically lead to higher losses in accuracy than unstructured pruning. In this paper, we present SparseRT, a code generator that leverage unstructured sparsity to accelerate sparse linear algebra operations in deep learning inference on GPUs. For 1x1 convolutions and fully connected layers, we demonstrate geometric mean of speedups of 3.4x over the equivalent dense computation at 90% sparsity and 5.4x at 95% sparsity when evaluated on hundreds of test cases in deep learning. For sparse 3x3 convolutions, we show speedups of over 5x on use cases in ResNet-50.


title: Changes in mobility and socioeconomic conditions in Bogot\'a city during the COVID-19 outbreak

abstract: We analyze mobility changes following the implementation of containment measures aimed at mitigating the spread of COVID-19 in Bogot\'a, Colombia. We characterize the mobility network before and during the pandemic and analyze its evolution and changes between January and July 2020. We then link the observed mobility changes to socioeconomic conditions, estimating a gravity model to assess the effect of socioeconomic conditions on mobility flows. We observe an overall reduction in mobility trends, but the overall connectivity between different areas of the city remains after the lockdown, reflecting the mobility network's resilience. We find that the responses to lockdown policies depend on socioeconomic conditions. Before the pandemic, the population with better socioeconomic conditions shows higher mobility flows. Since the lockdown, mobility presents a general decrease, but the population with worse socioeconomic conditions shows lower decreases in mobility flows. We conclude deriving policy implications.


title: Constraints on Decaying Sterile Neutrinos from Solar Antineutrinos

abstract: Solar neutrino experiments are highly sensitive to sources of $\nu\to\overline{\nu}$ conversions in the $^8$B neutrino flux. In this work we adapt these searches to non-minimal sterile neutrino models recently proposed to explain the LSND, MiniBooNE, and reactor anomalies. The production of such sterile neutrinos in the Sun, followed the decay chain $\nu_4 \to \nu \phi \to \nu \nu \overline{\nu}$ with a new scalar $\phi$ results in upper limits for the neutrino mixing $|U_{e4}|^2$ at the per mille level. We conclude that a simultaneous explanations of all anomalies is in tension with KamLAND, Super-Kamiokande, and Borexino constraints on the flux of solar antineutrinos. We then present other minimal models that violate parity or lepton number, and discuss the applicability of our constraints in each case. Future improvements can be expected from existing Borexino data as well as from future searches at Super-Kamiokande with added Gd.


title: Decision-making for Autonomous Vehicles on Highway: Deep Reinforcement Learning with Continuous Action Horizon

abstract: Decision-making strategy for autonomous vehicles de-scribes a sequence of driving maneuvers to achieve a certain navigational mission. This paper utilizes the deep reinforcement learning (DRL) method to address the continuous-horizon decision-making problem on the highway. First, the vehicle kinematics and driving scenario on the freeway are introduced. The running objective of the ego automated vehicle is to execute an efficient and smooth policy without collision. Then, the particular algorithm named proximal policy optimization (PPO)-enhanced DRL is illustrated. To overcome the challenges in tardy training efficiency and sample inefficiency, this applied algorithm could realize high learning efficiency and excellent control performance. Finally, the PPO-DRL-based decision-making strategy is estimated from multiple perspectives, including the optimality, learning efficiency, and adaptability. Its potential for online application is discussed by applying it to similar driving scenarios.


title: DeepPrognosis: Preoperative Prediction of Pancreatic Cancer Survival and Surgical Margin via Contrast-Enhanced CT Imaging

abstract: Pancreatic ductal adenocarcinoma (PDAC) is one of the most lethal cancers and carries a dismal prognosis. Surgery remains the best chance of a potential cure for patients who are eligible for initial resection of PDAC. However, outcomes vary significantly even among the resected patients of the same stage and received similar treatments. Accurate preoperative prognosis of resectable PDACs for personalized treatment is thus highly desired. Nevertheless, there are no automated methods yet to fully exploit the contrast-enhanced computed tomography (CE-CT) imaging for PDAC. Tumor attenuation changes across different CT phases can reflect the tumor internal stromal fractions and vascularization of individual tumors that may impact the clinical outcomes. In this work, we propose a novel deep neural network for the survival prediction of resectable PDAC patients, named as 3D Contrast-Enhanced Convolutional Long Short-Term Memory network(CE-ConvLSTM), which can derive the tumor attenuation signatures or patterns from CE-CT imaging studies. We present a multi-task CNN to accomplish both tasks of outcome and margin prediction where the network benefits from learning the tumor resection margin related features to improve survival prediction. The proposed framework can improve the prediction performances compared with existing state-of-the-art survival analysis approaches. The tumor signature built from our model has evidently added values to be combined with the existing clinical staging system.


title: Frictional state evolution laws and the non-linear nucleation of dynamic shear rupture

abstract: We assess if a characteristic length for a non-linear interfacial slip instability follows from theoretical descriptions of sliding friction. We examine friction laws and their coupling with the elasticity of bodies in contact and show that such a length does not always exist. We consider a range of descriptions for frictional strength and show that the area needed to support a slip instability is negligibly small for laws that are more faithful to experimental data. This questions whether a minimum earthquake size exists and shows that the nucleation phase of dynamic rupture contains discriminatory information on the nature of frictional strength evolution.


title: Hybrid Polymer-Garnet Materials for All-Solid-State Energy Storage Devices

abstract: Hybrid electrolyte materials comprising polymer-ionic salt matrixes embedded with garnet particles constitute a promising class of materials for the realization of all-solid-state batteries. In addition to providing solutions to the safety issues inherent to current liquid electrolytes, hybrid polymer electrolytes offer advantages over other solid-state electrolytes. This is because their functional properties such as ionic conductivity, electrochemical stability, mechanical and thermal properties can be tailored to a particular application by independently optimizing the properties of the constituent materials. Thereby, providing a rational approach to solving bottlenecks currently preventing solid-state electrolytes from practical implementation into battery devices. This review starts with a survey of solid-state electrolytes, focusing on their materials and ion transport limitations. Next, we summarize the current understanding of transport mechanisms in composite polymer electrolytes (CPEs) with the purpose of identifying materials solutions for further improving their properties. The overall goal of the review is to foster heightened research interest in these hybrid structures to rapidly advance development of future all-solid-state battery devices.


title: Hybrid Deep Neural Networks to Infer State Models of Black-Box Systems

abstract: Inferring behavior model of a running software system is quite useful for several automated software engineering tasks, such as program comprehension, anomaly detection, and testing. Most existing dynamic model inference techniques are white-box, i.e., they require source code to be instrumented to get run-time traces. However, in many systems, instrumenting the entire source code is not possible (e.g., when using black-box third-party libraries) or might be very costly. Unfortunately, most black-box techniques that detect states over time are either univariate, or make assumptions on the data distribution, or have limited power for learning over a long period of past behavior. To overcome the above issues, in this paper, we propose a hybrid deep neural network that accepts as input a set of time series, one per input/output signal of the system, and applies a set of convolutional and recurrent layers to learn the non-linear correlations between signals and the patterns, over time. We have applied our approach on a real UAV auto-pilot solution from our industry partner with half a million lines of C code. We ran 888 random recent system-level test cases and inferred states, over time. Our comparison with several traditional time series change point detection techniques showed that our approach improves their performance by up to 102%, in terms of finding state change points, measured by F1 score. We also showed that our state classification algorithm provides on average 90.45% F1 score, which improves traditional classification algorithms by up to 17%.


title: Charge pumping under spin resonance in Si(100) metal-oxide-semiconductor transistors

abstract: Gate-pulse-induced recombination, known as the charge pumping (CP), is a fundamental carrier recombination process, and has been utilized as a method for analyzing electrical properties of defects (or dangling bonds) at the transistor interfaces, which is now recognized to be well-matured and conventional. Nevertheless, neither the origin (the bonding configuration) of the defects responsible for the CP, nor their detailed recombination sequence has been clarified yet for Si metal-oxide-semiconductor (MOS) interfaces. In order to address these problems, we investigated the CP under spin resonance conditions at temperatures ranging from 27 to 300 K in Si(100) n-type MOS transistors. We obtained evidence that Pb0 and E' centers, the two major dangling bonds at (and near) the Si(100) interface, participate in the CP recombination process. We also show that the spin-dependent CP process is explained by the formation of electron-electron spin pairs, which in turn reveals that the CP via Pb0 and E' centers is inherently a two-electron process.


title: MAR: A structure-based search engine for models

abstract: The availability of shared software models provides opportunities for reusing, adapting and learning from them. Public models are typically stored in a variety of locations, including model repositories, regular source code repositories, web pages, etc. To profit from them developers need effective search mechanisms to locate the models relevant for their tasks. However, to date, there has been little success in creating a generic and efficient search engine specially tailored to the modelling domain. In this paper we present MAR, a search engine for models. MAR is generic in the sense that it can index any type of model if its meta-model is known. MAR uses a query-by-example approach, that is, it uses example models as queries. The search takes the model structure into account using the notion of bag of paths, which encodes the structure of a model using paths between model elements and is a representation amenable for indexing. MAR is built over HBase using a specific design to deal with large repositories. Our benchmarks show that the engine is efficient and has fast response times in most cases. We have also evaluated the precision of the search engine by creating model mutants which simulate user queries. A REST API is available to perform queries and an Eclipse plug-in allows end users to connect to the search engine from model editors. We have currently indexed more than 50.000 models of different kinds, including Ecore meta-models, BPMN diagrams and UML models. MAR is available at http://mar-search.org.


title: The abundance of primordial black holes from the global 21cm signal and extragalactic gamma-ray background

abstract: Primordial black holes (PBHs) formed in the early Universe can accret dark matter particles due to gravity and form ultracompact minihalos (UCMHs). The theoretical researches and simulations have shown that the density profile of dark matter in UCMHs is in the form of $\rho (r) \sim r^{-2.25}$. Compared with the popular dark matter halo model, e.g. NFW model, dark matter annihilation rate is larger in UCMHs. Considering dark matter annihilation, there is a maximum core density $\rho_{\rm max}$ in UCMHs which has been treated independent on redshift. While in this work, we point out that $\rho_{\rm max}$ depends on redshift and dark matter annihilation rate in UCMHs also changes with time. We re-investigate the $\gamma$-ray flux from UCMHs due to dark matter annihilation and focus on their contributions to the extragalactic gamma-ray background (EGB). Utilizing the EGB data of Fermi, the constraints on the abundance of PBHs are derived, $\Omega_{\rm PBH,EGB} \lesssim 2\times 10^{-8}$. Motivated by the recent observations of global 21cm signals by the EDGES experiment, we investigate the influences of dark matter annihilation in UCMHs on global 21cm signals and derive the constraints on the abundance of PBHs, $\Omega_{\rm PBH,21cm} \lesssim 2\times 10^{-10}$. The derived constraints are valid for mass range of $10^{-6} M_{\odot} \lesssim M_{\rm PBH} \lesssim 10^{3} M_{\odot}$.


title: New Method for Silicon Sensor Charge Calibration Using Compton Scattering

abstract: In order to cope with increasing lifetime radiation damage expected at collider experiments, silicon sensors are becoming increasingly thin. To achieve adequate detection efficiency, the next generation of detectors may have to operate with thresholds below 1000 electron-hole pairs. The readout chips attached to these sensors should be calibrated to some known external charge, but there is a lack of traditional sources in this charge regime. We present a new method for absolute charge calibration based on Compton scattering. In the past, this method has been used for calibration of scintillators, but to our knowledge never for silicon detectors. Here it has been studied using a 150 micron thick planar silicon sensor on an RD53A readout integrated circuit.


title: Short-time Monte Carlo simulation of the majority-vote model on cubic lattices

abstract: We perform short-time Monte Carlo simulations to study the criticality of the isotropic two-state majority-vote model on cubic lattices of volume $N = L^3$, with $L$ up to $2048$. We obtain the precise location of the critical point by examining the scaling properties of a new auxiliary function $\Psi$. We perform finite-time scaling analysis to accurately calculate the whole set of critical exponents, including the dynamical critical exponent $z=2.027(9)$, and the initial slip exponent $\theta = 0.1081(1)$. Our results indicate that the majority-vote model in three dimensions belongs to the same universality class of the three-dimensional Ising model.


title: Majority-vote model with limited visibility: an investigation into filter bubbles

abstract: The dynamics of opinion formation in a society is a complex phenomenon where many variables play an important role. Recently, the influence of algorithms to filter which content is fed to social networks users has come under scrutiny. Supposedly, the algorithms promote marketing strategies, but can also facilitate the formation of filters bubbles in which a user is most likely exposed to opinions that conform to their own. In the two-state majority-vote model an individual adopts an opinion contrary to the majority of its neighbors with probability $q$, defined as the noise parameter. Here, we introduce a visibility parameter $V$ in the dynamics of the majority-vote model, which equals the probability of an individual ignoring the opinion of each one of its neighbors. For $V=0.5$ each individual will, on average, ignore the opinion of half of its neighboring nodes. We employ Monte Carlo simulations to calculate the critical noise parameter as a function of the visibility $q_c(V)$ and obtain the phase diagram of the model. We find that the critical noise is an increasing function of the visibility parameter, such that a lower value of $V$ favors dissensus. Via finite-size scaling analysis we obtain the critical exponents of the model, which are visibility-independent, and show that the model belongs to the Ising universality class. We compare our results to the case of a network submitted to a static site dilution, and find that the limited visibility model is a more subtle way of inducing opinion polarization in a social network.


title: OVI Traces Photoionized Streams With Collisionally Ionized Boundaries in Cosmological Simulations of $z \sim 1$ Massive Galaxies

abstract: We analyse the distribution and origin of OVI in the Circumgalactic Medium (CGM) of dark-matter haloes of $\sim 10^{12}$ M$_\odot$ at $z\sim1$ in the VELA cosmological zoom-in simulations. We find that the OVI in the inflowing cold streams is primarily photoionized, while in the bulk volume it is primarily collisionally ionized. The photoionized component dominates the observed column density at large impact parameters ($\gtrsim 0.3 R_{\rm vir}$), while the collisionally ionized component dominates closer in. We find that most of the collisional OVI, by mass, resides in the relatively thin boundaries of the photoionized streams. We discuss how the results are in agreement with analytic predictions of stream and boundary properties, and their compatibility with observations. This allows us to predict the profiles of OVI and other ions in future CGM observations and provides a toy model for interpreting them.


title: Robust Design for IRS-Aided Communication Systems with User Location Uncertainty

abstract: In this paper, we propose a robust design framework for IRS-aided communication systems in the presence of user location uncertainty. By jointly designing the transmit beamforming vector at the BS and phase shifts at the IRS, we aim to minimize the transmit power subject to the worse-case quality of service (QoS) constraint, i.e., ensuring the user rate is above a threshold for all possible user location error realizations. With unit-modulus, this problem is not convex. The location uncertainty in the QoS constraint further increases the difficulty of solving this problem. By utilizing techniques of Taylor expansion, S-Procedure and semidefinite relaxation (SDP), we transform this problem into a sequence of semidefinite programming (SDP) sub-problems. Simulation results show that the proposed robust algorithm substantially outperforms the non-robust algorithm proposed in the literature, in terms of probability of reaching the required QoS target.


title: Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra

abstract: Numerous researchers recently applied empirical spectral analysis to the study of modern deep learning classifiers. We identify and discuss an important formal class/cross-class structure and show how it lies at the origin of the many visually striking features observed in deepnet spectra, some of which were reported in recent articles, others are unveiled here for the first time. These include spectral outliers, "spikes", and small but distinct continuous distributions, "bumps", often seen beyond the edge of a "main bulk". The significance of the cross-class structure is illustrated in three ways: (i) we prove the ratio of outliers to bulk in the spectrum of the Fisher information matrix is predictive of misclassification, in the context of multinomial logistic regression; (ii) we demonstrate how, gradually with depth, a network is able to separate class-distinctive information from class variability, all while orthogonalizing the class-distinctive information; and (iii) we propose a correction to KFAC, a well-known second-order optimization algorithm for training deepnets.


title: Time-varying exposure history and subsequent health outcomes: a two-stage approach to identify critical windows

abstract: Long-term behavioral and health risk factors constitute a primary focus of research on the etiology of chronic diseases. Yet, identifying critical time-windows during which risk factors have the strongest impact on disease risk is challenging. To assess the trajectory of association of an exposure history with an outcome, the weighted cumulative exposure index (WCIE) has been proposed, with weights reflecting the relative importance of exposures at different times. However, WCIE is restricted to a complete observed error-free exposure whereas exposures are often measured with intermittent missingness and error. Moreover, it rarely explores exposure history that is very distant from the outcome as usually sought in life-course epidemiology. We extend the WCIE methodology to (i) exposures that are intermittently measured with error, and (ii) contexts where the exposure time-window precedes the outcome time-window using a landmark approach. First, the individual exposure history up to the landmark time is estimated using a mixed model that handles missing data and error in exposure measurement, and the predicted complete error-free exposure history is derived. Then the WCIE methodology is applied to assess the trajectory of association between the predicted exposure history and the health outcome collected after the landmark time. In our context, the health outcome is a longitudinal marker analyzed using a mixed model. A simulation study first demonstrates the correct inference obtained with this approach. Then, applied to the Nurses' Health Study (19,415 women) to investigate the association between BMI history (collected from midlife) and subsequent cognitive decline after age 70. In conclusion, this approach, easy to implement, provides a flexible tool for studying complex dynamic relationships and identifying critical time windows while accounting for exposure measurement errors.


title: Planning in Learned Latent Action Spaces for Generalizable Legged Locomotion

abstract: Hierarchical learning has been successful at learning generalizable locomotion skills on walking robots in a sample-efficient manner. However, the low-dimensional "latent" action used to communicate between two layers of the hierarchy is typically user-designed. In this work, we present a fully-learned hierarchical framework, that is capable of jointly learning the low-level controller and the high-level latent action space. Once this latent space is learned, we plan over continuous latent actions in a model-predictive control fashion, using a learned high-level dynamics model. This framework generalizes to multiple robots, and we present results on a Daisy hexapod simulation, A1 quadruped simulation, and Daisy robot hardware. We compare a range of learned hierarchical approaches from literature, and show that our framework outperforms baselines on multiple tasks and two simulations. In addition to learning approaches, we also compare to inverse-kinematics (IK) acting on desired robot motion, and show that our fully-learned framework outperforms IK in adverse settings on both A1 and Daisy simulations. On hardware, we show the Daisy hexapod achieve multiple locomotion tasks, in an unstructured outdoor setting, with only 2000 hardware samples, reinforcing the robustness and sample-efficiency of our approach.


title: BumbleBee: Application-aware adaptation for container orchestration

abstract: Modern applications have embraced separation of concerns as a first-order organizing principle through the use of containers, container orchestration, and service meshes. However, adaptation to unexpected network variation has not followed suit. We present BumbleBee, a lightweight extension to the container ecosystem that supports application-aware adaptation. BumbleBee provides a simple abstraction for making decisions about network data using application semantics. Because this abstraction is placed within the communications framework of a modern service mesh, it is closer to the point at which changes are detected, providing more responsive and effective adaptation than possible at endpoints.


title: AMBERT: A Pre-trained Language Model with Multi-Grained Tokenization

abstract: Pre-trained language models such as BERT have exhibited remarkable performances in many tasks in natural language understanding (NLU). The tokens in the models are usually fine-grained in the sense that for languages like English they are words or sub-words and for languages like Chinese they are characters. In English, for example, there are multi-word expressions which form natural lexical units and thus the use of coarse-grained tokenization also appears to be reasonable. In fact, both fine-grained and coarse-grained tokenizations have advantages and disadvantages for learning of pre-trained language models. In this paper, we propose a novel pre-trained language model, referred to as AMBERT (A Multi-grained BERT), on the basis of both fine-grained and coarse-grained tokenizations. For English, AMBERT takes both the sequence of words (fine-grained tokens) and the sequence of phrases (coarse-grained tokens) as input after tokenization, employs one encoder for processing the sequence of words and the other encoder for processing the sequence of the phrases, utilizes shared parameters between the two encoders, and finally creates a sequence of contextualized representations of the words and a sequence of contextualized representations of the phrases. Experiments have been conducted on benchmark datasets for Chinese and English, including CLUE, GLUE, SQuAD and RACE. The results show that AMBERT can outperform BERT in all cases, particularly the improvements are significant for Chinese. We also develop a method to improve the efficiency of AMBERT in inference, which still performs better than BERT with the same computational cost as BERT.


title: Lymph Node Gross Tumor Volume Detection and Segmentation via Distance-based Gating using 3D CT/PET Imaging in Radiotherapy

abstract: Finding, identifying and segmenting suspicious cancer metastasized lymph nodes from 3D multi-modality imaging is a clinical task of paramount importance. In radiotherapy, they are referred to as Lymph Node Gross Tumor Volume (GTVLN). Determining and delineating the spread of GTVLN is essential in defining the corresponding resection and irradiating regions for the downstream workflows of surgical resection and radiotherapy of various cancers. In this work, we propose an effective distance-based gating approach to simulate and simplify the high-level reasoning protocols conducted by radiation oncologists, in a divide-and-conquer manner. GTVLN is divided into two subgroups of tumor-proximal and tumor-distal, respectively, by means of binary or soft distance gating. This is motivated by the observation that each category can have distinct though overlapping distributions of appearance, size and other LN characteristics. A novel multi-branch detection-by-segmentation network is trained with each branch specializing on learning one GTVLN category features, and outputs from multi-branch are fused in inference. The proposed method is evaluated on an in-house dataset of $141$ esophageal cancer patients with both PET and CT imaging modalities. Our results validate significant improvements on the mean recall from $72.5\%$ to $78.2\%$, as compared to previous state-of-the-art work. The highest achieved GTVLN recall of $82.5\%$ at $20\%$ precision is clinically relevant and valuable since human observers tend to have low sensitivity (around $80\%$ for the most experienced radiation oncologists, as reported by literature).


title: Multi-wavelength photometry during the 2018 superoutburst of the WZ Sge-type dwarf nova EG Cancri

abstract: We report on the multi-wavelength photometry of the 2018 superoutburst in EG Cnc. We have detected stage A superhumps and long-lasting late-stage superhumps via the optical photometry and have constrained the binary mass ratio and its possible range. The median value of the mass ratio is 0.048 and the upper limit is 0.057, which still implies that EG Cnc is one of the possible candidates for the period bouncer. This object also showed multiple rebrightenings in this superoutburst, which are the same as those in its previous superoutburst in 1996--1997 despite the difference in the main superoutburst. This would represent that the rebrightening type is inherent to each object and is independent of the initial disk mass at the beginning of superoutbursts. We also found that $B-I$ and $J-K_{\rm S}$ colors were unusually red just before the rebrightening phase and became bluer during the quiescence between rebrightenings, which would mean that the low-temperature mass reservoir at the outermost disk accreted with time after the main superoutburst. Also, the ultraviolet flux was sensitive to rebrightenings as well as the optical flux, and the $U-B$ color became redder during the rebrightening phase, which would indicate that the inner disk became cooler when this object repeated rebrightenings. Our results thus basically support the idea that the cool mass reservoir in the outermost disk is responsible for rebrightenings.


title: Towards Practical 2D Grapevine Bud Detection with Fully Convolutional Networks

abstract: In Viticulture, visual inspection of the plant is a necessary task for measuring relevant variables. In many cases, these visual inspections are susceptible to automation through computer vision methods. Bud detection is one such visual task, central for the measurement of important variables such as: measurement of bud sunlight exposure, autonomous pruning, bud counting, type-of-bud classification, bud geometric characterization, internode length, bud area, and bud development stage, among others. This paper presents a computer method for grapevine bud detection based on a Fully Convolutional Networks MobileNet architecture (FCN-MN). To validate its performance, this architecture was compared in the detection task with a strong method for bud detection, Scanning Windows (SW) based on a patch classifier, showing improvements over three aspects of detection: segmentation, correspondence identification and localization. The best version of FCN-MN showed a detection F1-measure of $88.6\%$ (for true positives defined as detected components whose intersection-over-union with the true bud is above $0.5$), and false positives that are small and near the true bud. Splits -- false positives overlapping the true bud -- showed a mean segmentation precision of $89.3\% (21.7)$, while false alarms -- false positives not overlapping the true bud -- showed a mean pixel area of only $8\%$ the area of a true bud, and a distance (between mass centers) of $1.1$ true bud diameters. The paper concludes by discussing how these results for FCN-MN would produce sufficiently accurate measurements of bud variables such as bud number, bud area, and internode length, suggesting a good performance in a practical setup.


title: Adaptively-Accumulated Knowledge Transfer for Partial Domain Adaptation

abstract: Partial domain adaptation (PDA) attracts appealing attention as it deals with a realistic and challenging problem when the source domain label space substitutes the target domain. Most conventional domain adaptation (DA) efforts concentrate on learning domain-invariant features to mitigate the distribution disparity across domains. However, it is crucial to alleviate the negative influence caused by the irrelevant source domain categories explicitly for PDA. In this work, we propose an Adaptively-Accumulated Knowledge Transfer framework (A$^2$KT) to align the relevant categories across two domains for effective domain adaptation. Specifically, an adaptively-accumulated mechanism is explored to gradually filter out the most confident target samples and their corresponding source categories, promoting positive transfer with more knowledge across two domains. Moreover, a dual distinct classifier architecture consisting of a prototype classifier and a multilayer perceptron classifier is built to capture intrinsic data distribution knowledge across domains from various perspectives. By maximizing the inter-class center-wise discrepancy and minimizing the intra-class sample-wise compactness, the proposed model is able to obtain more domain-invariant and task-specific discriminative representations of the shared categories data. Comprehensive experiments on several partial domain adaptation benchmarks demonstrate the effectiveness of our proposed model, compared with the state-of-the-art PDA methods.


title: What Can We Learn from the Travelers Data in Detecting Disease Outbreaks -- A Case Study of the COVID-19 Epidemic

abstract: Background: Travel is a potent force in the emergence of disease. We discussed how the traveler case reports could aid in a timely detection of a disease outbreak. Methods: Using the traveler data, we estimated a few indicators of the epidemic that affected decision making and policy, including the exponential growth rate, the doubling time, and the probability of severe cases exceeding the hospital capacity, in the initial phase of the COVID-19 epidemic in multiple countries. We imputed the arrival dates when they were missing. We compared the estimates from the traveler data to the ones from domestic data. We quantitatively evaluated the influence of each case report and knowing the arrival date on the estimation. Findings: We estimated the travel origin's daily exponential growth rate and examined the date from which the growth rate was consistently above 0.1 (equivalent to doubling time < 7 days). We found those dates were very close to the dates that critical decisions were made such as city lock-downs and national emergency announcement. Using only the traveler data, if the assumed epidemic start date was relatively accurate and the traveler sample was representative of the general population, the growth rate estimated from the traveler data was consistent with the domestic data. We also discussed situations that the traveler data could lead to biased estimates. From the data influence study, we found more recent travel cases had a larger influence on each day's estimate, and the influence of each case report got smaller as more cases became available. We provided the minimum number of exported cases needed to determine whether the local epidemic growth rate was above a certain level, and developed a user-friendly Shiny App to accommodate various scenarios.


title: Layer Edge States Stabilized by Internal Electric Fields in Two-dimensional Hybrid Perovskites

abstract: Two-dimensional (2D) organic-inorganic hybrid perovskites have been intensively explored for recent years, due to their tunable band gaps and exciton binding energies, and increased stability with respect to three-dimensional (3D) hybrid perovskites. There were fascinating experimental observations suggesting the existence of localized edge states in 2D hybrid perovskites which facilitate extremely efficient electron-hole dissociation and long carrier lifetimes. The observations and explanations of the edge states are not quite converging implying that there can be multiple origins for the edge state formation. Using first principles calculations, we demonstrate that layer edge states are stabilized by internal electric fields created by polarized molecular alignment of organic cations in 2D hybrid perovskites when they are two layers or thicker. Our study gives a simple physical explanation of the edge state formation, and it will pave the way for designing and manipulating layer edge states for optoelectronic applications.


title: Type Size Code for Compressing Erd\"os-R\'enyi Graphs

abstract: We consider universal source coding of unlabeled graphs which are commonly referred to as graphical structures. We adopt an Erd\"{o}s-R\'enyi model to generate the random graphical structures. We propose a variant of the previously introduced Type Size code, where type classes are characterized based on the number of edges of the graphical structures. The proposed scheme sorts the graphical structures based on the size of their type classes and assigns binary sequences to them in this order. The $\epsilon$-coding rate of the Type Size code (up to the third-order term) for compressing graphical structures is derived.


title: On the SAV-DG method for a class of fourth order gradient flows

abstract: For a class of fourth order gradient flow problems, integration of the scalar auxiliary variable (SAV) time discretization with the penalty-free discontinuous Galerkin (DG) spatial discretization leads to SAV-DG schemes. These schemes are linear and shown unconditionally energy stable. But the reduced linear systems are rather expensive to solve due to the dense coefficient matrices. In this paper, we provide a procedure to pre-evaluate the auxiliary variable in the piecewise polynomial space. As a result, the computational complexity of $O(\mathcal{N}^2)$ reduces to $O(\mathcal{N})$ when exploiting the conjugate gradient (CG) solver. This hybrid SAV-DG method is more efficient and able to deliver satisfactory results of high accuracy. This was also compared with solving the full augmented system of the SAV-DG schemes.


title: Adversarial Dual Distinct Classifiers for Unsupervised Domain Adaptation

abstract: Unsupervised Domain adaptation (UDA) attempts to recognize the unlabeled target samples by building a learning model from a differently-distributed labeled source domain. Conventional UDA concentrates on extracting domain-invariant features through deep adversarial networks. However, most of them seek to match the different domain feature distributions, without considering the task-specific decision boundaries across various classes. In this paper, we propose a novel Adversarial Dual Distinct Classifiers Network (AD$^2$CN) to align the source and target domain data distribution simultaneously with matching task-specific category boundaries. To be specific, a domain-invariant feature generator is exploited to embed the source and target data into a latent common space with the guidance of discriminative cross-domain alignment. Moreover, we naturally design two different structure classifiers to identify the unlabeled target samples over the supervision of the labeled source domain data. Such dual distinct classifiers with various architectures can capture diverse knowledge of the target data structure from different perspectives. Extensive experimental results on several cross-domain visual benchmarks prove the model's effectiveness by comparing it with other state-of-the-art UDA.


title: Efficient second-order semi-implicit finite element method for fourth-order nonlinear diffusion equations

abstract: We focus here on a class of fourth-order parabolic equations that can be written as a system of second-order equations by introducing an auxiliary variable. We design a novel second-order fully discrete mixed finite element method to approximate these equations. In our approach, we propose new techniques using the second-order backward differentiation formula for the time derivative and a special technique for the approximation of nonlinear terms. The use of the proposed technique for nonlinear terms makes the developed numerical scheme efficient in terms of computational cost since the proposed method only deals with a linear system at each time step and no iterative resolution is needed. A numerical convergence study is performed using the method of manufactured and analytical solutions of the system where we investigate different boundary conditions. With respect to the spatial discretization, convergence rates are found to at least match a priori error estimates available for linear problems. The convergence analysis is completed with an investigation of the temporal discretization where we numerically demonstrate the second-order time-accuracy of the proposed scheme using the method of reference solution. We present a series of numerical tests to demonstrate the efficiency and robustness of the proposed scheme.


title: A benchmark of data stream classification for human activity recognition on connected objects

abstract: This paper evaluates data stream classifiers from the perspective of connected devices, focusing on the use case of HAR. We measure both classification performance and resource consumption (runtime, memory, and power) of five usual stream classification algorithms, implemented in a consistent library, and applied to two real human activity datasets and to three synthetic datasets. Regarding classification performance, results show an overall superiority of the HT, the MF, and the NB classifiers over the FNN and the Micro Cluster Nearest Neighbor (MCNN) classifiers on 4 datasets out of 6, including the real ones. In addition, the HT, and to some extent MCNN, are the only classifiers that can recover from a concept drift. Overall, the three leading classifiers still perform substantially lower than an offline classifier on the real datasets. Regarding resource consumption, the HT and the MF are the most memory intensive and have the longest runtime, however, no difference in power consumption is found between classifiers. We conclude that stream learning for HAR on connected objects is challenged by two factors which could lead to interesting future work: a high memory consumption and low F1 scores overall.


title: CLAN: Continuous Learning using Asynchronous Neuroevolution on Commodity Edge Devices

abstract: Recent advancements in machine learning algorithms, especially the development of Deep Neural Networks (DNNs) have transformed the landscape of Artificial Intelligence (AI). With every passing day, deep learning based methods are applied to solve new problems with exceptional results. The portal to the real world is the edge. The true impact of AI can only be fully realized if we can have AI agents continuously interacting with the real world and solving everyday problems. Unfortunately, high compute and memory requirements of DNNs acts a huge barrier towards this vision. Today we circumvent this problem by deploying special purpose inference hardware on the edge while procuring trained models from the cloud. This approach, however, relies on constant interaction with the cloud for transmitting all the data, training on massive GPU clusters, and downloading updated models. This is challenging for bandwidth, privacy, and constant connectivity concerns that autonomous agents may exhibit. In this paper we evaluate techniques for enabling adaptive intelligence on edge devices with zero interaction with any high-end cloud/server. We build a prototype distributed system of Raspberry Pis communicating via WiFi running NeuroEvolutionary (NE) learning and inference. We evaluate the performance of such a collaborative system and detail the compute/communication characteristics of different arrangements of the system that trade-off parallelism versus communication. Using insights from our analysis, we also propose algorithmic modifications to reduce communication by up to 3.6x during the learning phase to enhance scalability even further and match performance of higher end computing devices at scale. We believe that these insights will enable algorithm-hardware co-design efforts for enabling continuous learning on the edge.


title: Crossing-Domain Generative Adversarial Networks for Unsupervised Multi-Domain Image-to-Image Translation

abstract: State-of-the-art techniques in Generative Adversarial Networks (GANs) have shown remarkable success in image-to-image translation from peer domain X to domain Y using paired image data. However, obtaining abundant paired data is a non-trivial and expensive process in the majority of applications. When there is a need to translate images across n domains, if the training is performed between every two domains, the complexity of the training will increase quadratically. Moreover, training with data from two domains only at a time cannot benefit from data of other domains, which prevents the extraction of more useful features and hinders the progress of this research area. In this work, we propose a general framework for unsupervised image-to-image translation across multiple domains, which can translate images from domain X to any a domain without requiring direct training between the two domains involved in image translation. A byproduct of the framework is the reduction of computing time and computing resources, since it needs less time than training the domains in pairs as is done in state-of-the-art works. Our proposed framework consists of a pair of encoders along with a pair of GANs which learns high-level features across different domains to generate diverse and realistic samples from. Our framework shows competing results on many image-to-image tasks compared with state-of-the-art techniques.


title: A hydrophobic-interaction-based mechanism trigger docking between the SARS CoV 2 spike and angiotensin-converting enzyme 2

abstract: A recent experimental study found that the binding affinity between the cellular receptor human angiotensin converting enzyme 2 (ACE2) and receptor-binding domain (RBD) in spike (S) protein of novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is more than 10-fold higher than that of the original severe acute respiratory syndrome coronavirus (SARS-CoV). However, main-chain structures of the SARS-CoV-2 RBD are almost the same with that of the SARS-CoV RBD. Understanding physical mechanism responsible for the outstanding affinity between the SARS-CoV-2 S and ACE2 is the "urgent challenge" for developing blockers, vaccines and therapeutic antibodies against the coronavirus disease 2019 (COVID-19) pandemic. Considering the mechanisms of hydrophobic interaction, hydration shell, surface tension, and the shielding effect of water molecules, this study reveals a hydrophobic-interaction-based mechanism by means of which SARS-CoV-2 S and ACE2 bind together in an aqueous environment. The hydrophobic interaction between the SARS-CoV-2 S and ACE2 protein is found to be significantly greater than that between SARS-CoV S and ACE2. At the docking site, the hydrophobic portions of the hydrophilic side chains of SARS-CoV-2 S are found to be involved in the hydrophobic interaction between SARS-CoV-2 S and ACE2. We propose a method to design live attenuated viruses by mutating several key amino acid residues of the spike protein to decrease the hydrophobic surface areas at the docking site. Mutation of a small amount of residues can greatly reduce the hydrophobic binding of the coronavirus to the receptor, which may be significant reduce infectivity and transmissibility of the virus.


title: Orthogonal rational functions with real poles, root asymptotics, and GMP matrices

abstract: There is a vast theory of the asymptotic behavior of orthogonal polynomials with respect to a measure on $\mathbb{R}$ and its applications to Jacobi matrices. That theory has an obvious affine invariance and a very special role for $\infty$. We extend aspects of this theory in the setting of rational functions with poles on $\overline{\mathbb{R}} = \mathbb{R} \cup \{\infty\}$, obtaining a formulation which allows multiple poles and proving an invariance with respect to $\overline{\mathbb{R}}$-preserving M\"obius transformations. We obtain a characterization of Stahl--Totik regularity of a GMP matrix in terms of its matrix elements; as an application, we give a proof of a conjecture of Simon -- a Ces\`aro--Nevai property of regular Jacobi matrices on finite gap sets.


title: Path homology and temporal networks

abstract: We present an algorithm to compute path homology for simple digraphs, and use it to topologically analyze various small digraphs en route to an analysis of complex temporal networks which exhibit such digraphs as underlying motifs. The digraphs analyzed include all digraphs, directed acyclic graphs, and undirected graphs up to certain numbers of vertices, as well as some specially constructed cases. Using information from this analysis, we identify small digraphs contributing to path homology in dimension $2$ for three temporal networks, and relate these digraphs to network behavior. We conclude that path homology can provide insight into temporal network structure and vice versa.


title: Randomness Quantification for Quantum Random Number Generation Based on Detection of Amplified Spontaneous Emission Noise

abstract: The amplified spontaneous emission (ASE) noise has been extensively studied and employed to build quantum random number generators (QRNGs). While the previous relative works mainly focus on the realization and verification of the QRNG system, the comprehensive physical model and randomness quantification for the general detection of the ASE noise are still incomplete, which is essential for the quantitative security analysis. In this paper, a systematical physical model for the emission, detection and acquisition of the ASE noise with added electronic noise is developed and verified, based on which the numerical simulations are performed under various setups and the simulation results all significantly fit well with the corresponding experimental data. Then, a randomness quantification method and the corresponding experimentally verifiable approach are proposed and validated, which quantifies the randomness purely resulted from the quantum process and improves the security analysis for the QRNG based on the detection of the ASE noise. The physical model and the randomness quantification method proposed in this paper are of significant feasibility and applicable for the QRNG system with randomness originating from the detection of the photon number with arbitrary distributions.


title: A Self-Reasoning Framework for Anomaly Detection Using Video-Level Labels

abstract: Anomalous event detection in surveillance videos is a challenging and practical research problem among image and video processing community. Compared to the frame-level annotations of anomalous events, obtaining video-level annotations is quite fast and cheap though such high-level labels may contain significant noise. More specifically, an anomalous labeled video may actually contain anomaly only in a short duration while the rest of the video frames may be normal. In the current work, we propose a weakly supervised anomaly detection framework based on deep neural networks which is trained in a self-reasoning fashion using only video-level labels. To carry out the self-reasoning based training, we generate pseudo labels by using binary clustering of spatio-temporal video features which helps in mitigating the noise present in the labels of anomalous videos. Our proposed formulation encourages both the main network and the clustering to complement each other in achieving the goal of more accurate anomaly detection. The proposed framework has been evaluated on publicly available real-world anomaly detection datasets including UCF-crime, ShanghaiTech and UCSD Ped2. The experiments demonstrate superiority of our proposed framework over the current state-of-the-art methods.


title: Generalized soap bubbles and the topology of manifolds with positive scalar curvature

abstract: We prove that for $n\in \{4,5\}$, a closed aspherical $n$-manifold does not admit a Riemannian metric with positive scalar curvature. Additionally, we show that for $n\leq 7$, the connected sum of a $n$-torus with an arbitrary manifold does not admit a complete metric of positive scalar curvature. When combined with forthcoming contributions by Lesourd--Unger--Yau, this proves that the Schoen--Yau Liouville theorem holds for all locally conformally flat manifolds with non-negative scalar curvature. A key tool in these results are generalized soap bubbles -- surfaces that are stationary for prescribed-mean-curvature functionals (also called $\mu$-bubbles).


title: Self-cleaning and self-cooling paper

abstract: The technique of passive daytime radiative cooling (PDRC) is used to cool an object down by simultaneously reflecting sunlight and thermally radiating heat to the cold outer space through the Earth's atmospheric window. However, for practical applications, current PDRC materials are facing unprecedented challenges such as complicated and expensive fabrication approaches and performance degradation arising from surface contamination. Here, we develop a scalable paper-based material with excellent self-cleaning and self-cooling capabilities, through air-spraying ethanolic polytetrafluoroethylene (PTFE) microparticles suspensions embedded within the micropores of the paper. The formed superhydrophobic PTFE coating not only protects the paper from water wetting and dust contamination for real-life applications but also reinforces its solar reflectance by sunlight backscattering. The paper fibers, when enhanced with PTFE particles, efficiently reflect sunlight and strongly radiate heat through the atmospheric window, resulting in a sub-ambient cooling performance of 5$^{\circ}$C and radiative cooling power of 104 W/m$^2$ under direct solar irradiance of 834 W/m$^2$ and 671 W/m$^2$, respectively. The self-cleaning surface of the cooling paper extends its lifespan and keep its good cooling performance for outdoor applications. Additionally, dyed papers are experimentally studied for broad engineering applications. They can absorb appropriate visible wavelengths to display specific colors and effectively reflect near-infrared lights to reduce solar heating, which synchronously achieves effective radiative cooling and aesthetic varieties in a cost-effective, scalable, and energy-efficient way.


title: CO observations toward HI-rich Ultra Diffuse Galaxies

abstract: We present CO observations toward a sample of six HI-rich Ultra-diffuse galaxies (UDGs) as well as one UDG (VLSB-A) in the Virgo Cluster with the IRAM 30-m telescope. CO 1-0 is marginally detected at 4sigma level in AGC122966, as the first detection of CO emission in UDGs. We estimate upper limits of molecular mass in other galaxies from the non-detection of CO lines. These upper limits and the marginal CO detection in AGC122966 indicate low mass ratios between molecular and atomic gas masses. With the star formation efficiency derived from the molecular gas, we suggest that the inefficiency of star formation in such HI-rich UDGs is likely caused by the low efficiency in converting molecules from atomic gas, instead of low efficiency in forming stars from molecular gas.


title: Phase-bistability between anticipated and delayed synchronization in neuronal populations

abstract: Two dynamical systems unidirectionally coupled in a sender-receiver configuration can synchronize with a nonzero phase-lag. In particular, the system can exhibit anticipated synchronization (AS), which is characterized by a negative phase-lag, if the receiver (R) also receives a delayed negative self-feedback. Recently, AS was shown to occur between cortical-like neuronal populations in which the self-feedback is mediated by inhibitory synapses. In this biologically plausible scenario, a transition from the usual delayed synchronization (DS, with positive phase-lag) to AS can be mediated by the inhibitory conductances in the receiver population. Here we show that depending on the relation between excitatory and inhibitory synaptic conductances the system can also exhibit phase-bistability between anticipated and delayed synchronization. Furthermore, we show that the amount of noise at the receiver and the synaptic conductances can mediate the transition from stable phase-locking to a bistable regime and eventually to a phase-drift (PD). We suggest that our spiking neuronal populations model could be potentially useful to study phase-bistability in cortical regions related to bistable perception.


title: Approximate Message Passing algorithms for rotationally invariant matrices

abstract: Approximate Message Passing (AMP) algorithms have seen widespread use across a variety of applications. However, the precise forms for their Onsager corrections and state evolutions depend on properties of the underlying random matrix ensemble, limiting the extent to which AMP algorithms derived for white noise may be applicable to data matrices that arise in practice. In this work, we study more general AMP algorithms for random matrices $W$ that satisfy orthogonal rotational invariance in law, where $W$ may have a spectral distribution that is different from the semicircle and Marcenko-Pastur laws characteristic of white noise. The Onsager corrections and state evolutions in these algorithms are defined by the free cumulants or rectangular free cumulants of the spectral distribution of $W$. Their forms were derived previously by Opper, \c{C}akmak, and Winther using non-rigorous dynamic functional theory techniques, and we provide rigorous proofs. Our motivating application is a Bayes-AMP algorithm for Principal Components Analysis, when there is prior structure for the principal components (PCs) and possibly non-white noise. For sufficiently large signal strengths and any non-Gaussian prior distributions for the PCs, we show that this algorithm provably achieves higher estimation accuracy than the sample PCs.

categories: math.PR cs.IT math.IT math.ST stat.ME stat.TH


title: Deformation of the scalar curvature and the mean curvature

abstract: On a compact manifold $M$ with boundary $\partial M$, we study the problem of prescribing the scalar curvature in $M$ and the mean curvature on the boundary $\partial M$ simultaneously. To do this, we introduce the notion of singular metric, which is inspired by the early work of Fischer-Marsden in [18] and Lin-Yuan in [23] for closed manifold. We show that we can prescribe the scalar curvature and the mean curvature simultaneously for generic scalar-flat manifolds with minimal boundary. We also prove some rigidity results for the flat manifolds with totally geodesic boundary.


title: Webly Supervised Image Classification with Self-Contained Confidence

abstract: This paper focuses on webly supervised learning (WSL), where datasets are built by crawling samples from the Internet and directly using search queries as web labels. Although WSL benefits from fast and low-cost data collection, noises in web labels hinder better performance of the image classification model. To alleviate this problem, in recent works, self-label supervised loss $\mathcal{L}_s$ is utilized together with webly supervised loss $\mathcal{L}_w$. $\mathcal{L}_s$ relies on pseudo labels predicted by the model itself. Since the correctness of the web label or pseudo label is usually on a case-by-case basis for each web sample, it is desirable to adjust the balance between $\mathcal{L}_s$ and $\mathcal{L}_w$ on sample level. Inspired by the ability of Deep Neural Networks (DNNs) in confidence prediction, we introduce Self-Contained Confidence (SCC) by adapting model uncertainty for WSL setting, and use it to sample-wisely balance $\mathcal{L}_s$ and $\mathcal{L}_w$. Therefore, a simple yet effective WSL framework is proposed. A series of SCC-friendly regularization approaches are investigated, among which the proposed graph-enhanced mixup is the most effective method to provide high-quality confidence to enhance our framework. The proposed WSL framework has achieved the state-of-the-art results on two large-scale WSL datasets, WebVision-1000 and Food101-N. Code is available at https://github.com/bigvideoresearch/SCC.


title: Multi-task Reinforcement Learning in Reproducing Kernel Hilbert Spaces via Cross-learning

abstract: Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a specific task. These methods require large amounts of reward samples to achieve good performance, and may not generalize well when the task is modified, even if the new task is related. In this paper we are interested in a collaborative scheme in which multiple agents with different tasks optimize their policies jointly. To this end, we introduce cross-learning, in which agents tackling related tasks have their policies constrained to be close to one another. Two properties make our new approach attractive: (i) it produces a multi-task central policy that can be used as a starting point to adapt quickly to one of the tasks trained for, in a situation when the agent does not know which task is currently facing, and (ii) as in meta-learning, it adapts to environments related but different to those seen during training. We focus on continuous policies belonging to reproducing kernel Hilbert spaces for which we bound the distance between the task-specific policies and the cross-learned policy. To solve the resulting optimization problem, we resort to a projected policy gradient algorithm and prove that it converges to a near-optimal solution with high probability. We evaluate our methodology with a navigation example in which agents can move through environments with obstacles of multiple shapes and avoid obstacles not trained for.


title: Random quench predicts universal properties of amorphous solids

abstract: Amorphous solids display numerous universal features in their mechanics, structure, and response. Current models assume heterogeneity in mesoscale elastic properties, but require fine-tuning in order to quantitatively explain vibrational properties. A complete model should derive the magnitude and character of elastic heterogeneity from an initially structureless medium, through a model of the quenching process during which the temperature is rapidly lowered and the solid is formed. Here we propose a field-theoretic model of a quench, and compute structural, mechanical, and vibrational observables in arbitrary dimension $d$. This allows us to relate the properties of the amorphous solid to those of the initial medium, and to those of the quench. We show that previous mean-field results are subsumed by our analysis and unify spatial fluctuations of elastic moduli, long-range correlations of inherent state stress, universal vibrational anomalies, and localized modes into one picture.


title: Automatic Speech Summarisation: A Scoping Review

abstract: Speech summarisation techniques take human speech as input and then output an abridged version as text or speech. Speech summarisation has applications in many domains from information technology to health care, for example improving speech archives or reducing clinical documentation burden. This scoping review maps the speech summarisation literature, with no restrictions on time frame, language summarised, research method, or paper type. We reviewed a total of 110 papers out of a set of 153 found through a literature search and extracted speech features used, methods, scope, and training corpora. Most studies employ one of four speech summarisation architectures: (1) Sentence extraction and compaction; (2) Feature extraction and classification or rank-based sentence selection; (3) Sentence compression and compression summarisation; and (4) Language modelling. We also discuss the strengths and weaknesses of these different methods and speech features. Overall, supervised methods (e.g. Hidden Markov support vector machines, Ranking support vector machines, Conditional random fields) performed better than unsupervised methods. As supervised methods require manually annotated training data which can be costly, there was more interest in unsupervised methods. Recent research into unsupervised methods focusses on extending language modelling, for example by combining Uni-gram modelling with deep neural networks. Protocol registration: The protocol for this scoping review is registered at https://osf.io.


title: Pose-Guided High-Resolution Appearance Transfer via Progressive Training

abstract: We propose a novel pose-guided appearance transfer network for transferring a given reference appearance to a target pose in unprecedented image resolution (1024 * 1024), given respectively an image of the reference and target person. No 3D model is used. Instead, our network utilizes dense local descriptors including local perceptual loss and local discriminators to refine details, which is trained progressively in a coarse-to-fine manner to produce the high-resolution output to faithfully preserve complex appearance of garment textures and geometry, while hallucinating seamlessly the transferred appearances including those with dis-occlusion. Our progressive encoder-decoder architecture can learn the reference appearance inherent in the input image at multiple scales. Extensive experimental results on the Human3.6M dataset, the DeepFashion dataset, and our dataset collected from YouTube show that our model produces high-quality images, which can be further utilized in useful applications such as garment transfer between people and pose-guided human video generation.


title: CausalFlow: Visual Analytics of Causality in Event Sequences

abstract: Understanding the relation of events plays an important role in different domains, such as identifying the reasons for users' certain actions from application logs as well as explaining sports players' behaviors according to historical records. Co-occurrence has been widely used to characterize the relation of events. However, insights provided by the co-occurrence relation are vague, which leads to difficulties in addressing domain problems. In this paper, we use causation to model the relation of events and present a visualization approach for conducting the causation analysis of event sequences. We integrate automatic causal discovery methods into the approach and propose a model for detecting event causalities. Considering the interpretability, we design a novel visualization named causal flow to integrate the detected causality into timeline-based event sequence visualizations. With this design, users can understand the occurrence of certain events and identify the causal pathways. We further implement an interactive system to help users comprehensively analyze event sequences. Two case studies are provided to evaluate the usability of the approach.


title: A Brief Survey on Replica Consistency in Cloud Environments

abstract: Cloud computing is a general term that involves delivering hosted services over the Internet. With the accelerated growth of the volume of data used by applications, many organizations have moved their data into cloud servers to provide scalable, reliable and highly available services. A particularly challenging issue that arises in the context of cloud storage systems with geographically-distributed data replication is how to reach a consistent state for all replicas. This survey reviews major aspects related to consistency issues in cloud data storage systems, categorizing recently proposed methods into three categories: (1) fixed consistency methods, (2) configurable consistency methods and (3) consistency monitoring methods.


title: Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving

abstract: We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view representations, and we propose an efficient and generic fusing method that aggregates benefits from all views. Our model builds on a state-of-the-art Bird's-Eye View (BEV) network that fuses voxelized features from a sequence of historical LiDAR data as well as rasterized high-definition map to perform detection and prediction tasks. We extend this model with additional LiDAR Range-View (RV) features that use the raw LiDAR information in its native, non-quantized representation. The RV feature map is projected into BEV and fused with the BEV features computed from LiDAR and high-definition map. The fused features are then further processed to output the final detections and trajectories, within a single end-to-end trainable network. In addition, the RV fusion of LiDAR and camera is performed in a straightforward and computationally efficient manner using this framework. The proposed multi-view fusion approach improves the state-of-the-art on proprietary large-scale real-world data collected by a fleet of self-driving vehicles, as well as on the public nuScenes data set with minimal increases on the computational cost.


title: Strange quark helicity in the proton from chiral effective theory

abstract: We compute the helicity-dependent strange quark distribution in the proton in the framework of chiral effective theory. Starting from the most general chiral SU(3) Lagrangian that respects Lorentz and gauge invariance, we derive the complete set of hadronic splitting functions at the one meson loop level, including the octet and decuplet rainbow, tadpole, Kroll-Ruderman and octet-decuplet transition configurations. By matching hadronic and quark level operators, we obtain generalized convolution formulas for the quark distributions in the proton in terms of hadronic splitting functions and quark distributions in the hadronic configurations, and from these derive model-independent relations for the leading nonanalytic behavior of their moments. Within the limits of parameters of the Pauli-Villars regulators derived from inclusive hyperon production, we find that the polarized strange quark distribution is rather small and mostly negative.


title: Statistical inference for principal components of spiked covariance matrices

abstract: In this paper, we study the asymptotic behavior of the extreme eigenvalues and eigenvectors of the high dimensional spiked sample covariance matrices, in the supercritical case when a reliable detection of spikes is possible. Especially, we derive the joint distribution of the extreme eigenvalues and the generalized components of the associated eigenvectors, i.e., the projections of the eigenvectors onto arbitrary given direction, assuming that the dimension and sample size are comparably large. In general, the joint distribution is given in terms of linear combinations of finitely many Gaussian and Chi-square variables, with parameters depending on the projection direction and the spikes. Our assumption on the spikes is fully general. First, the strengths of spikes are only required to be slightly above the critical threshold and no upper bound on the strengths is needed. Second, multiple spikes, i.e., spikes with the same strength, are allowed. Third, no structural assumption is imposed on the spikes. Thanks to the general setting, we can then apply the results to various high dimensional statistical hypothesis testing problems involving both the eigenvalues and eigenvectors. Specifically, we propose accurate and powerful statistics to conduct hypothesis testing on the principal components. These statistics are data-dependent and adaptive to the underlying true spikes. Numerical simulations also confirm the accuracy and powerfulness of our proposed statistics and illustrate significantly better performance compared to the existing methods in the literature. Especially, our methods are accurate and powerful even when either the spikes are small or the dimension is large.


title: A Precise Performance Analysis of Learning with Random Features

abstract: We study the problem of learning an unknown function using random feature models. Our main contribution is an exact asymptotic analysis of such learning problems with Gaussian data. Under mild regularity conditions for the feature matrix, we provide an exact characterization of the asymptotic training and generalization errors, valid in both the under-parameterized and over-parameterized regimes. The analysis presented in this paper holds for general families of feature matrices, activation functions, and convex loss functions. Numerical results validate our theoretical predictions, showing that our asymptotic findings are in excellent agreement with the actual performance of the considered learning problem, even in moderate dimensions. Moreover, they reveal an important role played by the regularization, the loss function and the activation function in the mitigation of the "double descent phenomenon" in learning.


title: On a torsion analogue of the weight-monodromy conjecture

abstract: We formulate and study a torsion analogue of the weight-monodromy conjecture for a proper smooth scheme over a non-archimedean local field. We prove it for proper smooth schemes over equal characteristic non-archimedean local fields, abelian varieties, surfaces, varieties uniformized by Drinfeld upper half spaces, and set-theoretic complete intersections in toric varieties. In the equal characteristic case, our methods rely on an ultraproduct variant of Weil II established by Cadoret.


title: A principled analysis of Behavior Trees and their generalisations

abstract: As complex autonomous robotic systems become more widespread, the need for transparent and reusable Artificial Intelligence (AI) designs becomes more apparent. In this paper we analyse how the principles behind Behavior Trees (BTs), an increasingly popular tree-structured control architecture, are applicable to these goals. Using structured programming as a guide, we analyse the BT principles of reactiveness and modularity in a formal framework of action selection. Proceeding from these principles, we review a number of challenging use cases of BTs in the literature, and show that reasoning via these principles leads to compatible solutions. Extending these arguments, we introduce a new class of control architectures we call generalised BTs or $k$-BTs and show how they can extend the applicability of BTs to some of the aforementioned challenging BT use cases while preserving the BT principles.


title: Reducibility of relativistic Schr\"odinger equation with unbounded perturbations

abstract: In this paper, we prove a reducibility result for a relativistic Schr\"odinger equation on torus with time quasi-periodic unbounded perturbations of order 1/2, and finally conjugate the original equation to a time independent, 2\times 2 block diagonal one.


title: MultiGBS: A multi-layer graph approach to biomedical summarization

abstract: Automatic text summarization methods generate a shorter version of the input text to assist the reader in gaining a quick yet informative gist. Existing text summarization methods generally focus on a single aspect of text when selecting sentences, causing the potential loss of essential information. In this study, we propose a domain-specific method that models a document as a multi-layer graph to enable multiple features of the text to be processed at the same time. The features we used in this paper are word similarity, semantic similarity, and co-reference similarity, which are modelled as three different layers. The unsupervised method selects sentences from the multi-layer graph based on the MultiRank algorithm and the number of concepts. The proposed MultiGBS algorithm employs UMLS and extracts the concepts and relationships using different tools such as SemRep, MetaMap, and OGER. Extensive evaluation by ROUGE and BERTScore shows increased F-measure values.


title: Muon Anomalous Magnetic Moment in Two Higgs Doublet Models with Vector-Like Leptons

abstract: We show that inclusion of a single generation of vector-like leptons in the Two-Higgs Doublet Models significantly enlarges the allowed parameter space consistent with the muon anomalous magnetic moment, as well as with other theoretical and experimental constraints. While previously $(g -2)_\mu$ could only be resolved in Type-X scenario by requiring a light pseudoscalar Higgs boson and large $\tan \beta$, contributions of vector-like leptons via two-loop Barr Zee diagrams broaden the allowed parameter space, allowing $\tan \beta$ as low as 10 and pseudoscalar masses as large as $\cal{O}$(1 TeV) while fulfilling the stringent constraints from precision and flavor observable. Similar results are obtained for Type-II scenarios, but there the parameter space is more restricted by flavor observables.


title: Response to Comment on "A Loophole of All "Loophole-Free" Bell-Type Theorems", by J.P. Lambare

abstract: Contrary to what Lambare [arXiv:2008.00369] assumes, in non-Newtonian calculus (a calculus based on non-Diophantine arithmetic) an integral is typically given by a nonlinear map. This is the technical reason why all the standard proofs of Bell-type inequalities fail if non-Newtonian hidden variables are taken into account. From the non-Newtonian perspective, Bell's inequality is a property of a limited and unphysical class of hidden-variable models. An explicit counterexample to Bell's theorem can be easily constructed.


title: Domain Adaptation Through Task Distillation

abstract: Deep networks devour millions of precisely annotated images to build their complex and powerful representations. Unfortunately, tasks like autonomous driving have virtually no real-world training data. Repeatedly crashing a car into a tree is simply too expensive. The commonly prescribed solution is simple: learn a representation in simulation and transfer it to the real world. However, this transfer is challenging since simulated and real-world visual experiences vary dramatically. Our core observation is that for certain tasks, such as image recognition, datasets are plentiful. They exist in any interesting domain, simulated or real, and are easy to label and extend. We use these recognition datasets to link up a source and target domain to transfer models between them in a task distillation framework. Our method can successfully transfer navigation policies between drastically different simulators: ViZDoom, SuperTuxKart, and CARLA. Furthermore, it shows promising results on standard domain adaptation benchmarks.


title: An alternative to hypercovers

abstract: I introduce a class of diagrams in a Grothendieck site called "atlases" which can be used to study hyperdescent, and show that hypersheaves take atlases to limits using an indexed `nerve' construction that produces hypercovers from atlases. Atlases have the flexibility to be at the same time more explicit and more universal than hypercovers.


title: Entwined modules over representations of categories

abstract: We introduce a theory of modules over a representation of a small category taking values in entwining structures over a semiperfect coalgebra. This takes forward the aim of developing categories of entwined modules to the same extent as that of module categories as well as the philosophy of Mitchell of working with rings with several objects. The representations are motivated by work of Estrada and Virili, who developed a theory of modules over a representation taking values in small preadditive categories, which were then studied in the same spirit as sheaves of modules over a scheme. We also describe, by means of Frobenius and separable functors, how our theory relates to that of modules over the underlying representation taking values in small $K$-linear categories.


title: Hard Magnetic Topological Semimetals in XPt3: Harmony of Berry Curvature

abstract: Topological magnetic semimetals, like Co3Sn2S2 and Co2MnGa, are known to display exotic transport properties, such as large intrinsic anomalous (AHE) due to uncompensated Berry curvature. The highly symmetric XPt3 compounds display anti-crossing gapped nodal lines, which are a driving mechanism in the intrinsic Berry curvature Hall effects. Uniquely, these compounds contain two sets of gapped nodal lines that harmoniously dominate the Berry curvature in this complex multiband system. We calculate a maximum AHE of 1965 S/cm in the CrPt3 by a state-of-the-art first principle electronic structure. We have grown high-quality thin films by magnetron sputtering and measured a robust AHE of 1750 S/cm for different sputtering growth conditions. Additionally, the cubic films display a hard magnetic axis along [111] direction. The facile and scalable fabrication of these materials is prime candidates for integration into topological devices.


title: Non-thermal line broadening due to braiding-induced turbulence in solar coronal loops

abstract: Aims: Emission line profiles from solar coronal loops exhibit properties that are unexplained by current models. We investigate the non-thermal broadening associated with plasma heating in coronal loops that is induced by magnetic field line braiding. Methods: We describe the coronal loop by a 3D magnetohydrodynamic model of the turbulent decay of an initially-braided magnetic field. From this we synthesize the Fe XII line at 193 Angstroms that forms around 1.5 MK. Results: Key features of current observations of extreme UV lines from the corona are reproduced in the synthesised spectra: (i) Typical non-thermal widths range from 15 to 20 km/s. (ii) The widths are approximately independent of the size of the field of view. (iii) There is a correlation between line intensity and the non-thermal broadening. (iv) Spectra are found to be non-Gaussian, with enhanced power in the wings of order 10-20%. Conclusions: Our model provides an explanation that self-consistently connects the heating process to the observed non-thermal line broadening. The non-Gaussian nature of the spectra is a consequence of the non-Gaussian nature of the underlying velocity fluctuations, interpreted as a signature of intermittency in the turbulence.


title: Generalization of the circular dichroism from metallic arrays that support Bloch-like surface plasmon polaritons

abstract: The broken mirror symmetry in subwavelength photonic systems has manifested many interesting chiroptical effects such as optical rotation and circular dichroism. When such systems are placed periodically in a lattice form, in addition to intrinsic chirality, extrinsic chirality also takes part, and the overall effect depends not only on the basis and lattice but also the excitation configuration. Here, we study planar chiral nanohole arrays in square lattice that support Bloch-like surface plasmon polaritons (SPPs) and clarify how the system geometry and the excitation contribute to circular dichroism. By using temporal coupled mode theory (CMT), the dissymmetry factor and the scattering matrix of the arrays are analytically formulated. Remarkably, we find the dissymmetry factor depends only on the coupling polarization angle and the in-coupling phase difference between the p- and s-polarizations. Besides, the upper limit of the dissymmetry factor at +/-2 can be reached simply by orienting the lattice of the arrays for properly exciting the Bloch-like SPPs and at the same time making the basis mimic two orthogonal and relatively displaced dipoles, demonstrating the interplay between extrinsic and intrinsic chirality. The models have been verified by numerical simulations and experiments, yielding the dissymmetry factors to be 1.82 and 1.55, respectively, from the proposed dual slot system.


title: Fingerprint Feature Extraction by Combining Texture, Minutiae, and Frequency Spectrum Using Multi-Task CNN

abstract: Although most fingerprint matching methods utilize minutia points and/or texture of fingerprint images as fingerprint features, the frequency spectrum is also a useful feature since a fingerprint is composed of ridge patterns with its inherent frequency band. We propose a novel CNN-based method for extracting fingerprint features from texture, minutiae, and frequency spectrum. In order to extract effective texture features from local regions around the minutiae, the minutia attention module is introduced to the proposed method. We also propose new data augmentation methods, which takes into account the characteristics of fingerprint images to increase the number of images during training since we use only a public dataset in training, which includes a few fingerprint classes. Through a set of experiments using FVC2004 DB1 and DB2, we demonstrated that the proposed method exhibits the efficient performance on fingerprint verification compared with a commercial fingerprint matching software and the conventional method.


title: Dynamic Batch Learning in High-Dimensional Sparse Linear Contextual Bandits

abstract: We study the problem of dynamic batch learning in high-dimensional sparse linear contextual bandits, where a decision maker, under a given maximum-number-of-batch constraint and only able to observe rewards at the end of each batch, can dynamically decide how many individuals to include in the next batch (at the end of the current batch) and what personalized action-selection scheme to adopt within each batch. Such batch constraints are ubiquitous in a variety of practical contexts, including personalized product offerings in marketing and medical treatment selection in clinical trials. We characterize the fundamental learning limit in this problem via a regret lower bound and provide a matching upper bound (up to log factors), thus prescribing an optimal scheme for this problem. To the best of our knowledge, our work provides the first inroad into a theoretical understanding of dynamic batch learning in high-dimensional sparse linear contextual bandits. Notably, even a special case of our result -- when no batch constraint is present -- yields that the simple exploration-free algorithm using the LASSO estimator already achieves the minimax optimal regret bound for standard online learning in high-dimensional linear contextual bandits (for the no-margin case), a result that appears unknown in the emerging literature of high-dimensional contextual bandits.