title: Hierarchical Optimization Time Integration for CFL-rate MPM Stepping

abstract: We propose Hierarchical Optimization Time Integration (HOT) for efficient implicit time-stepping of the Material Point Method (MPM) irrespective of simulated materials and conditions. HOT is an MPM-specialized hierarchical optimization algorithm that solves nonlinear time step problems for large-scale MPM systems near the CFL-limit. HOT provides convergent simulations "out-of-the-box" across widely varying materials and computational resolutions without parameter tuning. As an implicit MPM time stepper accelerated by a custom-designed Galerkin multigrid wrapped in a quasi-Newton solver, HOT is both highly parallelizable and robustly convergent. As we show in our analysis, HOT maintains consistent and efficient performance even as we grow stiffness, increase deformation, and vary materials over a wide range of finite strain, elastodynamic and plastic examples. Through careful benchmark ablation studies, we compare the effectiveness of HOT against seemingly plausible alternative combinations of MPM with standard multigrid and other Newton-Krylov models. We show how these alternative designs result in severe issues and poor performance. In contrast, HOT outperforms the existing state-of-the-art, heavily optimized implicit MPM codes with an up to 10x performance speedup across a wide range of challenging benchmark test simulations.


title: On the Price of Satisficing in Network User Equilibria

abstract: When network users are satisficing decision-makers, the resulting traffic pattern attains a satisficing user equilibrium, which may deviate from the (perfectly rational) user equilibrium. In a satisficing user equilibrium traffic pattern, the total system travel time can be worse than in the case of the PRUE. We show how bad the worst-case satisficing user equilibrium traffic pattern can be, compared to the perfectly rational user equilibrium. We call the ratio between the total system travel times of the two traffic patterns the price of satisficing, for which we provide an analytical bound. We compare the analytical bound with numerical bounds for several transportation networks.


title: Bayesian Learning of Occupancy Grids

abstract: Occupancy grids encode for hot spots on a map that is represented by a two dimensional grid of disjoint cells. The problem is to recursively update the probability that each cell in the grid is occupied, based on a sequence of sensor measurements from a moving platform. In this paper, we provide a new Bayesian framework for generating these probabilities that does not assume statistical independence between the occupancy state of grid cells. This approach is made analytically tractable through the use of binary asymmetric channel models that capture the errors associated with observing the occupancy state of a grid cell. Binary-valued measurement vectors are the thresholded output of a sensor in a radar, sonar, or other sensory system. We compare the performance of the proposed framework to that of the classical formulation for occupancy grids. The results show that the proposed framework identifies occupancy grids with lower false alarm and miss detection rates, and requires fewer observations of the surrounding area, to generate an accurate estimate of occupancy probabilities when compared to conventional formulations.


title: Face shape classification using Inception v3

abstract: In this paper, we present experimental results obtained from retraining the last layer of the Inception v3 model in classifying images of human faces into one of five basic face shapes. The accuracy of the retrained Inception v3 model was compared with that of the following classification methods that uses facial landmark distance ratios and angles as features: linear discriminant analysis (LDA), support vector machines with linear kernel (SVM-LIN), support vector machines with radial basis function kernel (SVM-RBF), artificial neural networks or multilayer perceptron (MLP), and k-nearest neighbors (KNN). All classifiers were trained and tested using a total of 500 images of female celebrities with known face shapes collected from the Internet. Results show that training accuracy and overall accuracy ranges from 98.0% to 100% and from 84.4% to 84.8% for Inception v3 and from 50.6% to 73.0% and from 36.4% to 64.6% for the other classifiers depending on the training set size used. This result shows that the retrained Inception v3 model was able to fit the training data well and outperform the other classifiers without the need to handpick specific features to include in model training. Future work should consider expanding the labeled dataset, preferably one that can also be freely distributed to the research community, so that proper model cross-validation can be performed. As far as we know, this is the first in the literature to use convolutional neural networks in face-shape classification. The scripts are available at https://github.com/adonistio/inception-face-shape-classifier.


title: Cross-modal supervised learning for better acoustic representations

abstract: Obtaining large-scale human-labeled datasets to train acoustic representation models is a very challenging task. On the contrary, we can easily collect data with machine-generated labels. In this work, we propose to exploit machine-generated labels to learn better acoustic representations, based on the synchronization between vision and audio. Firstly, we collect a large-scale video dataset with 15 million samples, which totally last 16,320 hours. Each video is 3 to 5 seconds in length and annotated automatically by publicly available visual and audio classification models. Secondly, we train various classical convolutional neural networks (CNNs) including VGGish, ResNet 50 and Mobilenet v2. We also make several improvements to VGGish and achieve better results. Finally, we transfer our models on three external standard benchmarks for audio classification task, and achieve significant performance boost over the state-of-the-art results. Models and codes are available at: https://github.com/Deeperjia/vgg-like-audio-models.


title: Improving Document Classification with Multi-Sense Embeddings

abstract: Efficient representation of text documents is an important building block in many NLP tasks. Research on long text categorization has shown that simple weighted averaging of word vectors for sentence representation often outperforms more sophisticated neural models. Recently proposed Sparse Composite Document Vector (SCDV) (Mekala et. al, 2017) extends this approach from sentences to documents using soft clustering over word vectors. However, SCDV disregards the multi-sense nature of words, and it also suffers from the curse of higher dimensionality. In this work, we address these shortcomings and propose SCDV-MS. SCDV-MS utilizes multi-sense word embeddings and learns a lower dimensional manifold. Through extensive experiments on multiple real-world datasets, we show that SCDV-MS embeddings outperform previous state-of-the-art embeddings on multi-class and multi-label text categorization tasks. Furthermore, SCDV-MS embeddings are more efficient than SCDV in terms of time and space complexity on textual classification tasks.


title: ASV: Accelerated Stereo Vision System

abstract: Estimating depth from stereo vision cameras, i.e., "depth from stereo", is critical to emerging intelligent applications deployed in energy- and performance-constrained devices, such as augmented reality headsets and mobile autonomous robots. While existing stereo vision systems make trade-offs between accuracy, performance and energy-efficiency, we describe ASV, an accelerated stereo vision system that simultaneously improves both performance and energy-efficiency while achieving high accuracy. The key to ASV is to exploit unique characteristics inherent to stereo vision, and apply stereo-specific optimizations, both algorithmically and computationally. We make two contributions. Firstly, we propose a new stereo algorithm, invariant-based stereo matching (ISM), that achieves significant speedup while retaining high accuracy. The algorithm combines classic "hand-crafted" stereo algorithms with recent developments in Deep Neural Networks (DNNs), by leveraging the correspondence invariant unique to stereo vision systems. Secondly, we observe that the bottleneck of the ISM algorithm is the DNN inference, and in particular the deconvolution operations that introduce massive compute-inefficiencies. We propose a set of software optimizations that mitigate these inefficiencies. We show that with less than 0.5% hardware area overhead, these algorithmic and computational optimizations can be effectively integrated within a conventional DNN accelerator. Overall, ASV achieves 5x speedup and 85% energy saving with 0.02% accuracy loss compared to today DNN-based stereo vision systems.


title: Data-driven modeling of the chaotic thermal convection in an annular thermosyphon

abstract: dentifying accurate and yet interpretable low-order models from data has gained a renewed interest over the past decade. In the present work, we illustrate how the combined use of dimensionality reduction and sparse system identification techniques allows us to obtain an accurate model of the chaotic thermal convection in a two-dimensional annular thermosyphon. Taking as guidelines the derivation of the Lorenz system, the chaotic thermal convection dynamics simulated using a high-fidelity computational fluid dynamics solver are first embedded into a low-dimensional space using dynamic mode decomposition. After having reviewed the physical properties the reduced-order model should exhibit, the latter is identified using SINDy, an increasingly popular and flexible framework for the identification of nonlinear continuous-time dynamical systems from data. The identified model closely resembles the canonical Lorenz system, having a similar structure and exhibiting the same physical properties. Finally, extensions to other flow configurations with or without control are discussed.


title: Privacy Leakage Avoidance with Switching Ensembles

abstract: We consider membership inference attacks, one of the main privacy issues in machine learning. These recently developed attacks have been proven successful in determining, with confidence better than a random guess, whether a given sample belongs to the dataset on which the attacked machine learning model was trained. Several approaches have been developed to mitigate this privacy leakage but the tradeoff performance implications of these defensive mechanisms (i.e., accuracy and utility of the defended machine learning model) are not well studied yet. We propose a novel approach of privacy leakage avoidance with switching ensembles (PASE), which both protects against current membership inference attacks and does that with very small accuracy penalty, while requiring acceptable increase in training and inference time. We test our PASE method, along with the the current state-of-the-art PATE approach, on three calibration image datasets and analyze their tradeoffs.


title: Patch augmentation: Towards efficient decision boundaries for neural networks

abstract: In this paper we propose a new augmentation technique, called patch augmentation, that, in our experiments, improves model accuracy and makes networks more robust to adversarial attacks. In brief, this data-independent approach creates new image data based on image/label pairs, where a patch from one of the two images in the pair is superimposed on to the other image, creating a new augmented sample. The new image's label is a linear combination of the image pair's corresponding labels. Initial experiments show a several percentage point increase in accuracy on CIFAR-10, from a baseline of approximately 81% to 89%. CIFAR-100 sees larger improvements still, from a baseline of 52% to 68% accuracy. Networks trained using patch augmentation are also more robust to adversarial attacks, which we demonstrate using the Fast Gradient Sign Method.


title: Cluster-wise Unsupervised Hashing for Cross-Modal Similarity Search

abstract: Large-scale cross-modal hashing similarity retrieval has attracted more and more attention in modern search applications such as search engines and autopilot, showing great superiority in computation and storage. However, current unsupervised cross-modal hashing methods still have some limitations: (1)many methods relax the discrete constraints to solve the optimization objective which may significantly degrade the retrieval performance;(2)most existing hashing model project heterogenous data into a common latent space, which may always lose sight of diversity in heterogenous data;(3)transforming real-valued data point to binary codes always results in abundant loss of information, producing the suboptimal continuous latent space. To overcome above problems, in this paper, a novel Cluster-wise Unsupervised Hashing (CUH) method is proposed. Specifically, CUH jointly performs the multi-view clustering that projects the original data points from different modalities into its own low-dimensional latent semantic space and finds the cluster centroid points and the common clustering indicators in its own low-dimensional space, and learns the compact hash codes and the corresponding linear hash functions. An discrete optimization framework is developed to learn the unified binary codes across modalities under the guidance cluster-wise code-prototypes. The reasonableness and effectiveness of CUH is well demonstrated by comprehensive experiments on diverse benchmark datasets.


title: Logo-2K+: A Large-Scale Logo Dataset for Scalable Logo Classification

abstract: Logo classification has gained increasing attention for its various applications, such as copyright infringement detection, product recommendation and contextual advertising. Compared with other types of object images, the real-world logo images have larger variety in logo appearance and more complexity in their background. Therefore, recognizing the logo from images is challenging. To support efforts towards scalable logo classification task, we have curated a dataset, Logo-2K+, a new large-scale publicly available real-world logo dataset with 2,341 categories and 167,140 images. Compared with existing popular logo datasets, such as FlickrLogos-32 and LOGO-Net, Logo-2K+ has more comprehensive coverage of logo categories and larger quantity of logo images. Moreover, we propose a Discriminative Region Navigation and Augmentation Network (DRNA-Net), which is capable of discovering more informative logo regions and augmenting these image regions for logo classification. DRNA-Net consists of four sub-networks: the navigator sub-network first selected informative logo-relevant regions guided by the teacher sub-network, which can evaluate its confidence belonging to the ground-truth logo class. The data augmentation sub-network then augments the selected regions via both region cropping and region dropping. Finally, the scrutinizer sub-network fuses features from augmented regions and the whole image for logo classification. Comprehensive experiments on Logo-2K+ and other three existing benchmark datasets demonstrate the effectiveness of proposed method. Logo-2K+ and the proposed strong baseline DRNA-Net are expected to further the development of scalable logo image recognition, and the Logo-2K+ dataset can be found at https://github.com/msn199959/Logo-2k-plus-Dataset.


title: WaveletKernelNet: An Interpretable Deep Neural Network for Industrial Intelligent Diagnosis

abstract: Convolutional neural network (CNN), with ability of feature learning and nonlinear mapping, has demonstrated its effectiveness in prognostics and health management (PHM). However, explanation on the physical meaning of a CNN architecture has rarely been studied. In this paper, a novel wavelet driven deep neural network termed as WaveletKernelNet (WKN) is presented, where a continuous wavelet convolutional (CWConv) layer is designed to replace the first convolutional layer of the standard CNN. This enables the first CWConv layer to discover more meaningful filters. Furthermore, only the scale parameter and translation parameter are directly learned from raw data at this CWConv layer. This provides a very effective way to obtain a customized filter bank, specifically tuned for extracting defect-related impact component embedded in the vibration signal. In addition, three experimental verification using data from laboratory environment are carried out to verify effectiveness of the proposed method for mechanical fault diagnosis. The results show the importance of the designed CWConv layer and the output of CWConv layer is interpretable. Besides, it is found that WKN has fewer parameters, higher fault classification accuracy and faster convergence speed than standard CNN.


title: VITON-GAN: Virtual Try-on Image Generator Trained with Adversarial Loss

abstract: Generating a virtual try-on image from in-shop clothing images and a model person's snapshot is a challenging task because the human body and clothes have high flexibility in their shapes. In this paper, we develop a Virtual Try-on Generative Adversarial Network (VITON-GAN), that generates virtual try-on images using images of in-shop clothing and a model person. This method enhances the quality of the generated image when occlusion is present in a model person's image (e.g., arms crossed in front of the clothes) by adding an adversarial mechanism in the training pipeline.


title: Deep Learning Captures More Accurate Diffusion Fiber Orientations Distributions than Constrained Spherical Deconvolution

abstract: Confocal histology provides an opportunity to establish intra-voxel fiber orientation distributions that can be used to quantitatively assess the biological relevance of diffusion weighted MRI models, e.g., constrained spherical deconvolution (CSD). Here, we apply deep learning to investigate the potential of single shell diffusion weighted MRI to explain histologically observed fiber orientation distributions (FOD) and compare the derived deep learning model with a leading CSD approach. This study (1) demonstrates that there exists additional information in the diffusion signal that is not currently exploited by CSD, and (2) provides an illustrative data-driven model that makes use of this information.


title: Visual Dialogue State Tracking for Question Generation

abstract: GuessWhat?! is a visual dialogue task between a guesser and an oracle. The guesser aims to locate an object supposed by the oracle oneself in an image by asking a sequence of Yes/No questions. Asking proper questions with the progress of dialogue is vital for achieving successful final guess. As a result, the progress of dialogue should be properly represented and tracked. Previous models for question generation pay less attention on the representation and tracking of dialogue states, and therefore are prone to asking low quality questions such as repeated questions. This paper proposes visual dialogue state tracking (VDST) based method for question generation. A visual dialogue state is defined as the distribution on objects in the image as well as representations of objects. Representations of objects are updated with the change of the distribution on objects. An object-difference based attention is used to decode new question. The distribution on objects is updated by comparing the question-answer pair and objects. Experimental results on GuessWhat?! dataset show that our model significantly outperforms existing methods and achieves new state-of-the-art performance. It is also noticeable that our model reduces the rate of repeated questions from more than 50% to 21.9% compared with previous state-of-the-art methods.


title: A Smartphone-Based Skin Disease Classification Using MobileNet CNN

abstract: The MobileNet model was used by applying transfer learning on the 7 skin diseases to create a skin disease classification system on Android application. The proponents gathered a total of 3,406 images and it is considered as imbalanced dataset because of the unequal number of images on its classes. Using different sampling method and preprocessing of input data was explored to further improved the accuracy of the MobileNet. Using under-sampling method and the default preprocessing of input data achieved an 84.28% accuracy. While, using imbalanced dataset and default preprocessing of input data achieved a 93.6% accuracy. Then, researchers explored oversampling the dataset and the model attained a 91.8% accuracy. Lastly, by using oversampling technique and data augmentation on preprocessing the input data provide a 94.4% accuracy and this model was deployed on the developed Android application.


title: BiNet: Degraded-Manuscript Binarization in Diverse Document Textures and Layouts using Deep Encoder-Decoder Networks

abstract: Handwritten document-image binarization is a semantic segmentation process to differentiate ink pixels from background pixels. It is one of the essential steps towards character recognition, writer identification, and script-style evolution analysis. The binarization task itself is challenging due to the vast diversity of writing styles, inks, and paper materials. It is even more difficult for historical manuscripts due to the aging and degradation of the documents over time. One of such manuscripts is the Dead Sea Scrolls (DSS) image collection, which poses extreme challenges for the existing binarization techniques. This article proposes a new binarization technique for the DSS images using the deep encoder-decoder networks. Although the artificial neural network proposed here is primarily designed to binarize the DSS images, it can be trained on different manuscript collections as well. Additionally, the use of transfer learning makes the network already utilizable for a wide range of handwritten documents, making it a unique multi-purpose tool for binarization. Qualitative results and several quantitative comparisons using both historical manuscripts and datasets from handwritten document image binarization competition (H-DIBCO and DIBCO) exhibit the robustness and the effectiveness of the system. The best performing network architecture proposed here is a variant of the U-Net encoder-decoders.


title: CAGFuzz: Coverage-Guided Adversarial Generative Fuzzing Testing of Deep Learning Systems

abstract: Deep Learning systems (DL) based on Deep Neural Networks (DNNs) are more and more used in various aspects of our life, including unmanned vehicles, speech processing, and robotics. However, due to the limited dataset and the dependence on manual labeling data, DNNs often fail to detect their erroneous behaviors, which may lead to serious problems. Several approaches have been proposed to enhance the input examples for testing DL systems. However, they have the following limitations. First, they design and generate adversarial examples from the perspective of model, which may cause low generalization ability when they are applied to other models. Second, they only use surface feature constraints to judge the difference between the adversarial example generated and the original example. The deep feature constraints, which contain high-level semantic information, such as image object category and scene semantics are completely neglected. To address these two problems, in this paper, we propose CAGFuzz, a Coverage-guided Adversarial Generative Fuzzing testing approach, which generates adversarial examples for a targeted DNN to discover its potential defects. First, we train an adversarial case generator (AEG) from the perspective of general data set. Second, we extract the depth features of the original and adversarial examples, and constrain the adversarial examples by cosine similarity to ensure that the semantic information of adversarial examples remains unchanged. Finally, we retrain effective adversarial examples to improve neuron testing coverage rate. Based on several popular data sets, we design a set of dedicated experiments to evaluate CAGFuzz. The experimental results show that CAGFuzz can improve the neuron coverage rate, detect hidden errors, and also improve the accuracy of the target DNN.


title: Copy-Move Forgery Classification via Unsupervised Domain Adaptation

abstract: In the current era, image manipulation is becoming increasingly easier, yielding more natural looking images, owing to the modern tools in image processing and computer vision techniques. The task of the segregation of forged images has become very challenging. To tackle such problems, publicly available datasets are insufficient. In this paper, we propose to create a synthetic forged dataset using deep semantic image inpainting algorithm. Furthermore, we use an unsupervised domain adaptation network to detect copy-move forgery in images. Our approach can be helpful in those cases, where the classification of data is unavailable.


title: Dont Even Look Once: Synthesizing Features for Zero-Shot Detection

abstract: Zero-shot detection, namely, localizing both seen and unseen objects, increasingly gains importance for large-scale applications, with large number of object classes, since, collecting sufficient annotated data with ground truth bounding boxes is simply not scalable. While vanilla deep neural networks deliver high performance for objects available during training, unseen object detection degrades significantly. At a fundamental level, while vanilla detectors are capable of proposing bounding boxes, which include unseen objects, they are often incapable of assigning high-confidence to unseen objects, due to the inherent precision/recall tradeoffs that requires rejecting background objects. We propose a novel detection algorithm Dont Even Look Once (DELO), that synthesizes visual features for unseen objects and augments existing training algorithms to incorporate unseen object detection. Our proposed scheme is evaluated on Pascal VOC and MSCOCO, and we demonstrate significant improvements in test accuracy over vanilla and other state-of-art zero-shot detectors


title: Training Set Effect on Super Resolution for Automated Target Recognition

abstract: Single Image Super Resolution (SISR) is the process of mapping a low-resolution image to a high resolution image. This inherently has applications in remote sensing as a way to increase the spatial resolution in satellite imagery. This suggests a possible improvement to automated target recognition in image classification and object detection. We explore the effect that different training sets have on SISR with the network, Super Resolution Generative Adversarial Network (SRGAN). We train 5 SRGANs on different land-use classes (e.g. agriculture, cities, ports) and test them on the same unseen dataset. We attempt to find the qualitative and quantitative differences in SISR, binary classification, and object detection performance. We find that curated training sets that contain objects in the test ontology perform better on both computer vision tasks while having a complex distribution of images allows object detection models to perform better. However, Super Resolution (SR) might not be beneficial to certain problems and will see a diminishing amount of returns for datasets that are closer to being solved.


title: Fitness Done Right: a Real-time Intelligent Personal Trainer for Exercise Correction

abstract: Keeping fit has been increasingly important for people nowadays. However, people may not get expected exercise results without following professional guidance while hiring personal trainers is expensive. In this paper, an effective real-time system called Fitness Done Right (FDR) is proposed for helping people exercise correctly on their own. The system includes detecting human body parts, recognizing exercise pose and detecting errors for test poses as well as giving correction advice. Generally, two branch multi-stage CNN is used for training data sets in order to learn human body parts and associations. Then, considering two poses, which are plank and squat in our model, we design a detection algorithm, combining Euclidean and angle distances, to determine the pose in the image. Finally, key values for key features of the two poses are computed correspondingly in the pose error detection part, which helps give correction advice. We conduct our system in real-time situation with error rate down to $1.2\%$, and the screenshots of experimental results are also presented.


title: Privacy Preserving Gaze Estimation using Synthetic Images via a Randomized Encoding Based Framework

abstract: Eye tracking is handled as one of the key technologies for applications that assess and evaluate human attention, behavior, and biometrics, especially using gaze, pupillary, and blink behaviors. One of the challenges with regard to the social acceptance of eye tracking technology is however the preserving of sensitive and personal information. To tackle this challenge, we employ a privacy-preserving framework based on randomized encoding to train a Support Vector Regression model using synthetic eye images privately to estimate the human gaze. During the computation, none of the parties learn about the data or the result that any other party has. Furthermore, the party that trains the model cannot reconstruct pupil, blinks or visual scanpath. The experimental results show that our privacy-preserving framework is capable of working in real-time, with the same accuracy as compared to non-private version and could be extended to other eye tracking related problems.


title: Inverse Graphics: Unsupervised Learning of 3D Shapes from Single Images

abstract: Using generative models for Inverse Graphics is an active area of research. However, most works focus on developing models for supervised and semi-supervised methods. In this paper, we study the problem of unsupervised learning of 3D geometry from single images. Our approach is to use a generative model that produces 2-D images as projections of a latent 3D voxel grid, which we train either as a variational auto-encoder or using adversarial methods. Our contributions are as follows: First, we show how to recover 3D shape and pose from general datasets such as MNIST, and MNIST Fashion in good quality. Second, we compare the shapes learned using adversarial and variational methods. Adversarial approach gives denser 3D shapes. Third, we explore the idea of modelling the pose of an object as uniform distribution to recover 3D shape from a single image. Our experiment with the CelebA dataset \cite{liu2015faceattributes} proves that we can recover complete 3D shape from a single image when the object is symmetric along one, or more axis whilst results obtained using ModelNet40 \cite{wu20153d} show the potential side-effects, in which the model learns 3D shapes such that it can render the same image from any viewpoint. Forth, we present a general end-to-end approach to learning 3D shapes from single images in a completely unsupervised fashion by modelling the factors of variation such as azimuth as independent latent variables. Our method makes no assumptions about the dataset, and can work with synthetic as well as real images (i.e. unsupervised in true sense). We present our results, by training the model using the $\mu$-VAE objective \cite{ucar2019bridging} and a dataset combining all images from MNIST, MNIST Fashion, CelebA and six categories of ModelNet40. The model is able to learn 3D shapes and the pose in qood quality and leverages information learned across all datasets.


title: Towards Good Practices for Multi-Person Pose Estimation

abstract: Multi-Person Pose Estimation is an interesting yet challenging task in computer vision. In this paper, we conduct a series of refinements with the MSPN and PoseFix Networks, and empirically evaluate their impact on the final model performance through ablation studies. By taking all the refinements, we achieve 78.7 on the COCO test-dev dataset and 76.3 on the COCO test-challenge dataset.


title: Towards Good Practices for Instance Segmentation

abstract: Instance Segmentation is an interesting yet challenging task in computer vision. In this paper, we conduct a series of refinements with the Hybrid Task Cascade (HTC) Network, and empirically evaluate their impact on the final model performance through ablation studies. By taking all the refinements, we achieve 0.47 on the COCO test-dev dataset and 0.47 on the COCO test-challenge dataset.


title: Neighborhood Watch: Representation Learning with Local-Margin Triplet Loss and Sampling Strategy for K-Nearest-Neighbor Image Classification

abstract: Deep representation learning using triplet network for classification suffers from a lack of theoretical foundation and difficulty in tuning both the network and classifiers for performance. To address the problem, local-margin triplet loss along with local positive and negative mining strategy is proposed with theory on how the strategy integrate nearest-neighbor hyper-parameter with triplet learning to increase subsequent classification performance. Results in experiments with 2 public datasets, MNIST and Cifar-10, and 2 small medical image datasets demonstrate that proposed strategy outperforms end-to-end softmax and typical triplet loss in settings without data augmentation while maintaining utility of transferable feature for related tasks. The method serves as a good performance baseline where end-to-end methods encounter difficulties such as small sample data with limited allowable data augmentation.


title: Concerning the geometry of stochastic differential equations and stochastic flows

abstract: Following Le Jan and Watanabe we define a connection associated with a non-degenrrate diffusion operators. This connection is characterized here and shown to be the Levi-Civita connection for gradient systems. This both explains why such systems have useful properties and allows us to extend these properties to more general systems. Topics described here include: moment estimates for $T\xi_t$, a Weitzenb\"ock formula for the generator of the semigroup on p-forms induced by the flow, a Bismut type formula for $d\log p_t$ in terms of an arbitrary metric connection, and a generalized Bochner vanishing theorem. A comprehensive theory on this, its generalization to semi-elliptic case and applications is published in the book `On the geometry of diffusion operators and stochastic flows'. Related to this is also the book `The geometry of filtering'. This article is easier to read.


title: Electrical control of a spin qubit in InSb nanowire quantum dots: strongly suppressed spin relaxation in high magnetic field

abstract: In this paper, we investigate the impact of gating potential and magnetic field on phonon induced spin relaxation rate and the speed of the electrically driven single-qubit operations inside the InSb nanowire spin qubit. We show that a strong $g$ factor and high magnetic field strength lead to the prevailing influence of electron-phonon scattering due to deformation potential, considered irrelevant for materials with a weak $g$ factor, like GaAs or Si/SiGe. In this regime, we find that spin relaxation between qubit states is significantly suppressed due to the confinement perpendicular to the nanowire axis. We also find that maximization of the number of single-qubit operations that can be performed during the lifetime of the spin qubit requires single quantum dot gating potential.


title: Machine-Learning for Nonintrusive Model Order Reduction of the Parametric Inviscid Transonic Flow past an airfoil

abstract: Fluid flow in the transonic regime finds relevance in aerospace engineering, particularly in the design of commercial air transportation vehicles. Computational fluid dynamics models of transonic flow for aerospace applications are computationally expensive to solve because of the high degrees of freedom as well as the coupled nature of the conservation laws. While these issues pose a bottleneck for the use of such models in aerospace design, computational costs can be significantly minimized by constructing special, structure-preserving surrogate models called reduced-order models. Such models are known to incur huge off-line costs, however, which can sometimes outweigh their potential benefits. Furthermore, their prediction accuracy is known to be poor under transonic flow conditions. In this work, we propose a machine learning method to construct reduced-order models via deep neural networks, and we demonstrate its ability to preserve accuracy with significantly lower offline and online costs. In addition, our machine learning methodology is physics-informed and constrained through the utilization of an interpretable encoding by way of proper orthogonal decomposition. Application to the inviscid transonic flow past the RAE2822 airfoil under varying freestream Mach numbers and angles of attack, as well as airfoil shape parameters with a deforming mesh, shows that the proposed approach adapts to high-dimensional parameter variation well. Notably, the proposed framework precludes knowledge of numerical operators utilized in the data generation phase, thereby demonstrating its potential utility in fast exploration of design space for diverse engineering applications.


title: A Knowledge-Driven Quality-of-Experience Model for Adaptive Streaming Videos

abstract: The fundamental conflict between the enormous space of adaptive streaming videos and the limited capacity for subjective experiment casts significant challenges to objective Quality-of-Experience (QoE) prediction. Existing objective QoE models exhibit complex functional form, failing to generalize well in diverse streaming environments. In this study, we propose an objective QoE model namely knowledge-driven streaming quality index (KSQI) to integrate prior knowledge on the human visual system and human annotated data in a principled way. By analyzing the subjective characteristics towards streaming videos from a corpus of subjective studies, we show that a family of QoE functions lies in a convex set. Using a variant of projected gradient descent, we optimize the objective QoE model over a database of training videos. The proposed KSQI demonstrates strong generalizability to diverse streaming environments, evident by state-of-the-art performance on four publicly available benchmark datasets.


title: Optimal Single-Choice Prophet Inequalities from Samples

abstract: We study the single-choice Prophet Inequality problem when the gambler is given access to samples. We show that the optimal competitive ratio of $1/2$ can be achieved with a single sample from each distribution. When the distributions are identical, we show that for any constant $\varepsilon > 0$, $O(n)$ samples from the distribution suffice to achieve the optimal competitive ratio ($\approx 0.745$) within $(1+\varepsilon)$, resolving an open problem of Correa, D\"utting, Fischer, and Schewior.


title: Inward Bound: The incredible journey of massive black holes as they pair and merge; I. The effect of mass ratio in flattened rotating galactic nuclei

abstract: Understanding how supermassive black holes (SMBHs) pair and merge helps to inform predictions of off-center, dual, and binary AGN, and provides key insights into how SMBHs grow and co-evolve with their galaxy hosts. As the loudest known gravitational wave source, binary SMBH mergers also hold centerstage for the Laser Interferometer Space Antenna (LISA), a joint ESA/NASA gravitational wave observatory set to launch in 2034. Here, we continue our work to characterize SMBH binary formation and evolution through increasingly more realistic high resolution direct $N$-body simulations, focusing on the effect of SMBH mass ratio, orientation, and eccentricity within a rotating and flattened stellar host. During the dynamical friction phase, we found a prolonged orbital decay for retrograde SMBHs and swift pairing timescales for prograde SMBHs compared to their counterparts in non-rotating models, an effect that becomes more pronounced for smaller mass ratios $M_{\rm sec}/M_{\rm prim} = q$. During this pairing phase, the eccentricity dramatically increases for retrograde configurations, but as the binary forms, the orbital plane flips so that it is almost perfectly prograde, which stifles the rapid eccentricity growth. In prograde configurations, SMBH binaries form and remain at comparatively low eccentricities. As in our prior work, we note that the center of mass of a prograde SMBH binary itself settles into an orbit about the center of the galaxy. Since even the initially retrograde binaries flip their orbital plane, we expect few binaries in rotating systems to reside at rest in the dynamic center of the host galaxy, though this effect is smaller as $q$ decreases.


title: An Algorithm for Distributed Bayesian Inference in Generalized Linear Models

abstract: Monte Carlo algorithms, such as Markov chain Monte Carlo (MCMC) and Hamiltonian Monte Carlo (HMC), are routinely used for Bayesian inference in generalized linear models; however, these algorithms are prohibitively slow in massive data settings because they require multiple passes through the full data in every iteration. Addressing this problem, we develop a scalable extension of these algorithms using the divide-and-conquer (D&C) technique that divides the data into a sufficiently large number of subsets, draws parameters in parallel on the subsets using a \textit{powered} likelihood, and produces Monte Carlo draws of the parameter by combining parameter draws obtained from each subset. These combined parameter draws play the role of draws from the original sampling algorithm. Our main contributions are two-fold. First, we demonstrate through diverse simulated and real data analyses that our distributed algorithm is comparable to the current state-of-the-art D&C algorithm in terms of statistical accuracy and computational efficiency. Second, providing theoretical support for our empirical observations, we identify regularity assumptions under which the proposed algorithm leads to asymptotically optimal inference. We illustrate our methodology through normal linear and logistic regressions, where parts of our D&C algorithm are analytically tractable.


title: Inviscid limit of the compressible Navier-Stokes equations for asymptotically isothermal gases

abstract: We prove the existence of relative finite-energy vanishing viscosity solutions of the one-dimensional, isentropic Euler equations under the assumption of an asymptotically isothermal pressure law, that is, $p(\rho)/\rho = O(1)$ in the limit $\rho \to \infty$. This solution is obtained as the vanishing viscosity limit of classical solutions of the one-dimensional, isentropic, compressible Navier--Stokes equations. Our approach relies on the method of compensated compactness to pass to the limit rigorously in the nonlinear terms. Key to our strategy is the derivation of hyperbolic representation formulas for the entropy kernel and related quantities; among others, a special entropy pair used to obtain higher uniform integrability estimates on the approximate solutions. Intricate bounding procedures relying on these representation formulas then yield the required compactness of the entropy dissipation measures. In turn, we prove that the Young measure generated by the classical solutions of the Navier--Stokes equations reduces to a Dirac mass, from which we deduce the required convergence to a solution of the Euler equations.


title: Donaldson-Thomas theory of quantum Fermat quintic threefolds I

abstract: In this paper, we study non-commutative projective schemes whose associated non-commutative graded algebras are finite over their centers. We study their moduli spaces of stable sheaves, and construct a symmetric obstruction theory in the Calabi-Yau-3 case. This allows us to define Donaldson-Thomas type invariants. We also discuss the simplest examples, called quantum Fermat quintic threefolds.


title: Covariant Radiative Transfer for Black Hole Spacetimes

abstract: It has now become possible to study directly, via numerical simulation, the evolution of relativistic, radiation-dominated flows around compact objects. With this in mind we set out explicitly covariant forms of the radiative transfer equation that are suitable for numerical integration in curved spacetime or flat spacetime in curvilinear coordinates. Our work builds on and summarizes in consistent form earlier work by Lindquist, Thorne, Morita and Kaneko, and others. We give explicitly the basic equations in spherical-polar coordinates for Minkowski space and the Kerr spacetime in Kerr-Schild coordinates.


title: Improving Universal Sound Separation Using Sound Classification

abstract: Deep learning approaches have recently achieved impressive performance on both audio source separation and sound classification. Most audio source separation approaches focus only on separating sources belonging to a restricted domain of source classes, such as speech and music. However, recent work has demonstrated the possibility of "universal sound separation", which aims to separate acoustic sources from an open domain, regardless of their class. In this paper, we utilize the semantic information learned by sound classifier networks trained on a vast amount of diverse sounds to improve universal sound separation. In particular, we show that semantic embeddings extracted from a sound classifier can be used to condition a separation network, providing it with useful additional information. This approach is especially useful in an iterative setup, where source estimates from an initial separation stage and their corresponding classifier-derived embeddings are fed to a second separation network. By performing a thorough hyperparameter search consisting of over a thousand experiments, we find that classifier embeddings from clean sources provide nearly one dB of SNR gain, and our best iterative models achieve a significant fraction of this oracle performance, establishing a new state-of-the-art for universal sound separation.


title: Asymptotic critical value set and Newton polyhedron

abstract: We present an effective method to investigate the asymptotic critical value set of a polynomial map. For this purpose we propose a method to construct rational curves with reduced number of terms present in its parametric representation. In this way we show that the asymptotic critical value set contains the critical value of an polynomial associated to so called bad face of the Newton polyhedron. Our main technical tool is the toric geometry that has been introduced into this question by A.N\'emethi and A.Zaharia


title: Sequential Multi-Frame Neural Beamforming for Speech Separation and Enhancement

abstract: This work introduces sequential neural beamforming, which alternates between neural network based spectral separation and beamforming based spatial separation. Our neural networks for separation use an advanced convolutional architecture trained with a novel stabilized signal-to-noise ratio loss function. For beamforming, we explore multiple ways of computing time-varying covariance matrices, including factorizing the spatial covariance into a time-varying amplitude component and a time-invariant spatial component, as well as using block-based techniques. In addition, we introduce a multi-frame beamforming method which improves the results significantly by adding contextual frames to the beamforming formulations. We extensively evaluate and analyze the effects of window size, block size, and multi-frame context size for these methods. Our best method utilizes a sequence of three neural separation and multi-frame time-invariant spatial beamforming stages, and demonstrates an average improvement of 2.75 dB in scale-invariant signal-to-noise ratio and 14.2% absolute reduction in a comparative speech recognition metric across four challenging reverberant speech enhancement and separation tasks. We also use our three-speaker separation model to separate real recordings in the LibriCSS evaluation set into non-overlapping tracks, and achieve a better word error rate as compared to a baseline mask based beamformer.


title: ISP4ML: Understanding the Role of Image Signal Processing in Efficient Deep Learning Vision Systems

abstract: Convolutional neural networks (CNNs) are now predominant components in a variety of computer vision (CV) systems. These systems typically include an image signal processor (ISP), even though the ISP is traditionally designed to produce images that look appealing to humans. In CV systems, it is not clear what the role of the ISP is, or if it is even required at all for accurate prediction. In this work, we investigate the efficacy of the ISP in CNN classification tasks, and outline the system-level trade-offs between prediction accuracy and computational cost. To do so, we build software models of a configurable ISP and an imaging sensor in order to train CNNs on ImageNet with a range of different ISP settings and functionality. Results on ImageNet show that an ISP improves accuracy by 4.6%-12.2% on MobileNet architectures of different widths. Results using ResNets demonstrate that these trends also generalize to deeper networks. An ablation study of the various processing stages in a typical ISP reveals that the tone mapper is the most significant stage when operating on high dynamic range (HDR) images, by providing 5.8% average accuracy improvement alone. Overall, the ISP benefits system efficiency because the memory and computational costs of the ISP is minimal compared to the cost of using a larger CNN to achieve the same accuracy.


title: R\'{e}nyi and von Neumann entropies for various Bipartite Gaussian States

abstract: The R\'{e}nyi and von Neumann entropies of various bipartite Gaussian states are derived analytically. We also discuss on the tripartite purification for the bipartite states when some particular conditions hold. The generalization to non-Gaussian states is briefly discussed.


title: Implicit Regularization and Convergence for Weight Normalization

abstract: Normalization methods such as batch [Ioffe and Szegedy, 2015], weight [Salimansand Kingma, 2016], instance [Ulyanov et al., 2016], and layer normalization [Baet al., 2016] have been widely used in modern machine learning. Here, we study the weight normalization (WN) method [Salimans and Kingma, 2016] and a variant called reparametrized projected gradient descent (rPGD) for overparametrized least-squares regression. WN and rPGD reparametrize the weights with a scale g and a unit vector w and thus the objective function becomes non-convex. We show that this non-convex formulation has beneficial regularization effects compared to gradient descent on the original objective. These methods adaptively regularize the weights and converge close to the minimum l2 norm solution, even for initializations far from zero. For certain stepsizes of g and w , we show that they can converge close to the minimum norm solution. This is different from the behavior of gradient descent, which converges to the minimum norm solution only when started at a point in the range space of the feature matrix, and is thus more sensitive to initialization.


title: Stability of exoplanetary systems retrieved from scalar time series

abstract: We propose a novel method applied to extrasolar planetary dynamics to describe the system stability. The observations in this field serve the measurements mainly of radial velocity, transit time, and/or celestial position. These scalar time series are used to build up the high-dimensional phase space trajectory representing the dynamical evolution of planetary motion. The framework of nonlinear time series analysis and Poincar\'e recurrences allows us to transform the obtained univariate signals into complex networks whose topology carries the dynamical properties of the underlying system. The network-based analysis is able to distinguish the regular and chaotic behaviour not only for synthetic inputs but also for noisy and irregularly sampled real world observations. The proposed scheme does not require neither n-body integration nor best fitting planetary model to perform the stability investigation, therefore, the computation time can be reduced drastically compared to those of the standard numerical methods.


title: Quantum Darwinism and non-Markovianity in a model of quantum harmonic oscillators

abstract: To explain aspects of the quantum-to-classical transition, quantum Darwinism explores the fact that, due to interactions between a quantum open system and its surrounding environment, information about the system can be spread redundantly to the environment. Here we recall that there are in the literature two distinct and non-equivalent ways to make this statement precise and quantitative. We first point out the difference with some simple but illustrative examples. We then consider a model where Darwinism can be seen from both perspectives. Moreover, the non-Markovianity of our model can be varied with a parameter. In a recent work [F. Galve \textit{et al.}, Sci. Reps. 6, 19607 (2016)], the authors concluded that quantum Darwinism can be hindered by non-Markovianity. We depart from their analysis and argue that, from both perspectives to quantum Darwinism, there is no clear relationship between non-Markovianity and quantum Darwinism in our model.


title: TracKlinic: Diagnosis of Challenge Factors in Visual Tracking

abstract: Generic visual tracking is difficult due to many challenge factors (e.g., occlusion, blur, etc.). Each of these factors may cause serious problems for a tracking algorithm, and when they work together can make things even more complicated. Despite a great amount of efforts devoted to understanding the behavior of tracking algorithms, reliable and quantifiable ways for studying the per factor tracking behavior remain barely available. Addressing this issue, in this paper we contribute to the community a tracking diagnosis toolkit, TracKlinic, for diagnosis of challenge factors of tracking algorithms. TracKlinic consists of two novel components focusing on the data and analysis aspects, respectively. For the data component, we carefully prepare a set of 2,390 annotated videos, each involving one and only one major challenge factor. When analyzing an algorithm for a specific challenge factor, such one-factor-per-sequence rule greatly inhibits the disturbance from other factors and consequently leads to more faithful analysis. For the analysis component, given the tracking results on all sequences, it investigates the behavior of the tracker under each individual factor and generates the report automatically. With TracKlinic, a thorough study is conducted on ten state-of-the-art trackers on nine challenge factors (including two compound ones). The results suggest that, heavy shape variation and occlusion are the two most challenging factors faced by most trackers. Besides, out-of-view, though does not happen frequently, is often fatal. By sharing TracKlinic, we expect to make it much easier for diagnosing tracking algorithms, and to thus facilitate developing better ones.


title: The {\alpha}{\mu} Search Algorithm for the Game of Bridge

abstract: {\alpha}{\mu} is an anytime heuristic search algorithm for incomplete information games that assumes perfect information for the opponents. {\alpha}{\mu} addresses the strategy fusion and non-locality problems encountered by Perfect Information Monte Carlo sampling. In this paper {\alpha}{\mu} is applied to the game of Bridge.


title: Theoretical condition for switching the magnetization in a perpendicularly magnetized ferromagnet via the spin Hall effect

abstract: A theoretical formula is derived for the threshold current to switch a perpendicular magnetization in a ferromagnet by the spin Hall effect. The numerical simulation of the Landau-Lifshitz-Gilbert equation indicates that magnetization switching is achieved when the steady-state solution of the magnetization in the presence of the current is outside an energetically unstable region. Based on the numerical result, an analytical theory deriving the threshold current is developed by focusing on the first-order perturbation to the unstable state. The analytical formula clarifies that the magnitude of the magnetic field applied to the current direction should be larger than 15\% of the perpendicular magnetic anisotropy field, and the current is less than the derived threshold value.


title: First tracking performance results from the ATLAS Fast TracKer

abstract: Particle physicists at the Large Hadron Collider investigate the properties of matter at subatomic length scales by colliding together bunches of high-energy protons and observing the decay products of the collisions. ATLAS is one of two general-purpose detectors that reconstruct the interactions and, as part of a wide range of physics goals, measure the production of Higgs bosons and searches for exotic new phenomena including supersymmetry, extra dimensions of spacetime, and dark matter. Selecting the interesting collision events using hardware- and software-based triggers is a major challenge that will become more difficult as the luminosity increases in future data. The ATLAS Fast TracKer (FTK) is a custom electronics system that performs fast hardware-based tracking of charged particles for use in trigger decisions. In 2018, two FTK "Slices" covering portions of the ATLAS detector were installed and commissioned using proton-proton collisions, to prepare for physics data-taking in Run 3. The FTK track-finding and track-fitting strategies and the tracking performance for the FTK Slices are presented. Strategies for coping with changing beamspot and other conditions in future data are discussed. A strategy for triggering on displaced tracks from long-lived particles is also presented.


title: Can You Really Backdoor Federated Learning?

abstract: The decentralized nature of federated learning makes detecting and defending against adversarial attacks a challenging task. This paper focuses on backdoor attacks in the federated learning setting, where the goal of the adversary is to reduce the performance of the model on targeted tasks while maintaining good performance on the main task. Unlike existing works, we allow non-malicious clients to have correctly labeled samples from the targeted tasks. We conduct a comprehensive study of backdoor attacks and defenses for the EMNIST dataset, a real-life, user-partitioned, and non-iid dataset. We observe that in the absence of defenses, the performance of the attack largely depends on the fraction of adversaries present and the "complexity'' of the targeted task. Moreover, we show that norm clipping and "weak'' differential privacy mitigate the attacks without hurting the overall performance. We have implemented the attacks and defenses in TensorFlow Federated (TFF), a TensorFlow framework for federated learning. In open-sourcing our code, our goal is to encourage researchers to contribute new attacks and defenses and evaluate them on standard federated datasets.


title: Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory

abstract: Several variants of recurrent neural networks (RNNs) with orthogonal or unitary recurrent matrices have recently been developed to mitigate the vanishing/exploding gradient problem and to model long-term dependencies of sequences. However, with the eigenvalues of the recurrent matrix on the unit circle, the recurrent state retains all input information which may unnecessarily consume model capacity. In this paper, we address this issue by proposing an architecture that expands upon an orthogonal/unitary RNN with a state that is generated by a recurrent matrix with eigenvalues in the unit disc. Any input to this state dissipates in time and is replaced with new inputs, simulating short-term memory. A gradient descent algorithm is derived for learning such a recurrent matrix. The resulting method, called the Eigenvalue Normalized RNN (ENRNN), is shown to be highly competitive in several experiments.


title: On the breakdown of regular solutions with finite energy for 3D degenerate compressible Navier-Stokes equations

abstract: In this paper, the three-dimensional (3D) isentropic compressible Navier-Stokes equations with degenerate viscosities (\textbf{ICND}) is considered in both the whole space and the periodic domain. First, for the corresponding Cauchy problem, when shear and bulk viscosity coefficients are both given as a constant multiple of the density's power ($\rho^\delta$ with $0<\delta<1$), based on some elaborate analysis of this system's intrinsic singular structures, we show that the $L^\infty$ norm of the deformation tensor $D(u)$ and the $L^6$ norm of $\nabla \rho^{\delta-1}$ control the possible breakdown of regular solutions with far field vacuum. This conclusion means that if a solution with far field vacuum of the \textbf{ICND} system is initially regular and loses its regularity at some later time, then the formation of singularity must be caused by losing the bound of $D(u)$ or $\nabla \rho^{\delta-1}$ as the critical time approaches. Second, under the additional assumption that the shear and second viscosities (respectively $\mu(\rho)$ and $\lambda(\rho)$) satisfy the BD relation $\lambda(\rho)=2(\mu'(\rho)\rho-\mu(\rho))$, if we consider the corresponding problem in some periodic domain and the initial density is away from the vacuum, it can be proved that the possible breakdown of classical solutions can be controlled only by the $L^\infty$ norm of $D(u)$. It is worth pointing out that, except the conclusions mentioned above, another purpose of the current paper is to show how to understand the intrinsic singular structures of the fluid system considered now, and then how to develop the corresponding nonlinear energy estimates in the specially designed energy space with singular weights for the unique regular solution with finite energy.


title: Can 100 Machines Agree?

abstract: Agreement protocols have been typically deployed at small scale, e.g., using three to five machines. This is because these protocols seem to suffer from a sharp performance decay. More specifically, as the size of a deployment---i.e., degree of replication---increases, the protocol performance greatly decreases. There is not much experimental evidence for this decay in practice, however, notably for larger system sizes, e.g., beyond a handful of machines. In this paper we execute agreement protocols on up to 100 machines and observe on their performance decay. We consider well-known agreement protocols part of mature systems, such as Apache ZooKeeper, etcd, and BFT-Smart, as well as a chain and a novel ring-based agreement protocol which we implement ourselves. We provide empirical evidence that current agreement protocols execute gracefully on 100 machines. We observe that throughput decay is initially sharp (consistent with previous observations); but intriguingly---as each system grows beyond a few tens of replicas---the decay dampens. For chain- and ring-based replication, this decay is slower than for the other systems. The positive takeaway from our evaluation is that mature agreement protocol implementations can sustain out-of-the-box 300 to 500 requests per second when executing on 100 replicas on a wide-area public cloud platform. Chain- and ring-based replication can reach between 4K and 11K (up to 20x improvements) depending on the fault assumptions.


title: DLBricks: Composable Benchmark Generation to Reduce Deep Learning Benchmarking Effort on CPUs (Extended)

abstract: The past few years have seen a surge of applying Deep Learning (DL) models for a wide array of tasks such as image classification, object detection, machine translation, etc. While DL models provide an opportunity to solve otherwise intractable tasks, their adoption relies on them being optimized to meet latency and resource requirements. Benchmarking is a key step in this process but has been hampered in part due to the lack of representative and up-to-date benchmarking suites. This is exacerbated by the fast-evolving pace of DL models. This paper proposes DLBricks, a composable benchmark generation design that reduces the effort of developing, maintaining, and running DL benchmarks on CPUs. DLBricks decomposes DL models into a set of unique runnable networks and constructs the original model's performance using the performance of the generated benchmarks. DLBricks leverages two key observations: DL layers are the performance building blocks of DL models and layers are extensively repeated within and across DL models. Since benchmarks are generated automatically and the benchmarking time is minimized, DLBricks can keep up-to-date with the latest proposed models, relieving the pressure of selecting representative DL models. Moreover, DLBricks allows users to represent proprietary models within benchmark suites. We evaluate DLBricks using $50$ MXNet models spanning $5$ DL tasks on $4$ representative CPU systems. We show that DLBricks provides an accurate performance estimate for the DL models and reduces the benchmarking time across systems (e.g. within $95\%$ accuracy and up to $4.4\times$ benchmarking time speedup on Amazon EC2 c5.xlarge).


title: Improving the Robustness of Capsule Networks to Image Affine Transformations

abstract: Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various geometric transformations of inputs. Recently, Capsule Networks (CapsNets) have been proposed to tackle this problem. In CapsNets, each entity is represented by a vector and routed to high-level entity representations by a dynamic routing algorithm. CapsNets have been shown to be more robust than CNNs to affine transformations of inputs. However, there is still a huge gap between their performance on transformed inputs compared to untransformed versions. In this work, we first revisit the routing procedure by (un)rolling its forward and backward passes. Our investigation reveals that the routing procedure contributes neither to the generalization ability nor to the affine robustness of the CapsNets. Furthermore, we explore the limitations of capsule transformations and propose affine CapsNets (Aff-CapsNets), which are more robust to affine transformations. On our benchmark task, where models are trained on the MNIST dataset and tested on the AffNIST dataset, our Aff-CapsNets improve the benchmark performance by a large margin (from 79% to 93.21%), without using any routing mechanism.


title: A hypergraph Tur\'{a}n problem with no stability

abstract: A fundamental barrier in extremal hypergraph theory is the presence of many near-extremal constructions with very different structures. Indeed, the classical constructions due to Kostochka imply that the notorious extremal problem for the tetrahedron exhibits this phenomenon assuming Tur\'an's conjecture. Our main result is to construct a finite family of triple systems $\mathcal{M}$, determine its Tur\'{a}n number, and prove that there are two near-extremal $\mathcal{M}$-free constructions that are far from each other in edit-distance. This is the first extremal result for a hypergraph family that fails to have a corresponding stability theorem.


title: Revealing Perceptible Backdoors, without the Training Set, via the Maximum Achievable Misclassification Fraction Statistic

abstract: Recently, a backdoor data poisoning attack was proposed, which adds mislabeled examples to the training set, with an embedded backdoor pattern, aiming to have the classifier learn to classify to a target class whenever the backdoor pattern is present in a test sample. Here, we address post-training detection of innocuous perceptible backdoors in DNN image classifiers, wherein the defender does not have access to the poisoned training set, but only to the trained classifier, as well as unpoisoned examples. This problem is challenging because without the poisoned training set, we have no hint about the actual backdoor pattern used during training. This post-training scenario is also of great import because in many practical contexts the DNN user did not train the DNN and does not have access to the training data. We identify two important properties of perceptible backdoor patterns - spatial invariance and robustness - based upon which we propose a novel detector using the maximum achievable misclassification fraction (MAMF) statistic. We detect whether the trained DNN has been backdoor-attacked and infer the source and target classes. Our detector outperforms other existing detectors and, coupled with an imperceptible backdoor detector, helps achieve post-training detection of all evasive backdoors.


title: vqSGD: Vector Quantized Stochastic Gradient Descent

abstract: In this work, we present a family of vector quantization schemes \emph{vqSGD} (Vector-Quantized Stochastic Gradient Descent) that provide an asymptotic reduction in the communication cost with convergence guarantees in first-order distributed optimization. In the process we derive the following fundamental information theoretic fact: $\Theta(\frac{d}{R^2})$ bits are necessary and sufficient to describe an unbiased estimator ${\hat{g}}({g})$ for any ${g}$ in the $d$-dimensional unit sphere, under the constraint that $\|{\hat{g}}({g})\|_2\le R$ almost surely. In particular, we consider a randomized scheme based on the convex hull of a point set, that returns an unbiased estimator of a $d$-dimensional gradient vector with almost surely bounded norm. We provide multiple efficient instances of our scheme, that are near optimal, and require only $o(d)$ bits of communication at the expense of tolerable increase in error. The instances of our quantization scheme are obtained using the properties of binary error-correcting codes and provide a smooth tradeoff between the communication and the estimation error of quantization. Furthermore, we show that \emph{vqSGD} also offers strong privacy guarantees.


title: Learning-Assisted Competitive Algorithms for Peak-Aware Energy Scheduling

abstract: In this paper, we study the peak-aware energy scheduling problem using the competitive framework with machine learning prediction. With the uncertainty of energy demand as the fundamental challenge, the goal is to schedule the energy output of local generation units such that the electricity bill is minimized. While this problem has been tackled using classic competitive design with worst-case guarantee, the goal of this paper is to develop learning-assisted competitive algorithms to improve the performance in a provable manner. We develop two deterministic and randomized algorithms that are provably robust against the poor performance of learning prediction, however, achieve the optimal performance as the error of prediction goes to zero. Extensive experiments using real data traces verify our theoretical observations and show 15.13% improved performance against pure online algorithms.


title: Superdiffusive Stochastic Fermi Acceleration in Space and Energy

abstract: We analyze the transport properties of charged particles (ions and electrons) interacting with randomly formed magnetic scatterers (e.g.\ large scale local ``magnetic fluctuations'' or ``coherent magnetic irregularities'' usually present in strongly turbulent plasmas), using the energization processes proposed initially by Fermi in 1949. The scatterers are formed by large scale local fluctuations ($\delta B/B \approx 1$) and are randomly distributed inside the unstable magnetic topology. We construct a 3D grid on which a small fraction of randomly chosen grid points are acting as scatterers. In particular, we study how a large number of test particles are accelerated and transported inside a collection of scatterers in a finite volume. Our main results are: (1) The spatial mean-square displacement $<(\Delta r)^2>$ inside the stochastic Fermi accelerator is superdiffusive, $<(\Delta r)^2> \sim t^{a_{r}},$ with $a_r \sim 1.2-1.6$, for the high energy electrons with kinetic energy $(W)$ larger than $1 MeV$, and it is normal ($a_r=1$) for the heated low energy $(W< 10 keV)$ electrons. (2) The transport properties of the high energy particles are closely related with the mean-free path that the particles travel in-between the scatterers ($\lambda_{sc}$). The smaller $\lambda_{sc}$ is, the faster the electrons and ions escape from the acceleration volume. (3) The mean displacement in energy $<\Delta W> \sim t^{a_{W}}$ is strongly enhanced inside the acceleration volume $(a_W=1.5- 2.5)$ for the high energy particles compared to the thermal low energy particles ($a_W=0.4$), i.e.\ high energy particles undergo an enhanced systematic gain in energy.(4) The mean-square displacement in energy $<W^2>$ is superdiffusive for the high energy particles and normal for the low energy, heated particles.


title: On coherence and the transverse spatial extent of a neutron wave packet

abstract: In the analysis of neutron scattering measurements of condensed matter structure, it normally suffices to treat the incident and scattered neutron beams as if composed of incoherent distributions of plane waves with wavevectors of different magnitudes and directions which are taken to define an instrumental resolution. However, despite the wide-ranging applicability of this conventional treatment, there are cases in which the wave function of an individual neutron in the beam must be described more accurately by a spatially localized packet, in particular with respect to its transverse extent normal to its mean direction of propagation. One such case involves the creation of orbital angular momentum (OAM) states in a neutron via interaction with a material device of a given size. It is shown in the work reported here that there exist two distinct measures of coherence of special significance and utility for describing neutron beams in scattering studies of materials in general. One measure corresponds to the coherent superposition of basis functions and their wavevectors which constitute each individual neutron packet state function whereas the other measure can be associated with an incoherent distribution of mean wavevectors of the individual neutron packets in a beam. Both the distribution of the mean wavevectors of individual packets in the beam as well as the wavevector components of the superposition of basis functions within an individual packet can contribute to the conventional notion of instrumental resolution. However, it is the transverse spatial extent of packet wavefronts alone that determines the area within which a coherent scattering process can occur in the first place. This picture is shown to be consistent with standard quantum theory. It is also demonstrated that these two measures of coherence can be distinguished from one another experimentally.


title: $\mathit{tmf}$-based Mahowald invariants

abstract: The $2$-primary homotopy $\beta$-family, defined as the collection of Mahowald invariants of Mahowald invariants of $2^i$, $i \geq 1$, is an infinite collection of periodic elements in the stable homotopy groups of spheres. In this paper, we calculate $\mathit{tmf}$-based approximations to this family. Our calculations combine an analysis of the Atiyah-Hirzebruch spectral sequence for the Tate construction of $\mathit{tmf}$ with trivial $C_2$-action and Behrens' filtered Mahowald invariant machinery.


title: Estimating Entropy of Distributions in Constant Space

abstract: We consider the task of estimating the entropy of $k$-ary distributions from samples in the streaming model, where space is limited. Our main contribution is an algorithm that requires $O\left(\frac{k \log (1/\varepsilon)^2}{\varepsilon^3}\right)$ samples and a constant $O(1)$ memory words of space and outputs a $\pm\varepsilon$ estimate of $H(p)$. Without space limitations, the sample complexity has been established as $S(k,\varepsilon)=\Theta\left(\frac k{\varepsilon\log k}+\frac{\log^2 k}{\varepsilon^2}\right)$, which is sub-linear in the domain size $k$, and the current algorithms that achieve optimal sample complexity also require nearly-linear space in $k$. Our algorithm partitions $[0,1]$ into intervals and estimates the entropy contribution of probability values in each interval. The intervals are designed to trade off the bias and variance of these estimates.


title: Physical Layer Security in Vehicular Communication Networks in the Presence of Interference

abstract: This paper studies the physical layer security of a vehicular communication network in the presence of interference constraints by analysing its secrecy capacity. The system considers a legitimate receiver node and an eavesdropper node, within a shared network, both under the effect of interference from other users. The double-Rayleigh fading channel is used to capture the effects of the wireless communication channel for the vehicular network. We present the standard logarithmic expression for the system capacity in an alternate form, to facilitate analysis in terms of the joint moment generating functions (MGF) of the random variables representing the channel fading and interference. Closed-form expressions for the MGFs are obtained and Monte-Carlo simulations are provided throughout to validate the results. The results show that performance of the system in terms of the secrecy capacity is affected by the number of interferers and their distances. The results further demonstrate the effect of the uncertainty in eavesdropper location on the analysis.


title: Holographic Topological Semimetals

abstract: The holographic duality allows to construct and study models of strongly coupled quantum matter via dual gravitational theories. In general such models are characterized by the absence of quasiparticles, hydrodynamic behavior and Planckian dissipation times. One particular interesting class of quantum materials are ungapped topological semimetals which have many interesting properties from Hall transport to topologically protected edge states. We review the application of the holographic duality to this type of quantum matter including the construction of holographic Weyl semimetals, nodal line semimetals, quantum phase transition to trivial states (ungapped and gapped), the holographic dual of Fermi arcs and how new unexpected transport properties, such as Hall viscosities arise. The holographic models promise to lead to new insights into the properties of this type of quantum matter.


title: ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations

abstract: Graph Neural Networks (GNN) have been shown to work effectively for modeling graph structured data to solve tasks such as node classification, link prediction and graph classification. There has been some recent progress in defining the notion of pooling in graphs whereby the model tries to generate a graph level representation by downsampling and summarizing the information present in the nodes. Existing pooling methods either fail to effectively capture the graph substructure or do not easily scale to large graphs. In this work, we propose ASAP (Adaptive Structure Aware Pooling), a sparse and differentiable pooling method that addresses the limitations of previous graph pooling architectures. ASAP utilizes a novel self-attention network along with a modified GNN formulation to capture the importance of each node in a given graph. It also learns a sparse soft cluster assignment for nodes at each layer to effectively pool the subgraphs to form the pooled graph. Through extensive experiments on multiple datasets and theoretical analysis, we motivate our choice of the components used in ASAP. Our experimental results show that combining existing GNN architectures with ASAP leads to state-of-the-art results on multiple graph classification benchmarks. ASAP has an average improvement of 4%, compared to current sparse hierarchical state-of-the-art method.


title: Simultaneous Mapping and Target Driven Navigation

abstract: This work presents a modular architecture for simultaneous mapping and target driven navigation in indoors environments. The semantic and appearance stored in 2.5D map is distilled from RGB images, semantic segmentation and outputs of object detectors by convolutional neural networks. Given this representation, the mapping module learns to localize the agent and register consecutive observations in the map. The navigation task is then formulated as a problem of learning a policy for reaching semantic targets using current observations and the up-to-date map. We demonstrate that the use of semantic information improves localization accuracy and the ability of storing spatial semantic map aids the target driven navigation policy. The two modules are evaluated separately and jointly on Active Vision Dataset and Matterport3D environments, demonstrating improved performance on both localization and navigation tasks.


title: New lower bounds for matrix multiplication and the 3x3 determinant

abstract: Let $M_{\langle u,v,w\rangle}\in C^{uv}\otimes C^{vw}\otimes C^{wu}$ denote the matrix multiplication tensor (and write $M_n=M_{\langle n,n,n\rangle}$) and let $det_3\in ( C^9)^{\otimes 3}$ denote the determinant polynomial considered as a tensor. For a tensor $T$, let $\underline R(T)$ denote its border rank. We (i) give the first hand-checkable algebraic proof that $\underline R(M_2)=7$,(ii) prove $\underline R(M_{\langle 223\rangle})=10$, and $\underline R(M_{\langle 233\rangle})=14$, where previously the only nontrivial matrix multiplication tensor whose border rank had been determined was $M_2$,(iii) prove $\underline R( M_3)\geq 17$, (iv) prove $\underline R( det_3)=17$, improving the previous lower bound of $12$, (v) prove $\underline R(M_{\langle 2nn\rangle})\geq n^2+1.32n$ for all $n\geq 25$ (previously only $\underline R(M_{\langle 2nn\rangle})\geq n^2+1$ was known) as well as lower bounds for $4\leq n\leq 25$, and (vi) prove $\underline R(M_{\langle 3nn\rangle})\geq n^2+2 n+1$ for all $ n\geq 21$, where previously only $\underline R(M_{\langle 3nn\rangle})\geq n^2+2$ was known, as well as lower boundsfor $4\leq n\leq 21$. Our results utilize a new technique initiated by Buczy\'{n}ska and Buczy\'{n}ski, called border apolarity. The two key ingredients are: (i) the use of a multi-graded ideal associated to a border rank $r$ decomposition of any tensor, and (ii) the exploitation of the large symmetry group of $T$ to restrict to $B_T$-invariant ideals, where $B_T$ is a maximal solvable subgroup of the symmetry group of $T$.


title: Unsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-Labeling

abstract: Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two domains. As a result, classifiers trained from labeled samples in the source domain suffer from significant performance drop when directly applied to the samples from the target domain. To address this issue, different approaches have been proposed to learn domain-invariant features or domain-specific classifiers. In either case, the lack of labeled samples in the target domain can be an issue which is usually overcome by pseudo-labeling. Inaccurate pseudo-labeling, however, could result in catastrophic error accumulation during learning. In this paper, we propose a novel selective pseudo-labeling strategy based on structured prediction. The idea of structured prediction is inspired by the fact that samples in the target domain are well clustered within the deep feature space so that unsupervised clustering analysis can be used to facilitate accurate pseudo-labeling. Experimental results on four datasets (i.e. Office-Caltech, Office31, ImageCLEF-DA and Office-Home) validate our approach outperforms contemporary state-of-the-art methods.


title: Task-Based Hybrid Shared Control for Training Through Forceful Interaction

abstract: Despite the fact that robotic platforms can provide both consistent practice and objective assessments of users over the course of their training, there are relatively few instances where physical human robot interaction has been significantly more effective than unassisted practice or human-mediated training. This paper describes a hybrid shared control robot, which enhances task learning through kinesthetic feedback. The assistance assesses user actions using a task-specific evaluation criterion and selectively accepts or rejects them at each time instant. Through two human subject studies (total n=68), we show that this hybrid approach of switching between full transparency and full rejection of user inputs leads to increased skill acquisition and short-term retention compared to unassisted practice. Moreover, we show that the shared control paradigm exhibits features previously shown to promote successful training. It avoids user passivity by only rejecting user actions and allowing failure at the task. It improves performance during assistance, providing meaningful task-specific feedback. It is sensitive to initial skill of the user and behaves as an `assist-as-needed' control scheme---adapting its engagement in real time based on the performance and needs of the user. Unlike other successful algorithms, it does not require explicit modulation of the level of impedance or error amplification during training and it is permissive to a range of strategies because of its evaluation criterion. We demonstrate that the proposed hybrid shared control paradigm with a task-based minimal intervention criterion significantly enhances task-specific training.


title: Learning Permutation Invariant Representations using Memory Networks

abstract: Many real-world tasks such as classification of digital histopathology images and 3D object detection involve learning from a set of instances. In these cases, only a group of instances or a set, collectively, contains meaningful information and therefore only the sets have labels, and not individual data instances. In this work, we present a permutation invariant neural network called Memory-based Exchangeable Model (MEM) for learning set functions. The MEM model consists of memory units that embed an input sequence to high-level features enabling the model to learn inter-dependencies among instances through a self-attention mechanism. We evaluated the learning ability of MEM on various toy datasets, point cloud classification, and classification of lung whole slide images (WSIs) into two subtypes of lung cancer---Lung Adenocarcinoma, and Lung Squamous Cell Carcinoma. We systematically extracted patches from lung WSIs downloaded from The Cancer Genome Atlas~(TCGA) dataset, the largest public repository of WSIs, achieving a competitive accuracy of 84.84\% for classification of two sub-types of lung cancer. The results on other datasets are promising as well, and demonstrate the efficacy of our model.


title: Analysis of the co-design activity: influence of a mixed artifact and contribution of the gestural function in a spatial augmented reality environment

abstract: Augmented reality provides new possibilities to propose environments where the designers can take advantage of the physicality of the artifacts while keeping the versatility of digital environments. Mixed objects can therefore provide new media in the interactions between stakeholders. Besides, the increasing interest in user participation in early design phases is limited by the poor representations or the expensive mock ups to be provided in design meetings. Therefore, understanding the role of these mixed artifacts by analyzing and characterizing the interactions is crucial to the development of both design methods and environments. By focusing on multimodal interactions, we aim at providing new results in terms of the design process, in particular by studying the contribution of the gesture in collaborative product co-creativity sessions but also by understanding the role of these multiple interactions in an augmented reality environment.


title: Comparison Against Task Driven Artificial Neural Networks Reveals Functional Organization of Mouse Visual Cortex

abstract: Partially inspired by features of computation in visual cortex, deep neural networks compute hierarchical representations of their inputs. While these networks have been highly successful in machine learning, it remains unclear to what extent they can aid our understanding of cortical function. Several groups have developed metrics that provide a quantitative comparison between representations computed by networks and representations measured in cortex. At the same time, neuroscience is well into an unprecedented phase of large-scale data collection, as evidenced by projects such as the Allen Brain Observatory. Despite the magnitude of these efforts, in a given experiment only a fraction of units are recorded, limiting the information available about the cortical representation. Moreover, only a finite number of stimuli can be shown to an animal over the course of a realistic experiment. These limitations raise the question of how and whether metrics that compare representations of deep networks are meaningful on these datasets. Here, we empirically quantify the capabilities and limitations of these metrics due to limited image presentations and neuron samples. We find that the comparison procedure is robust to different choices of stimuli set and the level of subsampling that one might expect in a large-scale brain survey with thousands of neurons. Using these results, we compare the representations measured in the Allen Brain Observatory in response to natural image presentations to deep neural network. We show that the visual cortical areas are relatively high order representations (in that they map to deeper layers of convolutional neural networks). Furthermore, we see evidence of a broad, more parallel organization rather than a sequential hierarchy, with the primary area VISp(V1) being lower order relative to the other areas.


title: Improved clustering algorithms for the Bipartite Stochastic Block Model

abstract: We establish sufficient conditions of exact and almost full recovery of the node partition in Bipartite Stochastic Block Model (BSBM) using polynomial time algorithms. First, we improve upon the known conditions of almost full recovery by spectral clustering algorithms in BSBM. Next, we propose a new computationally simple and fast procedure achieving exact recovery under milder conditions than the state of the art. Namely, if the vertex sets $V_1$ and $V_2$ in BSBM have sizes $n_1$ and $n_2$, we show that the condition $p = \Omega\left(\max\left(\sqrt{\frac{\log{n_1}}{n_1n_2}},\frac{\log{n_1}}{n_2}\right)\right)$ on the edge intensity $p$ is sufficient for exact recovery witin $V_1$. This condition exhibits an elbow at $n_{2} \asymp n_1\log{n_1}$ between the low-dimensional and high-dimensional regimes. The suggested procedure is a variant of Lloyd's iterations initialized with a well-chosen spectral estimator leading to what we expect to be the optimal condition for exact recovery in BSBM. {The optimality conjecture is supported by showing that, for a supervised oracle procedure, such a condition is necessary to achieve exact recovery.} The key elements of the proof techniques are different from classical community detection tools on random graphs. Numerical studies confirm our theory, and show that the suggested algorithm is both very fast and achieves {almost the same} performance as the supervised oracle. Finally, using the connection between planted satisfiability problems and the BSBM, we improve upon the sufficient number of clauses to completely recover the planted assignment.


title: Invariant Diffs

abstract: Software development is inherently incremental. Nowadays, many software companies adopt an agile process and a shorter release cycle, where software needs to be delivered faster with quality assurances. On the other hand, the majority of existing program analysis tools still target single versions of programs and are slow and inflexible to handle changes. In the popular version control systems such as git, the program changes are still presented using source code diffs. It is hard to understand what program conditions are changed and which source code lines cause them. In this paper, we propose to compute "invariant diffs" to specify changes. Similar to source diffs that report common code and code churns, we define version invariants to represent program conditions that are common across versions, and invariant churns to show the changes of program conditions between versions. We designed a static demand-driven, path-sensitive analysis to compute and compare invariants for multiple versions of programs using multiversion control flow graphs. We report invariant diffs at the matched program points where comparing invariants are meaningful. Importantly, our analysis correlates source diffs with invariant diffs to explain what source code changes lead to the property changes. We implemented our algorithms in a tool called $H_2$ and performed experiments on 104 versions of programs. Our results show that we are able to compute invariant diffs correctly within reasonable amount of time. The version invariants can capture the common properties of program versions even constructed by different persons, and the invariant churns can specify the semantics of changes such as how a patch changed a buggy condition to a correct condition.


title: WITCHcraft: Efficient PGD attacks with random step size

abstract: State-of-the-art adversarial attacks on neural networks use expensive iterative methods and numerous random restarts from different initial points. Iterative FGSM-based methods without restarts trade off performance for computational efficiency because they do not adequately explore the image space and are highly sensitive to the choice of step size. We propose a variant of Projected Gradient Descent (PGD) that uses a random step size to improve performance without resorting to expensive random restarts. Our method, Wide Iterative Stochastic crafting (WITCHcraft), achieves results superior to the classical PGD attack on the CIFAR-10 and MNIST data sets but without additional computational cost. This simple modification of PGD makes crafting attacks more economical, which is important in situations like adversarial training where attacks need to be crafted in real time.


title: Crowd Counting via Segmentation Guided Attention Networks and Curriculum Loss

abstract: Automatic crowd behaviour analysis is an important task for intelligent transportation systems to enable effective flow control and dynamic route planning for varying road participants. Crowd counting is one of the keys to automatic crowd behaviour analysis. Crowd counting using deep convolutional neural networks (CNN) has achieved encouraging progress in recent years. Researchers have devoted much effort to the design of variant CNN architectures and most of them are based on the pre-trained VGG16 model. Due to the insufficient expressive capacity, the backbone network of VGG16 is usually followed by another cumbersome network specially designed for good counting performance. Although VGG models have been outperformed by Inception models in image classification tasks, the existing crowd counting networks built with Inception modules still only have a small number of layers with basic types of Inception modules. To fill in this gap, in this paper, we firstly benchmark the baseline Inception-v3 model on commonly used crowd counting datasets and achieve surprisingly good performance comparable with or better than most existing crowd counting models. Subsequently, we push the boundary of this disruptive work further by proposing a Segmentation Guided Attention Network (SGANet) with Inception-v3 as the backbone and a novel curriculum loss for crowd counting. We conduct thorough experiments to compare the performance of our SGANet with prior arts and the proposed model can achieve state-of-the-art performance with MAE of 57.6, 6.3 and 87.6 on ShanghaiTechA, ShanghaiTechB and UCF\_QNRF, respectively.


title: Smooth semi-Lipschitz functions and almost isometries of Finsler manifolds

abstract: The convex cone $SC_{\mathrm{SLip}}^1(\mathcal{X})$ of real-valued smooth semi-Lipschitz functions on a Finsler manifold $\mathcal{X}$ is an order-algebraic structure that captures both the differentiable and the quasi-metric feature of $\mathcal{X}$. In this work we show that the subset of smooth semi-Lipschitz functions of constant strictly less than $1$, denoted $SC_{1^{-}}^1(\mathcal{X})$, can be used to classify Finsler manifolds and to characterize almost isometries between them, in the lines of the classical Banach-Stone and Mykers-Nakai theorems.


title: Long-Term Personalization of an In-Home Socially Assistive Robot for Children With Autism Spectrum Disorders

abstract: Socially assistive robots (SAR) have shown great potential to augment the social and educational development of children with autism spectrum disorders (ASD). As SAR continues to substantiate itself as an effective enhancement to human intervention, researchers have sought to study its longitudinal impacts in real-world environments, including the home. Computational personalization stands out as a central computational challenge as it is necessary to enable SAR systems to adapt to each child's unique and changing needs. Toward that end, we formalized personalization as a hierarchical human robot learning framework (hHRL) consisting of five controllers (disclosure, promise, instruction, feedback, and inquiry) mediated by a meta-controller that utilized reinforcement learning to personalize instruction challenge levels and robot feedback based on each user's unique learning patterns. We instantiated and evaluated the approach in a study with 17 children with ASD, aged 3 to 7 years old, over month-long interventions in their homes. Our findings demonstrate that the fully autonomous SAR system was able to personalize its instruction and feedback over time to each child's proficiency. As a result, every child participant showed improvements in targeted skills and long-term retention of intervention content. Moreover, all child users were engaged for a majority of the intervention, and their families reported the SAR system to be useful and adaptable. In summary, our results show that autonomous, personalized SAR interventions are both feasible and effective in providing long-term in-home developmental support for children with diverse learning needs.