title: Spatial Resolution of Local Field Potential Signals in Macaque V4

abstract: A main challenge for the development of cortical visual prostheses is to spatially localize individual spots of light, called phosphenes, by assigning appropriate stimulating parameters to implanted electrodes. Imitating the natural responses to phosphene-like stimuli at different positions can help in designing a systematic procedure to determine these parameters. The key characteristic of such a system is the ability to discriminate between responses to different positions in the visual field. While most previous prosthetic devices have targeted the primary visual cortex, the extrastriate cortex has the advantage of covering a large part of the visual field with a smaller amount of cortical tissue, providing the possibility of a more compact implant. Here, we studied how well ensembles of Multiunit activity (MUA) and Local Field Potentials (LFPs) responses from extrastriate cortical visual area V4 of a behaving macaque monkey can discriminate between two-dimensional spatial positions. We found that despite the large receptive field sizes in V4, the combined responses from multiple sites, whether MUA or LFP, has the capability for fine and coarse discrimination of positions. We identified a selection procedure that could significantly increase the discrimination performance while reducing the required number of electrodes. Analysis of noise correlation in MUA and LFP responses showed that noise correlations in LFP responses carry more information about the spatial positions. Overall, these findings suggest that spatial positions could be localized with patterned stimulation in extrastriate area V4.


title: Towards Visually Explaining Variational Autoencoders

abstract: Recent advances in Convolutional Neural Network (CNN) model interpretability have led to impressive progress in visualizing and understanding model predictions. In particular, gradient-based visual attention methods have driven much recent effort in using visual attention maps as a means for visual explanations. A key problem, however, is these methods are designed for classification and categorization tasks, and their extension to explaining generative models, e.g. variational autoencoders (VAE) is not trivial. In this work, we take a step towards bridging this crucial gap, proposing the first technique to visually explain VAEs by means of gradient-based attention. We present methods to generate visual attention from the learned latent space, and also demonstrate such attention explanations serve more than just explaining VAE predictions. We show how these attention maps can be used to localize anomalies in images, demonstrating state-of-the-art performance on the MVTec-AD dataset. We also show how they can be infused into model training, helping bootstrap the VAE into learning improved latent space disentanglement, demonstrated on the Dsprites dataset.


title: On the stochastic flocking of the Cucker-Smale flock with randomly switching topologies

abstract: We present an emergent stochastic flocking dynamics of the Cucker-Smale (CS) ensemble under randomly switching topologies. The evolution of the CS ensemble with randomly switching topologies involves two random components (switching times and choices of network topologies at switching instant). First, we allow switching times for the network topology to be random so that the successive increments are i.i.d. processes following the common probability distribution. Second, at each switching instant, we choose a network topology randomly from a finite set of admissible network topologies whose union contains a spanning tree. Even for the fixed deterministic network topology, the CS ensemble may not exhibit a mono-cluster flocking depending on the initial data and the decay mode of the communication weight functions measuring the degree of interactions between particles. For the flocking dynamics of the CS ensemble with these two random components, we first use a priori conditions on the network topologies and uniform boundedness of position diameter, and derive the flocking estimates via matrix theory together with a priori conditions, and then replace the a priori condition for the position diameter by some suitable condition on the system parameters and communication weight. The a priori condition on the network topology will be guaranteed by the suitable spanning tree time-blocks with probability one.


title: Justification-Based Reliability in Machine Learning

abstract: With the advent of Deep Learning, the field of machine learning (ML) has surpassed human-level performance on diverse classification tasks. At the same time, there is a stark need to characterize and quantify reliability of a model's prediction on individual samples. This is especially true in application of such models in safety-critical domains of industrial control and healthcare. To address this need, we link the question of reliability of a model's individual prediction to the epistemic uncertainty of the model's prediction. More specifically, we extend the theory of Justified True Belief (JTB) in epistemology, created to study the validity and limits of human-acquired knowledge, towards characterizing the validity and limits of knowledge in supervised classifiers. We present an analysis of neural network classifiers linking the reliability of its prediction on an input to characteristics of the support gathered from the input and latent spaces of the network. We hypothesize that the JTB analysis exposes the epistemic uncertainty (or ignorance) of a model with respect to its inference, thereby allowing for the inference to be only as strong as the justification permits. We explore various forms of support (for e.g., k-nearest neighbors (k-NN) and l_p-norm based) generated for an input, using the training data to construct a justification for the prediction with that input. Through experiments conducted on simulated and real datasets, we demonstrate that our approach can provide reliability for individual predictions and characterize regions where such reliability cannot be ascertained.


title: The cohomology of the moduli space of curves at infinite level

abstract: Full level-n structures on smooth, complex curves are trivializations of the n-torsion points of their Jacobians. We give an algebraic proof that the etale cohomology of the moduli space of smooth, complex curves of genus at least 2 with "infinite level structure" vanishes in degrees above 4g-5. This yields a new perspective on a result of Harer who showed such vanishing already at finite level via topological methods. We obtain similar results for moduli spaces of stable curves and curves of compact type which are not covered by Harer's methods. The key ingredients in the proof are a vanishing statement for certain constructible sheaves on perfectoid spaces and a comparison of the etale cohomology of different towers of Deligne-Mumford stacks in the presence of ramification.


title: Rebuttal to Berger et al., TOPLAS 2019

abstract: Berger et al., published in TOPLAS 2019, is a critique of our 2014 FSE conference abstract and its archival version, the 2017 CACM paper: A Large-Scale Study of Programming Languages and Code Quality in Github. In their paper Berger et al. make academic claims about the veracity of our work. Here, we respond to their technical and scientific critiques aimed at our work, attempting to stick with scientific discourse. We find that Berger et al. largely replicated our results, and agree with us in their conclusion: that the effects (in a statistical sense) found in the data are small, and should be taken with caution, and that it is possible that an absence of effect is the correct interpretation. Thus, our CACM paper's conclusions still hold, even more so now that they have been reproduced, and our paper is eminently citable.


title: Strategy Synthesis for Surveillance-Evasion Games with Learning-Enabled Visibility Optimization

abstract: This paper studies a two-player game with a quantitative surveillance requirement on an adversarial target moving in a discrete state space and a secondary objective to maximize short-term visibility of the environment. We impose the surveillance requirement as a temporal logic constraint.We then use a greedy approach to determine vantage points that optimize a notion of information gain, namely, the number of newly-seen states. By using a convolutional neural network trained on a class of environments, we can efficiently approximate the information gain at each potential vantage point.Subsequent vantage points are chosen such that moving to that location will not jeopardize the surveillance requirement, regardless of any future action chosen by the target. Our method combines guarantees of correctness from formal methods with the scalability of machine learning to provide an efficient approach for surveillance-constrained visibility optimization.


title: Automatic Freeway Bottleneck Identification and Visualization using Image Processing Techniques

abstract: This paper develops an automatic freeway bottleneck identification and visualization algorithm using a combination of image processing techniques and traffic flow theory. Unlike previous studies that are based solely on loop detector data, the proposed method can use traffic measurements from various sensing technologies. Four steps are included in the proposed algorithm. First, the raw spatiotemporal speed data are transformed into binary matrices using image binarization techniques. Second, two post-processer filters are developed to clean the binary matrices by filtering scattered noise cells and localized congested regions. Subsequently, the roadway geometry information is used to remove the impact of acceleration zones downstream of bottlenecks and thus locate bottlenecks more precisely. Finally, the major characteristics of bottlenecks including activation and deactivation points, shockwave speeds and traffic delay caused by bottleneck are automatically extracted and visualized. The proposed algorithm is tested using loop detector data from I-5 demonstrating that the proposed method outperforms the state-of-the-art methods for congestion identification. The second test using INRIX data from I-66 demonstrates ability of the proposed algorithm to accurately extract and visualize bottleneck characteristics.


title: Liouville Type Theorems for Minimal Surface Equations in Half Space

abstract: For $n\geq2,$ we obtain Liouville type theorems for minimal surface equations in half space $\mathbf R^n_+$ with affine Dirichlet boundary value or constant Neumann boundary value.


title: Spectro-polarimetric Observations at the NVST: I. Instrumental Polarization Calibration and Primary Measurements

abstract: This paper is devoted to the primary spectro-polarimetric observation performed at the New Vacuum Solar Telescope of China since 2017, and our aim is to precisely evaluate the real polarimetric accuracy and sensitivity of this polarimetry by using full Stokes spectro-polarimetric observations of the photospheric line Fe I 532.4 nm. In the work, we briefly describe the salient characteristic of the NVST as a polarimeter in technology and then characterize its instrumental polarization based on the operation in 2017 and 2019. It is verified that the calibration method making use of the instrumental polarization calibration unit (ICU) is stable and credible. The calibration accuracy can reach up to 3$\times 10^{-3}$ . Based on the scientific observation of the NOAA 12645 on April 5th, 2017, we estimate that the residual cross-talk from Stokes $I$ to Stokes $Q$, $U$ and $V$, after the instrumental polarization calibration, is about 4$\times10^{-3}$ on average, which is consistent with the calibration accuracy and close to the photon noise. The polarimetric sensitivity (i.e., the detection limit) for polarized light is of the order of $10^{-3}$ with an integration time over 20 seconds. Slow modulation rate is indeed an issue for the present system. The present NVST polarimeter is expected to be integrated with an high-order adaptive optics system and a field scanner to realize 2D magnetic field vector measurements in the following instrumentation update.


title: Lattice study on the twisted ${\mathbb C}P^{N-1}$ models on ${\mathbb R}\times S^{1}$

abstract: We report the results of the lattice simulation of the ${\mathbb C} P^{N-1}$ sigma model on $S_{s}^{1}$(large) $\times$ $S_{\tau}^{1}$(small). We take a sufficiently large ratio of the circumferences to approximate the model on ${\mathbb R} \times S^1$. For periodic boundary condition imposed in the $S_{\tau}^{1}$ direction, we show that the expectation value of the Polyakov loop undergoes a deconfinement crossover as the compactified circumference is decreased, where the peak of the associated susceptibility gets sharper for larger $N$. For ${\mathbb Z}_{N}$ twisted boundary condition, we find that, even at relatively high $\beta$ (small circumference), the regular $N$-sided polygon-shaped distributions of Polyakov loop leads to small expectation values of Polyakov loop, which implies unbroken ${\mathbb Z}_{N}$ symmetry if sufficient statistics and large volumes are adopted. We also argue the existence of fractional instantons and bions by investigating the dependence of the Polyakov loop on $S_{s}^{1}$ direction, which causes transition between ${\mathbb Z}_{N}$ vacua.


title: NeuronInspect: Detecting Backdoors in Neural Networks via Output Explanations

abstract: Deep neural networks have achieved state-of-the-art performance on various tasks. However, lack of interpretability and transparency makes it easier for malicious attackers to inject trojan backdoor into the neural networks, which will make the model behave abnormally when a backdoor sample with a specific trigger is input. In this paper, we propose NeuronInspect, a framework to detect trojan backdoors in deep neural networks via output explanation techniques. NeuronInspect first identifies the existence of backdoor attack targets by generating the explanation heatmap of the output layer. We observe that generated heatmaps from clean and backdoored models have different characteristics. Therefore we extract features that measure the attributes of explanations from an attacked model namely: sparse, smooth and persistent. We combine these features and use outlier detection to figure out the outliers, which is the set of attack targets. We demonstrate the effectiveness and efficiency of NeuronInspect on MNIST digit recognition dataset and GTSRB traffic sign recognition dataset. We extensively evaluate NeuronInspect on different attack scenarios and prove better robustness and effectiveness over state-of-the-art trojan backdoor detection techniques Neural Cleanse by a great margin.


title: Approximate Fixed Point Properties in Digital Topology

abstract: We study the approximate fixed point property (AFPP) for continuous single-valued functions and for continuous multivalued functions in digital topology. We extend what is known about these notions and discuss errors that have appeared in the literature.


title: SSRNet: Scalable 3D Surface Reconstruction Network

abstract: Existing learning-based surface reconstruction methods from point clouds are still facing challenges in terms of scalability and preservation of details on large-scale point clouds. In this paper, we propose the SSRNet, a novel scalable learning-based method for surface reconstruction. The proposed SSRNet constructs local geometry-aware features for octree vertices and designs a scalable reconstruction pipeline, which not only greatly enhances the predication accuracy of the relative position between the vertices and the implicit surface facilitating the surface reconstruction quality, but also allows dividing the point cloud and octree vertices and processing different parts in parallel for superior scalability on large-scale point clouds with millions of points. Moreover, SSRNet demonstrates outstanding generalization capability and only needs several surface data for training, much less than other learning-based reconstruction methods, which can effectively avoid overfitting. The trained model of SSRNet on one dataset can be directly used on other datasets with superior performance. Finally, the time consumption with SSRNet on a large-scale point cloud is acceptable and competitive. To our knowledge, the proposed SSRNet is the first to really bring a convincing solution to the scalability issue of the learning-based surface reconstruction methods, and is an important step to make learning-based methods competitive with respect to geometry processing methods on real-world and challenging data. Experiments show that our method achieves a breakthrough in scalability and quality compared with state-of-the-art learning-based methods.


title: Relative nonhomogeneous Koszul duality

abstract: This book contains a detailed exposition of the nonhomogeneous Koszul duality theory in the relative situation over a noncentral, noncommutative, nonsemisimple base ring, as announced in Section 0.4 of arXiv:0708.3398. We prove the Poincare-Birkhoff-Witt theorem in this context and construct the triangulated equivalences of derived Koszul duality. The duality between the ring of differential operators and the de Rham DG-algebra, with the ring of functions as the base ring, is the thematic example. The moderate generality level makes the exposition in this book more accessible than the very heavily technical Chapter 11 of arXiv:0708.3398.


title: Exposing and extending the interior waves field by transformation materials

abstract: Based on transformation optics, a strategy is proposed to expose the inner one-dimensional space of a wave field inside a beam volume to the surface of the propagation medium and extend the space from one-dimensional to two-dimensional, allowing the corresponding field distribution to be detected directly and more subtly, which is important in optical signal processing. The method is applied to the quadratic graded index lens to construct a new graded index lens, and its enhanced chirpyness detection ability is demonstrated by numerical simulation.


title: FFDNet-Based Channel Estimation for Massive MIMO Visible Light Communication Systems

abstract: Channel estimation is of crucial importance in massive multiple-input multiple-output (m-MIMO) visible light communication (VLC) systems. In order to tackle this problem, a fast and flexible denoising convolutional neural network (FFDNet)-based channel estimation scheme for m-MIMO VLC systems was proposed. The channel matrix of the m-MIMO VLC channel is identified as a two-dimensional natural image since the channel has the characteristic of sparsity. A deep learning-enabled image denoising network FFDNet is exploited to learn from a large number of training data and to estimate the m-MIMO VLC channel. Simulation results demonstrate that our proposed channel estimation based on the FFDNet significantly outperforms the benchmark scheme based on minimum mean square error.


title: Multi-task Sentence Encoding Model for Semantic Retrieval in Question Answering Systems

abstract: Question Answering (QA) systems are used to provide proper responses to users' questions automatically. Sentence matching is an essential task in the QA systems and is usually reformulated as a Paraphrase Identification (PI) problem. Given a question, the aim of the task is to find the most similar question from a QA knowledge base. In this paper, we propose a Multi-task Sentence Encoding Model (MSEM) for the PI problem, wherein a connected graph is employed to depict the relation between sentences, and a multi-task learning model is applied to address both the sentence matching and sentence intent classification problem. In addition, we implement a general semantic retrieval framework that combines our proposed model and the Approximate Nearest Neighbor (ANN) technology, which enables us to find the most similar question from all available candidates very quickly during online serving. The experiments show the superiority of our proposed method as compared with the existing sentence matching models.


title: Dynamics Near An Idempotent

abstract: Hindman and Leader first introduced the notion of semigroup of ultrafilters converging to zero for a dense subsemigroups of $((0,\infty),+)$. Using the algebraic structure of the Stone-$\breve{C}$ech compactification, Tootkabani and Vahed generalized and extended this notion to an idempotent instead of zero, that is a semigroup of ultrafilters converging to an idempotent $e$ for a dense subsemigroups of a semitopological semigroup $(T, +)$ and they gave the combinatorial proof of central set theorem near $e$. Algebraically one can also define quasi-central sets near $e$ for dense subsemigroups of $(T, +)$. In a dense subsemigroup of $(T,+)$, C-sets near $e$ are the sets, which satisfy the conclusions of the central sets theorem near $e$. S. K. Patra gave dynamical characterizations of these combinatorially rich sets near zero. In this paper we shall prove these dynamical characterizations for these combinatorially rich sets near $e$.


title: Convolution algebra of diagram automorphism fixed quiver variety

abstract: We study the convolution algebra $H_{*}(Z^{\theta}_{W})$ of homology on diagram automorphism fixed point quiver variety and prove that there exists an algebra homomorphism from the universal enveloping algebra of the diagram automorphism fixed algebra of the split quiver to $H_{*}(Z^{\theta}_{W})$.


title: Development of MirrorShape: High Fidelity Large-Scale Shape Rendering Framework for Virtual Reality

abstract: Today there is a high variety of haptic devices capable of providing tactile feedback. Although most of existing designs are aimed at realistic simulation of the surface properties, their capabilities are limited in attempts of displaying shape and position of virtual objects. This paper suggests a new concept of distributed haptic display for realistic interaction with virtual object of complex shape by a collaborative robot with shape display end-effector. MirrorShape renders the 3D object in virtual reality (VR) system by contacting the user hands with the robot end-effector at the calculated point in real-time. Our proposed system makes it possible to synchronously merge the position of contact point in VR and end-effector in real world. This feature provides presentation of different shapes, and at the same time expands the working area comparing to desktop solutions. The preliminary user study revealed that MirrorShape was effective at reducing positional error in VR interactions. Potentially this approach can be used in the virtual systems for rendering versatile VR objects with wide range of sizes with high fidelity large-scaleshape experience.


title: Online Learning and Matching for Resource Allocation Problems

abstract: In order for an e-commerce platform to maximize its revenue, it must recommend customers items they are most likely to purchase. However, the company often has business constraints on these items, such as the number of each item in stock. In this work, our goal is to recommend items to users as they arrive on a webpage sequentially, in an online manner, in order to maximize reward for a company, but also satisfy budget constraints. We first approach the simpler online problem in which the customers arrive as a stationary Poisson process, and present an integrated algorithm that performs online optimization and online learning together. We then make the model more complicated but more realistic, treating the arrival processes as non-stationary Poisson processes. To deal with heterogeneous customer arrivals, we propose a time segmentation algorithm that converts a non-stationary problem into a series of stationary problems. Experiments conducted on large-scale synthetic data demonstrate the effectiveness and efficiency of our proposed approaches on solving constrained resource allocation problems.


title: Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Training

abstract: Multi-scale (MS) approaches have been widely investigated for blind single image / video deblurring that sequentially recovers deblurred images in low spatial scale first and then in high spatial scale later with the output of lower scales. MS approaches have been effective especially for severe blurs induced by large motions in high spatial scale since those can be seen as small blurs in low spatial scale. In this work, we investigate alternative approach to MS, called multi-temporal (MT) approach, for non-uniform single image deblurring. We propose incremental temporal training with constructed MT level dataset from time-resolved dataset, develop novel MT-RNNs with recurrent feature maps, and investigate progressive single image deblurring over iterations. Our proposed MT methods outperform state-of-the-art MS methods on the GoPro dataset in PSNR with the smallest number of parameters.


title: Learning product graphs from multidomain signals

abstract: In this paper, we focus on learning the underlying product graph structure from multidomain training data. We assume that the product graph is formed from a Cartesian graph product of two smaller factor graphs. We then pose the product graph learning problem as the factor graph Laplacian matrix estimation problem. To estimate the factor graph Laplacian matrices, we assume that the data is smooth with respect to the underlying product graph. When the training data is noise free or complete, learning factor graphs can be formulated as a convex optimization problem, which has an explicit solution based on the water-filling algorithm. The developed framework is illustrated using numerical experiments on synthetic data as well as real data related to air quality monitoring in India.


title: Provable Filter Pruning for Efficient Neural Networks

abstract: We present a provable, sampling-based approach for generating compact Convolutional Neural Networks (CNNs) by identifying and removing redundant filters from an over-parameterized network. Our algorithm uses a small batch of input data points to assign a saliency score to each filter and constructs an importance sampling distribution where filters that highly affect the output are sampled with correspondingly high probability. In contrast to existing filter pruning approaches, our method is simultaneously data-informed, exhibits provable guarantees on the size and performance of the pruned network, and is widely applicable to varying network architectures and data sets. Our analytical bounds bridge the notions of compressibility and importance of network structures, which gives rise to a fully-automated procedure for identifying and preserving filters in layers that are essential to the network's performance. Our experimental evaluations on popular architectures and data sets show that our algorithm consistently generates sparser and more efficient models than those constructed by existing filter pruning approaches.


title: Spinor vertexes and bubbles in the "old" conformal bootstrap on AdS and FMH problem: Yukawa model

abstract: Attempts to resolve the longstanding Fermion mass hierarchy (FMH) problem in frames of the AdS/CFT correspondence demand the knowledge of bulk fermion masses. The approach of the "old" conformal bootstrap in AdS context permitted to calculate bulk masses of scalar fields [1], [2]. In the present paper this approach is extended to physically more interesting spin 1/2 bulk fields. Calculation of spinor-scalar vertices is performed in physical AdS space, and unexpectedly simple expressions for spinor-scalar bubbles (2-point one-loop self-energy Witten diagrams) are obtained. The "double-trace from UV to IR flow" subtraction of UV divergences used earlier in calculations of the UV-finite bulk tadpoles is applied to bubbles. This permitted to write down in frame of the "old" conformal bootstrap approach the nontrivial spectral equations for the bulk fermion masses; SU(N) Yukawa model of spinor fields interacting with conformal invariant scalar field in case of four boundary dimensions is considered as a specific example.


title: Potential Field: Interpretable and Unified Representation for Trajectory Prediction

abstract: Predicting an agent's future trajectory is a challenging task given the complicated stimuli (environmental/inertial/social) of motion. Prior works learn individual stimulus from different modules and fuse the representations in an end-to-end manner, which makes it hard to understand what are actually captured and how they are fused. In this work, we borrow the notion of potential field from physics as an interpretable and unified representation to model all stimuli. This allows us to not only supervise the intermediate learning process, but also have a coherent method to fuse the information of different sources. From the generated potential fields, we further estimate future motion direction and speed, which are modeled as Gaussian distributions to account for the multi-modal nature of the problem. The final prediction results are generated by recurrently moving past location based on the estimated motion direction and speed. We show state-of-the-art results on the ETH, UCY, and Stanford Drone datasets.


title: Spectroscopic Visualization of a Robust Electronic Response of Semiconducting Nanowires to Deposition of Superconducting Islands

abstract: Following significant progress in the visualization and characterization of Majorana end modes in hybrid systems of semiconducting nanowires and superconducting islands, much attention is devoted to the investigation of the electronic structure at the buried interface between the semiconductor and the superconductor. The properties of that interface and the structure of the electronic wavefunctions that occupy it determine the functionality and the topological nature of the superconducting state induced therein. Here we study this buried interface by performing spectroscopic mappings of superconducting aluminum islands epitaxially grown in-situ on indium arsenide nanowires. We find unexpected robustness of the hybrid system as the direct contact with the aluminum islands does not lead to any change in the chemical potential of the nanowires, nor does it induce a significant band bending in their vicinity. We attribute this to the presence of surface states bound to the facets of the nanowire. Such surface states, that are present also in bare nanowires prior to aluminum deposition, pin the Fermi-level thus rendering the nanowires resilient to surface perturbations. The aluminum islands further display Coulomb blockade gaps and peaks that signify the formation of a resistive tunneling barrier at the InAs-Al interface. At low energies we identify a potential energy barrier that further suppresses the transmittance through the interface. A corresponding barrier exists in bare semiconductors between surface states and the accumulation layer, induced to maintain charge neutrality. Our observations elucidate the delicate interplay between the resistive nature of the InAs-Al interface and the ability to proximitize superconductivity and tune the chemical potential in semiconductor-superconductor hybrid nanowires.


title: A Traversable Wormhole Teleportation Protocol in the SYK Model

abstract: In this paper, we propose a concrete teleportation protocol in the SYK model based on a particle traversing a wormhole. The required operations for the communication, and insertion and extraction of the qubit, are all simple operators in terms of the basic qubits. We determine the effectiveness of this protocol, and find a version achieves almost perfect fidelity. Many features of semiclassical traversable wormholes are manifested in this setup.


title: Algorithmic Discrepancy Minimization

abstract: This report will be a literature review on a result in algorithmic discrepancy theory. We will begin by providing a quick overview on discrepancy theory and some major results in the field, and then focus on an important result by Shachar Lovett and Raghu Meka. We restate the main algorithm and ideas of the paper, and rewrite proofs for some of the major results in the paper.


title: Grassmannian Packings in Neural Networks: Learning with Maximal Subspace Packings for Diversity and Anti-Sparsity

abstract: Kernel sparsity ("dying ReLUs") and lack of diversity are commonly observed in CNN kernels, which decreases model capacity. Drawing inspiration from information theory and wireless communications, we demonstrate the intersection of coding theory and deep learning through the Grassmannian subspace packing problem in CNNs. We propose Grassmannian packings for initial kernel layers to be initialized maximally far apart based on chordal or Fubini-Study distance. Convolutional kernels initialized with Grassmannian packings exhibit diverse features and obtain diverse representations. We show that Grassmannian packings, especially in the initial layers, address kernel sparsity and encourage diversity, while improving classification accuracy across shallow and deep CNNs with better convergence rates.


title: Excitation functions of related parameters from transverse momentum (mass) spectra in high energy collisions

abstract: Transverse momentum (mass) spectra of positively and negatively charged pions, positively and negatively charged kaons, protons and antiprotons produced at mid-(pseudo)rapidity in various collisions at high energies are analyzed in this work. The experimental data measured in central gold-gold, central lead-lead, and inelastic proton-proton collisions by several international collaborations are studied. The (two-component) standard distribution is used to fit the data and extract the excitation function of effective temperature. Then, the excitation functions of kinetic freeze-out temperature, transverse flow velocity, and initial temperature are obtained. In the considered collisions, the four parameters increase with the increase of collision energy in general, and the kinetic freeze-out temperature appears the trend of saturation at the top Relativistic Heavy Ion Collider and the Large Hadron Collider.


title: A Graph Autoencoder Approach to Causal Structure Learning

abstract: Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed the combinatorial structure learning problem into a continuous one and then solved it using gradient-based optimization methods. Following the recent state-of-the-arts, we propose a new gradient-based method to learn causal structures from observational data. The proposed method generalizes the recent gradient-based methods to a graph autoencoder framework that allows nonlinear structural equation models and is easily applicable to vector-valued variables. We demonstrate that on synthetic datasets, our proposed method outperforms other gradient-based methods significantly, especially on large causal graphs. We further investigate the scalability and efficiency of our method, and observe a near linear training time when scaling up the graph size.


title: Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models

abstract: AI Safety is a major concern in many deep learning applications such as autonomous driving. Given a trained deep learning model, an important natural problem is how to reliably verify the model's prediction. In this paper, we propose a novel framework -- deep verifier networks (DVN) to verify the inputs and outputs of deep discriminative models with deep generative models. Our proposed model is based on conditional variational auto-encoders with disentanglement constraints. We give both intuitive and theoretical justifications of the model. Our verifier network is trained independently with the prediction model, which eliminates the need of retraining the verifier network for a new model. We test the verifier network on out-of-distribution detection and adversarial example detection problems, as well as anomaly detection problems in structured prediction tasks such as image caption generation. We achieve state-of-the-art results in all of these problems.


title: Formulation and properties of a divergence used to compare probability measures without absolute continuity

abstract: This paper develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and exploit a representation as an infimum convolution of optimal transport cost and relative entropy. Also included are examples of computation and approximation of the divergence, and the demonstration of properties that are useful when one quantifies model uncertainty.


title: Learning to Predict More Accurate Text Instances for Scene Text Detection

abstract: At present, multi-oriented text detection methods based on deep neural network have achieved promising performances on various benchmarks. Nevertheless, there are still some difficulties for arbitrary shape text detection, especially for a simple and proper representation of arbitrary shape text instances. In this paper, a pixel-based text detector is proposed to facilitate the representation and prediction of text instances with arbitrary shapes in a simple manner. Firstly, to alleviate the effect of the target vertex sorting and achieve the direct regression of arbitrary shape text instances, the starting-point-independent coordinates regression loss is proposed. Furthermore, to predict more accurate text instances, the text instance accuracy loss is proposed as an assistant task to refine the predicted coordinates under the guidance of IoU. To evaluate the effectiveness of our detector, extensive experiments have been carried on public benchmarks which contain arbitrary shape text instances and multi-oriented text instances. We obtain 84.8% of F-measure on Total-Text benchmark. The results show that our method can reach state-of-the-art performance.


title: Fast and Accurate 3D Hand Pose Estimation via Recurrent Neural Network for Capturing Hand Articulations

abstract: 3D hand pose estimation from a single depth image plays an important role in computer vision and human-computer interaction. Although recent hand pose estimation methods using convolution neural network (CNN) have shown notable improvements in accuracy, most of them have a limitation that they rely on a complex network structure without fully exploiting the articulated structure of the hand. A hand, which is an articulated object, is composed of six local parts: the palm and five independent fingers. Each finger consists of sequential-joints that provide constrained motion, referred to as a kinematic chain. In this paper, we propose a hierarchically-structured convolutional recurrent neural network (HCRNN) with six branches that estimate the 3D position of the palm and five fingers independently. The palm position is predicted via fully-connected layers. Each sequential-joint, i.e. finger position, is obtained using a recurrent neural network (RNN) to capture the spatial dependencies between adjacent joints. Then the output features of the palm and finger branches are concatenated to estimate the global hand position. HCRNN directly takes the depth map as an input without a time-consuming data conversion, such as 3D voxels and point clouds. Experimental results on public datasets demonstrate that the proposed HCRNN not only outperforms most 2D CNN-based methods using the depth image as their inputs but also achieves competitive results with state-of-the-art 3D CNN-based methods with a highly efficient running speed of 285 fps on a single GPU.


title: On random stable matchings: cyclic matchings with strict preferences and two-side matchings with partially ordered preferences

abstract: Consider a cyclically ordered collection of $r$ equinumerous agent sets with strict preferences of every agent over the agents from the next agent set. A weakly stable cyclic matching is a partition of the set of agents into disjoint union of $r$-long cycles, one agent from each set per cycle, such that there are no destabilizing $r$-long cycles, i.e. cycles in which every agent strictly prefers its successor to its successor in the matching. Assuming that the preferences are uniformly random and independent, we show that the expected number of stable matchings grows with $n$ (cardinality of each agent set) as $(n\log n)^{r-1}$. We also consider a bipartite stable matching problem where preference list of each agent forms a partially ordered set. Each partial order is an intersection of several, $k_i$ for side $i$, independent, uniformly random, strict orders. For $k_1+k_2>2$, the expected number of stable matchings is analyzed for three, progressively stronger, notions of stability. The expected number of weakly stable matchings is shown to grow super-exponentially fast. In contrast, for $\min(k_1,k_2)>1$, the fraction of instances with at least one strongly stable (super-stable) matching is super-exponentially small.


title: What is the Perfect Shuffle?

abstract: When shuffling a deck of cards, one probably wants to make sure it is thoroughly shuffled. A way to do this is by sifting through the cards to ensure that no adjacent cards are the same number, because surely this is a poorly shuffled deck. Unfortunately, human intuition for probability tends to lead us astray. For a standard 52-card deck of playing cards, the event is actually extremely likely. This report will attempt to elucidate how to answer this surprisingly difficult combinatorial question directly using rook polynomials.


title: RotationOut as a Regularization Method for Neural Network

abstract: In this paper, we propose a novel regularization method, RotationOut, for neural networks. Different from Dropout that handles each neuron/channel independently, RotationOut regards its input layer as an entire vector and introduces regularization by randomly rotating the vector. RotationOut can also be used in convolutional layers and recurrent layers with small modifications. We further use a noise analysis method to interpret the difference between RotationOut and Dropout in co-adaptation reduction. Using this method, we also show how to use RotationOut/Dropout together with Batch Normalization. Extensive experiments in vision and language tasks are conducted to show the effectiveness of the proposed method. Codes are available at \url{https://github.com/RotationOut/RotationOut}.


title: RIP constants for deterministic compressed sensing matrices-beyond Gershgorin

abstract: Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representations. This is achieved by collecting linear, non-adaptive measurements of a signal, which can be formalized as multiplying the signal with a "measurement matrix". If the measurement satisfies the so-called restricted isometry property (RIP), then it will be appropriate to be used in compressed sensing. While a wide class of random matrices provably satisfy the RIP with high probability, explicit and deterministic constructions have been shown (so far) to satisfy the RIP only in a significantly suboptimal regime. In this paper, we propose two novel approaches for improving the RIP constant estimates based on Gershgorin circle theorem for a specific deterministic construction based on Paley tight frames, obtaining an improvement over the Gershgorin bound by a multiplicative constant. In one approach we use a recent result on the spectra of the skew-adjacency matrices of oriented graphs. In the other approach, we use the so-called Dembo bounds on the extreme eigenvalues of a positive semidefinite Hermitian matrix. We also generalize these bounds and we combine the new bounds with a conjecture we make regarding the distribution of quadratic residues in a finite field to provide a potential path to break the so-called "square-root barrier"-we provide a proof based on the assumption that the conjecture holds.


title: Pairwise Interactive Graph Attention Network for Context-Aware Recommendation

abstract: Context-aware recommender systems (CARS), which consider rich side information to improve recommendation performance, have caught more and more attention in both academia and industry. How to predict user preferences from diverse contextual features is the core of CARS. Several recent models pay attention to user behaviors and use specifically designed structures to extract adaptive user interests from history behaviors. However, few works take item history interactions into consideration, which leads to the insufficiency of item feature representation and item attraction extraction. From these observations, we model the user-item interaction as a dynamic interaction graph (DIG) and proposed a GNN-based model called Pairwise Interactive Graph Attention Network (PIGAT) to capture dynamic user interests and item attractions simultaneously. PIGAT introduces the attention mechanism to consider the importance of each interacted user/item to both the user and the item, which captures user interests, item attractions and their influence on the recommendation context. Moreover, confidence embeddings are applied to interactions to distinguish the confidence of interactions occurring at different times. Then more expressive user/item representations and adaptive interaction features are generated, which benefits the recommendation performance especially when involving long-tail items. We conduct experiments on three real-world datasets to demonstrate the effectiveness of PIGAT.


title: Broken Democracy with Intermediate $\mathbb S_2 \times \mathbb S_2$ Residual Symmetry and Random Perturbations

abstract: The democratic mass matrix is an intriguing possibility for explaining the observed fermion mixings due to its inherent hierarchical mass eigenvalues and large mixing angles. Nevertheless, two of the three mass eigenvalues are zero if the flavor democracy is exact, in obvious contradiction with the experimental observations. One possibility is breaking the flavor democracy with anarchical perturbations as we proposed in an earlier work. However, even within the first two generations, the charged fermion masses are also hierarchical which may not be a coincidence. The democratic $\mathbb S^L_3 \times \mathbb S^R_3$ symmetry of the three generations may first be broken down to an intermediate $\mathbb S^L_2 \times \mathbb S^R_2$ symmetry among the first two generations to regulate the sequential hierarchies, followed by random perturbations, that generate the correct size of all measured observables. Unique predictions for neutrinoless double beta decay are also found.


title: Near perfect matchings in uniform hypergraphs

abstract: In this paper, we study degree conditions for the existence of large matchings in uniform hypergraphs. We prove that for integers $k,l,n$ with $k\ge 3$, $k/2<l<k$, and $n$ large, if $H$ is a $k$-uniform hypergraph on $n$ vertices and $\delta_{l}(H)>{n-l\choose k-l}-{(n-l)-(\lceil n/k \rceil-2)\choose 2}$, then $H$ has a matching covering all but a constant number of vertices. When $l=k-2$ and $k\ge 5$, such a matching is near perfect and our bound on $\delta_l(H)$ is best possible. When $k=3$, with the help of an absorbing lemma of H\'{a}n, Person, and Schacht, our proof also implies that $H$ has a perfect matching, a result proved by K\" uhn, Osthus, and Treglown and, independently, of Kahn.


title: Fast 2D Map Matching Based on Area Graphs

abstract: We present a novel area matching algorithm for merging two different 2D grid maps. There are many approaches to address this problem, nevertheless, most previous work is built on some assumptions, such as rigid transformation, or similar scale and modalities of two maps. In this work we propose a 2D map matching algorithm based on area segmentation. We transfer general 2D occupancy grid maps to an area graph representation, then compute the correct results by voting in that space. In the experiments, we compare with a state-of-the-art method applied to the matching of sensor maps with ground truth layout maps. The experiment shows that our algorithm has a better performance on large-scale maps and a faster computation speed.


title: Quantifying the unextendibility of entanglement

abstract: Entanglement is a striking feature of quantum mechanics, and it has a key property called unextendibility. In this paper, we present a framework for quantifying and investigating the unextendibility of general bipartite quantum states. First, we define the unextendible entanglement, a family of entanglement measures based on the concept of a state-dependent set of free states. The intuition behind these measures is that the more entangled a bipartite state is, the less entangled each of its individual systems is with a third party. Second, we demonstrate that the unextendible entanglement is an entanglement monotone under two-extendible quantum operations, including local operations and one-way classical communication as a special case. Normalization and faithfulness are two other desirable properties of unextendible entanglement, which we establish here. We further show that the unextendible entanglement provides efficiently computable benchmarks for the rate of exact entanglement or secret key distillation, as well as the overhead of probabilistic entanglement or secret key distillation.


title: Ultra-Fast Accurate AoA Estimation via Automotive Massive-MIMO Radar

abstract: Massive multiple-input multiple-output (MIMO) radar, enabled by millimeter-wave virtual MIMO techniques, provides great promises to the high-resolution automotive sensing and target detection in unmanned ground/aerial vehicles (UGA/UAV). As a long-established problem, however, existing subspace methods suffer from either high complexity or low accuracy. In this work, we propose two efficient methods, to accomplish fast subspace computation and accurate angle of arrival (AoA) acquisition. By leveraging randomized low-rank approximation, our fast multiple signal classification (MUSIC) methods, relying on random sampling and projection techniques, substantially accelerate the subspace estimation by orders of magnitude. Moreover, we establish the theoretical bounds of our proposed methods, which ensure the accuracy of the approximated pseudo-spectrum. As demonstrated, the pseudo-spectrum acquired by our fast-MUSIC would be highly precise; and the estimated AoA is almost as accurate as standard MUSIC. In contrast, our new methods are tremendously faster than standard MUSIC. Thus, our fast-MUSIC enables the high-resolution real-time environmental sensing with massive MIMO radars, which has great potential in the emerging unmanned systems.


title: Arrival Time Differences of Lensed Massive Gravitational Waves

abstract: It is of fundamental importance to know the mass of gravitons. A simple method for constraining the graviton mass is to compare the arrival time of light and that of gravitational waves provided that both waves are simultaneously emitted from the same source. To date, from observations of gravitational waves by the LIGO, the upper bound on the graviton mass $m_g$ is given by $m_g\lesssim 5.0 \times 10^{-23}$eV. However, when we compare the arrival time of light and gravitational waves, lensing effects could be important for some cases. Moreover, in many cases, the wavelength of gravitational waves is comparable with the gravitational radius of a lens object. Hence, we calculate arrival time differences between electromagnetic waves and massive gravitational waves by taking into account the effect of the gravitational wave optics. Here we take two lens models, a point mass lens and a singular isothermal sphere lens. We find that the lensing changes the arrival time difference of two waves by more than a second for the massive gravitational waves detectable by the LISA.


title: Optical Response in Excitonic Insulating State: Variational Cluster Approach

abstract: Optical responses in an excitonic insulating (EI) system with strong electron correlation are studied. We adopt the two-orbital Hubbard model with a finite energy difference between the two orbitals where the spin state degree of freedom exists. This model is analyzed by the variational cluster approach. In order to include the local electron correlation effect, the vertex correction is taken into account in the formulation of the optical conductivity spectra. We calculate a finite-temperature phase diagram, in which an EI phase appears between a low-spin band insulating state and a high-spin Mott insulating state. Characteristic components of the optical conductivity spectra consisting of a sharp peak and continuum appear in the EI phase. Integrated intensity almost follows the order parameter of the EI state, suggesting that this component is available to identify the EI phases and transitions.


title: Weighted $L_q(L_p)$-estimate with Muckenhoupt weights for the diffusion-wave equations with time-fractional derivatives

abstract: We present a weighted $L_{q}(L_{p})$-theory ($p,q\in(1,\infty)$) with Muckenhoupt weights for the equation $$ \partial_{t}^{\alpha}u(t,x)=\Delta u(t,x) +f(t,x), \quad t>0, x\in \mathbb{R}^d. $$ Here, $\alpha\in (0,2)$ and $\partial_{t}^{\alpha}$ is the Caputo fractional derivative of order $\alpha$. In particular we prove that for any $p,q\in (1,\infty)$, $w_{1}(x)\in A_p$ and $w_{2}(t)\in A_q$, $$ \int^{\infty}_0\left(\int_{\mathbb{R}^d} |u_{xx}|^p \,w_{1} dx \right)^{q/p}\,w_{2}dt \leq N \int^{\infty}_0\left(\int_{\mathbb{R}^d} |f|^p \,w_{1} dx \right)^{q/p}\,w_{2}dt, $$ where $A_p$ is the class of Muckenhoupt $A_p$ weights. Our approach is based on the sharp function estimates of the derivatives of solutions.


title: Detection of UHE gamma rays from the Crab Nebula: Physical Implications

abstract: The Crab Nebula is an extreme particle accelerator boosting the energy of electrons up to a few PeV ($10^{15} \ \rm eV$), close to the maximum energy allowed by theory. The physical conditions in the acceleration site and the nature of the acceleration process itself remain highly uncertain. The key information about the highest energy accelerated particles is contained in the synchrotron and inverse Compton (IC) channels of radiation at energies above 1~MeV and 100~TeV, respectively. The recent report of detection of ultra-high energy gamma-ray signal from the Crab Nebula up to 300~TeV allows one to determine the energy distribution of the highest energy electrons and to derive the magnetic field strength in the acceleration region, $B\leq120\rm\,\mu G$, in a parameter-free way. This estimate brings new constraints on the properties of non-thermal particle distributions and puts important constraints on the MHD models for the Crab Nebula, in particular on the feasible magnetization and anisotropy of the pulsar wind. The calculations of synchrotron and IC emission show that future observations with instruments allowing detection of the Crab Nebula above 300~TeV and above 1~MeV will clarify the conditions allowing acceleration of electrons beyond PeV energies in the Crab Nebula. In particular, one will (1) verify the hypothetical multi-component composition of the electron energy distribution, and (2) determine the magnetic field strength in the regions responsible for the acceleration of PeV electrons.


title: Finite temperature density matrix embedding theory

abstract: We describe a formulation of the density matrix embedding theory at finite temperature. We present a generalization of the ground-state bath orbital construction that embeds a mean-field finite-temperature density matrix up to a given order in the Hamiltonian, or the Hamiltonian up to a given order in the density matrix. We assess the performance of the finite-temperature density matrix embedding on the 1D Hubbard model both at half-filling and away from it, and the 2D Hubbard model at half-filling, comparing to exact data where available, as well as results from finite-temperature density matrix renormalization group, dynamical mean-field theory, and dynamical cluster approximations. The accuracy of finite-temperature density matrix embedding appears comparable to that of the ground-state theory, with at most a modest increase in bath size, and competitive with that of cluster dynamical mean-field theory.


title: Large Scale Open-Set Deep Logo Detection

abstract: We present an open-set logo detection (OSLD) system, which can detect (localize and recognize) any number of unseen logo classes without re-training; it only requires a small set of canonical logo images for each logo class. We achieve this using a two-stage approach: (1) Generic logo detection to detect candidate logo regions in an image. (2) Logo matching for matching the detected logo regions to a set of canonical logo images to recognize them. We constructed an open-set logo detection dataset with 12.1k logo classes and released it for research purposes.We demonstrate the effectiveness of OSLD on our dataset and on the standard Flickr-32 logo dataset, outperforming the state-of-the-art open-set and closed-set logo detection methods by a large margin. OSLD is scalable to millions of logo classes.


title: Modelling the interaction between relativistic and non-relativistic winds in binary pulsar systems: strong magnetization of the pulsar wind

abstract: We present a numerical study of the properties of the flow produced by the collision of a magnetized anisotropic pulsar wind with the circumbinary environment. We focus on studying the impact of the high wind magnetization on the geometrical structure of the shocked flow. This work is an extension of our earlier studies that focused on a purely hydrodynamic interaction and weak wind magnetization. We consider the collision in the axisymmetric approximation, that is, the pulsar rotation axis is assumed to be oriented along the line between the pulsar and the optical star. The increase of the magnetization results in the expansion of the opening cone in which the shocked pulsar wind propagates. This effect is explained in the frameworks of the conventional theory of collimation of magnetized winds. This finding has a direct implication for scenarios that involve Doppler boosting as the primary mechanism behind the GeV flares detected with the Fermi/LAT from PSR B1259-63/LS2883. The maximum enhancement of the apparent emission is determined by the ratio of $4\pi$ to the solid in which the shocked pulsar wind propagates. Our simulations suggest that this enhancement factor is decreased by the impact of the magnetic field.


title: Probing Small Scale Primordial Power Spectrum with 21cm Line Global Signal

abstract: We argue that the global signal of neutral hydrogen 21cm line can be a powerful probe of primordial power spectrum on small scales. Since the amplitude of small scale primordial fluctuations is important to determine the early structure formation and the timing when the sources of Lyman ${\alpha}$ photons are produced, they in turn affect the neutral hydrogen 21cm line signal. We show that the information of the position of the absorption trough can severely constrain the small scale amplitude of primordial fluctuations once astrophysical parameters relevant to the 21cm line signal are fixed. We also discuss how the uncertainties of astrophysical parameters affect the constraints.


title: Sizing and Allocation of Distributed Energy Resources for Loss Reduction using Heuristic Algorithms

abstract: Loss minimization in distribution networks (DN) is of great significance since the trend to the distributed generation (DG) requires the most efficient operating scenario possible for economic viability variations. Moreover, voltage instability in DNs is a critical phenomenon and can lead to a major blackout in the system. The decreasing voltage stability level restricts the increase of load served by distribution companies. DG can be used to improve DN capabilities and brings new opportunities to traditional DNs. However, installation of DG in non-optimal places can result in an increase in system losses, voltage problems, etc. In this paper, genetic algorithm (GA), harmony search algorithm (HSA) and improved HSA have been applied to determine the optimal location of DGs. Simulation results for an IEEE 33 bus network are compared for different algorithms, and the best algorithm is stated for minimum losses.


title: A Code Injection Method for Rapid Docker Image Building

abstract: Docker images are composed of multiple layers, each of which contains a set of instructions, and an archive of files. Layers allow Docker to separate a large build task into smaller ones, such that when a part of the program is changed, only the corresponding layer needs to be changed. Yet the current implementation has major inefficiencies that make the rebuilding of an image unnecessarily slow when changes in bottom layers are required: uneven content distribution amongst layers, the need to rebuild an entire layer during update, and the rebuild fall-throughs in many cases. In this paper, we propose a code injection method that overcomes these inefficiencies by targeting only the changed layer and then bypassing the layer's content checksum. This process is developed specifically for an interpreted language such as Python, where changes can be detected explicitly via text diff tools and run as-is without compilation. We then demonstrate that this method can accelerate the rebuild time, effectively reducing the O(n) where n = size of layer rebuild time to O(1). Whereas for compiled languages, literal code injection cannot guarantee integrity in compiled machine code. Expanding on the same code injection principle, multi-layer targeted code injection will be addressed in a future discussion.


title: Temperature-induced nanostructural evolution of hydrogen-rich voids in amorphous silicon: A first-principles study

abstract: The paper presents an $ab$ $initio$ study of temperature-induced nanostructural evolution of hydrogen-rich voids in amorphous silicon. By using large $a$-Si models, obtained from classical molecular-dynamics simulations, with a realistic void-volume density of 0.2%, the dynamics of Si and H atoms on the surface of the nanometer-size cavities were studied and their effects on the shape and size of the voids were examined using first-principles density-functional simulations. The results from $ab$ $initio$ calculations were compared with those obtained from using the modified Stillinger-Weber potential. The temperature-induced nanostructural evolution of the voids was examined by analyzing the three-dimensional distribution of Si and H atoms on/near void surfaces using the convex-hull approximation, and computing the radius of gyration of the corresponding convex hulls. A comparison of the results with those from the simulated values of the intensity in small-angle X-ray scattering of $a$-Si/$a$-Si:H in the Guinier approximation is also provided, along with a discussion on the dynamics of bonded and non-bonded hydrogen in the vicinity of voids.


title: NAIS: Neural Architecture and Implementation Search and its Applications in Autonomous Driving

abstract: The rapidly growing demands for powerful AI algorithms in many application domains have motivated massive investment in both high-quality deep neural network (DNN) models and high-efficiency implementations. In this position paper, we argue that a simultaneous DNN/implementation co-design methodology, named Neural Architecture and Implementation Search (NAIS), deserves more research attention to boost the development productivity and efficiency of both DNN models and implementation optimization. We propose a stylized design methodology that can drastically cut down the search cost while preserving the quality of the end solution.As an illustration, we discuss this DNN/implementation methodology in the context of both FPGAs and GPUs. We take autonomous driving as a key use case as it is one of the most demanding areas for high quality AI algorithms and accelerators. We discuss how such a co-design methodology can impact the autonomous driving industry significantly. We identify several research opportunities in this exciting domain.


title: Subspace Shapes: Enhancing High-Dimensional Subspace Structures via Ambient Occlusion Shading

abstract: We test the hypothesis whether transforming a data matrix into a 3D shaded surface or even a volumetric display can be more appealing to humans than a scatterplot since it makes direct use of the innate 3D scene understanding capabilities of the human visual system. We also test whether 3D shaded displays can add a significant amount of information to the visualization of high-dimensional data, especially when enhanced with proper tools to navigate the various 3D subspaces. Our experiments suggest that mainstream users prefer shaded displays over scatterplots for visual cluster analysis tasks after receiving training for both. Our experiments also provide evidence that 3D displays can better communicate spatial relationships, size, and shape of clusters.


title: Weak Control Approach to Consumer-Preferred Energy Management

abstract: This paper is devoted to a consumer-preferred community-level energy management system (CEMS), in which a system manager allows consumers their selfish decisions of power-saving while regulating the overall demand-supply imbalance. The key structure of the system is to weakly control consumers: the controller sends the allowable range of the power-saving amount to each consumer, which is modeled by a set-valued control signal. Then, the consumers decide the amount in the range based on their private preference. In this paper, we address the design problem of the controller that generates the set-valued control signals. The controller structure is based on internal model control, which plays the essential role of guaranteeing the consumer-independent stability and the worst-case control performance of the overall CEMS. Finally, a numerical experiment of the consumer-preferred CEMS is performed to demonstrate the design procedure of the controller and to show its effectiveness.


title: Understanding Open Source Serverless Platforms: Design Considerations and Performance

abstract: Serverless computing is increasingly popular because of the promise of lower cost and the convenience it provides to users who do not need to focus on server management. This has resulted in the availability of a number of proprietary and open-source serverless solutions. We seek to understand how the performance of serverless computing depends on a number of design issues using several popular open-source serverless platforms. We identify the idiosyncrasies affecting performance (throughput and latency) for different open-source serverless platforms. Further, we observe that just having either resource-based (CPU and memory) or workload-based (request per second (RPS) or concurrent requests) auto-scaling is inadequate to address the needs of the serverless platforms.


title: Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation

abstract: Visual navigation is a task of training an embodied agent by intelligently navigating to a target object (e.g., television) using only visual observations. A key challenge for current deep reinforcement learning models lies in the requirements for a large amount of training data. It is exceedingly expensive to construct sufficient 3D synthetic environments annotated with the target object information. In this paper, we focus on visual navigation in the low-resource setting, where we have only a few training environments annotated with object information. We propose a novel unsupervised reinforcement learning approach to learn transferable meta-skills (e.g., bypass obstacles, go straight) from unannotated environments without any supervisory signals. The agent can then fast adapt to visual navigation through learning a high-level master policy to combine these meta-skills, when the visual-navigation-specified reward is provided. Evaluation in the AI2-THOR environments shows that our method significantly outperforms the baseline by 53.34% relatively on SPL, and further qualitative analysis demonstrates that our method learns transferable motor primitives for visual navigation.


title: DirectPose: Direct End-to-End Multi-Person Pose Estimation

abstract: We propose the first direct end-to-end multi-person pose estimation framework, termed DirectPose. Inspired by recent anchor-free object detectors, which directly regress the two corners of target bounding-boxes, the proposed framework directly predicts instance-aware keypoints for all the instances from a raw input image, eliminating the need for heuristic grouping in bottom-up methods or bounding-box detection and RoI operations in top-down ones. We also propose a novel Keypoint Alignment (KPAlign) mechanism, which overcomes the main difficulty: lack of the alignment between the convolutional features and predictions in this end-to-end framework. KPAlign improves the framework's performance by a large margin while still keeping the framework end-to-end trainable. With the only postprocessing non-maximum suppression (NMS), our proposed framework can detect multi-person keypoints with or without bounding-boxes in a single shot. Experiments demonstrate that the end-to-end paradigm can achieve competitive or better performance than previous strong baselines, in both bottom-up and top-down methods. We hope that our end-to-end approach can provide a new perspective for the human pose estimation task.


title: Mobile Traffic Offloading with Forecasting using Deep Reinforcement Learning

abstract: With the explosive growth in demand for mobile traffic, one of the promising solutions is to offload cellular traffic to small base stations for better system efficiency. Due to increasing system complexity, network operators are facing severe challenges and looking for machine learning-based solutions. In this work, we propose an energy-aware mobile traffic offloading scheme in the heterogeneous network jointly apply deep Q network (DQN) decision making and advanced traffic demand forecasting. The base station control model is trained and verified on an open dataset from a major telecom operator. The performance evaluation shows that DQN-based methods outperform others at all levels of mobile traffic demand. Also, the advantage of accurate traffic prediction is more significant under higher traffic demand.


title: Vulnerability Analysis for Data Driven Pricing Schemes

abstract: Data analytics and machine learning techniques are being rapidly adopted into the power system, including power system control as well as electricity market design. In this paper, from an adversarial machine learning point of view, we examine the vulnerability of data-driven electricity market design. More precisely, we follow the idea that consumer's load profile should uniquely determine its electricity rate, which yields a clustering oriented pricing scheme. We first identify the strategic behaviors of malicious users by defining a notion of disguising. Based on this notion, we characterize the sensitivity zones to evaluate the percentage of malicious users in each cluster. Based on a thorough cost benefit analysis, we conclude with the vulnerability analysis.


title: Non-Classical Crystal Growth Recipe using nanocrystalline ceria a detailed review

abstract: In this review, room temperature (RT) precipitation of the nanocrystalline-ceria (nc-ceria) re-dispersed and subsequently size-reduced by 20 kHz probe sonication in 25 % ethylene glycol/ 75 % DI-water mixed media is investigated. The sonication result in three nanostructured products: (1) water-soluble supernatant nc-ceria (Ce_Sl@RT), (2) settled gelatinous nc-ceria mass (Ce_SS@RT), and (3) ambient dried nc-ceria solid powder (Ce_SP@RT) product along with the parent RT nc-ceria (Ce@RT) precipitates. Surface/interface attributes are investigated systematically with the help of suitable spectroscopic probes. By following this synthesis protocol, the nc-ceria is made to cohabit with a variety (water, ethylene glycol, air) of neighbors that lead to the distinct surface and interface termination. The physical and chemical aspects of these varieties of the specialized surface terminated nc-ceria are explored coherently with respect to the Ce@RT precipitate. The second aspect of this review is devoted to the biomineralization for which the sonication derived Ce_Sl@RT is the candidate of choice. Aging of Ce_Sl@RT is physically tracked to mimic the natural aquatic medium crystal growth by the biomineralization process. In-situ TEM is extensively used to demonstrate the non-classical crystal growth mechanism physically. Uniquely TEM electron beam (e-beam) is exploited to aid both in the material manipulation and probing.


title: On the Assouad dimension and convergence of metric spaces

abstract: We introduce the notion of pseudo-cones of metric spaces as a generalization of both of the tangent cones and the asymptotic cones. We prove that the Assouad dimension of a metric space is bounded from below by that of any pseudo-cone of it. We exhibit a example containing all compact metric spaces as pseudo-cones, and examples containing all proper length spaces as tangent cones or asymptotic cones.


title: Steady-State Control and Machine Learning of Large-Scale Deformable Mirror Models

abstract: We use Machine Learning (ML) and system identification validation approaches to estimate neural network models of large-scale Deformable Mirrors (DMs) used in Adaptive Optics (AO) systems. To obtain the training, validation, and test data sets, we simulate a realistic large-scale Finite Element (FE) model of a faceplate DM. The estimated models reproduce the input-output behavior of Vector AutoRegressive with eXogenous (VARX) input models and can be used for the design of high-performance AO systems. We address the model order selection and overfitting problems. We also provide an FE based approach for computing steady-state control signals that produce the desired wavefront shape. This approach can be used to predict the steady-state DM correction performance for different actuator spacings and configurations. The presented methods are tested on models with thousands of state variables and hundreds of actuators. The numerical simulations are performed on low-cost high-performance graphic processing units and implemented using the TensorFlow machine learning framework. The used codes are available online. The approaches presented in this paper are useful for the design and optimization of high-performance DMs and AO systems.

categories: eess.SY cs.LG cs.SY math.OC physics.optics stat.ML


title: Calibrating the power of relativistic jets

abstract: There are several methods to calculate the radiative and kinetic power of relativistic jets, but their results can differ by one or two orders of magnitude. Therefore, it is necessary to perform a calibration of the jet power, to understand the reasons for these differences (whether wrong hypotheses or intrinsic source variability), and if it is possible to converge to a reliable measurement of this physical quantity. We present preliminary results of a project aimed at calibrating the power of relativistic jets in active galactic nuclei (AGN) and X-ray binaries (XRB). We started by selecting all the AGN associations with known redshift in the Fourth Fermi LAT Gamma-Ray Catalog (4FGL). We then calculated the radiative and/or kinetic powers from available data or we extracted this information from literature. We compare the values obtained for overlapping samples and highlight early conclusions.


title: Fa\`a di Bruno's formula and inversion of power series

abstract: Fa\`a di Bruno's formula gives an expression for the derivatives of the composition of two real-valued functions. In this paper we prove a multivariate and synthesized version of Fa\`a di Bruno's formula in higher dimensions, providing a combinatorial expression for the derivatives of chain compositions $F^{(1)} \circ \ldots \circ F^{(m)}$ of functions $F^{(l)} : \mathbb{R}^N \to \mathbb{R}^N$ in terms of sums over labelled trees. We give several applications of this formula, including a new involution formula for the inversion of multivariate power series. We use this framework to outline a combinatorial approach to studying the invertibility of polynomial mappings, giving a purely combinatorial restatement of the Jacobian conjecture. Our methods extend naturally to the non-commutative case, where we prove a free version of Fa\`a di Bruno's formula for multivariate power series in free indeterminates, and use this formula as a tool for obtaining a new inversion formula for free power series.


title: Interaction-impeded relaxation in the presence of finite temperature baths

abstract: We study the interplay between interactions and finite-temperature dephasing baths. We consider a double well with strongly interacting bosons coupled, via the density, to a bosonic bath. Such a system, when the bath has infinite temperature and instantaneous decay of correlations, relaxes with an emerging algebraic behavior with exponent 1/2. Here we show that, because of the finite-temperature baths and of the choice of spectral densities, such an algebraic relaxation may occur for a shorter duration and the characteristic exponent can be lower than 1/2. These results show that the interaction-induced impeding of relaxation is stronger and more complex when the bath has finite temperature and/or nonzero timescale for the decay of correlations.


title: Walking the Tightrope: An Investigation of the Convolutional Autoencoder Bottleneck

abstract: In this paper, we present an in-depth investigation of the convolutional autoencoder (CAE) bottleneck. Autoencoders (AE), and especially their convolutional variants, play a vital role in the current deep learning toolbox. Researchers and practitioners employ CAEs for a variety of tasks, ranging from outlier detection and compression to transfer and representation learning. Despite their widespread adoption, we have limited insight into how the bottleneck shape impacts the emergent properties of the CAE. We demonstrate that increased height and width of the bottleneck drastically improves generalization, which in turn leads to better performance of the latent codes in downstream transfer learning tasks. The number of channels in the bottleneck, on the other hand, is secondary in importance. Furthermore, we show empirically that, contrary to popular belief, CAEs do not learn to copy their input, even when the bottleneck has the same number of neurons as there are pixels in the input. Copying does not occur, despite training the CAE for 1,000 epochs on a tiny ($\approx$ 600 images) dataset. We believe that the findings in this paper are directly applicable and will lead to improvements in models that rely on CAEs.


title: Symmetry-Enforced Weyl Phonons

abstract: In spinful electronic systems, time-reversal symmetry makes that all Kramers pairs at the time-reversal-invariant momenta are Weyl points (WPs) in chiral crystals. Here, we find that such symmetry-enforced WPs can also emerge in bosonic systems ($e.g.$ phonons and photons) due to nonsymmorphic symmetries. We demonstrate that for some nonsymmorphic chiral space groups, several high-symmetry $k$-points can host $only$ WPs in the phononic systems, dubbed symmetry-enforced Weyl phonons (SEWPs). The SEWPs, enumerated in Table I, are pinned at the boundary of the three-dimensional (3D) Brillouin zone (BZ) and protected by nonsymmorphic crystal symmetries. By performing first-principles calculations and symmetry analysis, we propose that as an example of SEWPs, the two-fold degeneracies at P are monopole WPs in K$_2$Sn$_2$O$_3$ with space group 199. The two WPs of the same chirality at two nonequivalent P points are related by time-reversal symmetry. In particular, at $\sim 17.5$ THz, a spin-1 Weyl phonon is also found at H, since two Weyl phonons at P carrying a non-zero net Chern number cannot exist alone in the 3D BZ. The significant separation between P and H points makes the surface arcs long and clearly visible. Our findings not only present an effective way to search for WPs in bosonic systems, but also offer some promising candidates for studying monopole Weyl and spin-1 Weyl phonons in realistic materials.


title: Elastic Response in the Dilute non-Kramers System Y$_{1-x}$Pr$_x$Ir$_2$Zn$_{20}$

abstract: Ultrasonic investigations of the single-site quadrupolar Kondo effect in diluted Pr system Y$_{0.966}$Pr$_{0.034}$Ir$_2$Zn$_{20}$ are reported. The elastic constant $(C_{11}-C_{12})/2$ is measured down to ~40 mK using ultrasound for the dilute system Y$_{0.966}$Pr$_{0.034}$Ir$_2$Zn$_{20}$ and the pure compound YIr$_2$Zn$_{20}$. We found that the elastic constant $(C_{11}-C_{12})/2$ of the Pr-dilute system exhibits a logarithmic temperature dependence below $T_0$ ~0.3 K, where non-Fermi-liquid (NFL) behavior in the specific heat and electrical resistivity is observed. This logarithmic temperature variation manifested in the $\Gamma_3$-symmetry quadrupolar susceptibility is consistent with the theoretical prediction of the quadrupolar Kondo effect by D. L. Cox. On the other hand, the pure compound YIr$_2$Zn$_{20}$ without $4f$-electron contributions shows nearly no change in its elastic constants evidencing negligible phonon contributions. In addition, clear acoustic de Haas-van Alphen (dHvA) oscillations in the elastic constant were detected for both compounds on applying magnetic field. This is mainly interpreted as contribution from the Fermi surface of YIr$_2$Zn$_{20}$.


title: Optimal deployments of UAVs with directional antennas for a power-efficient coverage

abstract: To provide a reliable wireless uplink for users in a given ground area, one can deploy Unmanned Aerial Vehicles (UAVs) as base stations (BSs). In another application, one can use UAVs to collect data from sensors on the ground. For a power-efficient and scalable deployment of such flying BSs, directional antennas can be utilized to efficiently cover arbitrary 2-D ground areas. We consider a large-scale wireless path-loss model with a realistic angle-dependent radiation pattern for the directional antennas. Based on such a model, we determine the optimal 3-D deployment of N UAVs to minimize the average transmit-power consumption of the users in a given target area. The users are assumed to have identical transmitters with ideal omnidirectional antennas and the UAVs have identical directional antennas with given half-power beamwidth (HPBW) and symmetric radiation pattern along the vertical axis. For uniformly distributed ground users, we show that the UAVs have to share a common flight height in an optimal power-efficient deployment. We also derive in closed-form the asymptotic optimal common flight height of $N$ UAVs in terms of the area size, data-rate, bandwidth, HPBW, and path-loss exponent.


title: Insight into Two-Dimensional Borophene: Five-Center Bond and Phonon-Mediated Superconductivity

abstract: We report a previously unknown monolayer borophene allotrope and we call it super-B with a flat structure based on the ab initio calculations. It has good thermal, dynamical, and mechanical stability compared with many other typical borophenes. We find that super-B has a fascinating chemical bond environment consisting of standard sp, sp2 hybridizations, and delocalized five-center three-electron $\pi$ bond, called $\pi$(5c-3e). This particular electronic structure plays a pivotal role in stabilizing the super-B chemically. By extra doping, super-B can be transformed into a Dirac material from pristine metal. Like graphene, it can also sustain tensile strain smaller than 24%, indicating superior flexibility. Moreover, due to the small atomic mass and large density of states at the Fermi level, super-B has the highest critical temperature Tc of 25.3 K in single-element superconductors at ambient conditions. We attribute this high Tc of super-B to the giant anharmonicity of two linear acoustic phonon branches and an unusually low optic phonon mode. These predictions provide new insight into the chemical nature of low dimensional boron nanostructures and highlight the potential applications of designing flexible devices and high Tc superconductors.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.atm-clus physics.comp-ph


title: Implicit Enumeration of Topological-Minor-Embeddings and Its Application to Planar Subgraph Enumeration

abstract: Given graphs $G$ and $H$, we propose a method to implicitly enumerate topological-minor-embeddings of $H$ in $G$ using decision diagrams. We show a useful application of our method to enumerating subgraphs characterized by forbidden topological minors, that is, planar, outerplanar, series-parallel, and cactus subgraphs. Computational experiments show that our method can find all planar subgraphs in a given graph at most five orders of magnitude faster than a naive backtracking-based method.


title: A Message Passing Approach for Multiple Maneuvering Target Tracking

abstract: This paper considers the problem of detecting and tracking multiple maneuvering targets, which suffers from the intractable inference of high-dimensional latent variables that include target kinematic state, target visibility state, motion mode-model association, and data association. A unified message passing algorithm that combines belief propagation (BP) and mean-field (MF) approximation is proposed for simplifying the intractable inference. By assuming conjugate-exponential priors for target kinematic state, target visibility state, and motion mode-model association, the MF approximation decouples the joint inference of target kinematic state, target visibility state, motion mode-model association into individual low-dimensional inference, yielding simple message passing update equations. The BP is exploited to approximate the probabilities of data association events since it is compatible with hard constraints. Finally, the approximate posterior probability distributions are updated iteratively in a closed-loop manner, which is effective for dealing with the coupling issue between the estimations of target kinematic state and target visibility state and decisions on motion mode-model association and data association. The performance of the proposed algorithm is demonstrated by comparing with the well-known multiple maneuvering target tracking algorithms, including interacting multiple model joint probabilistic data association, interacting multiple model hypothesis-oriented multiple hypothesis tracker and multiple model generalized labeled multi-Bernoulli.


title: Particle size controlled magnetic loss in magnetite nanoparticles in RF-microwave region

abstract: Frequency dependant complex magnetic permeability is used to understand RF-microwave behaviour of magnetic nanoparticles in the frequency range 250 MHz to 3 GHz. The stable dispersions of Fe3O4 nanoparticles with mean size varying between 11 to 16 nm are prepared for this purpose. The effect of mean particle size and external static magnetic field over microwave absorption properties of magnetic fluid is studied. It is observed that frequency of ferrimagnetic resonance, frequency of maximum absorption, loss tangent and reflection loss (RL) can be controlled by modifying mean particle size and strength of applied external static magnetic field. This kind of study can be useful for radio-microwave devices like tunable attenuator, EM sheilder, and other applications like Hyperthermia.


title: Effect of particle contact on the electrical performance of NTC-epoxy composite thermistors

abstract: As demand rises for flexible electronics, traditionally prepared sintered ceramic sensors must be transformed into fully new sensor materials that can bend and flex in use and integration. Negative temperature coefficient of resistance (NTC) ceramic thermistors are preferred temperature sensors for their high accuracy and excellent stability, yet their high stiffness and high temperature fabrication process limits their use in flexible electronics. Here, a low stiffness thermistor based on NTC ceramic particles of micron size embedded in an epoxy polymer matrix is reported. The effect of particle-to-particle contact on electrical performance is studied by arranging the NTC particles in the composite films in one of three ways: 1) Low particle contact, 2) Improved particle contact perpendicular to the electrodes and 3) dispersing high particle contact agglomerated clumps throughout the polymer. At 50 vol.\% of agglomerated NTC particles, the composite films exhibit a $\beta$-value of 2069 K and a resistivity, $\rho$, of 3.3$\cdot 10^5$ $\Omega$m, 4 orders of magnitude lower than a randomly dispersed composite at identical volume. A quantitative analysis shows that attaining a predominantly parallel connectivity of the NTC particles and polymer is a key parameter in determining the electrical performance of the composite film.


title: Generalized Fitch Graphs II: Sets of Binary Relations that are explained by Edge-labeled Trees

abstract: Fitch graphs $G=(X,E)$ are digraphs that are explained by $\{\emptyset, 1\}$-edge-labeled rooted trees $T$ with leaf set $X$: there is an arc $(x,y) \in E$ if and only if the unique path in $T$ that connects the last common ancestor $\mathrm{lca}(x,y)$ of $x$ and $y$ with $y$ contains at least one edge with label "1". In practice, Fitch graphs represent xenology relations, i.e., pairs of genes $x$ and $y$ for which a horizontal gene transfer happened along the path from $\mathrm{lca}(x,y)$ to $y$. In this contribution, we generalize the concept of Fitch graphs and consider trees $T$ that are equipped with edge-labeling $\lambda: E\to \mathcal{P}(M)$ that assigns to each edge a subset $M'\subseteq M$ of colors. Given such a tree, we can derive a map $\varepsilon_{(T,\lambda)}$ (or equivalently a set of not necessarily disjoint binary relations), such that $i\in \varepsilon_{(T,\lambda)}(x,y)$ (or equivalently $(x,y)\in R_i$) with $x,y\in X$, if and only if there is at least one edge with color $i$ from $\mathrm{lca}(x,y)$ to $y$. The central question considered here: Is a given map $\varepsilon$ a Fitch map, i.e., is there there an edge-labeled tree $(T,\lambda)$ with $\varepsilon_{(T,\lambda)} = \varepsilon$, and thus explains $\varepsilon$? Here, we provide a characterization of Fitch maps in terms of certain neighborhoods and forbidden submaps. Further restrictions of Fitch maps are considered. Moreover, we show that the least-resolved tree explaining a Fitch map is unique (up to isomorphism). In addition, we provide a polynomial-time algorithm to decide whether $\varepsilon$ is a Fitch map and, in the affirmative case, to construct the (up to isomorphism) unique least-resolved tree $(T^*,\lambda^*)$ that explains $\varepsilon$.


title: Graph Transformer for Graph-to-Sequence Learning

abstract: The dominant graph-to-sequence transduction models employ graph neural networks for graph representation learning, where the structural information is reflected by the receptive field of neurons. Unlike graph neural networks that restrict the information exchange between immediate neighborhood, we propose a new model, known as Graph Transformer, that uses explicit relation encoding and allows direct communication between two distant nodes. It provides a more efficient way for global graph structure modeling. Experiments on the applications of text generation from Abstract Meaning Representation (AMR) and syntax-based neural machine translation show the superiority of our proposed model. Specifically, our model achieves 27.4 BLEU on LDC2015E86 and 29.7 BLEU on LDC2017T10 for AMR-to-text generation, outperforming the state-of-the-art results by up to 2.2 points. On the syntax-based translation tasks, our model establishes new single-model state-of-the-art BLEU scores, 21.3 for English-to-German and 14.1 for English-to-Czech, improving over the existing best results, including ensembles, by over 1 BLEU.


title: Preparing Lessons: Improve Knowledge Distillation with Better Supervision

abstract: Knowledge distillation (KD) is widely used for training a compact model with the supervision of another large model, which could effectively improve the performance. Previous methods mainly focus on two aspects: 1) training the student to mimic representation space of the teacher; 2) training the model progressively or adding extra module like discriminator. Knowledge from teacher is useful, but it is still not exactly right compared with ground truth. Besides, overly uncertain supervision also influences the result. We introduce two novel approaches, Knowledge Adjustment (KA) and Dynamic Temperature Distillation (DTD), to penalize bad supervision and improve student model. Experiments on CIFAR-100, CINIC-10 and Tiny ImageNet show that our methods get encouraging performance compared with state-of-the-art methods. When combined with other KD-based methods, the performance will be further improved.


title: Learning to Synthesize Fashion Textures

abstract: Existing unconditional generative models mainly focus on modeling general objects, such as faces and indoor scenes. Fashion textures, another important type of visual elements around us, have not been extensively studied. In this work, we propose an effective generative model for fashion textures and also comprehensively investigate the key components involved: internal representation, latent space sampling and the generator architecture. We use Gram matrix as a suitable internal representation for modeling realistic fashion textures, and further design two dedicated modules for modulating Gram matrix into a low-dimension vector. Since fashion textures are scale-dependent, we propose a recursive auto-encoder to capture the dependency between multiple granularity levels of texture feature. Another important observation is that fashion textures are multi-modal. We fit and sample from a Gaussian mixture model in the latent space to improve the diversity of the generated textures. Extensive experiments demonstrate that our approach is capable of synthesizing more realistic and diverse fashion textures over other state-of-the-art methods.


title: Resolvent kernels and time dependent Schr\" odinger equations under magnetic field on the hyperbolic half plane $\H$ and the Morse potential on the real line $\

abstract: This paper deals with exact formulas for the resolvent kernels and exact solutions of time dependent Schr\"odinger equations under a uniform magnetic field on the hyperbolic half plane $\H$, and under a diatomic molecular Morse potential on the real line $\R$.


title: Deep and Dense Sarcasm Detection

abstract: Recent work in automated sarcasm detection has placed a heavy focus on context and meta-data. Whilst certain utterances indeed require background knowledge and commonsense reasoning, previous works have only explored shallow models for capturing the lexical, syntactic and semantic cues present within a text. In this paper, we propose a deep 56 layer network, implemented with dense connectivity to model the isolated utterance and extract richer features therein. We compare our approach against recent state-of-the-art architectures which make considerable use of extrinsic information, and demonstrate competitive results whilst using only the local features of the text. Further, we provide an analysis of the dependency of prior convolution outputs in generating the final feature maps. Finally a case study is presented, supporting that our approach accurately classifies additional uses of clear sarcasm, which a standard CNN misclassifies.


title: On switching properties of time optimal controls for linear ODEs

abstract: In this paper, we present some properties of time optimal controls for linear ODEs with the ball-type control constraint. More precisely, for an optimal control, we build up an upper bound for the number of its switching points; show that it jumps from one direction to the reverse direction at each switching point; give its dynamic behaviour between two consecutive switching points; and study its switching directions.


title: An Algebraic Characterisation for Finsler Metrics of Constant Flag Curvature

abstract: In this paper we prove that a Finsler metrics has constant flag curvature if and only if the curvature of the induced nonlinear connection satisfies an algebraic identity with respect to some arbitrary second rank tensors. Such algebraic identity appears as an obstruction to the formal integrability of some operators in Finsler geometry, [4,7]. This algebraic characterisation for Finsler metrics of constant flag curvature allows to provide yet another proof for the Finslerian version of Beltrami's Theorem, [2,3].


title: The Picard groups of inclusions of $C^*$-algebras induced by equivalence bimodules

abstract: Let $A$ and $B$ be $\sigma$-unital $C^*$-algebras and $X$ and $Y$ an $A-A$-equivalence bimodule and a $B-B$-equivalence bimodule, respectively. Also, let $A\rtimes_X \mathbb{Z}$ and $B\rtimes_Y \mathbb{Z}$ be the crossed products of $A$ and $B$ by $X$ and $Y$, respectively. Furthermore, let $A\subset A\rtimes_X \mathbb{Z}$ and $B\subset B\rtimes_Y \mathbb{Z}$ be the inclusions of $C^*$-algebras induced by $X$ and $Y$, respectively. We suppose that $A' \cap M(A\rtimes_X \mathbb{Z})=\mathbb{C} 1$. In this paper we shall show that the inclusions $A\subset A\rtimes_X \mathbb{Z}$ and $B\subset B\rtimes_Y \mathbb{Z}$ are strongly Morita equivalent if and only if there is an $A-B$-equivalence bimodule $M$ such that $Y\cong \widetilde{M}\otimes_A X \otimes_A M$ or $\widetilde{Y}\cong \widetilde{M}\otimes_A X \otimes_A M$ as $B-B$-equivalence bimodules, where $\widetilde{M}$ and $\widetilde{Y}$ are the dual $B-A$-equivalence bimodule and the dual $B-B$-equivalence bimodule of $M$ and $Y$, respectively. Applying this result, we shall compute the Picard group of the inclusion $A\subset A\rtimes_X \mathbb{Z}$ under the assumption that $A' \cap M(A\rtimes_X \mathbb{Z})=\mathbb{C} 1$.