title: Topological entropy of nonautonomous dynamical systems

abstract: Let $\mathcal{M}(X)$ be the space of Borel probability measures on a compact metric space $X$ endowed with the weak$^\ast$-topology. In this paper, we prove that if the topological entropy of a nonautonomous dynamical system $(X,\{f_n\}_{n=1}^{+\infty})$ vanishes, then so does that of its induced system $(\mathcal{M}(X),\{f_n\}_{n=1}^{+\infty})$; moreover, once the topological entropy of $(X,\{f_n\}_{n=1}^{+\infty})$ is positive, that of its induced system $(\mathcal{M}(X),\{f_n\}_{n=1}^{+\infty})$ jumps to infinity. In contrast to Bowen's inequality, we construct a nonautonomous dynamical system whose topological entropy is not preserved under a finite-to-one extension.


title: Linguistically Aided Speaker Diarization Using Speaker Role Information

abstract: Speaker diarization relies on the assumption that speech segments corresponding to a particular speaker are concentrated in a specific region of the speaker space; a region which represents that speaker's identity. These identities are not known a priori, so a clustering algorithm is typically employed, which is traditionally based solely on audio. Under noisy conditions, however, such an approach poses the risk of generating unreliable speaker clusters. In this work we aim to utilize linguistic information as a supplemental modality to identify the various speakers in a more robust way. We are focused on conversational scenarios where the speakers assume distinct roles and are expected to follow different linguistic patterns. This distinct linguistic variability can be exploited to help us construct the speaker identities. That way, we are able to boost the diarization performance by converting the clustering task to a classification one. The proposed method is applied in real-world dyadic psychotherapy interactions between a provider and a patient and demonstrated to show improved results.


title: CD2 : Combined Distances of Contrast Distributions for the Assessment of Perceptual Quality of Image Processing

abstract: The quality of visual input is very important for both human and machine perception. Consequently many processing techniques exist that deal with different distortions. Usually image processing is applied freely and lacks redundancy regarding safety. We propose a novel image comparison method called the Combined Distances of Contrast Distributions (CD2) to protect against errors that arise during processing. Based on the distribution of image contrasts a new reduced-reference image quality assessment (IQA) method is introduced. By combining various distance functions excellent performance on IQA benchmarks is achieved with only a small data and computation overhead.


title: Improved Limits on Millicharged Particles Using the ArgoNeuT Experiment at Fermilab

abstract: A search for millicharged particles, a simple extension of the standard model, has been performed with the ArgoNeuT detector exposed to the Neutrinos at the Main Injector beam at Fermilab. The ArgoNeuT Liquid Argon Time Projection Chamber detector enables a search for millicharged particles through the detection of visible electron recoils. We search for an event signature with two soft hits (MeV-scale energy depositions) aligned with the upstream target. For an exposure of the detector of $1.0$ $\times$ $10^{20}$ protons on target, one candidate event has been observed, compatible with the expected background. This search is sensitive to millicharged particles with charges between $10^{-3}e$ and $10^{-1}e$ and with masses in the range from $0.1$ GeV to $3$ GeV. This measurement provides leading constraints on millicharged particles in this large unexplored parameter space region.


title: Analysis on image recovery for digital Fresnel hologram with aliased fringe generated from self-similarity of point spread function

abstract: We analyze the aliasing phenomenon for digital Fresnel hologram with an enhanced numerical aperture (NA). The enhanced-NA digital hologram acquired computationally or optically at a closer distance from the object has an aliased fringe generated by undersampling process of the Fresnel prefactor. The point spread function known as Fresnel factor reveals a self-similar envelope when being sampled, which becomes a crucial mechanism in making this type of aliasing fringe of hologram. We describe that as the enhanced-NA hologram involves already the complementary aliased fringe that might come up in the reconstruction process, the robust recovery of object image can be realized. These behaviors are confirmed through numerical simulation. Based on the analysis of aliased hologram fringe, we provide a method for reconstructing the object image from the enhanced-NA digital Fresnel hologram without the shrinkage of image size.


title: Memory Effect or Cosmic String? Classifying Gravitational-Wave Bursts with Bayesian Inference

abstract: A variety of gravitational-wave transient sources can be modeled in the Fourier domain using a power law. This simple power-law model provides a reasonable approximation for gravitational-wave bursts from cosmic string cusps, cosmic string kinks, and the memory effect. Each of these sources is described using a different spectral index. In this work, we simulate interferometer strain data with injections of power-law and memory bursts to demonstrate parameter estimation, signal detection, and model selection. We show how Bayesian inference can be used to measure the power-law spectral index, thereby distinguishing between different astrophysical scenarios.


title: Normal and Equivolumetric Coordinate Systems for Cortical Areas

abstract: We describe coordinate systems adapted for the space between two surfaces, such as those delineating the highly folded cortex in mammalian brains. These systems are estimated in order to satisfy geometric priors, including streamline normality or equivolumetric conditions on layers. We give a precise mathematical formulation of these problems, and present numerical simulations based on diffeomorphic registration methods, comparing them with recent approaches.


title: Monte Carlo Simulations of DNA Damage and Cellular Response to Hadron Irradiation

abstract: Numerical simulations are performed on a stochastic model based on Monte Carlo damage simulation process and Markov Chain Monte Carlo techniques to investigate the formation and evaluation of isolated and multiple DNA damage and cellular survival by light ionizing radiation in a colony of tumour cells. The contribution of the local clustering of the strand breaks and base damage is taken into account while considering double-strand breaks (DSBs) as primary lesions in the DNA of the cell nucleus induced by ionizing radiation. The model incorporates the combined effects of biological processes such as the tumour oxygenation, cellular multiplication and mutation through various probability distributions in a full Monte Carlo simulation of fractionated hadrontherapy. Our results indicate that the linear and quadratic parameters of the model show a negative correlation, for protons and helium ions, which might suggest an underlying biological mechanism. Despite using a model with quite different descriptions of linear and quadratic parameters, the observed results for linear parameter show largely reasonable agreement while the quadratic parameter consistent deviations from the results obtained using the LEM model at low LET. In addition to the LET dependence, RBE values showed a strong dependence on alpha/beta ratio and a considerable scatter for various particle types indicate particle specific behaviour of initial its slope. The surviving curves show a non-linear dose-response suggesting that interaction among DSBs induced by ionizing radiation contribute significantly to the quadratic term of the model.


title: Universality for Langevin-like spin glass dynamics

abstract: We study dynamics for asymmetric spin glass models, proposed by Hertz et al. and Sompolinsky et al. in the 1980's in the context of neural networks: particles evolve via a modified Langevin dynamics for the Sherrington--Kirkpatrick model with soft spins, whereby the disorder is i.i.d. standard Gaussian rather than symmetric. Ben Arous and Guionnet (1995), followed by Guionnet (1997), proved for Gaussian interactions that as the number of particles grows, the short-term empirical law of this dynamics converges a.s. to a non-random law $\mu_\star$ of a ``self-consistent single spin dynamics,'' as predicted by physicists. Here we obtain universality of this fact: For asymmetric disorder given by i.i.d. variables of zero mean, unit variance and exponential or better tail decay, at every temperature, the empirical law of sample paths of the Langevin-like dynamics in a fixed time interval has the same a.s. limit $\mu_\star$.


title: Robot Calligraphy using Pseudospectral Optimal Control in Conjunction with a Novel Dynamic Brush Model

abstract: Chinese calligraphy is a unique art form with great artistic value but difficult to master. In this paper, we formulate the calligraphy writing problem as a trajectory optimization problem, and propose an improved virtual brush model for simulating the real writing process. Our approach is inspired by pseudospectral optimal control in that we parameterize the actuator trajectory for each stroke as a Chebyshev polynomial. The proposed dynamic virtual brush model plays a key role in formulating the objective function to be optimized. Our approach shows excellent performance in drawing aesthetically pleasing characters, and does so much more efficiently than previous work, opening up the possibility to achieve real-time closed-loop control.


title: User-Driven Functional Movement Training with a Wearable Hand Robot after Stroke

abstract: We studied the performance of a robotic orthosis designed to assist the paretic hand after stroke. It is wearable and fully user-controlled, serving two possible roles: as a therapeutic tool that facilitates device mediated hand exercises to recover neuromuscular function or as an assistive device for use in everyday activities to aid functional use of the hand. We present the clinical outcomes of a pilot study designed as a feasibility test for these hypotheses. 11 chronic stroke (> 2 years) patients with moderate muscle tone (Modified Ashworth Scale less than or equal to 2 in upper extremity) engaged in a month-long training protocol using the orthosis. Individuals were evaluated using standardized outcome measures, both with and without orthosis assistance. Fugl-Meyer post intervention scores without robotic assistance showed improvement focused specifically at the distal joints of the upper limb, suggesting the use of the orthosis as a rehabilitative device for the hand. Action Research Arm Test scores post intervention with robotic assistance showed that the device may serve an assistive role in grasping tasks. These results highlight the potential for wearable and user-driven robotic hand orthoses to extend the use and training of the affected upper limb after stroke.


title: Consistent recovery threshold of hidden nearest neighbor graphs

abstract: Motivated by applications such as discovering strong ties in social networks and assembling genome subsequences in biology, we study the problem of recovering a hidden $2k$-nearest neighbor (NN) graph in an $n$-vertex complete graph, whose edge weights are independent and distributed according to $P_n$ for edges in the hidden $2k$-NN graph and $Q_n$ otherwise. The special case of Bernoulli distributions corresponds to a variant of the Watts-Strogatz small-world graph. We focus on two types of asymptotic recovery guarantees as $n\to \infty$: (1) exact recovery: all edges are classified correctly with probability tending to one; (2) almost exact recovery: the expected number of misclassified edges is $o(nk)$. We show that the maximum likelihood estimator achieves (1) exact recovery for $2 \le k \le n^{o(1)}$ if $ \liminf \frac{2\alpha_n}{\log n}>1$; (2) almost exact recovery for $ 1 \le k \le o\left( \frac{\log n}{\log \log n} \right)$ if $\liminf \frac{kD(P_n||Q_n)}{\log n}>1$, where $\alpha_n \triangleq -2 \log \int \sqrt{d P_n d Q_n}$ is the R\'enyi divergence of order $\frac{1}{2}$ and $D(P_n||Q_n)$ is the Kullback-Leibler divergence. Under mild distributional assumptions, these conditions are shown to be information-theoretically necessary for any algorithm to succeed. A key challenge in the analysis is the enumeration of $2k$-NN graphs that differ from the hidden one by a given number of edges.

categories: cs.DS cs.LG cs.SI math.ST stat.ML stat.TH


title: The AI Liability Puzzle and A Fund-Based Work-Around

abstract: Certainty around the regulatory environment is crucial to enable responsible AI innovation and foster the social acceptance of these powerful new technologies. One notable source of uncertainty is, however, that the existing legal liability system is inapt to assign responsibility where a potentially harmful conduct and/or the harm itself are unforeseeable, yet some instantiations of AI and/or the harms they may trigger are not foreseeable in the legal sense. The unpredictability of how courts would handle such cases makes the risks involved in the investment and use of AI incalculable, creating an environment that is not conducive to innovation and may deprive society of some of the benefits AI could provide. To tackle this problem, we propose to draw insights from financial regulatory best-practices and establish a system of AI guarantee schemes. We envisage the system to form part of the broader market-structuring regulatory framework, with the primary function to provide a readily available, clear, and transparent funding mechanism to compensate claims that are either extremely hard or impossible to realize via conventional litigation. We propose it to be at least partially industry-funded, with funding arrangements depending on whether it would pursue other potential policy goals. We aim to engage in a high-level, comparative conceptual debate around the suitability of the foreseeability concept to limit legal liability rather than confronting the intricacies of the case law of specific jurisdictions. Recognizing the importance of the latter task, we leave this to further research in support of the legal system's incremental adaptation to the novel challenges of present and future AI technologies.


title: The Complexity-Stability Debate, Chemical Organization Theory, and the Identi cation of Non-Classical Structures in Ecology

abstract: We present a novel approach to represent ecological systems using reaction networks, and show how a particular framework called Chemical Organization Theory (COT) sheds new light on the longstanding complexity-stability debate. Namely, COT provides a novel conceptual landscape plenty of analytic tools to explore the interplay between structure and stability of ecological systems. Given a large set of species and their interactions, COT identifies, in a computationally feasible way, each and every sub-collection of species that is closed and self-maintaining. These sub-collections, called organizations, correspond to the groups of species that can survive together (co-exist) in the long-term. Thus, the set of organizations contains all the stable regimes that can possibly happen in the dynamics of the ecological system. From here, we propose to conceive the notion of stability from the properties of the organizations, and thus apply the vast knowledge on the stability of reaction networks to the Complexity-Stability debate. As an example of the potential of COT to introduce new mathematical tools, we show that the set of organizations can be equipped with suitable joint and meet operators, and that for certain ecological systems the organizational structure is a non-boolean lattice, providing in this way an unexpected connection between logico-algebraic structures, popular in the foundations of quantum theory, and ecology.


title: Streetify: Using Street View Imagery And Deep Learning For Urban Streets Development

abstract: The classification of streets on road networks has been focused on the vehicular transportational features of streets such as arterials, major roads, minor roads and so forth based on their transportational use. City authorities on the other hand have been shifting to more urban inclusive planning of streets, encompassing the side use of a street combined with the transportational features of a street. In such classification schemes, streets are labeled for example as commercial throughway, residential neighborhood, park etc. This modern approach to urban planning has been adopted by major cities such as the city of San Francisco, the states of Florida and Pennsylvania among many others. Currently, the process of labeling streets according to their contexts is manual and hence is tedious and time consuming. In this paper, we propose an approach to collect and label imagery data then deploy advancements in computer vision towards modern urban planning. We collect and label street imagery then train deep convolutional neural networks (CNN) to perform the classification of street context. We show that CNN models can perform well achieving accuracies in the 81% to 87%, we then visualize samples from the embedding space of streets using the t-SNE method and apply class activation mapping methods to interpret the features in street imagery contributing to output classification from a model.


title: Towards a complete 3D morphable model of the human head

abstract: Three-dimensional Morphable Models (3DMMs) are powerful statistical tools for representing the 3D shapes and textures of an object class. Here we present the most complete 3DMM of the human head to date that includes face, cranium, ears, eyes, teeth and tongue. To achieve this, we propose two methods for combining existing 3DMMs of different overlapping head parts: i. use a regressor to complete missing parts of one model using the other, ii. use the Gaussian Process framework to blend covariance matrices from multiple models. Thus we build a new combined face-and-head shape model that blends the variability and facial detail of an existing face model (the LSFM) with the full head modelling capability of an existing head model (the LYHM). Then we construct and fuse a highly-detailed ear model to extend the variation of the ear shape. Eye and eye region models are incorporated into the head model, along with basic models of the teeth, tongue and inner mouth cavity. The new model achieves state-of-the-art performance. We use our model to reconstruct full head representations from single, unconstrained images allowing us to parameterize craniofacial shape and texture, along with the ear shape, eye gaze and eye color.


title: Low Complexity Autoencoder based End-to-End Learning of Coded Communications Systems

abstract: End-to-end learning of a communications system using the deep learning-based autoencoder concept has drawn interest in recent research due to its simplicity, flexibility and its potential of adapting to complex channel models and practical system imperfections. In this paper, we have compared the bit error rate (BER) performance of autoencoder based systems and conventional channel coded systems with convolutional coding (CC), in order to understand the potential of deep learning-based systems as alternatives to conventional systems. From the simulations, autoencoder implementation was observed to have a better BER in 0-5 dB $E_{b}/N_{0}$ range than its equivalent half-rate convolutional coded BPSK with hard decision decoding, and to have only less than 1 dB gap at a BER of $10^{-5}$. Furthermore, we have also proposed a novel low complexity autoencoder architecture to implement end-to-end learning of coded systems in which we have shown better BER performance than the baseline implementation. The newly proposed low complexity autoencoder was capable of achieving a better BER performance than half-rate 16-QAM with hard decision decoding over the full 0-10 dB $E_{b}/N_{0}$ range and a better BER performance than the soft decision decoding in 0-4 dB $E_{b}/N_{0}$ range.


title: Convolutional Neural Network and decision support in medical imaging: case study of the recognition of blood cell subtypes

abstract: Identifying and characterizing the patient's blood samples is indispensable in diagnostics of malignance suspicious. A painstaking and sometimes subjective task is used in laboratories to manually classify white blood cells. Neural mathematical methods as deep learnings can be very useful in the automated recognition of blood cells. This study uses a particular type of deep learning i.e., convolutional neural networks (CNNs or ConvNets) for image recognition of the four (4) blood cell types (neutrophil, eosinophil, lymphocyte and monocyte) and to enable it to tag them employing a dataset of blood cells with labels for the corresponding cell types. The elements of the database are the input of our CNN and they allowed us to create learning models for the image recognition/classification of the blood cells. We evaluated the recognition performance and outputs learned by the networks in order to implement a neural image recognition model capable of distinguishing polynuclear cells (neutrophil and eosinophil) from those of mononuclear cells (lymphocyte and monocyte). The validation accuracy is 97.77%.


title: Attack on Grid Event Cause Analysis: An Adversarial Machine Learning Approach

abstract: With the ever-increasing reliance on data for data-driven applications in power grids, such as event cause analysis, the authenticity of data streams has become crucially important. The data can be prone to adversarial stealthy attacks aiming to manipulate the data such that residual-based bad data detectors cannot detect them, and the perception of system operators or event classifiers changes about the actual event. This paper investigates the impact of adversarial attacks on convolutional neural network-based event cause analysis frameworks. We have successfully verified the ability of adversaries to maliciously misclassify events through stealthy data manipulations. The vulnerability assessment is studied with respect to the number of compromised measurements. Furthermore, a defense mechanism to robustify the performance of the event cause analysis is proposed. The effectiveness of adversarial attacks on changing the output of the framework is studied using the data generated by real-time digital simulator (RTDS) under different scenarios such as type of attacks and level of access to data.


title: Penalized PET/CT Reconstruction Algorithms with Automatic Realignment for Anatomical Priors

abstract: Two algorithms for solving misalignment issues in penalized PET/CT reconstruction using anatomical priors are proposed. Both approaches are based on a recently published joint motion estimation and image reconstruction method. The first approach deforms the anatomical image to align it with the functional one while the second approach deforms both images to align them with the measured data. Our current implementation alternates between image reconstruction and alignment estimation. To evaluate the potential of these approaches, we have chosen Parallel Level Sets (PLS) as a representative anatomical penalty, incorporating a spatially-variant penalty strength to achieve uniform local contrast. The performance was evaluated using simulated non-TOF data generated with an XCAT phantom in the thorax region. We used the attenuation image in the anatomical prior. The results demonstrated that both methods can estimate the misalignment and deform the anatomical image accordingly. However, the performance of the first approach depends highly on the workflow of the alternating process. The second approach shows a faster convergence rate to the correct alignment and is less sensitive to the workflow. Interestingly, the presence of anatomical information can improve the convergence rate of misalignment estimation for the second approach but slow it down for the first approach.


title: Theoretical Prediction of Enhanced Thermopower in n-doped Si/Ge Superlattices using Effective Mass Approximation

abstract: We analyze the cross-plane miniband transport in n-doped [001] silicon (Si)/germanium (Ge) superlattices using an effective mass approximation (EMA) approach that correctly accounts for the indirect nature of the Si and Ge band gaps. Direct-gap based EMA has been employed so far to investigate the electronic properties of these superlattices, that does not accurately predict transport properties. We use the Boltzmann transport equation framework in combination with the EMA band analysis, and predict that significant improvement of the thermopower of n-doped Si/Ge superlattices can be achieved by controlling the lattice strain environment in these heterostructured materials. We illustrate that a remarkable degree of tunability in the Seebeck coefficient can be attained by growing the superlattices on various substrates, and varying the periods, and the compositions. Our calculations show up to ~3.2-fold Seebeck enhancement in Si/Ge [001] superlattices over bulk silicon, in the high-doping regime, breaking the Pisarenko relation. The thermopower modulations lead to an increase of power factor by up to 20%. Our approach is generically applicable to other superlattice systems, e.g., to investigate dimensional effects on electronic transport in two-dimensional nanowire and three dimensional nanodot superlattices. A material with high S potentially improves the energy conversion efficiency of thermoelectric applications and additionally, is highly valuable in various Seebeck metrology techniques including thermal, flow, radiation, and chemical sensing applications. We anticipate that the ideas presented here will have a strong impact in controlling electronic transport in various thermoelectric, opto-electronic, and quantum-enhanced materials applications.


title: Noncommutative coordinates for symplectic representations

abstract: We introduce coordinates on the spaces of framed and decorated representations of the fundamental group of a surface with nonempty boundary into the symplectic group $Sp(2n,\mathbf R)$. These coordinates provide a noncommutative generalization of the parametrizations of the spaces of representations into $SL(2,\mathbf R)$ or $PSL(2,\mathbf R)$ given by Thurston, Penner, Kashaev, and Fock-Goncharov. On the space of decorated symplectic representations the coordinates give a geometric realization of the noncommutative cluster-like structures introduced by Berenstein-Retakh. The locus of positive coordinates maps to the space of framed maximal representations. We use this to determine an explicit homeomorphism between the space of framed maximal representations and a quotient by the group $O(n)$. This allows us to describe the homotopy type and, when $n=2$, to give an exact description of the singularities. Along the way, we establish a complete classification of pairs of nondegenerate quadratic forms.


title: Low-Rank Toeplitz Matrix Estimation via Random Ultra-Sparse Rulers

abstract: We study how to estimate a nearly low-rank Toeplitz covariance matrix $T$ from compressed measurements. Recent work of Qiao and Pal addresses this problem by combining sparse rulers (sparse linear arrays) with frequency finding (sparse Fourier transform) algorithms applied to the Vandermonde decomposition of $T$. Analytical bounds on the sample complexity are shown, under the assumption of sufficiently large gaps between the frequencies in this decomposition. In this work, we introduce random ultra-sparse rulers and propose an improved approach based on these objects. Our random rulers effectively apply a random permutation to the frequencies in $T$'s Vandermonde decomposition, letting us avoid frequency gap assumptions and leading to improved sample complexity bounds. In the special case when $T$ is circulant, we theoretically analyze the performance of our method when combined with sparse Fourier transform algorithms based on random hashing. We also show experimentally that our ultra-sparse rulers give significantly more robust and sample efficient estimation then baseline methods.


title: Optimal repairing schemes for Reed-Solomon codes with alphabet sizes linear in lengths under the rack-aware model

abstract: In modern practical data centers, storage nodes are usually organized into equally sized groups, which is called racks. The cost of cross-rack communication is much more expensive compared with the intra-rack communication cost. The codes for this system are called rack-aware regenerating codes. Similar to standard minimum storage regenerating (MSR) codes, it is a challenging task to construct minimum storage rack-aware regenerating (MSRR) codes achieving the cut-set bound. The known constructions of MSRR codes achieving the cut-set bound give codes with alphabet size $q$ exponential in the code length $n$, more precisely, $q=\Omega(\exp(n^n))$. The main contribution of this paper is to provide explicit construction of MSRR codes achieving the cut-set bound with the alphabet size linear in $n$. To achieve this goal, we first present a general framework to repair Reed-Solomon codes. It turns out that the known repairing schemes of Reed-Solomon codes can be realized under our general framework. Several techniques are used in this paper. In particular, we use the degree decent method to repair failure node. This technique allows us to get Reed-Solomon codes with the alphabet size linear in $n$. The other techniques include choice of good polynomials. Note that good polynomials are used for construction of locally repairable code in literature. To the best of our knowledge, it is the first time in this paper to make use of good polynomials for constructions of regenerating codes.


title: Implicit Generative Modeling for Efficient Exploration

abstract: Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic" reward. In this work, we focus on model uncertainty estimation as an intrinsic reward for efficient exploration. In particular, we introduce an implicit generative modeling approach to estimate a Bayesian uncertainty of the agent's belief of the environment dynamics. Each random draw from our generative model is a neural network that instantiates the dynamic function, hence multiple draws would approximate the posterior, and the variance in the future prediction based on this posterior is used as an intrinsic reward for exploration. We design a training algorithm for our generative model based on the amortized Stein Variational Gradient Descent. In experiments, we compare our implementation with state-of-the-art intrinsic reward-based exploration approaches, including two recent approaches based on an ensemble of dynamic models. In challenging exploration tasks, our implicit generative model consistently outperforms competing approaches regarding data efficiency in exploration.


title: Graph Learning for Spatiotemporal Signals with Long- and Short-Term Characterization

abstract: Mining natural associations from high-dimensional spatiotemporal signals plays an important role in various fields including biology, climatology, and financial analysis. However, most existing works have mainly studied time-independent signals without considering the correlations of spatiotemporal signals that achieve high learning accuracy. This paper aims to learn graphs that better reflect underlying data relations by leveraging the long- and short-term characteristics of spatiotemporal signals. First, a spatiotemporal signal model is presented that considers both spatial and temporal relations. In particular, we integrate a low-rank representation and a Gaussian Markov process to describe the temporal correlations. Then, the graph learning problem is formulated as a joint low-rank component estimation and graph Laplacian inference. Accordingly, we propose a low rank and spatiotemporal smoothness-based graph learning method (GL-LRSS), which introduces a spatiotemporal smoothness prior into time-vertex signal analysis. By jointly exploiting the low rank of long-time observations and the smoothness of short-time observations, the overall learning performance can be effectively improved. Experiments on both synthetic and real-world datasets demonstrate substantial improvements in the learning accuracy of the proposed method over the state-of-the-art low-rank component estimation and graph learning methods.


title: Online Learned Continual Compression with Adaptive Quantization Modules

abstract: We introduce and study the problem of Online Continual Compression, where one attempts to simultaneously learn to compress and store a representative dataset from a non i.i.d data stream, while only observing each sample once. A naive application of auto-encoders in this setting encounters a major challenge: representations derived from earlier encoder states must be usable by later decoder states. We show how to use discrete auto-encoders to effectively address this challenge and introduce Adaptive Quantization Modules (AQM) to control variation in the compression ability of the module at any given stage of learning. This enables selecting an appropriate compression for incoming samples, while taking into account overall memory constraints and current progress of the learned compression. Unlike previous methods, our approach does not require any pretraining, even on challenging datasets. We show that using AQM to replace standard episodic memory in continual learning settings leads to significant gains on continual learning benchmarks. Furthermore we demonstrate this approach with larger images, LiDAR, and reinforcement learning environments.


title: DARB: A Density-Aware Regular-Block Pruning for Deep Neural Networks

abstract: The rapidly growing parameter volume of deep neural networks (DNNs) hinders the artificial intelligence applications on resource constrained devices, such as mobile and wearable devices. Neural network pruning, as one of the mainstream model compression techniques, is under extensive study to reduce the number of parameters and computations. In contrast to irregular pruning that incurs high index storage and decoding overhead, structured pruning techniques have been proposed as the promising solutions. However, prior studies on structured pruning tackle the problem mainly from the perspective of facilitating hardware implementation, without analyzing the characteristics of sparse neural networks. The neglect on the study of sparse neural networks causes inefficient trade-off between regularity and pruning ratio. Consequently, the potential of structurally pruning neural networks is not sufficiently mined. In this work, we examine the structural characteristics of the irregularly pruned weight matrices, such as the diverse redundancy of different rows, the sensitivity of different rows to pruning, and the positional characteristics of retained weights. By leveraging the gained insights as a guidance, we first propose the novel block-max weight masking (BMWM) method, which can effectively retain the salient weights while imposing high regularity to the weight matrix. As a further optimization, we propose a density-adaptive regular-block (DARB) pruning that outperforms prior structured pruning work with high pruning ratio and decoding efficiency. Our experimental results show that DARB can achieve 13$\times$ to 25$\times$ pruning ratio, which are 2.8$\times$ to 4.3$\times$ improvements than the state-of-the-art counterparts on multiple neural network models and tasks. Moreover, DARB can achieve 14.3$\times$ decoding efficiency than block pruning with higher pruning ratio.


title: Parametric Sparse Bayesian Dictionary Learning for Multiple Sources Localization with Propagation Parameters Uncertainty and Nonuniform Noise

abstract: Received signal strength (RSS) based source localization method is popular due to its simplicity and low cost. However, this method is highly dependent on the propagation model which is not easy to be captured in practice. Moreover, most existing works only consider the single source and the identical measurement noise scenario, while in practice multiple co-channel sources may transmit simultaneously, and the measurement noise tends to be nonuniform. In this paper, we study the multiple co-channel sources localization (MSL) problem under unknown nonuniform noise, while jointly estimating the parametric propagation model. Specifically, we model the MSL problem as being parameterized by the unknown source locations and propagation parameters, and then reformulate it as a joint parametric sparsifying dictionary learning (PSDL) and sparse signal recovery (SSR) problem which is solved under the framework of sparse Bayesian learning with iterative parametric dictionary approximation. Furthermore, multiple snapshot measurements are utilized to improve the localization accuracy, and the Cramer-Rao lower bound (CRLB) is derived to analyze the theoretical estimation error bound. Comparing with the state-of-the-art sparsity-based MSL algorithms as well as CRLB, extensive simulations show the importance of jointly inferring the propagation parameters,and highlight the effectiveness and superiority of the proposed method.


title: Developments in statistical inference when assessing spatiotemporal disease clustering with the tau statistic

abstract: The tau statistic $\tau$ uses geolocation and, usually, symptom onset time to assess global spatiotemporal clustering from epidemiological data. We test different factors that could affect graphical hypothesis tests of clustering or bias clustering range estimates based on the statistic, by comparison with a baseline analysis of an open access measles dataset. From re-analysing this data we find that the spatial bootstrap sampling method used to construct the confidence interval for the tau estimate and confidence interval (CI) type can bias clustering range estimates. We suggest that the bias-corrected and accelerated (BCa) CI is essential for asymmetric sample bootstrap distributions of tau estimates. We also find evidence against no spatiotemporal clustering, $p$-value $\in$ [0,0.014] (global envelope test). We develop a tau-specific modification of the Loh & Stein spatial bootstrap sampling method, which gives more precise bootstrapped tau estimates and a 20% higher estimated clustering endpoint than previously published (36.0m; 95% BCa CI (14.9, 46.6), vs 30m) and an equivalent increase in the clustering area of elevated disease odds by 44%. What appears a modest radial bias in the range estimate is more than doubled on the areal scale, which public health resources are proportional to. This difference could have important consequences for control. Correct practice of hypothesis testing of no clustering and clustering range estimation of the tau statistic are illustrated in the Graphical abstract. We advocate proper implementation of this useful statistic, ultimately to reduce inaccuracies in control policy decisions made during disease clustering analysis.


title: Rare $\Lambda_b \rightarrow \Lambda l^+ l^- $ decay in the Bethe-Salpeter equation approach

abstract: We study the rare decays $\Lambda_b \rightarrow \Lambda l^+ l^-~(l=e,\mu, \tau)$ in the Bethe-Salpeter equation approach. We find that depending on the values of parameters in our model the branching ratio $Br(\Lambda_b \rightarrow \Lambda \mu^+ \mu^-)\times 10^{6}$ varies from $0.812$ to $1.445$ when $\kappa = 0.050 \sim 0.060$ GeV$^3$ and the binding energy $E_0=-0.14$ GeV while $Br(\Lambda_b \rightarrow \Lambda \mu^+ \mu^-)\times 10^{6}$ varies from $1.051$ to $1.098$ when $\kappa = 0.055$ Gev$^3$ and the binding energy $E_0$ changes from $-0.19$ to $-0.09$ GeV. These results agree with the experimental data. In the same parameter regions, we find that the branching ratio $Br(\Lambda_b \rightarrow \Lambda e^+ e^-(\tau^+ \tau^-) )\times 10^{6}$ varies in the range $0.660-1.028$ ($0.252-0.392$) and $0.749-1.098$ ($0.286-0.489$), respectively.


title: A Bias Trick for Centered Robust Principal Component Analysis

abstract: Outlier based Robust Principal Component Analysis (RPCA) requires centering of the non-outliers. We show a "bias trick" that automatically centers these non-outliers. Using this bias trick we obtain the first RPCA algorithm that is optimal with respect to centering.


title: Light quark masses in N_f = 2+1 lattice QCD with Wilson fermions

abstract: We present a lattice QCD determination of light quark masses with three sea-quark flavours ($N_f = 2+1$). Bare quark masses are known from PCAC relations in the framework of CLS lattice computations with a non-perturbatively improved Wilson-Clover action and a tree-level Symanzik improved gauge action. They are fully non-perturbatively improved, including the recently computed Symanzik counter-term $b_{\rm A} - b_{\rm P}$. The mass renormalisation at hadronic scales and the renormalisation group running over a wide range of scales are known non-perturbatively in the Schr\"odinger functional scheme. In the present paper we perform detailed extrapolations to the physical point, obtaining (for the four-flavour theory) $m_{u/d}(2{\rm GeV}) = 3.54(12)(9)$ MeV and $m_s(2{\rm GeV}) = 95.7(2.5)(2.4)$ MeV in the $\bar{MS}$ scheme. For the mass ratio we have $m_s/m_{u/d} = 27.0(1.0)(0.4)$. The RGI values in the three-flavour theory are $M_{u/d} = 4.70(15)(12)$ MeV and $M_s = 127.0(3.1)(3.2)$ MeV.


title: Time-dependent approaches to open quantum systems

abstract: Couplings of a system to other degrees of freedom (that is, environmental degrees of freedom) lead to energy dissipation when the number of environmental degrees of freedom is large enough. Here we discuss quantal treatments for such energy dissipation. To this end, we discuss two different time-dependent methods. One is to introduce an effective time-dependent Hamiltonian, which leads to a classical equation of motion as a relationship among expectation values of quantum operators. We apply this method to a heavy-ion fusion reaction and discuss the role of dissipation on the penetrability of the Coulomb barrier. The other method is to start with a Hamiltonian with environmental degrees of freedom and derive an equation which the system degree of freedom obeys. For this, we present a new efficient method to solve coupled-channels equations, which can be easily applied even when the dimension of the coupled-channels equations is huge.


title: The independence of premise rule in intuitionistic set theories

abstract: Independence of premise principles play an important role in characterizing the modified realizability and the Dialectica interpretations. In this paper we show that a great many intuitionistic set theories are closed under the corresponding independence of premise rule for finite types over $\mathbb{N}$. It is also shown that the existence property (or existential definability property) holds for statements of the form $\neg A\to \exists x^{\sigma} F(x^{\sigma})$, where the variable $x^{\sigma}$ ranges over a finite type $\sigma$. This applies in particular to Constructive Zermelo-Fraenkel Set Theory (CZF) and Intuitionistic Zermelo-Fraenkel Set Theory (IZF), two systems known not to have the general existence property. On the technical side, the paper uses the method of realizability with truth from [21] and [8] with the underlying partial combinatory algebra (pca) chosen among the total ones. A particular instance of the latter is provided by the substructure of the graph model formed by the semi computable subsets of $\mathbb{N}$, which has the advantage that it forms a set pca even in proof-theoretically weak set theories such as CZF.


title: Simultaneous Region Localization and Hash Coding for Fine-grained Image Retrieval

abstract: Fine-grained image hashing is a challenging problem due to the difficulties of discriminative region localization and hash code generation. Most existing deep hashing approaches solve the two tasks independently. While these two tasks are correlated and can reinforce each other. In this paper, we propose a deep fine-grained hashing to simultaneously localize the discriminative regions and generate the efficient binary codes. The proposed approach consists of a region localization module and a hash coding module. The region localization module aims to provide informative regions to the hash coding module. The hash coding module aims to generate effective binary codes and give feedback for learning better localizer. Moreover, to better capture subtle differences, multi-scale regions at different layers are learned without the need of bounding-box/part annotations. Extensive experiments are conducted on two public benchmark fine-grained datasets. The results demonstrate significant improvements in the performance of our method relative to other fine-grained hashing algorithms.


title: A mixed finite element method with piecewise linear elements for the biharmonic equation on surfaces

abstract: The biharmonic equation with Dirichlet and Neumann boundary conditions discretized using the mixed finite element method and piecewise linear (with the possible exception of boundary triangles) finite elements on triangular elements has been well-studied for domains in R2. Here we study the analogous problem on polyhedral surfaces. In particular, we provide a convergence proof of discrete solutions to the corresponding smooth solution of the biharmonic equation. We obtain convergence rates that are identical to the ones known for the planar setting. Our proof focuses on three different problems: solving the biharmonic equation on the surface, solving the biharmonic equation in a discrete space in the metric of the surface, and solving the biharmonic equation in a discrete space in the metric of the polyhedral approximation of the surface. We employ inverse discrete Laplacians to bound the error between the solutions of the two discrete problems, and generalize a flat strategy to bound the remaining error between the discrete solutions and the exact solution on the curved surface.


title: Driver Identification Based on Vehicle Telematics Data using LSTM-Recurrent Neural Network

abstract: Despite advancements in vehicle security systems, over the last decade, auto-theft rates have increased, and cyber-security attacks on internet-connected and autonomous vehicles are becoming a new threat. In this paper, a deep learning model is proposed, which can identify drivers from their driving behaviors based on vehicle telematics data. The proposed Long-Short-Term-Memory (LSTM) model predicts the identity of the driver based on the individual's unique driving patterns learned from the vehicle telematics data. Given the telematics is time-series data, the problem is formulated as a time series prediction task to exploit the embedded sequential information. The performance of the proposed approach is evaluated on three naturalistic driving datasets, which gives high accuracy prediction results. The robustness of the model on noisy and anomalous data that is usually caused by sensor defects or environmental factors is also investigated. Results show that the proposed model prediction accuracy remains satisfactory and outperforms the other approaches despite the extent of anomalies and noise-induced in the data.


title: The Design and Implementation of a Scalable DL Benchmarking Platform

abstract: The current Deep Learning (DL) landscape is fast-paced and is rife with non-uniform models, hardware/software (HW/SW) stacks, but lacks a DL benchmarking platform to facilitate evaluation and comparison of DL innovations, be it models, frameworks, libraries, or hardware. Due to the lack of a benchmarking platform, the current practice of evaluating the benefits of proposed DL innovations is both arduous and error-prone - stifling the adoption of the innovations. In this work, we first identify $10$ design features which are desirable within a DL benchmarking platform. These features include: performing the evaluation in a consistent, reproducible, and scalable manner, being framework and hardware agnostic, supporting real-world benchmarking workloads, providing in-depth model execution inspection across the HW/SW stack levels, etc. We then propose MLModelScope, a DL benchmarking platform design that realizes the $10$ objectives. MLModelScope proposes a specification to define DL model evaluations and techniques to provision the evaluation workflow using the user-specified HW/SW stack. MLModelScope defines abstractions for frameworks and supports board range of DL models and evaluation scenarios. We implement MLModelScope as an open-source project with support for all major frameworks and hardware architectures. Through MLModelScope's evaluation and automated analysis workflows, we performed case-study analyses of $37$ models across $4$ systems and show how model, hardware, and framework selection affects model accuracy and performance under different benchmarking scenarios. We further demonstrated how MLModelScope's tracing capability gives a holistic view of model execution and helps pinpoint bottlenecks.


title: Directions and scale-multiplicative semigroups in restricted Burger-Mozes groups

abstract: We study the scale function, space of directions and scale-multiplicative semigroups for restricted Burger-Mozes groups. We relate these general notions to intrinsic properties of the group. Among other things, we give a formula for the scale function; relate the space of directions to both the action on the tree and an action on a $\operatorname{CAT}(0)$ cube complex; and construct maximal scale-multiplicative semigroups from the space of directions.


title: A Process Calculus for Formally Verifying Blockchain Consensus Protocols

abstract: Blockchains are becoming increasingly relevant in a variety of fields, such as finance, logistics, and real estate. The fundamental task of a blockchain system is to establish data consistency among distributed agents in an open network. Blockchain consensus protocols are central for performing this task. Since consensus protocols play such a crucial role in blockchain technology, several projects are underway that apply formal methods to these protocols. One such project is carried out by a team of the Formal Methods Group at IOHK. This project, in which the author is involved, aims at a formally verified implementation of the Ouroboros family of consensus protocols, the backbone of the Cardano blockchain. The first outcome of our project is the $\natural$-calculus (pronounced "natural calculus"), a general-purpose process calculus that serves as our implementation language. The $\natural$-calculus is a domain-specific language embedded in a functional host language using higher-order abstract syntax. This paper will be a ramble through the $\natural$-calculus. First we will look at its language and its operational semantics. The latter is unique in that it uses a stack of two labeled transition systems to treat phenomena like data transfer and the opening and closing of channel scope in a modular fashion. The presence of multiple transition systems calls for a generic treatment of derived concurrency concepts. We will see how such a treatment can be achieved by capturing notions like scope opening and silent transitions abstractly using axiomatically defined algebraic structures based on functors and monads.


title: Super-Nyquist Rateless Coding for Intersymbol Interference Channels

abstract: A rateless transmission architecture is developed for communication over Gaussian intersymbol interference channels, based on the concept of super-Nyquist (SNQ) signaling. In such systems, the signaling rate is chosen significantly higher than the Nyquist rate of the system. We show that such signaling, when used in conjunction with good "off-the-shelf" base codes, simple linear redundancy, and minimum mean-square error decision feedback equalization, results in capacity-approaching, low-complexity rateless codes for the time-varying intersymbol-interference channel. Constructions for both single-input / single-output (SISO) and multi-input / multi-output (MIMO) ISI channels are developed.


title: Axion-Field-Enabled Nonreciprocal Thermal Radiation in Weyl Semimetals

abstract: Objects around us constantly emit and absorb thermal radiation. The emission and absorption processes are governed by two fundamental radiative properties: emissivity and absorptivity.For reciprocal systems, the emissivity and absorptivity are restricted to be equal by Kirchhoff's law of thermal radiation. This restriction limits the degree of freedom to control thermal radiation and contributes to an intrinsic loss mechanism in photonic energy harvesting systems such assolar cells. Existing approaches to violate Kirchhoff's law typically utilize conventional magneto-optical effects in the presence of an external magnetic field. However, these approaches require either a strong magnetic field (~3T), or narrow-band resonances under a moderate magnetic field (~0.3T), because the non-reciprocity in conventional magneto-optical effects isusually weak in the thermal wavelength range. Here, we show that the axion electrodynamics in magnetic Weyl semimetals can be used to construct strongly nonreciprocal thermal emitters that near completely violate Kirchhoff's law over broad angular and frequency ranges, without requiring any external magnetic field. The non-reciprocity moreover is strongly temperature tunable, opening new possibilities for active non-reciprocal devices in controlling thermal radiation.


title: Quantum spin liquid ground state in the disorder free triangular lattice NaYbS$_2$

abstract: Rare-earth delafossites were recently proposed as promising candidates for the realization of an effective $S$=1/2 quantum spin liquid (QSL) on the triangular lattice. In contrast to the most actively studied triangular-lattice antiferromagnet YbMgGaO$_4$, which is known for considerable structural disorder due to site intermixing, NaYbS$_2$ delafossite realizes structurally ideal triangular layers. We present detailed $\mu$SR studies on this regular (undistorted) triangular Yb sublattice based system with effective spin $J_{\mathrm{eff}}=1/2$ in the temperature range 0.05 - 40 K. Zero-field (ZF) and longitudinal field (LF) $\mu$SR studies confirm the absence of any long range magnetic order state down to 0.05K ($\sim J$/80). Current $\mu$SR results together with the so far available bulk characterization data suggest that NaYbS$_2$ is an ideal candidate to identify QSL ground state.


title: Evidence for photoinduced sliding of the charge-order condensate in La$_{1.875}$Ba$_{0.125}$CuO$_4$

abstract: We use femtosecond resonant soft x-ray scattering to measure the ultrafast optical melting of charge-order correlations in La$_{1.875}$Ba$_{0.125}$CuO$_4$. By analyzing both the energy-resolved and energy-integrated order parameter dynamics, we find evidence of a short-lived nonequilibrium state, whose features are compatible with a sliding charge density wave coherently set in motion by the pump. This transient state exhibits shifts in both the quasielastic line energy and its wave vector, as expected from a classical Doppler effect. The wave vector change is indeed found to directly follow the pump propagation direction. These results demonstrate the existence of sliding charge order behavior in an unconventional charge density wave system and underscore the power of ultrafast optical excitation as a tool to coherently manipulate electronic condensates.


title: Observation of Edge Solitons in Photonic Graphene

abstract: Edge states emerge in diverse areas of science, offering new opportunities for the development of novel electronic or optoelectronic devices, sound and light propagation controls in acoustics and photonics. Previous experiments on edge states and exploration of topological phases in photonics were carried out mostly in linear regimes, but the current belief is that nonlinearity introduces new striking features into physics of edge states, lead-ing to the formation of edge solitons, optical isolation, and topological lasing, to name a few. Here we experimentally demonstrate edge solitons at the zigzag edge of a reconfigurable photonic graphene lattice created via the effect of electromagneti-cally induced transparency in an atomic vapor cell with controllable nonlinearity . To obtain edge solitons, Raman gain was introduced to compensate strong absorption experienced by the edge state during propagation. Our observations pave the way to ex-perimental exploration of topological photonics on nonlinear, reconfigurable platform.


title: Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach

abstract: Weakly supervised semantic segmentation is a challenging task as it only takes image-level information as supervision for training but produces pixel-level predictions for testing. To address such a challenging task, most recent state-of-the-art approaches propose to adopt two-step solutions, \emph{i.e. } 1) learn to generate pseudo pixel-level masks, and 2) engage FCNs to train the semantic segmentation networks with the pseudo masks. However, the two-step solutions usually employ many bells and whistles in producing high-quality pseudo masks, making this kind of methods complicated and inelegant. In this work, we harness the image-level labels to produce reliable pixel-level annotations and design a fully end-to-end network to learn to predict segmentation maps. Concretely, we firstly leverage an image classification branch to generate class activation maps for the annotated categories, which are further pruned into confident yet tiny object/background regions. Such reliable regions are then directly served as ground-truth labels for the parallel segmentation branch, where a newly designed dense energy loss function is adopted for optimization. Despite its apparent simplicity, our one-step solution achieves competitive mIoU scores (\emph{val}: 62.6, \emph{test}: 62.9) on Pascal VOC compared with those two-step state-of-the-arts. By extending our one-step method to two-step, we get a new state-of-the-art performance on the Pascal VOC (\emph{val}: 66.3, \emph{test}: 66.5).


title: Poison as a Cure: Detecting & Neutralizing Variable-Sized Backdoor Attacks in Deep Neural Networks

abstract: Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is added. This poison pattern can be embedded in the training dataset by the adversary. Existing defenses are effective under certain conditions such as a small size of the poison pattern, knowledge about the ratio of poisoned training samples or when a validated clean dataset is available. Since a defender may not have such prior knowledge or resources, we propose a defense against backdoor poisoning that is effective even when those prerequisites are not met. It is made up of several parts: one to extract a backdoor poison signal, detect poison target and base classes, and filter out poisoned from clean samples with proven guarantees. The final part of our defense involves retraining the poisoned model on a dataset augmented with the extracted poison signal and corrective relabeling of poisoned samples to neutralize the backdoor. Our approach has shown to be effective in defending against backdoor attacks that use both small and large-sized poison patterns on nine different target-base class pairs from the CIFAR10 dataset.


title: Notes on the functional LYZ ellipsoid

abstract: We define the functional LYZ ellipsoid of log-concave functions. Then we give notes appended to [6].


title: Machine Learning-powered Iterative Combinatorial Auctions

abstract: We present a machine learning-powered iterative combinatorial auction (MLCA). The main goal of integrating machine learning (ML) into the auction is to improve preference elicitation, which is a major challenge in large combinatorial auctions (CAs). In contrast to prior work, our auction design uses value queries instead of prices to drive the auction. The ML algorithm is used to help the auction decide which value queries to ask in every iteration. While using ML inside a CA introduces new challenges, we demonstrate how we obtain a design that is individually rational, satisfies no-deficit, has good incentives, and is computationally practical. We benchmark our new auction against the well-known combinatorial clock auction (CCA). Our results indicate that, especially in large domains, MLCA can achieve significantly higher allocative efficiency than the CCA, even with only a small number of value queries.


title: Mapping NP-hard and NP-complete optimisation problems to Quadratic Unconstrained Binary Optimisation problems

abstract: We discuss several mappings from well-known NP-hard problems to Quadratic Unconstrained Binary Optimisation problems which are treated incorrectly by Lucas. We provide counterexamples and correct the mappings. We also extend the body of QUBO formulations of NP-complete and NP-hard optimisation problems by discussing additional problems.


title: Decision Making for Autonomous Driving via Augmented Adversarial Inverse Reinforcement Learning

abstract: Making decisions in complex driving environments is a challenging task for autonomous agents. Imitation learning methods have great potentials for achieving such a goal. Adversarial Inverse Reinforcement Learning (AIRL) is one of the state-of-art imitation learning methods that can learn both a behavioral policy and a reward function simultaneously, yet it is only demonstrated in simple and static environments where no interactions are introduced. In this paper, we improve and stabilize AIRL's performance by augmenting it with semantic rewards in the learning framework. Additionally, we adapt the augmented AIRL to a more practical and challenging decision-making task in a highly interactive environment in autonomous driving. The proposed method is compared with four baselines and evaluated by four performance metrics. Simulation results show that the augmented AIRL outperforms all the baseline methods, and its performance is comparable with that of the experts on all of the four metrics.


title: The k-Power Domination Number in Some Self-Similar Graphs

abstract: The $k$-power domination problem is a problem in graph theory, which has applications in many areas. However, it is hard to calculate the exact $k$-power domination number since determining k-power domination number of a generic graph is a NP-complete problem. We determine the exact $k$-power domination number in two graphs which have the same number of vertices and edges: pseudofractal scale-free web and Sierpi\'nski gasket. The $k$-power domination number becomes 1 for $k\ge2$ in the Sierpi\'nski gasket, while the $k$-power domination number increases at an exponential rate with regard to the number of vertices in the pseudofractal scale-free web. The scale-free property may account for the difference in the behavior of two graphs.


title: Experimental evidence of crystal symmetry protection for the topological nodal line semimetal state in ZrSiS

abstract: Tunable symmetry breaking plays a crucial role for the manipulation of topological phases of quantum matter. Here, through combined high-pressure magneto-transport measurements, Raman spectroscopy, and X-ray diffraction, we demonstrate a pressure-induced topological phase transition in nodal-line semimetal ZrSiS. Symmetry analysis and first-principles calculations suggest that this pressure-induced topological phase transition may be attributed to weak lattice distortions by non-hydrostatic compression, which breaks some crystal symmetries, such as the mirror and inversion symmetries. This finding provides some experimental evidence for crystal symmetry protection for the topological semimetal state, which is at the heart of topological relativistic fermion physics.


title: Particle Physics with the Cosmic Microwave Background with SPT-3G

abstract: The cosmic microwave background (CMB) encodes information about the content and evolution of the universe. The presence of light, weakly interacting particles impacts the expansion history of the early universe, which alters the temperature and polarization anisotropies of the CMB. In this way, current measurements of the CMB place interesting constraints on the neutrino energy density and mass, as well as on the abundance of other possible light relativistic particle species. We present the status of an on-going 1500 sq. deg. survey with the SPT-3G receiver, a new mm-wavelength camera on the 10-m diameter South Pole Telescope (SPT). The SPT-3G camera consists of 16,000 superconducting transition edge sensors, a 10x increase over the previous generation camera, which allows it to map the CMB with an unprecedented combination of sensitivity and angular resolution. We highlight projected constraints on the abundance of sterile neutrinos and the sum of the neutrino masses for the SPT-3G survey, which could help determine the neutrino mass hierarchy.


title: Gradient-based Sparse Principal Component Analysis with Extensions to Online Learning

abstract: Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on the global convergence. Sparse PCA algorithms based on a convex formulation, for example the Fantope projection and selection (FPS), overcome this difficulty, but are computationally expensive. In this work we study sparse PCA based on the convex FPS formulation, and propose a new algorithm that is computationally efficient and applicable to large and high-dimensional data sets. Nonasymptotic and explicit bounds are derived for both the optimization error and the statistical accuracy, which can be used for testing and inference problems. We also extend our algorithm to online learning problems, where data are obtained in a streaming fashion. The proposed algorithm is applied to high-dimensional gene expression data for the detection of functional gene groups.


title: Local electric field induced spin photocurrent in ReS2

abstract: Circular polarized photocurrent is observed near the electrodes on a few-layer ReS2sample at room temperature. For both electrodes, the spatial distribution of the circular polarized photocurrent shows a feature of two wings, with one positive and the other negative. We suggest that this phenomenon arises from the inverse spin Hall effect due to local electric field near the electrode. Bias voltage that modulates this field further controls the sign and magnitude of the inverse spin Hall effect photocurrent. Our research shows that electric field near electrodes has a significant impact on spin transmission operation, hence it could be taken into account for manufacturing spintronic devices in future.


title: Carpe Diem, Seize the Samples Uncertain "At the Moment" for Adaptive Batch Selection

abstract: The accuracy of deep neural networks is significantly affected by how well mini-batches are constructed during the training step. In this paper, we propose a novel adaptive batch selection algorithm called Recency Bias that exploits the uncertain samples predicted inconsistently in recent iterations. The historical label predictions of each training sample are used to evaluate its predictive uncertainty within a sliding window. Then, the sampling probability for the next mini-batch is assigned to each training sample in proportion to its predictive uncertainty. By taking advantage of this design, Recency Bias not only accelerates the training step but also achieves a more accurate network. We demonstrate the superiority of Recency Bias by extensive evaluation on two independent tasks. Compared with existing batch selection methods, the results showed that Recency Bias reduced the test error by up to 20.97% in a fixed wall-clock training time. At the same time, it improved the training time by up to 59.32% to reach the same test error


title: SimVAE: Simulator-Assisted Training forInterpretable Generative Models

abstract: This paper presents a simulator-assisted training method (SimVAE) for variational autoencoders (VAE) that leads to a disentangled and interpretable latent space. Training SimVAE is a two-step process in which first a deep generator network(decoder) is trained to approximate the simulator. During this step, the simulator acts as the data source or as a teacher network. Then an inference network (encoder)is trained to invert the decoder. As such, upon complete training, the encoder represents an approximately inverted simulator. By decoupling the training of the encoder and decoder we bypass some of the difficulties that arise in training generative models such as VAEs and generative adversarial networks (GANs). We show applications of our approach in a variety of domains such as circuit design, graphics de-rendering and other natural science problems that involve inference via simulation.


title: A special case of the existential version of the Non Commutative Khintchine inequality

abstract: Here we prove the following result. Let $A = \{a_{ij}\}_{i,j\in \mathbb{N}}$ be a bounded operator. Then there exists a signing of $A$ such that $$||A\circ S||_2 < 2||A||_{l_\infty(l_2)},$$ where $A\circ S$ denotes the matrix generated by the entry-wise product of $A$ and $S$.


title: A novel method for identifying the deep neural network model with the Serial Number

abstract: Deep neural network (DNN) with the state of art performance has emerged as a viable and lucrative business service. However, those impressive performances require a large number of computational resources, which comes at a high cost for the model creators. The necessity for protecting DNN models from illegal reproducing and distribution appears salient now. Recently, trigger-set watermarking, breaking the white-box restriction, relying on adversarial training pre-defined (incorrect) labels for crafted inputs, and subsequently using them to verify the model authenticity, has been the main topic of DNN ownership verification. While these methods have successfully demonstrated robustness against removal attacks, few are effective against the tampering attacks from competitors forging the fake watermarks and dogging in the manager. In this paper, we put forth a new framework of the trigger-set watermark by embedding a unique Serial Number (relatedness less original labels) to the deep neural network for model ownership identification, which is both robust to model pruning and resist to tampering attacks. Experiment results demonstrate that the DNN Serial Number only incurs slight accuracy degradation of the original performance and is valid for ownership verification.


title: Policy-Gradient Training of Fair and Unbiased Ranking Functions

abstract: While implicit feedback (e.g., clicks, dwell times, etc.) is an abundant and attractive source of data for learning to rank, it can produce unfair ranking policies for both exogenous and endogenous reasons. Exogenous reasons typically manifest themselves as biases in the training data, which then get reflected in the learned ranking policy and often lead to rich-get-richer dynamics. Moreover, even after the correction of such biases, reasons endogenous to the design of the learning algorithm can still lead to ranking policies that do not allocate exposure among items in a fair way. To address both exogenous and endogenous sources of unfairness, we present the first learning-to-rank approach that addresses both presentation bias and merit-based fairness of exposure simultaneously. Specifically, we define a class of amortized fairness-of-exposure constraints that can be chosen based on the needs of an application, and we show how these fairness criteria can be enforced despite the selection biases in implicit feedback data. The key result is an efficient and flexible policy-gradient algorithm, called FULTR, which is the first to enable the use of counterfactual estimators for both utility estimation and fairness constraints. Beyond the theoretical justification of the framework, we show empirically that the proposed algorithm can learn accurate and fair ranking policies from biased and noisy feedback.


title: One-bipolar topologically slice knots and primary decomposition

abstract: Let {T_n} be the bipolar filtration of the smooth concordance group of topologically slice knots, which was introduced by Cochran, Harvey, and Horn. It is known that for each n not equal to 1 the quotient group T_n/T_{n+1} has infinite rank and T_1/T_2 has positive rank. In this paper, we show that T_1/T_2 also has infinite rank. Moreover, we prove that there exist infinitely many Alexander polynomials p(t) such that there exist infinitely many knots in T_1 with Alexander polynomial p(t) whose nontrivial linear combinations are not concordant to any knot with Alexander polynomial coprime to p(t), even modulo T_2. This extends the recent result of Cha on the primary decomposition of T_n/T_{n+1} for all n greater than 1 to the case n=1. To prove our theorem, we show that the surgery manifolds of satellite links of $\nu^+$-equivalent knots with the same pattern link have the same Ozsv\'ath-Szab\'o $d$-invariants, which is of independent interest. As another application, for each g greater than 0, we give a topologically slice knot of concordance genus g that is $\nu^+$-equivalent to the unknot.


title: Modelling pressure-Hessian from local velocity gradients information in an incompressible turbulent flow field using deep neural networks

abstract: The understanding of the dynamics of the velocity gradients in turbulent flows is critical to understanding various non-linear turbulent processes. The pressure-Hessian and the viscous-Laplacian govern the evolution of the velocity-gradients and are known to be non-local in nature. Over the years, several simplified dynamical models have been proposed that models the viscous-Laplacian and the pressure-Hessian primarily in terms of local velocity gradients information. These models can also serve as closure models for the Lagrangian PDF methods. The recent fluid deformation closure model (RFDM) has been shown to retrieve excellent one-time statistics of the viscous process. However, the pressure-Hessian modelled by the RFDM has various physical limitations. In this work, we first demonstrate the limitations of the RFDM in estimating the pressure-Hessian. Further, we employ a tensor basis neural network (TBNN) to model the pressure-Hessian from the velocity gradient tensor itself. The neural network is trained on high-resolution data obtained from direct numerical simulation (DNS) of isotropic turbulence at Reynolds number of 433 (JHU turbulence database, JHTD). The predictions made by the TBNN are tested against two different isotropic turbulence datasets at Reynolds number of 433 (JHTD) and 315 (UP Madrid turbulence database, UPMTD) and channel flow dataset at Reynolds number of 1000 (UT Texas and JHTD). The evaluation of the neural network output is made in terms of the alignment statistics of the predicted pressure-Hessian eigenvectors with the strain-rate eigenvectors for turbulent isotropic flow as well as channel flow. Our analysis of the predicted solution leads to the discovery of ten unique coefficients of the tensor basis of strain-rate and rotation-rate tensors, the linear combination over which accurately captures key alignment statistics of the pressure-Hessian tensor.


title: Characterization of a 15 $\mu m$ Cutoff HgCdTe Detector Array for Astronomy

abstract: The University of Rochester infrared detector group is working together with Teledyne Imaging Sensors to develop HgCdTe 15 $\mu m$ cutoff wavelength detector arrays for future space missions. To reach the 15 $\mu m$ cutoff goal, we took an intermediate step by developing four $\sim$13 $\mu m$ cutoff wavelength arrays to identify any unforeseen effects related to increasing the cutoff wavelength from the extensively characterized 10 $\mu m$ cutoff wavelength detector arrays developed for the NEOCam mission. The characterization of the $\sim$13 $\mu m$ cutoff wavelength HgCdTe arrays at the University of Rochester allowed us to determine the key dark current mechanisms that limit the performance of these HgCdTe detector arrays at different temperatures and bias when the cutoff wavelength is increased. We present initial dark current and well depth measurements of a 15 $\mu m$ cutoff array which shows dark current values two orders of magnitude smaller at large reverse bias than would be expected from our previous best structures.


title: The Gradient descent method from the perspective of fractional calculus

abstract: Motivated by gradient methods in optimization theory, we give methods based on $\psi$-fractional derivatives of order $\alpha$ in order to solve unconstrained optimization problems. The convergence of these methods is analyzed in detail. This paper also presents an Adams-Bashforth-Moulton (ABM) method for the estimation of solutions to equations involving $\psi$-fractional derivatives. Numerical examples using the ABM method show that the fractional order $\alpha$ and weight $\psi$ are tunable parameters, which can be helpful for improving the performance of gradient descent methods.


title: How does Early Stopping Help Generalization against Label Noise?

abstract: Noisy labels are very common in real-world training data, which lead to poor generalization on test data because of overfitting to the noisy labels. In this paper, we claim that such overfitting can be avoided by "early stopping" training a deep neural network before the noisy labels are severely memorized. Then, we resume training the early stopped network using a "maximal safe set," which maintains a collection of almost certainly true-labeled samples at each epoch since the early stop point. Putting them all together, our novel two-phase training method, called Prestopping, realizes noise-free training under any type of label noise for practical use. Extensive experiments using four image benchmark data sets verify that our method significantly outperforms four state-of-the-art methods in test error by 0.4-8.2 percent points under existence of real-world noise.


title: Universal digital filtering for denoising volumetric retinal OCT and OCT angiography in 3D shearlet domain

abstract: Retinal optical coherence tomography (OCT) and OCT angiography (OCTA) suffer from the degeneration of image quality due to speckle noise and bulk-motion noise, respectively. Because the cross-sectional retina has distinct features in OCT and OCTA B-scans, existing digital filters that can denoise OCT efficiently are unable to handle the bulk-motion noise in OCTA. In this Letter, we propose a universal digital filtering approach that is capable of minimizing both types of noise. Considering the retinal capillaries in OCTA are hard to differentiate in B-scans while having distinct curvilinear structures in 3D volumes, we decompose the volumetric OCT and OCTA data with 3D shearlets thus efficiently separate the retinal tissue and vessels from the noise in this transform domain. Compared with wavelets and curvelets, the shearlets provide better representation of the layer edges in OCT and the vasculature in OCTA. Qualitative and quantitative results show the proposed method outperforms the state-of-the-art OCT and OCTA denoising methods. Besides, the superiority of 3D denoising is demonstrated by comparing the 3D shearlet filtering with its 2D counterpart.


title: Sparse recovery via nonconvex regularized $M$-estimators over $\ell_q$-balls

abstract: In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point of the nonconvex regularized $M$-estimator, under restricted strong convexity and some regularity conditions on the loss function and the regularizer, respectively. In the algorithmic aspect, we slightly decompose the objective function and then solve the nonconvex optimization problem via the proximal gradient method, which is proved to achieve a linear convergence rate. In particular, we note that for commonly-used regularizers such as SCAD and MCP, a simpler decomposition is applicable thanks to our assumption on the regularizer, which helps to construct the estimator with better recovery performance. Finally, we demonstrate our theoretical consequences and the advantage of the assumption by several numerical experiments on the corrupted errors-in-variables linear regression model. Simulation results show remarkable consistency with our theory under high-dimensional scaling.


title: Scalar hairy black holes in Einstein-Maxwell-conformally coupled scalar theory

abstract: We obtain scalar hairy black holes from Einstein-Maxwell-conformally coupled scalar (EMCS) theory with the scalar coupling parameter $\alpha$ to the Maxwell term. In case of $\alpha=0$, the $\alpha=0$ EMCS theory provides constant (charged) scalar hairy black hole and charged BBMB (Bocharova-Bronnikov-Melnikov-Bekenstein) black hole where the former is stable against full perturbations, while the latter remains unstable because it belongs to an extremal black hole. It is noted that for $\alpha\not=0$, the unstable Reissner-Nordstr\"{o}m black holes without scalar hair imply infinite branches of $n=0(\alpha \ge 8.019),1(\alpha \ge 40.84),2(\alpha \ge 99.89),\cdots$ scalarized charged black holes. In addition, for $\alpha>0$, we develop a single branch of scalarized charged black hole solutions inspired by the constant scalar hairy black hole. Finally, we obtain the numerical charged BBMB black hole solution from the $\alpha=0$ EMCS theory.


title: Minimax rates of $\ell_p$-losses for high-dimensional linear regression models with additive measurement errors over $\ell_q$-balls

abstract: We study minimax rates for high-dimensional linear regression with additive errors under the $\ell_p\ (1\leq p<\infty)$-losses, where the regression parameter is of weak sparsity. Our lower and upper bounds agree up to constant factors, implying that the proposed estimator is minimax optimal.


title: The Acceleration and Confinement of Energetic Electrons by a Termination Shock in a Magnetic Trap: An Explanation for Nonthermal Loop-top Sources during Solar Flares

abstract: Nonthermal loop-top sources in solar flares are the most prominent observational signature that suggests energy release and particle acceleration in the solar corona. Although several scenarios for particle acceleration have been proposed, the origin of the loop-top sources remains unclear. Here we present a model that combines a large-scale magnetohydrodynamic simulation of a two-ribbon flare with a particle acceleration and transport model for investigating electron acceleration by a fast-mode termination shock at the looptop. Our model provides spatially resolved electron distribution that evolves in response to the dynamic flare geometry. We find a concave-downward magnetic structure located below the flare termination shock, induced by the fast reconnection downflows. It acts as a magnetic trap to confine the electrons at the looptop for an extended period of time. The electrons are energized significantly as they cross the shock front, and eventually build up a power-law energy spectrum extending to hundreds of keV. We suggest that this particle acceleration and transport scenario driven by a flare termination shock is a viable interpretation for the observed nonthermal loop-top sources.


title: Adaptive Activation Network and Functional Regularization for Efficient and Flexible Deep Multi-Task Learning

abstract: Multi-task learning (MTL) is a common paradigm that seeks to improve the generalization performance of task learning by training related tasks simultaneously. However, it is still a challenging problem to search the flexible and accurate architecture that can be shared among multiple tasks. In this paper, we propose a novel deep learning model called Task Adaptive Activation Network (TAAN) that can automatically learn the optimal network architecture for MTL. The main principle of TAAN is to derive flexible activation functions for different tasks from the data with other parameters of the network fully shared. We further propose two functional regularization methods that improve the MTL performance of TAAN. The improved performance of both TAAN and the regularization methods is demonstrated by comprehensive experiments.


title: Some Results on Subspace-Hypercyclic Operators

abstract: A bounded linear operator $T$ on a Banach space $X$ is called subspace-hypercyclic if there is a subspace $M \subsetneq X$ and a vector $x \in X$ such that $orb{(x,T)} \cap M$ is dense in $M$. We show that every Banach space supports subspace-hypercyclic operators and provide a new criteira for subspace-hypercyclic operators, generalizing a previous result from Le.


title: Sets in $\mathbb{R}^d$ determining $k$ taxicab distances

abstract: We address an analog of a problem introduced by Erd\H{o}s and Fishburn, itself an inverse formulation of the famous Erd\H{o}s distance problem, in which the usual Euclidean distance is replaced with the metric induced by the $\ell^1$-norm, commonly referred to as the $\textit{taxicab metric}$. Specifically, we investigate the following question: given $d,k\in \mathbb{N}$, what is the maximum size of a subset of $\mathbb{R}^d$ that determines at most $k$ distinct taxicab distances, and can all such optimal arrangements be classified? We completely resolve the question in dimension $d=2$, as well as the $k=1$ case in dimension $d=3$, and we also provide a full resolution in the general case under an additional hypothesis.


title: Fuzzy Tiling Activations: A Simple Approach to Learning Sparse Representations Online

abstract: Recent work has shown that sparse representations -- where only a small percentage of units are active -- can significantly reduce interference. Those works, however, relied on relatively complex regularization or meta-learning approaches, that have only been used offline in a pre-training phase. In this work, we pursue a direction that achieves sparsity by design, rather than by learning. Specifically, we design an activation function that produces sparse representations deterministically by construction, and so is more amenable to online training. The idea relies on the simple approach of binning, but overcomes the two key limitations of binning: zero gradients for the flat regions almost everywhere, and lost precision -- reduced discrimination -- due to coarse aggregation. We introduce a Fuzzy Tiling Activation (FTA) that provides non-negligible gradients and produces overlap between bins that improves discrimination. We first show that FTA is robust under covariate shift in a synthetic online supervised learning problem, where we can vary the level of correlation and drift. Then we move to the deep reinforcement learning setting and investigate both value-based and policy gradient algorithms that use neural networks with FTAs, in classic discrete control and Mujoco continuous control environments. We show that algorithms equipped with FTAs are able to learn a stable policy faster without needing target networks on most domains.


title: Scale Invariance of the Homentropic Inviscid Euler Equations with Application to the Noh Problem

abstract: We investigate the inviscid compressible flow (Euler) equations constrained by an "isentropic" equation of state (EOS), whose functional form in pressure is an arbitrary function of density alone. Under the aforementioned condition, we interrogate using symmetry methods the scale-invariance of the homentropic inviscid Euler equations. We find that under general conditions, we can reduce the inviscid Euler equations into a system of two coupled ordinary differential equations. To exemplify the utility of these results, we formulate two example scale-invariant, self-similar solutions. The first example includes a shock-free expanding bubble scenario, featuring a modified Tait EOS. The second example features the classical Noh problem, coupled to an arbitrary isentropic EOS. In this case, in order to satisfy the conditions set forth in the classical Noh problem, we find that the solution for the flow is given by a transcendental algebraic equation in the shocked density.


title: Constraints on Lorentz invariance violation from HAWC observations of gamma rays above 100 TeV

abstract: Due to the high energies and long distances to the sources, astrophysical observations provide a unique opportunity to test possible signatures of Lorentz invariance violation (LIV). Superluminal LIV enables the decay of photons at high energy. The High Altitude Water Cherenkov (HAWC) Observatory is among the most sensitive gamma-ray instruments currently operating above 10 TeV. HAWC finds evidence of 100 TeV photon emission from at least four astrophysical sources. These observations exclude, for the strongest of the limits set, the LIV energy scale to $2.2\times10^{31}$ eV, over 1800 times the Planck energy and an improvement of 1 to 2 orders of magnitude over previous limits.


title: Stochastic estimations of a total number of classes for the clusterings with too enormous samples to be accommodate into a clustering engine

abstract: We considered the problem how to handle the exploding number of possibilities to be sorted into irreducible classes by using a clustering tool when its input capacity cannot accommodate the total number of the possibility. Concrete situations are explained taking examples of atomic substitutions in the supercell modeling of alloys. The number of the possibility sometimes amounts to $\sim$ trillion being too large to be accommodate. It is hence not practically feasible to identify how many irreducible classes exist by straightforward manner even though there are several tools available to perform the clustering. We have developed a stochastic framework to avoid the shortage of capacity, providing a method to estimate the total number of irreducible classes (the order of the classes) as a statistical estimate. A prominent conclusion derived here is that the statistical variation of the number of classes at each sampling trial is working as a promising measure to estimate the order.


title: Strain Engineering of Quantum Emitters in Hexagonal Boron Nitride

abstract: Quantum emitters in hexagonal boron nitride (hBN) are promising building blocks for the realization of integrated quantum photonic systems. However, their spectral inhomogeneity currently limits their potential applications. Here, we apply tensile strain to quantum emitters embedded in few-layer hBN films and realize both red and blue spectral shifts with tuning magnitudes up to 65 meV, a record for any two-dimensional quantum source. We demonstrate reversible tuning of the emission and related photophysical properties. We also observe rotation of the optical dipole in response to strain, suggesting the presence of a second excited state. We derive a theoretical model to describe strain-based tuning in hBN, and the rotation of the optical dipole. Our work demonstrates the immense potential for strain tuning of quantum emitters in layered materials to enable their employment in scalable quantum photonic networks.


title: Optimal V2G and Route Scheduling of Mobile Energy Storage Devices Using a Linear Transit Model to Reduce Electricity and Transportation Energy Losses

abstract: Mobile energy storage devices (MESDs) operate as medium- or large-sized batteries that can be loaded onto electric trucks and connected to charging stations to provide various ancillary services for distribution grids. This paper proposes a new strategy for MESD operation, in which their power outputs and paths are co-optimally scheduled to minimize the total energy loss in both power and transportation networks. The distances moved by MESDs and time at different locations are modeled using a set of linear equations, considering the time-varying traffic flow. The linear transit model is integrated with linearized constraints to support the reliable operation of the distribution grid. In particular, an optimal scheduling problem is formulated considering the maximum limits on incremental variations in bus voltages and line power flows for active and reactive power outputs of MESDs. A mixed-integer linear programming solver can be readily applied to the optimization problem, ensuring the global optimality of the solution. Simulation case studies are carried out under various power and transportation network conditions. The results of these case studies confirm that the proposed strategy using MESDs is effective in reducing total energy losses, compared to conventional methods using stationary batteries and plug-in electric vehicles.


title: Thick-Net: Parallel Network Structure for Sequential Modeling

abstract: Recurrent neural networks have been widely used in sequence learning tasks. In previous studies, the performance of the model has always been improved by either wider or deeper structures. However, the former becomes more prone to overfitting, while the latter is difficult to optimize. In this paper, we propose a simple new model named Thick-Net, by expanding the network from another dimension: thickness. Multiple parallel values are obtained via more sets of parameters in each hidden state, and the maximum value is selected as the final output among parallel intermediate outputs. Notably, Thick-Net can efficiently avoid overfitting, and is easier to optimize than the vanilla structures due to the large dropout affiliated with it. Our model is evaluated on four sequential tasks including adding problem, permuted sequential MNIST, text classification and language modeling. The results of these tasks demonstrate that our model can not only improve accuracy with faster convergence but also facilitate a better generalization ability.


title: Greenberger-Horne-Zeilinger-based quantum private comparison protocol with bit-flipping

abstract: By introducing a semi-honest third party (TP), we propose in this paper a novel QPC protocol using (n+1)- qubit (n \ge 2) Greenberger-Horne-Zeilinger (GHZ) states as information carriers. The parameter n not only determines the number of qubits contained in a GHZ state, but also determines the probability that TP can successfully steal the participants' data and the qubit efficiency. In the proposed protocol, we do not employ any other quantum technologies (e.g., entanglement swapping and unitary operation) except necessary technologies such as preparing quantum states and quantum measurements, which can reduce the need for quantum devices. We use the keys generated by quantum key distribution and bit-flipping for privacy protection, and decoy photons for eavesdropping checking, making both external and internal attacks invalid. Specifically, for external attacks, we take several well-known attack means (e.g., the intercept-resend attack and the measurement-resend attack) as examples to show that the attackers outside the protocol can not steal the participants' data successfully, in which we provide the security proof of the protocol against the entanglement-measurement attack. For internal attacks, we show that TP cannot steal the participants' data and the participants cannot steal each other's data. We also show that the existing attack means against QPC protocols are invalid for our protocol.


title: IFQ-Net: Integrated Fixed-point Quantization Networks for Embedded Vision

abstract: Deploying deep models on embedded devices has been a challenging problem since the great success of deep learning based networks. Fixed-point networks, which represent their data with low bits fixed-point and thus give remarkable savings on memory usage, are generally preferred. Even though current fixed-point networks employ relative low bits (e.g. 8-bits), the memory saving is far from enough for the embedded devices. On the other hand, quantization deep networks, for example XNOR-Net and HWGQNet, quantize the data into 1 or 2 bits resulting in more significant memory savings but still contain lots of floatingpoint data. In this paper, we propose a fixed-point network for embedded vision tasks through converting the floatingpoint data in a quantization network into fixed-point. Furthermore, to overcome the data loss caused by the conversion, we propose to compose floating-point data operations across multiple layers (e.g. convolution, batch normalization and quantization layers) and convert them into fixedpoint. We name the fixed-point network obtained through such integrated conversion as Integrated Fixed-point Quantization Networks (IFQ-Net). We demonstrate that our IFQNet gives 2.16x and 18x more savings on model size and runtime feature map memory respectively with similar accuracy on ImageNet. Furthermore, based on YOLOv2, we design IFQ-Tinier-YOLO face detector which is a fixed-point network with 256x reduction in model size (246k Bytes) than Tiny-YOLO. We illustrate the promising performance of our face detector in terms of detection rate on Face Detection Data Set and Bencmark (FDDB) and qualitative results of detecting small faces of Wider Face dataset.


title: Partial AUC optimization based deep speaker embeddings with class-center learning for text-independent speaker verification

abstract: Deep embedding based text-independent speaker verification has demonstrated superior performance to traditional methods in many challenging scenarios. Its loss functions can be generally categorized into two classes, i.e., verification and identification. The verification loss functions match the pipeline of speaker verification, but their implementations are difficult. Thus, most state-of-the-art deep embedding methods use the identification loss functions with softmax output units or their variants. In this paper, we propose a verification loss function, named the maximization of partial area under the Receiver-operating-characteristic (ROC) curve (pAUC), for deep embedding based text-independent speaker verification. We also propose a class-center based training trial construction method to improve the training efficiency, which is critical for the proposed loss function to be comparable to the identification loss in performance. Experiments on the Speaker in the Wild (SITW) and NIST SRE 2016 datasets show that the proposed pAUC loss function is highly competitive with the state-of-the-art identification loss functions.