title: Interpreting Uncertainty in Model Predictions For COVID-19 Diagnosis

abstract: COVID-19, due to its accelerated spread has brought in the need to use assistive tools for faster diagnosis in addition to typical lab swab testing. Chest X-Rays for COVID cases tend to show changes in the lungs such as ground glass opacities and peripheral consolidations which can be detected by deep neural networks. However, traditional convolutional networks use point estimate for predictions, lacking in capture of uncertainty, which makes them less reliable for adoption. There have been several works so far in predicting COVID positive cases with chest X-Rays. However, not much has been explored on quantifying the uncertainty of these predictions, interpreting uncertainty, and decomposing this to model or data uncertainty. To address these needs, we develop a visualization framework to address interpretability of uncertainty and its components, with uncertainty in predictions computed with a Bayesian Convolutional Neural Network. This framework aims to understand the contribution of individual features in the Chest-X-Ray images to predictive uncertainty. Providing this as an assistive tool can help the radiologist understand why the model came up with a prediction and whether the regions of interest captured by the model for the specific prediction are of significance in diagnosis. We demonstrate the usefulness of the tool in chest x-ray interpretation through several test cases from a benchmark dataset.


title: Variance-Reduced Off-Policy TDC Learning: Non-Asymptotic Convergence Analysis

abstract: Variance reduction techniques have been successfully applied to temporal-difference (TD) learning and help to improve the sample complexity in policy evaluation. However, the existing work applied variance reduction to either the less popular one time-scale TD algorithm or the two time-scale GTD algorithm but with a finite number of i.i.d.\ samples, and both algorithms apply to only the on-policy setting. In this work, we develop a variance reduction scheme for the two time-scale TDC algorithm in the off-policy setting and analyze its non-asymptotic convergence rate over both i.i.d.\ and Markovian samples. In the i.i.d.\ setting, our algorithm {matches the best-known lower bound $\tilde{O}(\epsilon^{-1}$).} In the Markovian setting, our algorithm achieves the state-of-the-art sample complexity $O(\epsilon^{-1} \log {\epsilon}^{-1})$ that is near-optimal. Experiments demonstrate that the proposed variance-reduced TDC achieves a smaller asymptotic convergence error than both the conventional TDC and the variance-reduced TD.


title: Efficient Joinable Table Discovery in Data Lakes: A High-Dimensional Similarity-Based Approach

abstract: Finding joinable tables in data lakes is key procedure in many applications such as data integration, data augmentation, data analysis, and data market. Traditional approaches that find equi-joinable tables are unable to deal with misspellings and different formats, nor do they capture any semantic joins. In this paper, we propose PEXESO, a framework for joinable table discovery in data lakes. We embed textual values as high-dimensional vectors and join columns under similarity predicates on high-dimensional vectors, hence to address the limitations of equi-join approaches and identify more meaningful results. To efficiently find joinable tables with similarity, we propose a block-and-verify method that utilizes pivot-based filtering. A partitioning technique is developed to cope with the case when the data lake is large and the index cannot fit in main memory. An experimental evaluation on real datasets shows that our solution identifies substantially more tables than equi-joins and outperforms other similarity-based options, and the join results are useful in data enrichment for machine learning tasks. The experiments also demonstrate the efficiency of the proposed method.


title: Presentations of Coxeter groups of type $A$, $B$, and $D$ using prefix-reversal generators

abstract: Here we provide three new presentations of Coxeter groups type $A$, $B$, and $D$ using prefix reversals (pancake flips) as generators. We prove these presentations are of their respective groups by using Tietze transformations on the presentations to recover the well known presentations with generators that are adjacent transpositions.


title: Asymptotic Behavior of Adversarial Training in Binary Classification

abstract: It has been consistently reported that many machine learning models are susceptible to adversarial attacks i.e., small additive adversarial perturbations applied to data points can cause misclassification. Adversarial training using empirical risk minimization is considered to be the state-of-the-art method for defense against adversarial attacks. Despite being successful in practice, several problems in understanding generalization performance of adversarial training remain open. In this paper, we derive precise theoretical predictions for the performance of adversarial training in binary classification. We consider the high-dimensional regime where the dimension of data grows with the size of the training data-set at a constant ratio. Our results provide exact asymptotics for standard and adversarial test errors of the estimators obtained by adversarial training with $\ell_q$-norm bounded perturbations ($q \ge 1$) for both discriminative binary models and generative Gaussian-mixture models with correlated features. Furthermore, we use these sharp predictions to uncover several intriguing observations on the role of various parameters including the over-parameterization ratio, the data model, and the attack budget on the adversarial and standard errors.


title: Towards Empowering Diabetic Patients: A perspective on self-management in the context of a group-based education program

abstract: This paper provides a novel framework for maximizing the effectiveness of the Diabetes Group Education Program, which could be generalized in any similar problem context.


title: Online State Estimation for a Physics-Based Lithium-Sulfur Battery Model

abstract: This article examines the problem of Lithium-Sulfur (Li-S) battery state estimation. Such estimation is important for the online management of this energy-dense chemistry. The literature uses equivalent circuit models (ECMs) for Li-S state estimation. This article's main goal is to perform estimation using a physics-based model instead. This approach is attractive because it furnishes online estimates of the masses of individual species in a given Li-S cell. The estimation is performed using an experimentally-validated, computationally tractable zero-dimensional model. Reformulation converts this model from differential algebraic equations (DAEs) to ordinary differential equations (ODEs), simplifying the estimation problem. The article's first contribution is to show that this model has poor observability, especially in the low plateau region, where the low sensitivity of cell voltage to precipitated sulfur mass complicates the estimation of this mass. The second contribution is to exploit mass conservation to derive a reduced-order model with attractive observability properties in both high and low plateau regions. The final contribution is to use an unscented Kalman filter (UKF) for estimating internal Li-S battery states, while taking constraints on species masses into account. Consistent with the article's observability analysis, the UKF achieves better low-plateau estimation accuracy when the reduced-order model is used.


title: Experimental Approach to Demonstrating Contextuality for Qudits

abstract: We propose a method to experimentally demonstrate contextuality with a family of tests for qudits. The experiment we propose uses a qudit encoded in the path of a single photon and its temporal degrees of freedom. We consider the impact of noise on the effectiveness of these tests, taking the approach of ontologically faithful non-contextuality. In this approach, imperfections in the experimental set up must be taken into account in any faithful ontological (classical) model, which limits how much the statistics can deviate within different contexts. In this way we bound the precision of the experimental setup under which ontologically faithful non-contextual models can be refuted. We further consider the noise tolerance through different types of decoherence models on different types of encodings of qudits. We quantify the effect of the decoherence on the required precision for the experimental setup in order to demonstrate contextuality in this broader sense.


title: Self-Switching Markov Chains: emerging dominance phenomena

abstract: In many dynamical systems in nature, the law of the dynamics changes along with the temporal evolution of the system. These changes are often associated with the occurrence of certain events. The timing of occurrence of these events depends, in turn, on the trajectory of the dynamical system itself, making the dynamics of the system and the timing of a change in the dynamics strongly coupled. Naturally, trajectories that take longer to satisfy the event will last longer. Therefore, we expect to observe more frequently the dominant dynamics, the ones that take longer to change in the long run. This article proposes a Markov chain model, called Self-Switching Markov Chain (SSMC), in which the emergence of dominant dynamics can be rigorously addressed. We present conditions and scaling in the SSMC under which we observe with probability one only the subset of dominant dynamics, and we characterize these dominant dynamics. Furthermore, we show that the switching between dynamics exhibits metastability-like property.


title: On the ranges of bilinear pseudo-differential operators of $S_{0,0}$-type on $L^2 \times L^2$

abstract: In this paper, the ranges of bilinear pseudo-differential operators of $S_{0,0}$-type on $L^2 \times L^2$ are determined in the framework of Besov spaces. Our result improves the $L^2 \times L^2 \to L^1$ boundedness of those operators with symbols in the bilinear H\"ormander class $BS^m_{0,0}$.


title: Detecting anomaly in vector boson scattering

abstract: Measuring the vector boson scattering (VBS) precisely is an important step towards understanding the electroweak symmetry breaking of the standard model (SM) and detecting new physics beyond the SM. We propose a neural network which compress the features of the VBS into three dimensional latent space. The consistency of the SM prediction and the experimental data is tested by the binned log-likelihood analysis in the latent space. We will show that the network is capable of distinguish different polarization modes of $WWjj$ production in both dileptonic channel and semi-leptonic channel. The method is also applied to constrain the effective field theory and two Higgs Doublet Model. The results demonstrate that the method is sensitive to generic new physics contributing to the VBS.


title: Semi-Disentangled Representation Learning in Recommendation System

abstract: Disentangled representation has been widely explored in many fields due to its maximal compactness, interpretability and versatility. Recommendation system also needs disentanglement to make representation more explainable and general for downstream tasks. However, some challenges slow its broader application -- the lack of fine-grained labels and the complexity of user-item interactions. To alleviate these problems, we propose a Semi-Disentangled Representation Learning method (SDRL) based on autoencoders. SDRL divides each user/item embedding into two parts: the explainable and the unexplainable, so as to improve proper disentanglement while preserving complex information in representation. The explainable part consists of $internal\ block$ for individual-based features and $external\ block$ for interaction-based features. The unexplainable part is composed by $other\ block$ for other remaining information. Experimental results on three real-world datasets demonstrate that the proposed SDRL could not only effectively express user and item features but also improve the explainability and generality compared with existing representation methods.


title: On annulus presentations, dualizable patterns and RGB-diagrams

abstract: The $0$-trace of a knot is the $4$-manifold represented by the $0$-framing of the knot. In this manuscript, we survey methods constructing a pair of knots with diffeomorphic $0$-traces. In particular, we focus on Gompf-Miyazaki's dualizable pattern, Abe-Jong-Omae-Takeuchi's band presentation, and RGB-diagram given by Piccirillo and named by the author, and we draw the relations among these methods directly. As an application, we give a sufficient condition that two knots obtained by Abe-Jong-Omae-Takeuchi's method coincide.


title: Contact Seaweeds

abstract: A ($2k+1$)$-$dimensional contact Lie algebra is one which admits a one-form $\varphi$ such that $\varphi \wedge (d\varphi)^k\ne0$. Such algebras have index one, but this is not generally a sufficient condition. Here we show that index-one type-A seaweed algebras are necessarily contact. Examples, together with a method for their explicit construction, are provided.


title: Malicious Requests Detection with Improved Bidirectional Long Short-term Memory Neural Networks

abstract: Detecting and intercepting malicious requests are one of the most widely used ways against attacks in the network security. Most existing detecting approaches, including matching blacklist characters and machine learning algorithms have all shown to be vulnerable to sophisticated attacks. To address the above issues, a more general and rigorous detection method is required. In this paper, we formulate the problem of detecting malicious requests as a temporal sequence classification problem, and propose a novel deep learning model namely Convolutional Neural Network-Bidirectional Long Short-term Memory-Convolutional Neural Network (CNN-BiLSTM-CNN). By connecting the shadow and deep feature maps of the convolutional layers, the malicious feature extracting ability is improved on more detailed functionality. Experimental results on HTTP dataset CSIC 2010 have demonstrated the effectiveness of the proposed method when compared with the state-of-the-arts.


title: The study of two quasi-degenerate heavy sterile neutrinos in rare meson decays

abstract: In this work, we study the lepton-number-violating processes of $K^\pm$ and $D^\pm$ mesons. Two quasi-degenerate sterile neutrinos are assumed to induce such processes. Different with the case where only one sterile neutrino involves, here, the CP phases of the mixing parameters could give sizable contribution. This, in turn, would affect the absolute values of the mixing parameters determined by the experimental upper limits of the branching fractions. A general function which express the difference of the mixing parameters for two-generation and one-generation is presented. Special cases with specific relations of the parameters are discussed. Besides, we also thoroughly investigate the CP violation effect of such processes. It is shown that generally $\mathcal A_{CP}$ is a function of the sterile neutrino mass.


title: Notes on the post-bounce background dynamics in bouncing cosmologies

abstract: We investigate the post-bounce background dynamics in a certain class of single bounce scenarios studied in the literature, in which the cosmic bounce is driven by a scalar field with negative exponential potential such as the ekpyrotic potential. We show that those models can actually lead to cyclic evolutions with repeated bounces. These cyclic evolutions, however, do not account for the currently observed late-time accelerated expansion and hence are not cosmologically viable. In this respect we consider a new kind of cyclic model proposed recently and derive some cosmological constraints on this model.


title: Activity Detection And Modeling Using Smart Meter Data: Concept And Case Studies

abstract: Electricity consumed by residential consumers counts for a significant part of global electricity consumption and utility companies can collect high-resolution load data thanks to the widely deployed advanced metering infrastructure. There has been a growing research interest toward appliance load disaggregation via nonintrusive load monitoring. As the electricity consumption of appliances is directly associated with the activities of consumers, this paper proposes a new and more effective approach, i.e., activity disaggregation. We present the concept of activity disaggregation and discuss its advantage over traditional appliance load disaggregation. We develop a framework by leverage machine learning for activity detection based on residential load data and features. We show through numerical case studies to demonstrate the effectiveness of the activity detection method and analyze consumer behaviors by time-dependent activity modeling. Last but not least, we discuss some potential use cases that can benefit from activity disaggregation and some future research directions.


title: A low-dissipation shock-capturing framework with flexible nonlinear dissipation control

abstract: In this work, a framework to construct arbitrarily high-order low-dissipation shock-capturing schemes with flexible and controllable nonlinear dissipation for convection-dominated problems is proposed. While a set of candidate stencils of incremental width is constructed, each one is indicated as smooth or nonsmooth by the ENO-like stencil selection procedure proposed in the targeted essentially non-oscillatory (TENO) scheme [Fu et al., Journal of Computational Physics 305 (2016): 333-359]. Rather than being discarded directly as with TENO schemes, the nonsmooth candidates are filtered by an extra nonlinear limiter, such as a monotonicity-preserving (MP) limiter or a total variation diminishing (TVD) limiter. Consequently, high-order reconstruction is achieved by assembling candidate fluxes with optimal linear weights since they are either smooth reconstructions or filtered ones which feature good non-oscillation property. A weight renormalization procedure as with the standard TENO paradigm is not necessary. This new framework concatenates the concepts of TENO, WENO and other nonlinear limiters for shock-capturing, and provides a new insight to designing low-dissipation nonlinear schemes. Through the adaptation of nonlinear limiters, nonlinear dissipation in the newly proposed framework can be controlled separately without affecting the performance in smooth regions. Based on the proposed framework, a family of new six- and eight-point nonlinear schemes with controllable dissipation is proposed. A set of critical benchmark cases involving strong discontinuities and broadband fluctuations is simulated. Numerical results reveal that the proposed new schemes capture discontinuities sharply and resolve the high-wavenumber fluctuations with low dissipation, while maintaining the desired accuracy order in smooth regions.


title: On reaction network implementations of neural networks

abstract: This paper is concerned with the utilization of deterministically modeled chemical reaction networks for the implementation of (feed-forward) neural networks. We develop a general mathematical framework and prove that the ordinary differential equations (ODEs) associated with certain reaction network implementations of neural networks have desirable properties including (i) existence of unique positive fixed points that are smooth in the parameters of the model (necessary for gradient descent), and (ii) fast convergence to the fixed point regardless of initial condition (necessary for efficient implementation). We do so by first making a connection between neural networks and fixed points for systems of ODEs, and then by constructing reaction networks with the correct associated set of ODEs. We demonstrate the theory by constructing a reaction network that implements a neural network with a smoothed ReLU activation function, though we also demonstrate how to generalize the construction to allow for other activation functions (each with the desirable properties listed previously). As there are multiple types of "networks" utilized in this paper, we also give a careful introduction to both reaction networks and neural networks, in order to disambiguate the overlapping vocabulary in the two settings and to clearly highlight the role of each network's properties.


title: Cluster glass transition and relaxation in random spinel CoGa2O4

abstract: We report magnetic properties in the random spinel magnet CoGa2O4. Rietveld analysis of the x-ray diffraction profile for CoGa2O4 reveals that the Co and Ga ions are distributed randomly in the tetrahedral A-sites and octahedral B-sites in the cubic spinel structure. CoGa2O4 exhibits a spin-glass transition at TSG = 8.2 K that is confirmed by measurements of the dc- and ac-susceptibilities and thermoremanent magnetization (TRM) that develops below TSG. From the frequency dependence of the freezing temperature Tf for CoGa2O4, it is indicated that the relaxation time follows a Vogel-Fulcher law. Magnetic entropy is considerably reduced, probably because magnetic cluster formation developed even at T > TSG. The relaxation rate of TRM is considerably enhanced at TSG and decays rapidly above and below TSG. The time course of TRM is reproduced by non-exponential relaxation forms, such as a stretched exponential (Kohlrausch) as well as Ogielski and Weron relaxation forms. This behavior is displayed universally in glass systems, and the characteristic parameters associated with these functions were reasonable.


title: Notes on constructions of knots with the same trace

abstract: The $m$-trace of a knot is the $4$-manifold obtained from $\mathbf{B}^4$ by attaching a $2$-handle along the knot with $m$-framing. In 2015, Abe, Jong, Luecke and Osoinach introduced a technique to construct infinitely many knots with the same $m$-trace, which is called the operation $(\ast m)$. In this paper, we prove that their technique can be explained in terms of Gompf and Miyazaki's dualizable pattern. In addition, we show that the family of knots admitting the same $4$-surgery given by Teragaito can be explained by the operation $(\ast m)$.


title: Hodge-Newton filtration for $p$-divisible groups with ramified endomorphism structure

abstract: Let $\mathcal{O}_K$ be a complete discrete valuation ring of mixed characteristic $(0,p)$ with perfect residue field. We prove the existence of the Hodge-Newton filtration for $p$-divisible groups over $\mathcal{O}_K$ with additional endomorphism structure for the ring of integers of a finite, possibly ramified field extension of $\mathbb{Q}_p$. The argument is based on the Harder-Narasimhan theory for finite flat group schemes over $\mathcal{O}_K$. In particular, we describe a sufficient condition for the existence of a filtration of $p$-divisible groups over $\mathcal{O}_K$ associated to a break point of the Harder-Narasimhan polygon.


title: Global Image Segmentation Process using Machine Learning algorithm & Convolution Neural Network method for Self- Driving Vehicles

abstract: In autonomous Vehicles technology Image segmentation was a major problem in visual perception. This image segmentation process is mainly used in medical applications. Here we adopted an image segmentation process to visual perception tasks for predicting the agents on the surrounding environment, identifying the road boundaries and tracking the line markings. Main objective of the paper is to divide the input images using the image segmentation process and Convolution Neural Network method for efficient results of visual perception. For Sampling assume a local city data-set samples and validation process done in Jupyter Notebook using Python language. We proposed this image segmentation method planning to standard and further the development of state-of-the art methods for visual inspection system understanding. The experimental results achieves 73% mean IOU. Our method also achieves 90 FPS inference speed and using a NVDIA GeForce GTX 1050 GPU.


title: Polynomial Invariants of Singular Knots and links

abstract: We generalize the notion of the quandle polynomial to the case of singquandles. We show that the singquandle polynomial is an invariant of finite singquandles. We also construct a singular link invariant from the singquandle polynomial and show that this new singular link invariant generalizes the singquandle counting invariant. In particular, using the new polynomial invariant, we can distinguish singular links with the same singquandle counting invariant.


title: Enhancing Cloud Storage with Shareable Instances for Social Computing

abstract: Cloud storage plays an important role in social computing. This paper aims to develop a cloud storage management system for mobile devices to support an extended set of file operations. Because of the limit of storage, bandwidth, power consumption, and other resource restrictions, most existing cloud storage apps for smartphones do not keep local copies of files. This efficient design, however, limits the application capacities. In this paper, we attempt to extend the available file operations for cloud storage service to better serve smartphone users. We develop an efficient and secure file management system, Skyfiles, to support more advanced file operations. The basic idea of our design is to utilize cloud instances to assist file operations. Particularly, Skyfiles supports downloading, compressing, encrypting, and converting operations, as well as file transfer between two smartphone users' cloud storage spaces. In addition, we propose a protocol for users to share their idle instances. All file operations supported by Skyfiles can be efficiently and securely accomplished with either a self-created instance or shared instance.


title: Discriminatively Constrained Semi-supervised Multi-view Nonnegative Matrix Factorization with Graph Regularization

abstract: In recent years, semi-supervised multi-view nonnegative matrix factorization (MVNMF) algorithms have achieved promising performances for multi-view clustering. While most of semi-supervised MVNMFs have failed to effectively consider discriminative information among clusters and feature alignment from multiple views simultaneously. In this paper, a novel Discriminatively Constrained Semi-Supervised Multi-View Nonnegative Matrix Factorization (DCS^2MVNMF) is proposed. Specifically, a discriminative weighting matrix is introduced for the auxiliary matrix of each view, which enhances the inter-class distinction. Meanwhile, a new graph regularization is constructed with the label and geometrical information. In addition, we design a new feature scale normalization strategy to align the multiple views and complete the corresponding iterative optimization schemes. Extensive experiments conducted on several real world multi-view datasets have demonstrated the effectiveness of the proposed method.


title: Fingerprint of the Interbond Electron Hopping in Second-Order Harmonic Generation

abstract: We experimentally explore the fingerprint of the microscopic electron dynamics in second-order harmonic generation (SHG). It is shown that the interbond electron hopping induces a novel source of nonlinear polarization and plays an important role even when the driving laser intensity is 2 orders of magnitude lower than the characteristic atomic field. Our model predicts anomalous anisotropic structures of the SHG yield contributed by the interbond electron hopping, which is identified in our experiments with ZnO crystals. Moreover, a generalized second-order susceptibility with an explicit form is proposed, which provides a unified description in both the weak and strong field regimes. Our work reveals the nonlinear responses of materials at the electron scale and extends the nonlinear optics to a previously unexplored regime, where the nonlinearity related to the interbond electron hopping becomes dominant. It paves the way for realizing controllable nonlinearity on an ultrafast time scale.


title: Iterative Ensemble Kalman Methods: A Unified Perspective with Some New Variants

abstract: This paper provides a unified perspective of iterative ensemble Kalman methods, a family of derivative-free algorithms for parameter reconstruction and other related tasks. We identify, compare and develop three subfamilies of ensemble methods that differ in the objective they seek to minimize and the derivative-based optimization scheme they approximate through the ensemble. Our work emphasizes two principles for the derivation and analysis of iterative ensemble Kalman methods: statistical linearization and continuum limits. Following these guiding principles, we introduce new iterative ensemble Kalman methods that show promising numerical performance in Bayesian inverse problems, data assimilation and machine learning tasks.


title: Noise Analysis of Current Sensitive Preamplifiers and Influence on Energy Resolution of NaI:Tl Detector System

abstract: Current Sensitive Preamplifiers (CSPs) are widely used in front-end electronics in data acquire system (DAQ), due to their ability to amplify signals directly. The optimization of energy resolution requires CSPs with suitable parameters such as gain, bandwidth, and low noise, etc. With the rapid improvement of CSP's bandwidth and trans-impedance gain, it is necessary to know how does the output noise of CSPs effect the energy resolution. For this purpose, we built the noise model of CSPs and analyzed the output noise voltage density of CSPs based on different commercial operation amplifiers (OP AMPs). Theoretical and experimental results shown that OP AMPs with low input noise voltage density is superior than others on energy resolution. Moreover, noise normalization factor has been defined to verify the relationship between energy resolution and noise of CSPs. The experimental results shown that the energy resolution and noise normalization factor are linearly conformable. This paper can provide reference on selecting commercial OP AMPs to design CSPs for optimization of energy resolution.


title: Scalable Bayesian Optimization with Sparse Gaussian Process Models

abstract: This thesis focuses on Bayesian optimization with the improvements coming from two aspects:(i) the use of derivative information to accelerate the optimization convergence; and (ii) the consideration of scalable GPs for handling massive data.


title: AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild

abstract: Occlusion is probably the biggest challenge for human pose estimation in the wild. Typical solutions often rely on intrusive sensors such as IMUs to detect occluded joints. To make the task truly unconstrained, we present AdaFuse, an adaptive multiview fusion method, which can enhance the features in occluded views by leveraging those in visible views. The core of AdaFuse is to determine the point-point correspondence between two views which we solve effectively by exploring the sparsity of the heatmap representation. We also learn an adaptive fusion weight for each camera view to reflect its feature quality in order to reduce the chance that good features are undesirably corrupted by ``bad'' views. The fusion model is trained end-to-end with the pose estimation network, and can be directly applied to new camera configurations without additional adaptation. We extensively evaluate the approach on three public datasets including Human3.6M, Total Capture and CMU Panoptic. It outperforms the state-of-the-arts on all of them. We also create a large scale synthetic dataset Occlusion-Person, which allows us to perform numerical evaluation on the occluded joints, as it provides occlusion labels for every joint in the images. The dataset and code are released at https://github.com/zhezh/adafuse-3d-human-pose.


title: Trajectory-wise Multiple Choice Learning for Dynamics Generalization in Reinforcement Learning

abstract: Model-based reinforcement learning (RL) has shown great potential in various control tasks in terms of both sample-efficiency and final performance. However, learning a generalizable dynamics model robust to changes in dynamics remains a challenge since the target transition dynamics follow a multi-modal distribution. In this paper, we present a new model-based RL algorithm, coined trajectory-wise multiple choice learning, that learns a multi-headed dynamics model for dynamics generalization. The main idea is updating the most accurate prediction head to specialize each head in certain environments with similar dynamics, i.e., clustering environments. Moreover, we incorporate context learning, which encodes dynamics-specific information from past experiences into the context latent vector, enabling the model to perform online adaptation to unseen environments. Finally, to utilize the specialized prediction heads more effectively, we propose an adaptive planning method, which selects the most accurate prediction head over a recent experience. Our method exhibits superior zero-shot generalization performance across a variety of control tasks, compared to state-of-the-art RL methods. Source code and videos are available at https://sites.google.com/view/trajectory-mcl.


title: Measuring the Impact of Influence on Individuals: Roadmap to Quantifying Attitude

abstract: Influence diffusion has been central to the study of propagation of information in social networks, where influence is typically modeled as a binary property of entities: influenced or not influenced. We introduce the notion of attitude, which, as described in social psychology, is the degree by which an entity is influenced by the information. We present an information diffusion model that quantifies the degree of influence, i.e., attitude of individuals, in a social network. With this model, we formulate and study attitude maximization problem. We prove that the function for computing attitude is monotonic and sub-modular, and the attitude maximization problem is NP-Hard. We present a greedy algorithm for maximization with an approximation guarantee of $(1-1/e)$. Using the same model, we also introduce the notion of "actionable" attitude with the aim to study the scenarios where attaining individuals with high attitude is objectively more important than maximizing the attitude of the entire network. We show that the function for computing actionable attitude, unlike that for computing attitude, is non-submodular and however is \emph{approximately submodular}. We present approximation algorithm for maximizing actionable attitude in a network. We experimentally evaluated our algorithms and study empirical properties of the attitude of nodes in network such as spatial and value distribution of high attitude nodes.


title: Min-max Minimal Hypersurfaces with Obstacle

abstract: We study min-max theory for area functional among hypersurfaces constrained in a smooth manifold with boundary. A Schoen-Simon-type regularity result is proved for integral varifolds which satisfy a variational inequality and restrict to a stable minimal hypersurface in the interior. Based on this, we show that for any admissible family of sweepouts $\Pi$ in a compact manifold with boundary, there always exists a closed $C^{1,1}$ hypersurface with codimension$\geq 7$ singular set in the interior and having mean curvature pointing outward along boundary realizing the width $\textbf{L}(\Pi)$.


title: Database, Features, and Machine Learning Model to Identify Thermally Driven Metal-Insulator Transition Compounds

abstract: Metal-insulator transition (MIT) compounds are materials that may exhibit insulating or metallic behavior, depending on the physical conditions, and are of immense fundamental interest owing to their potential applications in emerging microelectronics. There is a dearth of thermally-driven MIT materials, however, which makes delineating these compounds from those that are exclusively insulating or metallic challenging. Here we report a material database comprising temperature-controlled MITs (and metals and insulators with similar chemical composition and stoichiometries to the MIT compounds) from high quality experimental literature, built through a combination of materials-domain knowledge and natural language processing. We featurize the dataset using compositional, structural, and energetic descriptors, including two MIT relevant energy scales, an estimated Hubbard interaction and the charge transfer energy, as well as the structure-bond-stress metric referred to as the global-instability index (GII). We then perform supervised classification, constructing three electronic-state classifiers: metal vs non-metal (M), insulator vs non-insulator (I), and MIT vs non-MIT (T). We identify two important descriptors that separate metals, insulators, and MIT materials in a 2D feature space: the average deviation of the covalent radius and the range of the Mendeleev number. We further elaborate on other important features (GII and Ewald energy), and examine how they affect classification of binary vanadium and titanium oxides. We discuss the relationship of these atomic features to the physical interactions underlying MITs in the rare-earth nickelate family. Last, we implement an online version of the classifiers, enabling quick probabilistic class predictions by uploading a crystallographic structure file.


title: On explicit estimates for $S(t)$, $S_1(t)$, and $\zeta(1/2+\mathrm{i}t)$ under the Riemann Hypothesis

abstract: Assuming the Riemann Hypothesis, we provide explicit upper bounds for moduli of $S(t)$, $S_1(t)$, and $\zeta\left(1/2+\mathrm{i}t\right)$ while comparing them with recently proven unconditional ones. As a corollary we obtain a conditional explicit bound on gaps between consecutive zeros of the Riemann zeta-function.


title: Geometrically Matched Multi-source Microscopic Image Synthesis Using Bidirectional Adversarial Networks

abstract: Microscopic images from multiple modalities can produce plentiful experimental information. In practice, biological or physical constraints under a given observation period may prevent researchers from acquiring enough microscopic scanning. Recent studies demonstrate that image synthesis is one of the popular approaches to release such constraints. Nonetheless, most existing synthesis approaches only translate images from the source domain to the target domain without solid geometric associations. To embrace this challenge, we propose an innovative model architecture, BANIS, to synthesize diversified microscopic images from multi-source domains with distinct geometric features. The experimental outcomes indicate that BANIS successfully synthesizes favorable image pairs on C. elegans microscopy embryonic images. To the best of our knowledge, BANIS is the first application to synthesize microscopic images that associate distinct spatial geometric features from multi-source domains.


title: Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition

abstract: We propose a novel decentralized feature extraction approach in federated learning to address privacy-preservation issues for speech recognition. It is built upon a quantum convolutional neural network (QCNN) composed of a quantum circuit encoder for feature extraction, and a recurrent neural network (RNN) based end-to-end acoustic model (AM). To enhance model parameter protection in a decentralized architecture, an input speech is first up-streamed to a quantum computing server to extract Mel-spectrogram, and the corresponding convolutional features are encoded using a quantum circuit algorithm with random parameters. The encoded features are then down-streamed to the local RNN model for the final recognition. The proposed decentralized framework takes advantage of the quantum learning progress to secure models and to avoid privacy leakage attacks. Testing on the Google Speech Commands Dataset, the proposed QCNN encoder attains a competitive accuracy of 95.12% in a decentralized model, which is better than the previous architectures using centralized RNN models with convolutional features. We also conduct an in-depth study of different quantum circuit encoder architectures to provide insights into designing QCNN-based feature extractors. Neural saliency analyses demonstrate a correlation between the proposed QCNN features, class activation maps, and input spectrograms. We provide an implementation for future studies.


title: Cavitation model of the initial stage of Big Bang

abstract: In this paper, we propose a model for the initial stage of the development of the Universe, analogous to cavitation in a liquid in a negative pressure field. It is assumed that at the stage of inflation, multiple breaks of the metric occur with the formation of areas of physical vacuum in which the generation of matter occurs. The proposed model explains the large-scale isotropy of the Universe without ultrafast inflationary expansion and the emergence of a large-scale cellular (cluster) structure, as a result of the development of cavitation ruptures of a false vacuum. It is shown that the cavitation model can be considered on par with (or as an alternative to) the generally accepted inflationary multiverse model of the Big Bang.


title: RNNAccel: A Fusion Recurrent Neural Network Accelerator for Edge Intelligence

abstract: Many edge devices employ Recurrent Neural Networks (RNN) to enhance their product intelligence. However, the increasing computation complexity poses challenges for performance, energy efficiency and product development time. In this paper, we present an RNN deep learning accelerator, called RNNAccel, which supports Long Short-Term Memory (LSTM) network, Gated Recurrent Unit (GRU) network, and Fully Connected Layer (FC)/ Multiple-Perceptron Layer (MLP) networks. This RNN accelerator addresses (1) computing unit utilization bottleneck caused by RNN data dependency, (2) inflexible design for specific applications, (3) energy consumption dominated by memory access, (4) accuracy loss due to coefficient compression, and (5) unpredictable performance resulting from processor-accelerator integration. Our proposed RNN accelerator consists of a configurable 32-MAC array and a coefficient decompression engine. The MAC array can be scaled-up to meet throughput requirement and power budget. Its sophisticated off-line compression and simple hardware-friendly on-line decompression, called NeuCompression, reduces memory footprint up to 16x and decreases memory access power. Furthermore, for easy SOC integration, we developed a tool set for bit-accurate simulation and integration result validation. Evaluated using a keyword spotting application, the 32-MAC RNN accelerator achieves 90% MAC utilization, 1.27 TOPs/W at 40nm process, 8x compression ratio, and 90% inference accuracy.


title: Dispersive Divergence-Free Vector Meshless Method for Analysis of Frequency-Dependent Medium

abstract: The dispersive meshless method with scalar basis function has been successfully applied for analysis of frequency dependent media. However, as scalar based meshless methods are not always divergence-free in the absence of source,inaccurate or even wrong solutions may be found in the results. To overcome this problem, in this paper, a new dispersive formulation of meshless method with vector basis function is proposed for analysis of dispersive materials. The divergence free property of this method improves the accuracy of simulation by eliminating the artificial charges generated due to the numerical analysis. Moreover, the frequency behavior of the dispersive medium is modeled using auxiliary-differential equations (ADE) method. The efficiency and divergence-free property of the proposed method are verified and compared with dispersive meshless method with scalar basis function by a numerical example.


title: A Dark and Bright Channel Prior Guided Deep Network for Retinal Image Quality Assessment

abstract: Retinal image quality assessment is an essential task in the diagnosis of retinal diseases. Recently, there are emerging deep models to grade quality of retinal images. Current state-of-the-arts either directly transfer classification networks originally designed for natural images to quality classification of retinal images or introduce extra image quality priors via multiple CNN branches or independent CNNs. This paper proposes a dark and bright channel prior guided deep network for retinal image quality assessment called GuidedNet. Specifically, the dark and bright channel priors are embedded into the start layer of network to improve the discriminate ability of deep features. In addition, we re-annotate a new retinal image quality dataset called RIQA-RFMiD for further validation. Experimental results on a public retinal image quality dataset Eye-Quality and our re-annotated dataset RIQA-RFMiD demonstrate the effectiveness of the proposed GuidedNet.


title: Rigidity properties of the cotangent complex

abstract: This work concerns maps $\varphi \colon R\to S$ of commutative noetherian rings, locally of finite flat dimension. It is proved that the Andr\'e-Quillen homology functors are rigid, namely, if $\mathrm{D}_n(S/R;-)=0$ for some $n\ge 2$, then $\mathrm{D}_n(S/R;-)=0$ for all $n\ge 2$ and $\varphi$ is locally complete intersection. This extends Avramov's theorem that draws the same conclusion assuming $\mathrm{D}_n(S/R;-)$ vanishes for all $n\gg 0$, confirming a conjecture of Quillen. The rigidity of Andr\'e-Quillen functors is deduced from a more general result about the higher cotangent modules which answers a question raised by Avramov and Herzog, and subsumes a conjecture of Vasconcelos that was proved recently by the first author. The new insight leading to these results concerns the equivariance of a map from Andr\'e-Quillen cohomology to Hochschild cohomology defined using the universal Atiyah class of $\varphi$.


title: Energy scattering for radial focusing inhomogeneous bi-harmonic Schr\"odinger equations

abstract: This note studies the asymptotic behavior of global solutions to the fourth-order Schr\"odinger equation $$i\dot u+\Delta^2 u+F(x,u)=0 .$$ Indeed, for both cases, local and non-local source term, the scattering is obtained in the focusing mass super-critical and energy sub-critical regimes, with radial setting. This work uses a new approach due to Dodson-Murphy \cite{dm}.


title: Solar PV Frequency Control in the U.S. EI and ERCOT Interconnections -- Case Studies and Recommendations

abstract: This paper studied the solar PV frequency control in the U.S. Eastern Interconnection (EI) and Texas Interconnection (ERCOT) systems. The studied frequency control approaches include droop frequency control, inertia control, and droop-inertia-combined frequency control. The control effects of different frequency controls of PV in the EI and ERCOT are studied using actual high PV penetration interconnection grid models to provide suggestions to the future revision of future PV frequency control standards.


title: Structural Prior Driven Regularized Deep Learning for Sonar Image Classification

abstract: Deep learning has been recently shown to improve performance in the domain of synthetic aperture sonar (SAS) image classification. Given the constant resolution with range of a SAS, it is no surprise that deep learning techniques perform so well. Despite deep learning's recent success, there are still compelling open challenges in reducing the high false alarm rate and enabling success when training imagery is limited, which is a practical challenge that distinguishes the SAS classification problem from standard image classification set-ups where training imagery may be abundant. We address these challenges by exploiting prior knowledge that humans use to grasp the scene. These include unconscious elimination of the image speckle and localization of objects in the scene. We introduce a new deep learning architecture which incorporates these priors with the goal of improving automatic target recognition (ATR) from SAS imagery. Our proposal -- called SPDRDL, Structural Prior Driven Regularized Deep Learning -- incorporates the previously mentioned priors in a multi-task convolutional neural network (CNN) and requires no additional training data when compared to traditional SAS ATR methods. Two structural priors are enforced via regularization terms in the learning of the network: (1) structural similarity prior -- enhanced imagery (often through despeckling) aids human interpretation and is semantically similar to the original imagery and (2) structural scene context priors -- learned features ideally encapsulate target centering information; hence learning may be enhanced via a regularization that encourages fidelity against known ground truth target shifts (relative target position from scene center). Experiments on a challenging real-world dataset reveal that SPDRDL outperforms state-of-the-art deep learning and other competing methods for SAS image classification.


title: Operator-norm resolvent asymptotic analysis of continuous media with high-contrast inclusions

abstract: Using a generalisation of the classical notion of Dirichlet-to-Neumann map and the related formulae for the resolvents of boundary-value problems, we analyse the asymptotic behaviour of solutions to a "transmission problem" for a high-contrast inclusion in a continuous medium, for which we prove the operator-norm resolvent convergence to a limit problem of "electrostatic" type for functions that are constant on the inclusion. In particular, our results imply the convergence of the spectra of high-contrast problems to the spectrum of the limit operator, with order-sharp convergence estimates.


title: Migratable AI : Investigating users' affect on identity and information migration of a conversational AI agent

abstract: Conversational AI agents are becoming ubiquitous and provide assistance to us in our everyday activities. In recent years, researchers have explored the migration of these agents across different embodiments in order to maintain the continuity of the task and improve user experience. In this paper, we investigate user's affective responses in different configurations of the migration parameters. We present a 2x2 between-subjects study in a task-based scenario using information migration and identity migration as parameters. We outline the affect processing pipeline from the video footage collected during the study and report user's responses in each condition. Our results show that users reported highest joy and were most surprised when both the information and identity was migrated; and reported most anger when the information was migrated without the identity of their agent.


title: Zero-Shot Learning from scratch (ZFS): leveraging local compositional representations

abstract: Zero-shot classification is a generalization task where no instance from the target classes is seen during training. To allow for test-time transfer, each class is annotated with semantic information, commonly in the form of attributes or text descriptions. While classical zero-shot learning does not explicitly forbid using information from other datasets, the approaches that achieve the best absolute performance on image benchmarks rely on features extracted from encoders pretrained on Imagenet. This approach relies on hyper-optimized Imagenet-relevant parameters from the supervised classification setting, entangling important questions about the suitability of those parameters and how they were learned with more fundamental questions about representation learning and generalization. To remove these distractors, we propose a more challenging setting: Zero-Shot Learning from scratch (ZFS), which explicitly forbids the use of encoders fine-tuned on other datasets. Our analysis on this setting highlights the importance of local information, and compositional representations.


title: View-Invariant, Occlusion-Robust Probabilistic Embedding for Human Pose

abstract: Recognition of human poses and actions is crucial for autonomous systems to interact smoothly with people. However, cameras generally capture human poses in 2D as images and videos, which can have significant appearance variations across viewpoints that make the recognition tasks challenging. To address this, we explore recognizing similarity in 3D human body poses from 2D information, which has not been well-studied in existing works. Here, we propose an approach to learning a compact view-invariant embedding space from 2D body joint keypoints, without explicitly predicting 3D poses. Input ambiguities of 2D poses from projection and occlusion are difficult to represent through a deterministic mapping, and therefore we adopt a probabilistic formulation for our embedding space. Experimental results show that our embedding model achieves higher accuracy when retrieving similar poses across different camera views, in comparison with 3D pose estimation models. We also show that by training a simple temporal embedding model, we achieve superior performance on pose sequence retrieval and largely reduce the embedding dimension from stacking frame-based embeddings for efficient large-scale retrieval. Furthermore, in order to enable our embeddings to work with partially visible input, we further investigate different keypoint occlusion augmentation strategies during training. We demonstrate that these occlusion augmentations significantly improve retrieval performance on partial 2D input poses. Results on action recognition and video alignment demonstrate that using our embeddings without any additional training achieves competitive performance relative to other models specifically trained for each task.


title: How does enterprise IoT traffic evolve? Real-world evidence from a Finnish operator

abstract: The adoption of Internet of Things (IoT) technologies in businesses is increasing and thus enterprise IoT (EIoT) is seemingly shifting from hype to reality. However, the actual use of EIoT over significant timescales has not been empirically analyzed. In other words, the reality remains unexplored. Furthermore, despite the variety of EIoT verticals, the use of IoT across vertical industries has not been compared. This paper uses a two-year EIoT dataset from a major Finnish mobile network operator to investigate device use across industries, cellular traffic patterns, and mobility patterns. We present a variety of novel findings: EIoT traffic volume per device has increased three-fold over the last two years, the share of LTE-enabled devices has remained low at around 2% and that 30% of EIoT devices are still 2G only, and there are order of magnitude differences between different industries' EIoT traffic and mobility. We also show that daily traffic can be clustered into only three patterns, differing mainly in the presence and timing of a peak hour. Beyond these descriptive results, modeling and forecasting is conducted for both traffic and mobility. We forecast the total daily EIoT traffic through a temporal regression model and achieve an error of about 15% over medium-term (30 to 180 day) horizons. We also model device mobility through a Markov mixture model and quantify the upper bound of predictability for device mobility.


title: Constant Along Primal Rays Conjugacies and Generalized Convexity for Functions of the Support

abstract: The support of a vector in R d is the set of indices with nonzero entries. Functions of the support have the property to be 0-homogeneous and, because of that, the Fenchel conjugacy fails to provide relevant analysis. In this paper, we define the coupling Capra between R d and itself by dividing the classic Fenchel scalar product coupling by a given (source) norm on R d. Our main result is that, when both the source norm and its dual norm are orthant-strictly monotonic, any nondecreasing finite-valued function of the support mapping is Capra-convex, that is, is equal to its Capra-biconjugate (generalized convexity). We also establish that any such function is the composition of a proper convex lower semi continuous function on R d with the normalization mapping on the unit sphere (hidden convexity), and that, when normalized, it admits a variational formulation, which involves a family of generalized local-K-support dual norms.


title: Asymptotic Enumeration and Distributional Properties of Galled Networks

abstract: We show a first-order asymptotics result for the number of galled networks with $n$ leaves. This is the first class of phylogenetic networks of {\it large} size for which an asymptotic counting result of such strength can be obtained. In addition, we also find the limiting distribution of the number of reticulation nodes of a galled networks with $n$ leaves chosen uniformly at random. These results are obtained by performing an asymptotic analysis of a recent approach of Gunawan, Rathin, and Zhang (2020) which was devised for the purpose of (exactly) counting galled networks. Moreover, an old result of Bender and Richmond (1984) plays a crucial role in our proofs, too.


title: Extending Growth Mixture Model to Assess Heterogeneity in Joint Development with Piecewise Linear Trajectories in the Framework of Individual Measurement Occasions

abstract: Researchers continue to be interested in exploring the effects that covariates have on the heterogeneity in trajectories. The inclusion of covariates associated with latent classes allows for a more clear understanding of individual differences and a more meaningful interpretation of latent class membership. Many theoretical and empirical studies have focused on investigating heterogeneity in change patterns of a univariate repeated outcome and examining the effects on baseline covariates that inform the cluster formation. However, developmental processes rarely unfold in isolation; therefore, empirical researchers often desire to examine two or more outcomes over time, hoping to understand their joint development where these outcomes and their change patterns are correlated. This study examines the heterogeneity in parallel nonlinear trajectories and identifies baseline characteristics as predictors of latent classes. Our simulation studies show that the proposed model can tell the clusters of parallel trajectories apart and provide unbiased and accurate point estimates with target coverage probabilities for the parameters of interest in general. We illustrate how to apply the model to investigate the heterogeneity in the joint development of reading and mathematics ability from Grade K to 5. In this real-world example, we also demonstrate how to select covariates that contribute the most to the latent classes and transform candidate covariates from a large set into a more manageable set with retaining the meaningful properties of the original set in the structural equation modeling framework.


title: Classical logic, classical probability, and quantum mechanics

abstract: We give an overview and conceptual discussion of some of our results on contextuality and non-locality. We focus in particular on connections with the work of Itamar Pitowsky on correlation polytopes, Bell inequalities, and Boole's "conditions of possible experience".


title: Index of continuous semi-Fredholm families, regularities and semiregularities

abstract: In this paper, we define and index for continuous families of semi-Fredholm bounded liner operators. Moreover, we study various regularities and semiregularities of continuous families of bounded linear operators.


title: Whither Semantics?

abstract: We discuss how mathematical semantics has evolved, and suggest some new directions for future work. As an example, we discuss some recent work on encapsulating model comparison games as comonads, in the context of finite model theory.


title: Enhancements of the 3/2 and 5/2 frequencies of de Haas-van Alphen oscillations near the Lifshitz transition in the two-dimensional compensated metal with overtilted Dirac cones

abstract: We study the de Haas-van Alphen (dHvA) oscillations in the two-dimensional compensated metal with overtilted Dirac cones near the Lifshitz transition. We employ the tight-binding model of $\alpha$-(BEDT-TTF)$_2$I$_3$, in which the massless Dirac fermions are realized. When a uniaxial pressure $(P)$ along the $y$-axis is applied above $P\simeq 0.2$ kbar in $\alpha$-(BEDT-TTF)$_2$I$_3$, one electron pocket, which encloses the overtilted Dirac points, is changed to two electron pockets, i.e., Lifshitz transition happens, while a hole pocket does not change a topology. We show that the Fourier components corresponding to the $3/2$ and $5/2$ areas of the hole pocket are anomalously enhanced in the region of pressure where the Lifshitz transition occurs. This phenomenon will be observed in the two-dimensional overtilted Dirac fermions near the Lifshitz transition.


title: Fe-vacancy ordered Fe4Se5: The insulating parent phase of FeSe superconductor

abstract: We have carried out a detailed study to investigate the existence of an insulating parent phase for FeSe superconductor. The insulating Fe4Se5 with specific Fe-vacancy order shows a 3D-Mott variable range hopping behavior with a Verwey-like electronic correlation at around 45 K. The application of the RTA process at 450 celcius degree results in the destruction of Fe-vacancy order and induces more electron carriers by increasing the Fe3+ valence state. Superconductivity emerges with Tc ~ 8K without changing the chemical stoichiometry of the sample after the RTA process by resulting in the addition of extra carriers in favor of superconductivity.


title: Boundedly Spaced Subsequences and Weak Dynamics

abstract: The purpose of this paper is to characterize weak supercyclicity for Hilbert-space contractions, which is shown to be equivalent to characterizing weak supercyclicity for unitary operators$.$ This is naturally motivated by an open question that asks whether every weakly supercyclic power bounded operator is weakly stable (which in turn is naturally motivated by a result that asserts that every supercyclic power bounded operator is strongly stable)$.$ Precisely, weakly supercyclicity is investigated in light of boundedly spaced subsequences as discussed in Lemma 3.1$.$ The main result in Theorem 4.1 characterizes weakly l-sequentially supercyclic unitary operators $U\!$ that are weakly unstable in terms of boundedly spaced subsequences of the power sequence $\{U^n\}.$ Remark 4.1 shows that characterizing any form of weak super\-cyclicity for weakly unstable unitary operators is equivalent to characterizing any form of weak supercyclicity for weakly unstable contractions after the Nagy--Foia\c s--Langer decomposition.


title: The More Data, the Better? Demystifying Deletion-Based Methods in Linear Regression with Missing Data

abstract: We compare two deletion-based methods for dealing with the problem of missing observations in linear regression analysis. One is the complete-case analysis (CC, or listwise deletion) that discards all incomplete observations and only uses common samples for ordinary least-squares estimation. The other is the available-case analysis (AC, or pairwise deletion) that utilizes all available data to estimate the covariance matrices and applies these matrices to construct the normal equation. We show that the estimates from both methods are asymptotically unbiased and further compare their asymptotic variances in some typical situations. Surprisingly, using more data (i.e., AC) does not necessarily lead to better asymptotic efficiency in many scenarios. Missing patterns, covariance structure and true regression coefficient values all play a role in determining which is better. We further conduct simulation studies to corroborate the findings and demystify what has been missed or misinterpreted in the literature. Some detailed proofs and simulation results are available in the online supplemental materials.


title: Federated Learning in Multi-RIS Aided Systems

abstract: This paper investigates the problem of model aggregation in federated learning systems aided by multiple reconfigurable intelligent surfaces (RISs). The effective integration of computation and communication is achieved by over-the-air computation (AirComp). Since all local parameters are transmitted over shared wireless channels, the undesirable propagation error inevitably deteriorates the performance of global aggregation. The objective of this work is to 1) reduce the signal distortion of AirComp; 2) enhance the convergence rate of federated learning. Thus, the mean-square-error and the device set are optimized by designing the transmit power, controlling the receive scalar, tuning the phase shifts, and selecting participants in the model uploading process. The formulated mixed-integer non-linear problem (P0) is decomposed into a non-convex problem (P1) with continuous variables and a combinatorial problem (P2) with integer variables. To solve subproblem (P1), the closed-form expressions for transceivers are first derived, then the multi-antenna cases are addressed by the semidefinite relaxation. Next, the problem of phase shifts design is tackled by invoking the penalty-based successive convex approximation method. In terms of subproblem (P2), the difference-of-convex programming is adopted to optimize the device set for convergence acceleration, while satisfying the aggregation error demand. After that, an alternating optimization algorithm is proposed to find a suboptimal solution for problem (P0). Finally, simulation results demonstrate that i) the designed algorithm can converge faster and aggregate model more accurately compared to baselines; ii) the training loss and prediction accuracy of federated learning can be improved significantly with the aid of multiple RISs.


title: Distributed Node-Specific Block-Diagonal LCMV Beamforming in Wireless Acoustic Sensor Networks

abstract: This paper derives the analytical solution of a novel distributed node-specific block-diagonal linearly constrained minimum variance beamformer from the centralized linearly constrained minimum variance (LCMV) beamformer when considering that the noise covariance matrix is block-diagonal. To further reduce the computational complexity of the proposed beamformer, the ShermanMorrison-Woodbury formula is introduced to compute the inversion of noise sample covariance matrix. By doing so, the exchanged signals can be computed with lower dimensions between nodes, where the optimal LCMV beamformer is still available at each node as if each node is to transmit its all raw sensor signal observations. The proposed beamformer is fully distributable without imposing restrictions on the underlying network topology or scaling computational complexity, i.e., there is no increase in the per-node complexity when new nodes are added to the networks. Compared with state-of-the-art distributed node-specific algorithms that are often time-recursive, the proposed beamformer exactly solves the LCMV beamformer optimally frame by frame, which has much lower computational complexity and is more robust to acoustic transfer function estimation error and voice activity detector error. Numerous experimental results are presented to validate the effectiveness of the proposed beamformer.


title: Convergence Acceleration via Chebyshev Step: Plausible Interpretation of Deep-Unfolded Gradient Descent

abstract: Deep unfolding is a promising deep-learning technique, whose network architecture is based on expanding the recursive structure of existing iterative algorithms. Although convergence acceleration is a remarkable advantage of deep unfolding, its theoretical aspects have not been revealed yet. The first half of this study details the theoretical analysis of the convergence acceleration in deep-unfolded gradient descent (DUGD) whose trainable parameters are step sizes. We propose a plausible interpretation of the learned step-size parameters in DUGD by introducing the principle of Chebyshev steps derived from Chebyshev polynomials. The use of Chebyshev steps in gradient descent (GD) enables us to bound the spectral radius of a matrix governing the convergence speed of GD, leading to a tight upper bound on the convergence rate. The convergence rate of GD using Chebyshev steps is shown to be asymptotically optimal, although it has no momentum terms. We also show that Chebyshev steps numerically explain the learned step-size parameters in DUGD well. In the second half of the study, %we apply the theory of Chebyshev steps and Chebyshev-periodical successive over-relaxation (Chebyshev-PSOR) is proposed for accelerating linear/nonlinear fixed-point iterations. Theoretical analysis and numerical experiments indicate that Chebyshev-PSOR exhibits significantly faster convergence for various examples such as Jacobi method and proximal gradient methods.


title: Deep Sequential Learning for Cervical Spine Fracture Detection on Computed Tomography Imaging

abstract: Fractures of the cervical spine are a medical emergency and may lead to permanent paralysis and even death. Accurate diagnosis in patients with suspected fractures by computed tomography (CT) is critical to patient management. In this paper, we propose a deep convolutional neural network (DCNN) with a bidirectional long-short term memory (BLSTM) layer for the automated detection of cervical spine fractures in CT axial images. We used an annotated dataset of 3,666 CT scans (729 positive and 2,937 negative cases) to train and validate the model. The validation results show a classification accuracy of 70.92% and 79.18% on the balanced (104 positive and 104 negative cases) and imbalanced (104 positive and 419 negative cases) test datasets, respectively.


title: Robust Pre-Training by Adversarial Contrastive Learning

abstract: Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations that are consistent under both data augmentations and adversarial perturbations. Our approach leverages a recent contrastive learning framework, which learns representations by maximizing feature consistency under differently augmented views. This fits particularly well with the goal of adversarial robustness, as one cause of adversarial fragility is the lack of feature invariance, i.e., small input perturbations can result in undesirable large changes in features or even predicted labels. We explore various options to formulate the contrastive task, and demonstrate that by injecting adversarial perturbations, contrastive pre-training can lead to models that are both label-efficient and robust. We empirically evaluate the proposed Adversarial Contrastive Learning (ACL) and show it can consistently outperform existing methods. For example on the CIFAR-10 dataset, ACL outperforms the previous state-of-the-art unsupervised robust pre-training approach by 2.99% on robust accuracy and 2.14% on standard accuracy. We further demonstrate that ACL pre-training can improve semi-supervised adversarial training, even when only a few labeled examples are available. Our codes and pre-trained models have been released at: https://github.com/VITA-Group/Adversarial-Contrastive-Learning.


title: EDNet: Efficient Disparity Estimation with Cost Volume Combination and Attention-based Spatial Residual

abstract: Existing state-of-the-art disparity estimation works mostly leverage the 4D concatenation volume and construct a very deep 3D convolution neural network (CNN) for disparity regression, which is inefficient due to the high memory consumption and slow inference speed. In this paper, we propose a network named EDNet for efficient disparity estimation. Firstly, we construct a combined volume which incorporates contextual information from the squeezed concatenation volume and feature similarity measurement from the correlation volume. The combined volume can be next aggregated by 2D convolutions which are faster and require less memory than 3D convolutions. Secondly, we propose an attention-based spatial residual module to generate attention-aware residual features. The attention mechanism is applied to provide intuitive spatial evidence about inaccurate regions with the help of error maps at multiple scales and thus improve the residual learning efficiency. Extensive experiments on the Scene Flow and KITTI datasets show that EDNet outperforms the previous 3D CNN based works and achieves state-of-the-art performance with significantly faster speed and less memory consumption.


title: Improving pronunciation assessment via ordinal regression with anchored reference samples

abstract: Sentence level pronunciation assessment is important for Computer Assisted Language Learning (CALL). Traditional speech pronunciation assessment, based on the Goodness of Pronunciation (GOP) algorithm, has some weakness in assessing a speech utterance: 1) Phoneme GOP scores cannot be easily translated into a sentence score with a simple average for effective assessment; 2) The rank ordering information has not been well exploited in GOP scoring for delivering a robust assessment and correlate well with a human rater's evaluations. In this paper, we propose two new statistical features, average GOP (aGOP) and confusion GOP (cGOP) and use them to train a binary classifier in Ordinal Regression with Anchored Reference Samples (ORARS). When the proposed approach is tested on Microsoft mTutor ESL Dataset, a relative improvement of Pearson correlation coefficient of 26.9% is obtained over the conventional GOP-based one. The performance is at a human-parity level or better than human raters.


title: What can be learned from satisfaction assessments?

abstract: Companies survey their customers to measure their satisfaction levels with the company and its services. The received responses are crucial as they allow companies to assess their respective performances and find ways to make needed improvements. This study focuses on the non-systematic bias that arises when customers assign numerical values in ordinal surveys. Using real customer satisfaction survey data of a large retail bank, we show that the common practice of segmenting ordinal survey responses into uneven segments limit the value that can be extracted from the data. We then show that it is possible to assess the magnitude of the irreducible error under simple assumptions, even in real surveys, and place the achievable modeling goal in perspective. We finish the study by suggesting that a thoughtful survey design, which uses either a careful binning strategy or proper calibration, can reduce the compounding non-systematic error even in elaborated ordinal surveys. A possible application of the calibration method we propose is efficiently conducting targeted surveys using active learning.


title: Principal series component of Gelfand-Graev representation

abstract: Let $G$ be a connected reductive group defined over a non-archimedean local field $F$. Let $B$ be a minimal $F$-parabolic subgroup with Levi factor $T$ and unipotent radical $U$. Let $\psi$ be a non-degenerate character of $U(F)$ and $\lambda$ a character of $T(F)$. Let $(K,\rho)$ be a Bushnell-Kutzko type associated to the Bernstein block of $G(F)$ determined by the pair $(T,\lambda)$. We study the $\rho$-isotypical component $(c\text{-ind}_{U(F)}^{G(F)}\psi)^{\rho}$ of the induced space $c\text{-ind}_{U(F)}^{G(F)}\psi$ of functions compactly supported mod $U(F)$. We show that $(c\text{-ind}_{U(F)}^{G(F)}\psi)^{\rho}$ is cyclic module for the Hecke algebra $\mathcal{H}(G,\rho)$ associated to the pair $(K,\rho)$. When $T$ is split, we describe it more explicitly in terms of $\mathcal{H}(G,\rho)$. We make assumptions on the residue characteristic of $F$ and later also on the characteristic of $F$ and the center of $G$ depending on the pair $(T,\lambda)$. Our results generalize the main result of Chan and Savin in \cite{CS18} who treated the case of $\lambda=1$ for $T$ split.


abstract: This work is based on the seminar titled ``Resiliency in Numerical Algorithm Design for Extreme Scale Simulations'' held March 1-6, 2020 at Schloss Dagstuhl, that was attended by all the authors. Naive versions of conventional resilience techniques will not scale to the exascale regime: with a main memory footprint of tens of Petabytes, synchronously writing checkpoint data all the way to background storage at frequent intervals will create intolerable overheads in runtime and energy consumption. Forecasts show that the mean time between failures could be lower than the time to recover from such a checkpoint, so that large calculations at scale might not make any progress if robust alternatives are not investigated. More advanced resilience techniques must be devised. The key may lie in exploiting both advanced system features as well as specific application knowledge. Research will face two essential questions: (1) what are the reliability requirements for a particular computation and (2) how do we best design the algorithms and software to meet these requirements? One avenue would be to refine and improve on system- or application-level checkpointing and rollback strategies in the case an error is detected. Developers might use fault notification interfaces and flexible runtime systems to respond to node failures in an application-dependent fashion. Novel numerical algorithms or more stochastic computational approaches may be required to meet accuracy requirements in the face of undetectable soft errors. The goal of this Dagstuhl Seminar was to bring together a diverse group of scientists with expertise in exascale computing to discuss novel ways to make applications resilient against detected and undetected faults. In particular, participants explored the role that algorithms and applications play in the holistic approach needed to tackle this challenge.


title: Semi supervised segmentation and graph-based tracking of 3D nuclei in time-lapse microscopy

abstract: We propose a novel weakly supervised method to improve the boundary of the 3D segmented nuclei utilizing an over-segmented image. This is motivated by the observation that current state-of-the-art deep learning methods do not result in accurate boundaries when the training data is weakly annotated. Towards this, a 3D U-Net is trained to get the centroid of the nuclei and integrated with a simple linear iterative clustering (SLIC) supervoxel algorithm that provides better adherence to cluster boundaries. To track these segmented nuclei, our algorithm utilizes the relative nuclei location depicting the processes of nuclei division and apoptosis. The proposed algorithmic pipeline achieves better segmentation performance compared to the state-of-the-art method in Cell Tracking Challenge (CTC) 2019 and comparable performance to state-of-the-art methods in IEEE ISBI CTC2020 while utilizing very few pixel-wise annotated data. Detailed experimental results are provided, and the source code is available on GitHub.


title: A note on stabilization heights of fiber surfaces and the Hopf invariants

abstract: In this paper, we focus on the Hopf invariant and give an alternative proof for the unboundedness of stabilization heights of fiber surfaces, which was firstly proved by Baader and Misev.


title: A formula for boundary correlations of the critical Ising model

abstract: Given a finite rhombus tiling of a polygonal region in the plane, the associated critical $Z$-invariant Ising model is invariant under star-triangle transformations. We give a simple matrix formula describing spin correlations between boundary vertices in terms of the shape of the region. When the region is a regular polygon, our formula becomes an explicit trigonometric sum.


title: Energy and Service-priority aware Trajectory Design for UAV-BSs using Double Q-Learning

abstract: Next-generation mobile networks have proposed the integration of Unmanned Aerial Vehicles (UAVs) as aerial base stations (UAV-BS) to serve ground nodes. Despite having advantages of using UAV-BSs, their dependence on the on-board, limited-capacity battery hinders their service continuity. Shorter trajectories can save flying energy, however, UAV-BSs must also serve nodes based on their service priority since nodes' service requirements are not always the same. In this paper, we present an energy-efficient trajectory optimization for a UAV assisted IoT system in which the UAV-BS considers the IoT nodes' service priorities in making its movement decisions. We solve the trajectory optimization problem using Double Q-Learning algorithm. Simulation results reveal that the Q-Learning based optimized trajectory outperforms a benchmark algorithm, namely Greedily-served algorithm, in terms of reducing the average energy consumption of the UAV-BS as well as the service delay for high priority nodes.


title: A Language and Methodology based on Scenarios, Grammars and Views, for Administrative Business Processes Modelling

abstract: In Business Process Management (BPM), process modelling has been solved in various ways. However, there are no commonly accepted modelling tools (languages). Some of them are criticized for their inability to capture both the lifecycle, informational and organizational models of processes. For some others, process modelling is generally done using a single graph; this does not facilitate modularity, maintenance and scalability. In addition, some of these languages are very general; hence, their application to specific domain processes (such as administrative processes) is very complex. In this paper, we present a new language and a new methodology, dedicated to administrative process modelling. This language is based on a variant of attributed grammars and is able to capture the lifecycle, informational and organizational models of such processes. Also, it proposes a simple graphical formalism allowing to model each process's execution scenario as an annotated tree (modularity). In the new language, a particular emphasis is put on modelling (using "views") the perceptions that actors have on processes and their data.


title: Effects of space sizes on the dispersion of cough-generated droplets from a walking person

abstract: The dispersion of viral droplets plays a key role in the transmission of COVID-19. In this work, we analyze the dispersion of cough-generated droplets in the wake of a walking person for different space sizes. The air flow is simulated by solving the Reynolds-Averaged Navier-Stokes equations, and the droplets are modelled as passive Lagrangian particles. Simulation results show that the cloud of droplets locates around and below the waist height of the manikin after two seconds from coughing, which indicates that kids walking behind an infectious patient are exposed to higher transmission risk than adults. More importantly, two distinct droplet dispersion modes occupying significantly different contamination regions are discovered. A slight change of space size is found being able to trigger the transition of dispersion modes even though the flow patterns are still similar. This shows the importance of accurately simulating the air flow in predicting the dispersion of viral droplets and implies the necessity to set different safe-distancing guidelines for different environments.


title: Stochastic resonance in thermally bistable Josephson weak-links and micro-SQUIDs

abstract: Constriction-based Josephson weak-links display a thermal bi-stability between two states exhibiting zero and finite voltages. This manifests in experiments either as hysteresis in weak-links current voltage characteristics or as random telegraphic signal in voltage. In the latter case, a noise-driven amplification of a sinusoidal excitation of the device is observed, at frequencies matching the characteristic switching frequency in telegraphic signal, a phenomenon known as stochastic resonance. The observed behavior is understood using a two-state model of stochastic resonance and is exploited to illustrate an enhanced signal-to-noise-ratio in a micro-SQUID as a magnetic field sensor.


title: Emotion controllable speech synthesis using emotion-unlabeled dataset with the assistance of cross-domain speech emotion recognition

abstract: Neural text-to-speech (TTS) approaches generally require a huge number of high quality speech data, which makes it difficult to obtain such a dataset with extra emotion labels. In this paper, we propose a novel approach for emotional TTS synthesis on a TTS dataset without emotion labels. Specifically, our proposed method consists of a cross-domain speech emotion recognition (SER) model and an emotional TTS model. Firstly, we train the cross-domain SER model on both SER and TTS datasets. Then, we use emotion labels on the TTS dataset predicted by the trained SER model to build an auxiliary SER task and jointly train it with the TTS model. Experimental results show that our proposed method can generate speech with the specified emotional expressiveness and nearly no hindering on the speech quality.


title: Convolutional neural network and long short-term memory based reduced order surrogate for minimal turbulent channel flow

abstract: We investigate the applicability of machine learning based reduced order model (ML-ROM) to three-dimensional complex flows. As an example, we consider a turbulent channel flow at the friction Reynolds number of $Re_\tau=110$ in a minimum domain which can maintain coherent structures of turbulence. Training data set are prepared by direct numerical simulation (DNS). The present ML-ROM is constructed by combining a three-dimensional convolutional neural network autoencoder (CNN-AE) and a long short-term memory (LSTM). The CNN-AE works to map high-dimensional flow fields into a low-dimensional latent space. The LSTM is then utilized to predict a temporal evolution of the latent vectors obtained by the CNN-AE. The combination of CNN-AE and LSTM can represent the spatio-temporal high-dimensional dynamics of flow fields by only integrating the temporal evolution of the low-dimensional latent dynamics. The turbulent flow fields reproduced by the present ML-ROM show statistical agreement with the reference DNS data in time-ensemble sense, which can also be found through an orbit-based analysis. Influences of the population of vortical structures contained in the domain and the time interval used for temporal prediction on the ML- ROM performance are also investigated. The potential and limitation of the present ML-ROM for turbulence analysis are discussed at the end of our presentation.


title: The Age-related Differences in Web Information Search Process

abstract: Older adults' need for quality health information has never been more critical as during the COVID-19 pandemic. Yet, they are susceptible to the wide-spread misinformation disseminated through search engines and social media. To build a search-related behavioral profile of older adults, this article surveys the empirical research on age-related differences in query formulation, search strategies, information evaluation, and susceptibility to misinformation effects. It also decomposes the mechanisms (i.e., cognitive changes, development goal shift) and moderators (i.e., search task and interface design) of such differences. To inform the design of information systems to improve older adults' information search experience, we discuss opportunities for future research.


title: Resonating dimer-monomer liquid state in a magnetization plateau of a spin-$\frac{1}{2}$ kagome-strip Heisenberg chain

abstract: Highly frustrated spin systems such as the kagome lattice (KL) are a treasure trove of new quantum states with large entanglements. We thus study the spin-$\frac{1}{2}$ Heisenberg model on a kagome-strip chain (KSC), which is one-dimensional KL, using the density-matrix renormalization group (DMRG) method. Calculating central charge and entanglement spectrum for the KSC, we find a novel gapless spin liquid state with doubly degenerate entanglement spectra in a 1/5 magnetization plateau. We also obtain a gapless low-lying continuum in the dynamic spin structure calculated by dynamical DMRG method. We propose a resonating dimer-monomer liquid state that would meet these features.


title: Constraining the density dependence of the symmetry energy with nuclear data and astronomical observations in the KIDS framework

abstract: The KIDS framework for the nuclear equation of state (EoS) and energy density functional (EDF) offers the possibility to explore symmetry-energy (SE) parameters such as J (value at saturation density), L (slope), Ksym (curvature) and so on independently of each other and of assumptions about the effective mass. Here we examine the performance of EoSs with different SE parameters in reproducing nuclear properties and astronomical observations in an effort to constrain especially L and Ksym or the droplet-model counterpart Ktau. Assuming a standard EoS for symmetric matter, we explore several points on the hyperplane of (J,L,Ksym or Ktau) values. For each point, the corresponding EDF parameters and a pairing parameter are obtained for applications in spherical even-even nuclei. This is the first application of KIDS EDFs with pairing correlations. The EoSs are tested successively on properties of closed-shell nuclei, along the Sn isotopic chain, and on astronomical observations, in a step-by-step process of elimination and correction. A small regime of best-performing parameters is determined. The results strongly suggest that Ksym is negative and no lower than -200MeV, that Ktau lies between roughly -400 and -300MeV and that L lies between 40 and 65MeV with L<55MeV more likely. Correlations between symmetry-energy parameters are critically discussed. Predictions for the position of the neutron drip line and the neutron skin thickness of selected nuclei are reported. They are only weakly affected by the choice of effective mass values. Parts of the drip line can be sensitive to the SE parameters. The results underscore the role of Ktau and of precise astronomical input. Better constraints are possible with precise fits to nuclear energies and, in the future, more-precise input from astronomy.


title: PSF-LO: Parameterized Semantic Features Based Lidar Odometry

abstract: Lidar odometry (LO) is a key technology in numerous reliable and accurate localization and mapping systems of autonomous driving. The state-of-the-art LO methods generally leverage geometric information to perform point cloud registration. Furthermore, obtaining point cloud semantic information which can describe the environment more abundantly will help for the registration. We present a novel semantic lidar odometry method based on self-designed parameterized semantic features (PSFs) to achieve low-drift ego-motion estimation for autonomous vehicle in realtime. We first use a convolutional neural network-based algorithm to obtain point-wise semantics from the input laser point cloud, and then use semantic labels to separate the road, building, traffic sign and pole-like point cloud and fit them separately to obtain corresponding PSFs. A fast PSF-based matching enable us to refine geometric features (GeFs) registration, reducing the impact of blurred submap surface on the accuracy of GeFs matching. Besides, we design an efficient method to accurately recognize and remove the dynamic objects while retaining static ones in the semantic point cloud, which are beneficial to further improve the accuracy of LO. We evaluated our method, namely PSF-LO, on the public dataset KITTI Odometry Benchmark and ranked #1 among semantic lidar methods with an average translation error of 0.82% in the test dataset at the time of writing.


title: Exploring the Security Boundary of Data Reconstruction via Neuron Exclusivity Analysis

abstract: Among existing privacy attacks on the gradient of neural networks, \emph{data reconstruction attack}, which reverse engineers the training batch from the gradient, poses a severe threat on the private training data. Despite its empirical success on large architectures and small training batches, unstable reconstruction accuracy is also observed when a smaller architecture or a larger batch is under attack. Due to the weak interpretability of existing learning-based attacks, there is little known on why, when and how data reconstruction attack is feasible. In our work, we perform the first analytic study on the security boundary of data reconstruction from gradient via a microcosmic view on neural networks with rectified linear units (ReLUs), the most popular activation function in practice. For the first time, we characterize the insecure/secure boundary of data reconstruction attack in terms of the \emph{neuron exclusivity state} of a training batch, indexed by the number of \emph{\textbf{Ex}clusively \textbf{A}ctivated \textbf{N}eurons} (ExANs, i.e., a ReLU activated by only one sample in a batch). Intuitively, we show a training batch with more ExANs are more vulnerable to data reconstruction attack and vice versa. On the one hand, we construct a novel deterministic attack algorithm which substantially outperforms previous attacks for reconstructing training batches lying in the insecure boundary of a neural network. Meanwhile, for training batches lying in the secure boundary, we prove the impossibility of unique reconstruction, based on which an exclusivity reduction strategy is devised to enlarge the secure boundary for mitigation purposes.


title: Where to Look and How to Describe: Fashion Image Retrieval with an Attentional Heterogeneous Bilinear Network

abstract: Fashion products typically feature in compositions of a variety of styles at different clothing parts. In order to distinguish images of different fashion products, we need to extract both appearance (i.e., "how to describe") and localization (i.e.,"where to look") information, and their interactions. To this end, we propose a biologically inspired framework for image-based fashion product retrieval, which mimics the hypothesized twostream visual processing system of human brain. The proposed attentional heterogeneous bilinear network (AHBN) consists of two branches: a deep CNN branch to extract fine-grained appearance attributes and a fully convolutional branch to extract landmark localization information. A joint channel-wise attention mechanism is further applied to the extracted heterogeneous features to focus on important channels, followed by a compact bilinear pooling layer to model the interaction of the two streams. Our proposed framework achieves satisfactory performance on three image-based fashion product retrieval benchmarks.


title: The future probe of the light Higgs boson pair production

abstract: In this work we study the light Higgs scenario in the framework of two Higgs doublet model (2HDM). In this case the heavier CP-even Higgs boson $H$ in 2HDM is the SM-like Higgs with 125 GeV mass and a CP-even Higgs boson $h$ lighter than 125 GeV exhibits in the spectrum. We find that this scenario exists in the alignment limit of $\sin(\beta-\alpha)\simeq 0$ and is still allowed by the global fit of the 125 GeV Higgs and the direct searches for $H\to hh$ and $h\to \gamma\gamma$. The case of $M_h<M_H/2$ is highly constrained as the exotic decay mode $H\to hh$ is kinematically allowed. We focus on the $M_h>M_H/2$ case and simulate the pair production of the light Higgs boson at the LHC. The pair production is sensitive to the soft $\mathbb{Z}_2$ symmetry breaking term $m_{12}$ in the 2HDM potential through the Higgs self-couplings. We find that the future high-luminosity LHC can discover the $b\bar{b}\gamma\gamma$ signal in the region of $\tan\beta\lesssim 1$ and $0<m_{12}<100$ GeV allowed by the theoretical constraints.


title: A Distributed Training Algorithm of Generative Adversarial Networks with Quantized Gradients

abstract: Training generative adversarial networks (GAN) in a distributed fashion is a promising technology since it is contributed to training GAN on a massive of data efficiently in real-world applications. However, GAN is known to be difficult to train by SGD-type methods (may fail to converge) and the distributed SGD-type methods may also suffer from massive amount of communication cost. In this paper, we propose a {distributed GANs training algorithm with quantized gradient, dubbed DQGAN,} which is the first distributed training method with quantized gradient for GANs. The new method trains GANs based on a specific single machine algorithm called Optimistic Mirror Descent (OMD) algorithm, and is applicable to any gradient compression method that satisfies a general $\delta$-approximate compressor. The error-feedback operation we designed is used to compensate for the bias caused by the compression, and moreover, ensure the convergence of the new method. Theoretically, we establish the non-asymptotic convergence of {DQGAN} algorithm to first-order stationary point, which shows that the proposed algorithm can achieve a linear speedup in the parameter server model. Empirically, our experiments show that our {DQGAN} algorithm can reduce the communication cost and save the training time with slight performance degradation on both synthetic and real datasets.


title: Quotients of the curve complex

abstract: We consider three kinds of quotients of the curve complex which are obtained by coning off uniformly quasi-convex subspaces: symmetric curve sets, non-maximal train track sets, and compression body disc sets. We show that the actions of the mapping class group on those quotients are strongly WPD, which implies that the actions are non-elementary and those quotients are of infinite diameter.


title: Sheet diagrams for bimonoidal categories

abstract: Bimonoidal categories (also known as rig categories) are categories with two monoidal structures, one of which distributes over the other. We formally define sheet diagrams, a graphical calculus for bimonoidal categories that was informally introduced by Staton. Sheet diagrams are string diagrams drawn on a branching surface, which is itself an extruded string diagram. Our main result is a soundness and completeness theorem of the usual form for graphical calculi: we show that sheet diagrams form the free bimonoidal category on a signature.