title: Asymptotic preserving IMEX-DG-S schemes for linear kinetic transport equations based on Schur complement

abstract: We consider a linear kinetic transport equation under a diffusive scaling, that converges to a diffusion equation as the Knudsen number $\varepsilon\rightarrow0$. In [3, 21], to achieve the asymptotic preserving (AP) property and unconditional stability in the diffusive regime with $\varepsilon\ll 1$, numerical schemes are developed based on an additional reformulation of the even-odd or micro-macro decomposed version of the equation. The key of the reformulation is to add a weighted diffusive term on both sides of one equation in the decomposed system. The choice of the weight function, however, is problem-dependent and ad-hoc, and it can affect the performance of numerical simulations. To avoid issues related to the choice of the weight function and still obtain the AP property and unconditional stability in the diffusive regime, we propose in this paper a new family of AP schemes, termed as IMEX-DG-S schemes, directly solving the micro-macro decomposed system without any further reformulation. The main ingredients of the IMEX-DG-S schemes include globally stiffly accurate implicit-explicit (IMEX) Runge-Kutta (RK) temporal discretizations with a new IMEX strategy, discontinuous Galerkin (DG) spatial discretizations, discrete ordinate methods for the velocity space, and the application of the Schur complement to the algebraic form of the schemes to control the overall computational cost. The AP property of the schemes is shown formally. With an energy type stability analysis applied to the first order scheme, and Fourier type stability analysis applied to the first to third order schemes, we confirm the uniform stability of the methods with respect to $\varepsilon$ and the unconditional stability in the diffusive regime. A series of numerical examples are presented to demonstrate the performance of the new schemes.


title: Multi-Modal Fingerprint Presentation Attack Detection: Evaluation On A New Dataset

abstract: Fingerprint presentation attack detection is becoming an increasingly challenging problem due to the continuous advancement of attack preparation techniques, which generate realistic-looking fake fingerprint presentations. In this work, rather than relying on legacy fingerprint images, which are widely used in the community, we study the usefulness of multiple recently introduced sensing modalities. Our study covers front-illumination imaging using short-wave-infrared, near-infrared, and laser illumination; and back-illumination imaging using near-infrared light. Toward studying the effectiveness of each of these unconventional sensing modalities and their fusion for liveness detection, we conducted a comprehensive analysis using a fully convolutional deep neural network framework. Our evaluation compares different combination of the new sensing modalities to legacy data from one of our collections as well as the public LivDet2015 dataset, showing the superiority of the new sensing modalities in most cases. It also covers the cases of known and unknown attacks and the cases of intra-dataset and inter-dataset evaluations. Our results indicate that the power of our approach stems from the nature of the captured data rather than the employed classification framework, which justifies the extra cost for hardware-based (or hybrid) solutions. We plan to publicly release one of our dataset collections.


title: A Generative Model for Joint Natural Language Understanding and Generation

abstract: Natural language understanding (NLU) and natural language generation (NLG) are two fundamental and related tasks in building task-oriented dialogue systems with opposite objectives: NLU tackles the transformation from natural language to formal representations, whereas NLG does the reverse. A key to success in either task is parallel training data which is expensive to obtain at a large scale. In this work, we propose a generative model which couples NLU and NLG through a shared latent variable. This approach allows us to explore both spaces of natural language and formal representations, and facilitates information sharing through the latent space to eventually benefit NLU and NLG. Our model achieves state-of-the-art performance on two dialogue datasets with both flat and tree-structured formal representations. We also show that the model can be trained in a semi-supervised fashion by utilising unlabelled data to boost its performance.


title: Domain Generalization using Causal Matching

abstract: In the domain generalization literature, a common objective is to learn representations independent of the domain after conditioning on the class label. We show that this objective is not sufficient: there exist counter-examples where a model fails to generalize to unseen domains even after satisfying class-conditional domain invariance. We formalize this observation through a structural causal model and show the importance of modeling within-class variations for generalization. Specifically, classes contain objects that characterize specific causal features, and domains can be interpreted as interventions on these objects that change non-causal features. We highlight an alternative condition: inputs across domains should have the same representation if they are derived from the same object. Based on this objective, we propose matching-based algorithms when base objects are observed (e.g., through data augmentation) and approximate the objective when objects are not observed (MatchDG). Our simple matching-based algorithms are competitive to prior work on out-of-domain accuracy for rotated MNIST, Fashion-MNIST, PACS, and Chest-Xray datasets. Our method MatchDG also recovers ground-truth object matches: on MNIST and Fashion-MNIST, top-10 matches from MatchDG have over 50% overlap with ground-truth matches.


title: Entanglement-Enhanced Optical Atomic Clock

abstract: State-of-the-art atomic clocks are based on the precise detection of the energy difference between two atomic levels, measured as a quantum phase accumulated in a given time interval. Optical-lattice clocks (OLCs) now operate at or near the standard quantum limit (SQL) that arises from the quantum noise associated with discrete measurement outcomes. While performance beyond the SQL has been achieved in microwave clocks and other atomic sensors by engineering quantum correlations (entanglement) between the atoms, the generation of entanglement on an optical-clock transition and operation of such a clock beyond the SQL represent major goals in quantum metrology that have never been demonstrated. Here we report creation of a many-atom entangled state on an optical transition, and demonstrate an OLC with an Allan deviation below the SQL. We report a metrological gain of $4.4^{+0.6}_{-0.4}$ dB over the SQL using an ensemble consisting of a few hundred 171Yb atoms, allowing us to reach a given stability $2.8{\pm}0.3$ times faster than the same clock operated at the SQL. Our results should be readily applicable to other systems, thus enabling further advances in timekeeping precision and accuracy. Entanglement-enhanced OLCs will have many scientific and technological applications, including precision tests of the fundamental laws of physics, geodesy, or gravitational wave detection.


title: UniT: Unified Knowledge Transfer for Any-shot Object Detection and Segmentation

abstract: Methods for object detection and segmentation rely on large scale instance-level annotations for training, which are difficult and time-consuming to collect. Efforts to alleviate this look at varying degrees and quality of supervision. Weakly-supervised approaches draw on image-level labels to build detectors/segmentors, while zero/few-shot methods assume abundant instance-level data for a set of base classes, and none to a few examples for novel classes. This taxonomy has largely siloed algorithmic designs. In this work, we aim to bridge this divide by proposing an intuitive and unified semi-supervised model that is applicable to a range of supervision: from zero to a few instance-level samples per novel class. For base classes, our model learns a mapping from weakly-supervised to fully-supervised detectors/segmentors. By learning and leveraging visual and lingual similarities between the novel and base classes, we transfer those mappings to obtain detectors/segmentors for novel classes; refining them with a few novel class instance-level annotated samples, if available. The overall model is end-to-end trainable and highly flexible. Through extensive experiments on MS-COCO and Pascal VOC benchmark datasets we show improved performance in a variety of settings.


title: Temporal Variability in Implicit Online Learning

abstract: In the setting of online learning, Implicit algorithms turn out to be highly successful from a practical standpoint. However, the tightest regret analyses only show marginal improvements over Online Mirror Descent. In this work, we shed light on this behavior carrying out a careful regret analysis. We prove a novel static regret bound that depends on the temporal variability of the sequence of loss functions, a quantity which is often encountered when considering dynamic competitors. We show, for example, that the regret can be constant if the temporal variability is constant and the learning rate is tuned appropriately, without the need of smooth losses. Moreover, we present an adaptive algorithm that achieves this regret bound without prior knowledge of the temporal variability and prove a matching lower bound. Finally, we validate our theoretical findings on classification and regression datasets.


title: Efficient computation of Jacobian matrices for entropy stable summation-by-parts schemes

abstract: Entropy stable schemes replicate an entropy inequality at the semi-discrete level. These schemes rely on an algebraic summation-by-parts (SBP) structure and a technique referred to as flux differencing. We provide simple and efficient formulas for Jacobian matrices for the semi-discrete systems of ODEs produced by entropy stable discretizations. These formulas are derived based on the structure of flux differencing and derivatives of flux functions, which can be computed using automatic differentiation (AD). Numerical results demonstrate the efficiency and utility of these Jacobian formulas, which are then used in the context of two-derivative explicit time-stepping schemes and implicit time-stepping.


title: PLVER: Joint Stable Allocation and Content Replication for Edge-assisted Live Video Delivery

abstract: The live streaming services have gained extreme popularity in recent years. Due to the spiky traffic patterns of live videos, utilizing the distributed edge servers to improve viewers' quality of experience (QoE) has become a common practice nowadays. Nevertheless, current client-driven content caching mechanism does not support caching beforehand from the cloud to the edge, resulting in considerable cache missing in live video delivery. State-of-the-art research generally sacrifices the liveness of delivered videos in order to deal with the above problem. In this paper, by jointly considering the features of live videos and edge servers, we propose PLVER, a proactive live video push scheme to resolve the cache miss problem in live video delivery. Specifically, PLVER first conducts a one-tomultiple stable allocation between edge clusters and user groups, to balance the load of live traffic over the edge servers. Then it adopts proactive video replication algorithms to speed up the video replication among the edge servers. We conduct extensive trace-driven evaluations, covering 0.3 million Twitch viewers and more than 300 Twitch channels. The results demonstrate that with PLVER, edge servers can carry 28% and 82% more traffic than the auction-based replication method and the caching on requested time method, respectively.


title: Uncertainty Quantification for Inferring Hawkes Networks

abstract: Multivariate Hawkes processes are commonly used to model streaming networked event data in a wide variety of applications. However, it remains a challenge to extract reliable inference from complex datasets with uncertainty quantification. Aiming towards this, we develop a statistical inference framework to learn causal relationships between nodes from networked data, where the underlying directed graph implies Granger causality. We provide uncertainty quantification for the maximum likelihood estimate of the network multivariate Hawkes process by providing a non-asymptotic confidence set. The main technique is based on the concentration inequalities of continuous-time martingales. We compare our method to the previously-derived asymptotic Hawkes process confidence interval, and demonstrate the strengths of our method in an application to neuronal connectivity reconstruction.


title: Better Parameter-free Stochastic Optimization with ODE Updates for Coin-Betting

abstract: Parameter-free stochastic gradient descent (PFSGD) algorithms do not require setting learning rates while achieving optimal theoretical performance. In practical applications, however, there remains an empirical gap between tuned stochastic gradient descent (SGD) and PFSGD. In this paper, we close the empirical gap with a new parameter-free algorithm based on continuous-time Coin-Betting on truncated models. The new update is derived through the solution of an Ordinary Differential Equation (ODE) and solved in a closed form. We show empirically that this new parameter-free algorithm outperforms algorithms with the "best default" learning rates and almost matches the performance of finely tuned baselines without anything to tune.


title: Realistic Physics Based Character Controller

abstract: Over the course of the last several years there was a strong interest in application of modern optimal control techniques to the field of character animation. This interest was fueled by introduction of efficient learning based algorithms for policy optimization, growth in computation power, and game engine improvements. It was shown that it is possible to generate natural looking control of a character by using two ingredients. First, the simulated agent must adhere to a motion capture dataset. And second, the character aims to track the control input from the user. The paper aims at closing the gap between the researchers and users by introducing an open source implementation of physics based character control in Unity framework that has a low entry barrier and a steep learning curve.


title: Thermal and quantum melting phase diagrams for a magnetic-field-induced Wigner solid

abstract: A sufficiently large perpendicular magnetic field quenches the kinetic (Fermi) energy of an interacting two-dimensional (2D) system of fermions, making them susceptible to the formation of a Wigner solid (WS) phase in which the charged carriers organize themselves in a periodic array in order to minimize their Coulomb repulsion energy. In low-disorder 2D electron systems confined to modulation-doped GaAs heterostructures, signatures of a magnetic-field-induced WS appear at low temperatures and very small Landau level filling factors ($\nu\simeq1/5$). In dilute GaAs 2D \textit{hole} systems, on the other hand, thanks to the larger hole effective mass and the ensuing Landau level mixing, the WS forms at relatively higher fillings ($\nu\simeq1/3$). Here we report our measurements of the fundamental temperature vs. filling phase diagram for the 2D holes' WS-liquid \textit{thermal melting}. Moreover, via changing the 2D hole density, we also probe their Landau level mixing vs. filling WS-liquid \textit{quantum melting} phase diagram. We find our data to be in good agreement with the results of very recent calculations, although intriguing subtleties remain.


title: Do Dogs have Whiskers? A New Knowledge Base of hasPart Relations

abstract: We present a new knowledge-base of hasPart relationships, extracted from a large corpus of generic statements. Complementary to other resources available, it is the first which is all three of: accurate (90% precision), salient (covers relationships a person may mention), and has high coverage of common terms (approximated as within a 10 year old's vocabulary), as well as having several times more hasPart entries than in the popular ontologies ConceptNet and WordNet. In addition, it contains information about quantifiers, argument modifiers, and links the entities to appropriate concepts in Wikipedia and WordNet. The knowledge base is available at https://allenai.org/data/haspartkb


title: Quaternionic slice regular functions and quaternionic Laplace transforms

abstract: The functions studied in the paper are quaternion-valued functions of a quaternionic variable. It is show that the left slice regular functions and right slice regular functions are related by a particular involution. The relation between left slice regular functions, right slice regular functions and intrinsic regular functions is revealed. The classical Laplace transform can be naturally generalized to quaternions in two different ways, which transform a quaternion-valued function of a real variable to a left or right slice regular quaternion-valued function of a quaternionic variable. The usual properties of the classical Laplace transforms are generalized to quaternionic Laplace transforms.


title: FrugalML: How to Use ML Prediction APIs More Accurately and Cheaply

abstract: Prediction APIs offered for a fee are a fast-growing industry and an important part of machine learning as a service. While many such services are available, the heterogeneity in their price and performance makes it challenging for users to decide which API or combination of APIs to use for their own data and budget. We take a first step towards addressing this challenge by proposing FrugalML, a principled framework that jointly learns the strength and weakness of each API on different data, and performs an efficient optimization to automatically identify the best sequential strategy to adaptively use the available APIs within a budget constraint. Our theoretical analysis shows that natural sparsity in the formulation can be leveraged to make FrugalML efficient. We conduct systematic experiments using ML APIs from Google, Microsoft, Amazon, IBM, Baidu and other providers for tasks including facial emotion recognition, sentiment analysis and speech recognition. Across various tasks, FrugalML can achieve up to 90% cost reduction while matching the accuracy of the best single API, or up to 5% better accuracy while matching the best API's cost.


title: Bayesian Group Learning for Shot Selection of Professional Basketball Players

abstract: In this paper, we develop a group learning approach to analyze the underlying heterogeneity structure of shot selection among professional basketball players in the NBA. We propose a mixture of finite mixtures (MFM) model to capture the heterogeneity of shot selection among different players based on Log Gaussian Cox process (LGCP). Our proposed method can simultaneously estimate the number of groups and group configurations. An efficient Markov Chain Monte Carlo (MCMC) algorithm is developed for our proposed model. Simulation studies have been conducted to demonstrate its performance. Ultimately, our proposed learning approach is further illustrated in analyzing shot charts of several players in the NBA's 2017-2018 regular season.


title: Green Measures for Markov Processes

abstract: In this paper we study Green measures of certain classes of Markov processes. In particular Brownian motion and processes with jump generators with different tails. The Green measures are represented as a sum of a singular and a regular part given in terms of the jump generator. The main technical question is to find a bound for the regular part.


title: Generalizing Gain Penalization for Feature Selection in Tree-based Models

abstract: We develop a new approach for feature selection via gain penalization in tree-based models. First, we show that previous methods do not perform sufficient regularization and often exhibit sub-optimal out-of-sample performance, especially when correlated features are present. Instead, we develop a new gain penalization idea that exhibits a general local-global regularization for tree-based models. The new method allows for more flexibility in the choice of feature-specific importance weights. We validate our method on both simulated and real data and implement itas an extension of the popular R package ranger.


title: Analyzing the Impact of Foursquare and Streetlight Data with Human Demographics on Future Crime Prediction

abstract: Finding the factors contributing to criminal activities and their consequences is essential to improve quantitative crime research. To respond to this concern, we examine an extensive set of features from different perspectives and explanations. Our study aims to build data-driven models for predicting future crime occurrences. In this paper, we propose the use of streetlight infrastructure and Foursquare data along with demographic characteristics for improving future crime incident prediction. We evaluate the classification performance based on various feature combinations as well as with the baseline model. Our proposed model was tested on each smallest geographic region in Halifax, Canada. Our findings demonstrate the effectiveness of integrating diverse sources of data to gain satisfactory classification performance.


title: Luzin's (N) and randomness reflection

abstract: We show that a computable function $f:\mathbb R\rightarrow\mathbb R$ has Luzin's property (N) if and only if it reflects $\Pi^1_1$-randomnes, if and only if it reflects $\Delta^1_1(\mathcal O)$-randomness, and if and only if it reflects $\mathcal O$-Kurtz randomness, but reflecting Martin-L\"of randomness or weak-2-randomness does not suffice. Here a function $f$ is said to reflect a randomness notion $R$ if whenever $f(x)$ is $R$-random, then $x$ is $R$-random as well. If additionally $f$ is known to have bounded variation, then we show $f$ has Luzin's (N) if and only if it reflects weak-2-randomness, and if and only if it reflects $\emptyset'$-Kurtz randomness. This links classical real analysis with algorithmic randomness.


title: Decentralized decision making and navigation strategy for tracking intruders in a cluttered area by a group of mobile robots

abstract: In the current era of the industrial revolution, mobile robots are playing a pivotal role in helping out mankind in many complex and hazardous environments for performing tasks like search and rescue, obstacle avoidance, mining and security surveillance, etc. A lot of navigation algorithms have been developed in recent years but novel challenges still exist in autonomous path planning of multiple robots to track and follow multiple intruders. This report demonstrates a decentralized strategy of arithmetic mean based navigation algorithm for a group of mobile robots to navigate through an unknown environment filled with obstacles to detect and follow multiple invading intruders. The suggested navigation strategy ensures that mobile robots safely move right in the middle of surrounding obstacles to maintain a safe distance and to avoid collision with obstacles and each other. The conventional method of color recognition is used to detect dynamic intruders and calculate pixel values using the Microsoft Kinect sensor camera. A probability of danger algorithm is introduced to ensure that all the intruders present in the environment are being followed by friendly robots on the bases of the minimum distance between an intruder and its follower. The mobile robots follow intruders movement on the bases of their pixel values. The low pixel value means that intruder is far away and high pixel value represents that intruder is closer to the friendly robots. All the algorithms and image processing techniques are implemented and tested in WEBOTS simulation environment using C programming language and the results show the success of proposed arithmetic mean based navigation and probability of danger based intruders following algorithms.


title: Conversational User Interfaces for Blind Knowledge Workers: A Case Study

abstract: Modern trends in interface design for office equipment using controls on touch surfaces create greater obstacles for blind and visually impaired users and contribute to an environment of dependency in work settings. We believe that \textit{conversational user interfaces} (CUIs) offer a reasonable alternative to touchscreen interactions enabling more access and most importantly greater independence for blind knowledge workers. We present a case study of our work to develop a conversational user interface for accessibility for multifunction printers. We also describe our approach to conversational interfaces in general, which emphasizes task-based collaborative interactions between people and intelligent agents, and we detail the specifics of the solution we created for multifunction printers. To guide our design, we worked with a group of blind and visually impaired individuals starting with focus group sessions to ascertain the challenges our target users face in their professional lives. We followed our technology development with a user study to assess the solution and direct our future efforts. We present our findings and conclusions from the study.


title: Temporal Fusion Network for Temporal Action Localization:Submission to ActivityNet Challenge 2020 (Task E)

abstract: This technical report analyzes a temporal action localization method we used in the HACS competition which is hosted in Activitynet Challenge 2020.The goal of our task is to locate the start time and end time of the action in the untrimmed video, and predict action category.Firstly, we utilize the video-level feature information to train multiple video-level action classification models. In this way, we can get the category of action in the video.Secondly, we focus on generating high quality temporal proposals.For this purpose, we apply BMN to generate a large number of proposals to obtain high recall rates. We then refine these proposals by employing a cascade structure network called Refine Network, which can predict position offset and new IOU under the supervision of ground truth.To make the proposals more accurate, we use bidirectional LSTM, Nonlocal and Transformer to capture temporal relationships between local features of each proposal and global features of the video data.Finally, by fusing the results of multiple models, our method obtains 40.55% on the validation set and 40.53% on the test set in terms of mAP, and achieves Rank 1 in this challenge.


title: A Blockchain-based Decentralized Data Sharing Infrastructure for Off-grid Networking

abstract: Off-grid networks are recently emerging as a solution to connect the unconnected or provide alternative services to networks of possibly untrusted participants. The systems currently used, however, exhibit limitations due to their centralized nature and thus prove inadequate to secure trust. Blockchain technology can be the tool that will enable trust and transparency in such networks. In this paper, we introduce a platform for secure and privacy-respecting decentralized data sharing among untrusted participants in off-grid networks. The proposed architecture realizes this goal via the integration of existing blockchain frameworks (Hyperledger Fabric, Indy, Aries) with an off-grid network device and a distributed file system. We evaluate the proposed platform through experiments and show results for its throughput and latency, which indicate its adequate performance for supporting off-grid decentralized applications.


title: Understanding Learning Dynamics of Binary Neural Networks via Information Bottleneck

abstract: Compact neural networks are essential for affordable and power efficient deep learning solutions. Binary Neural Networks (BNNs) take compactification to the extreme by constraining both weights and activations to two levels, $\{+1, -1\}$. However, training BNNs are not easy due to the discontinuity in activation functions, and the training dynamics of BNNs is not well understood. In this paper, we present an information-theoretic perspective of BNN training. We analyze BNNs through the Information Bottleneck principle and observe that the training dynamics of BNNs is considerably different from that of Deep Neural Networks (DNNs). While DNNs have a separate empirical risk minimization and representation compression phases, our numerical experiments show that in BNNs, both these phases are simultaneous. Since BNNs have a less expressive capacity, they tend to find efficient hidden representations concurrently with label fitting. Experiments in multiple datasets support these observations, and we see a consistent behavior across different activation functions in BNNs.


title: Data-driven determination of the spin Hamiltonian parameters and their uncertainties: The case of the zigzag-chain compound KCu$_4$P$_3$O$_{12}$

abstract: We propose a data-driven technique to estimate the spin Hamiltonian, including uncertainty, from multiple physical quantities. Using our technique, an effective model of KCu$_4$P$_3$O$_{12}$ is determined from the experimentally observed magnetic susceptibility and magnetization curves with various temperatures under high magnetic fields. An effective model, which is the quantum Heisenberg model on a zigzag chain with eight spins having $J_1= -8.54 \pm 0.51 \{\rm meV}$, $J_2 = -2.67 \pm 1.13 \{\rm meV}$, $J_3 = -3.90 \pm 0.15 \{\rm meV}$, and $J_4 = 6.24 \pm 0.95 \{\rm meV}$, describes these measured results well. These uncertainties are successfully determined by the noise estimation. The relations among the estimated magnetic interactions or physical quantities are also discussed. The obtained effective model is useful to predict hard-to-measure properties such as spin gap, spin configuration at the ground state, magnetic specific heat, and magnetic entropy.


title: Least action and the maximum-coupling approximations in the theory of spontaneous fission

abstract: We investigate the dynamics of spontaneous fission in a configuration-interaction (CI) approach. In that formalism the decay rate is governed by an effective interaction coupling the ground-state configuration and a fission doorway configuration, with the interaction strength determined by inverting a high-dimensioned CI Hamiltonian matrix that may have a block-tridiagonal structure. It is shown that the decay rate decreases exponentially with the number of blocks at a rate determined by the largest eigenvalue of a matrix in the block space for Hamiltonians with identical off-diagonal blocks. The theory is greatly simplified by approximations similar in spirit to the adiabatic and the least-action approximations in continuum representations. Here each block is replaced by a single matrix element. While the adiabatic reduction underestimates the coupling, a reduction based on a maximum-coupling approximation works well in a schematic CI model.


title: Self-Supervised Discovery of Anatomical Shape Landmarks

abstract: Statistical shape analysis is a very useful tool in a wide range of medical and biological applications. However, it typically relies on the ability to produce a relatively small number of features that can capture the relevant variability in a population. State-of-the-art methods for obtaining such anatomical features rely on either extensive preprocessing or segmentation and/or significant tuning and post-processing. These shortcomings limit the widespread use of shape statistics. We propose that effective shape representations should provide sufficient information to align/register images. Using this assumption we propose a self-supervised, neural network approach for automatically positioning and detecting landmarks in images that can be used for subsequent analysis. The network discovers the landmarks corresponding to anatomical shape features that promote good image registration in the context of a particular class of transformations. In addition, we also propose a regularization for the proposed network which allows for a uniform distribution of these discovered landmarks. In this paper, we present a complete framework, which only takes a set of input images and produces landmarks that are immediately usable for statistical shape analysis. We evaluate the performance on a phantom dataset as well as 2D and 3D images.


title: CBR-Net: Cascade Boundary Refinement Network for Action Detection: Submission to ActivityNet Challenge 2020 (Task 1)

abstract: In this report, we present our solution for the task of temporal action localization (detection) (task 1) in ActivityNet Challenge 2020. The purpose of this task is to temporally localize intervals where actions of interest occur and predict the action categories in a long untrimmed video. Our solution mainly includes three components: 1) feature encoding: we apply three kinds of backbones, including TSN [7], Slowfast[3] and I3d[1], which are both pretrained on Kinetics dataset[2]. Applying these models, we can extract snippet-level video representations; 2) proposal generation: we choose BMN [5] as our baseline, base on which we design a Cascade Boundary Refinement Network (CBR-Net) to conduct proposal detection. The CBR-Net mainly contains two modules: temporal feature encoding, which applies BiLSTM to encode long-term temporal information; CBR module, which targets to refine the proposal precision under different parameter settings; 3) action localization: In this stage, we combine the video-level classification results obtained by the fine tuning networks to predict the category of each proposal. Moreover, we also apply to different ensemble strategies to improve the performance of the designed solution, by which we achieve 42.788% on the testing set of ActivityNet v1.3 dataset in terms of mean Average Precision metrics.


title: Inductive Graph Neural Networks for Spatiotemporal Kriging

abstract: Time series forecasting and spatiotemporal kriging are the two most important tasks in spatiotemporal data analysis. Recent research on graph neural networks has made substantial progress in time series forecasting, while little attention has been paid to the kriging problem -- recovering signals for unsampled locations/sensors. Most existing scalable kriging methods (e.g., matrix/tensor completion) are transductive, and thus full retraining is required when we have a new sensor to interpolate. In this paper, we develop an Inductive Graph Neural Network Kriging (IGNNK) model to recover data for unsampled sensors on a network/graph structure. To generalize the effect of distance and reachability, we generate random subgraphs as samples and reconstruct the corresponding adjacency matrix for each sample. By reconstructing all signals on each sample subgraph, IGNNK can effectively learn the spatial message passing mechanism. Empirical results on several real-world spatiotemporal datasets demonstrate the effectiveness of our model. In addition, we also find that the learned model can be successfully transferred to the same type of kriging tasks on an unseen dataset. Our results show that: 1) GNN is an efficient and effective tool for spatial kriging; 2) inductive GNNs can be trained using dynamic adjacency matrices; 3) a trained model can be transferred to new graph structures and 4) IGNNK can be used to generate virtual sensors.


title: Projection based adiabatic elimination of bipartite open quantum systems

abstract: Adiabatic elimination methods allow the reduction of the space dimension needed to describe systems dynamics which exhibits separation of time scale. For open quantum system, it consists in eliminating the fast part assuming it has almost instantaneously reached its steady-state and obtaining an approximation of the evolution of the slow part. These methods can be applied to eliminate a linear subspace within the system Hilbert space, or alternatively to eliminate a fast subsystems in a bipartite quantum system. In this work, we extend an adiabatic elimination method used for removing fast degrees of freedom within a open quantum system (Phys. Rev. A 2020, 101,042102) to eliminate a subsystem from an open bipartite quantum system. As an illustration, we apply our technique to a dispersively coupled two-qubit system and in the case of the open Rabi model.

categories: quant-ph cond-mat.mes-hall physics.atom-ph physics.chem-ph


title: Rethinking the Value of Labels for Improving Class-Imbalanced Learning

abstract: Real-world data often exhibits long-tailed distributions with heavy class imbalance, posing great challenges for deep recognition models. We identify a persisting dilemma on the value of labels in the context of imbalanced learning: on the one hand, supervision from labels typically leads to better results than its unsupervised counterparts; on the other hand, heavily imbalanced data naturally incurs "label bias" in the classifier, where the decision boundary can be drastically altered by the majority classes. In this work, we systematically investigate these two facets of labels. We demonstrate, theoretically and empirically, that class-imbalanced learning can significantly benefit in both semi-supervised and self-supervised manners. Specifically, we confirm that (1) positively, imbalanced labels are valuable: given more unlabeled data, the original labels can be leveraged with the extra data to reduce label bias in a semi-supervised manner, which greatly improves the final classifier; (2) negatively however, we argue that imbalanced labels are not useful always: classifiers that are first pre-trained in a self-supervised manner consistently outperform their corresponding baselines. Extensive experiments on large-scale imbalanced datasets verify our theoretically grounded strategies, showing superior performance over previous state-of-the-arts. Our intriguing findings highlight the need to rethink the usage of imbalanced labels in realistic long-tailed tasks. Code is available at https://github.com/YyzHarry/imbalanced-semi-self.


title: Dynamic Attention Based Generative Adversarial Network with Phase Post-Processing for Speech Enhancement

abstract: The generative adversarial networks (GANs) have facilitated the development of speech enhancement recently. Nevertheless, the performance advantage is still limited when compared with state-of-the-art models. In this paper, we propose a powerful Dynamic Attention Recursive GAN called DARGAN for noise reduction in the time-frequency domain. Different from previous works, we have several innovations. First, recursive learning, an iterative training protocol, is used in the generator, which consists of multiple steps. By reusing the network in each step, the noise components are progressively reduced in a step-wise manner. Second, the dynamic attention mechanism is deployed, which helps to re-adjust the feature distribution in the noise reduction module. Third, we exploit the deep Griffin-Lim algorithm as the module for phase postprocessing, which facilitates further improvement in speech quality. Experimental results on Voice Bank corpus show that the proposed GAN achieves state-of-the-art performance than previous GAN- and non-GAN-based models


title: A family of $(p,n)$-gonal Riemann surfaces with several $(p,n)$-gonal groups

abstract: Let $p \geqslant 3$ be a prime number and let $n \geqslant 0$ be an integer such that $p-1$ divides $n.$ In this short note we construct a family of $(p,n)$-gonal Riemann surfaces of maximal genus $2np+(p-1)^2$ with more than one $(p,n)$-gonal group.


title: Online Bayesian Goal Inference for Boundedly-Rational Planning Agents

abstract: People routinely infer the goals of others by observing their actions over time. Remarkably, we can do so even when those actions lead to failure, enabling us to assist others when we detect that they might not achieve their goals. How might we endow machines with similar capabilities? Here we present an architecture capable of inferring an agent's goals online from both optimal and non-optimal sequences of actions. Our architecture models agents as boundedly-rational planners that interleave search with execution by replanning, thereby accounting for sub-optimal behavior. These models are specified as probabilistic programs, allowing us to represent and perform efficient Bayesian inference over an agent's goals and internal planning processes. To perform such inference, we develop Sequential Inverse Plan Search (SIPS), a sequential Monte Carlo algorithm that exploits the online replanning assumption of these models, limiting computation by incrementally extending inferred plans as new actions are observed. We present experiments showing that this modeling and inference architecture outperforms Bayesian inverse reinforcement learning baselines, accurately inferring goals from both optimal and non-optimal trajectories involving failure and back-tracking, while generalizing across domains with compositional structure and sparse rewards.


title: FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstruction

abstract: At this moment, GAN-based image generation methods are still imperfect, whose upsampling design has limitations in leaving some certain artifact patterns in the synthesized image. Such artifact patterns can be easily exploited (by recent methods) for difference detection of real and GAN-synthesized images. However, the existing detection methods put much emphasis on the artifact patterns, which can become futile if such artifact patterns were reduced. Towards reducing the artifacts in the synthesized images, in this paper, we devise a simple yet powerful approach termed FakePolisher that performs shallow reconstruction of fake images through a learned linear dictionary, intending to effectively and efficiently reduce the artifacts introduced during image synthesis. The comprehensive evaluation on 3 state-of-the-art DeepFake detection methods and fake images generated by 16 popular GAN-based fake image generation techniques, demonstrates the effectiveness of our technique.Overall, through reducing artifact patterns, our technique significantly reduces the accuracy of the 3 state-of-the-art fake image detection methods, i.e., 47% on average and up to 93% in the worst case.


title: Constraints on Multicomponent Dark Energy from Cosmological Observations

abstract: Dark energy (DE) plays an important role in the expansion history of our universe. But we only got limited knowledge about its nature and properties after decades of study.In most numerical researches, DE is usually considered as a dynamical whole. Actually, multicomponent DE models can also explain the accelerating expansion of our universe, which is accepted theoretically but lack of numerical researches. We try to study the multicomponent DE models from observation by constructing $w_n$CDM models. The total energy density of DE is separated into $n$ ($n=2,3,5$) parts equally and every part has a constant EOS $w_i$ ($i=1,2...n$). We modify the Friedmann equation and the parameterized post-Friedmann description of DE, then put constraints on $w_i$s from Planck 2018 TT,TE,EE$+$lowE$+$lensing, BAO data and PANTHEON samples. The multicomponent DE models are favoured if any $w_n$CDM model is preferred by observational data and there is no overlap between the highest and lowest values of $w_i$s. We find the data combination supports the $w_n$CDM model when $n$ is small and the $w_2$CDM model is slightly preferred by $\Delta \chi^2_{\text{min}} = \Delta \text{AIC} =\Delta \text{BIC} = -2.48$ over the CPL model, but the largest value of $w_i$ overlaps the smallest one. With larger $n$, the maximum and minimum of $w_i$s do not overlap with each other, but $\chi^2_{\text{min}}$ and AIC also increase. In brief, we find no obvious evidence that DE is composed of different components.


title: Galaxy and Mass Assembly (GAMA): Demonstrating the power of WISE in the study of Galaxy Groups to $z<0.1$

abstract: Combining high-fidelity group characterisation from the Galaxy and Mass Assembly (GAMA) survey and source-tailored $z<0.1$ photometry from the WISE survey, we present a comprehensive study of the properties of ungrouped galaxies, compared to 497 galaxy groups (4$\leq$ N$_{\rm FoF}$ $\leq$ 20) as a function of stellar and halo mass. Ungrouped galaxies are largely unimodal in WISE color, the result of being dominated by star-forming, late-type galaxies. Grouped galaxies, however, show a clear bimodality in WISE color, which correlates strongly with stellar mass and morphology. We find evidence for an increasing early-type fraction, in stellar mass bins between $10^{10}\lesssim$M$_{\rm stellar} \lesssim10^{11}$ M$_\odot$, with increasing halo mass. Using ungrouped, late-type galaxies with star-forming colors (W2$-$W3$>$3), we define a star-forming main-sequence (SFMS), which we use to delineate systems that have moved below the sequence ("quenched" for the purposes of this work). We find that with increasing halo mass, the relative number of late-type systems on the SFMS decreases, with a corresponding increase in early-type, quenched systems at high stellar mass (M$_{\rm stellar}>{10}^{10.5}$ M$_\odot$), consistent with mass quenching. Group galaxies with masses M$_{\rm stellar}<{10}^{10.5}$ M$_\odot$ show evidence of quenching consistent with environmentally-driven processes. The stellar mass distribution of late-type, quenched galaxies suggests they may be an intermediate population as systems transition from being star-forming and late-type to the "red sequence". Finally, we use the projected area of groups on the sky to extract groups that are (relatively) compact for their halo mass. Although these show a marginal increase in their proportion of high mass and early-type galaxies compared to nominal groups, a clear increase in quenched fraction is not evident.


title: Photonic crystals as metamaterials

abstract: The visionary work of Veselago had inspired intensive research efforts over the last decade, towards the realization of man-made structures with unprecedented electromagnetic (EM) properties. These structures, known as metamaterials, are typically periodic metallic-based resonant structures demonstrating effective constitutive parameters beyond the possibilities of natural material. For example they can exhibit optical magnetism or simultaneously negative effective permeability and permittivity which implies the existence of a negative refractive index. However, also periodic dielectric and polar material, known as photonic crystals, can exhibit EM capabilities beyond natural materials. This paper reviews the conditions and manifestations of metamaterial capabilities of photonic crystal systems.


title: The Origin of X-ray Emission in the Gamma-ray emitting Narrow-Line Seyfert 1 1H 0323+342

abstract: We present the results of X-ray spectral and timing analyses of the closest gamma-ray emitting narrow-line Seyfert 1 ($\gamma$-NLS1) galaxy, 1H 0323+342. We use observations from a recent, simultaneous XMM-Newton/NuSTAR campaign. As in radio-quiet NLS1s, the spectrum reveals a soft excess at low energies ($\lesssim2$ keV) and reflection features such as a broad iron K emission line. We also find evidence of a hard excess at energies above $\sim35$ keV that is likely a consequence of jet emission. Our analysis shows that relativistic reflection is statistically required, and using a combination of models that includes the reflection model relxill for the broadband spectrum, we find an inclination of $i=63^{+7}_{-5}$ degrees, which is in tension with much lower values inferred by superluminal motion in radio observations. We also find a flat ($q=2.2\pm0.3$) emissivity profile, implying that there is more reflected flux than usual being emitted from the outer regions of the disk, which in turn suggests a deviation from the thin disk model assumption. We discuss possible reasons for this, such as reflection off of a thick accretion disk geometry.


title: Allometric scaling law and ergodicity breaking in the vascular system

abstract: Allometry or the quantitative study of the relationship of body size to living organism physiology is an important area of biophysical scaling research. The West-Brown-Enquist (WBE) model of fractal branching in a vascular network explains the empirical allometric Kleiber law (the 3/4 scaling exponent for metabolic rates as a function of animal's mass). The WBE model raises a number of new questions, such as how to account for capillary phenomena more accurately and what are more realistic dependencies for blood flow velocity on the size of a capillary. We suggest a generalized formulation of the branching model and investigate the ergodicity in the fractal vascular system. In general, the fluid flow in such a system is not ergodic, and ergodicity breaking is attributed to the fractal structure of the network. Consequently, the fractal branching may be viewed as a source of ergodicity breaking in biophysical systems, in addition to such mechanisms as aging and macromolecular crowding. Accounting for non-ergodicity is important for a wide range of biomedical applications where long observations of time series are impractical. The relevance to microfluidics applications is also discussed.


title: An Approximate Method for the Optimization of Long-Horizon Tank Blending and Scheduling Operations

abstract: We address a challenging tank blending and scheduling problem regarding operations for a chemical plant. We model the problem as a nonconvex MIQCP, then approximate this model as a MILP using a discretization-based approach. We combine a rolling horizon approach with the discretization of individual chemical property specifications to deal with long scheduling horizons, time-varying quality specifications, and multiple suppliers with discrete arrival times. This approach has been evaluated using industry-representative data sets from the specialty chemical industry. We demonstrate that the proposed approach supports fast planning cycles.


title: MetaPerturb: Transferable Regularizer for Heterogeneous Tasks and Architectures

abstract: Regularization and transfer learning are two popular techniques to enhance generalization on unseen data, which is a fundamental problem of machine learning. Regularization techniques are versatile, as they are task- and architecture-agnostic, but they do not exploit a large amount of data available. Transfer learning methods learn to transfer knowledge from one domain to another, but may not generalize across tasks and architectures, and may introduce new training cost for adapting to the target task. To bridge the gap between the two, we propose a transferable perturbation, MetaPerturb, which is meta-learned to improve generalization performance on unseen data. MetaPerturb is implemented as a set-based lightweight network that is agnostic to the size and the order of the input, which is shared across the layers. Then, we propose a meta-learning framework, to jointly train the perturbation function over heterogeneous tasks in parallel. As MetaPerturb is a set-function trained over diverse distributions across layers and tasks, it can generalize to heterogeneous tasks and architectures. We validate the efficacy and generality of MetaPerturb trained on a specific source domain and architecture, by applying it to the training of diverse neural architectures on heterogeneous target datasets against various regularizers and fine-tuning. The results show that the networks trained with MetaPerturb significantly outperform the baselines on most of the tasks and architectures, with a negligible increase in the parameter size and no hyperparameters to tune.


title: Follow the Perturbed Leader: Optimism and Fast Parallel Algorithms for Smooth Minimax Games

abstract: We consider the problem of online learning and its application to solving minimax games. For the online learning problem, Follow the Perturbed Leader (FTPL) is a widely studied algorithm which enjoys the optimal $O(T^{1/2})$ worst-case regret guarantee for both convex and nonconvex losses. In this work, we show that when the sequence of loss functions is predictable, a simple modification of FTPL which incorporates optimism can achieve better regret guarantees, while retaining the optimal worst-case regret guarantee for unpredictable sequences. A key challenge in obtaining these tighter regret bounds is the stochasticity and optimism in the algorithm, which requires different analysis techniques than those commonly used in the analysis of FTPL. The key ingredient we utilize in our analysis is the dual view of perturbation as regularization. While our algorithm has several applications, we consider the specific application of minimax games. For solving smooth convex-concave games, our algorithm only requires access to a linear optimization oracle. For Lipschitz and smooth nonconvex-nonconcave games, our algorithm requires access to an optimization oracle which computes the perturbed best response. In both these settings, our algorithm solves the game up to an accuracy of $O(T^{-1/2})$ using $T$ calls to the optimization oracle. An important feature of our algorithm is that it is highly parallelizable and requires only $O(T^{1/2})$ iterations, with each iteration making $O(T^{1/2})$ parallel calls to the optimization oracle.


title: Commutative d-Torsion K-Theory and Its Applications

abstract: Commutative $d$-torsion $K$-theory is a variant of topological $K$-theory constructed from commuting unitary matrices of order dividing $d$. Such matrices appear as solutions of linear constraint systems that play a role in the study of quantum contextuality and in applications to operator-theoretic problems motivated by quantum information theory. Using methods from stable homotopy theory we modify commutative $d$-torsion $K$-theory into a cohomology theory which can be used for studying operator solutions of linear constraint systems. This provides an interesting connection between stable homotopy theory and quantum information theory.


title: GAN Memory with No Forgetting

abstract: As a fundamental issue in lifelong learning, catastrophic forgetting is directly caused by inaccessible historical data; accordingly, if the data (information) were memorized perfectly, no forgetting should be expected. Motivated by that, we propose a GAN memory for lifelong learning, which is capable of remembering a stream of datasets via generative processes, with \emph{no} forgetting. Our GAN memory is based on recognizing that one can modulate the "style" of a GAN model to form perceptually-distant targeted generation. Accordingly, we propose to do sequential style modulations atop a well-behaved base GAN model, to form sequential targeted generative models, while simultaneously benefiting from the transferred base knowledge. The GAN memory -- that is motivated by lifelong learning -- is therefore itself manifested by a form of lifelong learning, via forward transfer and modulation of information from prior tasks. Experiments demonstrate the superiority of our method over existing approaches and its effectiveness in alleviating catastrophic forgetting for lifelong classification problems. Code is available at https://github.com/MiaoyunZhao/GANmemory_LifelongLearning.


title: Risk Variance Penalization

abstract: The key of the out-of-distribution (OOD) generalization is to generalize invariance from training domains to target domains. The variance risk extrapolation (V-REx) is a practical OOD method, which depends on a domain-level regularization but lacks theoretical verifications about its motivation and utility. This article provides theoretical insights into V-REx by studying a variance-based regularizer. We propose Risk Variance Penalization (RVP), which slightly changes the regularization of V-REx but addresses the theory concerns about V-REx. We provide theoretical explanations and a theory-inspired tuning scheme for the regularization parameter of RVP. Our results point out that RVP discovers a robust predictor. Finally, we experimentally show that the proposed regularizer can find an invariant predictor under certain conditions.


title: Strongly localized semiclassical states for nonlinear Dirac equations

abstract: We study semiclassical states of the nonlinear Dirac equation \[ -i\hbar\partial_t\psi = ic\hbar\sum_{k=1}^3\alpha_k\partial_k\psi - mc^2\beta \psi - M(x)\psi + f(|\psi|)\psi,\quad t\in\mathbb{R},\ x\in\mathbb{R}^3, \] where $V$ is a bounded continuous potential function and the nonlinear term $f(|\psi|)\psi$ is superlinear, possibly of critical growth. Our main result deals with standing wave solutions that concentrate near a critical point of the potential. Standard methods applicable to nonlinear Schr\"odinger equations, like Lyapunov-Schmidt reduction or penalization, do not work, not even for the homogeneous nonlinearity $f(s)=s^p$. We develop a variational method for the strongly indefinite functional associated to the problem.


title: Bayesian Calibration of Computer Models with Informative Failures

abstract: There are many practical difficulties in the calibration of computer models to experimental data. One such complication is the fact that certain combinations of the calibration inputs can cause the code to output data lacking fundamental properties, or even to produce no output at all. In many cases the researchers want or need to exclude the possibility of these "failures" within their analyses. We propose a Bayesian (meta-)model in which the posterior distribution for the calibration parameters naturally excludes regions of the input space corresponding to failed runs. That is, we define a statistical selection model to rigorously couple the disjoint problems of binary classification and computer model calibration. We demonstrate our methodology using data from a carbon capture experiment in which the numerics of the computational fluid dynamics are prone to instability.


title: Experimental formation of monolayer group-IV monochalcogenides

abstract: Monolayer group-IV monochalcogenides (MX, M = Ge, Sn, Pb; X = S, Se, Te) are a family of novel two-dimensional (2D) materials that have atomic structures closely related to that of the staggered black phosphorus lattice. The structure of most monolayer MX materials exhibits a broken inversion symmetry, and many of them exhibit ferroelectricity with a reversible in-plane electric polarization. A further consequence of the noncentrosymmetric structure is that when coupled with strong spin-orbit coupling, many MX materials are promising for the future applications in non-linear optics, photovoltaics, spintronics and valleytronics. Nevertheless, because of the relatively large exfoliation energy, the creation of monolayer MX materials is not easy, which hinders the integration of these materials into the fast-developing field of 2D material heterostructures. In this Perspective, we review recent developments in experimental routes to the creation of monolayer MX, including molecular beam epitaxy and two-step etching methods. Other approaches that could be used to prepare monolayer MX are also discussed, such as liquid phase exfoliation and solution phase synthesis. A quantitative comparison between these different methods is also presented.


title: Guided Transformer: Leveraging Multiple External Sources for Representation Learning in Conversational Search

abstract: Asking clarifying questions in response to ambiguous or faceted queries has been recognized as a useful technique for various information retrieval systems, especially conversational search systems with limited bandwidth interfaces. Analyzing and generating clarifying questions have been studied recently but the accurate utilization of user responses to clarifying questions has been relatively less explored. In this paper, we enrich the representations learned by Transformer networks using a novel attention mechanism from external information sources that weights each term in the conversation. We evaluate this Guided Transformer model in a conversational search scenario that includes clarifying questions. In our experiments, we use two separate external sources, including the top retrieved documents and a set of different possible clarifying questions for the query. We implement the proposed representation learning model for two downstream tasks in conversational search; document retrieval and next clarifying question selection. Our experiments use a public dataset for search clarification and demonstrate significant improvements compared to competitive baselines.


title: Hindsight Expectation Maximization for Goal-conditioned Reinforcement Learning

abstract: We propose a graphical model framework for goal-conditioned RL, with an EM algorithm that operates on the lower bound of the RL objective. The E-step provides a natural interpretation of how 'learning in hindsight' techniques, such as HER, to handle extremely sparse goal-conditioned rewards. The M-step reduces policy optimization to supervised learning updates, which greatly stabilizes end-to-end training on high-dimensional inputs such as images. We show that the combined algorithm, hEM significantly outperforms model-free baselines on a wide range of goal-conditioned benchmarks with sparse rewards.


title: Fault Tolerant Free Gait and Footstep Planning for Hexapod Robot Based on Monte-Carlo Tree

abstract: Legged robots can pass through complex field environments by selecting gaits and discrete footholds carefully. Traditional methods plan gait and foothold separately and treat them as the single-step optimal process. However, such processing causes its poor passability in a sparse foothold environment. This paper novelly proposes a coordinative planning method for hexapod robots that regards the planning of gait and foothold as a sequence optimization problem with the consideration of dealing with the harshness of the environment as leg fault. The Monte Carlo tree search algorithm(MCTS) is used to optimize the entire sequence. Two methods, FastMCTS, and SlidingMCTS are proposed to solve some defeats of the standard MCTS applicating in the field of legged robot planning. The proposed planning algorithm combines the fault-tolerant gait method to improve the passability of the algorithm. Finally, compared with other planning methods, experiments on terrains with different densities of footholds and artificially-designed challenging terrain are carried out to verify our methods. All results show that the proposed method dramatically improves the hexapod robot's ability to pass through sparse footholds environment.


title: Testing for unit roots based on sample autocovariances

abstract: We propose a new unit-root test for a stationary null hypothesis $H_0$ against a unit-root alternative $H_1$. Our approach is nonparametric as $H_0$ only assumes that the process concerned is $I(0)$ without specifying any parametric forms. The new test is based on the fact that the sample autocovariance function (ACVF) converges to the finite population ACVF for an $I(0)$ process while it diverges to infinity for a process with unit-roots. Therefore the new test rejects $H_0$ for the large values of the sample ACVF. To address the technical challenge `how large is large', we split the sample and establish an appropriate normal approximation for the null-distribution of the test statistic. The substantial discriminative power of the new test statistic is rooted from the fact that it takes finite value under $H_0$ and diverges to infinity under $H_1$. This allows us to truncate the critical values of the test to make it with the asymptotic power one. It also alleviates the loss of power due to the sample-splitting. The test is implemented in a user-friendly R-function.


title: Cyclic Re-austenitization of Copper-bearing High-Strength Low-Alloy Steels Fabricated by Laser Powder Bed Fusion

abstract: For the first time, cyclic re-austenitization is carried out for additively manufactured high-strength low-alloy (HSLA) steels in order to refine the microstructure by reducing the prior austenite grain (PAG) size. In this work, HSLA-100 steels processed using laser powder bed fusion (LPBF) technique are subjected to several cycles of re-austenitization using quenching dilatometry. Microstructure characterization for every cycle revealed the presence of bainite, martensite and martensite/austenite (M/A) islands. From the analysis of the dilatometry curves and extensive microstructure characterization, it was found that till the 2nd cycle of re-austenitization, both PAG size and martensite start (Ms) temperature get reduced, while the amount of bainite transformed decreased and the retained austenite content increased. Concomitantly, the highest microhardness along with peak nanohardness of the constituent phases was achieved at the 2nd cycle. Conversely, from the 3rd cycle, the microhardness, as well as the nanohardness of the constituent phases, are found to decrease due to an increase in the PAG size. This behavior is in contrast to the general tendency where a saturation limit is reached after the peak refinement is achieved. It is found that retained austenite can act as a pinning particle to obstruct the PAG boundary movement and its fraction is found to decrease from the 3rd cycle. Hence, the increase in PAG size after the 3rd cycle can be attributed to the destabilization of effective pinning particles to hinder the PAG boundary movement during the re-austenitization.


title: Sparse Separable Nonnegative Matrix Factorization

abstract: We propose a new variant of nonnegative matrix factorization (NMF), combining separability and sparsity assumptions. Separability requires that the columns of the first NMF factor are equal to columns of the input matrix, while sparsity requires that the columns of the second NMF factor are sparse. We call this variant sparse separable NMF (SSNMF), which we prove to be NP-complete, as opposed to separable NMF which can be solved in polynomial time. The main motivation to consider this new model is to handle underdetermined blind source separation problems, such as multispectral image unmixing. We introduce an algorithm to solve SSNMF, based on the successive nonnegative projection algorithm (SNPA, an effective algorithm for separable NMF), and an exact sparse nonnegative least squares solver. We prove that, in noiseless settings and under mild assumptions, our algorithm recovers the true underlying sources. This is illustrated by experiments on synthetic data sets and the unmixing of a multispectral image.


title: Online Hyper-parameter Tuning in Off-policy Learning via Evolutionary Strategies

abstract: Off-policy learning algorithms have been known to be sensitive to the choice of hyper-parameters. However, unlike near on-policy algorithms for which hyper-parameters could be optimized via e.g. meta-gradients, similar techniques could not be straightforwardly applied to off-policy learning. In this work, we propose a framework which entails the application of Evolutionary Strategies to online hyper-parameter tuning in off-policy learning. Our formulation draws close connections to meta-gradients and leverages the strengths of black-box optimization with relatively low-dimensional search spaces. We show that our method outperforms state-of-the-art off-policy learning baselines with static hyper-parameters and recent prior work over a wide range of continuous control benchmarks.


title: Continuous and discrete phasor analysis of binned or time-gated periodic decays

abstract: Time-resolved analysis of periodically excited luminescence decays by the phasor method in the presence of time-gating or binning is revisited. Analytical expressions for discrete configurations of square gates are derived and the locus of the phasors of such modified periodic single-exponential decays is compared to the canonical uni-versal semicircle. The effects of IRF offset, decay truncation and gate shape are also discussed. Finally, modified expressions for the phase and modulus lifetimes are pro-vided for some simple cases. A discussion of a modified phasor calibration approach is presented, and illustration of the new concepts with examples from the literature conclude this work.


title: Interpretable Neural Architecture Search via Bayesian Optimisation with Weisfeiler-Lehman Kernels

abstract: Current neural architecture search (NAS) strategies focus only on finding a single, good, architecture. They offer little insight into why a specific network is performing well, or how we should modify the architecture if we want further improvements. We propose a Bayesian optimisation (BO) approach for NAS that combines the Weisfeiler-Lehman graph kernel with a Gaussian process surrogate. Our method optimises the architecture in a highly data-efficient manner: it is capable of capturing the topological structures of the architectures and is scalable to large graphs, thus making the high-dimensional and graph-like search spaces amenable to BO. More importantly, our method affords interpretability by discovering useful network features and their corresponding impact on the network performance. Indeed, we demonstrate empirically that our surrogate model is capable of identifying useful motifs which can guide the generation of new architectures. We finally show that our method outperforms existing NAS approaches to achieve the state of the art on both closed- and open-domain search spaces.


title: A nonabelian M5 brane Lagrangian in a supergravity background

abstract: We present a nonabelian Lagrangian that appears to have $(2,0)$ superconformal symmetry and that can be coupled to a supergravity background. But for our construction to work, we have to break this superconformal symmetry by imposing as a constraint on top of the Lagrangian that the fields have vanishing Lie derivatives along a Killing direction.


title: Ethical Considerations for AI Researchers

abstract: Use of artificial intelligence is growing and expanding into applications that impact people's lives. People trust their technology without really understanding it or its limitations. There is the potential for harm and we are already seeing examples of that in the world. AI researchers have an obligation to consider the impact of intelligent applications they work on. While the ethics of AI is not clear-cut, there are guidelines we can consider to minimize the harm we might introduce.


title: Enabling Joint Communication and Radar Sensing in Mobile Networks -- A Survey

abstract: Mobile network is evolving from a communication-only network towards one with joint communication and radar/radio sensing (JCAS) capabilities, that we call perceptive mobile network (PMN). In PMNs, JCAS integrates sensing into communications, sharing a majority of system modules and the same transmitted signals. The PMN is expected to provide a ubiquitous radio sensing platform and enable a vast number of novel smart applications, whilst providing non-compromised communications. In this paper, we present a broad picture of the motivation, methodologies, challenges, and research opportunities of realizing PMN, by providing a comprehensive survey for systems and technologies developed mainly in the last ten years. Beginning by reviewing the work on coexisting communication and radar systems, we highlight their limits on addressing the interference problem, and then introduce the JCAS technology. We then set up JCAS in the mobile network context and envisage its potential applications. We continue to provide a brief review of three types of JCAS systems, with particular attention to their differences in design philosophy. We then introduce a framework of PMN, including the system platform and infrastructure, three types of sensing operations, and signals usable for sensing. Subsequently, we discuss required system modifications to enable sensing on current communication-only infrastructure. Within the context of PMN, we review stimulating research problems and potential solutions, organized under nine topics: performance bounds, waveform optimization, antenna array design, clutter suppression, sensing parameter estimation, resolution of sensing ambiguity, pattern analysis, networked sensing under cellular topology, and sensing-assisted communications. We conclude the paper by listing key open research problems for the aforementioned topics and sharing some lessons that we have learned.


title: Accurate Anchor Free Tracking

abstract: Visual object tracking is an important application of computer vision. Recently, Siamese based trackers have achieved good accuracy. However, most of Siamese based trackers are not efficient, as they exhaustively search potential object locations to define anchors and then classify each anchor (i.e., a bounding box). This paper develops the first Anchor Free Siamese Network (AFSN). Specifically, a target object is defined by a bounding box center, tracking offset, and object size. All three are regressed by Siamese network with no additional classification or regional proposal, and performed once for each frame. We also tune the stride and receptive field for Siamese network, and further perform ablation experiments to quantitatively illustrate the effectiveness of our AFSN. We evaluate AFSN using five most commonly used benchmarks and compare to the best anchor-based trackers with source codes available for each benchmark. AFSN is 3-425 times faster than these best anchor based trackers. AFSN is also 5.97% to 12.4% more accurate in terms of all metrics for benchmark sets OTB2015, VOT2015, VOT2016, VOT2018 and TrackingNet, except that SiamRPN++ is 4% better than AFSN in terms of Expected Average Overlap (EAO) on VOT2018 (but SiamRPN++ is 3.9 times slower).


title: Model Based Screening Embedded Bayesian Variable Selection for Ultra-high Dimensional Settings

abstract: We develop a Bayesian variable selection method, called SVEN, based on a hierarchical Gaussian linear model with priors placed on the regression coefficients as well as on the model space. Sparsity is achieved by using degenerate spike priors on inactive variables, whereas Gaussian slab priors are placed on the coefficients for the important predictors making the posterior probability of a model available in explicit form (up to a normalizing constant). The strong model selection consistency is shown to be attained when the number of predictors grows nearly exponentially with the sample size and even when the norm of mean effects solely due to the unimportant variables diverge, which is a novel attractive feature. An appealing byproduct of SVEN is the construction of novel model weight adjusted prediction intervals. Embedding a unique model based screening and using fast Cholesky updates, SVEN produces a highly scalable computational framework to explore gigantic model spaces, rapidly identify the regions of high posterior probabilities and make fast inference and prediction. A temperature schedule guided by our model selection consistency derivations is used to further mitigate multimodal posterior distributions. The performance of SVEN is demonstrated through a number of simulation experiments and a real data example from a genome wide association study with over half a million markers.


title: Explicit Best Arm Identification in Linear Bandits Using No-Regret Learners

abstract: We study the problem of best arm identification in linearly parameterised multi-armed bandits. Given a set of feature vectors $\mathcal{X}\subset\mathbb{R}^d,$ a confidence parameter $\delta$ and an unknown vector $\theta^*,$ the goal is to identify $\arg\max_{x\in\mathcal{X}}x^T\theta^*$, with probability at least $1-\delta,$ using noisy measurements of the form $x^T\theta^*.$ For this fixed confidence ($\delta$-PAC) setting, we propose an explicitly implementable and provably order-optimal sample-complexity algorithm to solve this problem. Previous approaches rely on access to minimax optimization oracles. The algorithm, which we call the \textit{Phased Elimination Linear Exploration Game} (PELEG), maintains a high-probability confidence ellipsoid containing $\theta^*$ in each round and uses it to eliminate suboptimal arms in phases. PELEG achieves fast shrinkage of this confidence ellipsoid along the most confusing (i.e., close to, but not optimal) directions by interpreting the problem as a two player zero-sum game, and sequentially converging to its saddle point using low-regret learners to compute players' strategies in each round. We analyze the sample complexity of PELEG and show that it matches, up to order, an instance-dependent lower bound on sample complexity in the linear bandit setting. We also provide numerical results for the proposed algorithm consistent with its theoretical guarantees.


title: Modeling bike counts in a bike-sharing system considering the effect of weather conditions

abstract: The paper develops a method that quantifies the effect of weather conditions on the prediction of bike station counts in the San Francisco Bay Area Bike Share System. The Random Forest technique was used to rank the predictors that were then used to develop a regression model using a guided forward step-wise regression approach. The Bayesian Information Criterion was used in the development and comparison of the various prediction models. We demonstrated that the proposed approach is promising to quantify the effect of various features on a large BSS and on each station in cases of large networks with big data. The results show that the time-of-the-day, temperature, and humidity level (which has not been studied before) are significant count predictors. It also shows that as weather variables are geographic location dependent and thus should be quantified before using them in modeling. Further, findings show that the number of available bikes at station i at time t-1 and time-of-the-day were the most significant variables in estimating the bike counts at station i.


title: Bilevel Distributed Optimization in Directed Networks

abstract: Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to cooperatively minimize a global cost function. We introduce a new unifying distributed constrained optimization model that is characterized as a bilevel optimization problem. This model captures a wide range of existing problems over directed networks including: (i) Distributed optimization with linear constraints; (ii) Distributed unconstrained nonstrongly convex optimization over directed networks. Employing a novel regularization-based relaxation approach and gradient-tracking schemes, we develop an iteratively regularized push-pull gradient algorithm. We establish the consensus and derive new convergence rate statements for suboptimality and infeasibility of the generated iterates for solving the bilevel model. The proposed algorithm and the complexity analysis obtained in this work appear to be new for addressing the bilevel model and also for the two sub-classes of problems. The numerical performance of the proposed algorithm is presented.


title: Line-of-Sight MIMO for High Capacity Millimeter Wave Backhaul in FDD Systems

abstract: Wireless backhaul is considered to be the key part of the future wireless network with dense small cell traffic and high capacity demand. In this paper, we focus on the design of a high spectral efficiency line-of-sight (LoS) multiple-input multiple-output (MIMO) system for millimeter wave (mmWave) backhaul using dual-polarized frequency division duplex (FDD). High spectral efficiency is very challenging to achieve for the system due to various physical impairments such as phase noise (PHN), timing offset (TO) as well as the poor condition number of the LoS MIMO. In this paper, we propose a holistic solution containing TO compensation, PHN estimation, precoder/decorrelator optimization of the LoS MIMO for wireless backhaul, and the interleaving of each part. We show that the proposed solution has robust performance with end-to-end spectral efficiency of 60 bits/s/Hz for 8x8 MIMO.


title: Lattice Equable Quadrilaterals I -- Parallelograms

abstract: This paper studies equable parallelograms whose vertices lie on the integer lattice. Using Rosenberger's Theorem on generalised Markov equations, we show that the g.c.d. of the side lengths of such parallelograms can only be 3, 4 or 5, and in each of these cases the set of parallelograms naturally forms an infinite tree all of whose vertices have degree 4, bar the root. The paper then focuses on what we call Pythagorean equable parallelograms. These are lattice equable parallelograms whose complement in a circumscribing rectangle consists of two Pythagorean triangles. We prove that for these parallelograms the shortest side can only be 3, 4, 5, 6 or 10, and there are five infinite families of such parallelograms, given by solutions to corresponding Pell-like equations.


title: Unbiased Auxiliary Classifier GANs with MINE

abstract: Auxiliary Classifier GANs (AC-GANs) are widely used conditional generative models and are capable of generating high-quality images. Previous work has pointed out that AC-GAN learns a biased distribution. To remedy this, Twin Auxiliary Classifier GAN (TAC-GAN) introduces a twin classifier to the min-max game. However, it has been reported that using a twin auxiliary classifier may cause instability in training. To this end, we propose an Unbiased Auxiliary GANs (UAC-GAN) that utilizes the Mutual Information Neural Estimator (MINE) to estimate the mutual information between the generated data distribution and labels. To further improve the performance, we also propose a novel projection-based statistics network architecture for MINE. Experimental results on three datasets, including Mixture of Gaussian (MoG), MNIST and CIFAR10 datasets, show that our UAC-GAN performs better than AC-GAN and TAC-GAN. Code can be found on the project website.


title: Primal-dual path-following methods and the trust-region updating strategy for linear programming with noisy data

abstract: In this article, we consider the primal-dual path-following method and the trust-region updating strategy for the standard linear programming problem. For the rank-deficient problem with the small noisy data, we also give the preprocessing method based on the QR decomposition with column pivoting. Then, we prove the global convergence of the new method when the initial point is strictly primal-dual feasible. Finally, for some rank-deficient problems with or without the small noisy data from the NETLIB collection, we compare it with other two popular interior-point methods, i.e. the subroutine pathfollow.m and the built-in subroutine linprog.m of the MATLAB environment. Numerical results show that the new method is more robust than the other two methods for the rank-deficient problem with the small noise data.


title: The Power of Predictions in Online Control

abstract: We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics. In both settings, we characterize the optimal policy and derive tight bounds on the minimum cost and dynamic regret. Perhaps surprisingly, our analysis shows that the conventional greedy MPC approach is a near-optimal policy in both stochastic and adversarial settings. Specifically, for length-$T$ problems, MPC requires only $O(\log T)$ predictions to reach $O(1)$ dynamic regret, which matches (up to lower-order terms) our lower bound on the required prediction horizon for constant regret.


title: Ergosphere and shadow of a rotating regular black hole

abstract: The spacetime singularities in classical general relativity predicted by the celebrated singularity theorems are formed at the end of gravitational collapse. Quantum gravity is the expected theory to resolve the singularity problem, but we are now far from it. Therefore attention has shifted to models of regular black holes free from the singularities. A spherically symmetric regular toy model was obtained by Dymnikova (1992) which we demonstrate as an exact solution of Einstein's field equations coupled to nonlinear electrodynamics for a Lagrangian with parameter $b$ related to magnetic charge. We construct rotating counterpart of this solution which encompasses the Kerr black hole as a special case when charge is switched off ($b=0$). Event Horizon Telescope has released the first image of supermassive black hole M87$^*$, revealing the structure near black hole horizon. The rotating regular black hole's shadow may be useful to determine strong field regime. We investigate ergosphere and black hole shadow of rotating regular black hole to infer that their sizes are sensitive to charge $b$ and have a richer chaotic structure. In particular, rotating regular black hole possess larger size, but less distorted shadows when compared with Kerr black holes. We find one to one correspondence between ergosphere and shadow of the black hole.


title: $\gamma$-ABC: Outlier-Robust Approximate Bayesian Computation Based on a Robust Divergence Estimator

abstract: Approximate Bayesian computation (ABC) is a likelihood-free inference method that has been employed in various applications. However, ABC can be sensitive to outliers if a data discrepancy measure is chosen inappropriately. In this paper, we propose to use a nearest-neighbor-based $\gamma$-divergence estimator as a data discrepancy measure. We show that our estimator possesses a suitable theoretical robustness property called the redescending property. In addition, our estimator enjoys various desirable properties such as high flexibility, asymptotic unbiasedness, almost sure convergence, and linear-time computational complexity. Through experiments, we demonstrate that our method achieves significantly higher robustness than existing discrepancy measures.


title: Observations and Analysis of Absorption Lines including J = K Rotational Levels of CH3CN: The Envelope of Sagittarius B2(M)

abstract: Molecules in diffuse and translucent clouds experience cooling as a result of radiation and less excitation from collisions. However, a rotation around a molecular axis of acetonitrile, CH3CN, cannot be cooled by radiation, causing rotational populations to concentrate at the J = K levels. We aim to search for absorption lines of CH3CN having J = K level concentrations in diffuse and translucent clouds. The JK = 43-33 transition at 73.6 GHz was investigated toward Sgr B2(M) in the Galactic Center region and other sources, using the Nobeyama 45 m telescope. Based on the detected absorption lines toward Sgr B2(M), a radiation temperature of 2.8 +/- 0.5 K, kinetic temperature of 88 +/- 29 K, and column density of (1.35 +/- 0.14) x 10^14 cm-2 were derived for this molecule, revealing extremely concentrated J = K levels due to the lower excitation temperature and the higher kinetic temperature. The absorption lines occurred at a velocity of 64 km s-1. The results confirm that CH3CN with J = K level concentrations exists in the envelope of Sgr B2(M).


title: GIPFA: Generating IPA Pronunciation from Audio

abstract: Transcribing spoken audio samples into the International Phonetic Alphabet (IPA) has long been reserved for experts. In this study, we examine the use of an Artificial Neural Network (ANN) model to automatically extract the IPA phonemic pronunciation of a word based on its audio pronunciation, hence its name Generating IPA Pronunciation From Audio (GIPFA). Based on the French Wikimedia dictionary, we trained our model which then correctly predicted 75% of the IPA pronunciations tested. Interestingly, by studying inference errors, the model made it possible to highlight possible errors in the dataset as well as to identify the closest phonemes in French.


title: Splitting of Volterra Integral Operators with Degenerate Kernels

abstract: Volterra integral operators with non-sign-definite degenerate kernels $A(x,t)= \sum_{k=0}^n A_k(x,t)$, $A_k(x,t)= a_k (x) t^k$, are studied acting from one weighted $L_2$ space on $(0,+\infty)$ to another. Imposing an integral doubling condition on one of the weights, it is shown that the operator with the kernel $A(x,t)$ is bounded if and only $n+1$ operators with kernels $A_k(x,t)$ are all bounded. We apply this result to describe spaces of pointwise multipliers in weighted Sobolev spaces on $(0,+\infty)$.


title: Consistent Semi-Supervised Graph Regularization for High Dimensional Data

abstract: Semi-supervised Laplacian regularization, a standard graph-based approach for learning from both labelled and unlabelled data, was recently demonstrated to have an insignificant high dimensional learning efficiency with respect to unlabelled data (Mai and Couillet 2018), causing it to be outperformed by its unsupervised counterpart, spectral clustering, given sufficient unlabelled data. Following a detailed discussion on the origin of this inconsistency problem, a novel regularization approach involving centering operation is proposed as solution, supported by both theoretical analysis and empirical results.


title: Mitigating Face Recognition Bias via Group Adaptive Classifier

abstract: Face recognition is known to exhibit bias - subjects in a certain demographic group can be better recognized than other groups. This work aims to learn a fair face representation, where faces of every group could be more equally represented. Our proposed group adaptive classifier mitigates bias by using adaptive convolution kernels and attention mechanisms on faces based on their demographic attributes. The adaptive module comprises kernel masks and channel-wise attention maps for each demographic group so as to activate different facial regions for identification, leading to more discriminative features pertinent to their demographics. Our introduced automated adaptation strategy determines whether to apply adaptation to a certain layer by iteratively computing the dissimilarity among demographic-adaptive parameters. A new de-biasing loss function is proposed to mitigate the gap of average intra-class distance between demographic groups. Experiments on face benchmarks (RFW, LFW, IJB-A, and IJB-C) show that our work is able to mitigate face recognition bias across demographic groups while maintaining the competitive accuracy.


title: Search for Optically Dark Infrared Galaxies without Counterparts of Subaru Hyper Suprime-Cam in the AKARI North Ecliptic Pole Wide Survey Field

abstract: We present the physical properties of AKARI sources without optical counterparts in optical images from the Hyper Suprime-Cam (HSC) on the Subaru telescope. Using the AKARI infrared (IR) source catalog and HSC optical catalog, we select 583 objects that do not have HSC counterparts in the AKARI North Ecliptic Pole (NEP) wide survey field ($\sim 5$ deg$^{2}$). Because the HSC limiting magnitude is deep ($g_{\rm AB}$ $\sim 28.6$), these are good candidates for extremely red star-forming galaxies (SFGs) and/or active galactic nuclei (AGNs), possibly at high redshifts. We compile multi-wavelength data out to 500 $\mu$m and use it for Spectral Energy Distribution (SED) fitting with CIGALE to investigate the physical properties of AKARI galaxies without optical counterparts. We also compare their physical quantities with AKARI mid-IR selected galaxies with HSC counterparts. The estimated redshifts of AKARI objects without HSC counterparts range up to $z\sim 4$, significantly higher than that of AKARI objects with HSC counterparts. We find that: (i) 3.6 $-$ 4.5 $\mu$m color, (ii) AGN luminosity, (iii) stellar mass, (iv) star formation rate, and (v) $V$-band dust attenuation in the interstellar medium of AKARI objects without HSC counterparts are systematically larger than those of AKARI objects with counterparts. These results suggest that our sample includes luminous, heavily dust-obscured SFGs/AGNs at $z\sim 1-4$ that are missed by previous optical surveys, providing very interesting targets for the coming James Webb Space Telescope era.


title: Blockchain for Mobile Edge Computing: Consensus Mechanisms and Scalability

abstract: Mobile edge computing (MEC) and next-generation mobile networks are set to disrupt the way intelligent and autonomous systems are interconnected. This will have an effect on a wide range of domains, from the Internet of Things to autonomous mobile robots. The integration of such a variety of MEC services in a inherently distributed architecture requires a robust system for managing hardware resources, balancing the network load and securing the distributed applications. Blockchain technology has emerged a solution for managing MEC services, with consensus protocols and data integrity checks that enable transparent and efficient distributed decision-making. In addition to transparency, the benefits from a security point of view are evident. Nonetheless, blockchain technology faces significant challenges in terms of scalability. In this chapter, we review existing consensus protocols and scalability techniques in both well-established and next-generation blockchain architectures. From this, we evaluate the most suitable solutions for managing MEC services and discuss the benefits and drawbacks of the available alternatives.


title: Stability Analysis using Quadratic Constraints for Systems with Neural Network Controllers

abstract: A method is presented to analyze the stability of feedback systems with neural network controllers. Two stability theorems are given to prove asymptotic stability and to compute an ellipsoidal inner-approximation to the region of attraction (ROA). The first theorem addresses linear time-invariant systems, and merges Lyapunov theory with local (sector) quadratic constraints to bound the nonlinear activation functions in the neural network. The second theorem allows the system to include perturbations such as unmodeled dynamics, slope-restricted nonlinearities, and time delay, using integral quadratic constraint (IQCs) to capture their input/output behavior. This in turn allows for off-by-one IQCs to refine the description of activation functions by capturing their slope restrictions. Both results rely on semidefinite programming to approximate the ROA. The method is illustrated on systems with neural networks trained to stabilize a nonlinear inverted pendulum as well as vehicle lateral dynamics with actuator uncertainty.


title: Modeling Implicit Communities using Spatio-Temporal Point Processes from Geo-tagged Event Traces

abstract: The location check-ins of users through various location-based services such as Foursquare, Twitter, and Facebook Places, etc., generate large traces of geo-tagged events. These event-traces often manifest in hidden (possibly overlapping) communities of users with similar interests. Inferring these implicit communities is crucial for forming user profiles for improvements in recommendation and prediction tasks. Given only time-stamped geo-tagged traces of users, can we find out these implicit communities, and characteristics of the underlying influence network? Can we use this network to improve the next location prediction task? In this paper, we focus on the problem of community detection as well as capturing the underlying diffusion process and propose a model COLAB based on Spatio-temporal point processes in continuous time but discrete space of locations that simultaneously models the implicit communities of users based on their check-in activities, without making use of their social network connections. COLAB captures the semantic features of the location, user-to-user influence along with spatial and temporal preferences of users. To learn the latent community of users and model parameters, we propose an algorithm based on stochastic variational inference. To the best of our knowledge, this is the first attempt at jointly modeling the diffusion process with activity-driven implicit communities. We demonstrate COLAB achieves up to 27% improvements in location prediction task over recent deep point-process based methods on geo-tagged event traces collected from Foursquare check-ins.


title: Mining Implicit Relevance Feedback from User Behavior for Web Question Answering

abstract: Training and refreshing a web-scale Question Answering (QA) system for a multi-lingual commercial search engine often requires a huge amount of training examples. One principled idea is to mine implicit relevance feedback from user behavior recorded in search engine logs. All previous works on mining implicit relevance feedback target at relevance of web documents rather than passages. Due to several unique characteristics of QA tasks, the existing user behavior models for web documents cannot be applied to infer passage relevance. In this paper, we make the first study to explore the correlation between user behavior and passage relevance, and propose a novel approach for mining training data for Web QA. We conduct extensive experiments on four test datasets and the results show our approach significantly improves the accuracy of passage ranking without extra human labeled data. In practice, this work has proved effective to substantially reduce the human labeling cost for the QA service in a global commercial search engine, especially for languages with low resources. Our techniques have been deployed in multi-language services.


title: Spaces of Random Plane Triangulations and the Density of States

abstract: Tiling spaces are constructed using a metric in which two tilings of $\mathbb{R}^n$ are close if and only if, after a small translation, they agree on a large ball around the origin. We construct analogous spaces to study random triangulations of the plane. We construct a continuous space which is a foliated space equipped with a transverse measure, and a discrete space which is a transversal of that space. Measures on these triangulations can be constructed as limits of measures on spheres. We consider von Neumann algebras associated with these spaces. Under certain conditions, we show that the von Neumann algebra associated with the discrete space is a hyperfinite type $II_1$ factor. We also show that the density of states of certain operators is well-behaved with respect to the convergence of measures, and in particular can be computed by approximating it on spheres, where eigenvalues can be directly computed. Additionally, we prove a connection between jumps of the integrated density of states and compactly supported eigenfunctions analogous to arXiv:0709.2836.

categories: math.OA math-ph math.FA math.MG math.MP math.SP