title: Free-space sub-terahertz field-polarization controlled by waveguide-mode-selection

abstract: We study experimentally the free-space electro-magnetic field emitted from a multimode rectangular waveguide equipped with a diagonal-horn antenna. Using the frequency range of 215-580 GHz, a photo-mixer is used to launch a free-space circularly-polarized electro-magnetic field, exciting multiple modes at the input of the rectangular waveguide via an input diagonal-horn antenna. A second photo-mixer is used, together with a silicon mirror Fresnel scatterer, to act as a polarization-sensitive coherent detector to characterize the emitted field. We find that the radiated field, excited by the fundamental waveguide mode, is characterized by a linear polarization. In addition, we find that the polarization of the radiated field rotates by 45 degree if selectively exciting higher-order modes in the waveguide. Despite the higher-order modes, the radiated field appears to maintain a predominant Gaussian beam character, since an unidirectional coupling to a detector was possible, whereas the unidirectionality is independent of the frequency. We discuss a possible application of this finding.


title: A Realistic Simulation Testbed of A Turbocharged Spark-Ignited Engine System: A Platform for the Evaluation of Fault Diagnosis Algorithms and Strategies

abstract: Research on fault diagnosis on highly nonlinear dynamic systems such as the engine of a vehicle have garnered huge interest in recent years, especially with the automotive industry heading towards self-driving technologies. This article presents a novel opensource simulation testbed of a turbocharged spark ignited (TCSI) petrol engine system for testing and evaluation of residuals generation and fault diagnosis methods. Designed and developed using Matlab/Simulink, the user interacts with the testbed using a GUI interface, where the engine can be realistically simulated using industrial-standard driving cycles such as the Worldwide harmonized Light vehicles Test Procedures (WLTP), the New European Driving Cycle (NEDC), the Extra-Urban Driving Cycle (EUDC), and EPA Federal Test Procedure (FTP-75). The engine is modeled using the mean value engine model (MVEM) and is controlled using a proportional-integral (PI)-based boost controller. The GUI interface also allows the user to induce one of the 11 faults of interest, so that their effects on the performance of the engine are better understood. This minimizes the risk of causing permanent damages to the engine and shortening its lifespan, should the tests be conducted onto the actual physical system. This simulation testbed will serve 16 as an excellent platform where researchers can generate critical data to develop and compare current and future research methods for fault diagnosis of automotive engine systems.


title: Admissibility and general dichotomies for evolution families

abstract: For an arbitrary noninvertible evolution family on the half-line and for $\rho \colon [0, \infty)\to [0, \infty)$ in a large class of rate functions, we consider the notion of a $\rho$-dichotomy with respect to a family of norms and characterize it in terms of two admissibility conditions. In particular, our results are applicable to exponential as well as polynomial dichotomies with respect to a family of norms. As a nontrivial application of our work, we establish the robustness of general nonuniform dichotomies.


title: Eliminating Search Intent Bias in Learning to Rank

abstract: Click-through data has proven to be a valuable resource for improving search-ranking quality. Search engines can easily collect click data, but biases introduced in the data can make it difficult to use the data effectively. In order to measure the effects of biases, many click models have been proposed in the literature. However, none of the models can explain the observation that users with different search intent (e.g., informational, navigational, etc.) have different click behaviors. In this paper, we study how differences in user search intent can influence click activities and determined that there exists a bias between user search intent and the relevance of the document relevance. Based on this observation, we propose a search intent bias hypothesis that can be applied to most existing click models to improve their ability to learn unbiased relevance. Experimental results demonstrate that after adopting the search intent hypothesis, click models can better interpret user clicks and substantially improve retrieval performance.


title: Evolution of porous dust grains in protoplanetary discs -- I. Growing grains

abstract: One of the main problems in planet formation, hampering the growth of small dust to planetesimals, is the so-called radial-drift barrier. Pebbles of cm to dm sizes are thought to drift radially across protoplanetary discs faster than they can grow to larger sizes, and thus to be lost to the star. To overcome this barrier, drift has to be slowed down or stopped, or growth needs to be sped up. In this paper, we investigate the role of porosity on both drift and growth. We have developed a model for porosity evolution during grain growth and applied it to numerical simulations of protoplanetary discs. We find that growth is faster for porous grains, enabling them to transition to the Stokes drag regime, decouple from the gas, and survive the radial-drift barrier. Direct formation of small planetesimals from porous dust is possible over large areas of the disc.


title: Asymptotically Optimal Control of a Centralized Dynamic Matching Market with General Utilities

abstract: We consider a matching market where buyers and sellers arrive according to independent Poisson processes at the same rate and independently abandon the market if not matched after an exponential amount of time with the same mean. In this centralized market, the utility for the system manager from matching any buyer and any seller is a general random variable. We consider a sequence of systems indexed by $n$ where the arrivals in the $n^{\mathrm{th}}$ system are sped up by a factor of $n$. We analyze two families of one-parameter policies: the population threshold policy immediately matches an arriving agent to its best available mate only if the number of mates in the system is above a threshold, and the utility threshold policy matches an arriving agent to its best available mate only if the corresponding utility is above a threshold. Using a fluid analysis of the two-dimensional Markov process of buyers and sellers, we show that when the matching utility distribution is light-tailed, the population threshold policy with threshold $\frac{n}{\ln n}$ is asymptotically optimal among all policies that make matches only at agent arrival epochs. In the heavy-tailed case, we characterize the optimal threshold level for both policies. We also study the utility threshold policy in an unbalanced matching market with heavy-tailed matching utilities and find that the buyers and sellers have the same asymptotically optimal utility threshold. We derive optimal thresholds when the matching utility distribution is exponential, uniform, Pareto, and correlated Pareto. We find that as the right tail of the matching utility distribution gets heavier, the threshold level of each policy (and hence market thickness) increases, as does the magnitude by which the utility threshold policy outperforms the population threshold policy.


title: Characterizing Structural Regularities of Labeled Data in Overparameterized Models

abstract: Humans are accustomed to environments that contain both regularities and exceptions. For example, at most gas stations, one pays prior to pumping, but the occasional rural station does not accept payment in advance. Likewise, deep neural networks can generalize across instances that share common patterns or structures, yet have the capacity to memorize rare or irregular forms. We analyze how individual instances are treated by a model via a consistency score. The score characterizes the expected accuracy for a held-out instance given training sets of varying size sampled from the data distribution. We obtain empirical estimates of this score for individual instances in multiple data sets, and we show that the score identifies out-of-distribution and mislabeled examples at one end of the continuum and strongly regular examples at the other end. We identify computationally inexpensive proxies to the consistency score using statistics collected during training. We show examples of potential applications to the analysis of deep-learning systems.


title: Design and Selection of Additional Residuals to Enhance Fault Isolation of a Turbocharged Spark Ignited Engine System

abstract: This paper presents a method to enhance fault isolation without adding physical sensors on a turbocharged spark ignited petrol engine system by designing additional residuals from an initial observer-based residuals setup. The best candidates from all potential additional residuals are selected using the concept of sequential residual generation to ensure best fault isolation performance for the least number of additional residuals required. A simulation testbed is used to generate realistic engine data for the design of the additional residuals and the fault isolation performance is verified using structural analysis method.


title: Transfinite Milnor invariants for 3-manifolds

abstract: In his 1957 paper, John Milnor introduced link invariants which measure the homotopy class of the longitudes of a link relative to the lower central series of the link group. Consequently, these invariants determine the lower central series quotients of the link group. This work has driven decades of research with profound influence. One of Milnor's original problems remained unsolved: to extract similar invariants from the transfinite lower central series of the link group. We reformulate and extend Milnor's invariants in the broader setting of 3-manifolds, with his original invariants as special cases. We present a solution to Milnor's problem for general 3-manifold groups, developing a theory of transfinite invariants and realizing nontrivial values.


title: Affine Combination of Diffusion Strategies over Networks

abstract: Diffusion adaptation is a powerful strategy for distributed estimation and learning over networks. Motivated by the concept of combining adaptive filters, this work proposes a combination framework that aggregates the operation of multiple diffusion strategies for enhanced performance. By assigning a combination coefficient to each node, and using an adaptation mechanism to minimize the network error, we obtain a combined diffusion strategy that benefits from the best characteristics of all component strategies simultaneously in terms of excess-mean-square error (EMSE). Analyses of the universality are provided to show the superior performance of affine combination scheme and to characterize its behavior in the mean and mean-square sense. Simulation results are presented to demonstrate the effectiveness of the proposed strategies, as well as the accuracy of theoretical findings.


title: Measuring Nuclear Matter Parameters with NICER and LIGO/Virgo

abstract: The NICER Collaboration recently reported the measurement of the mass and radius of a pulsar PSR J0030+0451. We here use this new measurement to constrain one of the higher-order nuclear matter parameters $K_{\mathrm{sym,0}}$. We further combine the tidal measurement of the binary neutron star merger GW170817 by LIGO/Virgo to derive a joint 1-$\sigma$ constraint as $K_{\mathrm{sym,0}} = -102^{+71}_{-72}$ MeV. We believe this is the most reliable bound on the parameter to date under the assumption that there is no new physics above the saturation density which impacts neutron star observations.


title: Appreciating the variety of goals in computational neuroscience

abstract: Within computational neuroscience, informal interactions with modelers often reveal wildly divergent goals. In this opinion piece, we explicitly address the diversity of goals that motivate and ultimately influence modeling efforts. We argue that a wide range of goals can be meaningfully taken to be of highest importance. A simple informal survey conducted on the Internet confirmed the diversity of goals in the community. However, different priorities or preferences of individual researchers can lead to divergent model evaluation criteria. We propose that many disagreements in evaluating the merit of computational research stem from differences in goals and not from the mechanics of constructing, describing, and validating models. We suggest that authors state explicitly their goals when proposing models so that others can judge the quality of the research with respect to its stated goals.


title: Invariant Hopping Attacks on Block Ciphers

abstract: Block ciphers are in widespread use since the 1970s. Their iterated structure is prone to numerous round invariant attacks for example in Linear Cryptanalysis (LC). The next step is to look at non-linear polynomial invariants cf. Eurocrypt'95. Until recently, researchers have found extremely few such attacks, with some impossibility results. Eventually recent papers show how to construct polynomial invariant attacks for block ciphers, however many such results were of degree 2. In this paper we propose a new incremental methodology for constructing high degree polynomial invariant attacks on block ciphers. A trivial attack on one cipher setup will be transposed to show the existence of a more advanced attack on a stronger cipher in several steps. The key tool is the manipulation of the roots of the so called Fundamental Equation. Examples are constructed with an old historical block cipher T-310.


title: Curvature of Feasible Sets in Offline and Online Optimization

abstract: It is known that the curvature of the feasible set in convex optimization allows for algorithms with better convergence rates, and there has been renewed interest in this topic both for offline as well as online problems. In this paper, leveraging results on geometry and convex analysis, we further our understanding of the role of curvature in optimization: - We first show the equivalence of two notions of curvature, namely strong convexity and gauge bodies, proving a conjecture of Abernethy et al. As a consequence, this show that the Frank-Wolfe-type method of Wang and Abernethy has accelerated convergence rate $O(\frac{1}{t^2})$ over strongly convex feasible sets without additional assumptions on the (convex) objective function. - In Online Linear Optimization, we identify two main properties that help explaining \emph{why/when} Follow the Leader (FTL) has only logarithmic regret over strongly convex sets. This allows one to directly recover a recent result of Huang et al., and to show that FTL has logarithmic regret over strongly convex sets whenever the gain vectors are non-negative. - We provide an efficient procedure for approximating convex bodies by strongly convex ones while smoothly trading off approximation error and curvature. This allows one to extend the improved algorithms over strongly convex sets to general convex sets. As a concrete application, we extend the results of Dekel et al. on Online Linear Optimization with Hints to general convex sets.


title: DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection

abstract: Digital receivers are required to recover the transmitted symbols from their observed channel output. In multiuser multiple-input multiple-output (MIMO) setups, where multiple symbols are simultaneously transmitted, accurate symbol detection is challenging. A family of algorithms capable of reliably recovering multiple symbols is based on interference cancellation. However, these methods assume that the channel is linear, a model which does not reflect many relevant channels, as well as require accurate channel state information (CSI), which may not be available. In this work we propose a multiuser MIMO receiver which learns to jointly detect in a data-driven fashion, without assuming a specific channel model or requiring CSI. In particular, we propose a data-driven implementation of the iterative soft interference cancellation (SIC) algorithm which we refer to as DeepSIC. The resulting symbol detector is based on integrating dedicated machine-learning (ML) methods into the iterative SIC algorithm. DeepSIC learns to carry out joint detection from a limited set of training samples without requiring the channel to be linear and its parameters to be known. Our numerical evaluations demonstrate that for linear channels with full CSI, DeepSIC approaches the performance of iterative SIC, which is comparable to the optimal performance, and outperforms previously proposed ML-based MIMO receivers. Furthermore, in the presence of CSI uncertainty, DeepSIC significantly outperforms model-based approaches. Finally, we show that DeepSIC accurately detects symbols in non-linear channels, where conventional iterative SIC fails even when accurate CSI is available.


title: Observation of a charge-2 photonic Weyl point in the infrared

abstract: Weyl points are robust point degeneracies in the band structure of a periodic material, which act as monopoles of Berry curvature. They have been at the forefront of research in three-dimensional topological materials (whether photonic, electronic or otherwise) as they are associated with novel behavior both in the bulk and on the surface. Here, we present the experimental observation of a charge-2 photonic Weyl point in a low-index-contrast photonic crystal fabricated by two-photon polymerization. The reflection spectrum obtained via Fourier Transform Infrared (FTIR) spectroscopy closely matches simulations and shows two bands with quadratic dispersion around a point degeneracy. This work provides a launching point towards all-dielectric, low-contrast three-dimensional photonic topological devices.


title: Automatic Extraction and Sign Determination of Respiratory Signal in Real-time Cardiac Magnetic Resonance imaging

abstract: In real-time (RT) cardiac cine imaging, a stack of 2D slices is collected sequentially under free-breathing conditions. A complete heartbeat from each slice is then used for cardiac function quantification. The inter-slice respiratory mismatch can compromise accurate quantification of cardiac function. Methods based on principal components analysis (PCA) have been proposed to extract the respiratory signal from RT cardiac cine, but these methods cannot resolve the inter-slice sign ambiguity of the respiratory signal. In this work, we propose a fully automatic sign correction procedure based on the similarity of neighboring slices and correlation to the center-of-mass curve. The proposed method is evaluated in eleven volunteers, with ten slices per volunteer. The motion in a manually selected region-of-interest (ROI) is used as a reference. The results show that the extracted respiratory signal has a high, positive correlation with the reference in all cases. The qualitative assessment of images also shows that the proposed approach can accurately identify heartbeats, one from each slice, belonging to the same respiratory phase. This approach can improve cardiac function quantification for RT cine without manual intervention.


title: Inference for Batched Bandits

abstract: As bandit algorithms are increasingly utilized in scientific studies and industrial applications, there is an associated increasing need for reliable inference methods based on the resulting adaptively-collected data. In this work, we develop methods for inference on data collected in batches using a bandit algorithm. We first prove that the ordinary least squares estimator (OLS), which is asymptotically normal on independently sampled data, is not asymptotically normal on data collected using standard bandit algorithms when there is no unique optimal arm. This asymptotic non-normality result implies that the naive assumption that the OLS estimator is approximately normal can lead to Type-1 error inflation and confidence intervals with below-nominal coverage probabilities. Second, we introduce the Batched OLS estimator (BOLS) that we prove is (1) asymptotically normal on data collected from both multi-arm and contextual bandits and (2) robust to non-stationarity in the baseline reward.


title: Conservative Exploration in Reinforcement Learning

abstract: While learning in an unknown Markov Decision Process (MDP), an agent should trade off exploration to discover new information about the MDP, and exploitation of the current knowledge to maximize the reward. Although the agent will eventually learn a good or optimal policy, there is no guarantee on the quality of the intermediate policies. This lack of control is undesired in real-world applications where a minimum requirement is that the executed policies are guaranteed to perform at least as well as an existing baseline. In this paper, we introduce the notion of conservative exploration for average reward and finite horizon problems. We present two optimistic algorithms that guarantee (w.h.p.) that the conservative constraint is never violated during learning. We derive regret bounds showing that being conservative does not hinder the learning ability of these algorithms.


title: Exocentric to Egocentric Image Generation via Parallel Generative Adversarial Network

abstract: Cross-view image generation has been recently proposed to generate images of one view from another dramatically different view. In this paper, we investigate exocentric (third-person) view to egocentric (first-person) view image generation. This is a challenging task since egocentric view sometimes is remarkably different from exocentric view. Thus, transforming the appearances across the two views is a non-trivial task. To this end, we propose a novel Parallel Generative Adversarial Network (P-GAN) with a novel cross-cycle loss to learn the shared information for generating egocentric images from exocentric view. We also incorporate a novel contextual feature loss in the learning procedure to capture the contextual information in images. Extensive experiments on the Exo-Ego datasets show that our model outperforms the state-of-the-art approaches.


title: Auto-equivalences of the modular tensor categories of type $A$, $B$, $C$ and $G$

abstract: We compute the monoidal and braided auto-equivalences of the modular tensor categories $\mathcal{C}(\mathfrak{sl}_{r+1},k)$, $\mathcal{C}(\mathfrak{so}_{2r+1},k)$, $\mathcal{C}(\mathfrak{sp}_{2r},k)$, and $\mathcal{C}(\mathfrak{g}_{2},k)$. Along with the expected simple current auto-equivalences, we show the existence of the charge conjugation auto-equivalence of $\mathcal{C}(\mathfrak{sl}_{r+1},k)$, and exceptional auto-equivalences of $\mathcal{C}(\mathfrak{so}_{2r+1},2)$, $\mathcal{C}(\mathfrak{sp}_{2r},r)$, $\mathcal{C}(\mathfrak{g}_{2},4)$. We end the paper with a section discussing potential applications of these computations.


title: Improved Algorithms for Conservative Exploration in Bandits

abstract: In many fields such as digital marketing, healthcare, finance, and robotics, it is common to have a well-tested and reliable baseline policy running in production (e.g., a recommender system). Nonetheless, the baseline policy is often suboptimal. In this case, it is desirable to deploy online learning algorithms (e.g., a multi-armed bandit algorithm) that interact with the system to learn a better/optimal policy under the constraint that during the learning process the performance is almost never worse than the performance of the baseline itself. In this paper, we study the conservative learning problem in the contextual linear bandit setting and introduce a novel algorithm, the Conservative Constrained LinUCB (CLUCB2). We derive regret bounds for CLUCB2 that match existing results and empirically show that it outperforms state-of-the-art conservative bandit algorithms in a number of synthetic and real-world problems. Finally, we consider a more realistic constraint where the performance is verified only at predefined checkpoints (instead of at every step) and show how this relaxed constraint favorably impacts the regret and empirical performance of CLUCB2.


title: SUOD: Toward Scalable Unsupervised Outlier Detection

abstract: Outlier detection is a key field of machine learning for identifying abnormal data objects. Due to the high expense of acquiring ground truth, unsupervised models are often chosen in practice. To compensate for the unstable nature of unsupervised algorithms, practitioners from high-stakes fields like finance, health, and security, prefer to build a large number of models for further combination and analysis. However, this poses scalability challenges in high-dimensional large datasets. In this study, we propose a three-module acceleration framework called SUOD to expedite the training and prediction with a large number of unsupervised detection models. SUOD's Random Projection module can generate lower subspaces for high-dimensional datasets while reserving their distance relationship. Balanced Parallel Scheduling module can forecast the training and prediction cost of models with high confidence---so the task scheduler could assign nearly equal amount of taskload among workers for efficient parallelization. SUOD also comes with a Pseudo-supervised Approximation module, which can approximate fitted unsupervised models by lower time complexity supervised regressors for fast prediction on unseen data. It may be considered as an unsupervised model knowledge distillation process. Notably, all three modules are independent with great flexibility to "mix and match"; a combination of modules can be chosen based on use cases. Extensive experiments on more than 30 benchmark datasets have shown the efficacy of SUOD, and a comprehensive future development plan is also presented.


title: Conjoined Dirichlet Process

abstract: Biclustering is a class of techniques that simultaneously clusters the rows and columns of a matrix to sort heterogeneous data into homogeneous blocks. Although many algorithms have been proposed to find biclusters, existing methods suffer from the pre-specification of the number of biclusters or place constraints on the model structure. To address these issues, we develop a novel, non-parametric probabilistic biclustering method based on Dirichlet processes to identify biclusters with strong co-occurrence in both rows and columns. The proposed method utilizes dual Dirichlet process mixture models to learn row and column clusters, with the number of resulting clusters determined by the data rather than pre-specified. Probabilistic biclusters are identified by modeling the mutual dependence between the row and column clusters. We apply our method to two different applications, text mining and gene expression analysis, and demonstrate that our method improves bicluster extraction in many settings compared to existing approaches.


title: Detecting, identifying, and localizing radiological material in urban environments using scan statistics

abstract: A method is proposed, based on scan statistics, to detect, identify, and localize illicit radiological material using mobile sensors in an urban environment. Our method handles varying levels of background radiation that change according to an (unknown) environment. Our method can accurately determine if a source is present along a street segment as well as identify which of six possible sources generated the radiation. Our method can also localize the source, when detected, to within a few seconds. We have presented our results across a range of decision thresholds allowing stakeholders to evaluate the performance at different false alarm rates. Due to the simplicity of our approach, our models can be trained in a few minutes with very little training data and holds the potential to score a run in real-time. Our method was one of the top performing submissions in the 'Detecting Radiological Threats in Urban Areas' competition.


title: Convolutional Framework for Accelerated Magnetic Resonance Imaging

abstract: Magnetic Resonance Imaging (MRI) is a noninvasive imaging technique that provides exquisite soft-tissue contrast without using ionizing radiation. The clinical application of MRI may be limited by long data acquisition times; therefore, MR image reconstruction from highly undersampled k-space data has been an active area of research. Many works exploit rank deficiency in a Hankel data matrix to recover unobserved k-space samples; the resulting problem is non-convex, so the choice of numerical algorithm can significantly affect performance, computation, and memory. We present a simple, scalable approach called Convolutional Framework (CF). We demonstrate the feasibility and versatility of CF using measured data from 2D, 3D, and dynamic applications.


title: Free-breathing Cardiovascular MRI Using a Plug-and-Play Method with Learned Denoiser

abstract: Cardiac magnetic resonance imaging (CMR) is a noninvasive imaging modality that provides a comprehensive evaluation of the cardiovascular system. The clinical utility of CMR is hampered by long acquisition times, however. In this work, we propose and validate a plug-and-play (PnP) method for CMR reconstruction from undersampled multi-coil data. To fully exploit the rich image structure inherent in CMR, we pair the PnP framework with a deep learning (DL)-based denoiser that is trained using spatiotemporal patches from high-quality, breath-held cardiac cine images. The resulting "PnP-DL" method iterates over data consistency and denoising subroutines. We compare the reconstruction performance of PnP-DL to that of compressed sensing (CS) using eight breath-held and ten real-time (RT) free-breathing cardiac cine datasets. We find that, for breath-held datasets, PnP-DL offers more than one dB advantage over commonly used CS methods. For RT free-breathing datasets, where ground truth is not available, PnP-DL receives higher scores in qualitative evaluation. The results highlight the potential of PnP-DL to accelerate RT CMR.


title: Local times and Tanaka--Meyer formulae for c\`adl\`ag paths

abstract: Three concepts of local times for deterministic c{\`a}dl{\`a}g paths are developed and the corresponding pathwise Tanaka--Meyer formulae are provided. For semimartingales, it is shown that their sample paths a.s. satisfy all three pathwise definitions of local times and that all coincide with the classical semimartingale local time. In particular, this demonstrates that each definition constitutes a legit pathwise counterpart of probabilistic local times. The last pathwise construction presented in the paper expresses local times in terms of normalized numbers of interval crossings and does not depend on the choice of the sequence of grids. This is a new result also for c{\`a}dl{\`a}g semimartingales, which may be related to previous results of Nicole El~Karoui and Marc Lemieux.


title: Intrinsic Dimension Estimation via Nearest Constrained Subspace Classifier

abstract: We consider the problems of classification and intrinsic dimension estimation on image data. A new subspace based classifier is proposed for supervised classification or intrinsic dimension estimation. The distribution of the data in each class is modeled by a union of of a finite number ofaffine subspaces of the feature space. The affine subspaces have a common dimension, which is assumed to be much less than the dimension of the feature space. The subspaces are found using regression based on the L0-norm. The proposed method is a generalisation of classical NN (Nearest Neighbor), NFL (Nearest Feature Line) classifiers and has a close relationship to NS (Nearest Subspace) classifier. The proposed classifier with an accurately estimated dimension parameter generally outperforms its competitors in terms of classification accuracy. We also propose a fast version of the classifier using a neighborhood representation to reduce its computational complexity. Experiments on publicly available datasets corroborate these claims.


title: Supervised Quantile Normalization for Low-rank Matrix Approximation

abstract: Low rank matrix factorization is a fundamental building block in machine learning, used for instance to summarize gene expression profile data or word-document counts. To be robust to outliers and differences in scale across features, a matrix factorization step is usually preceded by ad-hoc feature normalization steps, such as \texttt{tf-idf} scaling or data whitening. We propose in this work to learn these normalization operators jointly with the factorization itself. More precisely, given a $d\times n$ matrix $X$ of $d$ features measured on $n$ individuals, we propose to learn the parameters of quantile normalization operators that can operate row-wise on the values of $X$ and/or of its factorization $UV$ to improve the quality of the low-rank representation of $X$ itself. This optimization is facilitated by the introduction of a new differentiable quantile normalization operator built using optimal transport, providing new results on top of existing work by (Cuturi et al. 2019). We demonstrate the applicability of these techniques on synthetic and genomics datasets.


title: Hierarchical Generation of Molecular Graphs using Structural Motifs

abstract: Graph generation techniques are increasingly being adopted for drug discovery. Previous graph generation approaches have utilized relatively small molecular building blocks such as atoms or simple cycles, limiting their effectiveness to smaller molecules. Indeed, as we demonstrate, their performance degrades significantly for larger molecules. In this paper, we propose a new hierarchical graph encoder-decoder that employs significantly larger and more flexible graph motifs as basic building blocks. Our encoder produces a multi-resolution representation for each molecule in a fine-to-coarse fashion, from atoms to connected motifs. Each level integrates the encoding of constituents below with the graph at that level. Our autoregressive coarse-to-fine decoder adds one motif at a time, interleaving the decision of selecting a new motif with the process of resolving its attachments to the emerging molecule. We evaluate our model on multiple molecule generation tasks, including polymers, and show that our model significantly outperforms previous state-of-the-art baselines.


title: Soft Threshold Weight Reparameterization for Learnable Sparsity

abstract: Sparsity in Deep Neural Networks (DNNs) is studied extensively with the focus of maximizing prediction accuracy given an overall parameter budget. Existing methods rely on uniform or heuristic non-uniform sparsity budgets which have sub-optimal layer-wise parameter allocation resulting in a) lower prediction accuracy or b) higher inference cost (FLOPs). This work proposes Soft Threshold Reparameterization (STR), a novel use of the soft-threshold operator on DNN weights. STR smoothly induces sparsity while learning pruning thresholds thereby obtaining a non-uniform sparsity budget. Our method achieves state-of-the-art accuracy for unstructured sparsity in CNNs (ResNet50 and MobileNetV1 on ImageNet-1K), and, additionally, learns non-uniform budgets that empirically reduce the FLOPs by up to 50%. Notably, STR boosts the accuracy over existing results by up to 10% in the ultra sparse (99%) regime and can also be used to induce low-rank (structured sparsity) in RNNs. In short, STR is a simple mechanism which learns effective sparsity budgets that contrast with popular heuristics. Code, pretrained models and sparsity budgets are at https://github.com/RAIVNLab/STR.


title: p-Adic distribution of CM points and Hecke orbits. I. Convergence towards the Gauss point

abstract: We study the asymptotic distribution of CM points on the moduli space of elliptic curves over $\mathbb{C}_p$, as the discriminant of the underlying endomorphism ring varies. In contrast with the complex case, we show that there is no uniform distribution. In this paper we characterize all the sequences of discriminants for which the corresponding CM points converge towards the Gauss point of the Berkovich affine line. We also give an analogous characterization for Hecke orbits. In the companion paper we characterize all the remaining limit measures of CM points and Hecke orbits.


title: Five open problems in quantum information

abstract: We identify five selected open problems in the theory of quantum information, which are rather simple to formulate, were well-studied in the literature, but are technically not easy. As these problems enjoy diverse mathematical connections, they offer a huge breakthrough potential. The first four concern existence of certain objects relevant for quantum information, namely a family of symmetric informationally complete generalized measurements in an infinite sequence of dimensions, mutually unbiased bases in dimension six, absolutely maximally entangled states for four subsystems with six levels each and bound entangled states with negative partial transpose. The fifth problem requires checking whether a certain state of a two-ququart system is 2-copy distillable. An award for solving each of them is announced.


title: The dissipation-time uncertainty relation

abstract: We show that the dissipation rate bounds the rate at which physical processes can be performed in stochastic systems far from equilibrium. Namely, for rare processes we prove the fundamental tradeoff $\langle \dot S_\text{e} \rangle \mathcal{T} \geq k_{\text{B}} $ between the entropy flow $\langle \dot S_\text{e} \rangle$ into the reservoirs and the mean time $\mathcal{T}$ to complete a process. This dissipation-time uncertainty relation is a novel form of speed limit: the smaller the dissipation, the larger the time to perform a process.

categories: cond-mat.stat-mech cond-mat.soft nlin.CD physics.bio-ph


title: An internal fraud model for operational losses in retail banking

abstract: This paper develops a dynamic internal fraud model for operational losses in retail banking. It considers public operational losses arising from internal fraud in retail banking within a group of international banks. Additionally, the model takes into account internal factors such as the ethical quality of workers and the risk controls set by bank managers. The model is validated by measuring the impact of macroeconomic indicators such as GDP growth and the corruption perception upon the severity and frequency of losses implied by the model. In general,results show that internal fraud losses are pro-cyclical, and that country specific corruption perceptions positively affects internal fraud losses. Namely, when a country is perceived to be more corrupt, retail banking in that country will feature more severe internal fraud losses.


title: Tactile Dexterity: Manipulation Primitives with Tactile Feedback

abstract: This paper develops closed-loop tactile controllers for dexterous robotic manipulation with a dual-palm robotic system. Tactile dexterity is an approach to dexterous manipulation that plans for robot/object interactions that render interpretable tactile information for control. We divide the role of tactile control into two goals: 1) control the contact state between the end-effector and the object (contact/no-contact, stick/slip) by regulating the stability of planned contact configurations and monitoring undesired slip events; and 2) control the object state by tactile-based tracking and iterative replanning of the object and robot trajectories. Key to this formulation is the decomposition of manipulation plans into sequences of manipulation primitives with simple mechanics and efficient planners. We consider the scenario of manipulating an object from an initial pose to a target pose on a flat surface while correcting for external perturbations and uncertainty in the initial pose of the object. We experimentally validate the approach with an ABB YuMi dual-arm robot and demonstrate the ability of the tactile controller to react to external perturbations.


title: Learning CHARME models with neural networks

abstract: In this paper, we consider a model called CHARME (Conditional Heteroscedastic Autoregressive Mixture of Experts), a class of generalized mixture of nonlinear nonparametric AR-ARCH time series. Under certain Lipschitz-type conditions on the autoregressive and volatility functions, we prove that this model is stationary, ergodic and $\tau$-weakly dependent. These conditions are much weaker than those presented in the literature that treats this model. Moreover, this result forms the theoretical basis for deriving an asymptotic theory of the underlying (non)parametric estimation, which we present for this model. As an application, from the universal approximation property of neural networks (NN), we develop a learning theory for the NN-based autoregressive functions of the model, where the strong consistency and asymptotic normality of the considered estimator of the NN weights and biases are guaranteed under weak conditions.


title: Multi-Label Class Balancing Algorithm for Action Unit Detection

abstract: Isolated facial movements, so-called Action Units, can describe combined emotions or physical states such as pain. As datasets are limited and mostly imbalanced, we present an approach incorporating a multi-label class balancing algorithm. This submission is subject to the Action Unit detection task of the Affective Behavior Analysis in-the-wild (ABAW) challenge at the IEEE Conference on Face and Gesture Recognition 2020.


title: Curse of Dimensionality on Randomized Smoothing for Certifiable Robustness

abstract: Randomized smoothing, using just a simple isotropic Gaussian distribution, has been shown to produce good robustness guarantees against $\ell_2$-norm bounded adversaries. In this work, we show that extending the smoothing technique to defend against other attack models can be challenging, especially in the high-dimensional regime. In particular, for a vast class of i.i.d.~smoothing distributions, we prove that the largest $\ell_p$-radius that can be certified decreases as $O(1/d^{\frac{1}{2} - \frac{1}{p}})$ with dimension $d$ for $p > 2$. Notably, for $p \geq 2$, this dependence on $d$ is no better than that of the $\ell_p$-radius that can be certified using isotropic Gaussian smoothing, essentially putting a matching lower bound on the robustness radius. When restricted to {\it generalized} Gaussian smoothing, these two bounds can be shown to be within a constant factor of each other in an asymptotic sense, establishing that Gaussian smoothing provides the best possible results, up to a constant factor, when $p \geq 2$. We present experimental results on CIFAR to validate our theory. For other smoothing distributions, such as, a uniform distribution within an $\ell_1$ or an $\ell_\infty$-norm ball, we show upper bounds of the form $O(1 / d)$ and $O(1 / d^{1 - \frac{1}{p}})$ respectively, which have an even worse dependence on $d$.


title: Multi-task Reinforcement Learning with a Planning Quasi-Metric

abstract: We introduce a new reinforcement learning approach combining a planning quasi-metric (PQM) that estimates the number of steps required to go from any state to another, with task-specific "aimers" that compute a target state to reach a given goal. This decomposition allows the sharing across tasks of a task-agnostic model of the quasi-metric that captures the environment's dynamics and can be learned in a dense and unsupervised manner. We achieve multiple-fold training speed-up compared to recently published methods on the standard bit-flip problem and in the MuJoCo robotic arm simulator.


title: Ensemble of Deep Convolutional Neural Networks for Automatic Pavement Crack Detection and Measurement

abstract: Automated pavement crack detection and measurement are important road issues. Agencies have to guarantee the improvement of road safety. Conventional crack detection and measurement algorithms can be extremely time-consuming and low efficiency. Therefore, recently, innovative algorithms have received increased attention from researchers. In this paper, we propose an ensemble of convolutional neural networks (without a pooling layer) based on probability fusion for automated pavement crack detection and measurement. Specifically, an ensemble of convolutional neural networks was employed to identify the structure of small cracks with raw images. Secondly, outputs of the individual convolutional neural network model for the ensemble were averaged to produce the final crack probability value of each pixel, which can obtain a predicted probability map. Finally, the predicted morphological features of the cracks were measured by using the skeleton extraction algorithm. To validate the proposed method, some experiments were performed on two public crack databases (CFD and AigleRN) and the results of the different state-of-the-art methods were compared. The experimental results show that the proposed method outperforms the other methods. For crack measurement, the crack length and width can be measure based on different crack types (complex, common, thin, and intersecting cracks.). The results show that the proposed algorithm can be effectively applied for crack measurement.


title: Microtomography on the ANATOMIX beamline at Synchrotron SOLEIL

abstract: The ANATOMIX beamline at Synchrotron SOLEIL, operational since 2018, is dedicated to hard X-ray full-field tomography techniques. Operating in a range of photon energies from approximately 5 to 50 keV, it offers both parallel-beam projection microtomography, in absorption and phase contrast, and nanotomography using a zone-plate transmission X-ray microscope. With these methods, the beamline covers a range of spatial resolution from 20 nm to 20 $\mu$m, expressed in terms of useful pixel size. The variable beam size of up to 40 mm allows users to image large objects. Here we describe the microtomography instrumentation of the beamline.


title: Sp-equivariant modules over polynomial rings in infinitely many variables

abstract: We study the category of Sp-equivariant modules over the infinite variable polynomial ring, where Sp denotes the infinite symplectic group. We establish a number of results about this category: for instance, we show that every finitely generated module M fits into an exact triangle $T \to M \to F \to$ where T is a finite length complex of torsion modules and F is a finite length complex of "free" modules; we determine the Grothendieck group; and we (partially) determine the structure of injective modules. We apply these results to show that the twisted commutative algebras ${\rm Sym}({\bf C}^{\infty} \oplus \bigwedge^2{\bf C}^{\infty})$ and ${\rm Sym}({\bf C}^{\infty} \oplus {\rm Sym}^2{\bf C}^{\infty})$ are noetherian, which are the strongest results to date of this kind. We also show that the free 2-step nilpotent twisted Lie algebra and Lie superalgebra are noetherian.


title: Multi-Objective Molecule Generation using Interpretable Substructures

abstract: Drug discovery aims to find novel compounds with specified chemical property profiles. In terms of generative modeling, the goal is to learn to sample molecules in the intersection of multiple property constraints. This task becomes increasingly challenging when there are many property constraints. We propose to offset this complexity by composing molecules from a vocabulary of substructures that we call molecular rationales. These rationales are identified from molecules as substructures that are likely responsible for each property of interest. We then learn to expand rationales into a full molecule using graph generative models. Our final generative model composes molecules as mixtures of multiple rationale completions, and this mixture is fine-tuned to preserve the properties of interest. We evaluate our model on various drug design tasks and demonstrate significant improvements over state-of-the-art baselines in terms of accuracy, diversity, and novelty of generated compounds.


title: Nonlinear Stability of Periodic-Wave Solutions for Systems of Dispersive Equations

abstract: We prove the orbital stability of periodic traveling-wave solutions for systems of dispersive equations with coupled nonlinear terms. Our method is basically developed under two assumptions: one concerning the spectrum of the linearized operator around the traveling wave and another one concerning the existence of a conserved quantity with suitable properties. The method can be applied to several systems such as the Liu-Kubota-Ko system, the modified KdV system and a log-KdV type system.


title: SPA: Verbal Interactions between Agents and Avatars in Shared Virtual Environments using Propositional Planning

abstract: We present a novel approach for generating plausible verbal interactions between virtual human-like agents and user avatars in shared virtual environments. Sense-Plan-Ask, or SPA, extends prior work in propositional planning and natural language processing to enable agents to plan with uncertain information, and leverage question and answer dialogue with other agents and avatars to obtain the needed information and complete their goals. The agents are additionally able to respond to questions from the avatars and other agents using natural-language enabling real-time multi-agent multi-avatar communication environments. Our algorithm can simulate tens of virtual agents at interactive rates interacting, moving, communicating, planning, and replanning. We find that our algorithm creates a small runtime cost and enables agents to complete their goals more effectively than agents without the ability to leverage natural-language communication. We demonstrate quantitative results on a set of simulated benchmarks and detail the results of a preliminary user-study conducted to evaluate the plausibility of the virtual interactions generated by SPA. Overall, we find that participants prefer SPA to prior techniques in 84\% of responses including significant benefits in terms of the plausibility of natural-language interactions and the positive impact of those interactions.


title: Propulsion of Spacecrafts to Relativistic Speeds Using Natural Astrophysical Sources

abstract: In this paper, we explore from a conceptual standpoint the possibility of using natural astrophysical sources to accelerate spacecrafts to relativistic speeds. We focus on light sails and electric sails, which are reliant on momentum transfer from photons and protons, respectively, because these two classes of spacecrafts are not required to carry fuel on board. The payload is assumed to be stationed near the astrophysical source, and the sail is subsequently unfolded and activated when the source is functional. By considering a number of astrophysical objects such as massive stars, microquasars, supernovae, pulsar wind nebulae, and active galactic nuclei, we show that terminal speeds approaching the speed of light might be realizable under idealized circumstances provided that sufficiently advanced sail materials and control techniques exist. We also investigate the constraints arising from the sail's material properties, the voyage through the ambient source environment, and the passage through the interstellar medium. While all of these considerations pose significant challenges to spacecrafts, our analysis indicates that they are not insurmountable in optimal conditions. Finally, we sketch the implications for carrying out future technosignature searches.

categories: astro-ph.IM astro-ph.EP astro-ph.HE physics.space-ph


title: Implications of Abiotic Oxygen Buildup for Earth-like Complex Life

abstract: One of the chief paradoxes of molecular oxygen (O$_2$) is that it is an essential requirement for multicellular eukaryotes on Earth while simultaneously posing a threat to their survival via the formation of reactive oxygen species. In this paper, the constraints imposed by O$_2$ on Earth-like complex life are invoked to explore whether worlds with abiotic O$_2$ inventories can harbor such organisms. By taking the major O$_2$ sources and sinks of Earth-like planets into account using a simple model, it is suggested that worlds that receive time-averaged X-ray and extreme ultraviolet fluxes that are $\gtrsim 10$ times higher than Earth might not be capable of hosting complex lifeforms because the photolysis of molecules such as water may lead to significant O$_2$ buildup. Methods for testing this hypothesis by searching for anticorrelations between biosignatures and indicators of abiotic O$_2$ atmospheres are described. In the event, however, that life successfully adapts to high-oxygen environments, these worlds could permit the evolution of large and complex organisms.


title: Fisher-information-based estimation of optomechanical coupling strengths

abstract: The formalism of quantum estimation theory, focusing on the quantum and classical Fisher information, is applied to the estimation of the coupling strength in an optomechanical system. In order to estimate the optomechanical coupling, we have considered a cavity optomechanical model with non-Markovian Brownian motion of the mirror and employed input-output formalism to obtain the cavity output field. Our estimation scenario is based on balanced homodyne photodetection of the cavity output field. We have explored the difference between the associated measurement-dependent classical Fisher information and the quantum Fisher information, thus addressing the question of whether it is possible to reach the lower bound of the mean squared error of an unbiased estimator by means of balanced homodyne detection. We have found that the phase of the local oscillator in the homodyne detection is crucial; certain quadrature measurements allow very accurate estimation.


title: Logarithmic Integrals: A Review from Gradshteyn and Ryzhik to Recent Times

abstract: The need to evaluate Logarithmic integrals is ubiquitous in essentially all quantitative areas including mathematical sciences, physical sciences. Some recent developments in Physics namely Feynman diagrams deals with the evaluation of complicated integrals involving logarithmic functions. This work deals with a systematic review of logarithmic integrals starting from Malmsten integrals to classical collection of Integrals, Series and Products by I. S. Gradshteyn and I. M. Ryzhik [1] to recent times. The evaluation of these types of integrals involves higher transcendental functions (i.e., Hurwitz Zeta function, Polylogarithms, Lerch Transcendental, Orthogonal Polynomials, PolyGamma functions). In a more general sense the following types of integrals are considered for this work: \begin{align*} \int_{0}^{a} f(x) \ln{\{g(x)\}} \ dx \end{align*} with $a \in R^{+}$ , $f(x)$ and $g(x)$ both either rational/trigonometric or both type of functions.


title: A comparison of Bayesian accelerated failure time models with spatially varying coefficients

abstract: The accelerated failure time (AFT) model is a commonly used tool in analyzing survival data. In public health studies, data is often collected from medical service providers in different locations. Survival rates from different locations often present geographically varying patterns. In this paper, we focus on the accelerated failure time model with spatially varying coefficients. We compare three types of the priors for spatially varying coefficients. A model selection criterion, logarithm of the pseudo-marginal likelihood (LPML), is developed to assess the fit of AFT model with different priors. Extensive simulation studies are carried out to examine the empirical performance of the proposed methods. Finally, we apply our model to SEER data on prostate cancer in Louisiana and demonstrate the existence of spatially varying effects on survival rates from prostate cancer data.


title: Distributed Bayesian: a continuous Distributed Constraint Optimization Problem solver

abstract: In this work, the novel Distributed Bayesian (D-Bay) algorithm is presented for solving multi-agent problems within the continuous Distributed Constraint Optimization Problem (DCOP) framework. This framework extends the classical DCOP framework towards utility functions with continuous domains. Traditional DCOP solvers discretize the continuous domains, which increases the problem size exponentially. D-Bay overcomes this problem by utilizing Bayesian optimization for the adaptive sampling of variables to avoid discretization entirely. We theoretically show that D-Bay converges to the global optimum of the DCOP for Lipschitz continuous utility functions. The performance of the algorithm is evaluated empirically based on the sample efficiency. The proposed algorithm is compared to a centralized approach with equidistant discretization of the continuous domains for the sensor coordination problem. We find that our algorithm generates better solutions while requiring less samples.


title: Real positive maps and conditional expectations on operator algebras

abstract: Most of this article is an expanded version of our conference talk. It is essentially a survey, but some part, like most of the lengthy Section 5, is comprised of new results whose proofs are unpublished elsewhere. We begin by reviewing the theory of real positivity of operator algebras initiated by the author and Charles Read. Then we present several new general results (mostly joint work with Matthew Neal) about real positive maps. The key point is that real positivity is often the right replacement in a general algebra $A$ for positivity in C*-algebras. We then apply this to studying contractive projections (`conditional expectations') and isometries of operator algebras. For example we generalize and find variants of certain classical results on positive projections on C*-algebras and JB algebras due to Choi, Effros, St{\o}rmer, Friedman and Russo, and others. In previous work with Neal we had done the `completely contractive' case; we focus here on describing the real positive contractive case from recent work with Neal. We also prove here several new and complementary results on this topic due to the author, indeed this new work constitutes most of Section 5. Finally, in the last section we describe a related part of some recent joint work with Labuschagne on what we consider to be a good noncommutative generalization of the `characters' (i.e. homomorphisms into the scalars) on an algebra. Such characters are a special case of the projections mentioned above, and are shown to be intimately related to conditional expectations. The idea is to try to use these to generalize certain classical function algebra results involving characters.


title: Exceptional points as lasing pre-thresholds in open-cavity lasers

abstract: The genesis of lasing, as an evolution of the laser hybrid eigenstates comprised of electromagnetic modes and atomic polarization, is considered. It is shown that the start of coherent generation at the laser threshold is preceded by the formation of a special hybrid state at the lasing pre-threshold. This special state is characterized by an enhanced coupling among excited atoms and electromagnetic modes. This leads to an increase in the rate of stimulated emission in the special state and, ultimately, to lasing. At the lasing pre-threshold, the transformation of hybrid eigenstates has the features of an exceptional point (EP) observed in non-Hermitian systems. The special state is formed when eigenfrequencies of two hybrid states coalesce or come close to each other. Below the pre-threshold, lifetimes of all hybrid states grow with increasing pump rate. When the pump rate crosses the pre-threshold, resonance trapping occurs with the lifetime of the special state continuing to increase while the lifetimes of all other eigenstates begin to decrease. Consequently, the latter eigenstates do not participate in the lasing. Thus, above the pre-threshold, a laser transitions into the single-mode regime.


title: A new elementary proof of the Prime Number Theorem

abstract: Let $\Omega(n)$ denote the number of prime factors of $n$. We show that for any bounded $f\colon\mathbb{N}\to\mathbb{C}$ one has \[ \frac{1}{N}\sum_{n=1}^N\, f(\Omega(n)+1)=\frac{1}{N}\sum_{n=1}^N\, f(\Omega(n))+\mathrm{o}_{N\to\infty}(1). \] This yields a new elementary proof of the Prime Number Theorem.


title: Diversity and Inclusion Metrics in Subset Selection

abstract: The ethical concept of fairness has recently been applied in machine learning (ML) settings to describe a wide range of constraints and objectives. When considering the relevance of ethical concepts to subset selection problems, the concepts of diversity and inclusion are additionally applicable in order to create outputs that account for social power and access differentials. We introduce metrics based on these concepts, which can be applied together, separately, and in tandem with additional fairness constraints. Results from human subject experiments lend support to the proposed criteria. Social choice methods can additionally be leveraged to aggregate and choose preferable sets, and we detail how these may be applied.


title: Rational polytopes with Ehrhart coefficients of arbitrary period

abstract: A seminal result of E. Ehrhart states that the number of integer lattice points in the dilation of a rational polytope by a positive integer $k$ is a quasi-polynomial function of $k$ --- that is, a "polynomial" in which the coefficients are themselves periodic functions of $k$. Using a result of F. Liu on the Ehrhart polynomials of cyclic polytopes, we construct not-necessarily-convex rational polytopes of arbitrary dimension in which the periods of the coefficient functions appearing in the Ehrhart quasi-polynomial take on arbitrary values.


title: TSM2X: High-Performance Tall-and-Skinny Matrix-Matrix Multiplication on GPUs

abstract: Linear algebra operations have been widely used in big data analytics and scientific computations. Many works have been done on optimizing linear algebra operations on GPUs with regular-shaped input. However, few works focus on fully utilizing GPU resources when the input is not regular-shaped. Current optimizations do not consider fully utilizing the memory bandwidth and computing power; therefore, they can only achieve sub-optimal performance. In this paper, we propose two efficient algorithms -- TSM2R and TSM2L -- for two classes of tall-and-skinny matrix-matrix multiplications on GPUs. Both of them focus on optimizing linear algebra operation with at least one of the input matrices is tall-and-skinny. Specifically, TSM2R is designed for a large regular-shaped matrix multiplying a tall-and-skinny matrix, while TSM2L is designed for a tall-and-skinny matrix multiplying a small regular-shaped matrix. We implement our proposed algorithms and test on several modern NVIDIA GPU micro-architectures. Experiments show that, compared to the current state-of-the-art works, (1) TSM2R speeds up the computation by 1.1x~3x and improves the memory bandwidth utilization and computing power utilization by 8%~47.6% and 7%~37.3%, respectively, when the regular-shaped matrix size is relatively large or medium; and (2) TSM2L speeds up the computation by 1.1x~3.5x and improve the memory bandwidth utilization by up to 55% when the regular-shaped matrix size is relatively small.


title: Rough Set based Aggregate Rank Measure & its Application to Supervised Multi Document Summarization

abstract: Most problems in Machine Learning cater to classification and the objects of universe are classified to a relevant class. Ranking of classified objects of universe per decision class is a challenging problem. We in this paper propose a novel Rough Set based membership called Rank Measure to solve to this problem. It shall be utilized for ranking the elements to a particular class. It differs from Pawlak Rough Set based membership function which gives an equivalent characterization of the Rough Set based approximations. It becomes paramount to look beyond the traditional approach of computing memberships while handling inconsistent, erroneous and missing data that is typically present in real world problems. This led us to propose the aggregate Rank Measure. The contribution of the paper is three fold. Firstly, it proposes a Rough Set based measure to be utilized for numerical characterization of within class ranking of objects. Secondly, it proposes and establish the properties of Rank Measure and aggregate Rank Measure based membership. Thirdly, we apply the concept of membership and aggregate ranking to the problem of supervised Multi Document Summarization wherein first the important class of sentences are determined using various supervised learning techniques and are post processed using the proposed ranking measure. The results proved to have significant improvement in accuracy.


title: Large-Scale Discrete Fourier Transform on TPUs

abstract: In this work, we present two parallel algorithms for the large-scale discrete Fourier transform (DFT) on Tensor Processing Unit (TPU) clusters. The two parallel algorithms are associated with two formulations of DFT: one is based on the Kronecker product, to be specific, dense matrix multiplications between the input data and the Vandermonde matrix, denoted as KDFT in this work; the other is based on the famous Cooley-Tukey algorithm and phase adjustment, denoted as FFT in this work. Both KDFT and FFT formulations take full advantage of TPU's strength in matrix multiplications. The KDFT formulation allows direct use of nonuniform inputs without additional step. In the two parallel algorithms, the same strategy of data decomposition is applied to the input data. Through the data decomposition, the dense matrix multiplications in KDFT and FFT are kept local within TPU cores, which can be performed completely in parallel. The communication among TPU cores is achieved through the one-shuffle scheme in both parallel algorithms, with which sending and receiving data takes place simultaneously between two neighboring cores and along the same direction on the interconnect network. The one-shuffle scheme is designed for the interconnect topology of TPU clusters, minimizing the time required by the communication among TPU cores. Both KDFT and FFT are implemented in TensorFlow. The three-dimensional complex DFT is performed on an example of dimension $8192 \times 8192 \times 8192$ with a full TPU Pod: the run time of KDFT is 12.66 seconds and that of FFT is 8.3 seconds. Scaling analysis is provided to demonstrate the high parallel efficiency of the two DFT implementations on TPUs.


title: Privacy-Preserving Image Classification in the Local Setting

abstract: Image data has been greatly produced by individuals and commercial vendors in the daily life, and it has been used across various domains, like advertising, medical and traffic analysis. Recently, image data also appears to be greatly important in social utility, like emergency response. However, the privacy concern becomes the biggest obstacle that prevents further exploration of image data, due to that the image could reveal sensitive information, like the personal identity and locations. The recent developed Local Differential Privacy (LDP) brings us a promising solution, which allows the data owners to randomly perturb their input to provide the plausible deniability of the data before releasing. In this paper, we consider a two-party image classification problem, in which data owners hold the image and the untrustworthy data user would like to fit a machine learning model with these images as input. To protect the image privacy, we propose to locally perturb the image representation before revealing to the data user. Subsequently, we analyze how the perturbation satisfies {\epsilon}-LDP and affect the data utility regarding count-based and distance-based machine learning algorithm, and propose a supervised image feature extractor, DCAConv, which produces an image representation with scalable domain size. Our experiments show that DCAConv could maintain a high data utility while preserving the privacy regarding multiple image benchmark datasets.


title: Two-loop non-leptonic penguin amplitude in QCD factorization

abstract: We complete the calculation of the QCD penguin amplitude at next-to-next-to-leading order in the QCD factorization approach to non-leptonic B-meson decays. This provides the last missing piece in the computation of the QCD correction to direct CP asymmetries at leading power in the heavy-quark expansion.


title: Asymptotics for Hecke eigenvalues of automorphic forms on compact arithmetic quotients

abstract: In this paper, we describe the asymptotic distribution of Hecke eigenvalues in the Laplace eigenvalue aspect for certain families of Hecke-Maass forms on compact arithmetic quotients. Instead of relying on the trace formula, which was the primary tool in preceding studies on the subject, we use Fourier integral operator methods. This allows us to treat not only spherical, but also non-spherical Hecke-Maass forms with corresponding remainder estimates. Our asymptotic formulas are available for arbitrary simple and connected algebraic groups over number fields with cocompact arithmetic subgroups.


title: GradMix: Multi-source Transfer across Domains and Tasks

abstract: The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex mappings from X to Y. The advent of each task often accompanies the release of a large-scale annotated dataset, for supervised training of deep network. However, it is expensive and time-consuming to manually label sufficient amount of training data. Therefore, it is important to develop algorithms that can leverage off-the-shelf labeled dataset to learn useful knowledge for the target task. While previous works mostly focus on transfer learning from a single source, we study multi-source transfer across domains and tasks (MS-DTT), in a semi-supervised setting. We propose GradMix, a model-agnostic method applicable to any model trained with gradient-based learning rule, to transfer knowledge via gradient descent by weighting and mixing the gradients from all sources during training. GradMix follows a meta-learning objective, which assigns layer-wise weights to the source gradients, such that the combined gradient follows the direction that minimize the loss for a small set of samples from the target dataset. In addition, we propose to adaptively adjust the learning rate for each mini-batch based on its importance to the target task, and a pseudo-labeling method to leverage the unlabeled samples in the target domain. We conduct MS-DTT experiments on two tasks: digit recognition and action recognition, and demonstrate the advantageous performance of the proposed method against multiple baselines.


title: Robust URLLC Packet Scheduling of OFDM Systems

abstract: In this paper, we consider the power minimization problem of joint physical resource block (PRB) assignment and transmit power allocation under specified delay and reliability requirements for ultra-reliable and low-latency communication (URLLC) in downlink cellular orthogonal frequency-division multiple-access (OFDMA) system. To be more practical, only the imperfect channel state information (CSI) is assumed to be available at the base station (BS). The formulated problem is a combinatorial and mixed-integer nonconvex problem and is difficult to tackle. Through techniques of slack variables introduction, the first-order Taylor approximation and reweighted $\ell_1$-norm, we approximate it by a convex problem and the successive convex approximation (SCA) based iterative algorithm is proposed to yield sub-optimal solutions. Numerical results provide some insights into the impact of channel estimation error, user number, the allowable maximum delay and packet error probability on the required system sum power.


title: Weakly-Supervised Multi-Person Action Recognition in 360$^{\circ}$ Videos

abstract: The recent development of commodity 360$^{\circ}$ cameras have enabled a single video to capture an entire scene, which endows promising potentials in surveillance scenarios. However, research in omnidirectional video analysis has lagged behind the hardware advances. In this work, we address the important problem of action recognition in top-view 360$^{\circ}$ videos. Due to the wide filed-of-view, 360$^{\circ}$ videos usually capture multiple people performing actions at the same time. Furthermore, the appearance of people are deformed. The proposed framework first transforms omnidirectional videos into panoramic videos, then it extracts spatial-temporal features using region-based 3D CNNs for action recognition. We propose a weakly-supervised method based on multi-instance multi-label learning, which trains the model to recognize and localize multiple actions in a video using only video-level action labels as supervision. We perform experiments to quantitatively validate the efficacy of the proposed method and qualitatively demonstrate action localization results. To enable research in this direction, we introduce 360Action, the first omnidirectional video dataset for multi-person action recognition.


title: Evolution of a Complex Predator-Prey Ecosystem on Large-scale Multi-Agent Deep Reinforcement Learning

abstract: Simulation of population dynamics is a central research theme in computational biology, which contributes to understanding the interactions between predators and preys. Conventional mathematical tools of this theme, however, are incapable of accounting for several important attributes of such systems, such as the intelligent and adaptive behavior exhibited by individual agents. This unrealistic setting is often insufficient to simulate properties of population dynamics found in the real-world. In this work, we leverage multi-agent deep reinforcement learning, and we propose a new model of large-scale predator-prey ecosystems. Using different variants of our proposed environment, we show that multi-agent simulations can exhibit key real-world dynamical properties. To obtain this behavior, we firstly define a mating mechanism such that existing agents reproduce new individuals bound by the conditions of the environment. Furthermore, we incorporate a real-time evolutionary algorithm and show that reinforcement learning enhances the evolution of the agents' physical properties such as speed, attack and resilience against attacks.


title: The Novel Coronavirus, 2019-nCoV, is Highly Contagious and More Infectious Than Initially Estimated

abstract: The novel coronavirus (2019-nCoV) is a recently emerged human pathogen that has spread widely since January 2020. Initially, the basic reproductive number, R0, was estimated to be 2.2 to 2.7. Here we provide a new estimate of this quantity. We collected extensive individual case reports and estimated key epidemiology parameters, including the incubation period. Integrating these estimates and high-resolution real-time human travel and infection data with mathematical models, we estimated that the number of infected individuals during early epidemic double every 2.4 days, and the R0 value is likely to be between 4.7 and 6.6. We further show that quarantine and contact tracing of symptomatic individuals alone may not be effective and early, strong control measures are needed to stop transmission of the virus.


title: Linearly Convergent Algorithm with Variance Reduction for Distributed Stochastic Optimization

abstract: This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation and distributedness of local objective, fast linearly convergent distributed algorithms have not been achieved yet. This work proposes a novel distributed stochastic gradient tracking algorithm with variance reduction, where the local gradients are estimated by an increasing batch-size of sampled gradients. With an undirected connected communication graph and a geometrically increasing batch-size, the iterates are shown to converge in mean to the optimal solution at a geometric rate (achieving linear convergence). The iteration, communication, and oracle complexity for obtaining an $\epsilon$-optimal solution are established as well. Particulary, the communication complexity is $\mathcal{O}(\ln (1/\epsilon))$ while the oracle complexity (number of sampled gradients) is $\mathcal{O}(1/\epsilon^2)$, which is of the same order as that of centralized approaches. Hence, the proposed scheme is communication-efficient without requiring extra sampled gradients. Numerical simulations are given to demonstrate the theoretic results.


title: Propagating Slow Sausage Waves in a Sunspot Observed by the New Vacuum Solar Telescope

abstract: A sunspot is an ideal waveguide for a variety of magnetohydrodynamic waves, which carry a significant amount of energy to the upper atmosphere and could be used as a tool to probe magnetic and thermal structure of a sunspot. In this study, we used the New Vacuum Solar Telescope and took high-resolution image sequences simultaneously in both TiO (7058$\pm$10 \AA) and H$_\alpha$ (6562$\pm$2.5 \AA) bandpasses. We extracted the area and total emission intensity variations of sunspot umbra and analyzed the signals with synchrosqueezing transform. We found that the area and emission intensity varied with both three and five minute periodicity. Moreover, the area and intensity oscillated in phase with each other, this fact hold in both TiO and H$_\alpha$ data. We interpret this oscillatory signal as propagating slow sausage wave. The propagation speed is estimated at about 8 km$\cdot$s$^{-1}$. We infer that this sunspot's umbra could have temperature as low as 2800--3500 K.


title: Learning efficient structured dictionary for image classification

abstract: Recent years have witnessed the success of dictionary learning (DL) based approaches in the domain of pattern classification. In this paper, we present an efficient structured dictionary learning (ESDL) method which takes both the diversity and label information of training samples into account. Specifically, ESDL introduces alternative training samples into the process of dictionary learning. To increase the discriminative capability of representation coefficients for classification, an ideal regularization term is incorporated into the objective function of ESDL. Moreover, in contrast with conventional DL approaches which impose computationally expensive L1-norm constraint on the coefficient matrix, ESDL employs L2-norm regularization term. Experimental results on benchmark databases (including four face databases and one scene dataset) demonstrate that ESDL outperforms previous DL approaches. More importantly, ESDL can be applied in a wide range of pattern classification tasks.


title: Local Nonparametric Meta-Learning

abstract: A central goal of meta-learning is to find a learning rule that enables fast adaptation across a set of tasks, by learning the appropriate inductive bias for that set. Most meta-learning algorithms try to find a \textit{global} learning rule that encodes this inductive bias. However, a global learning rule represented by a fixed-size representation is prone to meta-underfitting or -overfitting since the right representational power for a task set is difficult to choose a priori. Even when chosen correctly, we show that global, fixed-size representations often fail when confronted with certain types of out-of-distribution tasks, even when the same inductive bias is appropriate. To address these problems, we propose a novel nonparametric meta-learning algorithm that utilizes a meta-trained local learning rule, building on recent ideas in attention-based and functional gradient-based meta-learning. In several meta-regression problems, we show improved meta-generalization results using our local, nonparametric approach and achieve state-of-the-art results in the robotics benchmark, Omnipush.


title: On the Complexity of Minimizing Convex Finite Sums Without Using the Indices of the Individual Functions

abstract: Recent advances in randomized incremental methods for minimizing $L$-smooth $\mu$-strongly convex finite sums have culminated in tight complexity of $\tilde{O}((n+\sqrt{n L/\mu})\log(1/\epsilon))$ and $O(n+\sqrt{nL/\epsilon})$, where $\mu>0$ and $\mu=0$, respectively, and $n$ denotes the number of individual functions. Unlike incremental methods, stochastic methods for finite sums do not rely on an explicit knowledge of which individual function is being addressed at each iteration, and as such, must perform at least $\Omega(n^2)$ iterations to obtain $O(1/n^2)$-optimal solutions. In this work, we exploit the finite noise structure of finite sums to derive a matching $O(n^2)$-upper bound under the global oracle model, showing that this lower bound is indeed tight. Following a similar approach, we propose a novel adaptation of SVRG which is both \emph{compatible with stochastic oracles}, and achieves complexity bounds of $\tilde{O}((n^2+n\sqrt{L/\mu})\log(1/\epsilon))$ and $O(n\sqrt{L/\epsilon})$, for $\mu>0$ and $\mu=0$, respectively. Our bounds hold w.h.p. and match in part existing lower bounds of $\tilde{\Omega}(n^2+\sqrt{nL/\mu}\log(1/\epsilon))$ and $\tilde{\Omega}(n^2+\sqrt{nL/\epsilon})$, for $\mu>0$ and $\mu=0$, respectively.


title: A Distributed Path Query Engine for Temporal Property Graphs

abstract: Property graphs are a common form of linked data, with path queries used to traverse and explore them for enterprise transactions and mining. Temporal property graphs are a recent variant where time is a first-class entity to be queried over, and their properties and structure vary over time. These are seen in social, telecom, transit and epidemic networks. However, current graph databases and query engines have limited support for temporal relations among graph entities, no support for time-varying entities and/or do not scale on distributed resources. We address this gap by extending a linear path query model over property graphs to include intuitive temporal predicates and aggregation operators over temporal graphs. We design a distributed execution model for these temporal path queries using the interval-centric computing model, and develop a novel cost model to select an efficient execution plan from several. We perform detailed experiments of our Granite distributed query engine using both static and dynamic temporal property graphs as large as 52M vertices, 218M edges and 325M properties, and a 1600-query workload, derived from the LDBC benchmark. We often offer sub-second query latencies on a commodity cluster, which is 149x-1140x faster compared to industry-leading Neo4J shared-memory graph database and the JanusGraph / Spark distributed graph query engine. Granite also completes 100% of the queries for all graphs, compared to only 32-92% workload completion by the baseline systems. Further, our cost model selects a query plan that is within 10% of the optimal execution time in 90% of the cases. Despite the irregular nature of graph processing, we exhibit a weak-scaling efficiency >= 60% on 8 nodes and >= 40% on 16 nodes, for most query workloads.


title: Comparative intra-night optical variability of X-ray and $\gamma$-ray detected narrow-line Seyfert 1 galaxies

abstract: In a systematic program to characterise the intra-night optical variability (INOV) of different classes of narrow-line Seyfert 1 galaxies (NLSy1s), we report here the first comparative INOV study of NLSy1 sets detected in the X-ray and $\gamma$-ray bands. Our sample consists of 18 sources detected in X-ray but not in $\gamma$-rays (hereafter x$\textunderscore$NLSy1s) and 7 sources detected in $\gamma$-rays (hereafter g$\textunderscore$NLSy1s), out of which 5 are detected also in X-rays. We have monitored these two sets of NLSy1s, respectively, in 24 and 21 sessions of a minimum of 3 hours duration each. The INOV duty cycles for these two sets are found to be 12\% and 53\%, respectively (at a 99\% confidence level). In the set of 18 x$\textunderscore$NLSy1s, INOV duty cycle is found to be zero for the 13 radio-quiet members (monitored in 14 sessions) and 43\% for the 5 radio-loud members (10 sessions). The latter is very similar to the aforementioned duty cycle of 53\% found here for the set of g$\textunderscore$NLSy1s (all of which are radio-loud). Thus it appears that the radio loudness level is the prime factor behind the INOV detection and the pattern of the high-energy radiation plays only a minor role.


title: Asymmetric Rejection Loss for Fairer Face Recognition

abstract: Face recognition performance has seen a tremendous gain in recent years, mostly due to the availability of large-scale face images dataset that can be exploited by deep neural networks to learn powerful face representations. However, recent research has shown differences in face recognition performance across different ethnic groups mostly due to the racial imbalance in the training datasets where Caucasian identities largely dominate other ethnicities. This is actually symptomatic of the under-representation of non-Caucasian ethnic groups in the celebdom from which face datasets are usually gathered, rendering the acquisition of labeled data of the under-represented groups challenging. In this paper, we propose an Asymmetric Rejection Loss, which aims at making full use of unlabeled images of those under-represented groups, to reduce the racial bias of face recognition models. We view each unlabeled image as a unique class, however as we cannot guarantee that two unlabeled samples are from a distinct class we exploit both labeled and unlabeled data in an asymmetric manner in our loss formalism. Extensive experiments show our method's strength in mitigating racial bias, outperforming state-of-the-art semi-supervision methods. Performance on the under-represented ethnicity groups increases while that on the well-represented group is nearly unchanged.


title: A New Framework for Online Testing of Heterogeneous Treatment Effect

abstract: We propose a new framework for online testing of heterogeneous treatment effects. The proposed test, named sequential score test (SST), is able to control type I error under continuous monitoring and detect multi-dimensional heterogeneous treatment effects. We provide an online p-value calculation for SST, making it convenient for continuous monitoring, and extend our tests to online multiple testing settings by controlling the false discovery rate. We examine the empirical performance of the proposed tests and compare them with a state-of-art online test, named mSPRT using simulations and a real data. The results show that our proposed test controls type I error at any time, has higher detection power and allows quick inference on online A/B testing.


title: Domain Adaptation as a Problem of Inference on Graphical Models

abstract: This paper is concerned with data-driven unsupervised domain adaptation, where it is unknown in advance how the joint distribution changes across domains, i.e., what factors or modules of the data distribution remain invariant or change across domains. To develop an automated way of domain adaptation with multiple source domains, we propose to use a graphical model as a compact way to encode the change property of the joint distribution, which can be learned from data, and then view domain adaptation as a problem of Bayesian inference on the graphical models. Such a graphical model distinguishes between constant and varied modules of the distribution and specifies the properties of the changes across domains, which serves as prior knowledge of the changing modules for the purpose of deriving the posterior of the target variable $Y$ in the target domain. This provides an end-to-end framework of domain adaptation, in which additional knowledge about how the joint distribution changes, if available, can be directly incorporated to improve the graphical representation. We discuss how causality-based domain adaptation can be put under this umbrella. Experimental results on both synthetic and real data demonstrate the efficacy of the proposed framework for domain adaptation. The code is available at https://github.com/mgong2/DA_Infer .


title: Reconstruction of acoustic sources from multi-frequency phaseless far-field data

abstract: We consider the inverse source problem of determining an acoustic source from multi-frequency phaseless far-field data. By supplementing some reference point sources to the inverse source model, we develop a novel strategy for recovering the phase information of far-field data. This reference source technique leads to an easy-to-implement phase retrieval formula. Mathematically, the stability of the phase retrieval approach is rigorously justified. Then we employ the Fourier method to deal with the multi-frequency inverse source problem with recovered phase information. Finally, some two and three dimensional numerical results are presented to demonstrate the viability and effectiveness of the proposed method.


title: Discovering transition phenomena from data of stochastic dynamical systems with L\'evy noise

abstract: It is a challenging issue to analyze complex dynamics from observed and simulated data. An advantage of extracting dynamic behaviors from data is that this approach enables the investigation of nonlinear phenomena whose mathematical models are unavailable. The purpose of this present work is to extract information about transition phenomena (e.g., mean exit time and escape probability), from data of stochastic differential equations with non-Gaussian L\'evy noise. As a tool in describing dynamical systems, the Koopman semigroup transforms a nonlinear system into a linear system, but at the cost of elevating a finite dimensional problem into an infinite dimensional one. In spite of this, using the relation between the stochastic Koopman semigroup and the infinitesimal generator of a stochastic differential equation, we learn the mean exit time and escape probability from data. Specifically, we first obtain a finite dimensional approximation of the infinitesimal generator by an extended dynamic mode decomposition algorithm. Then we identify the drift coefficient, diffusion coefficient and anomalous diffusion coefficient for the stochastic differential equation. Finally, we compute the mean exit time and escape probability by finite difference discretization of the associated nonlocal partial differential equations. This approach is applicable in extracting transition information from data of stochastic differential equations with either (Gaussian) Brownian motion or (non-Gaussian) L\'evy motion. We present one - and two-dimensional examples to demonstrate the effectiveness of our approach.


title: PointHop++: A Lightweight Learning Model on Point Sets for 3D Classification

abstract: The PointHop method was recently proposed by Zhang et al. for 3D point cloud classification with unsupervised feature extraction. It has an extremely low training complexity while achieving state-of-the-art classification performance. In this work, we improve the PointHop method furthermore in two aspects: 1) reducing its model complexity in terms of the model parameter number and 2) ordering discriminant features automatically based on the cross-entropy criterion. The resulting method is called PointHop++. The first improvement is essential for wearable and mobile computing while the second improvement bridges statistics-based and optimization-based machine learning methodologies. With experiments conducted on the ModelNet40 benchmark dataset, we show that the PointHop++ method performs on par with deep neural network (DNN) solutions and surpasses other unsupervised feature extraction methods.


title: A Deep Reinforcement Learning Algorithm Using Dynamic Attention Model for Vehicle Routing Problems

abstract: Recent researches show that machine learning has the potential to learn better heuristics than the one designed by human for solving combinatorial optimization problems. The deep neural network is used to characterize the input instance for constructing a feasible solution incrementally. Recently, an attention model is proposed to solve routing problems. In this model, the state of an instance is represented by node features that are fixed over time. However, the fact is, the state of an instance is changed according to the decision that the model made at different construction steps, and the node features should be updated correspondingly. Therefore, this paper presents a dynamic attention model with dynamic encoder-decoder architecture, which enables the model to explore node features dynamically and exploit hidden structure information effectively at different construction steps. This paper focuses on a challenging NP-hard problem, vehicle routing problem. The experiments indicate that our model outperforms the previous methods and also shows a good generalization performance.


title: Segmented Graph-Bert for Graph Instance Modeling

abstract: In graph instance representation learning, both the diverse graph instance sizes and the graph node orderless property have been the major obstacles that render existing representation learning models fail to work. In this paper, we will examine the effectiveness of GRAPH-BERT on graph instance representation learning, which was designed for node representation learning tasks originally. To adapt GRAPH-BERT to the new problem settings, we re-design it with a segmented architecture instead, which is also named as SEG-BERT (Segmented GRAPH-BERT) for reference simplicity in this paper. SEG-BERT involves no node-order-variant inputs or functional components anymore, and it can handle the graph node orderless property naturally. What's more, SEG-BERT has a segmented architecture and introduces three different strategies to unify the graph instance sizes, i.e., full-input, padding/pruning and segment shifting, respectively. SEG-BERT is pre-trainable in an unsupervised manner, which can be further transferred to new tasks directly or with necessary fine-tuning. We have tested the effectiveness of SEG-BERT with experiments on seven graph instance benchmark datasets, and SEG-BERT can out-perform the comparison methods on six out of them with significant performance advantages.


title: Target Privacy Preserving for Social Networks

abstract: In this paper, we incorporate the realistic scenario of key protection into link privacy preserving and propose the target-link privacy preserving (TPP) model: target links referred to as targets are the most important and sensitive objectives that would be intentionally attacked by adversaries, in order that need privacy protections, while other links of less privacy concerns are properly released to maintain the graph utility. The goal of TPP is to limit the target disclosure by deleting a budget limited set of alternative non-target links referred to as protectors to defend the adversarial link predictions for all targets. Traditional link privacy preserving treated all links as targets and concentrated on structural level protections in which serious link disclosure and high graph utility loss is still the bottleneck of graph releasing today, while TPP focuses on the target level protections in which key protection is implemented on a tiny fraction of critical targets to achieve better privacy protection and lower graph utility loss. Currently there is a lack of clear TPP problem definition, provable optimal or near optimal protector selection algorithms and scalable implementations on large-scale social graphs. Firstly, we introduce the TPP model and propose a dissimilarity function used for measuring the defense ability against privacy analyzing for the targets. We consider two different problems by budget assignment settings: 1) we protect all targets and to optimize the dissimilarity of all targets with a single budget; 2) besides the protections of all targets, we also care about the protection of each target by assigning a local budget to every target, considering two local protector selections. We also implement scalable implementations and experiments to demonstrate the effectiveness and efficiency of the proposed algorithms.


title: Pulsar timing array signals induced by black hole binaries in relativistic eccentric orbits

abstract: Individual supermassive black hole binaries in non-circular orbits are possible nanohertz gravitational wave sources for the rapidly maturing Pulsar Timing Array experiments. We develop an accurate and efficient approach to compute Pulsar Timing Array signals due to gravitational waves from inspiraling supermassive black hole binaries in relativistic eccentric orbits. Our approach employs a Keplerian-type parametric solution to model third post-Newtonian accurate precessing eccentric orbits while a novel semi-analytic prescription is provided to model the effects of quadrupolar order gravitational wave emission. These inputs lead to a semi-analytic prescription to model such signals, induced by non-spinning black hole binaries inspiralling along arbitrary eccentricity orbits. Additionally, we provide a fully analytic prescription to model Pulsar Timing Array signals from black hole binaries inspiraling along moderately eccentric orbits, influenced by Boetzelet al.[Phys. Rev. D 96,044011(2017)]. These approaches are being incorporated into Enterprise and TEMPO2 for searching the presence of such binaries in Pulsar Timing Array datasets.


title: Stability and asymptotic analysis of the F\"ollmer-Schweizer decomposition on a finite probability space

abstract: First, we consider the problem of hedging in complete binomial models. Using the discrete-time F\"ollmer-Schweizer decomposition, we demonstrate the equivalence of the backward induction and sequential regression approaches. Second, in incomplete trinomial models, we examine the extension of the sequential regression approach for approximation of contingent claims. Then, on a finite probability space, we investigate stability of the discrete-time F\"ollmer-Schweizer decomposition with respect to perturbations of the stock price dynamics and, finally, perform its asymptotic analysis under simultaneous perturbations of the drift and volatility of the underlying discounted stock price process, where we prove stability and obtain explicit formulas for the leading order correction terms.