title: Revealing the spectroscopic variations of FU Orionis object V960 Mon with high-resolution spectroscopy

abstract: We present the results of the high-resolution spectroscopy of the FU Orionis-type star V960 Mon. The brightness of V960 Mon decreased continuously after the outburst was detected in 2014 November. During this dimming event, we have carried out medium-resolution spectroscopic monitoring observations and found that the equivalent width of the absorption features showed variations. To further investigate the spectroscopic variations, we conducted a high-resolution spectroscopic observation of V960 Mon with the Subaru Telescope and the High Dispersion Spectrograph on 2018 January 8 and 2020 February 1. By comparing this spectrum with the archival data of the Keck Observatory and the High Resolution Echelle Spectrometer taken between 2014 and 2017, we found that the absorption profiles changed as V960 Mon faded. The line profile of absorption lines such as Fe I and Ca I can be explained by a sum of the spectra of the disk atmosphere and the central star. The model spectrum created to explain the variations of the line profiles suggests that the effective temperature of the central star is $\sim$5500 K, which is comparable to that of the pre-outburst phase with a distance of 1.6 kpc with Gaia. The spectrum also shows that the effective temperature of the disk atmosphere decreased as V960 Mon faded. The variations of the H$\alpha$ and Ca II lines (8498.0 A, 8542.1 A) also show that the V960 Mon spectrum became central-star dominant.


title: Graph-Based Modeling and Decomposition of Energy Infrastructures

abstract: Nonlinear optimization problems are found at the heart of real-time operations of critical infrastructures. These problems are computationally challenging because they embed complex physical models that exhibit space-time dynamics. We propose modeling these problems as graph-structured optimization problems, and illustrate how their structure can be exploited at the modeling level (for parallelizing function/derivative computations) and at the solver level (for parallelizing linear algebra operations). Specifically, we present a restricted additive Schwarz scheme that enables flexible decomposition of complex graph structures within an interior-point algorithm. The proposed approach is implemented as a general-purpose nonlinear programming solver that we call MadNLP.jl; this Julia-based solver is interfaced to the graph-based modeling package Plasmo.jl. The efficiency of this framework is demonstrated via problems arising in transient gas network optimization and multi-period AC optimal power flow. We show that our framework accelerates the solution (compared to off-the-shelf tools) by over 300%; specifically, solution times are reduced from 72.36 sec to 23.84 sec for the gas problem and from 515.81 sec to 149.45 sec for the power flow problem.


title: Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor Learning

abstract: We present a simple few-shot named entity recognition (NER) system based on nearest neighbor learning and structured inference. Our system uses a supervised NER model trained on the source domain, as a feature extractor. Across several test domains, we show that a nearest neighbor classifier in this feature-space is far more effective than the standard meta-learning approaches. We further propose a cheap but effective method to capture the label dependencies between entity tags without expensive CRF training. We show that our method of combining structured decoding with nearest neighbor learning achieves state-of-the-art performance on standard few-shot NER evaluation tasks, improving F1 scores by $6\%$ to $16\%$ absolute points over prior meta-learning based systems.


title: Video Anomaly Detection Using Pre-Trained Deep Convolutional Neural Nets and Context Mining

abstract: Anomaly detection is critically important for intelligent surveillance systems to detect in a timely manner any malicious activities. Many video anomaly detection approaches using deep learning methods focus on a single camera video stream with a fixed scenario. These deep learning methods use large-scale training data with large complexity. As a solution, in this paper, we show how to use pre-trained convolutional neural net models to perform feature extraction and context mining, and then use denoising autoencoder with relatively low model complexity to provide efficient and accurate surveillance anomaly detection, which can be useful for the resource-constrained devices such as edge devices of the Internet of Things (IoT). Our anomaly detection model makes decisions based on the high-level features derived from the selected embedded computer vision models such as object classification and object detection. Additionally, we derive contextual properties from the high-level features to further improve the performance of our video anomaly detection method. We use two UCSD datasets to demonstrate that our approach with relatively low model complexity can achieve comparable performance compared to the state-of-the-art approaches.


title: Adversarial Grammatical Error Correction

abstract: Recent works in Grammatical Error Correction (GEC) have leveraged the progress in Neural Machine Translation (NMT), to learn rewrites from parallel corpora of grammatically incorrect and corrected sentences, achieving state-of-the-art results. At the same time, Generative Adversarial Networks (GANs) have been successful in generating realistic texts across many different tasks by learning to directly minimize the difference between human-generated and synthetic text. In this work, we present an adversarial learning approach to GEC, using the generator-discriminator framework. The generator is a Transformer model, trained to produce grammatically correct sentences given grammatically incorrect ones. The discriminator is a sentence-pair classification model, trained to judge a given pair of grammatically incorrect-correct sentences on the quality of grammatical correction. We pre-train both the discriminator and the generator on parallel texts and then fine-tune them further using a policy gradient method that assigns high rewards to sentences which could be true corrections of the grammatically incorrect text. Experimental results on FCE, CoNLL-14, and BEA-19 datasets show that Adversarial-GEC can achieve competitive GEC quality compared to NMT-based baselines.


title: Entropic Continuity Bounds & Eventually Entanglement-Breaking Channels

abstract: In the first part of this thesis, we present a general technique for establishing local and uniform continuity bounds for Schur concave functions. Our technique uses a particular relationship between majorization and the trace distance between quantum states. Namely, the majorization pre-order attains a minimum over $\epsilon$-balls in this distance. By tracing the path of the majorization-minimizer as a function of the distance $\epsilon$, we obtain the path of "majorization flow". This yields a new proof of the Audenaert-Fannes continuity bound for the von Neumann entropy in a universal framework which extends to the other functions, including the $\alpha$-R\'enyi entropy, for which we obtain novel bounds in the case $\alpha > 1$. We apply this technique to other Schur concave functions, such as the number of connected components of a certain random graph model, and the number of distinct realizations of a random variable. In the second part, we consider repeated interaction systems, in which a system of interest interacts with a sequence of probes one at a time. We characterize which repeated interaction systems break any initially-present entanglement between the system and an untouched reference after finitely many steps. Additionally, when the probes and their interactions with the system are slowly-varying (i.e. adiabatic), we analyze the saturation of Landauer's bound, an inequality between the entropy change of the system and the energy change of the probes, in the limit in which the number of steps tends to infinity and both the difference between consecutive probes and the difference between their interactions vanishes. This analysis proceeds at a fine-grained level by means of a two-time measurement protocol, in which the energy of the probes is measured before and after each interaction.


title: Inverse Spin Hall effect in ferromagnetic nanomagnet. Dependencies on magnetic field, current and current polarity

abstract: The measured Hall angle in a ferromagnetic nanomagnet shows a substantial non-linear dependence on an external magnetic field, which cannot be explained by adopted mechanisms of the Ordinary and Anomalous (AHE) Hall effects implying a linear plus constant dependence on the external magnetic field. We suggest that there is an additional non-linear contribution from the Inverse Spin Hall effect (ISHE). The significant contribution of ISHE in a ferromagnet is supported by perfect agreement of experiment with a phenomenological theory of ISHE. We observed different dependencies of AHE and ISHE on current suggesting their different thermal dependencies. We also observe dependence of the Hall angle of the current polarity which is due to the Spin Hall effect.


title: On the number of simultaneous solutions of certain diagonal equations over finite fields

abstract: In this paper we obtain explicit estimates and existence results on the number of $\mathbb{F}_q$-rational solutions of certain systems defined by families of diagonal equations over finite fields. Our approach relies on the study of the geometric properties of the varieties defined by the systems involved. We apply these results to a generalization of Waring's problem and the distribution of solutions of congruences modulo a prime number.


title: ERFit: Entropic Regression Fit Matlab Package, for Data-Driven System Identification of Underlying Dynamic Equations

abstract: Data-driven sparse system identification becomes the general framework for a wide range of problems in science and engineering. It is a problem of growing importance in applied machine learning and artificial intelligence algorithms. In this work, we developed the Entropic Regression Software Package (ERFit), a MATLAB package for sparse system identification using the entropic regression method. The code requires minimal supervision, with a wide range of options that make it adapt easily to different problems in science and engineering. The ERFit is available at https://github.com/almomaa/ERFit-Package


title: Adaptive Active-Passive Networked Multiagent Systems

abstract: Active-passive multiagent systems consist of agents subject to inputs (active agents) and agents with no inputs (passive agents), where active and passive agent roles are considered to be interchangeable in order to capture a wide array of applications. A challenge in the control of active-passive multiagent systems is the presence of information exchange uncertainties that can yield to undesirable closed-loop system performance. Motivated by this standpoint, this paper proposes an adaptive control algorithm for this class of multiagent systems to suppress the negative effects of information exchange uncertainties. Specifically, by estimating these uncertainties, the proposed adaptive control architecture has the ability to recover the active-passive multiagent system performance in a distributed manner. As a result, the agents converge to a user-adjustable neighborhood of the average of the applied inputs to the active agents. The efficacy of the proposed control architecture is also validated from a human-robot collaboration perspective, where a human is visiting several task locations, and the multiagent system identifies these locations and moves toward them as a coverage control problem.


title: Efficient One-Pass End-to-End Entity Linking for Questions

abstract: We present ELQ, a fast end-to-end entity linking model for questions, which uses a biencoder to jointly perform mention detection and linking in one pass. Evaluated on WebQSP and GraphQuestions with extended annotations that cover multiple entities per question, ELQ outperforms the previous state of the art by a large margin of +12.7% and +19.6% F1, respectively. With a very fast inference time (1.57 examples/s on a single CPU), ELQ can be useful for downstream question answering systems. In a proof-of-concept experiment, we demonstrate that using ELQ significantly improves the downstream QA performance of GraphRetriever (arXiv:1911.03868). Code and data available at https://github.com/facebookresearch/BLINK/tree/master/elq


title: ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution

abstract: Deep convolutional neural networks have significantly improved the peak signal-to-noise ratio of SuperResolution (SR). However, image viewer applications commonly allow users to zoom the images to arbitrary magnification scales, thus far imposing a large number of required training scales at a tremendous computational cost. To obtain a more computationally efficient model for arbitrary scale SR, this paper employs a Laplacian pyramid method to reconstruct any-scale high-resolution (HR) images using the high-frequency image details in a Laplacian Frequency Representation. For SR of small-scales (between 1 and 2), images are constructed by interpolation from a sparse set of precalculated Laplacian pyramid levels. SR of larger scales is computed by recursion from small scales, which significantly reduces the computational cost. For a full comparison, fixed- and any-scale experiments are conducted using various benchmarks. At fixed scales, ASDN outperforms predefined upsampling methods (e.g., SRCNN, VDSR, DRRN) by about 1 dB in PSNR. At any-scale, ASDN generally exceeds Meta-SR on many scales.


title: Data-Driven Learning of Geometric Scattering Networks

abstract: We propose a new graph neural network (GNN) module, based on relaxations of recently proposed geometric scattering transforms, which consist of a cascade of graph wavelet filters. Our learnable geometric scattering (LEGS) module enables adaptive tuning of the wavelets to encourage band-pass features to emerge in learned representations. The incorporation of our LEGS-module in GNNs enables the learning of longer-range graph relations compared to many popular GNNs, which often rely on encoding graph structure via smoothness or similarity between neighbors. Further, its wavelet priors result in simplified architectures with significantly fewer learned parameters compared to competing GNNs. We demonstrate the predictive performance of LEGS-based networks on graph classification benchmarks, as well as the descriptive quality of their learned features in biochemical graph data exploration tasks.


title: Efficient Inference For Neural Machine Translation

abstract: Large Transformer models have achieved state-of-the-art results in neural machine translation and have become standard in the field. In this work, we look for the optimal combination of known techniques to optimize inference speed without sacrificing translation quality. We conduct an empirical study that stacks various approaches and demonstrates that combination of replacing decoder self-attention with simplified recurrent units, adopting a deep encoder and a shallow decoder architecture and multi-head attention pruning can achieve up to 109% and 84% speedup on CPU and GPU respectively and reduce the number of parameters by 25% while maintaining the same translation quality in terms of BLEU.


title: Pay Attention to the cough: Early Diagnosis of COVID-19 using Interpretable Symptoms Embeddings with Cough Sound Signal Processing

abstract: COVID-19 (coronavirus disease 2019) pandemic caused by SARS-CoV-2 has led to a treacherous and devastating catastrophe for humanity. At the time of writing, no specific antivirus drugs or vaccines are recommended to control infection transmission and spread. The current diagnosis of COVID-19 is done by Reverse-Transcription Polymer Chain Reaction (RT-PCR) testing. However, this method is expensive, time-consuming, and not easily available in straitened regions. An interpretable and COVID-19 diagnosis AI framework is devised and developed based on the cough sounds features and symptoms metadata to overcome these limitations. The proposed framework's performance was evaluated using a medical dataset containing Symptoms and Demographic data of 30000 audio segments, 328 cough sounds from 150 patients with four cough classes ( COVID-19, Asthma, Bronchitis, and Healthy). Experiments' results show that the model captures the better and robust feature embedding to distinguish between COVID-19 patient coughs and several types of non-COVID-19 coughs with higher specificity and accuracy of 95.04 $\pm$ 0.18% and 96.83$\pm$ 0.18% respectively, all the while maintaining interpretability.


title: The Effectiveness of Memory Replay in Large Scale Continual Learning

abstract: We study continual learning in the large scale setting where tasks in the input sequence are not limited to classification, and the outputs can be of high dimension. Among multiple state-of-the-art methods, we found vanilla experience replay (ER) still very competitive in terms of both performance and scalability, despite its simplicity. However, a degraded performance is observed for ER with small memory. A further visualization of the feature space reveals that the intermediate representation undergoes a distributional drift. While existing methods usually replay only the input-output pairs, we hypothesize that their regularization effect is inadequate for complex deep models and diverse tasks with small replay buffer size. Following this observation, we propose to replay the activation of the intermediate layers in addition to the input-output pairs. Considering that saving raw activation maps can dramatically increase memory and compute cost, we propose the Compressed Activation Replay technique, where compressed representations of layer activation are saved to the replay buffer. We show that this approach can achieve superior regularization effect while adding negligible memory overhead to replay method. Experiments on both the large-scale Taskonomy benchmark with a diverse set of tasks and standard common datasets (Split-CIFAR and Split-miniImageNet) demonstrate the effectiveness of the proposed method.


title: Providing Actionable Feedback in Hiring Marketplaces using Generative Adversarial Networks

abstract: Machine learning predictors have been increasingly applied in production settings, including in one of the world's largest hiring platforms, Hired, to provide a better candidate and recruiter experience. The ability to provide actionable feedback is desirable for candidates to improve their chances of achieving success in the marketplace. Until recently, however, methods aimed at providing actionable feedback have been limited in terms of realism and latency. In this work, we demonstrate how, by applying a newly introduced method based on Generative Adversarial Networks (GANs), we are able to overcome these limitations and provide actionable feedback in real-time to candidates in production settings. Our experimental results highlight the significant benefits of utilizing a GAN-based approach on our dataset relative to two other state-of-the-art approaches (including over 1000x latency gains). We also illustrate the potential impact of this approach in detail on two real candidate profile examples.


title: Functions definable in definably complete uniformly locally o-minimal structure of the second kind

abstract: We investigate continuous functions definable in a definably complete uniformly locally o-minimal expansion of the second kind of a densely linearly ordered abelian group (DCULOAS structure). We prove a variant of the Arzela-Ascoli theorem for uniformly continuous definable functions and the following assertion: Consider the parameterized function $f:C \times P \rightarrow M$ which is equi-continuous with respect to $P$. The projection image of the set at which $f$ is discontinuous to the parameter space $P$ is of dimension smaller than $\dim P$ when $C$ is closed and bounded. In addition, we demonstrate that an archimedean DCULOAS structure which enjoys definable Tietze extension property is o-minimal. In the appendix, we show that an o-minimal expansion of an ordered group is not semi-bounded if and only if it enjoys definable Tietze extension property.


title: BVOT: Self-Tallying Boardroom Voting with Oblivious Transfer

abstract: A boardroom election is an election with a small number of voters carried out with public communications. We present BVOT, a self-tallying boardroom voting protocol with ballot secrecy, fairness (no tally information is available before the polls close), and dispute-freeness (voters can observe that all voters correctly followed the protocol). BVOT works by using a multiparty threshold homomorphic encryption system in which each candidate is associated with a masked unique prime. Each voter engages in an oblivious transfer with an untrusted distributor: the voter selects the index of a prime associated with a candidate and receives the selected prime in masked form. The voter then casts their vote by encrypting their masked prime and broadcasting it to everyone. The distributor does not learn the voter's choice, and no one learns the mapping between primes and candidates until the audit phase. By hiding the mapping between primes and candidates, BVOT provides voters with insufficient information to carry out effective cheating. The threshold feature prevents anyone from computing any partial tally---until everyone has voted. Multiplying all votes, their decryption shares, and the unmasking factor yields a product of the primes each raised to the number of votes received. In contrast to some existing boardroom voting protocols, BVOT does not rely on any zero-knowledge proof; instead, it uses oblivious transfer to assure ballot secrecy and correct vote casting. Also, BVOT can handle multiple candidates in one election. BVOT prevents cheating by hiding crucial information: an attempt to increase the tally of one candidate might increase the tally of another candidate. After all votes are cast, any party can tally the votes.


title: Lagrangian submanifolds of Adjoint semisimple orbits given by real forms

abstract: We found some Lagrangian submanifolds of the adjoint semisimple orbit in two cases. For the first, the compact case, also known as the Generalized flag manifolds, we prove that the real flags can be seen as infinitesimally tight Lagrangian submanifolds with respect to the KKS symplectic form and we give a complete classification. And for the second, the complex case, we prove that the orbits of real forms are Lagrangian submanifolds with respect to the Hermitian symplectic form.


title: On the Role of Supervision in Unsupervised Constituency Parsing

abstract: We analyze several recent unsupervised constituency parsing models, which are tuned with respect to the parsing $F_1$ score on the Wall Street Journal (WSJ) development set (1,700 sentences). We introduce strong baselines for them, by training an existing supervised parsing model (Kitaev and Klein, 2018) on the same labeled examples they access. When training on the 1,700 examples, or even when using only 50 examples for training and 5 for development, such a few-shot parsing approach can outperform all the unsupervised parsing methods by a significant margin. Few-shot parsing can be further improved by a simple data augmentation method and self-training. This suggests that, in order to arrive at fair conclusions, we should carefully consider the amount of labeled data used for model development. We propose two protocols for future work on unsupervised parsing: (i) use fully unsupervised criteria for hyperparameter tuning and model selection; (ii) use as few labeled examples as possible for model development, and compare to few-shot parsing trained on the same labeled examples.


title: Splitting Gaussian Process Regression for Streaming Data

abstract: Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In particular, the cubic time complexity of updating standard Gaussian process models make them generally unsuitable for application to streaming data. We propose an algorithm for sequentially partitioning the input space and fitting a localized Gaussian process to each disjoint region. The algorithm is shown to have superior time and space complexity to existing methods, and its sequential nature permits application to streaming data. The algorithm constructs a model for which the time complexity of updating is tightly bounded above by a pre-specified parameter. To the best of our knowledge, the model is the first local Gaussian process regression model to achieve linear memory complexity. Theoretical continuity properties of the model are proven. We demonstrate the efficacy of the resulting model on multi-dimensional regression tasks for streaming data.


title: Improving Nonparametric Density Estimation with Tensor Decompositions

abstract: While nonparametric density estimators often perform well on low dimensional data, their performance can suffer when applied to higher dimensional data, owing presumably to the curse of dimensionality. One technique for avoiding this is to assume no dependence between features and that the data are sampled from a separable density. This allows one to estimate each marginal distribution independently thereby avoiding the slow rates associated with estimating the full joint density. This is a strategy employed in naive Bayes models and is analogous to estimating a rank-one tensor. In this paper we investigate whether these improvements can be extended to other simplified dependence assumptions which we model via nonnegative tensor decompositions. In our central theoretical results we prove that restricting estimation to low-rank nonnegative PARAFAC or Tucker decompositions removes the dimensionality exponent on bin width rates for multidimensional histograms. These results are validated experimentally with high statistical significance via direct application of existing nonnegative tensor factorization to histogram estimators.


title: Concentrated Radiative Cooling

abstract: A fundamental limit of current radiative cooling systems is that only the top surface facing deep-space can provide the radiative cooling effect, while the bottom surface cannot. Here, we propose and experimentally demonstrate a concept of "concentrated radiative cooling" by nesting a radiative cooling system in a mid-infrared reflective trough, so that the lower surface, which does not contribute to radiative cooling in previous systems, can radiate heat to deep-space via the reflective trough. Field experiments show that the temperature drop of a radiative cooling pipe with the trough is more than double that of the standalone radiative cooling pipe. Furthermore, by integrating the concentrated radiative cooling system as a preconditioner in an air conditioning system, we predict electricity savings of $>75\%$ in Phoenix, AZ, and $>80\%$ in Reno, NV, for a single-story commercial building.


title: Urod algebras and Translation of W-algebras

abstract: In this work, we introduce Urod algebras associated to simply-laced Lie algebras as well as the concept of translation of W-algebras. Both results are achieved by showing that the quantum Hamiltonian reduction commutes with tensoring with integrable representations, that is, for $V$ and $L$ an affine vertex algebra and an integrable affine vertex algebra associated with $\mathfrak{g}$, we have the vertex algebra isomorphism $H_{DS,f}^0(V\otimes L)\cong H_{DS,f}^0(V)\otimes L$, where in the left-hand-side the Drinfeld-Sokolov reduction is taken with respect to the diagonal action of $\widehat{\mathfrak{g}}$ on $V\otimes L$. The proof is based on some new constructionof automorphisms of vertex algebras, which may be of independent interest. As corollaries we get fusion categories of modules of many exceptional W-algebras and we can construct various corner vertex algebras. A major motivation for this work is that Urod algebras of type $A$ provide a representation theoretic interpretation of the celebrated Nakajima-Yoshioka blowup equations for the moduli space of framed torsion free sheaves on $\mathbb{CP}^2$ of an arbitrary rank.


title: UnQovering Stereotyping Biases via Underspecified Questions

abstract: While language embeddings have been shown to have stereotyping biases, how these biases affect downstream question answering (QA) models remains unexplored. We present UNQOVER, a general framework to probe and quantify biases through underspecified questions. We show that a naive use of model scores can lead to incorrect bias estimates due to two forms of reasoning errors: positional dependence and question independence. We design a formalism that isolates the aforementioned errors. As case studies, we use this metric to analyze four important classes of stereotypes: gender, nationality, ethnicity, and religion. We probe five transformer-based QA models trained on two QA datasets, along with their underlying language models. Our broad study reveals that (1) all these models, with and without fine-tuning, have notable stereotyping biases in these classes; (2) larger models often have higher bias; and (3) the effect of fine-tuning on bias varies strongly with the dataset and the model size.


title: Modeling Preconditions in Text with a Crowd-sourced Dataset

abstract: Preconditions provide a form of logical connection between events that explains why some events occur together and information that is complementary to the more widely studied relations such as causation, temporal ordering, entailment, and discourse relations. Modeling preconditions in text has been hampered in part due to the lack of large scale labeled data grounded in text. This paper introduces PeKo, a crowd-sourced annotation of preconditions between event pairs in newswire, an order of magnitude larger than prior text annotations. To complement this new corpus, we also introduce two challenge tasks aimed at modeling preconditions: (i) Precondition Identification -- a standard classification task defined over pairs of event mentions, and (ii) Precondition Generation -- a generative task aimed at testing a more general ability to reason about a given event. Evaluation on both tasks shows that modeling preconditions is challenging even for today's large language models (LM). This suggests that precondition knowledge is not easily accessible in LM-derived representations alone. Our generation results show that fine-tuning an LM on PeKo yields better conditional relations than when trained on raw text or temporally-ordered corpora.


title: Shot in the Dark: Few-Shot Learning with No Base-Class Labels

abstract: Few-shot learning aims to build classifiers for new classes from a small number of labeled examples and is commonly facilitated by access to examples from a distinct set of 'base classes'. The difference in data distribution between the test set (novel classes) and the base classes used to learn an inductive bias often results in poor generalization on the novel classes. To alleviate problems caused by the distribution shift, previous research has explored the use of unlabeled examples from the novel classes, in addition to labeled examples of the base classes, which is known as the transductive setting. In this work, we show that, surprisingly, off-the-shelf self-supervised learning outperforms transductive few-shot methods by 3.9% for 5-shot accuracy on miniImageNet without using any base class labels. This motivates us to examine more carefully the role of features learned through self-supervision in few-shot learning. Comprehensive experiments are conducted to compare the transferability, robustness, efficiency, and the complementarity of supervised and self-supervised features.


title: Multi-harmonic Hamiltonian models with applications to first-order resonances

abstract: In this work, two multi-harmonic Hamiltonian models for mean motion resonances are formulated and their applications to first-order resonances are discussed. For the $k_p$:$k$ resonance, the usual critical argument $\varphi = k \lambda - k_p \lambda_p + (k_p - k) \varpi$ is taken as the resonant angle in the first model, while the second model is characterized by a new critical argument $\sigma = \varphi / k_p$. Based on canonical transformations, the resonant Hamiltonians associated with these two models are formulated. It is found that the second Hamiltonian model holds two advantages in comparison to the first model: (a) providing a direct correspondence between phase portraits and Poincar\'e sections, and (b) presenting new phase-phase structures where the zero-eccentricity point is a visible saddle point. Then, the second Hamiltonian model is applied to the first-order inner and outer resonances, including the 2:1, 3:2, 4:3, 2:3 and 3:4 resonances. The phase-space structures of these first-order resonances are discussed in detail and then the libration centers and associated resonant widths are identified analytically. Simulation results show that there are pericentric and apocentric libration zones where the libration centers diverge away from the nominal resonance location as the eccentricity approaches zero and, in particular, the resonance separatrices do not vanish at arbitrary eccentricities for both the inner and outer (first-order) resonances.


title: A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inference

abstract: Recent increases in the computational demands of deep neural networks (DNNs), combined with the observation that most input samples require only simple models, have sparked interest in $input$-$adaptive$ multi-exit architectures, such as MSDNets or Shallow-Deep Networks. These architectures enable faster inferences and could bring DNNs to low-power devices, e.g., in the Internet of Things (IoT). However, it is unknown if the computational savings provided by this approach are robust against adversarial pressure. In particular, an adversary may aim to slowdown adaptive DNNs by increasing their average inference time$-$a threat analogous to the $denial$-$of$-$service$ attacks from the Internet. In this paper, we conduct a systematic evaluation of this threat by experimenting with three generic multi-exit DNNs (based on VGG16, MobileNet, and ResNet56) and a custom multi-exit architecture, on two popular image classification benchmarks (CIFAR-10 and Tiny ImageNet). To this end, we show that adversarial example-crafting techniques can be modified to cause slowdown, and we propose a metric for comparing their impact on different architectures. We show that a slowdown attack reduces the efficacy of multi-exit DNNs by 90-100%, and it amplifies the latency by 1.5-5$\times$ in a typical IoT deployment. We also show that it is possible to craft universal, reusable perturbations and that the attack can be effective in realistic black-box scenarios, where the attacker has limited knowledge about the victim. Finally, we show that adversarial training provides limited protection against slowdowns. These results suggest that further research is needed for defending multi-exit architectures against this emerging threat. Our code is available at https://github.com/sanghyun-hong/deepsloth.


title: Active Feature Acquisition with Generative Surrogate Models

abstract: Many real-world situations allow for the acquisition of additional relevant information when making an assessment with limited or uncertain data. However, traditional ML approaches either require all features to be acquired beforehand or regard part of them as missing data that cannot be acquired. In this work, we consider models that perform active feature acquisition (AFA) and query the environment for unobserved features to improve the prediction assessments at evaluation time. Our work reformulates the Markov decision process (MDP) that underlies the AFA problem as a generative modeling task and optimizes a policy via a novel model-based approach. We propose learning a generative surrogate model (GSM) that captures the dependencies among input features to assess potential information gain from acquisitions. The GSM is leveraged to provide intermediate rewards and auxiliary information to aid the agent navigate a complicated high-dimensional action space and sparse rewards. Furthermore, we extend AFA in a task we coin active instance recognition (AIR) for the unsupervised case where the target variables are the unobserved features themselves and the goal is to collect information for a particular instance in a cost-efficient way. Empirical results demonstrate that our approach achieves considerably better performance than previous state of the art methods on both supervised and unsupervised tasks.


title: The Sequence-to-Sequence Baseline for the Voice Conversion Challenge 2020: Cascading ASR and TTS

abstract: This paper presents the sequence-to-sequence (seq2seq) baseline system for the voice conversion challenge (VCC) 2020. We consider a naive approach for voice conversion (VC), which is to first transcribe the input speech with an automatic speech recognition (ASR) model, followed using the transcriptions to generate the voice of the target with a text-to-speech (TTS) model. We revisit this method under a sequence-to-sequence (seq2seq) framework by utilizing ESPnet, an open-source end-to-end speech processing toolkit, and the many well-configured pretrained models provided by the community. Official evaluation results show that our system comes out top among the participating systems in terms of conversion similarity, demonstrating the promising ability of seq2seq models to convert speaker identity. The implementation is made open-source at: https://github.com/espnet/espnet/tree/master/egs/vcc20.


title: The enclosure method using a single point on the graph of the response operator for the Stokes system

abstract: An inverse obstacle problem governed by the Stokes system in the time domain is considered. Two types of extraction formulae about the geometry of an unknown obstacle are given by using the most recent version of the time domain enclosure method in a unified style. Each of the formulae employs only a single set of velocity and the Cauchy stress fields over a finite time interval on the surface of the region where a viscous incompressible fluid occupies.


title: Byzantine Geoconsensus

abstract: We define and investigate the consensus problem for a set of $N$ processes embedded on the $d$-dimensional plane, $d\geq 2$, which we call the {\em geoconsensus} problem. The processes have unique coordinates and can communicate with each other through oral messages. In contrast to the literature where processes are individually considered Byzantine, it is considered that all processes covered by a finite-size convex fault area $F$ are Byzantine and there may be one or more processes in a fault area. Similarly as in the literature where correct processes do not know which processes are Byzantine, it is assumed that the fault area location is not known to the correct processes. We prove that the geoconsensus is impossible if all processes may be covered by at most three areas where one is a fault area. Considering the 2-dimensional embedding, on the constructive side, for $M \geq 1$ fault areas $F$ of arbitrary shape with diameter $D$, we present a consensus algorithm that tolerates $f\leq N-(2M+1)$ Byzantine processes provided that there are $9M+3$ processes with pairwise distance between them greater than $D$. For square $F$ with side $\ell$, we provide a consensus algorithm that lifts this pairwise distance requirement and tolerates $f\leq N-15M$ Byzantine processes given that all processes are covered by at least $22M$ axis aligned squares of the same size as $F$. For a circular $F$ of diameter $\ell$, this algorithm tolerates $f\leq N-57M$ Byzantine processes if all processes are covered by at least $85M$ circles. We then extend these results to various size combinations of fault and non-fault areas as well as $d$-dimensional process embeddings, $d\geq 3$.


title: Ab initio dipolar electron-phonon interactions in two-dimensional materials

abstract: We develop an ab initio formalism for dipolar electron-phonon interactions (EPI) in two-dimensional (2D) materials. Unlike purely longitudinal Fr\"ohlich model, we show that the out-of-plane dipoles also contribute to the long-wavelength non-analytical behavior of EPI. And the 2D dipolar EPI plays an important role not only in the typical polar material MoS$_2$, but also in graphane and fluorinated graphene. By incorporating this formalism into Wannier-Fourier interpolation, we enable accurate EPI calculations for 2D materials and subsequent intrinsic carrier mobility prediction. The results show that Fr\"ohlich model is inadequate for 2D materials and correct long-wavelength interaction must be included for the reliable prediction.


title: Daejeon16 interaction with contact-term corrections for heavy nuclear systems

abstract: The Daejeon16 two-nucleon interaction is employed in many-body approaches based on the mean-field approximation. The perturbative character of Daejeon16 is verified by comparing results for 16O from the Hartree-Fock (HF) approximation and from the no-core shell model and by examining the magnitude of perturbative corrections to the HF energy in light and heavy nuclei. In order to approximately describe energies and radii across the nuclear chart, a phenomenological correction in the form of a two-plus-three-nucleon contact interaction is introduced. With fitted parameters we achieve a very good description of medium-mass nuclei in terms of energy and size and also in terms of the centroid energy of the giant monopole resonance and the dipole polarizability calculated within the random-phase approximation (RPA). Our results provide further justification for the use of Daejeon16 augmented with phenomenological corrections as an effective interaction of perturbative character in a variety of applications.


title: The evolution of high-fidelity social learning

abstract: A defining feature of human culture is that knowledge and technology continually improve over time. Such cumulative cultural evolution (CCE) probably depends far more heavily on how reliably information is preserved than on how efficiently it is refined. Therefore, one possible reason that CCE appears diminished or absent in other species is that it requires accurate but specialized forms of social learning at which humans are uniquely adept. Here, we develop a Bayesian model to contrast the evolution of high-fidelity social learning, which supports CCE, against low-fidelity social learning, which does not. We find that high-fidelity transmission evolves when (1) social and (2) individual learning are inexpensive, (3) traits are complex, (4) individual learning is abundant, (5) adaptive problems are difficult and (6) behaviour is flexible. Low-fidelity transmission differs in many respects. It not only evolves when (2) individual learning is costly and (4) infrequent but also proves more robust when (3) traits are simple and (5) adaptive problems are easy. If conditions favouring the evolution of high-fidelity transmission are stricter (3 and 5) or harder to meet (2 and 4), this could explain why social learning is common, but CCE is rare.


title: Localized and Distributed H2 State Feedback Control

abstract: Distributed linear control design is crucial for large-scale cyber-physical systems. It is generally desirable to both impose information exchange (communication) constraints on the distributed controller, and to limit the propagation of disturbances to a local region without cascading to the global network (localization). Recently proposed System Level Synthesis (SLS) theory provides a framework where such communication and localization requirements can be tractably incorporated in controller design and implementation. In this work, we derive a solution to the localized and distributed H2 state feedback control problem without resorting to Finite Impulse Response (FIR) approximation. Our proposed synthesis algorithm allows a column-wise decomposition of the resulting convex program, and is therefore scalable to arbitrary large-scale networks. We demonstrate superior cost performance and computation time of the proposed procedure over previous methods via numerical simulation.


title: Physical Nature of the Eclipsing {\delta} Scuti Star AO Serpentis

abstract: We present the absolute properties of the eclipsing binary AO Ser with a pulsating component from our $BV$ photometric and high-resolution spectroscopic observations, which were performed between April and May 2017. The radial velocities (RVs) for both components were measured, and the effective temperature and projected rotational velocity of the primary star were determined to be $T_{\rm eff,1}$ = 8,820 $\pm$ 62 K and $v_1 \sin i_{1}$ = 90 $\pm$ 18 km s$^{-1}$, respectively, by comparing the observed spectrum with the Kurucz models. The accurate fundamental parameters of AO Ser were determined by a simultaneous analysis of the light and RV curves. The masses and radii of the primary and secondary components are $M_1$ = 2.55 $\pm$ 0.09 M$_\odot$ and $R_1$ = 1.64 $\pm$ 0.02 R$_\odot$ and $M_2$ = 0.49 $\pm$ 0.02 M$_\odot$ and $R_2$ = 1.38 $\pm$ 0.02 R$_\odot$, respectively. Multiple frequency analyses for the eclipse-subtracted light residuals were conducted. As a result, we detected two frequencies of $f_1$ = 21.852 days$^{-1}$ and $f_2$ = 23.484 days$^{-1}$. The evolutionary position on the HR diagram and the pulsational characteristics indicate that the primary star is a $\delta$ Sct pulsator with a radial fundamental mode. On the other hand, the relatively evolved secondary is oversized for its own mass.


title: Quantum Computing Solution of DC Power Flow

abstract: In this paper, we model and solve a fundamental power system problem, i.e., DC power flow, using a practical quantum computer. The Harrow-Hassidim-Lloyd (HHL) quantum algorithm is used to solve the DC power flow problem. The HHL algorithm for the solution of a system of linear equations (SLE) offers an exponential speedup over the classical computers. The speedup advantage is more significant when the size and the frequency of solving the power flow problem become more substantial. Verified quantum computing applications to power systems are merely nonexistent at this point. Through this paper, we plan to (1) provide a proof-of-concept that practical power system problems can be solved using quantum technology, (2) build a quantum-grid foundation by solving a fundamental power system problem with applications in many other critical grid problems, and (3) apply HHL to solve an SLE which has broad applications in many power system problems. A small 3-bus system is used for testing and demonstration purposes, considering the limitations of the available quantum computing hardware and software. The proposed method's merits and effectiveness are demonstrated using IBM open-source quantum computer and reported through proof-of-concept experimental demonstration using a 4-qubit quantum information processor.


title: Multi-Fact Correction in Abstractive Text Summarization

abstract: Pre-trained neural abstractive summarization systems have dominated extractive strategies on news summarization performance, at least in terms of ROUGE. However, system-generated abstractive summaries often face the pitfall of factual inconsistency: generating incorrect facts with respect to the source text. To address this challenge, we propose Span-Fact, a suite of two factual correction models that leverages knowledge learned from question answering models to make corrections in system-generated summaries via span selection. Our models employ single or multi-masking strategies to either iteratively or auto-regressively replace entities in order to ensure semantic consistency w.r.t. the source text, while retaining the syntactic structure of summaries generated by abstractive summarization models. Experiments show that our models significantly boost the factual consistency of system-generated summaries without sacrificing summary quality in terms of both automatic metrics and human evaluation.


title: Distributed Coding of Quantized Random Projections

abstract: In this paper we propose a new framework for distributed source coding of structured sources, such as sparse signals. Our framework capitalizes on recent advances in the theory of linear inverse problems and signal representations using incoherent projections. Our approach acquires and quantizes incoherent linear measurements of the signal, which are represented as separate bitplanes. Each bitplane is coded using a distributed source code of the appropriate rate, and transmitted. The decoder, starts from the least significant biplane and, using a prediction of the signal as side information, iteratively recovers each bitplane based on the source prediction and the signal, assuming all the previous bitplanes of lower significance have already been recovered. We provide theoretical results guiding the rate selection, relying only on the least squares prediction error of the source. This is in contrast to existing approaches which rely on difficult-to-estimate information-theoretic metrics to set the rate. We validate our approach using simulations on remote-sensing multispectral images, comparing them with existing approaches of similar complexity.


title: The x-dependence of hadronic parton distributions: A review on the progress of lattice QCD

abstract: In this article, we review recent lattice calculations on the $x$-dependence of parton distributions, with the latter providing information on hadron structure. These calculations are based on matrix elements of boosted hadrons coupled to non-local operators and can be related to the standard, light-cone distribution functions via an appropriate factorization formalism. There is significant progress in several directions, including calculations of flavor singlet parton distribution functions (PDFs), first calculations of generalized parton distributions (GPDs), as well as the implementation of some of the approaches for the transverse-momentum-dependent PDFs (TMD PDFs). This new direction of lattice calculations is particularly interesting for phenomenological fits on experimental data sets, as the lattice results can help to improve the constraints on the distribution functions.


title: Homomorphisms of commutator subgroups of braid groups with small number of strings

abstract: For any $n$, we describe all endomorphisms of the braid group $B_n$ and of its commutator subgroup $B'_n$, as well as all homomorphisms $B'_n\to B_n$. These results are new only for small $n$ because endomorphisms of $B_n$ are already described by Castel for $n\ge 6$, and homomorphisms $B'_n\to B_n$ and endomorphisms of $B'_n$ are already described by Kordek and Margalit for $n\ge 7$. We use very different approaches for $n=4$ and for $n\ge 5$.


title: Error Analysis of Finite Element Approximations of Diffusion Coefficient Identification for Elliptic and Parabolic Problems

abstract: In this work, we present a novel error analysis for recovering a spatially dependent diffusion coefficient in an elliptic or parabolic problem. It is based on the standard regularized output least-squares formulation with an $H^1(\Omega)$ seminorm penalty, and then discretized using the Galerkin finite element method with conforming piecewise linear finite elements for both state and coefficient, and backward Euler in time in the parabolic case. We derive \textit{a priori} weighted $L^2(\Omega)$ estimates where the constants depend only on the given problem data for both elliptic and parabolic cases. Further, these estimates also allow deriving standard $L^2(\Omega)$ error estimates, under a positivity condition that can be verified for certain problem data. Numerical experiments are provided to complement the error analysis.


title: On the Branching Bias of Syntax Extracted from Pre-trained Language Models

abstract: Many efforts have been devoted to extracting constituency trees from pre-trained language models, often proceeding in two stages: feature definition and parsing. However, this kind of methods may suffer from the branching bias issue, which will inflate the performances on languages with the same branch it biases to. In this work, we propose quantitatively measuring the branching bias by comparing the performance gap on a language and its reversed language, which is agnostic to both language models and extracting methods. Furthermore, we analyze the impacts of three factors on the branching bias, namely parsing algorithms, feature definitions, and language models. Experiments show that several existing works exhibit branching biases, and some implementations of these three factors can introduce the branching bias.


title: On the Universality of Rotation Equivariant Point Cloud Networks

abstract: Learning functions on point clouds has applications in many fields, including computer vision, computer graphics, physics, and chemistry. Recently, there has been a growing interest in neural architectures that are invariant or equivariant to all three shape-preserving transformations of point clouds: translation, rotation, and permutation. In this paper, we present a first study of the approximation power of these architectures. We first derive two sufficient conditions for an equivariant architecture to have the universal approximation property, based on a novel characterization of the space of equivariant polynomials. We then use these conditions to show that two recently suggested models are universal, and for devising two other novel universal architectures.


title: Neutron skin thickness of ${}^{208}$Pb determined from reaction cross section for proton scattering

abstract: The reaction cross section $\sigma_R$ is useful to determine the neutron radius $R_n$ as well as the matter radius $R_m$. The chiral (Kyushu) $g$-matrix folding model for $^{12}$C scattering on $^{9}$Be, $^{12}$C, $^{27}$Al targets was tested in the incident energy range of $30 \lsim E_{\rm in} \lsim 400 $ MeV, and it is found that the model reliably reproduces the $\sigma_R$ in $30 \lsim E_{\rm in} \lsim 100 $ MeV and $250 \lsim E_{\rm in} \lsim 400$ MeV. \item[Aim] We determine $R_n$ and the neutron skin thickness $R_{\rm skin}$ of ${}^{208}{\rm Pb}$ by using high-quality $\sigma_R$ data for the $p+{}^{208}{\rm Pb}$ scattering in $30 \leq E_{\rm in} \leq 100$ MeV. The theoretical model is the Kyushu $g$-matrix folding model with the densities calculated with Gongny-D1S HFB (GHFB) with the angular momentum projection (AMP). \item[Results] The Kyushu $g$-matrix folding model with the GHFB+AMP densities underestimates $\sigma_{\rm R}$ in $30 \leq E_{\rm in} \leq 100$~MeV only by a factor of 0.97. Since the proton radius $R_p$ calculated with GHFB+AMP agrees with the precise experimental data of 5.444 fm, the small deviation of the theoretical result from the data on $\sigma_R$ allows us to scale the GHFB+AMP neutron density so as to reproduce the $\sigma_R$ data. In $E_{\rm in}$ = 30--100 MeV, the experimental $\sigma_R$ data can be reproduced by assuming the neutron radius of ${}^{208}{\rm Pb}$ as $R_n$ = $5.722 \pm 0.035$ fm. \item[Conclusion] The present result $R_{\rm skin}$ = $0.278 \pm 0.035$ fm is in good agreement with the recent PREX-II result of $r_{\rm skin}$ = $0.283\pm 0.071$ fm.


title: Collaboratively boosting data-driven deep learning and knowledge-guided ontological reasoning for semantic segmentation of remote sensing imagery

abstract: As one kind of architecture from the deep learning family, deep semantic segmentation network (DSSN) achieves a certain degree of success on the semantic segmentation task and obviously outperforms the traditional methods based on hand-crafted features. As a classic data-driven technique, DSSN can be trained by an end-to-end mechanism and competent for employing the low-level and mid-level cues (i.e., the discriminative image structure) to understand images, but lacks the high-level inference ability. By contrast, human beings have an excellent inference capacity and can be able to reliably interpret the RS imagery only when human beings master the basic RS domain knowledge. In literature, ontological modeling and reasoning is an ideal way to imitate and employ the domain knowledge of human beings, but is still rarely explored and adopted in the RS domain. To remedy the aforementioned critical limitation of DSSN, this paper proposes a collaboratively boosting framework (CBF) to combine data-driven deep learning module and knowledge-guided ontological reasoning module in an iterative way.


title: Nonstandard Representation of the Dirichlet Form

abstract: The Dirichlet form is a generalization of the Laplacian, heavily used in the study of many diffusion-like processes. In this paper we present a nonstandard representation theorem for the Dirichlet form, showing that the usual Dirichlet form can be well-approximated by a hyperfinite sum. One of the main motivations for such a result is to provide a tool for directly translating results about Dirichlet forms on finite or countable state spaces to results on more general state spaces, without having to translate the details of the proofs. As an application, we prove a generalization of a well-known comparison theorem for Markov chains on finite state spaces, and also relate our results to previous generalization attempts.


title: Stellar Mass Black Hole Formation and Multi-messenger Signals from Three Dimensional Rotating Core-Collapse Supernova Simulations

abstract: We present self-consistent, 3D core-collapse supernova simulations of a 40 Msun progenitor model using the isotropic diffusion source approximation for neutrino transport and an effective general relativistic potential up to $\sim0.9$~s~postbounce. We consider three different rotational speeds with initial angular velocities of $\Omega_0=0$,~0.5, and~1~rad~s$^{-1}$ and investigate the impact of rotation on shock dynamics, black hole formation, and gravitational wave signals. The rapidly-rotating model undergoes an early explosion at $\sim 250$~ms postbounce and shows signs of the low $T/|W|$ instability. We do not find black hole formation in this model within $\sim 460$~ms postbounce. In contrast, we find black hole formation at 776~ms~postbounce and 936~ms~postbounce for the non-rotating and slowly-rotating models, respectively. The slowly-rotating model explodes at $\sim 650$~ms postbounce, and the subsequent fallback accretion onto the proto-neutron star (PNS) results in BH formation. In addition, the standing~accretion~shock~instability induces rotation of the proto-neutron star in the model that started with a non-rotating progenitor. Assuming conservation of specific angular momentum during black hole formation, this corresponds to a black~hole spin parameter of $a=J/M=0.046$. However, if no explosion sets in, all the angular momentum will eventually be accreted by the BH, resulting in a non-spinning BH. The successful explosion of the slowly-rotating model drastically slows down the accretion onto the PNS, allowing continued cooling and contraction that results in an extremely high gravitational-wave frequency ($f\sim3000$~Hz) at black~hole formation, while the non-rotating model generates gravitational wave signals similar to our corresponding 2D simulations.


title: Energy-momentum tensor of special relativistic fluids and Connection of relativistic and non-relativistic fluids in the new scaling

abstract: In this paper, the relativistic fluids with the negligible magnetic field in the flat metric are studied. The iso-dimension scale in introduced, in this scale, all similar components of a variable have the same dimension. Also, the components of shear, bulk and heat flux tensors and the components of energy-momentum tensors are calculated in the cylindrical and spherical coordinate systems, all these components are derived in the iso-dimension scale. The non-relativistic shear, bulk and heat flux tensors and the components of energy-momentum tensor are derived in the limit of the relativistic fluids. Also, the connection of relativistic and non-relativistic fluids are seen. So, some distinctions of relativistic and non-relativistic fluids are displayed, for example in the relativistic fluids, the time derivative of velocity is created the shear stress tensor and derivative of velocity and temperature is created the heat flux energy-momentum tensor, etc.


title: An ultra-stable 1.5 tesla permanent magnet assembly for qubit experiments at cryogenic temperatures

abstract: Magnetic fields are a standard tool in the toolbox of every physicist, and are required for the characterization of materials, as well as the polarization of spins in nuclear magnetic resonance or electron paramagnetic resonance experiments. Quite often a static magnetic field of sufficiently large, but fixed magnitude is suitable for these tasks. Here we present a permanent magnet assembly that can achieve magnetic field strengths of up to 1.5T over an air gap length of 7mm. The assembly is based on a Halbach array of neodymium (NdFeB) magnets, with the inclusion of the soft magnetic material Supermendur to boost the magnetic field strength inside the air gap. We present the design, simulation and characterization of the permanent magnet assembly, measuring an outstanding magnetic field stability with a drift rate of |D| < 2.8 ppb/h. Our measurements demonstrate that this assembly can be used for spin qubit experiments inside a dilution refrigerator, successfully replacing the more expensive and bulky superconducting solenoids.


title: Downscaling Attack and Defense: Turning What You See Back Into What You Get

abstract: The resizing of images, which is typically a required part of preprocessing for computer vision systems, is vulnerable to attack. Images can be created such that the image is completely different at machine-vision scales than at other scales and the default settings for some common computer vision and machine learning systems are vulnerable. We show that defenses exist and are trivial to administer provided that defenders are aware of the threat. These attacks and defenses help to establish the role of input sanitization in machine learning.


title: Task Admission Control and Boundary Analysis of Cognitive Cloud Data Centers

abstract: A novel cloud data center (DC) model is studied here with cognitive capabilities for real-time (or online) flow compared to the batch tasks. Here, a DC can determine the cost of using resources and an online user or the user with batch tasks may decide whether or not to pay for getting the services. The online service tasks have a higher priority in getting the service over batch tasks. Both types of tasks need a certain number of virtual machines (VM). By targeting on the maximization of total discounted reward, an optimal policy for admitting task tasks is finally verified to be a state-related control limit policy. Next, a lower and an upper bound for such an optimal policy are derived, respectively, for the estimation and utilization in reality. Finally, a comprehensive set of experiments on the various cases to validate this proposed model and the solution is conducted. As a demonstration, the machine learning method is adopted to show how to obtain the optimal values by using a feed-forward neural network model. The results achieved in this paper will be expectedly utilized in various cloud data centers with cognitive characteristics in an economically optimal strategy.


title: Identifying Spurious Correlations for Robust Text Classification

abstract: The predictions of text classifiers are often driven by spurious correlations -- e.g., the term `Spielberg' correlates with positively reviewed movies, even though the term itself does not semantically convey a positive sentiment. In this paper, we propose a method to distinguish spurious and genuine correlations in text classification. We treat this as a supervised classification problem, using features derived from treatment effect estimators to distinguish spurious correlations from "genuine" ones. Due to the generic nature of these features and their small dimensionality, we find that the approach works well even with limited training examples, and that it is possible to transport the word classifier to new domains. Experiments on four datasets (sentiment classification and toxicity detection) suggest that using this approach to inform feature selection also leads to more robust classification, as measured by improved worst-case accuracy on the samples affected by spurious correlations.


title: Usable Information and Evolution of Optimal Representations During Training

abstract: We introduce a notion of usable information contained in the representation learned by a deep network, and use it to study how optimal representations for the task emerge during training. We show that the implicit regularization coming from training with Stochastic Gradient Descent with a high learning-rate and small batch size plays an important role in learning minimal sufficient representations for the task. In the process of arriving at a minimal sufficient representation, we find that the content of the representation changes dynamically during training. In particular, we find that semantically meaningful but ultimately irrelevant information is encoded in the early transient dynamics of training, before being later discarded. In addition, we evaluate how perturbing the initial part of training impacts the learning dynamics and the resulting representations. We show these effects on both perceptual decision-making tasks inspired by neuroscience literature, as well as on standard image classification tasks.


title: Hairy Taub-NUT/Bolt-AdS solutions in Horndeski theory

abstract: We present different Taub-NUT/Bolt-anti de Sitter (AdS) solutions in a shift-symmetric sector of Horndeski theory of gravity possessing nonminimal kinetic coupling of scalar fields to the Einstein tensor. In four dimensions, we find locally and asymptotically locally AdS solutions possessing nontrivial scalar field. In higher dimensions, analytical Taub-NUT/Bolt-AdS p-branes and solitons are obtained, supported by the existence of p Horndeski scalar fields with axionic profile. The thermodynamical properties are studied through Euclidean methods and it is found that the first law of thermodynamics is satisfied. Moreover, constraints on the parameter space of Horndeski gravity and NUT charge are obtained by demanding positivity of the mass, entropy, and specific heat of the p-branes and soliton. We briefly comment on future applications in holography.


title: Interplay of spin-orbit coupling and Coulomb interaction in ZnO-based electron system

abstract: Spin-orbit coupling (SOC) is pivotal for various fundamental spin-dependent phenomena in solids and their technological applications. In semiconductors, these phenomena have been so far studied in relatively weak electron-electron interaction regimes, where the single electron picture holds. However, SOC can profoundly compete against Coulomb interaction, which could lead to the emergence of unconventional electronic phases. Since SOC depends on the electric field in the crystal including contributions of itinerant electrons, electron-electron interactions can modify this coupling. Here we demonstrate the emergence of SOC effect in a high-mobility two-dimensional electron system in a simple band structure MgZnO/ZnO semiconductor. This electron system features also strong electron-electron interaction effects. By changing the carrier density with Mg-content, we tune the SOC strength and achieve its interplay with electron-electron interaction. These systems pave a way to emergent spintronic phenomena in strong electron correlation regime and to the formation of novel quasiparticles with the electron spin strongly coupled to the density.


title: Some interesting topics provoked by the solar filament research in the past decade

abstract: Solar filaments are an intriguing phenomenon, like cool clouds suspended in the hot corona. Similar structures exist in the intergalactic medium as well. Despite being a long-studied topic, solar filaments have continually attracted intensive attention because of their link to the coronal heating, coronal seismology, solar flares, and coronal mass ejections (CMEs). In this review paper, by combing through the solar filament-related work done in the past decade, we discuss several controversial topics, such as the fine structures, dynamics, magnetic configurations, and helicity of filaments. With high-resolution and high-sensitivity observations, combined with numerical simulations, it is expected that resolving these disputes will definitely lead to a huge leap in understanding the physics related to solar filaments, and even shed light on galactic filaments.


title: Finitely-additive, countably-additive and internal probability measures

abstract: We discuss two ways to construct standard probability measures, called push-down measures, from internal probability measures. We show that the Wasserstein distance between an internal probability measure and its push-down measure is infinitesimal. As an application to standard probability theory, we show that every finitely-additive Borel probability measure $P$ on a separable metric space is a limit of a sequence of countably-additive Borel probability measures if and only if the space is totally bounded.


title: Buzano, Kre\u{i}n and Cauchy-Schwarz inequalities

abstract: The Cauchy-Schwarz, Buzano and Kre\u{\i}n inequalities are three inequalities about inner product. The main goal of this article is to present refinements of Buzano and Cauchy-Schwarz inequalities, and to present a new proof of a refined version of a Kre\u{\i}n-type inequality. Applications that include Buzano-type inequalities for certain operators, operator norm and numerical radius inequalities of Hilbert space operators will be presented.


title: A study of backward stochastic differential equation on a Riemannian manifold

abstract: Suppose $N$ is a compact Riemannian manifold, in this paper we will introduce the definition of $N$-valued BSDE and $L^2(\mathbb{T}^m;N)$-valued BSDE for which the solution are not necessarily staying in only one local coordinate. Moreover, the global existence of a solution to $L^2(\mathbb{T}^m;N)$-valued BSDE will be proved without any convexity condition on $N$.


title: Are Words Commensurate with Actions? Quantifying Commitment to a Cause from Online Public Messaging

abstract: Public entities such as companies and politicians increasingly use online social networks to communicate directly with their constituencies. Often, this public messaging is aimed at aligning the entity with a particular cause or issue, such as the environment or public health. However, as a consumer or voter, it can be difficult to assess an entity's true commitment to a cause based on public messaging. In this paper, we present a text classification approach to categorize a message according to its commitment level toward a cause. We then compare the volume of such messages with external ratings based on entities' actions (e.g., a politician's voting record with respect to the environment or a company's rating from environmental non-profits). We find that by distinguishing between low- and high- level commitment messages, we can more reliably identify truly committed entities. Furthermore, by measuring the discrepancy between classified messages and external ratings, we can identify entities whose public messaging does not align with their actions, thereby providing a methodology to identify potentially "inauthentic" messaging campaigns.


title: Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays

abstract: Automatic medical image report generation has drawn growing attention due to its potential to alleviate radiologists' workload. Existing work on report generation often trains encoder-decoder networks to generate complete reports. However, such models are affected by data bias (e.g.~label imbalance) and face common issues inherent in text generation models (e.g.~repetition). In this work, we focus on reporting abnormal findings on radiology images; instead of training on complete radiology reports, we propose a method to identify abnormal findings from the reports in addition to grouping them with unsupervised clustering and minimal rules. We formulate the task as cross-modal retrieval and propose Conditional Visual-Semantic Embeddings to align images and fine-grained abnormal findings in a joint embedding space. We demonstrate that our method is able to retrieve abnormal findings and outperforms existing generation models on both clinical correctness and text generation metrics.


title: Visualizing Color-wise Saliency of Black-Box Image Classification Models

abstract: Image classification based on machine learning is being commonly used. However, a classification result given by an advanced method, including deep learning, is often hard to interpret. This problem of interpretability is one of the major obstacles in deploying a trained model in safety-critical systems. Several techniques have been proposed to address this problem; one of which is RISE, which explains a classification result by a heatmap, called a saliency map, which explains the significance of each pixel. We propose MC-RISE (Multi-Color RISE), which is an enhancement of RISE to take color information into account in an explanation. Our method not only shows the saliency of each pixel in a given image as the original RISE does, but the significance of color components of each pixel; a saliency map with color information is useful especially in the domain where the color information matters (e.g., traffic-sign recognition). We implemented MC-RISE and evaluate them using two datasets (GTSRB and ImageNet) to demonstrate the effectiveness of our methods in comparison with existing techniques for interpreting image classification results.


title: Generalized Matrix Factorization: efficient algorithms for fitting generalized linear latent variable models to large data arrays

abstract: Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools such as factor analysis or principal component analysis with a well-established theory and fast algorithms. Generalized Linear Latent Variable models (GLLVMs) generalize such factor models to non-Gaussian responses. However, current algorithms for estimating model parameters in GLLVMs require intensive computation and do not scale to large datasets with thousands of observational units or responses. In this article, we propose a new approach for fitting GLLVMs to high-dimensional datasets, based on approximating the model using penalized quasi-likelihood and then using a Newton method and Fisher scoring to learn the model parameters. Computationally, our method is noticeably faster and more stable, enabling GLLVM fits to much larger matrices than previously possible. We apply our method on a dataset of 48,000 observational units with over 2,000 observed species in each unit and find that most of the variability can be explained with a handful of factors. We publish an easy-to-use implementation of our proposed fitting algorithm.


title: Reflectionless excitation of arbitrary photonic structures: A general theory

abstract: We outline a recently developed theory of impedance-matching, or reflectionless excitation of arbitrary finite photonic structures in any dimension. It describes the necessary and sufficient conditions for perfectly reflectionless excitation to be possible, and specifies how many physical parameters must be tuned to achieve this. In the absence of geometric symmetries the tuning of at least one structural parameter will be necessary to achieve reflectionless excitation. The theory employs a recently identified set of complex-frequency solutions of the Maxwell equations as a starting point, which are defined by having zero reflection into a chosen set of input channels, and which are referred to as R-zeros. Tuning is generically necessary in order to move an R-zero to the real-frequency axis, where it becomes a physical steady-state solution, referred to as a Reflectionless Scattering Mode (RSM). Except in single-channel systems, the RSM corresponds to a particular input wavefront, and any other wavefront will generally not be reflectionless. In a structure with parity and time-reversal symmmetry or with parity-time symmetry, generically a subset of R-zeros is real, and reflectionless states exist without structural tuning. Such systems can exhibit symmetry-breaking transitions when two RSMs meet, which corresponds to a recently identified kind of exceptional point at which the shape of the reflection and transmission resonance lineshape is flattened.


title: Determination for minimum symbol-pair and RT weights via torsional degrees of repeated-root cyclic codes

abstract: There are various metrics for researching error-correcting codes. Especially, high-density data storage system gives the existence of inconsistency for the reading and writing process. The symbol-pair metric is motivated for outputs that have overlapping pairs of symbols in a certain channel. The Rosenbloom-Tsfasman (RT) metric is introduced since there exists a problem that is related to transmission over several parallel communication channels with some channels not available for the transmission. In this paper, we determine the minimum symbol-pair weight and RT weight of repeated-root cyclic codes over $\mathfrak R=\Bbb F_{p^m}[u]/\langle u^4\rangle$ of length $n=p^k$. For the determination, we explicitly present third torsional degree for all different types of cyclic codes over $\mathfrak R$ of length $n$.


title: What Makes a Popular Academic AI Repository?

abstract: Many AI researchers are publishing code, data and other resources that accompany their papers in GitHub repositories. In this paper, we refer to these repositories as academic AI repositories. Our preliminary study shows that highly cited papers are more likely to have popular academic AI repositories (and vice versa). Hence, in this study, we perform an empirical study on academic AI repositories to highlight good software engineering practices of popular academic AI repositories for AI researchers. We collect 1,149 academic AI repositories, in which we label the top 20% repositories that have the most number of stars as popular, and we label the bottom 70% repositories as unpopular. The remaining 10% repositories are set as a gap between popular and unpopular academic AI repositories. We propose 21 features to characterize the software engineering practices of academic AI repositories. Our experimental results show that popular and unpopular academic AI repositories are statistically significantly different in 11 of the studied features---indicating that the two groups of repositories have significantly different software engineering practices. Furthermore, we find that the number of links to other GitHub repositories in the README file, the number of images in the README file and the inclusion of a license are the most important features for differentiating the two groups of academic AI repositories. Our dataset and code are made publicly available to share with the community.


title: Iterative Domain-Repaired Back-Translation

abstract: In this paper, we focus on the domain-specific translation with low resources, where in-domain parallel corpora are scarce or nonexistent. One common and effective strategy for this case is exploiting in-domain monolingual data with the back-translation method. However, the synthetic parallel data is very noisy because they are generated by imperfect out-of-domain systems, resulting in the poor performance of domain adaptation. To address this issue, we propose a novel iterative domain-repaired back-translation framework, which introduces the Domain-Repair (DR) model to refine translations in synthetic bilingual data. To this end, we construct corresponding data for the DR model training by round-trip translating the monolingual sentences, and then design the unified training framework to optimize paired DR and NMT models jointly. Experiments on adapting NMT models between specific domains and from the general domain to specific domains demonstrate the effectiveness of our proposed approach, achieving 15.79 and 4.47 BLEU improvements on average over unadapted models and back-translation.


title: Reward Propagation Using Graph Convolutional Networks

abstract: Potential-based reward shaping provides an approach for designing good reward functions, with the purpose of speeding up learning. However, automatically finding potential functions for complex environments is a difficult problem (in fact, of the same difficulty as learning a value function from scratch). We propose a new framework for learning potential functions by leveraging ideas from graph representation learning. Our approach relies on Graph Convolutional Networks which we use as a key ingredient in combination with the probabilistic inference view of reinforcement learning. More precisely, we leverage Graph Convolutional Networks to perform message passing from rewarding states. The propagated messages can then be used as potential functions for reward shaping to accelerate learning. We verify empirically that our approach can achieve considerable improvements in both small and high-dimensional control problems.


title: Joint COCO and Mapillary Workshop at ICCV 2019: COCO Instance Segmentation Challenge Track

abstract: In this report, we present our object detection/instance segmentation system, MegDetV2, which works in a two-pass fashion, first to detect instances then to obtain segmentation. Our baseline detector is mainly built on a new designed RPN, called RPN++. On the COCO-2019 detection/instance-segmentation test-dev dataset, our system achieves 61.0/53.1 mAP, which surpassed our 2018 winning results by 5.0/4.2 respectively. We achieve the best results in COCO Challenge 2019 and 2020.


title: Limit results for $L^p$ functionals of weighted CUSUM processes

abstract: The cumulative sum (CUSUM) process is often used in change point analysis to detect changes in the mean of sequentially observed data. We provide a full description of the asymptotic distribution of $L^p, 1\leq p <\infty$, functionals of the weighted CUSUM process for time series under general conditions.


title: A Unified Deep Learning Framework for Short-Duration Speaker Verification in Adverse Environments

abstract: Speaker verification (SV) has recently attracted considerable research interest due to the growing popularity of virtual assistants. At the same time, there is an increasing requirement for an SV system: it should be robust to short speech segments, especially in noisy and reverberant environments. In this paper, we consider one more important requirement for practical applications: the system should be robust to an audio stream containing long non-speech segments, where a voice activity detection (VAD) is not applied. To meet these two requirements, we introduce feature pyramid module (FPM)-based multi-scale aggregation (MSA) and self-adaptive soft VAD (SAS-VAD). We present the FPM-based MSA to deal with short speech segments in noisy and reverberant environments. Also, we use the SAS-VAD to increase the robustness to long non-speech segments. To further improve the robustness to acoustic distortions (i.e., noise and reverberation), we apply a masking-based speech enhancement (SE) method. We combine SV, VAD, and SE models in a unified deep learning framework and jointly train the entire network in an end-to-end manner. To the best of our knowledge, this is the first work combining these three models in a deep learning framework. We conduct experiments on Korean indoor (KID) and VoxCeleb datasets, which are corrupted by noise and reverberation. The results show that the proposed method is effective for SV in the challenging conditions and performs better than the baseline i-vector and deep speaker embedding systems.


title: Practical Guide of Using Kendall's {\tau} in the Context of Forecasting Critical Transitions

abstract: Recent studies demonstrate that trends in indicators extracted from measured time series can indicate approaching to an impending transition. Kendall's {\tau} coefficient is often used to study the trend of statistics related to the critical slowing down phenomenon and other methods to forecast critical transitions. Because statistics are estimated from time series, the values of Kendall's {\tau} are affected by parameters such as window size, sample rate and length of the time series, resulting in challenges and uncertainties in interpreting results. In this study, we examine the effects of different parameters on the distribution of the trend obtained from Kendall's {\tau}, and provide insights into how to choose these parameters. We also suggest the use of the non-parametric Mann-Kendall test to evaluate the significance of a Kendall's {\tau} value. The non-parametric test is computationally much faster compared to the traditional parametric ARMA test.


title: A One-bit, Comparison-Based Gradient Estimator

abstract: We study zeroth-order optimization for convex functions where we further assume that function evaluations are unavailable. Instead, one only has access to a $\textit{comparison oracle}$, which given two points $x$ and $y$ returns a single bit of information indicating which point has larger function value, $f(x)$ or $f(y)$. By treating the gradient as an unknown signal to be recovered, we show how one can use tools from one-bit compressed sensing to construct a robust and reliable estimator of the normalized gradient. We then propose an algorithm, coined SCOBO, that uses this estimator within a gradient descent scheme. We show that when $f(x)$ has some low dimensional structure that can be exploited, SCOBO outperforms the state-of-the-art in terms of query complexity. Our theoretical claims are verified by extensive numerical experiments.


title: Pretrained Language Model Embryology: The Birth of ALBERT

abstract: While behaviors of pretrained language models (LMs) have been thoroughly examined, what happened during pretraining is rarely studied. We thus investigate the developmental process from a set of randomly initialized parameters to a totipotent language model, which we refer to as the embryology of a pretrained language model. Our results show that ALBERT learns to reconstruct and predict tokens of different parts of speech (POS) in different learning speeds during pretraining. We also find that linguistic knowledge and world knowledge do not generally improve as pretraining proceeds, nor do downstream tasks' performance. These findings suggest that knowledge of a pretrained model varies during pretraining, and having more pretrain steps does not necessarily provide a model with more comprehensive knowledge. We will provide source codes and pretrained models to reproduce our results at https://github.com/d223302/albert-embryology.


title: Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detection

abstract: Few-shot Intent Detection is challenging due to the scarcity of available annotated utterances. Although recent works demonstrate that multi-level matching plays an important role in transferring learned knowledge from seen training classes to novel testing classes, they rely on a static similarity measure and overly fine-grained matching components. These limitations inhibit generalizing capability towards Generalized Few-shot Learning settings where both seen and novel classes are co-existent. In this paper, we propose a novel Semantic Matching and Aggregation Network where semantic components are distilled from utterances via multi-head self-attention with additional dynamic regularization constraints. These semantic components capture high-level information, resulting in more effective matching between instances. Our multi-perspective matching method provides a comprehensive matching measure to enhance representations of both labeled and unlabeled instances. We also propose a more challenging evaluation setting that considers classification on the joint all-class label space. Extensive experimental results demonstrate the effectiveness of our method. Our code and data are publicly available.


title: Optimal High-order Tensor SVD via Tensor-Train Orthogonal Iteration

abstract: This paper studies a general framework for high-order tensor SVD. We propose a new computationally efficient algorithm, tensor-train orthogonal iteration (TTOI), that aims to estimate the low tensor-train rank structure from the noisy high-order tensor observation. The proposed TTOI consists of initialization via TT-SVD (Oseledets, 2011) and new iterative backward/forward updates. We develop the general upper bound on estimation error for TTOI with the support of several new representation lemmas on tensor matricizations. By developing a matching information-theoretic lower bound, we also prove that TTOI achieves the minimax optimality under the spiked tensor model. The merits of the proposed TTOI are illustrated through applications to estimation and dimension reduction of high-order Markov processes, numerical studies, and a real data example on New York City taxi travel records. The software of the proposed algorithm is available online$^6$.

categories: math.ST cs.LG cs.NA math.NA stat.CO stat.ME stat.TH


title: Abstract polynomial processes

abstract: We suggest a novel approach to polynomial processes solely based on a polynomial action operator. With this approach, we can analyse such processes on general state spaces, going far beyond Banach spaces. Moreover, we can be very flexible in the definition of what "polynomial" means. We show that "polynomial process" universally means "affine drift". Simple assumptions on the polynomial action operators lead to stronger characterisations on the polynomial class of processes. In our framework we do not need to specify polynomials explicitly but can work with a general sequence of graded vector spaces of functions on the state space. Elements of these graded vector spaces form the monomials by introducing a sequence of vector space complements. The basic tool of our analysis is the polynomial action operator, which is a semigroup of operators mapping conditional expected values of monomials acting on the polynomial process to monomials of the same or lower grade. Unlike the classical Euclidean case, the polynomial action operator may not form a finite-dimensional subspace after a finite iteration, a property we call locally finite. We study abstract polynomial processes under both algebraic and topological assumptions on the polynomial actions, and establish an affine drift structure. Moreover, we characterize the covariance structure under similar but slightly stronger conditions. A crucial part in our analysis is the use of the (algebraic or topological) dual of the monomials of grade one, which serves as a linearization of the state space of the polynomial process. Our general framework covers polynomial processes with values in Banach spaces recently studied by Cuchiero and Svaluto-Ferro.


title: Exposure Trajectory Recovery from Motion Blur

abstract: Motion blur in dynamic scenes is an important yet challenging research topic. Recently, deep learning methods have achieved impressive performance for dynamic scene deblurring. However, the motion information contained in a blurry image has yet to be fully explored and accurately formulated because: (i) the ground truth of dynamic motion is difficult to obtain; (ii) the temporal ordering is destroyed during the exposure; and (iii) the motion estimation from a blurry image is highly ill-posed. By revisiting the principle of camera exposure, motion blur can be described by the relative motions of sharp content with respect to each exposed position. In this paper, we define exposure trajectories, which represent the motion information contained in a blurry image and explain the causes of motion blur. A novel motion offset estimation framework is proposed to model pixel-wise displacements of the latent sharp image at multiple timepoints. Under mild constraints, our method can recover dense, (non-)linear exposure trajectories, which significantly reduce temporal disorder and ill-posed problems. Finally, experiments demonstrate that the recovered exposure trajectories not only capture accurate and interpretable motion information from a blurry image, but also benefit motion-aware image deblurring and warping-based video extraction tasks. Codes are available on https://github.com/yjzhang96/Motion-ETR.


title: A dissiptive logarithmic type evolution equation: asymptotic profile and optimal estimates

abstract: We introduce a new model of the logarithmic type of wave-like equation with a nonlocal logarithmic damping mechanism, which is rather weakly effective as compared with frequently studied fractional damping cases. We consider the Cauchy problem for this new model in the whole space, and study the asymptotic profile and optimal decay and/or blowup rates of solutions as time goes to infinity in L^{2}-sense. The operator L considered in this paper was used to dissipate the solutions of the wave equation in the paper studied by Charao-Ikehata in 2020, and in the low frequency parameters the principal part of the equation and the damping term is rather weakly effective than those of well-studied power type operators.


title: Local Deal-Agreement Based Monotonic Distributed Algorithms for Load Balancing in General Graphs

abstract: In computer networks, participants may cooperate in processing tasks, so that loads are balanced among them. We present local distributed algorithms that (repeatedly) use local imbalance criteria to transfer loads concurrently across the participants of the system, iterating until all loads are balanced. Our algorithms are based on a short local deal-agreement communication of proposal/deal, based on the neighborhood loads. They converge monotonically, always providing a better state as the execution progresses. Besides, our algorithms avoid making loads temporarily negative. Thus, they may be considered anytime ones, in the sense that they can be stopped at any time during the execution. We show that our synchronous load balancing algorithms achieve $\epsilon$-Balanced state for the continuous setting and 1-Balanced state for the discrete setting in all graphs, within $O(n D \log(n K/\epsilon))$ and $O(n D \log(n K/D) + n D^2)$ time, respectively, where $n$ is the number of nodes, $K$ is the initial discrepancy, $D$ is the graph diameter, and $\epsilon$ is the final discrepancy. Our other monotonic synchronous and asynchronous algorithms for the discrete setting are generalizations of the first presented algorithms, where load balancing is performed concurrently with more than one neighbor. These algorithms arrive at a 1-Balanced state in time $O(n K^2)$ in general graphs, but have a potential to be faster as the loads are balanced among all neighbors, rather than with only one; we describe a scenario that demonstrates the potential for a fast ($O(1)$) convergence. Our asynchronous algorithm avoids the need to wait for the slowest participants' activity prior to making the next load balancing steps as synchronous settings restrict. We also introduce a self-stabilizing version of our asynchronous algorithm.


title: Gradient Einstein-Type Structures immersed into a Riemannian Warped Product

abstract: In this paper, we study gradient Einstein-type structure immersed into a Riemannian warped product manifold. We obtain some triviality results for the potential function and smooth map $u$. We investigate conditions for a gradient Einstein-type structure to be minimal, totally umbilical, or totally geodesic immersed into a warped product $I\times_f M^n$. Furthermore, we characterize rotational hypersurface into $\mathbb{R}\times_f\mathbb{R}^n$ has a gradient Einstein-type structure.


title: RANP: Resource Aware Neuron Pruning at Initialization for 3D CNNs

abstract: Although 3D Convolutional Neural Networks (CNNs) are essential for most learning based applications involving dense 3D data, their applicability is limited due to excessive memory and computational requirements. Compressing such networks by pruning therefore becomes highly desirable. However, pruning 3D CNNs is largely unexplored possibly because of the complex nature of typical pruning algorithms that embeds pruning into an iterative optimization paradigm. In this work, we introduce a Resource Aware Neuron Pruning (RANP) algorithm that prunes 3D CNNs at initialization to high sparsity levels. Specifically, the core idea is to obtain an importance score for each neuron based on their sensitivity to the loss function. This neuron importance is then reweighted according to the neuron resource consumption related to FLOPs or memory. We demonstrate the effectiveness of our pruning method on 3D semantic segmentation with widely used 3D-UNets on ShapeNet and BraTS'18 as well as on video classification with MobileNetV2 and I3D on UCF101 dataset. In these experiments, our RANP leads to roughly 50-95 reduction in FLOPs and 35-80 reduction in memory with negligible loss in accuracy compared to the unpruned networks. This significantly reduces the computational resources required to train 3D CNNs. The pruned network obtained by our algorithm can also be easily scaled up and transferred to another dataset for training.


title: Predicting quasibound states of negative ions

abstract: We demonstrated the accurate prediction of a quasibound spectrum of a negative ion using a novel high-precision theoretical approach. We used La$^-$ as a test case due to a recent experiment that measured energies of 11 resonances in its photodetachment spectrum attributed to transitions to quasibound states [C. W. Walter et al., PRA, in press (2020); arXiv:2010.01122]. We identified all of the observed resonances, and predicted one more peak just outside the range of the prior experiment. Following the theoretical prediction, the peak was observed at the predicted wavelength, validating the identification. The same approach is applicable to a wide range of negative ions. Moreover, theory advances reported in this work can be used for massive generation of atomic transition properties for neutrals and positive ions needed for a variety of applications.