title: An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels

abstract: Large-scale Multi-label Text Classification (LMTC) has a wide range of Natural Language Processing (NLP) applications and presents interesting challenges. First, not all labels are well represented in the training set, due to the very large label set and the skewed label distributions of LMTC datasets. Also, label hierarchies and differences in human labelling guidelines may affect graph-aware annotation proximity. Finally, the label hierarchies are periodically updated, requiring LMTC models capable of zero-shot generalization. Current state-of-the-art LMTC models employ Label-Wise Attention Networks (LWANs), which (1) typically treat LMTC as flat multi-label classification; (2) may use the label hierarchy to improve zero-shot learning, although this practice is vastly understudied; and (3) have not been combined with pre-trained Transformers (e.g. BERT), which have led to state-of-the-art results in several NLP benchmarks. Here, for the first time, we empirically evaluate a battery of LMTC methods from vanilla LWANs to hierarchical classification approaches and transfer learning, on frequent, few, and zero-shot learning on three datasets from different domains. We show that hierarchical methods based on Probabilistic Label Trees (PLTs) outperform LWANs. Furthermore, we show that Transformer-based approaches outperform the state-of-the-art in two of the datasets, and we propose a new state-of-the-art method which combines BERT with LWANs. Finally, we propose new models that leverage the label hierarchy to improve few and zero-shot learning, considering on each dataset a graph-aware annotation proximity measure that we introduce.


title: Bayesian Feature Selection in Joint Quantile Time Series Analysis

abstract: Quantile feature selection over correlated multivariate time series data has always been a methodological challenge and is an open problem. In this paper, we propose a general Bayesian dimension reduction methodology for feature selection in high-dimensional joint quantile time series analysis, under the name of the quantile feature selection time series (QFSTS) model. The QFSTS model is a general structural time series model, where each component yields an additive contribution to the time series modeling with direct interpretations. Its flexibility is compound in the sense that users can add/deduct components for each time series and each time series can have its own specific valued components of different sizes. Feature selection is conducted in the quantile regression component, where each time series has its own pool of contemporaneous external predictors allowing nowcasting. Bayesian methodology in extending feature selection to the quantile time series research area is developed using multivariate asymmetric Laplace distribution, spike-and-slab prior setup, the Metropolis-Hastings algorithm, and the Bayesian model averaging technique, all implemented consistently in the Bayesian paradigm. The QFSTS model requires small datasets to train and converges fast. Extensive examinations confirmed that the QFSTS model has superior performance in feature selection, parameter estimation, and forecast.


title: Completeness of Positive Linear Recurrence Sequences

abstract: A sequence of positive integers is complete if every positive integer is a sum of distinct terms. A positive linear recurrence sequence (PLRS) is a sequence defined by a homogeneous linear recurrence relation with nonnegative coefficients of the form $H_{n+1} = c_1 H_n + \cdots + c_L H_{n-L+1}$ and a particular set of initial conditions. We seek to classify various PLRS's by completeness. With results on how completeness is affected by modifying the recurrence coefficients of a PLRS, we completely characterize completeness of several families of PLRS's as well as conjecturing criteria for more general families. Our primary method is applying Brown's criterion, which says that an increasing sequence $\{H_n\}_{n = 1}^{\infty}$ is complete if and only if $H_1 = 1$ and $H_{n + 1} \leq 1 + \sum_{i = 1}^n H_i$. %A survey of these results can be found in \cite{BHLLMT}. Finally, we adopt previous analytic work on PLRS's to find a more efficient way to check completeness. Specifically, the characteristic polynomial of any PLRS has exactly one positive root; by bounding the size of this root, the majority of sequences may be classified as complete or incomplete. Additionally, we show there exists an indeterminate region where the principal root does not reveal any information on completeness. We have conjectured precise bounds for this region.


title: Uncertainty relations for the Hohenberg-Kohn theorem

abstract: How does charge density constrain many-body wavefunctions in nature? The Hohenberg-Kohn theorem for non-relativistic, interacting many-body Schr\"odinger systems is well-known and was proved using \emph{reductio-ad-absurdum}; however, the physical mechanism or principle which enables this theorem in nature has not been understood. Here, we obtain effective canonical operators in the interacting many-body problem -- (i) the local electric field, which mediates interaction between particles, and contributes to the potential energy; and (ii) the particle momenta, which contribute to the kinetic energy. The commutation of these operators results in the charge density distribution. Thus, quantum fluctuations of interacting many-particle systems are constrained by charge density, providing a mechanism by which an external potential, by coupling to the charge density, tunes the quantum-mechanical many-body wavefunction. As an initial test, we obtain the functional form for total energy of interacting many-particle systems, and in the uniform density limit, find promising agreement with Quantum Monte Carlo simulations.


title: Inquisitive Question Generation for High Level Text Comprehension

abstract: Inquisitive probing questions come naturally to humans in a variety of settings, but is a challenging task for automatic systems. One natural type of question to ask tries to fill a gap in knowledge during text comprehension, like reading a news article: we might ask about background information, deeper reasons behind things occurring, or more. Despite recent progress with data-driven approaches, generating such questions is beyond the range of models trained on existing datasets. We introduce INQUISITIVE, a dataset of ~19K questions that are elicited while a person is reading through a document. Compared to existing datasets, INQUISITIVE questions target more towards high-level (semantic and discourse) comprehension of text. We show that readers engage in a series of pragmatic strategies to seek information. Finally, we evaluate question generation models based on GPT-2 and show that our model is able to generate reasonable questions although the task is challenging, and highlight the importance of context to generate INQUISITIVE questions.


title: Generating Dialogue Responses from a Semantic Latent Space

abstract: Existing open-domain dialogue generation models are usually trained to mimic the gold response in the training set using cross-entropy loss on the vocabulary. However, a good response does not need to resemble the gold response, since there are multiple possible responses to a given prompt. In this work, we hypothesize that the current models are unable to integrate information from multiple semantically similar valid responses of a prompt, resulting in the generation of generic and uninformative responses. To address this issue, we propose an alternative to the end-to-end classification on vocabulary. We learn the pair relationship between the prompts and responses as a regression task on a latent space instead. In our novel dialog generation model, the representations of semantically related sentences are close to each other on the latent space. Human evaluation showed that learning the task on a continuous space can generate responses that are both relevant and informative.


title: Data-efficient Online Classification with Siamese Networks and Active Learning

abstract: An ever increasing volume of data is nowadays becoming available in a streaming manner in many application areas, such as, in critical infrastructure systems, finance and banking, security and crime and web analytics. To meet this new demand, predictive models need to be built online where learning occurs on-the-fly. Online learning poses important challenges that affect the deployment of online classification systems to real-life problems. In this paper we investigate learning from limited labelled, nonstationary and imbalanced data in online classification. We propose a learning method that synergistically combines siamese neural networks and active learning. The proposed method uses a multi-sliding window approach to store data, and maintains separate and balanced queues for each class. Our study shows that the proposed method is robust to data nonstationarity and imbalance, and significantly outperforms baselines and state-of-the-art algorithms in terms of both learning speed and performance. Importantly, it is effective even when only 1% of the labels of the arriving instances are available.


title: Weak Topologies

abstract: Lecture notes on Weak Topologies: We discuss about the weak and weak star topologies on a normed linear space. Our aim is to prove the well known Banach-Alaouglu theorem and discuss some of its consequences, in particular, characterizations of reflexive spaces.


title: A discontinuous Galerkin method for a diffuse-interface model of immiscible two-phase flows with soluble surfactant

abstract: A numerical method using discontinuous polynomial approximations is formulated for solving a phase-field model of two immiscible fluids with a soluble surfactant. The scheme recovers the Langmuir adsorption isotherms at equilibrium. Simulations of spinodal decomposition, flow through a cylinder and flow through a sequence of pore throats show the dynamics of the flow with and without surfactant. Finally the numerical method is used to simulate fluid flows in the pore space of Berea sandstone obtained by micro-CT imaging.


title: Learning from Home: A Mixed-Methods Analysis of Live Streaming Based Remote Education Experience in Chinese Colleges During the COVID-19 Pandemic

abstract: The COVID-19 global pandemic and resulted lockdown policies have forced education in nearly every country to switch from a traditional co-located paradigm to a pure online 'distance learning from home' paradigm. Lying in the center of this learning paradigm shift is the emergence and wide adoption of distance communication tools and live streaming platforms for education. Here, we present a mixed-methods study on live streaming based education experience during the COVID-19 pandemic. We focus our analysis on Chinese higher education, carried out semi-structured interviews on 30 students, and 7 instructors from diverse colleges and disciplines, meanwhile launched a large-scale survey covering 6291 students and 1160 instructors in one leading Chinese university. Our study not only reveals important design guidelines and insights to better support current remote learning experience during the pandemic, but also provides valuable implications towards constructing future collaborative education supporting systems and experience after pandemic.


title: KiU-Net: Overcomplete Convolutional Architectures for Biomedical Image and Volumetric Segmentation

abstract: Most methods for medical image segmentation use U-Net or its variants as they have been successful in most of the applications. After a detailed analysis of these "traditional" encoder-decoder based approaches, we observed that they perform poorly in detecting smaller structures and are unable to segment boundary regions precisely. This issue can be attributed to the increase in receptive field size as we go deeper into the encoder. The extra focus on learning high level features causes the U-Net based approaches to learn less information about low-level features which are crucial for detecting small structures. To overcome this issue, we propose using an overcomplete convolutional architecture where we project our input image into a higher dimension such that we constrain the receptive field from increasing in the deep layers of the network. We design a new architecture for image segmentation- KiU-Net which has two branches: (1) an overcomplete convolutional network Kite-Net which learns to capture fine details and accurate edges of the input, and (2) U-Net which learns high level features. Furthermore, we also propose KiU-Net 3D which is a 3D convolutional architecture for volumetric segmentation. We perform a detailed study of KiU-Net by performing experiments on five different datasets covering various image modalities like ultrasound (US), magnetic resonance imaging (MRI), computed tomography (CT), microscopic and fundus images. The proposed method achieves a better performance as compared to all the recent methods with an additional benefit of fewer parameters and faster convergence. Additionally, we also demonstrate that the extensions of KiU-Net based on residual blocks and dense blocks result in further performance improvements. The implementation of KiU-Net can be found here: https://github.com/jeya-maria-jose/KiU-Net-pytorch


title: Multi-Resolution Fusion and Multi-scale Input Priors Based Crowd Counting

abstract: Crowd counting in still images is a challenging problem in practice due to huge crowd-density variations, large perspective changes, severe occlusion, and variable lighting conditions. The state-of-the-art patch rescaling module (PRM) based approaches prove to be very effective in improving the crowd counting performance. However, the PRM module requires an additional and compromising crowd-density classification process. To address these issues and challenges, the paper proposes a new multi-resolution fusion based end-to-end crowd counting network. It employs three deep-layers based columns/branches, each catering the respective crowd-density scale. These columns regularly fuse (share) the information with each other. The network is divided into three phases with each phase containing one or more columns. Three input priors are introduced to serve as an efficient and effective alternative to the PRM module, without requiring any additional classification operations. Along with the final crowd count regression head, the network also contains three auxiliary crowd estimation regression heads, which are strategically placed at each phase end to boost the overall performance. Comprehensive experiments on three benchmark datasets demonstrate that the proposed approach outperforms all the state-of-the-art models under the RMSE evaluation metric. The proposed approach also has better generalization capability with the best results during the cross-dataset experiments.


title: Observable Proton Decay in Flipped SU(5)

abstract: We explore proton decay in a class of realistic supersymmetric flipped $SU(5)$ models supplemented by a $U(1)_R$ symmetry which plays an essential role in implementing hybrid inflation. Two distinct neutrino mass models, based on inverse seesaw and type I seesaw, are identified, with the latter arising from the breaking of $U(1)_R$ by nonrenormalizable superpotential terms. Depending on the neutrino mass model an appropriate set of intermediate scale color triplets from the Higgs superfields play a key role in proton decay channels that include $p \rightarrow (e^{+},\mu^+)\, \pi^0$, $p \rightarrow ( e^+,\mu^{+})\, K^0 $, $p \rightarrow \overline{\nu}\, \pi^{+}$, and $p \rightarrow \overline{\nu}\, K^+ $. We identify regions of the parameter space that yield proton lifetime estimates which are testable at Hyper-Kamiokande and other next generation experiments. We discuss how gauge coupling unification in the presence of intermediate scale particles is realized, and a $Z_4$ symmetry is utilized to show how such intermediate scales can arise in flipped $SU(5)$. Finally, we compare our predictions for proton decay with previous work based on $SU(5)$ and flipped $SU(5)$.


title: Multi-Modal Retrieval using Graph Neural Networks

abstract: Most real world applications of image retrieval such as Adobe Stock, which is a marketplace for stock photography and illustrations, need a way for users to find images which are both visually (i.e. aesthetically) and conceptually (i.e. containing the same salient objects) as a query image. Learning visual-semantic representations from images is a well studied problem for image retrieval. Filtering based on image concepts or attributes is traditionally achieved with index-based filtering (e.g. on textual tags) or by re-ranking after an initial visual embedding based retrieval. In this paper, we learn a joint vision and concept embedding in the same high-dimensional space. This joint model gives the user fine-grained control over the semantics of the result set, allowing them to explore the catalog of images more rapidly. We model the visual and concept relationships as a graph structure, which captures the rich information through node neighborhood. This graph structure helps us learn multi-modal node embeddings using Graph Neural Networks. We also introduce a novel inference time control, based on selective neighborhood connectivity allowing the user control over the retrieval algorithm. We evaluate these multi-modal embeddings quantitatively on the downstream relevance task of image retrieval on MS-COCO dataset and qualitatively on MS-COCO and an Adobe Stock dataset.


title: Improving Target-side Lexical Transfer in Multilingual Neural Machine Translation

abstract: To improve the performance of Neural Machine Translation~(NMT) for low-resource languages~(LRL), one effective strategy is to leverage parallel data from a related high-resource language~(HRL). However, multilingual data has been found more beneficial for NMT models that translate from the LRL to a target language than the ones that translate into the LRLs. In this paper, we aim to improve the effectiveness of multilingual transfer for NMT models that translate \emph{into} the LRL, by designing a better decoder word embedding. Extending upon a general-purpose multilingual encoding method Soft Decoupled Encoding~\citep{SDE}, we propose DecSDE, an efficient character n-gram based embedding specifically designed for the NMT decoder. Our experiments show that DecSDE leads to consistent gains of up to 1.8 BLEU on translation from English to four different languages.


title: Diagonal Memory Optimisation for Machine Learning on Micro-controllers

abstract: As machine learning spreads into more and more application areas, micro controllers and low power CPUs are increasingly being used to perform inference with machine learning models. The capability to deploy onto these limited hardware targets is enabling machine learning models to be used across a diverse range of new domains. Optimising the inference process on these targets poses different challenges from either desktop CPU or GPU implementations, where the small amounts of RAM available on these targets sets limits on size of models which can be executed. Analysis of the memory use patterns of eleven machine learning models was performed. Memory load and store patterns were observed using a modified version of the Valgrind debugging tool, identifying memory areas holding values necessary for the calculation as inference progressed. These analyses identified opportunities optimise the memory use of these models by overlapping the input and output buffers of individual tensor operations. Three methods are presented which can calculate the safe overlap of input and output buffers for tensor operations. Ranging from a computationally expensive approach with the ability to operate on compiled layer operations, to a versatile analytical solution which requires access to the original source code of the layer. The diagonal memory optimisation technique is described and shown to achieve memory savings of up to 34.5% when applied to eleven common models. Micro-controller targets are identified where it is only possible to deploy some models if diagonal memory optimisation is used.


title: Surface Agnostic Metrics for Cortical Volume Segmentation and Regression

abstract: The cerebral cortex performs higher-order brain functions and is thus implicated in a range of cognitive disorders. Current analysis of cortical variation is typically performed by fitting surface mesh models to inner and outer cortical boundaries and investigating metrics such as surface area and cortical curvature or thickness. These, however, take a long time to run, and are sensitive to motion and image and surface resolution, which can prohibit their use in clinical settings. In this paper, we instead propose a machine learning solution, training a novel architecture to predict cortical thickness and curvature metrics from T2 MRI images, while additionally returning metrics of prediction uncertainty. Our proposed model is tested on a clinical cohort (Down Syndrome) for which surface-based modelling often fails. Results suggest that deep convolutional neural networks are a viable option to predict cortical metrics across a range of brain development stages and pathologies.


title: Mixing Strategies in Cryptocurrencies and An Alternative Implementation

abstract: Since the initial launch of Bitcoin by Satoshi Nakamoto in 2009, decentralized digital currencies have long been of major interest in both the academia and the industry. Till today, there are more than 3000 different cryptocurrencies over the internet. Each one relies on mathematical soundness and cryptographic wit to provide unique properties in addition to securing basic correctness. A common misbelief for cryptocurrencies is that they provide complete anonymity by replacing people's real-life identity with a randomly generated wallet address in payments. However, this "pseudonymity" is easily breakable under the public ledger. Many attacks demonstrate ways to deanonymize people through observing the transaction patterns or network interactions. Thus, cryptocurrency fungibility has become a popular topic in the research community. This report reviews a partial list of existing schemes and describes an alternative implementation, Eth-Tumbler. Eth-Tumbler utilizes layered encryption and multiple signatures and thus efficiently hides a user under k-anonymity.


title: Hopf bifurcation of a financial dynamical system with delay

abstract: The aim of this work is to investigate the qualitative behaviour of a financial dynamical system which contains a time delay. We investigate the dynamic response of this system of which variables are interest rate, investment demand, price index and average profit margin. We perform a stability analysis at the fixed points and show that the system undergoes a Hopf bifurcation. The bifurcation analyses are supported by numerical simulations.


title: Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarization

abstract: Text summarization is one of the most challenging and interesting problems in NLP. Although much attention has been paid to summarizing structured text like news reports or encyclopedia articles, summarizing conversations---an essential part of human-human/machine interaction where most important pieces of information are scattered across various utterances of different speakers---remains relatively under-investigated. This work proposes a multi-view sequence-to-sequence model by first extracting conversational structures of unstructured daily chats from different views to represent conversations and then utilizing a multi-view decoder to incorporate different views to generate dialogue summaries. Experiments on a large-scale dialogue summarization corpus demonstrated that our methods significantly outperformed previous state-of-the-art models via both automatic evaluations and human judgment. We also discussed specific challenges that current approaches faced with this task. We have publicly released our code at https://github.com/GT-SALT/Multi-View-Seq2Seq.


title: Comparing Bennequin-type inequalities

abstract: The slice-Bennequin inequality states an upper bound for the self-linking number of a knot in terms of its four-ball genus. The $s$-Bennequin and $\tau$-Bennequin inequalities provide upper bounds on the self-linking number of a knot in terms of the Rasmussen $s$ invariant and the Ozsv\'ath-Szab\'o $\tau$ invariant. We exhibit examples in which the difference between self-linking number and four-ball genus grows arbitrarily large, whereas the $s$-Bennequin inequality and the $\tau$-Bennequin inequality are both sharp.


title: Spatial Damage Characterization in Self-Sensing Materials via Neural Network-Aided Electrical Impedance Tomography: A Computational Study

abstract: Continuous structural health monitoring (SHM) and integrated nondestructive evaluation (NDE) are important for ensuring the safe operation of high-risk engineering structures. Recently, piezoresistive nanocomposite materials have received much attention for SHM and NDE. These materials are self-sensing because their electrical conductivity changes in response to deformation and damage. Combined with electrical impedance tomography (EIT), it is possible to map deleterious effects. However, EIT suffers from important limitations -- it is computationally expensive, provides indistinct information on damage shape, and can miss multiple damages if they are close together. In this article we apply a novel neural network approach to quantify damage metrics such as size, number, and location from EIT data. This network is trained using a simulation routine calibrated to experimental data for a piezoresistive carbon nanofiber-modified epoxy. Our results show that the network can predict the number of damages with 99.2% accuracy, quantify damage size with respect to the averaged radius at an average of 2.46% error, and quantify damage position with respect to the domain length at an average of 0.89% error. These results are an important first step in translating the combination of self-sensing materials and EIT to real-world SHM and NDE.


title: Dyson's Classification And Real Division Superalgebras

abstract: It is well-known that unitary irreducible representations of groups can be usefully classified in a 3-fold classification scheme: Real, Complex, Quaternionic. In 1962 Freeman Dyson pointed out that there is an analogous 10-fold classification of irreducible representations of groups involving both unitary and antiunitary operators. More recently it was realized that there is also a 10-fold classification scheme involving superdivision algebras. Here we give a careful proof of the equivalence of these two 10-fold ways.


title: Explainability via Responsibility

abstract: Procedural Content Generation via Machine Learning (PCGML) refers to a group of methods for creating game content (e.g. platformer levels, game maps, etc.) using machine learning models. PCGML approaches rely on black box models, which can be difficult to understand and debug by human designers who do not have expert knowledge about machine learning. This can be even more tricky in co-creative systems where human designers must interact with AI agents to generate game content. In this paper we present an approach to explainable artificial intelligence in which certain training instances are offered to human users as an explanation for the AI agent's actions during a co-creation process. We evaluate this approach by approximating its ability to provide human users with the explanations of AI agent's actions and helping them to more efficiently cooperate with the AI agent.


title: Local Additivity Based Data Augmentation for Semi-supervised NER

abstract: Named Entity Recognition (NER) is one of the first stages in deep language understanding yet current NER models heavily rely on human-annotated data. In this work, to alleviate the dependence on labeled data, we propose a Local Additivity based Data Augmentation (LADA) method for semi-supervised NER, in which we create virtual samples by interpolating sequences close to each other. Our approach has two variations: Intra-LADA and Inter-LADA, where Intra-LADA performs interpolations among tokens within one sentence, and Inter-LADA samples different sentences to interpolate. Through linear additions between sampled training data, LADA creates an infinite amount of labeled data and improves both entity and context learning. We further extend LADA to the semi-supervised setting by designing a novel consistency loss for unlabeled data. Experiments conducted on two NER benchmarks demonstrate the effectiveness of our methods over several strong baselines. We have publicly released our code at https://github.com/GT-SALT/LADA.


title: Optimal Neural Program Synthesis from Multimodal Specifications

abstract: Multimodal program synthesis, which leverages different types of user input to synthesize a desired program, is an attractive way to scale program synthesis to challenging settings; however, it requires integrating noisy signals from the user, like natural language, with hard constraints on the program's behavior. This paper proposes an optimal neural synthesis approach where the goal is to find a program that satisfies user-provided constraints while also maximizing the program's score with respect to a neural model. Specifically, we focus on multimodal synthesis tasks in which the user intent is expressed using a combination of natural language (NL) and input-output examples. At the core of our method is a top-down recurrent neural model that places distributions over abstract syntax trees conditioned on the NL input. This model not only allows for efficient search over the space of syntactically valid programs, but it allows us to leverage automated program analysis techniques for pruning the search space based on infeasibility of partial programs with respect to the user's constraints. The experimental results on a multimodal synthesis dataset (StructuredRegex) show that our method substantially outperforms prior state-of-the-art techniques in terms of accuracy and efficiency, and finds model-optimal programs more frequently.


title: Learning Complete 3D Morphable Face Models from Images and Videos

abstract: Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D scans and thus do not generalize well across different identities and expressions. We present the first approach to learn complete 3D models of face identity geometry, albedo and expression just from images and videos. The virtually endless collection of such data, in combination with our self-supervised learning-based approach allows for learning face models that generalize beyond the span of existing approaches. Our network design and loss functions ensure a disentangled parameterization of not only identity and albedo, but also, for the first time, an expression basis. Our method also allows for in-the-wild monocular reconstruction at test time. We show that our learned models better generalize and lead to higher quality image-based reconstructions than existing approaches.


title: Range Expansion for Wireless Power Transfer using Joint Beamforming and Waveform Architecture: An Experimental Study in Indoor Environment

abstract: Far-field Wireless Power Transfer (WPT) has emerged as a potential power source for the Internet of Things (IoT) and Wireless Sensor Network (WSN).The expansion of the power transfer range is one of the key challenges to make the technology viable. In this paper, we experimentally study a channel-adaptive joint beamforming and waveform architecture to expand the power transfer range. WPT experiments have been conducted in a variety of wireless channels at various distances in a realistic indoor environment. The measurement data have been fitted using a simple analytical model to analyze the output DC power and achievable range improvement depending on the signal design schemes and the number of tones and antennas. The model shows a clear relationship between signal design versus output DC power and achievable range, and highlight the significant benefit of the proposed architecture to expand the power transfer range.


title: Generating Gameplay-Relevant Art Assets with Transfer Learning

abstract: In game development, designing compelling visual assets that convey gameplay-relevant features requires time and experience. Recent image generation methods that create high-quality content could reduce development costs, but these approaches do not consider game mechanics. We propose a Convolutional Variational Autoencoder (CVAE) system to modify and generate new game visuals based on their gameplay relevance. We test this approach with Pok\'emon sprites and Pok\'emon type information, since types are one of the game's core mechanics and they directly impact the game's visuals. Our experimental results indicate that adopting a transfer learning approach can help to improve visual quality and stability over unseen data.


title: Eigenvalues of the MOTS stability operator for slowly rotating Kerr black holes

abstract: We study the eigenvalues of the MOTS stability operator for the Kerr black hole with angular momentum per unit mass $|a| \ll M$. We prove that each eigenvalue depends analytically on $a$ (in a neighbourhood of $a=0$), and compute its first nonvanishing derivative. Recalling that $a=0$ corresponds to the Schwarzschild solution, where each eigenvalue has multiplicity $2\ell+1$, we find that this degeneracy is completely broken for nonzero $a$. In particular, for $0 < |a| \ll M$ we obtain a cluster consisting of $\ell$ distinct complex conjugate pairs and one real eigenvalue. As a special case of our results, we get a simple formula for the variation of the principal eigenvalue. For perturbations that preserve the total area or mass of the black hole, we find that the principal eigenvalue has a local maximum at $a=0$. However, there are other perturbations for which the principal eigenvalue has a local minimum at $a=0$.


title: Weakly-supervised Fine-grained Event Recognition on Social Media Texts for Disaster Management

abstract: People increasingly use social media to report emergencies, seek help or share information during disasters, which makes social networks an important tool for disaster management. To meet these time-critical needs, we present a weakly supervised approach for rapidly building high-quality classifiers that label each individual Twitter message with fine-grained event categories. Most importantly, we propose a novel method to create high-quality labeled data in a timely manner that automatically clusters tweets containing an event keyword and asks a domain expert to disambiguate event word senses and label clusters quickly. In addition, to process extremely noisy and often rather short user-generated messages, we enrich tweet representations using preceding context tweets and reply tweets in building event recognition classifiers. The evaluation on two hurricanes, Harvey and Florence, shows that using only 1-2 person-hours of human supervision, the rapidly trained weakly supervised classifiers outperform supervised classifiers trained using more than ten thousand annotated tweets created in over 50 person-hours.


title: Large System Analysis of Box-Relaxation in Correlated Massive MIMO Systems Under Imperfect CSI (Extended Version)

abstract: In this paper, we study the mean square error (MSE) and the bit error rate (BER) performance of the box-relaxation decoder in massive multiple-input-multiple-output (MIMO) systems under the assumptions of imperfect channel state information (CSI) and receive-side channel correlation. Our analysis assumes that the number of transmit and receive antennas ($n$,and $m$) grow simultaneously large while their ratio remains fixed. For simplicity of the analysis, we consider binary phase shift keying (BPSK) modulated signals. The asymptotic approximations of the MSE and BER enable us to derive the optimal power allocation scheme under MSE/BER minimization. Numerical simulations suggest that the asymptotic approximations are accurate even for small $n$ and $m$. They also show the important role of the box constraint in mitigating the so called double descent phenomenon.


title: Entity Embedding as Game Representation

abstract: Procedural content generation via machine learning (PCGML) has shown success at producing new video game content with machine learning. However, the majority of the work has focused on the production of static game content, including game levels and visual elements. There has been much less work on dynamic game content, such as game mechanics. One reason for this is the lack of a consistent representation for dynamic game content, which is key for a number of statistical machine learning approaches. We present an autoencoder for deriving what we call "entity embeddings", a consistent way to represent different dynamic entities across multiple games in the same representation. In this paper we introduce the learned representation, along with some evidence towards its quality and future utility.


title: The impact of composition choices on solar evolution: age, helio- and asteroseismology, and neutrinos

abstract: The Sun is the most studied and well-known star, and as such, solar fundamental parameters are often used to bridge gaps in the knowledge of other stars, when these are required for modelling. However, the two most powerful and precise independent methodologies currently available to infer the internal solar structure are in disagreement. We aim to show the potential impact of composition choices in the overall evolution of a star, using the Sun as an example. To this effect, we create two Standard Solar Models and a comparison model using different combinations of metallicity and relative element abundances and compare evolutionary, helioseismic, and neutrino-related properties for each. We report differences in age for models calibrated to the same point in the HR diagram, in the red giant branch, of more than 1 Gyr, and found that the current precision level of asteroseismic measurements is enough to differentiate these models, which would exhibit differences in priod spacing of 1.30-2.58 per cent. Additionally, we show that the measurement of neutrino fluxes from the carbon-nitrogen-oxygen cycle with a precision of around 17 per cent, which could be achieved by the next generation of solar neutrino experiments, could help resolve the stellar abundance problem.


title: Learning Risk Preferences from Investment Portfolios Using Inverse Optimization

abstract: The fundamental principle in Modern Portfolio Theory (MPT) is based on the quantification of the portfolio's risk related to performance. Although MPT has made huge impacts on the investment world and prompted the success and prevalence of passive investing, it still has shortcomings in real-world applications. One of the main challenges is that the level of risk an investor can endure, known as \emph{risk-preference}, is a subjective choice that is tightly related to psychology and behavioral science in decision making. This paper presents a novel approach of measuring risk preference from existing portfolios using inverse optimization on the mean-variance portfolio allocation framework. Our approach allows the learner to continuously estimate real-time risk preferences using concurrent observed portfolios and market price data. We demonstrate our methods on real market data that consists of 20 years of asset pricing and 10 years of mutual fund portfolio holdings. Moreover, the quantified risk preference parameters are validated with two well-known risk measurements currently applied in the field. The proposed methods could lead to practical and fruitful innovations in automated/personalized portfolio management, such as Robo-advising, to augment financial advisors' decision intelligence in a long-term investment horizon.


title: Superscattering, Superabsorption, and Nonreciprocity in Nonlinear Antennas

abstract: We propose tunable nonlinear antennas based on an epsilon-near-zero material with a large optical nonlinearity. We show that the absorption and scattering cross sections of the antennas can be controlled dynamically from a nearly superscatterer to a nearly superabsorber by changing the intensity of the laser beam. Moreover, we demonstrate that a hybrid nonlinear antenna, composed of epsilon-near-zero and high-index dielectric materials, exhibits nonreciprocal radiation patterns because of broken spatial inversion symmetry and large optical nonlinearity of the epsilon-near-zero material. By changing the intensity of the laser, the radiation pattern of the antenna can be tuned between a bidirectional and a unidirectional emission known as a Huygens source. Our study provides a novel approach toward ultrafast dynamical control of metamaterials, for applications such as beam steering and optical limiting.


title: On the compatibility of Nonlinear Electrodynamics models with Robinson--Trautman geometry

abstract: Robinson--Trautman solutions with Nonlinear Electrodynamics are investigated for both L(F ) and L(F, G) Lagrangians and presence of electric and magnetic charges as well as electromagnetic radiation is assumed. Particular interest is devoted to models representing regular black holes for spherically symmetric situations. The results show clear uniqueness of Maxwell electrodynamics with respect to compatibility with Robinson--Trautman class. Additionally, regular black hole models are clearly not suited to this class while famous Born--Infeld model illustrates important distinction between L(F ) and L(F, G) for obtained electric field when magnetic field is nontrivial.


title: Eikonal formulation of large dynamical random matrix models

abstract: Standard approach to dynamical random matrix models relies on the description of trajectories of eigenvalues. Using the analogy from optics, based on the duality between the Fermat principle(trajectories) and the Huygens principle (wavefronts), we formulate the Hamilton-Jacobi dynamics for large random matrix models. The resulting equations describe a broad class of random matrix models in a unified way, including normal (Hermitian or unitary) as well as strictly non-normal dynamics. HJ formalism applied to Brownian bridge dynamics allows one for calculations of the asymptotics of the Harish-Chandra-Itzykson-Zuber integrals.


title: Observation of second order meron polarisation textures in optical microcavities

abstract: Multicomponent Bose-Einstein condensates, quantum Hall systems, and chiral magnetic materials display twists and knots in the continuous symmetries of their order parameter, known as Skyrmions. Originally discovered as solutions to the nonlinear sigma model in quantum field theory, these vectorial excitations are quantified by a topological winding number dictating their interactions and global properties of the host system. Here, we report the first experimental observation of a stable individual second order meron, and antimeron, appearing in an electromagnetic field. These complex textures are realised by confining light into a liquid-crystal filled cavity which, through its anisotropic refractive index, provides an adjustable artificial photonic gauge field which couples the cavity photons motion to its polarisation resulting in formation of these fundamental vectorial vortex states of light. Our observations take a step towards bringing topologically robust room-temperature optical vector textures into the field of photonic information processing and storage.


title: Finite type invariants for knotoids

abstract: We extend the theory of Vassiliev (or finite type) invariants for knots to knotoids using two different approaches. Firstly, we take closures on knotoids to obtain knots and we use the Vassiliev invariants for knots, proving that these are knotoid isotopy invariant. Secondly, we define finite type invariants directly on knotoids, by extending knotoid invariants to singular knotoid invariants via the Vassiliev skein relation. Then, for spherical knotoids we show that there are non-trivial type-1 invariants, in contrast with classical knot theory where type-1 invariants vanish. We give a complete theory of type-1 invariants for spherical knotoids, by classifying linear chord diagrams of order one, and we present examples arising from the affine index polynomial and the extended bracket polynomial.


title: DLGNet-Task: An End-to-end Neural Network Framework for Modeling Multi-turn Multi-domain Task-Oriented Dialogue

abstract: Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain dialogue generation capabilities of streamlined end-to-end open-domain dialogue systems. In this paper, we present a new framework, DLGNet-Task, a unified task-oriented dialogue system which employs autoregressive transformer networks such as DLGNet and GPT-2/3 to complete user tasks in multi-turn multi-domain conversations. Our framework enjoys the controllable, verifiable, and explainable outputs of modular approaches, and the low development, deployment and maintenance cost of end-to-end systems. Treating open-domain system components as additional TOD system modules allows DLGNet-Task to learn the joint distribution of the inputs and outputs of all the functional blocks of existing modular approaches such as, natural language understanding (NLU), state tracking, action policy, as well as natural language generation (NLG). Rather than training the modules individually, as is common in real-world systems, we trained them jointly with appropriate module separations. When evaluated on the MultiWOZ2.1 dataset, DLGNet-Task shows comparable performance to the existing state-of-the-art approaches. Furthermore, using DLGNet-Task in conversational AI systems reduces the level of effort required for developing, deploying, and maintaining intelligent assistants at scale.


title: On Losses for Modern Language Models

abstract: BERT set many state-of-the-art results over varied NLU benchmarks by pre-training over two tasks: masked language modelling (MLM) and next sentence prediction (NSP), the latter of which has been highly criticized. In this paper, we 1) clarify NSP's effect on BERT pre-training, 2) explore fourteen possible auxiliary pre-training tasks, of which seven are novel to modern language models, and 3) investigate different ways to include multiple tasks into pre-training. We show that NSP is detrimental to training due to its context splitting and shallow semantic signal. We also identify six auxiliary pre-training tasks -- sentence ordering, adjacent sentence prediction, TF prediction, TF-IDF prediction, a FastSent variant, and a Quick Thoughts variant -- that outperform a pure MLM baseline. Finally, we demonstrate that using multiple tasks in a multi-task pre-training framework provides better results than using any single auxiliary task. Using these methods, we outperform BERT Base on the GLUE benchmark using fewer than a quarter of the training tokens.


title: MetaDetect: Uncertainty Quantification and Prediction Quality Estimates for Object Detection

abstract: In object detection with deep neural networks, the box-wise objectness score tends to be overconfident, sometimes even indicating high confidence in presence of inaccurate predictions. Hence, the reliability of the prediction and therefore reliable uncertainties are of highest interest. In this work, we present a post processing method that for any given neural network provides predictive uncertainty estimates and quality estimates. These estimates are learned by a post processing model that receives as input a hand-crafted set of transparent metrics in form of a structured dataset. Therefrom, we learn two tasks for predicted bounding boxes. We discriminate between true positives ($\mathit{IoU}\geq0.5$) and false positives ($\mathit{IoU} < 0.5$) which we term meta classification, and we predict $\mathit{IoU}$ values directly which we term meta regression. The probabilities of the meta classification model aim at learning the probabilities of success and failure and therefore provide a modelled predictive uncertainty estimate. On the other hand, meta regression gives rise to a quality estimate. In numerical experiments, we use the publicly available YOLOv3 network and the Faster-RCNN network and evaluate meta classification and regression performance on the Kitti, Pascal VOC and COCO datasets. We demonstrate that our metrics are indeed well correlated with the $\mathit{IoU}$. For meta classification we obtain classification accuracies of up to 98.92% and AUROCs of up to 99.93%. For meta regression we obtain an $R^2$ value of up to 91.78%. These results yield significant improvements compared to other network's objectness score and other baseline approaches. Therefore, we obtain more reliable uncertainty and quality estimates which is particularly interesting in the absence of ground truth.


title: Relic Neutrino Degeneracies and Their Impact on Cosmological Parameters

abstract: In the standard $\Lambda$CDM model, neutrinos are treated as radiation, with their masses and possible degeneracy ignored. In this paper, we compute the impact of a finite relic neutrino degeneracy $\xi$ on the CMB angular power spectra, and obtain constraints on $\xi$ using current cosmological data sets. We find that $\xi \approx O(1)$ is still allowed. We also study the correlations between $\xi$, the Hubble parameter $H_0$, and the spectral index $n_s$. Due to these correlations, the CMB constraints on inflation models are loosened when $\xi$ is fitted together with other cosmological parameters, such that some models excluded at 95% confidence level by standard fittings without $\xi$ could be revived. Furthermore, the tension in CMB and local measurements of $H_0$ is slightly alleviated. Our results suggest that $\xi$ is a non-negligible physical parameter for cosmological analyses.


title: Pricing the zero-coupon bond of the extended Cox-Ingersoll-Ross model using Malliavin calculus

abstract: In this paper, we price the zero-coupon bond of the extended Cox-Ingersoll-Ross model by a Dyson type formula established in one of the authors' paper Jin, Peng and Schelllhorn (2016) using Malliavin calculus. This formula provides a fast convergent series to represent the bond price, and it depends on the given drift and volatility of the interest rate process but not the instantaneous forward rate used in Maghsoodi (1996). This expression can be also regarded as a new solution to a class of Reccati equations with time-dependent coefficients.


title: Propagation of Hauser-Feshbach uncertainty estimates to r-process nucleosynthesis: Benchmark of statistical property models for neutron rich nuclei far from stability

abstract: Multimessenger observations of the neutron star merger event GW170817 have re-energized the debate over the astrophysical origins of the most massive elements via the r-process nucleosynthesis. A key aspect of such studies is comparing astronomical observations to theoretical nucleosynthesis yields in a meaningful way. To perform realistic nucleosynthesis calculations, understanding the uncertainty in microphysics details such as nuclear reaction rates is as essential as understanding uncertainties in modeling the astrophysical environment. We present an investigation of neutron capture rate calculations' uncertainty away from stability using the Hauser-Feshbach model. We provide a quantitative measure of the calculations' dependability when we extrapolate models of statistical properties to nuclei in an r-process network. We select several level density and gamma-ray strength models appropriate for neutron-capture and use them to calculate the reaction rate for each nucleus in the network. We observe how statistical properties affect the theoretical reaction rates. The rates are then sampled with the Monte Carlo technique and used in network calculations to map the range of possible r-process abundances. The results show that neutron capture rates can vary by a couple of orders of magnitude between calculations. Phenomenological models provide smoother results than semi-microscopic. They cannot, however, reproduce nuclear structure changes such as shell closures. While semi-microscopic models predict nuclear structure effects away from stability, it is not clear that these results are quantitatively accurate. The effect of the uncertainty on r-process yields is large enough to impede comparisons between observation and calculations. Progress in developing better microscopic models of gamma strengths and level densities is urgently needed to improve the fidelity of r-process models.


title: Calibrating the Galactic Cepheid Period-Luminosity relation from the maximum-likelihood technique

abstract: We present a realization of the maximum-likelihood (ML) technique, which is one of the latest modifications of the Baade--Becker--Wesselink (BBW) method. Our approach is based on non-linear calibrations of the effective temperature and bolometric correction which take into account metallicity and surface gravity. It allows one to estimate the key Cepheid parameters, the distance modulus, and the interstellar reddening, combining photometric and spectroscopic data (including the effective temperature data). This method is applied to a sample of 44 Galactic Cepheids, for which multiphase temperature measurements are available. The additional data correction is performed to subtract the impact of the component in binary/multiple systems. We also study the effect of shock waves, whose presence in the stellar atmosphere distorts the observational data and leads to systematic errors in the obtained parameters. We determine the optimal restriction on the input data to eliminate this effect. This restriction provides accurate period-radius and period-luminosity relations which are consistent with the results in previous studies. We found the following relations: $log\,R = (0.68 \pm 0.03) \cdot log\,P + (1.14 \pm 0.03)$, $M_v = - (2.67 \pm 0.16) \cdot (log\,P - 1) - (4.14 \pm 0.05)$.


title: Mossad: Defeating Software Plagiarism Detection

abstract: Automatic software plagiarism detection tools are widely used in educational settings to ensure that submitted work was not copied. These tools have grown in use together with the rise in enrollments in computer science programs and the widespread availability of code on-line. Educators rely on the robustness of plagiarism detection tools; the working assumption is that the effort required to evade detection is as high as that required to actually do the assigned work. This paper shows this is not the case. It presents an entirely automatic program transformation approach, Mossad, that defeats popular software plagiarism detection tools. Mossad comprises a framework that couples techniques inspired by genetic programming with domain-specific knowledge to effectively undermine plagiarism detectors. Mossad is effective at defeating four plagiarism detectors, including Moss and JPlag. Mossad is both fast and effective: it can, in minutes, generate modified versions of programs that are likely to escape detection. More insidiously, because of its non-deterministic approach, Mossad can, from a single program, generate dozens of variants, which are classified as no more suspicious than legitimate assignments. A detailed study of Mossad across a corpus of real student assignments demonstrates its efficacy at evading detection. A user study shows that graduate student assistants consistently rate Mossad-generated code as just as readable as authentic student code. This work motivates the need for both research on more robust plagiarism detection tools and greater integration of naturally plagiarism-resistant methodologies like code review into computer science education.


title: Remarks on Periodic Jacobi Matrices on Trees

abstract: We look at periodic Jacobi matrices on trees. We provide upper and lower bounds on the gap of such operators analogous to the well known gap in the spectrum of the Laplacian on the upper half-plane with hyperbolic metric. We make some conjectures about antibound states and make an interesting observation for what [3] calls the rg-model.


title: A High-Order Accurate Meshless Method for Solution of Incompressible Fluid Flow Problems

abstract: Meshless solution to differential equations using radial basis functions (RBF) is an alternative to grid based methods commonly used. Since the meshless method does not need an underlying connectivity in the form of control volumes or elements, issues such as grid skewness that adversely impact accuracy are eliminated. Gaussian, Multiquadrics and inverse Multiquadrics are some of the most popular RBFs used for the solutions of fluid flow and heat transfer problems. But they have additional shape parameters that have to be fine tuned for accuracy and stability. Moreover, they also face stagnation error when the point density is increased for accuracy. Recently, Polyharmonic splines (PHS) with appended polynomials have been shown to solve the above issues and give rapid convergence of discretization errors with the degree of appended polynomials. In this research, we extend the PHS-RBF method for the solution of incompressible Navier-Stokes equations. A fractional step method with explicit convection and explicit diffusion terms is combined with a pressure Poisson equation to satisfy the momentum and continuity equations. Systematic convergence tests have been performed for five model problems with two of them having analytical solutions. We demonstrate fast convergence both with refinement of number of points and degree of appended polynomials. The method is further applied to solve problems such as lid-driven cavity and vortex shedding over circular cylinder. We have also analyzed the performance of this approach for solution of Euler equations. The proposed method shows promise to solve fluid flow and heat transfer problems in complex domains with high accuracy.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: Multi-microphone Complex Spectral Mapping for Utterance-wise and Continuous Speech Separation

abstract: We propose multi-microphone complex spectral mapping, a simple way of applying deep learning for time-varying non-linear beamforming, for speaker separation in reverberant conditions. We aim at both speaker separation and dereverberation. Our study first investigates offline utterance-wise speaker separation and then extends to block-online continuous speech separation (CSS). Assuming a fixed array geometry between training and testing, we train deep neural networks (DNN) to predict the real and imaginary (RI) components of target speech at a reference microphone from the RI components of multiple microphones. We then integrate multi-microphone complex spectral mapping with minimum variance distortionless response (MVDR) beamforming and post-filtering to further improve separation, and combine it with frame-level speaker counting for block-online CSS. Although our system is trained on simulated room impulse responses (RIR) based on a fixed number of microphones arranged in a given geometry, it generalizes well to a real array with the same geometry. State-of-the-art separation performance is obtained on the simulated two-talker SMS-WSJ corpus and the real-recorded LibriCSS dataset.


title: Proton Light Yield in Organic Scintillators using a Double Time-of-Flight Technique

abstract: Recent progress in the development of novel organic scintillators necessitates modern characterization capabilities. As the primary means of energy deposition by neutrons in these materials is n-p elastic scattering, knowledge of the proton light yield is paramount. This work establishes a new model-independent method to continuously measure proton light yield in organic scintillators over a broad energy range. Using a deuteron breakup neutron source at the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory and an array of organic scintillators, the proton light yield of EJ-301 and EJ-309, commercially available organic liquid scintillators from Eljen Technology, were measured via a double time-of-flight technique. The light yield was determined using a kinematically over-constrained system in the proton energy range of 1-20 MeV. The effect of pulse integration length on the magnitude and shape of the proton light yield relation was also explored. This work enables accurate simulation of the performance of advanced neutron detectors and supports the development of next-generation neutron imaging systems.


title: A Polynomial Time Algorithm for Learning Halfspaces with Tsybakov Noise

abstract: We study the problem of PAC learning homogeneous halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, the label of every sample is independently flipped with an adversarially controlled probability that can be arbitrarily close to $1/2$ for a fraction of the samples. {\em We give the first polynomial-time algorithm for this fundamental learning problem.} Our algorithm learns the true halfspace within any desired accuracy $\epsilon$ and succeeds under a broad family of well-behaved distributions including log-concave distributions. Prior to our work, the only previous algorithm for this problem required quasi-polynomial runtime in $1/\epsilon$. Our algorithm employs a recently developed reduction \cite{DKTZ20b} from learning to certifying the non-optimality of a candidate halfspace. This prior work developed a quasi-polynomial time certificate algorithm based on polynomial regression. {\em The main technical contribution of the current paper is the first polynomial-time certificate algorithm.} Starting from a non-trivial warm-start, our algorithm performs a novel "win-win" iterative process which, at each step, either finds a valid certificate or improves the angle between the current halfspace and the true one. Our warm-start algorithm for isotropic log-concave distributions involves a number of analytic tools that may be of broader interest. These include a new efficient method for reweighting the distribution in order to recenter it and a novel characterization of the spectrum of the degree-$2$ Chow parameters.


title: Efficient multiply robust imputation in the presence of influential units in surveys

abstract: Item nonresponse is a common issue in surveys. Because unadjusted estimators may be biased in the presence of nonresponse, it is common practice to impute the missing values with the objective of reducing the nonresponse bias as much as possible. However, commonly used imputation procedures may lead to unstable estimators of population totals/means when influential units are present in the set of respondents. In this article, we consider the class of multiply robust imputation procedures that provide some protection against the failure of underlying model assumptions. We develop an efficient version of multiply robust estimators based on the concept of conditional bias, a measure of influence. We present the results of a simulation study to show the benefits of the proposed method in terms of bias and efficiency.


title: Rank Position Forecasting in Car Racing

abstract: Forecasting is challenging since uncertainty resulted from exogenous factors exists. This work investigates the rank position forecasting problem in car racing, which predicts the rank positions at the future laps for cars. Among the many factors that bring changes to the rank positions, pit stops are critical but irregular and rare. We found existing methods, including statistical models, machine learning regression models, and state-of-the-art deep forecasting model based on encoder-decoder architecture, all have limitations in the forecasting. By elaborative analysis of pit stops events, we propose a deep model, RankNet, with the cause effects decomposition that modeling the rank position sequence and pit stop events separately. It also incorporates probabilistic forecasting to model the uncertainty inside each sub-model. Through extensive experiments, RankNet demonstrates a strong performance improvement over the baselines, e.g., MAE improves more than 10% consistently, and is also more stable when adapting to unseen new data. Details of model optimization, performance profiling are presented. It is promising to provide useful forecasting tools for the car racing analysis and shine a light on solutions to similar challenging issues in general forecasting problems.


title: Hilbert series of symplectic quotients by the 2-torus

abstract: We compute the Hilbert series of the graded algebra of real regular functions on a linear symplectic quotient by the $2$-torus as well as the first four coefficients of the Laurent expansion of this Hilbert series at $t = 1$. We describe an algorithm to compute the Hilbert series as well as the Laurent coefficients in explicit examples.


title: Instead of Rewriting Foreign Code for Machine Learning, Automatically Synthesize Fast Gradients

abstract: Applying differentiable programming techniques and machine learning algorithms to foreign programs requires developers to either rewrite their code in a machine learning framework, or otherwise provide derivatives of the foreign code. This paper presents Enzyme, a high-performance automatic differentiation (AD) compiler plugin for the LLVM compiler framework capable of synthesizing gradients of statically analyzable programs expressed in the LLVM intermediate representation (IR). Enzyme synthesizes gradients for programs written in any language whose compiler targets LLVM IR including C, C++, Fortran, Julia, Rust, Swift, MLIR, etc., thereby providing native AD capabilities in these languages. Unlike traditional source-to-source and operator-overloading tools, Enzyme performs AD on optimized IR. On a machine-learning focused benchmark suite including Microsoft's ADBench, AD on optimized IR achieves a geometric mean speedup of 4.5x over AD on IR before optimization allowing Enzyme to achieve state-of-the-art performance. Packaging Enzyme for PyTorch and TensorFlow provides convenient access to gradients of foreign code with state-of-the art performance, enabling foreign code to be directly incorporated into existing machine learning workflows.


title: Chance-Constrained Controller State and Reference Governor

abstract: The controller state and reference governor (CSRG) is an add-on scheme for nominal closed-loop systems with dynamic controllers which supervises the controller internal state and the reference input to the closed-loop system to enforce pointwise-in-time constraints. By admitting both controller state and reference modifications, the CSRG can achieve an enlarged constrained domain of attraction compared to conventional reference governor schemes where only reference modification is permitted. This paper studies the CSRG for systems subject to stochastic disturbances and chance constraints. We describe the CSRG algorithm in such a stochastic setting and analyze its theoretical properties, including chance-constraint enforcement, finite-time reference convergence, and closed-loop stability. We also present examples illustrating the application of CSRG to constrained aircraft flight control.


title: A Generative Machine Learning Approach to Policy Optimization in Pursuit-Evasion Games

abstract: We consider a pursuit-evasion game [11] played between two agents, 'Blue' (the pursuer) and 'Red' (the evader), over $T$ time steps. Red aims to attack Blue's territory. Blue's objective is to intercept Red by time $T$ and thereby limit the success of Red's attack. Blue must plan its pursuit trajectory by choosing parameters that determine its course of movement (speed and angle in our setup) such that it intercepts Red by time $T$. We show that Blue's path-planning problem in pursuing Red, can be posed as a sequential decision making problem under uncertainty. Blue's unawareness of Red's action policy renders the analytic dynamic programming approach intractable for finding the optimal action policy for Blue. In this work, we are interested in exploring data-driven approaches to the policy optimization problem that Blue faces. We apply generative machine learning (ML) approaches to learn optimal action policies for Blue. This highlights the ability of generative ML model to learn the relevant implicit representations for the dynamics of simulated pursuit-evasion games. We demonstrate the effectiveness of our modeling approach via extensive statistical assessments. This work can be viewed as a preliminary step towards further adoption of generative modeling approaches for addressing policy optimization problems that arise in the context of multi-agent learning and planning [1].


title: IoT Malware Network Traffic Classification using Visual Representation and Deep Learning

abstract: With the increase of IoT devices and technologies coming into service, Malware has risen as a challenging threat with increased infection rates and levels of sophistication. Without strong security mechanisms, a huge amount of sensitive data is exposed to vulnerabilities, and therefore, easily abused by cybercriminals to perform several illegal activities. Thus, advanced network security mechanisms that are able of performing a real-time traffic analysis and mitigation of malicious traffic are required. To address this challenge, we are proposing a novel IoT malware traffic analysis approach using deep learning and visual representation for faster detection and classification of new malware (zero-day malware). The detection of malicious network traffic in the proposed approach works at the package level, significantly reducing the time of detection with promising results due to the deep learning technologies used. To evaluate our proposed method performance, a dataset is constructed which consists of 1000 pcap files of normal and malware traffic that are collected from different network traffic sources. The experimental results of Residual Neural Network (ResNet50) are very promising, providing a 94.50% accuracy rate for detection of malware traffic.


title: Reading Comprehension as Natural Language Inference: A Semantic Analysis

abstract: In the recent past, Natural language Inference (NLI) has gained significant attention, particularly given its promise for downstream NLP tasks. However, its true impact is limited and has not been well studied. Therefore, in this paper, we explore the utility of NLI for one of the most prominent downstream tasks, viz. Question Answering (QA). We transform the one of the largest available MRC dataset (RACE) to an NLI form, and compare the performances of a state-of-the-art model (RoBERTa) on both these forms. We propose new characterizations of questions, and evaluate the performance of QA and NLI models on these categories. We highlight clear categories for which the model is able to perform better when the data is presented in a coherent entailment form, and a structured question-answer concatenation form, respectively.


title: Arithmetic inflection formulae for linear series on hyperelliptic curves

abstract: Over the complex numbers, Pl\"ucker's formula computes the number of inflection points of a linear series of projective dimension $r$ and degree $d$ on a curve of genus $g$. Here we explore the geometric meaning of a natural analogue of Pl\"ucker's formula in $\mathbb{A}^1$-homotopy theory for certain linear series on hyperelliptic curves defined over an arbitrary field.


title: Motion-induced inertial effects and topological phase transitions in skyrmion transport

abstract: In this work, the current-induced inertial effects on skyrmions hosted in ferromagnetic systems are studied. {When the dynamics is considered beyond the particle-like description, magnetic skyrmions can deform due to a self-induced field. We perform Monte Carlo simulations to characterize the deformation of the skyrmion during its movement}. In the low-velocity regime, the deformation in the skyrmion shape is quantified by an effective inertial mass, which is related to the dissipative force. When skyrmions move faster, the large self-induced deformation triggers topological transitions. The transition is characterized by the proliferation of skyrmions and different total topological charge, which are obtained in terms of the skyrmion velocity. Our findings provide an alternative way to describe the skyrmion dynamics that take into account the deformations of its structure. Furthermore, the motion-induced topological phase transition brings the possibility to control the number of ferromagnetic skyrmions by velocity effects.


title: Few-neutron systems with the long-range Casimir-Polder force

abstract: In this work we present results of the long-range electromagnetic Casimir-Polder interactions between two neutrons, a neutron and a conducting wall, and a neutron between two walls. As input, we use the dynamic dipole polarizabilities of the neutron fitted to chiral EFT results up to the pion production threshold and at the onset of the Delta resonance. Our work can be relevant to the physics of confined ultracold neutrons inside bottles.


title: STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generation

abstract: Systems for story generation are asked to produce plausible and enjoyable stories given an input context. This task is underspecified, as a vast number of diverse stories can originate from a single input. The large output space makes it difficult to build and evaluate story generation models, as (1) existing datasets lack rich enough contexts to meaningfully guide models, and (2) existing evaluations (both crowdsourced and automatic) are unreliable for assessing long-form creative text. To address these issues, we introduce a dataset and evaluation platform built from STORIUM, an online collaborative storytelling community. Our author-generated dataset contains 6K lengthy stories (125M tokens) with fine-grained natural language annotations (e.g., character goals and attributes) interspersed throughout each narrative, forming a robust source for guiding models. We evaluate language models fine-tuned on our dataset by integrating them onto STORIUM, where real authors can query a model for suggested story continuations and then edit them. Automatic metrics computed over these edits correlate well with both user ratings of generated stories and qualitative feedback from semi-structured user interviews. We release both the STORIUM dataset and evaluation platform to spur more principled research into story generation.


title: Computational tools for the multiscale analysis of Hi-C data in bacterial chromosomes

abstract: Just as in eukaryotes, high-throughput chromosome conformation capture (Hi-C) data have revealed nested organizations of bacterial chromosomes into overlapping interaction domains. In this chapter, we present a multiscale analysis framework aiming at capturing and quantifying these properties. These include both standard tools (e.g. contact laws) and novel ones such as an index that allows identifying loci involved in domain formation independently of the structuring scale at play. Our objective is two-fold. On the one hand, we aim at providing a full, understandable Python/Jupyter-based code which can be used by both computer scientists as well as biologists with no advanced computational background. On the other hand, we discuss statistical issues inherent to Hi-C data analysis, focusing more particularly on how to properly assess the statistical significance of results. As a pedagogical example, we analyze data produced in {\it Pseudomonas aeruginosa}, a model pathogenetic bacterium. All files (codes and input data) can be found on a github repository. We have also embedded the files into a Binder package so that the full analysis can be run on any machine through internet.


title: Stochastic homogenization of a class of quasiconvex viscous Hamilton-Jacobi equations in one space dimension

abstract: We prove homogenization for a class of viscous Hamilton-Jacobi equations in the stationary and ergodic setting in one space dimension. Our assumptions include most notably the following: the Hamiltonian is of the form $G(p) + \beta V(x,\omega)$, the function $G$ is coercive and strictly quasiconvex, $\min G = 0$, $\beta>0$, the random potential $V$ takes values in $[0,1]$ with full support and it satisfies a hill condition that involves the diffusion coefficient. Our approach is based on showing that, for every direction outside of a bounded interval $(\theta_1(\beta),\theta_2(\beta))$, there is a unique sublinear corrector with certain properties. We obtain a formula for the effective Hamiltonian and deduce that it is coercive, identically equal to $\beta$ on $(\theta_1(\beta),\theta_2(\beta))$, and strictly monotone elsewhere.


title: Superfluid Rayleigh-Plesset extension of FLRW cosmology

abstract: Guided by the analogy with the Rayleigh-Plesset dynamics of multielectron bubbles in superfluid He-4, we consider the cosmological FLRW evolution equation with additional cubic and sixth powers of the inverse of the scale factor of the universe. For the barotropic parameter w=2/3 (coasting universe), along with zero cosmological constant in the absence of viscous terms, by using the Sundman time as evolution parameter, we present parametric solutions for the scale factor of the universe in terms of rational expressions of Weierstrass elliptic functions and their particular cases thereof. For other values of the equation of state parameter w, such as w=-1, but also the same coasting case, we present a more standard discussion in the conformal time variable using solutions obtained by numerical integration.


title: Motion Correction of 3D Dynamic Contrast-Enhanced Ultrasound Imaging without Anatomical Bmode Images

abstract: In conventional 2D DCE-US, motion correction algorithms take advantage of accompanying side-by-side anatomical Bmode images that contain time-stable features. However, current commercial models of 3D DCE-US do not provide side-by-side Bmode images, which makes motion correction challenging. This work introduces a novel motion correction (MC) algorithm for 3D DCE-US and assesses its efficacy when handling clinical data sets. In brief, the algorithm uses a pyramidal approach whereby short temporal windows consisting of 3-6 consecutive frames are created to perform local registrations, which are then registered to a master reference derived from a weighted average of all frames. We evaluated the algorithm in 8 patients with metastatic lesions in the liver using the Philips X6-1 matrix transducer at a frame rate of 1-3 Hz. We assessed improvements in original vs. motion corrected 3D DCE-US cine using: i) frame-to-frame volumetric overlap of segmented lesions, ii) normalized correlation coefficient (NCC) between frames (similarity analysis), and iii) sum of squared errors (SSE), root-mean-squared error (RMSE), and r-squared (R2) quality-of-fit from fitted time-intensity curves (TIC) extracted from a segmented lesion. Overall, results demonstrate significant decreases in 3D DCE-US motion after applying the proposed algorithm. We noted significant improvements in frame-to-frame lesion overlap across all patients, from 68% without correction to 83% with motion correction (p = 0.023). Frame-to-frame similarity as assessed by NCC also significantly improved on two different sets of time points from 0.694 (original cine) to 0.862 (corresponding MC cine) and 0.723 to 0.886. TIC analysis displayed a significant decrease in RMSE (p = 0.018) and a significant increase in R2 goodness-of-fit (p = 0.029) for the patient cohort.


title: Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

abstract: Mobile edge computing (MEC) is a promising technology to support mission-critical vehicular applications, such as intelligent path planning and safety applications. In this paper, a collaborative edge computing framework is developed to reduce the computing service latency and improve service reliability for vehicular networks. First, a task partition and scheduling algorithm (TPSA) is proposed to decide the workload allocation and schedule the execution order of the tasks offloaded to the edge servers given a computation offloading strategy. Second, an artificial intelligence (AI) based collaborative computing approach is developed to determine the task offloading, computing, and result delivery policy for vehicles. Specifically, the offloading and computing problem is formulated as a Markov decision process. A deep reinforcement learning technique, i.e., deep deterministic policy gradient, is adopted to find the optimal solution in a complex urban transportation network. By our approach, the service cost, which includes computing service latency and service failure penalty, can be minimized via the optimal workload assignment and server selection in collaborative computing. Simulation results show that the proposed AI-based collaborative computing approach can adapt to a highly dynamic environment with outstanding performance.


title: Wasm/k: Delimited Continuations for WebAssembly

abstract: WebAssembly is designed to be an alternative to JavaScript that is a safe, portable, and efficient compilation target for a variety of languages. The performance of high-level languages depends not only on the underlying performance of WebAssembly, but also on the quality of the generated WebAssembly code. In this paper, we identify several features of high-level languages that current approaches can only compile to WebAssembly by generating complex and inefficient code. We argue that these problems could be addressed if WebAssembly natively supported first-class continuations. We then present Wasm/k, which extends WebAssembly with delimited continuations. Wasm/k introduces no new value types, and thus does not require significant changes to the WebAssembly type system (validation). Wasm/k is safe, even in the presence of foreign function calls (e.g., to and from JavaScript). Finally, Wasm/k is amenable to efficient implementation: we implement Wasm/k as a local change to Wasmtime, an existing WebAssembly JIT. We evaluate Wasm/k by implementing C/k, which adds delimited continuations to C/C++. C/k uses Emscripten and its implementation serves as a case study on how to use Wasm/k in a compiler that targets WebAssembly. We present several case studies using C/k, and show that on implementing green threads, it can outperform the state-of-the-art approach Asyncify with an 18% improvement in performance and a 30% improvement in code size.


title: TextAttack: Lessons learned in designing Python frameworks for NLP

abstract: TextAttack is an open-source Python toolkit for adversarial attacks, adversarial training, and data augmentation in NLP. TextAttack unites 15+ papers from the NLP adversarial attack literature into a single framework, with many components reused across attacks. This framework allows both researchers and developers to test and study the weaknesses of their NLP models. To build such an open-source NLP toolkit requires solving some common problems: How do we enable users to supply models from different deep learning frameworks? How can we build tools to support as many different datasets as possible? We share our insights into developing a well-written, well-documented NLP Python framework in hope that they can aid future development of similar packages.


title: Attention Guided Semantic Relationship Parsing for Visual Question Answering

abstract: Humans explain inter-object relationships with semantic labels that demonstrate a high-level understanding required to perform complex Vision-Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent relationships as a combination of object-level visual features which constrain a model to express interactions between objects in a single domain, while the model is trying to solve a multi-modal task. In this paper, we propose a general purpose semantic relationship parser which generates a semantic feature vector for each subject-predicate-object triplet in an image, and a Mutual and Self Attention (MSA) mechanism that learns to identify relationship triplets that are important to answer the given question. To motivate the significance of semantic relationships, we show an oracle setting with ground-truth relationship triplets, where our model achieves a ~25% accuracy gain over the closest state-of-the-art model on the challenging GQA dataset. Further, with our semantic parser, we show that our model outperforms other comparable approaches on VQA and GQA datasets.


title: A Fulton-Hansen theorem for almost homogeneous spaces

abstract: We prove a generalization of the Fulton-Hansen connectedness theorem, where ${\mathbb P}^n$ is replaced by a normal variety on which an algebraic group acts with a dense orbit.


title: Strikingly Suspicious Overnight and Intraday Returns

abstract: The world's stock markets display a strikingly suspicious pattern of overnight and intraday returns. Overnight returns to major stock market indices over the past few decades have been wildly positive, while intraday returns have been disturbingly negative. The cause of these astonishingly consistent return patterns is unknown. We highlight the features of these extraordinary patterns that have hindered the construction of any plausible innocuous explanation. We then use those same features to deduce the only plausible explanation so far advanced for these strikingly suspicious returns.


title: Group actions, power mean orbit size, and musical scales

abstract: We provide an application of the theory of group actions to the study of musical scales. For any group $G$, finite $G$-set $S$, and real number $t$, we define the {\it $t$-power diameter} $\operatorname{diam}_t(G,S)$ to be the size of any maximal orbit of $S$ divided by the $t$-power mean orbit size of the elements of $S$. The symmetric group $S_{11}$ acts on the set of all tonic scales, where a {\it tonic scale} is a subset of $\mathbb{Z}_{12}$ containing $0$. We show that, for all $t \in [-1,1]$, among all the subgroups $G$ of $S_{11}$, the $t$-power diameter of the $G$-set of all heptatonic scales is largest for the subgroup $\Gamma$, and its conjugate subgroups, generated by $\{(1 \ 2),(3 \ 4),(5 \ 6),(8 \ 9),(10 \ 11)\}$. The unique maximal $\Gamma$-orbit consists of the 32 th\=ats of Hindustani classical music popularized by Bhatkhande. This analysis provides a reason why these 32 scales, among all 462 heptatonic scales, are of mathematical interest. We also apply our analysis, to a lesser degree, to hexatonic and pentatonic scales.


title: Revisiting Batch Normalization for Training Low-latency Deep Spiking Neural Networks from Scratch

abstract: Spiking Neural Networks (SNNs) have recently emerged as an alternative to deep learning owing to sparse, asynchronous and binary event (or spike) driven processing, that can yield huge energy efficiency benefits on neuromorphic hardware. However, training high-accuracy and low-latency SNNs from scratch suffers from non-differentiable nature of a spiking neuron. To address this training issue in SNNs, we revisit batch normalization and propose a temporal Batch Normalization Through Time (BNTT) technique. Most prior SNN works till now have disregarded batch normalization deeming it ineffective for training temporal SNNs. Different from previous works, our proposed BNTT decouples the parameters in a BNTT layer along the time axis to capture the temporal dynamics of spikes. The temporally evolving learnable parameters in BNTT allow a neuron to control its spike rate through different time-steps, enabling low-latency and low-energy training from scratch. We conduct experiments on CIFAR-10, CIFAR-100, Tiny-ImageNet and event-driven DVS-CIFAR10 datasets. BNTT allows us to train deep SNN architectures from scratch, for the first time, on complex datasets with just few 25-30 time-steps. We also propose an early exit algorithm using the distribution of parameters in BNTT to reduce the latency at inference, that further improves the energy-efficiency.


title: Facebook Political Ads And Accountability: Outside Groups Are Most Negative, Especially When Hiding Donors

abstract: The emergence of online political advertising has come with little regulation, allowing political advertisers on social media to avoid accountability. We analyze how transparency and accountability deficits caused by dark money and disappearing groups relate to the sentiment of political ads on Facebook. We obtained 430,044 ads with FEC-registered advertisers from Facebook's ad library that ran between August-November 2018. We compare ads run by candidates, parties, and outside groups, which we classify by (1) their donor transparency (dark money or disclosed) and (2) the group's permanence (only FEC-registered in 2018 or persistent across cycles). The most negative advertising came from dark money and disappearing outside groups, which were mostly corporations or 501(c) organizations. However, only dark money was associated with a significant decrease in ad sentiment. These results suggest that accountability for political speech matters for advertising tone, especially in the context of affective polarization on social media.


title: Asymptotic expansions of weighted prime power counting functions

abstract: We prove several asymptotic continued fraction expansions of $\pi(x)$, $\Pi(x)$, $\operatorname{li}(x)$, $\operatorname{Ri}(x)$, and related functions, where $\pi(x)$ is the prime counting function, $\Pi(x) = \sum_{k = 1}^\infty \frac{1}{k}\pi(\sqrt[k]{x})$ is the Riemann prime counting function, and $\operatorname{Ri}(x) = \sum_{k=1}^\infty \frac{ \mu(k)}{k} \operatorname{li}(\sqrt[k]{x})$ is Riemann's approximation to the prime counting function. We also determine asymptotic continued fraction expansions of the function $\sum_{p \leq x} p^s$ for all $s \in \mathbb{C}$ with $\operatorname{Re}(s) > -1$, and of the functions $\sum_{a^x < p \leq a^{x+1}} \frac{1}{p}$ and $\log \prod_{a^x < p \leq a^{x+1}} (1 -1/p)^{-1}$ for all real numbers $a > 1$. We also determine the first few terms of an asymptotic continued fraction expansion of the function $\pi(ax)-\pi(bx)$ for $a > b > 0$. As a corollary of these results, we determine the best rational approximations of the "linearized" verions of these various functions.


title: Lipschitz Bounded Equilibrium Networks

abstract: This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a Lipschitz bound during training via unconstrained optimization: no projections or barrier functions are required. Lipschitz bounds are a common proxy for robustness and appear in many generalization bounds. Furthermore, compared to previous works we show well-posedness (existence of solutions) under less restrictive conditions on the network weights and more natural assumptions on the activation functions: that they are monotone and slope restricted. These results are proved by establishing novel connections with convex optimization, operator splitting on non-Euclidean spaces, and contracting neural ODEs. In image classification experiments we show that the Lipschitz bounds are very accurate and improve robustness to adversarial attacks.

categories: cs.LG cs.CV cs.SY eess.SY math.OC stat.ML


title: D3Net: Densely connected multidilated DenseNet for music source separation

abstract: Music source separation involves a large input field to model a long-term dependence of an audio signal. Previous convolutional neural network (CNN)-based approaches address the large input field modeling using sequentially down- and up-sampling feature maps or dilated convolution. In this paper, we claim the importance of a rapid growth of a receptive field and a simultaneous modeling of multi-resolution data in a single convolution layer, and propose a novel CNN architecture called densely connected dilated DenseNet (D3Net). D3Net involves a novel multi-dilated convolution that has different dilation factors in a single layer to model different resolutions simultaneously. By combining the multi-dilated convolution with DenseNet architecture, D3Net avoids the aliasing problem that exists when we naively incorporate the dilated convolution in DenseNet. Experimental results on MUSDB18 dataset show that D3Net achieves state-of-the-art performance with an average signal to distortion ratio (SDR) of 6.01 dB.


title: Finding Signs of Life on Earth-like Planets: High-resolution Transmission Spectra of Earth through time around FGKM stars

abstract: The search for life in the universe mainly uses modern Earth as a template. However, we know that Earth's atmospheric composition changed significantly through its geological evolution. Recent discoveries show that transiting, potentially Earth-like exoplanets orbit a wide range of host stars, which strongly influence their atmospheric composition and remotely detectable spectra. Thus, a database for transiting terrestrial exoplanet around different host stars at different geological times is a crucial missing ingredient to support observational searches for signs of life in exoplanet atmospheres. Here, we present the first high-resolution transmission spectra database for Earth-like planets, orbiting a wide range of host stars, throughout four representative stages of Earth's history. These correspond to a prebiotic high CO2-world - about 3.9 billion years ago in Earth's history - and three epochs through the rise of oxygen from 0.2% to modern atmospheric levels of 21%. We demonstrate that the spectral biosignature pairs O2 + CH4 and O3 + CH4 in the atmosphere of a transiting Earth-like planet would show a remote observer that a biosphere exists for oxygen concentrations of about 1% modern Earth's - corresponding to about 1 to 2 billion years ago in Earth's history - for all host stars. The full model and high-resolution transmission spectra database, covering 0.4 to 20microns, for transiting exoplanets - from young prebiotic worlds to modern Earths-analogs - orbiting a wide range of host stars is available online. It can be used as a tool to plan and optimize our observation strategy, train retrieval methods, and interpret upcoming observations with ground- and space-based telescopes.


title: MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning

abstract: Multi-hop reasoning approaches over knowledge graphs infer a missing relationship between entities with a multi-hop rule, which corresponds to a chain of relationships. We extend existing works to consider a generalized form of multi-hop rules, where each rule is a set of relation chains. To learn such generalized rules efficiently, we propose a two-step approach that first selects a small set of relation chains as a rule and then evaluates the confidence of the target relationship by jointly scoring the selected chains. A game-theoretical framework is proposed to this end to simultaneously optimize the rule selection and prediction steps. Empirical results show that our multi-chain multi-hop (MCMH) rules result in superior results compared to the standard single-chain approaches, justifying both our formulation of generalized rules and the effectiveness of the proposed learning framework.


title: Geometry-aware Instance-reweighted Adversarial Training

abstract: In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other direction, whether we can keep the accuracy while improving the robustness, is conceptually and practically more interesting, since robust accuracy should be lower than standard accuracy for any model. In this paper, we show this direction is also promising. Firstly, we find even over-parameterized deep networks may still have insufficient model capacity, because adversarial training has an overwhelming smoothing effect. Secondly, given limited model capacity, we argue adversarial data should have unequal importance: geometrically speaking, a natural data point closer to/farther from the class boundary is less/more robust, and the corresponding adversarial data point should be assigned with larger/smaller weight. Finally, to implement the idea, we propose geometry-aware instance-reweighted adversarial training, where the weights are based on how difficult it is to attack a natural data point. Experiments show that our proposal boosts the robustness of standard adversarial training; combining two directions, we improve both robustness and accuracy of standard adversarial training.


title: Transformer-Based Neural Text Generation with Syntactic Guidance

abstract: We study the problem of using (partial) constituency parse trees as syntactic guidance for controlled text generation. Existing approaches to this problem use recurrent structures, which not only suffer from the long-term dependency problem but also falls short in modeling the tree structure of the syntactic guidance. We propose to leverage the parallelism of Transformer to better incorporate parse trees. Our method first expands a partial template constituency parse tree to a full-fledged parse tree tailored for the input source text, and then uses the expanded tree to guide text generation. The effectiveness of our model in this process hinges upon two new attention mechanisms: 1) a path attention mechanism that forces one node to attend to only other nodes located in its path in the syntax tree to better incorporate syntax guidance; 2) a multi-encoder attention mechanism that allows the decoder to dynamically attend to information from multiple encoders. Our experiments in the controlled paraphrasing task show that our method outperforms SOTA models both semantically and syntactically, improving the best baseline's BLEU score from 11.83 to 26.27.