title: SVM-Lattice: A Recognition & Evaluation Frame for Double-peaked Profiles

abstract: In big data era, the special data with rare characteristics may be of great significations. However, it is very difficult to automatically search these samples from the massive and high-dimensional datasets and systematically evaluate them. The DoPS, our previous work [2], provided a search method of rare spectra with double-peaked profiles from massive and high-dimensional data of LAMOST survey. The identification of the results is mainly depended on visually inspection by astronomers. In this paper, as a follow-up study, a new lattice structure named SVM-Lattice is designed based on SVM(Support Vector Machine) and FCL(Formal Concept Lattice) and particularly applied in the recognition and evaluation of rare spectra with double-peaked profiles. First, each node in the SVM-Lattice structure contains two components: the intents are defined by the support vectors trained by the spectral samples with the specific characteristics, and the relevant extents are all the positive samples classified by the support vectors. The hyperplanes can be extracted from every lattice node and used as classifiers to search targets by categories. A generalization and specialization relationship is expressed between the layers, and higher layers indicate higher confidence of targets. Then, including a SVM-Lattice building algorithm, a pruning algorithm based on association rules, and an evaluation algorithm, the supporting algorithms are provided and analysed. Finally, for the recognition and evaluation of spectra with double-peaked profiles, several data sets from LAMOST survey are used as experimental dataset. The results exhibit good consistency with traditional methods, more detailed and accurate evaluations of classification results, and higher searching efficiency than other similar methods.


title: Algebraic Groups Constructed From Rings with Involution

abstract: We define a class of groups constructed from rings equipped with an involution. We show that under suitable conditions, these groups are either algebraic or arithmetic, including as special cases the orientation-preserving isometry group of hyperbolic 4-space, $SL(2,R)$ for any commutative ring $R$, various symplectic and orthogonal groups, and an important class of arithmetic subgroups of $SO^+(4,1)$. We investigate when such groups are isomorphic and conjugate, and relate this to problem of determining when hyperbolic $4$-orbifolds are homotopic.


title: Planar Symmetric Juggling of a Devil-Stick

abstract: Juggling a devil-stick can be described as a problem of non-prehensile manipulation. Assuming that the devil-stick remains confined to the vertical plane, the problem of juggling the stick between two symmetric configurations is considered. Impulsive forces are applied to the stick intermittently and the impulse of the force and its point of application are modeled as control inputs to the system. The dynamics of the devil-stick due to the impulsive forces and gravity is described by half-return maps between two Poincare sections; the symmetric configurations are fixed points of these sections. A coordinate transformation is used to convert the juggling problem to that of stabilization of one of the fixed points. Inclusion of the coordinate transformation in the dynamic model results in a nonlinear discrete-time system. A dead-beat design for one of the inputs simplifies the control problem and results in a linear time-invariant discrete-time system. Standard control techniques are used to show that symmetric juggling can be achieved from arbitrary initial conditions.


title: Pointer-Machine Algorithms for Fully-Online Construction of Suffix Trees and DAWGs on Multiple Strings

abstract: We deal with the problem of maintaining the suffix tree indexing structure for a fully-online collection of multiple strings, where a new character can be prepended to any string in the collection at any time. The only previously known algorithm for the problem, recently proposed by Takagi et al. [Algorithmica 82(5): 1346-1377 (2020)], runs in $O(N \log \sigma)$ time and $O(N)$ space on the word RAM model, where $N$ denotes the total length of the strings and $\sigma$ denotes the alphabet size. Their algorithm makes heavy use of the nearest marked ancestor (NMA) data structure on semi-dynamic trees, that can answer queries and supports insertion of nodes in $O(1)$ amortized time on the word RAM model. In this paper, we present a simpler fully-online right-to-left algorithm that builds the suffix tree for a given string collection in $O(N (\log \sigma + \log d))$ time and $O(N)$ space, where $d$ is the maximum number of in-coming Weiner links to a node of the suffix tree. We note that $d$ is bounded by the height of the suffix tree, which is further bounded by the length of the longest string in the collection. The advantage of this new algorithm is that it works on the pointer machine model, namely, it does not use the complicated NMA data structures that involve table look-ups. As a byproduct, we also obtain a pointer-machine algorithm for building the directed acyclic word graph (DAWG) for a fully-online left-to-right collection of multiple strings, which runs in $O(N (\log \sigma + \log d))$ time and $O(N)$ space again without the aid of the NMA data structures.


title: Some characterizations of L-weakly compact sets using the the unbounded absolutely weakly convergence and applications

abstract: Based on the concept of unbounded absolutely weakly convergence, we give new characterizations of L-weakly compact sets. As applications, we find some properties of order weakly compact operators. Also, a new characterizations of order continuous Banach lattices are obtained.


title: Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models

abstract: Recent works show that pre-trained language models (PTLMs), such as BERT, possess certain commonsense and factual knowledge. They suggest that it is promising to use PTLMs as "neural knowledge bases" via predicting masked words. Surprisingly, we find that this may not work for numerical commonsense knowledge (e.g., a bird usually has two legs). In this paper, we investigate whether and to what extent we can induce numerical commonsense knowledge from PTLMs as well as the robustness of this process. To study this, we introduce a novel probing task with a diagnostic dataset, NumerSense, containing 13.6k masked-word-prediction probes (10.5k for fine-tuning and 3.1k for testing). Our analysis reveals that: (1) BERT and its stronger variant RoBERTa perform poorly on the diagnostic dataset prior to any fine-tuning; (2) fine-tuning with distant supervision brings some improvement; (3) the best supervised model still performs poorly as compared to human performance (54.06% vs 96.3% in accuracy).


title: Observing photo-induced chiral edge states of graphene nanoribbons in pump-probe spectroscopies

abstract: Photo-induced edge states in low dimensional materials have attracted considerable attention due to the tunability of topological properties and dispersion. Specifically, graphene nanoribbons have been predicted to host chiral edge modes upon irradiation with circularly polarized light. Here, we present numerical calculations of time-resolved angle resolved photoemission spectroscopy (trARPES) and time-resolved resonant inelastic x-ray scattering (trRIXS) of a graphene nanoribbon. We characterize pump-probe spectroscopic signatures of photo-induced edge states, illustrate the origin of distinct spectral features that arise from Floquet topological edge modes, and investigate the roles of incoming photon energies and finite core-hole lifetime in RIXS. With momentum, energy, and time resolution, pump-probe spectroscopies can play an important role in understanding the behavior of photo-induced topological states of matter.


title: Reciprocal plasmonic metasurfaces: Theory and applications

abstract: A new configuration for metasurface construction is presented to achieve multi-functional capabilities including perfect absorption, bio/chem sensing, and surface-mode lasing. The reciprocal plasmonic metasurfaces discussed here are composed of two plasmonic surfaces of reciprocal geometries separated by a dielectric spacer. Compared to conventional metasurfaces this simple geometry exhibits an enhanced optical performance. The discussed reciprocal metasurface design further enables effective structural optimization and allows for a simple and scalable fabrication. The physical principle and potential applications of the reciprocal plasmonic metasurfaces are demonstrated using numerical and analytical approaches.


title: Angular reconstruction of high energy air showers using the radio signal spectrum

abstract: The Hellenic Open University extensive air shower array (also known as Astroneu array) is a small scale hybrid detection system operating in an area with high levels of electromagnetic noise from anthropogenic activity. In the present study we report the latest results of the data analysis concerning the estimation of the shower direction using the spectrum of the RF system. In a recent layout of the array, 4 RF antennas were operating receiving a common trigger from an autonomous detection station of 3 particle detectors. The directions estimated with the RF system are in very good agreement with the corresponding estimations using the particle detectors demonstrating that a single antenna has the potential for reconstructing the shower axis angular direction.


title: Open Graph Benchmark: Datasets for Machine Learning on Graphs

abstract: We present the Open Graph Benchmark (OGB), a diverse set of challenging and realistic benchmark datasets to facilitate scalable, robust, and reproducible graph machine learning (ML) research. OGB datasets are large-scale, encompass multiple important graph ML tasks, and cover a diverse range of domains, ranging from social and information networks to biological networks, molecular graphs, source code ASTs, and knowledge graphs. For each dataset, we provide a unified evaluation protocol using meaningful application-specific data splits and evaluation metrics. In addition to building the datasets, we also perform extensive benchmark experiments for each dataset. Our experiments suggest that OGB datasets present significant challenges of scalability to large-scale graphs and out-of-distribution generalization under realistic data splits, indicating fruitful opportunities for future research. Finally, OGB provides an automated end-to-end graph ML pipeline that simplifies and standardizes the process of graph data loading, experimental setup, and model evaluation. OGB will be regularly updated and welcomes inputs from the community. OGB datasets as well as data loaders, evaluation scripts, baseline code, and leaderboards are publicly available at https://ogb.stanford.edu .


title: Intrusion of Magnetic Peninsula toward the Neighboring Opposite-polarity Region That Triggers the Largest Solar Flare in Solar Cycle 24

abstract: The largest X9.3 solar flare in solar cycle 24 and the preceding X2.2 flare occurred on September 6, 2017, in the solar active region NOAA 12673. This study aims to understand the onset mechanism of these flares via analysis of multiple observational datasets from the Hinode and Solar Dynamics Observatory and results from a non-linear force-free field extrapolation. The most noticeable feature is the intrusion of a major negative-polarity region, appearing similar to a peninsula, oriented northwest into a neighboring opposite-polarity region. We also observe proxies of magnetic reconnection caused by related to the intrusion of the negative peninsula: rapid changes of the magnetic field around the intruding negative peninsula; precursor brightening at the tip of the negative peninsula, including a cusp-shaped brightening that shows a transient but significant downflow (~100 km/s) at a leg of the cusp; a dark tube-like structure that appears to be a magnetic flux rope that erupted with the X9.3 flare; and coronal brightening along the dark tube-like structure that appears to represent the electric current generated under the flux rope. Based on these observational features, we propose that (1) the intrusion of the negative peninsula was critical in promoting the push-mode magnetic reconnection that forms and grows a twisted magnetic flux rope that erupted with the X2.2 flare, (2) the continuing intrusion progressing even beyond the X2.2 flare is further promoted to disrupt the equilibrium that leads the reinforcement of the magnetic flux rope that erupted with the X9.3 flare.


title: An Imitation Game for Learning Semantic Parsers from User Interaction

abstract: Despite the widely successful applications, bootstrapping and fine-tuning semantic parsers are still a tedious process with challenges such as costly data annotation and privacy risks. In this paper, we suggest an alternative, human-in-the-loop methodology for learning semantic parsers directly from users. A semantic parser should be introspective of its uncertainties and prompt for user demonstration when uncertain. In doing so it also gets to imitate the user behavior and continue improving itself autonomously with the hope that eventually it may become as good as the user in interpreting their questions. To combat the sparsity of demonstration, we propose a novel annotation-efficient imitation learning algorithm, which iteratively collects new datasets by mixing demonstrated states and confident predictions and re-trains the semantic parser in a Dataset Aggregation fashion (Ross et al., 2011). We provide a theoretical analysis of its cost bound and also empirically demonstrate its promising performance on the text-to-SQL problem. Code will be available at https://github.com/sunlab-osu/MISP.


title: Independent Set on P$_k$-Free Graphs in Quasi-Polynomial Time

abstract: We present an algorithm that takes as input a graph $G$ with weights on the vertices, and computes a maximum weight independent set $S$ of $G$. If the input graph $G$ excludes a path $P_k$ on $k$ vertices as an induced subgraph, the algorithm runs in time $n^{O(k^2 \log^3 n)}$. Hence, for every fixed $k$ our algorithm runs in quasi-polynomial time. This resolves in the affirmative an open problem of [Thomass\'{e}, SODA'20 invited presentation]. Previous to this work, polynomial time algorithms were only known for $P_4$-free graphs [Corneil et al., DAM'81], $P_5$-free graphs [Lokshtanov et al., SODA'14], and $P_6$-free graphs [Grzesik et al., SODA'19]. For larger values of $t$, only $2^{O(\sqrt{kn\log n})}$ time algorithms [Basc\'{o} et al., Algorithmica'19] and quasi-polynomial time approximation schemes [Chudnovsky et al., SODA'20] were known. Thus, our work is the first to offer conclusive evidence that Independent Set on $P_k$-free graphs is not NP-complete for any integer $k$. Additionally we show that for every graph $H$, if there exists a quasi-polynomial time algorithm for Independent Set on $C$-free graphs for every connected component $C$ of $H$, then there also exists a quasi-polynomial time algorithm for {\sc Independent Set} on $H$-free graphs. This lifts our quasi-polynomial time algorithm to $T_k$-free graphs, where $T_k$ has one component that is a $P_k$, and $k-1$ components isomorphic to a fork (the unique $5$-vertex tree with a degree $3$ vertex).


title: Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering

abstract: Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on these KGs may not suffice, considering their limited coverage and the contextual dependence of their knowledge. In this paper, we augment a general commonsense QA framework with a knowledgeable path generator. By extrapolating over existing paths in a KG with a state-of-the-art language model, our generator learns to connect a pair of entities in text with a dynamic, and potentially novel, multi-hop relational path. Such paths can provide structured evidence for solving commonsense questions without fine-tuning the path generator. Experiments on two datasets show the superiority of our method over previous works which fully rely on knowledge from KGs (with up to 6% improvement in accuracy), across various amounts of training data. Further evaluation suggests that the generated paths are typically interpretable, novel, and relevant to the task.


title: Design Challenges in Low-resource Cross-lingual Entity Linking

abstract: Cross-lingual Entity Linking (XEL), the problem of grounding mentions of entities in a foreign language text into an English knowledge base such as Wikipedia, has seen a lot of research in recent years, with a range of promising techniques. However, current techniques do not rise to the challenges introduced by text in low-resource languages (LRL) and, surprisingly, fail to generalize to text not taken from Wikipedia, on which they are usually trained. This paper provides a thorough analysis of low-resource XEL techniques, focusing on the key step of identifying candidate English Wikipedia titles that correspond to a given foreign language mention. Our analysis indicates that current methods are limited by their reliance on Wikipedia's interlanguage links and thus suffer when the foreign language's Wikipedia is small. We conclude that the LRL setting requires the use of outside-Wikipedia cross-lingual resources and present a simple yet effective zero-shot XEL system, QuEL, that utilizes search engines query logs. With experiments on 25 languages, QuEL~shows an average increase of 25\% in gold candidate recall and of 13\% in end-to-end linking accuracy over state-of-the-art baselines.


title: Are Emojis Emotional? A Study to Understand the Association between Emojis and Emotions

abstract: Given the growing ubiquity of emojis in language, there is a need for methods and resources that shed light on their meaning and communicative role. One conspicuous aspect of emojis is their use to convey affect in ways that may otherwise be non-trivial to achieve. In this paper, we seek to explore the connection between emojis and emotions by means of a new dataset consisting of human-solicited association ratings. We additionally conduct experiments to assess to what extent such associations can be inferred from existing data, such that similar associations can be predicted for a larger set of emojis. Our experiments show that this succeeds when high-quality word-level information is available.


title: Optimal Beam Association for High Mobility mmWave Vehicular Networks: Lightweight Parallel Reinforcement Learning Approach

abstract: In intelligent transportation systems (ITS), vehicles are expected to feature with advanced applications and services which demand ultra-high data rates and low-latency communications. For that, the millimeter wave (mmWave) communication has been emerging as a very promising solution. However, incorporating the mmWave into ITS is particularly challenging due to the high mobility of vehicles and the inherent sensitivity of mmWave beams to dynamic blockages. This article addresses these problems by developing an optimal beam association framework for mmWave vehicular networks under high mobility. Specifically, we use the semi-Markov decision process to capture the dynamics and uncertainty of the environment. The Q-learning algorithm is then often used to find the optimal policy. However, Q-learning is notorious for its slow-convergence. Instead of adopting deep reinforcement learning structures (like most works in the literature), we leverage the fact that there are usually multiple vehicles on the road to speed up the learning process. To that end, we develop a lightweight yet very effective parallel Q-learning algorithm to quickly obtain the optimal policy by simultaneously learning from various vehicles. Extensive simulations demonstrate that our proposed solution can increase the data rate by 47% and reduce the disconnection probability by 29% compared to other solutions.


title: On the Generalization Effects of Linear Transformations in Data Augmentation

abstract: Data augmentation is a powerful technique to improve performance in applications such as image and text classification tasks. Yet, there is little rigorous understanding of why and how various augmentations work. In this work, we consider a family of linear transformations and study their effects on the ridge estimator in an over-parametrized linear regression setting. First, we show that transformations that preserve the labels of the data can improve estimation by enlarging the span of the training data. Second, we show that transformations that mix data can improve estimation by playing a regularization effect. Finally, we validate our theoretical insights on MNIST. Based on the insights, we propose an augmentation scheme that searches over the space of transformations by how uncertain the model is about the transformed data. We validate our proposed scheme on image and text datasets. For example, our method outperforms random sampling methods by 1.24% on CIFAR-100 using Wide-ResNet-28-10. Furthermore, we achieve comparable accuracy to the SoTA Adversarial AutoAugment on CIFAR-10, CIFAR-100, SVHN, and ImageNet datasets.


title: Robust and Interpretable Grounding of Spatial References with Relation Networks

abstract: Learning representations of spatial references in natural language is a key challenge in tasks like autonomous navigation and robotic manipulation. Recent work has investigated various neural architectures for learning multi-modal representations for spatial concepts. However, the lack of explicit reasoning over entities makes such approaches vulnerable to noise in input text or state observations. In this paper, we develop effective models for understanding spatial references in text that are robust and interpretable, without sacrificing performance. We design a text-conditioned \textit{relation network} whose parameters are dynamically computed with a cross-modal attention module to capture fine-grained spatial relations between entities. This design choice provides interpretability of learned intermediate outputs. Experiments across three tasks demonstrate that our model achieves superior performance, with a 17\% improvement in predicting goal locations and a 15\% improvement in robustness compared to state-of-the-art systems.


title: DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering

abstract: Transformer-based QA models use input-wide self-attention -- i.e. across both the question and the input passage -- at all layers, causing them to be slow and memory-intensive. It turns out that we can get by without input-wide self-attention at all layers, especially in the lower layers. We introduce DeFormer, a decomposed transformer, which substitutes the full self-attention with question-wide and passage-wide self-attentions in the lower layers. This allows for question-independent processing of the input text representations, which in turn enables pre-computing passage representations reducing runtime compute drastically. Furthermore, because DeFormer is largely similar to the original model, we can initialize DeFormer with the pre-training weights of a standard transformer, and directly fine-tune on the target QA dataset. We show DeFormer versions of BERT and XLNet can be used to speed up QA by over 4.3x and with simple distillation-based losses they incur only a 1% drop in accuracy. We open source the code at https://github.com/StonyBrookNLP/deformer.


title: Deep ConvLSTM with self-attention for human activity decoding using wearables

abstract: Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal features from time-series data from multiple sensors. We propose a deep neural network architecture that not only captures the spatio-temporal features of multiple sensor time-series data but also selects, learns important time points by utilizing a self-attention mechanism. We show the validity of the proposed approach across different data sampling strategies on six public datasets and demonstrate that the self-attention mechanism gave a significant improvement in performance over deep networks using a combination of recurrent and convolution networks. We also show that the proposed approach gave a statistically significant performance enhancement over previous state-of-the-art methods for the tested datasets. The proposed methods open avenues for better decoding of human activity from multiple body sensors over extended periods of time. The code implementation for the proposed model is available at https://github.com/isukrit/encodingHumanActivity.


title: Gender Bias in Multilingual Embeddings and Cross-Lingual Transfer

abstract: Multilingual representations embed words from many languages into a single semantic space such that words with similar meanings are close to each other regardless of the language. These embeddings have been widely used in various settings, such as cross-lingual transfer, where a natural language processing (NLP) model trained on one language is deployed to another language. While the cross-lingual transfer techniques are powerful, they carry gender bias from the source to target languages. In this paper, we study gender bias in multilingual embeddings and how it affects transfer learning for NLP applications. We create a multilingual dataset for bias analysis and propose several ways for quantifying bias in multilingual representations from both the intrinsic and extrinsic perspectives. Experimental results show that the magnitude of bias in the multilingual representations changes differently when we align the embeddings to different target spaces and that the alignment direction can also have an influence on the bias in transfer learning. We further provide recommendations for using the multilingual word representations for downstream tasks.


title: UnifiedQA: Crossing Format Boundaries With a Single QA System

abstract: Question answering (QA) tasks have been posed using a variety of formats, such as extractive span selection, multiple choice, etc. This has led to format-specialized models, and even to an implicit division in the QA community. We argue that such boundaries are artificial and perhaps unnecessary, given the reasoning abilities we seek to teach are not governed by the format. As evidence, we use the latest advances in language modeling to build a single pre-trained QA model, UnifiedQA, that performs surprisingly well across 17 QA datasets spanning 4 diverse formats. UnifiedQA performs on par with 9 different models that were trained on individual datasets themselves. Even when faced with 12 unseen datasets of observed formats, UnifiedQA performs surprisingly well, showing strong generalization from its out-of-format training data. Finally, simply fine-tuning this pre-trained QA model into specialized models results in a new state of the art on 6 datasets, establishing UnifiedQA as a strong starting point for building QA systems.


title: Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymen

abstract: The curse of knowledge can impede communication between experts and laymen. We propose a new task of expertise style transfer and contribute a manually annotated dataset with the goal of alleviating such cognitive biases. Solving this task not only simplifies the professional language, but also improves the accuracy and expertise level of laymen descriptions using simple words. This is a challenging task, unaddressed in previous work, as it requires the models to have expert intelligence in order to modify text with a deep understanding of domain knowledge and structures. We establish the benchmark performance of five state-of-the-art models for style transfer and text simplification. The results demonstrate a significant gap between machine and human performance. We also discuss the challenges of automatic evaluation, to provide insights into future research directions. The dataset is publicly available at https://srhthu.github.io/expertise-style-transfer.


title: A Girl Has A Name: Detecting Authorship Obfuscation

abstract: Authorship attribution aims to identify the author of a text based on the stylometric analysis. Authorship obfuscation, on the other hand, aims to protect against authorship attribution by modifying a text's style. In this paper, we evaluate the stealthiness of state-of-the-art authorship obfuscation methods under an adversarial threat model. An obfuscator is stealthy to the extent an adversary finds it challenging to detect whether or not a text modified by the obfuscator is obfuscated - a decision that is key to the adversary interested in authorship attribution. We show that the existing authorship obfuscation methods are not stealthy as their obfuscated texts can be identified with an average F1 score of 0.87. The reason for the lack of stealthiness is that these obfuscators degrade text smoothness, as ascertained by neural language models, in a detectable manner. Our results highlight the need to develop stealthy authorship obfuscation methods that can better protect the identity of an author seeking anonymity.


title: Differentially Private Collaborative Intrusion Detection Systems For VANETs

abstract: Vehicular ad hoc network (VANET) is an enabling technology in modern transportation systems for providing safety and valuable information, and yet vulnerable to a number of attacks from passive eavesdropping to active interfering. Intrusion detection systems (IDSs) are important devices that can mitigate the threats by detecting malicious behaviors. Furthermore, the collaborations among vehicles in VANETs can improve the detection accuracy by communicating their experiences between nodes. To this end, distributed machine learning is a suitable framework for the design of scalable and implementable collaborative detection algorithms over VANETs. One fundamental barrier to collaborative learning is the privacy concern as nodes exchange data among them. A malicious node can obtain sensitive information of other nodes by inferring from the observed data. In this paper, we propose a privacy-preserving machine-learning based collaborative IDS (PML-CIDS) for VANETs. The proposed algorithm employs the alternating direction method of multipliers (ADMM) to a class of empirical risk minimization (ERM) problems and trains a classifier to detect the intrusions in the VANETs. We use the differential privacy to capture the privacy notation of the PML-CIDS and propose a method of dual variable perturbation to provide dynamic differential privacy. We analyze theoretical performance and characterize the fundamental tradeoff between the security and privacy of the PML-CIDS. We also conduct numerical experiments using the NSL-KDD dataset to corroborate the results on the detection accuracy, security-privacy tradeoffs, and design.


title: Automotive-Radar-Based 50-cm Urban Positioning

abstract: Deployment of automated ground vehicles (AGVs) beyond the confines of sunny and dry climes will require sub-lane-level positioning techniques based on radio waves rather than near-visible-light radiation. Like human sight, lidar and cameras perform poorly in low-visibility conditions. This paper develops and demonstrates a novel technique for robust 50-cm-accurate urban ground positioning based on commercially-available low-cost automotive radars. The technique is computationally efficient yet obtains a globally-optimal translation and heading solution, avoiding local minima caused by repeating patterns in the urban radar environment. Performance is evaluated on an extensive and realistic urban data set. Comparison against ground truth shows that, when coupled with stable short-term odometry, the technique maintains 95-percentile errors below 50 cm in horizontal position and 1 degree in heading.


title: AVA: an Automatic eValuation Approach to Question Answering Systems

abstract: We introduce AVA, an automatic evaluation approach for Question Answering, which given a set of questions associated with Gold Standard answers, can estimate system Accuracy. AVA uses Transformer-based language models to encode question, answer, and reference text. This allows for effectively measuring the similarity between the reference and an automatic answer, biased towards the question semantics. To design, train and test AVA, we built multiple large training, development, and test sets on both public and industrial benchmarks. Our innovative solutions achieve up to 74.7% in F1 score in predicting human judgement for single answers. Additionally, AVA can be used to evaluate the overall system Accuracy with an RMSE, ranging from 0.02 to 0.09, depending on the availability of multiple references.


title: A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos

abstract: Watching instructional videos are often used to learn about procedures. Video captioning is one way of automatically collecting such knowledge. However, it provides only an indirect, overall evaluation of multimodal models with no finer-grained quantitative measure of what they have learned. We propose instead, a benchmark of structured procedural knowledge extracted from cooking videos. This work is complementary to existing tasks, but requires models to produce interpretable structured knowledge in the form of verb-argument tuples. Our manually annotated open-vocabulary resource includes 356 instructional cooking videos and 15,523 video clip/sentence-level annotations. Our analysis shows that the proposed task is challenging and standard modeling approaches like unsupervised segmentation, semantic role labeling, and visual action detection perform poorly when forced to predict every action of a procedure in a structured form.


title: Benchmarking Materials Property Prediction Methods: The Matbench Test Set and Automatminer Reference Algorithm

abstract: We present a benchmark test suite and an automated machine learning procedure for evaluating supervised machine learning (ML) models for predicting properties of inorganic bulk materials. The test suite, Matbench, is a set of 13 ML tasks that range in size from 312 to 132k samples and contain data from 10 density functional theory-derived and experimental sources. Tasks include predicting optical, thermal, electronic, thermodynamic, tensile, and elastic properties given a materials composition and/or crystal structure. The reference algorithm, Automatminer, is a highly-extensible, fully-automated ML pipeline for predicting materials properties from materials primitives (such as composition and crystal structure) without user intervention or hyperparameter tuning. We test Automatminer on the Matbench test suite and compare its predictive power with state-of-the-art crystal graph neural networks and a traditional descriptor-based Random Forest model. We find Automatminer achieves the best performance on 8 of 13 tasks in the benchmark. We also show our test suite is capable of exposing predictive advantages of each algorithm - namely, that crystal graph methods appear to outperform traditional machine learning methods given ~10^4 or greater data points. The pre-processed, ready-to-use Matbench tasks and the Automatminer source code are open source and available online (http://hackingmaterials.lbl.gov/automatminer/). We encourage evaluating new materials ML algorithms on the MatBench benchmark and comparing them against the latest version of Automatminer.


title: Elucidation of lasing mechanism in all-inorganic perovskite microcavity with exciton/free-carrier hybrid nature

abstract: Lead-halide perovskites are highly promising for various optoelectronic applications including laser devices. However, fundamental photophysics describing the lasing behaviour in this material family have not been investigated systematically, and thus the detailed lasing mechanism remains veiled. Here, we demonstrate that an all-inorganic perovskite shows a lasing emission based on a novel principle. A series of photoluminescence experiment results reveals that the excited state of CsPbBr3 single crystal exhibits free carrier nature. In a form of microcavity, on the other hand, the CsPbBr3 single crystal shows emission from polaritonic excited state, demonstrating the coexistence of excitonic nature. Room temperature polariton lasing is also clearly observed. This unprecedent mechanism, i.e. polariton lasing based on free-carrier reservoir, is accomplished by the exciton/free-carrier hybrid nature of CsPbBr3.


title: TEX-CUP: The University of Texas Challenge for Urban Positioning

abstract: A public benchmark dataset collected in the dense urban center of the city of Austin, TX is introduced for evaluation of multi-sensor GNSS-based urban positioning. Existing public datasets on localization and/or odometry evaluation are based on sensors such as lidar, cameras, and radar. The role of GNSS in these datasets is typically limited to the generation of a reference trajectory in conjunction with a high-end inertial navigation system (INS). In contrast, the dataset introduced in this paper provides raw ADC output of wideband intermediate frequency (IF) GNSS data along with tightly synchronized raw measurements from inertial measurement units (IMUs) and a stereoscopic camera unit. This dataset will enable optimization of the full GNSS stack from signal tracking to state estimation, as well as sensor fusion with other automotive sensors. The dataset is available at http://radionavlab.ae.utexas.edu under Public Datasets. Efforts to collect and share similar datasets from a number of dense urban centers around the world are under way.


title: Fluctuations in Mean-Field Ising models

abstract: In this paper, we study the fluctuations of the average magnetization in an Ising model on an approximately $d_N$ regular graph $G_N$ on $N$ vertices. In particular, if $G_N$ is \enquote{well connected}, we show that whenever $d_N\gg \sqrt{N}$, the fluctuations are universal and same as that of the Curie-Weiss model in the entire Ferro-magnetic parameter regime. We give a counterexample to demonstrate that the condition $d_N\gg \sqrt{N}$ is tight, in the sense that the limiting distribution changes if $d_N\sim \sqrt{N}$ except in the high temperature regime. By refining our argument, we extend universality in the high temperature regime up to $d_N\gg N^{1/3}$. Our results conclude universal fluctuations of the average magnetization in Ising models on regular graphs, Erd\H{o}s-R\'enyi graphs (directed and undirected), stochastic block models, and sparse regular graphons. In fact, our results apply to general matrices with non-negative entries, including Ising models on a Wigner matrix, and the block spin Ising model. As a by-product of our proof technique, we obtain Berry-Esseen bounds for these fluctuations, exponential concentration for the average of spins, and tight error bounds for the Mean-Field approximation of the partition function.


title: Active Learning for Linear Parameter-Varying System Identification

abstract: Active learning is proposed for selection of the next operating points in the design of experiments, for identifying linear parameter-varying systems. We extend existing approaches found in literature to multiple-input multiple-output systems with a multivariate scheduling parameter. Our approach is based on exploiting the probabilistic features of Gaussian process regression to quantify the overall model uncertainty across locally identified models. This results in a flexible framework which accommodates for various techniques to be applied for estimation of local linear models and their corresponding uncertainty. We perform active learning in application to the identification of a diesel engine air-path model, and demonstrate that measures of model uncertainty can be successfully reduced using the proposed framework.


title: Mechanical properties of graphene oxide: the impact of functional groups

abstract: In the current study, mechanical characteristics of graphene oxide (GO) as a promising substitute of graphene are systematically studied through molecular dynamics simulation. For this purpose, several GO samples having different concentrations of epoxide and hydroxyl functional groups are considered. The results reveal that increasing the epoxide coverage causes a noticeable deterioration in the mechanical characteristics of GO systems. This change is correlated with the increase of the formation of ripples in the structure upon increasing the epoxide coverage. Moreover, investigating the bond lengths in the system, it is concluded that the higher epoxide percentage leads to an increase in the length of single and hybrid resonance bonds leading to an overall deterioration of the mechanical properties of GO samples. Additionally, our results demonstrate that high concentration of functional groups can lead to a negative Poisson ratio. Increasing the amount of hydroxyl groups shows the same declining effect on the Young modulus. In a graphene system containing both epoxide and hydroxyl groups, it is deduced that a higher percentage of the former can result in a higher residual strain because of the formation of more ripples within the system.


title: Differences of composition operators from analytic Besov spaces into little Bloch type spaces

abstract: The purpose of this paper is to describe the characterization for the compact difference of two composition operators acting between analytic Besov spaces and the weighted little Bloch type space over the unit disk.


title: Neutron Decay to a Non-Abelian Dark Sector

abstract: According to the Standard Model (SM), we expect to find a proton for each decaying neutron. However, the experiments counting the number of decayed neutrons and produced protons have a disagreement. This discrepancy suggests that neutrons might have an exotic decay to a Dark Sector (DS). In this paper, we explore a scenario where neutrons decay to a dark Dirac fermion $\chi$ and a non-abelian dark gauge boson $W'$. We discuss the cosmological implications of this scenario assuming DS particles are produced via freeze-in. In our proposed scenario, DS has three portals with the SM sector: (1) the fermion portal coming from the mixing of the neutron with $\chi$, (2) a scalar portal, and (3) a non-renormalizable kinetic mixing between photon and dark gauge bosons which induces a vector portal between the two sectors. We show that neither the fermion portal nor the scalar portal should contribute to the production of the particles in the early universe. Specifically, we argue that the maximum temperature of the universe must be low enough to prevent the production of $\chi$ in the early universe. In this paper, we rely on the vector portal to connect the two sectors, and we discuss the phenomenological bounds on the model. The main constraints come from ensuring the right relic abundance of dark matter and evading the neutron star bounds. When dark gauge boson is very light, measurements of the Big Bang Nucleosynthesis impose a stringent constraint as well.


title: Closed-form Solutions for an Explicit Modern Ideal Tontine with Bequest Motive

abstract: In this paper I extend the work of Bernhardt and Donnelly (2019) dealing with modern explicit tontines, as a way of providing income under a specified bequest motive, from a defined contribution pension pot. A key feature of the present paper is that it relaxes the assumption of fixed proportions invested in tontine and bequest accounts. In making the bequest proportion an additional control function I obtain, hitherto unavailable, closed-form solutions for the fractional consumption rate, wealth, bequest amount, and bequest proportion under a constant relative risk averse utility. I show that the optimal bequest proportion is the product of the optimum fractional consumption rate and an exponentiated bequest parameter. I show that under certain circumstances, such as a very high bequest motive, a life-cycle utility maximisation strategy will necessitate negative mortality credits analogous to a member paying life insurance premiums. Typical scenarios are explored using UK Office of National Statistics life tables.


title: Field-temperature phase diagram of magnetic bubbles spanning charge$/$orbital ordered and metallic phases in La$_{1-x}$Sr$_x$MnO$_3$ ($x = 0.125$)

abstract: We report formation of magnetic textures in the ferromagnetic (FM) phase of La$_{1-x}$Sr$_x$MnO$_3$ for $x =$ 0.125; these textures are magnetic bubbles, magnetic stripe domains, and forced FM states. In situ Lorentz microscopy (LM) observations show that magnetic bubbles exist in the FM insulating phase accompanying the formation of the charge$/$orbital ordering (CO$/$OO). Furthermore, stable magnetic bubbles still exist in an intermediate temperature region between the CO$/$OO ($T_{CO} =$ 155 K) and FM ($T_c =$ 190 K) transition temperatures. These magnetic bubbles are believed to originate from the magnetocrystalline anisotropy and the dipole-dipole interaction in the FM phase. Based on in situ LM observations as a function of both temperature and the strength of the external magnetic field applied, a magnetic field-temperature phase diagram is constructed, exhibiting the stabilizing regions of the magnetic bubbles in the FM phase of La$_{0.875}$Sr$_{0.125}$MnO$_{3}$.


title: Diagonal symmetrizers for hyperbolic operators with triple characteristics

abstract: Symmetrizers for hyperbolic equations are obtained by diagonalizing the Bezoutian matrix of hyperbolic symbols. Such diagonal symmetrizers are applied to the Cauchy problem for hyperbolic operators with triple characteristics. In particular, the V.Ivrii's conjecture concerned with triple effectively hyperbolic characteristics is proved for differential operators with coefficients depending on the time variable.


title: Large-scale Uncertainty Estimation and Its Application in Revenue Forecast of SMEs

abstract: The economic and banking importance of the small and medium enterprise (SME) sector is well recognized in contemporary society. Business credit loans are very important for the operation of SMEs, and the revenue is a key indicator of credit limit management. Therefore, it is very beneficial to construct a reliable revenue forecasting model. If the uncertainty of an enterprise's revenue forecasting can be estimated, a more proper credit limit can be granted. Natural gradient boosting approach, which estimates the uncertainty of prediction by a multi-parameter boosting algorithm based on the natural gradient. However, its original implementation is not easy to scale into big data scenarios, and computationally expensive compared to state-of-the-art tree-based models (such as XGBoost). In this paper, we propose a Scalable Natural Gradient Boosting Machines that is simple to implement, readily parallelizable, interpretable and yields high-quality predictive uncertainty estimates. According to the characteristics of revenue distribution, we derive an uncertainty quantification function. We demonstrate that our method can distinguish between samples that are accurate and inaccurate on revenue forecasting of SMEs. What's more, interpretability can be naturally obtained from the model, satisfying the financial needs.


title: Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?

abstract: Although neural models have achieved impressive results on several NLP benchmarks, little is understood about the mechanisms they use to perform language tasks. Thus, much recent attention has been devoted to analyzing the sentence representations learned by neural encoders, through the lens of `probing' tasks. However, to what extent was the information encoded in sentence representations, as discovered through a probe, actually used by the model to perform its task? In this work, we examine this probing paradigm through a case study in Natural Language Inference, showing that models can learn to encode linguistic properties even if they are not needed for the task on which the model was trained. We further identify that pretrained word embeddings play a considerable role in encoding these properties rather than the training task itself, highlighting the importance of careful controls when designing probing experiments. Finally, through a set of controlled synthetic tasks, we demonstrate models can encode these properties considerably above chance-level even when distributed in the data as random noise, calling into question the interpretation of absolute claims on probing tasks.


title: Lorentz microscopy and small-angle electron diffraction study of magnetic textures in La$_{1-x}$Sr$_x$MnO$_3$ (0.15 $< x <$ 0.30): the role of magnetic anisotropy

abstract: Magnetic textures in the ferromagnetic phases of La$_{1-x}$Sr$_x$MnO$_3$ for 0.15 $< x <$ 0.30 have been investigated by Lorentz microscopy combined with small-angle electron diffraction experiments. Various types of magnetic textures characterized by stripe, plate-shaped, and cylindrical (magnetic bubble) domains were found. Two distinct types of magnetic stripe domains appeared in the orthorhombic structure with an inversion symmetry of La$_{0.825}$Sr$_{0.175}$MnO$_3$, depending significantly on magnetocrystalline anisotropy. Based on in-situ observations as functions of temperature and the strength of the external magnetic field, a magnetic field-temperature phase diagram was constructed, showing the stabilization of magnetic bubbles in the ferromagnetic phase of La$_{0.825}$Sr$_{0.175}$MnO$_3$.


title: Learning What a Machine Learns in a Many-Body Localization Transition

abstract: We employ a convolutional neural network to explore the distinct phases in random spin systems with the aim to understand the specific features that the neural network chooses to identify the phases. With the energy spectrum normalized to the bandwidth as the input data, we demonstrate that a network of the smallest nontrivial kernel width selects level spacing as the signature to distinguish the many-body localized phase from the thermal phase. We also study the performance of the neural network with an increased kernel width, based on which we find an alternative diagnostic to detect phases from the raw energy spectrum of such a disordered interacting system.


title: Enhancing network forensics with particle swarm and deep learning: The particle deep framework

abstract: The popularity of IoT smart things is rising, due to the automation they provide and its effects on productivity. However, it has been proven that IoT devices are vulnerable to both well established and new IoT-specific attack vectors. In this paper, we propose the Particle Deep Framework, a new network forensic framework for IoT networks that utilised Particle Swarm Optimisation to tune the hyperparameters of a deep MLP model and improve its performance. The PDF is trained and validated using Bot-IoT dataset, a contemporary network-traffic dataset that combines normal IoT and non-IoT traffic, with well known botnet-related attacks. Through experimentation, we show that the performance of a deep MLP model is vastly improved, achieving an accuracy of 99.9% and false alarm rate of close to 0%.


title: Towards Efficient Processing and Learning with Spikes: New Approaches for Multi-Spike Learning

abstract: Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remains as a challenging problem. In this paper, we make our contributions towards this direction. A simplified spiking neuron model is firstly introduced with effects of both synaptic input and firing output on membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multi-spike learning rules which demonstrate better performance over other baselines on various tasks including association, classification, feature detection. In addition to efficiency, our learning rules demonstrate a high robustness against strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably single neuron is capable of solving multi-category classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised STDP with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules can not only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.


title: Obtaining Faithful Interpretations from Compositional Neural Networks

abstract: Neural module networks (NMNs) are a popular approach for modeling compositionality: they achieve high accuracy when applied to problems in language and vision, while reflecting the compositional structure of the problem in the network architecture. However, prior work implicitly assumed that the structure of the network modules, describing the abstract reasoning process, provides a faithful explanation of the model's reasoning; that is, that all modules perform their intended behaviour. In this work, we propose and conduct a systematic evaluation of the intermediate outputs of NMNs on NLVR2 and DROP, two datasets which require composing multiple reasoning steps. We find that the intermediate outputs differ from the expected output, illustrating that the network structure does not provide a faithful explanation of model behaviour. To remedy that, we train the model with auxiliary supervision and propose particular choices for module architecture that yield much better faithfulness, at a minimal cost to accuracy.


title: Cross-View Image Retrieval -- Ground to Aerial Image Retrieval through Deep Learning

abstract: Cross-modal retrieval aims to measure the content similarity between different types of data. The idea has been previously applied to visual, text, and speech data. In this paper, we present a novel cross-modal retrieval method specifically for multi-view images, called Cross-view Image Retrieval CVIR. Our approach aims to find a feature space as well as an embedding space in which samples from street-view images are compared directly to satellite-view images (and vice-versa). For this comparison, a novel deep metric learning based solution "DeepCVIR" has been proposed. Previous cross-view image datasets are deficient in that they (1) lack class information; (2) were originally collected for cross-view image geolocalization task with coupled images; (3) do not include any images from off-street locations. To train, compare, and evaluate the performance of cross-view image retrieval, we present a new 6 class cross-view image dataset termed as CrossViewRet which comprises of images including freeway, mountain, palace, river, ship, and stadium with 700 high-resolution dual-view images for each class. Results show that the proposed DeepCVIR outperforms conventional matching approaches on the CVIR task for the given dataset and would also serve as the baseline for future research.


title: New families of self-dual codes

abstract: In the recent paper entitled "Explicit constructions of MDS self-dual codes" accepted in { IEEE Transactions on Information Theory}, doi: 10.1109/TIT.2019.2954877, the author has constructed families of MDS self-dual codes from genus zero algebraic geometry (AG) codes, where the AG codes of length $n$ were defined using two divisors $G$ and $D=P_1+\cdots+P_n.$ In the present correspondence, we explore more families of optimal self-dual codes from AG codes. New families of MDS self-dual codes with odd characteristics and those of almost MDS self-dual codes are constructed explicitly from genus zero and genus one curves, respectively. More families of self-dual codes are constructed from algebraic curves of higher genus.


title: Heterogeneous Knowledge Distillation using Information Flow Modeling

abstract: Knowledge Distillation (KD) methods are capable of transferring the knowledge encoded in a large and complex teacher into a smaller and faster student. Early methods were usually limited to transferring the knowledge only between the last layers of the networks, while latter approaches were capable of performing multi-layer KD, further increasing the accuracy of the student. However, despite their improved performance, these methods still suffer from several limitations that restrict both their efficiency and flexibility. First, existing KD methods typically ignore that neural networks undergo through different learning phases during the training process, which often requires different types of supervision for each one. Furthermore, existing multi-layer KD methods are usually unable to effectively handle networks with significantly different architectures (heterogeneous KD). In this paper we propose a novel KD method that works by modeling the information flow through the various layers of the teacher model and then train a student model to mimic this information flow. The proposed method is capable of overcoming the aforementioned limitations by using an appropriate supervision scheme during the different phases of the training process, as well as by designing and training an appropriate auxiliary teacher model that acts as a proxy model capable of "explaining" the way the teacher works to the student. The effectiveness of the proposed method is demonstrated using four image datasets and several different evaluation setups.


title: RMM: A Recursive Mental Model for Dialog Navigation

abstract: Language-guided robots must be able to both ask humans questions and understand answers. Much existing work focuses only on the latter. In this paper, we go beyond instruction following and introduce a two-agent task where one agent navigates and asks questions that a second, guiding agent answers. Inspired by theory of mind, we propose the Recursive Mental Model (RMM). The navigating agent models the guiding agent to simulate answers given candidate generated questions. The guiding agent in turn models the navigating agent to simulate navigation steps it would take to generate answers. We use the progress agents make towards the goal as a reinforcement learning reward signal to directly inform not only navigation actions, but also both question and answer generation. We demonstrate that RMM enables better generalization to novel environments. Interlocutor modelling may be a way forward for human-agent dialogue where robots need to both ask and answer questions.


title: Deformations of relative Rota-Baxter operators on Leibniz algebras

abstract: In this paper, we introduce the cohomology theory of relative Rota-Baxter operators on Leibniz algebras. We use the cohomological approach to study linear and formal deformations of relative Rota-Baxter operators. In particular, the notion of Nijenhuis elements is introduced to characterize trivial linear deformations. Formal deformations and extendibility of order n deformations of a relative Rota-Baxter operator are also characterized in terms of the cohomology theory.


title: ESPRIT: Explaining Solutions to Physical Reasoning Tasks

abstract: Neural networks lack the ability to reason about qualitative physics and so cannot generalize to scenarios and tasks unseen during training. We propose ESPRIT, a framework for commonsense reasoning about qualitative physics in natural language that generates interpretable descriptions of physical events. We use a two-step approach of first identifying the pivotal physical events in an environment and then generating natural language descriptions of those events using a data-to-text approach. Our framework learns to generate explanations of how the physical simulation will causally evolve so that an agent or a human can easily reason about a solution using those interpretable descriptions. Human evaluations indicate that ESPRIT produces crucial fine-grained details and has high coverage of physical concepts compared to even human annotations. Dataset, code and documentation are available at https://github.com/salesforce/esprit.


title: Sentiment Paradoxes in Social Networks: Why Your Friends Are More Positive Than You?

abstract: Most people consider their friends to be more positive than themselves, exhibiting a Sentiment Paradox. Psychology research attributes this paradox to human cognition bias. With the goal to understand this phenomenon, we study sentiment paradoxes in social networks. Our work shows that social connections (friends, followees, or followers) of users are indeed (not just illusively) more positive than the users themselves. This is mostly due to positive users having more friends. We identify five sentiment paradoxes at different network levels ranging from triads to large-scale communities. Empirical and theoretical evidence are provided to validate the existence of such sentiment paradoxes. By investigating the relationships between the sentiment paradox and other well-developed network paradoxes, i.e., friendship paradox and activity paradox, we find that user sentiments are positively correlated to their number of friends but rarely to their social activity. Finally, we demonstrate how sentiment paradoxes can be used to predict user sentiments.


title: Power-law scaling in granular rheology across flow geometries

abstract: Based on discrete element method simulations, we propose a new form of the constitution equation for granular flows independent of packing fraction. Rescaling the stress ratio $\mu$ by a power of dimensionless temperature $\Theta$ makes the data from a wide set of flow geometries collapse to a master curve depending only on the inertial number $I$. The basic power-law structure appears robust to varying particle properties (e.g. surface friction) in both 2D and 3D systems. We show how this rheology fits and extends frameworks such as kinetic theory and the Nonlocal Granular Fluidity model.


title: Geometric-Phase Waveplates for Free-Form Dark Hollow beams

abstract: We demonstrate the possibility to create optical beams with phase singularities engraved into exotic intensity landscapes imitating the shapes of a large variety of diverse plane curves. To achieve this aim, we have developed a method for directly encoding the geometric properties of some selected curve into a single azimuthal phase factor without passing through indirect encryption methods based on lengthy numerical procedures. The outcome is utilized to mould the optic axis distribution of a liquid-crystal-based inhomogeneous waveplate. The latter is finally used to sculpt the wavefront of an input optical gaussian beam via Pancharatnam-Berry phase.


title: Utilizing Pulse Pileup Effect in Development of Robust Low-SNR Covert Communication Links

abstract: In contrast to other spread-spectrum techniques, wideband pulse trains with relatively low pulse arrival rates may be considered unsuitable for covert communications. The high crest factor of such trains can be extremely burdensome for the transmitter hardware, and it makes the pulse trains easily detectable even at very low signal-to-noise ratios. In addition, it may appear that sharing the wideband channel by multiple users would require explicit allocation of the pulse arrival times for each sub-channel, which would be impractical in most cases. On the other hand, messaging by wideband pulse trains has many appealing features. Among those are the ease of synchronous as well as asynchronous pulse detection, and on-the-fly channel reconfigurability (e.g. changing the spreading factor). Favorably, the crest factor of a pulse train, as well as its apparent temporal and amplitude structure, can be easily, and reversibly, controlled by simple linear filtering. For example, a transmitted pulse train can be made statistically indistinguishable from the Gaussian component of the channel noise (e.g. the thermal noise) observed in the same spectral band, while the received signal will be the designed high-crest-factor wideband pulse train. In this paper, we utilize the so-called pulse pileup effect to perform such reversible control of the pulse train structure, enabling a wider use of this approach for synthesis of robust low-SNR covert communication links. We place a particular focus on the synchronous pulse detection in the receiver, that provides a better utilization of the channel spectrum.


title: Non-Abelian statistics of Majorana zero modes in the presence of an Andreev bound state

abstract: Braiding Majorana zero modes (MZMs) is the key procedure toward topological quantum computation. We show such braiding can be well performed in a parallel semiconductor-superconductor nanowire structure. Considering the fact that the low-energy Andreev bound states (ABSs) usually mix with the MZMs in the present set-up, we further investigate the braiding properties of MZMs when an ABS is presented. Our numerical simulation suggests that ABS can be regarded as a pair of weakly coupled MZMs. The dynamical hybridization of MZMs plus the non-Abelian braiding of MZMs would induce an arbitrary rotation on the Bloch sphere of a single qubit. Remarkably, such rotation is manipulable since the rotation parameters could be individually modulated. Thus, the dynamic evolution can be eliminated and the non-Abelian braiding statistics, independent of the braiding time, retrieves.


title: Collective excitations in biased bilayer graphene: Temperature effects

abstract: We have studied the temperature effect on collective excitations in biased bilayer graphene within random-phase approximation. From the zeros of temperature dynamical dielectric function of the system we have found one weakly damped plasmon mode. For a given electrostatic potential bias, at low (high) temperature T the plasmon frequency changes slightly (increases remarkably) with T. We have also studied the effects of potential bias and carrier density on the plasmon frequency of the system at finite temperatures.


title: HOMFLYPT skein sub-modules of the lens spaces $L(p, 1)$

abstract: In this paper we work toward the HOMFLYPT skein module of $L(p, 1)$, $\mathcal{S}(L(p,1))$, via braids. Our starting point is the linear Turaev-basis, $\Lambda^{\prime}$, of the HOMFLYPT skein module of the solid torus ST, $\mathcal{S}({\rm ST})$, which can be decomposed as the tensor product of the "positive" ${\Lambda^{\prime}}^+$ and the "negative" ${\Lambda^{\prime}}^-$ sub-modules, and the Lambropoulou invariant, $X$, for knots and links in ST, that captures $S({\rm ST})$. It is a well-known result by now that $\mathcal{S}(L(p, 1))=\frac{\mathcal{S}(ST)}{<bbm's>}$, where bbm's (braid band moves) denotes the isotopy moves that correspond to the surgery description of $L(p, 1)$. Namely, a HOMFLYPT-type invariant for knots and links in ST can be extended to an invariant for knots and links in $L(p, 1)$ by imposing relations coming from the performance of bbm's and solving the infinite system of equations obtained that way. \smallbreak In this paper we work with a new basis of $\mathcal{S}({\rm ST})$, $\Lambda$, and we relate the infinite system of equations obtained by performing bbm's on elements in $\Lambda^+$ to the infinite system of equations obtained by performing bbm's on elements in $\Lambda^-$ via a map $I$. More precisely we prove that the solutions of one system can be derived from the solutions of the other. Our aim is to reduce the complexity of the infinite system one needs to solve in order to compute $\mathcal{S}(L(p,1))$ using the braid technique. Finally, we present a generating set and a potential basis for $\frac{\Lambda^+}{<bbm's>}$ and thus, we obtain a generating set and a potential basis for $\frac{\Lambda^-}{<bbm's>}$. We also discuss further steps needed in order to compute $\mathcal{S}(L(p,1))$ via braids.


title: Asymptotics of smoothed Wasserstein distances

abstract: We investigate contraction of the Wasserstein distances on $\mathbb{R}^d$ under Gaussian smoothing. It is well known that the heat semigroup is exponentially contractive with respect to the Wasserstein distances on manifolds of positive curvature; however, on flat Euclidean space---where the heat semigroup corresponds to smoothing the measures by Gaussian convolution---the situation is more subtle. We prove precise asymptotics for the $2$-Wasserstein distance under the action of the Euclidean heat semigroup, and show that, in contrast to the positively curved case, the contraction rate is always polynomial, with exponent depending on the moment sequences of the measures. We establish similar results for the $p$-Wasserstein distances for $p \neq 2$ as well as the $\chi^2$ divergence, relative entropy, and total variation distance. Together, these results establish the central role of moment matching arguments in the analysis of measures smoothed by Gaussian convolution.


title: Design-Informed Kinematic Control for Improved Dexterous Teleoperation of a Bilateral Manipulator System

abstract: This paper explores the possibility of improving bilateral robot manipulation task performance through optimizing the robot morphology and configuration of the system through motion. To optimize the design for different scenarios, we select a set of tasks that represent the variability in small scale manipulation (e.g. pick and place, tasks involving positioning and orientation) and track the motion to obtain a reproducible trajectory. Kinematic data is captured through an electromagnetic (EM) tracker system while a human subject performs the tasks. Then, the data is pre-processed and used to optimize the morphology of each symmetric robot arm of the bilateral system. Once optimized, a kinematic control scheme is used to generate a motion with dexterous configurations. The dexterity is evaluated along the trajectories with standard dexterity metrics. Results show a 10\% improvement in dexterous maneuverability with the optimized arm design and optimal base configuration.


title: Plasmon modes in double-layer biased bilayer graphene

abstract: We investigate zero-temperature plasmon modes in a double-layer bilayer graphene structure under a perpendicular electrostatic bias. The numerical results demonstrate that there exist two collective modes which are undamped in the long wavelength limit. The finite potential bias decreases remarkably the plasmon energy in a wide range of wave-vector and makes plasmon branches become Landau damped at a higher wave-vector as compared to unbiased case. We find that the dependence of plasmon dispersions on the system parameters such as the inter-layer separation and carrier density is similar in two cases with and without electrostatic bias.


title: Relay Selection for 5G New Radio Via Artificial Neural Networks

abstract: Millimeter-wave supplies an alternative frequency band of wide bandwidth to better realize pillar technologies of enhanced mobile broadband (eMBB) and ultra-reliable and lowlatency communication (uRLLC) for 5G - new radio (5G-NR). When using mmWave frequency band, relay stations to assist the coverage of base stations in radio access network (RAN) emerge as an attractive technique. However, relay selection to result in the strongest link becomes the critical technology to facilitate RAN using mmWave. A alternative approach toward relay selection is to take advantage of existing operating data and apply appropriate artificial neural networks (ANN) and deep learning algorithms to alleviate severe fading in mmWave band. In this paper, we apply classification techniques using ANN with multilayer perception to predict the path loss of multiple transmitted links and base on a certain loss level, and thus execute effective relay selection, which also recommends the handover to an appropriate path. ANN with multilayer perceptions are compared with other ML algorithms to demonstrate the effectiveness for relay selection in 5G-NR.


title: Hard-Coded Gaussian Attention for Neural Machine Translation

abstract: Recent work has questioned the importance of the Transformer's multi-headed attention for achieving high translation quality. We push further in this direction by developing a "hard-coded" attention variant without any learned parameters. Surprisingly, replacing all learned self-attention heads in the encoder and decoder with fixed, input-agnostic Gaussian distributions minimally impacts BLEU scores across four different language pairs. However, additionally hard-coding cross attention (which connects the decoder to the encoder) significantly lowers BLEU, suggesting that it is more important than self-attention. Much of this BLEU drop can be recovered by adding just a single learned cross attention head to an otherwise hard-coded Transformer. Taken as a whole, our results offer insight into which components of the Transformer are actually important, which we hope will guide future work into the development of simpler and more efficient attention-based models.


title: Synthesizer: Rethinking Self-Attention in Transformer Models

abstract: The dot product self-attention is known to be central and indispensable to state-of-the-art Transformer models. But is it really required? This paper investigates the true importance and contribution of the dot product-based self-attention mechanism on the performance of Transformer models. Via extensive experiments, we find that (1) random alignment matrices surprisingly perform quite competitively and (2) learning attention weights from token-token (query-key) interactions is useful but not that important after all. To this end, we propose \textsc{Synthesizer}, a model that learns synthetic attention weights without token-token interactions. In our experiments, we first show that simple Synthesizers achieve highly competitive performance when compared against vanilla Transformer models across a range of tasks, including machine translation, language modeling, text generation and GLUE/SuperGLUE benchmarks. When composed with dot product attention, we find that Synthesizers consistently outperform Transformers. Moreover, we conduct additional comparisons of Synthesizers against Dynamic Convolutions, showing that simple Random Synthesizer is not only $60\%$ faster but also improves perplexity by a relative $3.5\%$. Finally, we show that simple factorized Synthesizers can outperform Linformers on encoding only tasks.


title: Charged impurity scattering in bilayer-graphene double layers

abstract: We consider a double-layer system made of two parallel bilayer graphene sheets separated by a dielectric medium. We calculate the finite-temperature electrical conductivity of the first layer due to charged impurities located in two layers. We study the effects of temperature, interlayer distance, dielectric constants and impurity concentration, carrier concentration on the electrical conductivity. We show the importance of charged impurities located in layer II in determining electrical conductivity of the first layer for small interlayer distance. The results in this paper give us more understanding about the long-range charged impurity scattering in bilayer graphene under effect of the second one.


title: Predicting the Path Loss of Wireless Channel Models Using Machine Learning Techniques in MmWave Urban Communications

abstract: The classic wireless communication channel modeling is performed using Deterministic and Stochastic channel methodologies. Machine learning (ML) emerges to revolutionize system design for 5G and beyond. ML techniques such as supervise leaning methods will be used to predict the wireless channel path loss of a variate of environments base on a certain dataset. The propagation signal of communication systems fundamentals is focusing on channel modeling particularly for new frequency bands such as MmWave. Machine learning can facilitate rapid channel modeling for 5G and beyond wireless communication systems due to the availability of partially relevant channel measurement data and model. When irregularity of the wireless channels lead to a complex methodology to achieve accurate models, appropriate machine learning methodology explores to reduce the complexity and increase the accuracy. In this paper, we demonstrate alternative procedures beyond traditional channel modeling to enhance the path loss models using machine learning techniques, to alleviate the dilemma of channel complexity and time-consuming process that the measurements were taken. This demonstrated regression uses the measurement data of a certain scenario to successfully assist the prediction of path loss model of a different operating environment.


title: On infinite guarded recursive specifications in process algebra

abstract: In most presentations of ACP with guarded recursion, recursive specifications are finite or infinite sets of recursion equations of which the right-hand sides are guarded terms. The completeness with respect to bisimulation equivalence of the axioms of ACP with guarded recursion has only been proved for the special case where recursive specifications are finite sets of recursion equations of which the right-hand sides are guarded terms of a restricted form known as linear terms. In this note, we widen this completeness result to the general case.


title: Universal thermodynamic extremality relations for charged AdS black hole surrounded by quintessence

abstract: The perturbation correction of general relativity has obtained the general relationship between entropy and extremality. The relation was found to exactly hold for the charged AdS black hole, and extended to the rotating and massive gravity black holes. In this paper, We confirm the universal relation for the four dimensional RN-AdS black hole surrounded by the quintessence, and find a new extremality relation between black hole mass and the normalization factor $a$ related to the density of quintessence. Besides, we also find that when the black hole entropy increases, the correction constant is negative, the black hole mass and the mass-charge ratio decreases, hence this black hole displays WGC-like behavior. Moreover, we derive the general relationship on nonlinear electrodynamic source couples to AdS spacetime with quintessence field. We find another new extremality relation between black hole mass and the magnetic monopole charge $\beta$.


title: Observation of liquid glass in suspensions of ellipsoidal colloids

abstract: Despite the omnipresence of colloidal suspensions, little is known about the influence of shape on phase transformations, especially in nonequilibrium. To date, real-space imaging results are limited to systems composed of spherical colloids. In most natural and technical systems, however, particles are non-spherical and their structural dynamics are determined by translational and rotational degrees of freedom. Using confocal microscopy, we reveal that suspensions of ellipsoidal colloids form an unexpected state of matter, a liquid glass in which rotations are frozen while translations remain fluid. Image analysis unveils hitherto unknown nematic precursors as characteristic structural elements of this state. The mutual obstruction of these ramified clusters prevents liquid crystalline order. Our results give unique insight into the interplay between local structures and phase transformations. This helps to guide applications such as self-assembly of colloidal superstructures and also gives first evidence of the importance of shape on the glass transition in general.


title: Smart, Adaptive Energy Optimization for Mobile Web Interactions

abstract: Web technology underpins many interactive mobile applications. However, energy-efficient mobile web interactions is an outstanding challenge. Given the increasing diversity and complexity of mobile hardware, any practical optimization scheme must work for a wide range of users, mobile platforms and web workloads. This paper presents CAMEL , a novel energy optimization system for mobile web interactions. CAMEL leverages machine learning techniques to develop a smart, adaptive scheme to judiciously trade performance for reduced power consumption. Unlike prior work, C AMEL directly models how a given web content affects the user expectation and uses this to guide energy optimization. It goes further by employing transfer learning and conformal predictions to tune a previously learned model in the end-user environment and improve it over time. We apply CAMEL to Chromium and evaluate it on four distinct mobile systems involving 1,000 testing webpages and 30 users. Compared to four state-of-the-art web-event optimizers, CAMEL delivers 22% more energy savings, but with 49% fewer violations on the quality of user experience, and exhibits orders of magnitudes less overhead when targeting a new computing environment.


title: Simulations of the spread of COVID-19 and control policies in Tunisia

abstract: We develop and analyze in this work an epidemiological model for COVID-19 using Tunisian data. Our aims are first to evaluate Tunisian control policies for COVID-19 and secondly to understand the effect of different screening, quarantine and containment strategies and the rule of the asymptomatic patients on the spread of the virus in the Tunisian population. With this work, we show that Tunisian control policies are efficient in screening infected and asymptomatic individuals and that if containment and curfew are maintained the epidemic will be quickly contained.


title: Exceptional collections on certain Hassett spaces

abstract: We construct an $S_2\times S_n$ invariant full exceptional collection on Hassett spaces of weighted stable rational curves with $n+2$ markings and weights $(\frac{1}{2}+\eta, \frac{1}{2}+\eta,\epsilon,\ldots,\epsilon)$, for $0<\epsilon, \eta\ll1$ and can be identified with symmetric GIT quotients of $(\mathbb{P}^1)^n$ by the diagonal action of $\mathbb{G}_m$ when $n$ is odd, and their Kirwan desingularization when $n$ is even. The existence of such an exceptional collection is one of the needed ingredients in order to prove the existence of a full $S_n$-invariant exceptional collection on $\overline{\mathcal{M}}_{0,n}$. To prove exceptionality we use the method of windows in derived categories. To prove fullness we use previous work on the existence of invariant full exceptional collections on Losev-Manin spaces.


title: Topological Modes Protected by Chiral and Two-Fold Rotational Symmetry in a Spring-Mass Model with a Lieb Lattice Structure

abstract: We propose how to realize the topological modes, which correspond to topological zero modes for a quantum system, protected by chiral and rotation symmetry for a mechanical system. Specifically, we show the emergence of topological modes protected by chiral and two-fold rotational symmetry by a spring-mass system with a Lieb lattice structure and dents on the floor. Moreover, comparing the results of a tight-binding model, we have found the additional topological modes for our spring-mass model due to the extra degrees of freedoms. Our approach to realize the topological modes can be applied to other cases with rotation symmetry, e.g., a system of a honeycomb lattice with three-fold rotational symmetry.


title: Imprint of a new light particle at KOTO?

abstract: Recently, the KOTO experiment reported their new preliminary result of searching for the decay $K_L\to\pi^0\nu\bar{\nu}$. Three candidate events were observed in the signal region, which exceed significantly the expectation based on the standard model. On the other hand, the new NA62 and previous BNL-E949 experiments yielded a consistent result and confirmed the standard model prediction in the charged meson decay $K^+\to\pi^+\nu\bar{\nu}$. Furthermore, the two decays are bound by a well-motivated relation from an analysis of isospin symmetry that is hard to break by the new physics of heavy particles. In this work, we study the issue by a systematic effective field theory approach with three of the simplest scenarios, in which the $K_L$ may decay into a new light neutral particle $X$, i.e., $K_L\to\pi^0X$, $K_L\to \gamma\gamma X$, or $K_L\to\pi^0XX$. We assess the feasibility of the scenarios by simulations and by incorporating constraints coming from NA62 and other relevant experiments. Our main conclusion is that the scenario $K\to\pi XX$ for a long lived scalar $X$ seems more credible than the other two when combining distributions and other experimental constraints while the region below the KOTO's blind box provides a good detection environment to search for all three scenarios for a relatively heavy $X$.


title: CoMoGCN: Coherent Motion Aware Trajectory Prediction with Graph Representation

abstract: Forecasting human trajectories is critical for tasks such as robot crowd navigation and autonomous driving. Modeling social interactions is of great importance for accurate group-wise motion prediction. However, most existing methods do not consider information about coherence within the crowd, but rather only pairwise interactions. In this work, we propose a novel framework, coherent motion aware graph convolutional network (CoMoGCN), for trajectory prediction in crowded scenes with group constraints. First, we cluster pedestrian trajectories into groups according to motion coherence. Then, we use graph convolutional networks to aggregate crowd information efficiently. The CoMoGCN also takes advantage of variational autoencoders to capture the multimodal nature of the human trajectories by modeling the distribution. Our method achieves state-of-the-art performance on several different trajectory prediction benchmarks, and the best average performance among all benchmarks considered.


title: Energy Growth of Infinite Harmonic Chain under Microscopic Random Influence

abstract: Infinite harmonic chains of point particles with finite range translation invariant interaction have considered. It is assumed that the only one particle influenced by the white noise. We studied microscopic and macroscopic behavior of the system's energies (potential, kinetic, total) when time goes to infinity. We proved that under quite general condition on interaction potential the energies grow linearly with time on macroscopic scale, and grow as $\ln(t)$ on microscopic scale. Moreover it is turned out that the system exhibit some equipartition properties in this non equilibrium settings.


title: Experimental velocity data estimation for imperfect particle images using machine learning

abstract: We propose a method using supervised machine learning to estimate velocity fields from particle images having missing regions due to experimental limitations. As a first example, a velocity field around a square cylinder at Reynolds number of ${\rm Re}_D=300$ is considered. To train machine learning models, we utilize artificial particle images (APIs) as the input data, which mimic the images of the particle image velocimetry (PIV). The output data are the velocity fields, and the correct answers for them are given by a direct numerical simulation (DNS). We examine two types of the input data: APIs without missing regions (i.e., full APIs) and APIs with missing regions (lacked APIs). The missing regions in the lacked APIs are assumed following the exact experimental situation in our wind tunnel setup. The velocity fields estimated from both full and lacked APIs are in great agreement with the reference DNS data in terms of various statistical assessments. We further apply these machine learned models trained with the DNS data to experimental particle images so that their applicability to the exact experimental situation can be investigated. The velocity fields estimated by the machine learned models contain approximately 40 folds denser data than that with the conventional cross-correlation method. This finding suggests that we may be able to obtain finer and hidden structures of the flow field which cannot be resolved with the conventional cross-correlation method. We also found that even the complex flow structures are hidden due to the alignment of two square cylinders, the machine learned model is able to estimate the field in the missing region reasonably well. The present results indicate a great potential of the proposed machine learning based method as a new data reconstruction method for PIV.


title: Ice coverage of dust grains in cold astrophysical environments

abstract: Surface processes on cosmic solids in cold astrophysical environments lead to gas phase depletion and molecular complexity. Most astrophysical models assume that the molecular ice forms a thick multilayer substrate, not interacting with the dust surface. In contrast, we present experimental results demonstrating the importance of the surface for porous grains. We show that cosmic dust grains may be covered by a few monolayers of ice only. This implies that the role of dust surface structure, composition, and reactivity in models describing surface processes in cold interstellar, protostellar, and protoplanetary environments has to be reevaluated.


title: Information Propagation in Stochastic Networks

abstract: In this paper, a network-based stochastic information propagation model is developed. The information flow is modeled by a probabilistic differential equation system. The numerical solution of these equations leads to the expected number of informed nodes as a function of time and reveals the relationship between the degrees of the nodes and their reception time. The validity of the model is justified by Monte Carlo network simulation through the analysis of information propagation in scale-free and Erdos-Renyi networks. It has been found that the developed model provides more accurate results compared to the widely used network-based SI mean-field model, especially in sparse networks.


title: Cherenkov Radiation of a Charge Flying through the "Inverted" Conical Target

abstract: Radiation generated by a charge moving through a vacuum channel in a dielectric cone is analyzed. It is assumed that the charge moves through the cone from the apex side to the base side (the case of "inverted" cone). The cone size is supposed to be much larger than the wavelengths under consideration. We calculate the wave field outside the target using the "aperture method" developed in our previous papers. Contrary to the problems considered earlier, here the wave which incidences directly on the aperture is not the main wave, while the wave once reflected from the lateral surface is much more important. The general formulas for the radiation field are obtained, and the particular cases of the ray optics area and the Fraunhofer area are analyzed. Significant physical effects including the phenomenon of "Cherenkov spotlight" are discussed. In particular it is shown that this phenomenon allows reaching essential enhancement of the radiation intensity in the far-field region at certain selection of the problem parameters. Owing to the "inverted" cone geometry, this effect can be realized for arbitrary charge velocity, including the ultra relativistic case, by proper selection of the cone material and the apex angle. Typical radiation patterns in the far-field area are demonstrated.


title: A Comprehensive Study on Challenges in Deploying Deep Learning Based Software

abstract: Deep learning (DL) becomes increasingly pervasive, being used in a wide range of software applications. These software applications, named as DL based software (in short as DL software), integrate DL models trained using a large data corpus with DL programs written based on DL frameworks such as TensorFlow and Keras. A DL program encodes the network structure of a desirable DL model and the process by which the model is trained using the training data. To help developers of DL software meet the new challenges posed by DL, enormous research efforts in software engineering have been devoted. Existing studies focus on the development of DL software and extensively analyze faults in DL programs. However, the deployment of DL software has not been comprehensively studied. To fill this knowledge gap, this paper presents a comprehensive study on understanding challenges in deploying DL software. We mine and analyze 3,023 relevant posts from Stack Overflow, a popular Q&A website for developers, and show the increasing popularity and high difficulty of DL software deployment among developers. We build a taxonomy of specific challenges encountered by developers in the process of DL software deployment through manual inspection of 769 sampled posts and report a series of actionable implications for researchers, developers, and DL framework vendors.


title: Contamination and conditioning of the prototype double spoke cryomodule for European Spallation Source

abstract: A superconducting Double Spoke Resonator (DSR) is the technology of choice in a low energy section of a high power proton linear accelerator. At the FREIA laboratory in Uppsala University, we have tested two DSRs in a prototype cryomodule for the European Spallation Source (ESS) project. It showed that the conditioning process of these cavity packages would be the key for the series production tests. In this paper, we present the conditioning procedure that we developed, and also describe the results with a special focus on the cross-contamination observed between two high-power couplers. This study defines a standard conditioning recipe for the series DSR production for ESS and also for future similar projects in the world.


title: Projection Inpainting Using Partial Convolution for Metal Artifact Reduction

abstract: In computer tomography, due to the presence of metal implants in the patient body, reconstructed images will suffer from metal artifacts. In order to reduce metal artifacts, metals are typically removed in projection images. Therefore, the metal corrupted projection areas need to be inpainted. For deep learning inpainting methods, convolutional neural networks (CNNs) are widely used, for example, the U-Net. However, such CNNs use convolutional filter responses on both valid and corrupted pixel values, resulting in unsatisfactory image quality. In this work, partial convolution is applied for projection inpainting, which only relies on valid pixels values. The U-Net with partial convolution and conventional convolution are compared for metal artifact reduction. Our experiments demonstrate that the U-Net with partial convolution is able to inpaint the metal corrupted areas better than that with conventional convolution.


title: On the mixing angle of the vector mesons $\omega(782)$ and $\phi(1020)$

abstract: In the present work, the mixing angle of the vector $\omega(782)$ and $\phi(1020)$ mesons is estimated in the framework of Nambu--Jona-Lasinio model. The decay $\phi \to \pi^{0} \gamma$ is considered as a basic process to determine this angle. The obtained value is compared with the results of the other authors. Besides, the width of the decay $\phi \to 3\pi$ and the cross-section of the process $e^{+}e^{-} \to \pi^{0} \phi$ are calculated by using this angle.


title: Role of various scale-similarity models in stabilized mixed subgrid-scale model

abstract: We investigate the physical role of various scale-similarity models in the stabilized mixed model [K. Abe, Int. J. Heat Fluid Flow, 39, 42 (2013); M. Inagaki and K. Abe, Int. J. Heat Fluid Flow, 64, 137 (2017)] and evaluate their performance in turbulent channel flows. Among various models in the present study, the original model combined with the scale-similarity model for the subgrid-scale (SGS)-Reynolds term yields the best prediction for the anisotropy of the grid-scale (GS) velocity fluctuations and the SGS stress, even in coarse grid resolutions. Moreover, it successfully predicts large intensities of the spectra close to the cut-off scale in accordance with the filtered direct numerical simulation, whereas other models predict a rapid decay of the spectra in the low-wavelength region. To investigate the behavior of the models close to the cut-off scale, we analyze the budget equation for the GS Reynolds stress spectrum. The result shows that the scale-similarity model for the SGS-Reynolds term plays a role in the enhancement of the wall-normal velocity fluctuation close to the cut-off scale. Thereby, it activates turbulence close to the cut-off scale, leading to a reproduction of the proper streak structures observed in wall-bounded turbulent flows. The reproduction of velocity fluctuations close to the cut-off scale and turbulent structures is a key element for further development of SGS models.


title: Long Time Behavior of Infinite Harmonic Chain with $l_{2}$ Initial Conditions

abstract: We consider infinite harmonic chain with $l_{2}$-initial conditions and deterministic dynamics (no probability at all). Main results concern the question when the solution will be uniformly bounded in time and space in the $l_{\infty}$-norm.


title: BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA

abstract: Khandelwal et al. (2020) use a k-nearest-neighbor (kNN) component to improve language model performance. We show that this idea is beneficial for open-domain question answering (QA). To improve the recall of facts encountered during training, we combine BERT (Devlin et al., 2019) with a traditional information retrieval step (IR) and a kNN search over a large datastore of an embedded text collection. Our contributions are as follows: i) BERT-kNN outperforms BERT on cloze-style QA by large margins without any further training. ii) We show that BERT often identifies the correct response category (e.g., US city), but only kNN recovers the factually correct answer (e.g., "Miami"). iii) Compared to BERT, BERT-kNN excels for rare facts. iv) BERT-kNN can easily handle facts not covered by BERT's training set, e.g., recent events.