title: TSGN: Transaction Subgraph Networks for Identifying Ethereum Phishing Accounts

abstract: Blockchain technology and, in particular, blockchain-based transaction offers us information that has never been seen before in the financial world. In contrast to fiat currencies, transactions through virtual currencies like Bitcoin are completely public. And these transactions of cryptocurrencies are permanently recorded on Blockchain and are available at any time. Therefore, this allows us to build transaction networks (TN) to analyze illegal phenomenons such as phishing scams in blockchain from a network perspective. In this paper, we propose a Transaction SubGraph Network (TSGN) based classification model to identify phishing accounts in Ethereum. Firstly we extract transaction subgraphs for each address and then expand these subgraphs into corresponding TSGNs based on the different mapping mechanisms. We find that TSGNs can provide more potential information to benefit the identification of phishing accounts. Moreover, Directed-TSGNs, by introducing direction attributes, can retain the transaction flow information that captures the significant topological pattern of phishing scams. By comparing with the TSGN, Directed-TSGN indeed has much lower time complexity, benefiting the graph representation learning. Experimental results demonstrate that, combined with network representation algorithms, the TSGN model can capture more features to enhance the classification algorithm and improve phishing nodes' identification accuracy in the Ethereum networks.


title: Constrained Language Models Yield Few-Shot Semantic Parsers

abstract: We explore the use of large pretrained language models as few-shot semantic parsers. The goal in semantic parsing is to generate a structured meaning representation given a natural language input. However, language models are trained to generate natural language. To bridge the gap, we use language models to paraphrase inputs into a controlled sublanguage resembling English that can be automatically mapped to a target meaning representation. Our results demonstrate that with only a small amount of data and very little code to convert into English-like representations, our blueprint for rapidly bootstrapping semantic parsers leads to surprisingly effective performance on multiple community tasks, greatly exceeding baseline methods also trained on the same limited data.


title: Fair Representation Learning for Heterogeneous Information Networks

abstract: Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness. A growing body of research has identified unfair AI systems and proposed methods to debias them, yet many challenges remain. Representation learning for Heterogeneous Information Networks (HINs), a fundamental building block used in complex network mining, has socially consequential applications such as automated career counseling, but there have been few attempts to ensure that it will not encode or amplify harmful biases, e.g. sexism in the job market. To address this gap, in this paper we propose a comprehensive set of de-biasing methods for fair HINs representation learning, including sampling-based, projection-based, and graph neural networks (GNNs)-based techniques. We systematically study the behavior of these algorithms, especially their capability in balancing the trade-off between fairness and prediction accuracy. We evaluate the performance of the proposed methods in an automated career counseling application where we mitigate gender bias in career recommendation. Based on the evaluation results on two datasets, we identify the most effective fair HINs representation learning techniques under different conditions.


title: Irreducible Non-Metrizable Path Systems in Graphs

abstract: A path system $\mathcal{P}$ in a graph $G=(V,E)$ is said to be irreducible if there does not exist a partition $V= A\sqcup B$ such that $\mathcal{P}$ restricts to a path system on both $G[A]$ and $G[B]$. In this paper, we construct an infinite family of non-metrizable irreducible path systems defined on certain Paley graphs.


title: Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation

abstract: We study the power of cross-attention in the Transformer architecture within the context of transfer learning for machine translation, and extend the findings of studies into cross-attention when training from scratch. We conduct a series of experiments through fine-tuning a translation model on data where either the source or target language has changed. These experiments reveal that fine-tuning only the cross-attention parameters is nearly as effective as fine-tuning all parameters (i.e., the entire translation model). We provide insights into why this is the case and observe that limiting fine-tuning in this manner yields cross-lingually aligned embeddings. The implications of this finding for researchers and practitioners include a mitigation of catastrophic forgetting, the potential for zero-shot translation, and the ability to extend machine translation models to several new language pairs with reduced parameter storage overhead.


title: Chemical-Potential-Assisted Particle Production in FRW Spacetimes

abstract: We analyze gravitational particle production assisted by chemical potential. By utilizing the uniformly smoothed Stokes-line method and Borel summation, we gain insight into the fine-grained history of enhanced particle production. Analytic/semi-analytic formulae describing the production amount, time and width are obtained for both spin-1 and spin-1/2 particles in various FRW spacetimes. Our work also serves as a concrete demonstration of the uniformly smoothed Stokes-line method applied to cosmology.


title: Cross-Task Generalization via Natural Language Crowdsourcing Instructions

abstract: Humans (e.g., crowdworkers) have a remarkable ability in solving different tasks, by simply reading textual instructions that define them and looking at a few examples. Despite the success of the conventional supervised learning on individual datasets, such models often struggle with generalization across tasks (e.g., a question-answering system cannot solve classification tasks). A long-standing challenge in AI is to build a model that learns a new task by understanding the human-readable instructions that define it. To study this, we introduce NATURAL INSTRUCTIONS, a dataset of 61 distinct tasks, their human-authored instructions, and 193k task instances (input-output pairs). The instructions are obtained from crowdsourcing instructions used to create existing NLP datasets and mapped to a unified schema. Using this meta-dataset, we measure cross-task generalization by training models on seen tasks and measuring generalization to the remaining unseen ones. We adopt generative pre-trained language models to encode task-specific instructions along with input and generate task output. Our results indicate that models benefit from instructions when evaluated in terms of generalization to unseen tasks (19% better for models utilizing instructions). These models, however, are far behind an estimated performance upperbound indicating significant room for more progress in this direction.


title: ARCH-Elites: Quality-Diversity for Urban Design

abstract: This paper introduces ARCH-Elites, a MAP-Elites implementation that can reconfigure large-scale urban layouts at real-world locations via a pre-trained surrogate model instead of costly simulations. In a series of experiments, we generate novel urban designs for two real-world locations in Boston, Massachusetts. Combining the exploration of a possibility space with real-time performance evaluation creates a powerful new paradigm for architectural generative design that can extract and articulate design intelligence.


title: Dynamically Addressing Unseen Rumor via Continual Learning

abstract: Rumors are often associated with newly emerging events, thus, an ability to deal with unseen rumors is crucial for a rumor veracity classification model. Previous works address this issue by improving the model's generalizability, with an assumption that the model will stay unchanged even after the new outbreak of an event. In this work, we propose an alternative solution to continuously update the model in accordance with the dynamics of rumor domain creations. The biggest technical challenge associated with this new approach is the catastrophic forgetting of previous learnings due to new learnings. We adopt continual learning strategies that control the new learnings to avoid catastrophic forgetting and propose an additional strategy that can jointly be used to strengthen the forgetting alleviation.


title: Federated Learning of User Verification Models Without Sharing Embeddings

abstract: We consider the problem of training User Verification (UV) models in federated setting, where each user has access to the data of only one class and user embeddings cannot be shared with the server or other users. To address this problem, we propose Federated User Verification (FedUV), a framework in which users jointly learn a set of vectors and maximize the correlation of their instance embeddings with a secret linear combination of those vectors. We show that choosing the linear combinations from the codewords of an error-correcting code allows users to collaboratively train the model without revealing their embedding vectors. We present the experimental results for user verification with voice, face, and handwriting data and show that FedUV is on par with existing approaches, while not sharing the embeddings with other users or the server.


title: Line Segmentation from Unconstrained Handwritten Text Images using Adaptive Approach

abstract: Line segmentation from handwritten text images is one of the challenging task due to diversity and unknown variations as undefined spaces, styles, orientations, stroke heights, overlapping, and alignments. Though abundant researches, there is a need of improvement to achieve robustness and higher segmentation rates. In the present work, an adaptive approach is used for the line segmentation from handwritten text images merging the alignment of connected component coordinates and text height. The mathematical justification is provided for measuring the text height respective to the image size. The novelty of the work lies in the text height calculation dynamically. The experiments are tested on the dataset provided by the Chinese company for the project. The proposed scheme is tested on two different type of datasets; document pages having base lines and plain pages. Dataset is highly complex and consists of abundant and uncommon variations in handwriting patterns. The performance of the proposed method is tested on our datasets as well as benchmark datasets, namely IAM and ICDAR09 to achieve 98.01% detection rate on average. The performance is examined on the above said datasets to observe 91.99% and 96% detection rates, respectively.


title: A massive open cluster hiding in full sight

abstract: Obscuration and confusion conspire to limit our knowledge of the inner Milky Way. Even at moderate distances, the identification of stellar systems becomes compounded by the extremely high density of background sources. Here we provide a very revealing example of these complications by unveiling a large, massive, young cluster in the Sagittarius arm that has escaped detection until now despite containing more than 30 stars brighter than $G=13$. By combining Gaia DR2 astrometry, Gaia and 2MASS photometry and optical spectroscopy, we find that the new cluster, which we name Valparaiso~1, located at $\sim2.3\:$kpc, is about 75~Ma old and includes a large complement of evolved stars, among which we highlight the 4~d classical Cepheid CM~Sct and an M-type giant that probably represents the first detection of an AGB star in a Galactic young open cluster. Although strong differential reddening renders accurate parameter determination unfeasible with the current dataset, direct comparison to clusters of similar age suggests that Valparaiso~1 was born as one of the most massive clusters in the Solar Neighbourhood, with an initial mass close to $10^{4}\:$M$_{\odot}$.


title: Variational Weakly Supervised Sentiment Analysis with Posterior Regularization

abstract: Sentiment analysis is an important task in natural language processing (NLP). Most of existing state-of-the-art methods are under the supervised learning paradigm. However, human annotations can be scarce. Thus, we should leverage more weak supervision for sentiment analysis. In this paper, we propose a posterior regularization framework for the variational approach to the weakly supervised sentiment analysis to better control the posterior distribution of the label assignment. The intuition behind the posterior regularization is that if extracted opinion words from two documents are semantically similar, the posterior distributions of two documents should be similar. Our experimental results show that the posterior regularization can improve the original variational approach to the weakly supervised sentiment analysis and the performance is more stable with smaller prediction variance.


title: Relative orbifold Pandharipande-Thomas theory and the degeneration formula

abstract: We construct relative moduli spaces of semistable pairs on a family of projective Deligne-Mumford stacks. We define moduli stacks of stable orbifold Pandharipande-Thomas pairs on stacks of expanded degenerations and pairs, and then show they are separated and proper Deligne-Mumford stacks of finite type. As an application, we present the degeneration formula for the absolute and relative orbifold Pandharipande-Thomas invariants.


title: Monte Carlo Elites: Quality-Diversity Selection as a Multi-Armed Bandit Problem

abstract: A core challenge of evolutionary search is the need to balance between exploration of the search space and exploitation of highly fit regions. Quality-diversity search has explicitly walked this tightrope between a population's diversity and its quality. This paper extends a popular quality-diversity search algorithm, MAP-Elites, by treating the selection of parents as a multi-armed bandit problem. Using variations of the upper-confidence bound to select parents from under-explored but potentially rewarding areas of the search space can accelerate the discovery of new regions as well as improve its archive's total quality. The paper tests an indirect measure of quality for parent selection: the survival rate of a parent's offspring. Results show that maintaining a balance between exploration and exploitation leads to the most diverse and high-quality set of solutions in three different testbeds.


title: On the Sensitivity and Stability of Model Interpretations in NLP

abstract: Recent years have witnessed the emergence of a variety of post-hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it remains an open problem how to define and quantitatively measure the faithfulness of interpretations, i.e., to what extent interpretations reflect the reasoning process by a model. We propose two new criteria, sensitivity and stability, that provide complementary notions of faithfulness to the existed removal-based criteria. Our results show that the conclusion for how faithful interpretations are could vary substantially based on different notions. Motivated by the desiderata of sensitivity and stability, we introduce a new class of interpretation methods that adopt techniques from adversarial robustness. Empirical results show that our proposed methods are effective under the new criteria and overcome limitations of gradient-based methods on removal-based criteria. Besides text classification, we also apply interpretation methods and metrics to dependency parsing. Our results shed light on understanding the diverse set of interpretations.


title: Gaussian Dynamic Convolution for Efficient Single-Image Segmentation

abstract: Interactive single-image segmentation is ubiquitous in the scientific and commercial imaging software. In this work, we focus on the single-image segmentation problem only with some seeds such as scribbles. Inspired by the dynamic receptive field in the human being's visual system, we propose the Gaussian dynamic convolution (GDC) to fast and efficiently aggregate the contextual information for neural networks. The core idea is randomly selecting the spatial sampling area according to the Gaussian distribution offsets. Our GDC can be easily used as a module to build lightweight or complex segmentation networks. We adopt the proposed GDC to address the typical single-image segmentation tasks. Furthermore, we also build a Gaussian dynamic pyramid Pooling to show its potential and generality in common semantic segmentation. Experiments demonstrate that the GDC outperforms other existing convolutions on three benchmark segmentation datasets including Pascal-Context, Pascal-VOC 2012, and Cityscapes. Additional experiments are also conducted to illustrate that the GDC can produce richer and more vivid features compared with other convolutions. In general, our GDC is conducive to the convolutional neural networks to form an overall impression of the image.


title: Efficient Fully Sequential Indifference-Zone Procedures Using Properties of Multidimensional Brownian Motion Exiting a Sphere

abstract: We consider a ranking and selection (R&S) problem with the goal to select a system with the largest or smallest expected performance measure among a number of simulated systems with a pre-specified probability of correct selection. Fully sequential procedures take one observation from each survived system and eliminate inferior systems when there is clear statistical evidence that they are inferior. Most fully sequential procedures make elimination decisions based on sample performances of each possible pair of survived systems and exploit the bound crossing properties of a univariate Brownian motion. In this paper, we present new fully sequential procedures with elimination decisions that are based on sample performances of all competing systems. Using properties of a multidimensional Brownian motion exiting a sphere, we derive heuristics that aim to achieve a given target probability of correct selection. We show that in practice the new procedures significantly outperform a widely used fully sequential procedure. Compared to BIZ, a recent fully-sequential procedure that uses statistics inspired by Bayes posterior probabilities, our procedures have better performance under difficult mean or variance configurations but similar performance under easy mean configurations.


title: Leveraging Randomized Compiling for the QITE Algorithm

abstract: The success of the current generation of Noisy Intermediate-Scale Quantum (NISQ) hardware shows that quantum hardware may be able to tackle complex problems even without error correction. One outstanding issue is that of coherent errors arising from the increased complexity of these devices. These errors can accumulate through a circuit, making their impact on algorithms hard to predict and mitigate. Iterative algorithms like Quantum Imaginary Time Evolution are susceptible to these errors. This article presents the combination of both noise tailoring using Randomized Compiling and error mitigation with a purification. We also show that Cycle Benchmarking gives an estimate of the reliability of the purification. We apply this method to the Quantum Imaginary Time Evolution of a Transverse Field Ising Model and report an energy estimation and a ground state infidelity both below 1\%. Our methodology is general and can be used for other algorithms and platforms. We show how combining noise tailoring and error mitigation will push forward the performance of NISQ devices.


title: Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity

abstract: When primed with only a handful of training samples, very large, pretrained language models such as GPT-3 have shown competitive results when compared to fully-supervised, fine-tuned, large, pretrained language models. We demonstrate that the order in which the samples are provided can make the difference between near state-of-the-art and random guess performance: essentially some permutations are "fantastic" and some not. We analyse this phenomenon in detail, establishing that: it is present across model sizes (even for the largest current models), it is not related to a specific subset of samples, and that a given good permutation for one model is not transferable to another. While one could use a development set to determine which permutations are performant, this would deviate from the true few-shot setting as it requires additional annotated data. Instead, we use the generative nature of language models to construct an artificial development set and based on entropy statistics of the candidate permutations on this set, we identify performant prompts. Our method yields a 13% relative improvement for GPT-family models across eleven different established text classification tasks.


title: Chinese Sentences Similarity via Cross-Attention Based Siamese Network

abstract: Measuring sentence similarity is a key research area nowadays as it allows machines to better understand human languages. In this paper, we proposed a Cross-Attention Siamese Network (CATsNet) to carry out the task of learning the semantic meanings of Chinese sentences and comparing the similarity between two sentences. This novel model is capable of catching non-local features. Additionally, we also tried to apply the long short-term memory (LSTM) network in the model to improve its performance. The experiments were conducted on the LCQMC dataset and the results showed that our model could achieve a higher accuracy than previous work.


title: On finite groups factorized by $\sigma$-nilpotent subgroups

abstract: Let $G$ be a finite group and $\sigma=\{\sigma_{i}|i\in I\}$ be a partition of the set of all primes $\mathbb{P}$, that is, $\mathbb{P}=\bigcup_{i\in I}\sigma_{i}$ and $\sigma_{i}\cap \sigma_{j}=\emptyset$ for all $i\neq j$. A chief factor $H/K$ of $G$ is said to be $\sigma$-central in $G$, if the semidirect product $(H/K)\rtimes(G/C_G(H/K))$ is a $\sigma_i$-group for some $i\in I$. The group $G$ is said to be $\sigma$-nilpotent if either $G=1$ or every chief factor of $G$ is $\sigma$-central. In this paper, we study the properties of a finite group $G=AB$, factorized by two $\sigma$-nilpotent subgroups $A$ and $B$, and also generalize some known results.


title: An Uncertainty-aware Hierarchical Probabilistic Network for Early Prediction, Quantification and Segmentation of Pulmonary Tumour Growth

abstract: Early detection and quantification of tumour growth would help clinicians to prescribe more accurate treatments and provide better surgical planning. However, the multifactorial and heterogeneous nature of lung tumour progression hampers identification of growth patterns. In this study, we present a novel method based on a deep hierarchical generative and probabilistic framework that, according to radiological guidelines, predicts tumour growth, quantifies its size and provides a semantic appearance of the future nodule. Unlike previous deterministic solutions, the generative characteristic of our approach also allows us to estimate the uncertainty in the predictions, especially important for complex and doubtful cases. Results of evaluating this method on an independent test set reported a tumour growth balanced accuracy of 74%, a tumour growth size MAE of 1.77 mm and a tumour segmentation Dice score of 78%. These surpassed the performances of equivalent deterministic and alternative generative solutions (i.e. probabilistic U-Net, Bayesian test dropout and Pix2Pix GAN) confirming the suitability of our approach.


title: Misinfo Reaction Frames: Reasoning about Readers' Reactions to News Headlines

abstract: Even to a simple and short news headline, readers react in a multitude of ways: cognitively (e.g. inferring the writer's intent), emotionally (e.g. feeling distrust), and behaviorally (e.g. sharing the news with their friends). Such reactions are instantaneous and yet complex, as they rely on factors that go beyond interpreting factual content of news. We propose Misinfo Reaction Frames (MRF), a pragmatic formalism for modeling how readers might react to a news headline. In contrast to categorical schema, our free-text dimensions provide a more nuanced way of understanding intent beyond being benign or malicious. We also introduce a Misinfo Reaction Frames corpus, a crowdsourced dataset of reactions to over 25k news headlines focusing on global crises: the Covid-19 pandemic, climate change, and cancer. Empirical results confirm that it is indeed possible for neural models to predict the prominent patterns of readers' reactions to previously unseen news headlines. Additionally, our user study shows that displaying machine-generated MRF implications alongside news headlines to readers can increase their trust in real news while decreasing their trust in misinformation. Our work demonstrates the feasibility and importance of pragmatic inferences on news headlines to help enhance AI-guided misinformation detection and mitigation.


title: Catalog of One-side Head-Tail Galaxies in the FIRST Survey

abstract: One-side head-tail (OHT) galaxies are radio galaxies with a peculiar shape. They usually appear in galaxy clusters, but they have never been cataloged systematically. We design an automatic procedure to search for them in the Faint Images of the Radio Sky at Twenty-Centimeters source catalog and compile a sample with 115 HT candidates. After cross-checking with the Sloan Digital Sky Survey photometric data and catalogs of galaxy clusters, we find that 69 of them are possible OHT galaxies. Most of them are close to the center of galaxy clusters. The lengths of their tails do not correlate with the projection distance to the center of the nearest galaxy clusters, but show weak anticorrelation with the cluster richness, and are inversely proportional to the radial velocity differences between clusters and host galaxies. Our catalog provides a unique sample to study this special type of radio galaxies.


title: Human-Imitating Metrics for Training and Evaluating Privacy Preserving Emotion Recognition Models Using Sociolinguistic Knowledge

abstract: Privacy preservation is a crucial component of any real-world application. But, in applications relying on machine learning backends, privacy is challenging because models often capture more than what the model was initially trained for, resulting in the potential leakage of sensitive information. In this paper, we propose an automatic and quantifiable metric that allows us to evaluate humans' perception of a model's ability to preserve privacy with respect to sensitive variables. In this paper, we focus on saliency-based explanations, explanations that highlight regions of the input text, to infer internal workings of a black box model. We use the degree with which differences in interpretation of general vs privacy preserving models correlate with sociolinguistic biases to inform metric design. We show how certain commonly-used methods that seek to preserve privacy do not align with human perception of privacy preservation leading to distrust about model's claims. We demonstrate the versatility of our proposed metric by validating its utility for measuring cross corpus generalization for both privacy and emotion. Finally, we conduct crowdsourcing experiments to evaluate the inclination of the evaluators to choose a particular model for a given purpose when model explanations are provided, and show a positive relationship with the proposed metric. To the best of our knowledge, we take the first step in proposing automatic and quantifiable metrics that best align with human perception of model's ability for privacy preservation, allowing for cost-effective model development.


title: SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning

abstract: Augmenting pre-trained language models with knowledge graphs (KGs) has achieved success on various commonsense reasoning tasks. However, for a given task instance, the KG, or certain parts of the KG, may not be useful. Although KG-augmented models often use attention to focus on specific KG components, the KG is still always used, and the attention mechanism is never explicitly taught which KG components should be used. Meanwhile, saliency methods can measure how much a KG feature (e.g., graph, node, path) influences the model to make the correct prediction, thus explaining which KG features are useful. This paper explores how saliency explanations can be used to improve KG-augmented models' performance. First, we propose to create coarse (Is the KG useful?) and fine (Which nodes/paths in the KG are useful?) saliency explanations. Second, to motivate saliency-based supervision, we analyze oracle KG-augmented models which directly use saliency explanations as extra inputs for guiding their attention. Third, we propose SalKG, a framework for KG-augmented models to learn from coarse and/or fine saliency explanations. Given saliency explanations created from a task's training set, SalKG jointly trains the model to predict the explanations, then solve the task by attending to KG features highlighted by the predicted explanations. On three commonsense QA benchmarks (CSQA, OBQA, CODAH) and a range of KG-augmented models, we show that SalKG can yield considerable performance gains -- up to 2.76% absolute improvement on CSQA.


title: Atom-Orbital Qubits under Holonomic Quantum Control

abstract: Quantum computing has been attracting tremendous efforts in recent years. One prominent application is to perform quantum simulations of electron correlations in large molecules and solid-state materials, where orbital degrees of freedom are crucial to quantitatively model electronic properties. Electron orbitals unlike quantum spins obey crystal symmetries, making the atomic orbital in optical lattices a natural candidate to emulate electron orbitals. Here, we construct atom-orbital qubits by manipulating $s$- and $d$-orbitals of atomic Bose-Einstein condensation in an optical lattice. Noise-resilient quantum gate operations are achieved by performing holonomic quantum control, which admits geometrical protection. We find it is critical to eliminate the orbital leakage error in the system. The gate robustness is tested by varying the intensity of the laser forming the lattice. Our work opens up wide opportunities for atom-orbital based quantum information processing, of vital importance to programmable quantum simulations of multi-orbital physics in molecules and quantum materials.


title: Intuitive Physics Guided Exploration for Sample Efficient Sim2real Transfer

abstract: Physics-based reinforcement learning tasks can benefit from simplified physics simulators as they potentially allow near-optimal policies to be learned in simulation. However, such simulators require the latent factors (e.g. mass, friction coefficient etc.) of the associated objects and other environment-specific factors (e.g. wind speed, air density etc.) to be accurately specified, without which, it could take considerable additional learning effort to adapt the learned simulation policy to the real environment. As such a complete specification can be impractical, in this paper, we instead, focus on learning task-specific estimates of latent factors which allow the approximation of real world trajectories in an ideal simulation environment. Specifically, we propose two new concepts: a) action grouping - the idea that certain types of actions are closely associated with the estimation of certain latent factors, and; b) partial grounding - the idea that simulation of task-specific dynamics may not need precise estimation of all the latent factors. We first introduce intuitive action groupings based on human physics knowledge and experience, which is then used to design novel strategies for interacting with the real environment. Next, we describe how prior knowledge of a task in a given environment can be used to extract the relative importance of different latent factors, and how this can be used to inform partial grounding, which enables efficient learning of the task in any arbitrary environment. We demonstrate our approach in a range of physics based tasks, and show that it achieves superior performance relative to other baselines, using only a limited number of real-world interactions.


title: Ecological Adaptive Cruise Control for City Buses based on Hybrid Model Predictive Control using PnG and Traffic Light Information

abstract: This paper proposes an ecological adaptive cruise control (EACC) concept with the primary goal to minimize the fuel consumption in a city bus with an internal combustion engine (ICE). A hybrid model predictive control (HMPC) is implemented in this work to control both continuous and discrete-time variables. Moreover, a multi-objective optimization problem for EACC is formulated in time-domain as a mixed-integer quadratically constrained quadratic programming (MIQCQP) problem. The proposed HMPC-EACC performs robust vehicle-following while tracking a leading vehicle and plans fuel-efficient acceleration and deceleration maneuvers for the host vehicle. Additionally, it uses the signal phase and timing (SPaT) information to compute a green wave reference speed for the host vehicle to cross the signalized intersections at a green phase. Moreover, the proposed controller performs pulse and glide (PnG) to optimally control the engine ON and OFF states and save additional fuel. Furthermore, the performance of the proposed strategy is evaluated on a real-world driving profile and compared against a baseline controller from the literature. Finally, the influence of different prediction horizons on the fuel savings and computation times are studied. The results reveal significant reduction in fuel consumption with HMPC-EACC and demonstrate that the proposed controller is real-time capable.


title: MonoGRNet: A General Framework for Monocular 3D Object Detection

abstract: Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection. We propose MonoGRNet for the amodal 3D object detection from a monocular image via geometric reasoning in both the observed 2D projection and the unobserved depth dimension. MonoGRNet decomposes the monocular 3D object detection task into four sub-tasks including 2D object detection, instance-level depth estimation, projected 3D center estimation and local corner regression. The task decomposition significantly facilitates the monocular 3D object detection, allowing the target 3D bounding boxes to be efficiently predicted in a single forward pass, without using object proposals, post-processing or the computationally expensive pixel-level depth estimation utilized by previous methods. In addition, MonoGRNet flexibly adapts to both fully and weakly supervised learning, which improves the feasibility of our framework in diverse settings. Experiments are conducted on KITTI, Cityscapes and MS COCO datasets. Results demonstrate the promising performance of our framework in various scenarios.


title: Near-miss Identities and Spinor Genus Classification of Ternary Quadratic Forms with Congruence Conditions

abstract: In this paper, near-miss identities for the number of representations of some integral ternary quadratic forms with congruence conditions are found and proven. The genus and spinor genus of the corresponding lattice cosets are then classified. Finally, a complete genus and spinor genus classification for all conductor 2 lattice cosets of 2-adically unimodular lattices is given.


title: Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learning

abstract: Aiming to generate a set of keyphrases, Keyphrase Generation (KG) is a classical task for capturing the central idea from a given document. Based on Seq2Seq models, the previous reinforcement learning framework on KG tasks utilizes the evaluation metrics to further improve the well-trained neural models. However, these KG evaluation metrics such as $F_1@5$ and $F_1@M$ are only aware of the exact correctness of predictions on phrase-level and ignore the semantic similarities between similar predictions and targets, which inhibits the model from learning deep linguistic patterns. In response to this problem, we propose a new fine-grained evaluation metric to improve the RL framework, which considers different granularities: token-level $F_1$ score, edit distance, duplication, and prediction quantities. On the whole, the new framework includes two reward functions: the fine-grained evaluation score and the vanilla $F_1$ score. This framework helps the model identifying some partial match phrases which can be further optimized as the exact match ones. Experiments on KG benchmarks show that our proposed training framework outperforms the previous RL training frameworks among all evaluation scores. In addition, our method can effectively ease the synonym problem and generate a higher quality prediction. The source code is available at \url{https://github.com/xuyige/FGRL4KG}.


title: Electro-optical properties of excitons in Cu$_2$O quantum wells: I discrete states

abstract: We present theoretical results of the calculations of optical functions for Cu$_2$O quantum well (QW) with Rydberg excitons in an external homogeneous electric field of an arbitrary field strength. Two configurations of an external electric field perpendicular and parallel to the QW planes are considered in the energetic region for discrete excitonic states and continuum states. With the help of the real density matrix approach, which enables the derivation of the analytical expressions for the QW electro-optical functions, absorption spectra are calculated for the case of the excitation energy below the gap energy.


title: Back-Training excels Self-Training at Unsupervised Domain Adaptation of Question Generation and Passage Retrieval

abstract: In this work, we introduce back-training, an alternative to self-training for unsupervised domain adaptation (UDA) from source to target domain. While self-training generates synthetic training data where natural inputs are aligned with noisy outputs, back-training results in natural outputs aligned with noisy inputs. This significantly reduces the gap between the target domain and synthetic data distribution, and reduces model overfitting to the source domain. We run UDA experiments on question generation and passage retrieval from the \textit{Natural Questions} domain to machine learning and biomedical domains. We find that back-training vastly outperforms self-training by a mean improvement of 7.8 BLEU-4 points on generation, and 17.6\% top-20 retrieval accuracy across both domains. We further propose consistency filters to remove low-quality synthetic data before training. We also release a new domain-adaptation dataset- \textit{MLQuestions} containing 35K unaligned questions, 50K unaligned passages, and 3K aligned question-passage pairs.


title: Electro-optical properties of excitons in Cu$_2$O quantum wells: II continuum states

abstract: We present theoretically calculated optical functions for Cu$_2$O quantum well (QW) with Rydberg excitons in an external, homogeneous electric field parallel to the QW planes for the energy region above the gap, suitable to observe the Franz-Keldysh (FK) oscillations. We quantitatively describe the amplitudes and periodicity of FK modulations and the influence of both Rydberg excitons and confinement effect on this phenomenon.


title: Consistent Accelerated Inference via Confident Adaptive Transformers

abstract: We develop a novel approach for confidently accelerating inference in the large and expensive multilayer Transformers that are now ubiquitous in natural language processing (NLP). Amortized or approximate computational methods increase efficiency, but can come with unpredictable performance costs. In this work, we present CATs -- Confident Adaptive Transformers -- in which we simultaneously increase computational efficiency, while guaranteeing a specifiable degree of consistency with the original model with high confidence. Our method trains additional prediction heads on top of intermediate layers, and dynamically decides when to stop allocating computational effort to each input using a meta consistency classifier. To calibrate our early prediction stopping rule, we formulate a unique extension of conformal prediction. We demonstrate the effectiveness of this approach on four classification and regression tasks.


title: Multilingual Knowledge Graph Completion with Joint Relation and Entity Alignment

abstract: Knowledge Graph Completion (KGC) predicts missing facts in an incomplete Knowledge Graph. Almost all of existing KGC research is applicable to only one KG at a time, and in one language only. However, different language speakers may maintain separate KGs in their language and no individual KG is expected to be complete. Moreover, common entities or relations in these KGs have different surface forms and IDs, leading to ID proliferation. Entity alignment (EA) and relation alignment (RA) tasks resolve this by recognizing pairs of entity (relation) IDs in different KGs that represent the same entity (relation). This can further help prediction of missing facts, since knowledge from one KG is likely to benefit completion of another. High confidence predictions may also add valuable information for the alignment tasks. In response, we study the novel task of jointly training multilingual KGC, relation alignment and entity alignment models. We present ALIGNKGC, which uses some seed alignments to jointly optimize all three of KGC, EA and RA losses. A key component of ALIGNKGC is an embedding based soft notion of asymmetric overlap defined on the (subject, object) set signatures of relations this aids in better predicting relations that are equivalent to or implied by other relations. Extensive experiments with DBPedia in five languages establish the benefits of joint training for all tasks, achieving 10-32 MRR improvements of ALIGNKGC over a strong state-of-the-art single-KGC system completion model over each monolingual KG . Further, ALIGNKGC achieves reasonable gains in EA and RA tasks over a vanilla completion model over a KG that combines all facts without alignment, underscoring the value of joint training for these tasks.


title: Low-rank State-action Value-function Approximation

abstract: Value functions are central to Dynamic Programming and Reinforcement Learning but their exact estimation suffers from the curse of dimensionality, challenging the development of practical value-function (VF) estimation algorithms. Several approaches have been proposed to overcome this issue, from non-parametric schemes that aggregate states or actions to parametric approximations of state and action VFs via, e.g., linear estimators or deep neural networks. Relevantly, several high-dimensional state problems can be well-approximated by an intrinsic low-rank structure. Motivated by this and leveraging results from low-rank optimization, this paper proposes different stochastic algorithms to estimate a low-rank factorization of the $Q(s, a)$ matrix. This is a non-parametric alternative to VF approximation that dramatically reduces the computational and sample complexities relative to classical $Q$-learning methods that estimate $Q(s,a)$ separately for each state-action pair.


title: Best Practices for Noise-Based Augmentation to Improve the Performance of Deployable Speech-Based Emotion Recognition Systems

abstract: Speech emotion recognition is an important component of any human centered system. But speech characteristics produced and perceived by a person can be influenced by a multitude of reasons, both desirable such as emotion, and undesirable such as noise. To train robust emotion recognition models, we need a large, yet realistic data distribution, but emotion datasets are often small and hence are augmented with noise. Often noise augmentation makes one important assumption, that the prediction label should remain the same in presence or absence of noise, which is true for automatic speech recognition but not necessarily true for perception based tasks. In this paper we make three novel contributions. We validate through crowdsourcing that the presence of noise does change the annotation label and hence may alter the original ground truth label. We then show how disregarding this knowledge and assuming consistency in ground truth labels propagates to downstream evaluation of ML models, both for performance evaluation and robustness testing. We end the paper with a set of recommendations for noise augmentations in speech emotion recognition datasets.


title: Eddy current compensated double diffusion encoded (DDE) MRI

abstract: Purpose: Eddy currents might lead to image distortions in diffusion weighted echo planar imaging. A method is proposed to reduce their effects on double diffusion encoding (DDE) MRI experiments and the thereby derived microscopic fractional anisotropy (\mu FA) . Methods: The twice refocused spin echo scheme was adapted for DDE measurements. To assess the effect of individual diffusion encodings on the image distortions, measurements of a grid of plastic rods in water were performed. The effect of eddy current compensation on \mu FA measurements was evaluated in the brains of six healthy volunteers. Results: The use of an eddy current compensation reduced the signal variation. As expected, the distortions caused by the second encoding were larger than those of the first encoding entailing a stronger need to compensate for them. For an optimal result, however, both encodings had to be compensated. The artifact reduction strongly improved the measurement of the \mu FA in ventricles and grey matter by reducing the overestimation. An effect of the compensation on absolute \mu FA values in white matter was not observed. Conclusion: It is advisable to compensate both encodings in DDE measurements for eddy currents.


title: Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning

abstract: The ability to continuously expand knowledge over time and utilize it to rapidly generalize to new tasks is a key feature of human linguistic intelligence. Existing models that pursue rapid generalization to new tasks (e.g., few-shot learning methods), however, are mostly trained in a single shot on fixed datasets, unable to dynamically expand their knowledge; while continual learning algorithms are not specifically designed for rapid generalization. We present a new learning setup, Continual Learning of Few-Shot Learners (CLIF), to address the challenges of both learning settings in a unified setup. CLIF assumes a model learns from a sequence of diverse NLP tasks arriving sequentially, accumulating knowledge for improved generalization to new tasks, while also retaining performance on the tasks learned earlier. We examine how the generalization ability is affected in the continual learning setup, evaluate a number of continual learning algorithms, and propose a novel regularized adapter generation approach. We find that catastrophic forgetting affects generalization ability to a less degree than performance on seen tasks; while continual learning algorithms can still bring considerable benefit to the generalization ability.


title: SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts

abstract: Determining coreference of concept mentions across multiple documents is a fundamental task in natural language understanding. Previous work on cross-document coreference resolution (CDCR) typically considers mentions of events in the news, which seldom involve abstract technical concepts that are prevalent in science and technology. These complex concepts take diverse or ambiguous forms and have many hierarchical levels of granularity (e.g., tasks and subtasks), posing challenges for CDCR. We present a new task of Hierarchical CDCR (H-CDCR) with the goal of jointly inferring coreference clusters and hierarchy between them. We create SciCo, an expert-annotated dataset for H-CDCR in scientific papers, 3X larger than the prominent ECB+ resource. We study strong baseline models that we customize for H-CDCR, and highlight challenges for future work.


title: Multiband superconductivity with sign-preserving order parameter in kagome superconductor CsV3Sb5

abstract: The superconductivity of a kagome superconductor CsV3Sb5 is studied by scanning tunneling microscopy / spectroscopy at an ultralow temperature with high resolution. Two kinds of superconducting gaps with multiple sets of coherent peaks and residual zero-energy density of states are observed on both half-Cs and Sb surfaces, implying multiband superconductivity with gap nodes. Sixfold star-shaped magnetic vortex is observed with conventional Caroli-de Gennes-Matricon bound states inside. Magnetic impurities suppress the superconductivity, while nonmagnetic impurities do not, suggesting the absence of sign-change in the superconducting order parameter. Moreover, the interplay between charge density waves and superconductivity differs on various bands, resulting in different density of state distributions. Our study provides critical clues for further understanding the superconductivity and its relation to charge density waves in CsV3Sb5.


title: Human Schema Curation via Causal Association Rule Mining

abstract: Event schemas are structured knowledge sources defining typical real-world scenarios (e.g., going to an airport). We present a framework for efficient human-in-the-loop construction of a schema library, based on a novel script induction system and a well-crafted interface that allows non-experts to "program" complex event structures. Associated with this work we release a schema library: a machine readable resource of 232 detailed event schemas, each of which describe a distinct typical scenario in terms of its relevant sub-event structure (what happens in the scenario), participants (who plays a role in the scenario), fine-grained typing of each participant, and the implied relational constraints between them. We make our schema library and the SchemaBlocks interface available online.


title: Contrastive Out-of-Distribution Detection for Pretrained Transformers

abstract: Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic shift problems at inference time. Therefore, in practice, a reliable model should identify such instances, and then either reject them during inference or pass them over to models that handle another distribution. In this paper, we develop an unsupervised OOD detection method, in which only the in-distribution (ID) data are used in training. We propose to fine-tune the Transformers with a contrastive loss, which improves the compactness of representations, such that OOD instances can be better differentiated from ID ones. These OOD instances can then be accurately detected using the Mahalanobis distance in the model's penultimate layer. We experiment with comprehensive settings and achieve near-perfect OOD detection performance, outperforming baselines drastically. We further investigate the rationales behind the improvement, finding that more compact representations through margin-based contrastive learning bring the improvement. We release our code to the community for future research.


title: CNN aided Weighted Interpolation for Channel Estimation in Vehicular Communications

abstract: IEEE 802.11p standard defines wireless technology protocols that enable vehicular transportation and manage traffic efficiency. A major challenge in the development of this technology is ensuring communication reliability in highly dynamic vehicular environments, where the wireless communication channels are doubly selective, thus making channel estimation and tracking a relevant problem to investigate. In this paper, a novel deep learning (DL)-based weighted interpolation estimator is proposed to accurately estimate vehicular channels especially in high mobility scenarios. The proposed estimator is based on modifying the pilot allocation of the IEEE 802.11p standard so that more transmission data rates are achieved. Extensive numerical experiments demonstrate that the developed estimator significantly outperforms the recently proposed DL-based frame-by-frame estimators in different vehicular scenarios, while substantially reducing the overall computational complexity.


title: Exotic resonances of fully-heavy tetraquarks in a lattice-QCD insipired quark model

abstract: Fully-heavy tetraquark states, i.e. $cc\bar{c}\bar{c}$, $bb\bar{b}\bar{b}$, $bb\bar{c}\bar{c}$ ($cc\bar{b}\bar{b}$), $cb\bar{c}\bar{c}$, $cb\bar{b}\bar{b}$, and $cb\bar{c}\bar{b}$, are systematically investigated by means of a non-relativistic quark model based on lattice-QCD studies of the two-body $Q\bar{Q}$ interaction, which exhibits a spin-independent Cornell potential along with a spin-spin term. The four-body problem is solved using the Gaussian expansion method; additionally, the so-called complex scaling technique is employed so that bound, resonance, and scattering states can be treated on the same footing. Moreover, a complete set of four-body configurations, including meson-meson, diquark-antidiquark, and K-type configurations, as well as their couplings, are considered for spin-parity quantum numbers $J^{P(C)}=0^{+(+)}$, $1^{+(\pm)}$, and $2^{+(+)}$ in the $S$-wave channel. Several narrow resonances, with two-meson strong decay widths less than 30 MeV, are found in all of the tetraquark systems studied. Particularly, the fully-charm resonances recently reported by the LHCb Collaboration, at the energy range between 6.2 and 7.2 GeV in the di-$J/\psi$ invariant spectrum, can be well identified in our calculation. Focusing on the fully-bottom tetraquark spectrum, resonances with masses between 18.9 and 19.6 GeV are found. For the remaining charm-bottom cases, the masses are obtained within a energy region from 9.8 GeV to 16.4 GeV. All these predicted resonances can be further examined in future experiments.


title: FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks

abstract: Increasing concerns and regulations about data privacy and sparsity necessitate the study of privacy-preserving, decentralized learning methods for natural language processing (NLP) tasks. Federated learning (FL) provides promising approaches for a large number of clients (e.g., personal devices or organizations) to collaboratively learn a shared global model to benefit all clients while allowing users to keep their data locally. Despite interest in studying FL methods for NLP tasks, a systematic comparison and analysis is lacking in the literature. Herein, we present the FedNLP, a benchmarking framework for evaluating federated learning methods on four different task formulations: text classification, sequence tagging, question answering, and seq2seq. We propose a universal interface between Transformer-based language models (e.g., BERT, BART) and FL methods (e.g., FedAvg, FedOPT, etc.) under various non-IID partitioning strategies. Our extensive experiments with FedNLP provide empirical comparisons between FL methods and helps us better understand the inherent challenges of this direction. The comprehensive analysis points to intriguing and exciting future research aimed at developing FL methods for NLP tasks.


title: Representations and Deformations of 3-Hom-$\rho$-Lie algebras

abstract: The aim of this paper is to introduce 3-Hom-$\rho$-Lie algebra structures generalizing the algebras of 3-Hom-Lie algebra. Also, we investigate the representations and deformations theory of this type of Hom-Lie algebras. Moreover, we introduce the definition of extensions and abelian extensions of 3-Hom-$\rho$-Lie algebras and show that associated to any abelian extension, there is a representation and a 2-cocycle.


title: Stream-level Latency Evaluation for Simultaneous Machine Translation

abstract: Simultaneous machine translation has recently gained traction thanks to significant quality improvements and the advent of streaming applications. Simultaneous translation systems need to find a trade-off between translation quality and response time, and with this purpose multiple latency measures have been proposed. However, latency evaluations for simultaneous translation are estimated at the sentence level, not taking into account the sequential nature of a streaming scenario. Indeed, these sentence-level latency measures are not well suited for continuous stream translation resulting in figures that are not coherent with the simultaneous translation policy of the system being assessed. This work proposes a stream-level adaptation of the current latency measures based on a re-segmentation approach applied to the output translation, that is successfully evaluated on streaming conditions for a reference IWSLT task.


title: Naturalness of lepton non-universality and muon g-2

abstract: We show that the observed anomalies in the lepton sector can be explained in extensions of the Standard Model that are natural and, therefore, resolve the Higgs sector hierarchy problem. The scale of new physics is around the TeV and Technicolor-like theories are ideal candidate models.


title: Classifications of the Summative Assessment for Revised Blooms Taxonomy by using Deep Learning

abstract: Education is the basic step of understanding the truth and the preparation of the intelligence to reflect. Focused on the rational capacity of the human being the Cognitive process and knowledge dimensions of Revised Blooms Taxonomy helps to differentiate the procedure of studying into six types of various cognitive processes and four types of knowledge dimensions. These types are synchronized in the increasing level of difficulty. In this paper Software Engineering courses of B.Tech Computer Engineering and Information Technology offered by various Universities and Educational Institutes have been investigated for Revised Blooms Taxonomy RBT. Questions are a very useful constituent. Knowledge intelligence and strength of the learners can be tested by applying questions.The fundamental goal of this paper is to create a relative study of the classification of the summative assessment based on Revised Blooms Taxonomy using the Convolutional Neural Networks CNN Long Short-Term Memory LSTM of Deep Learning techniques in an endeavor to attain significant accomplishment and elevated precision levels.


title: Fair Coin Flipping: Tighter Analysis and the Many-Party Case

abstract: In a multi-party fair coin-flipping protocol, the parties output a common (close to) unbiased bit, even when some adversarial parties try to bias the output. In this work we focus on the case of an arbitrary number of corrupted parties. Cleve [STOC 1986] has shown that in any such $m$-round coin-flipping protocol, the corrupted parties can bias the honest parties' common output bit by $\Theta(1/m)$. For more than two decades, the best known coin-flipping protocol was the one of Awerbuch et al. [Manuscript 1985], who presented a $t$-party, $m$-round protocol with bias $\Theta(t/\sqrt{m})$. This was changed by the breakthrough result of Moran et al. [TCC 2009], who constructed an $m$-round, two-party coin-flipping protocol with optimal bias $\Theta(1/m)$. Haitner and Tsfadia [STOC 2014] constructed an $m$-round, three-party coin-flipping protocol with bias $O(\log^3m / m)$. Still for the case of more than three parties, the best known protocol remained the $\Theta(t/\sqrt{m})$-bias protocol of Awerbuch et al. We make a step towards eliminating the above gap, presenting a $t$-party, $m$-round coin-flipping protocol, with bias $O(\frac{t^4 \cdot 2^t \cdot \sqrt{\log m}}{m^{1/2+1/\left(2^{t-1}-2\right)}})$ for any $t\le \tfrac12 \log\log m$. This improves upon the $\Theta(t/\sqrt{m})$-bias protocol of Awerbuch et al., and in particular, for $t\in O(1)$ it is an $1/m^{\frac12 + \Theta(1)}$-bias protocol. For the three-party case, it is an $O(\sqrt{\log m}/m)$-bias protocol, improving over the $O(\log^3m / m)$-bias protocol of Haitner and Tsfadia. Our protocol generalizes that of Haitner and Tsfadia, by presenting an appropriate recovery protocol for the remaining parties to interact in, in the case that some parties abort or are caught cheating. We prove the fairness of the new protocol by presenting a new paradigm for analyzing fairness of coin-flipping protocols.


title: SimCSE: Simple Contrastive Learning of Sentence Embeddings

abstract: This paper presents SimCSE, a simple contrastive learning framework that greatly advances state-of-the-art sentence embeddings. We first describe an unsupervised approach, which takes an input sentence and predicts itself in a contrastive objective, with only standard dropout used as noise. This simple method works surprisingly well, performing on par with previous supervised counterparts. We find that dropout acts as minimal data augmentation, and removing it leads to a representation collapse. Then, we propose a supervised approach, which incorporates annotated pairs from natural language inference datasets into our contrastive learning framework by using "entailment" pairs as positives and "contradiction" pairs as hard negatives. We evaluate SimCSE on standard semantic textual similarity (STS) tasks, and our unsupervised and supervised models using BERT base achieve an average of 76.3% and 81.6% Spearman's correlation respectively, a 4.2% and 2.2% improvement compared to the previous best results. We also show -- both theoretically and empirically -- that the contrastive learning objective regularizes pre-trained embeddings' anisotropic space to be more uniform, and it better aligns positive pairs when supervised signals are available.


title: An extension of the proximal point algorithm beyond convexity

abstract: We introduce and investigate a new generalized convexity notion for functions called prox-convexity. The proximity operator of such a function is single-valued and firmly nonexpansive. We provide examples of (strongly) quasiconvex, weakly convex, and DC (difference of convex) functions that are prox-convex, however none of these classes fully contains the one of prox-convex functions or is included into it. We show that the classical proximal point algorithm remains convergent when the convexity of the proper lower semicontinuous function to be minimized is relaxed to prox-convexity.


title: Acoustic Metagrating Circulators: Nonreciprocal, Robust, and Tunable Manipulation with Unitary Efficiency

abstract: Nonreciprocal signal operation is highly desired for various acoustic applications, where protection from unwanted backscattering can be realized so that transmitting and receiving signals are processed in a full-duplex mode. Here we present the realization of a class of nonreciprocal circulators based on simply structured acoustic metagratings, which consist only of a few solid cylinders and a steady fluid flow with low velocity. These innovative metagratings are intelligently designed via a diffraction analysis of the linearized potential flow equation and a genetic-algorithm-based optimization process. Unitary reflection efficiency between desired ports of the circulators are demonstrated through full-wave numerical simulations, confirming nonreciprocal and robust circulation of the acoustic signal over a broad range of flow velocity magnitude and profile. Our design provides a feasible degree of tunability, including switching from reciprocal to nonreciprocal operation and reversing the handedness of the circulator, presenting a convenient but efficient approach for the realization of nonreciprocal acoustic devices from wavelength-thick metagratings. It may find applications in various scenarios including underwater communication, energy harvesting, and acoustic sensing.


title: XCloud-pFISTA: A Medical Intelligence Cloud for Accelerated MRI

abstract: Machine learning and artificial intelligence have shown remarkable performance in accelerated magnetic resonance imaging (MRI). Cloud computing technologies have great advantages in building an easily accessible platform to deploy advanced algorithms. In this work, we develop an open-access, easy-to-use and high-performance medical intelligence cloud computing platform (XCloud-pFISTA) to reconstruct MRI images from undersampled k-space data. Two state-of-the-art approaches of the Projected Fast Iterative Soft-Thresholding Algorithm (pFISTA) family have been successfully implemented on the cloud. This work can be considered as a good example of cloud-based medical image reconstruction and may benefit the future development of integrated reconstruction and online diagnosis system.


title: Flexible Generation of Natural Language Deductions

abstract: An interpretable system for open-domain reasoning needs to express its reasoning process in a transparent form. Natural language is an attractive representation for this purpose -- it is both highly expressive and easy for humans to understand. However, manipulating natural language statements in logically consistent ways is hard: models must cope with variation in how meaning is expressed while remaining precise. In this paper, we describe ParaPattern, a method for building models to generate deductive inferences from diverse natural language inputs without direct human supervision. We train BART-based models (Lewis et al., 2020) to generate the result of applying a particular logical operation to one or more premise statements. Crucially, we develop a largely automated pipeline for constructing suitable training examples from Wikipedia. We evaluate our models using out-of-domain sentence compositions from the QASC (Khot et al., 2020) and EntailmentBank (Dalvi et al., 2021) datasets as well as targeted perturbation sets. Our results show that our models are substantially more accurate and flexible than baseline systems. ParaPattern achieves 85% validity on examples of the 'substitution' operation from EntailmentBank without the use of any in-domain training data, matching the performance of a model fine-tuned for EntailmentBank. The full source code for our method is publicly available.


title: GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation

abstract: Large-scale language models such as GPT-3 are excellent few-shot learners, allowing them to be controlled via natural text prompts. Recent studies report that prompt-based direct classification eliminates the need for fine-tuning but lacks data and inference scalability. This paper proposes a novel data augmentation technique that leverages large-scale language models to generate realistic text samples from a mixture of real samples. We also propose utilizing soft-labels predicted by the language models, effectively distilling knowledge from the large-scale language models and creating textual perturbations simultaneously. We perform data augmentation experiments on diverse classification tasks and show that our method hugely outperforms existing text augmentation methods. Ablation studies and a qualitative analysis provide more insights into our approach.


title: Light Curves of Partial Tidal Disruption Events

abstract: Tidal disruption events (TDEs) can uncover the quiescent black holes (BHs) at the center of galaxies and also offer a promising method to study them. In a partial TDE (PTDE), the BH's tidal force cannot fully disrupt the star, so the stellar core survives and only a varied portion of the stellar mass is bound to the BH and feeds it. We calculate the event rate of PTDEs and full TDEs (FTDEs). In general, the event rate of PTDEs is higher than that of FTDEs, especially for the larger BHs. And the detection rate of PTDEs is about dozens per year by Zwicky Transient Factory (ZTF). During the circularization process of the debris stream in PTDEs, no outflow can be launched due to the efficient radiative diffusion. The circularized debris ring then experiences viscous evolution and forms an accretion disk. We calculate the light curves of PTDEs contributed by these two processes, along with their radiation temperature evolution. The light curves have double peaks and the spectra peak in UV. Without obscuration or reprocessing of the radiation by an outflow, PTDEs provide a clean environment to study the circularization and transient disk formation in TDEs.


title: Enhanced dynamically assisted pair production in spatial inhomogeneous electric fields with the frequency chirping

abstract: Chirped dynamically assisted pair production in spatial inhomogeneous electric fields is studied by the Dirac-Heisenberg-Wigner formalism. The effects of the chirp parameter on the reduced momentum spectrum, the reduced total yield of the created pairs for either low or high frequency one-color field and two-color dynamically assisted combinational fields are investigated in detail. Also, the enhancement factor is obtained in the later two-color field case. It is found that for the low frequency field, no matter whether it is accompanied by the other high frequency field, its chirping has a little effect on the pair production. For the one-color high frequency field or/and two-color fields, the momentum spectrum exhibits incomplete interference and the interference effect becomes more and more remarkable as chirp increases. We also find that in the chirped dynamically assisted field, the reduced total yield is enhanced significantly when the chirps are acting on the two fields, compared with that the chirp is acting only for the low frequency strong field. Specifically, by the chirping, it is found the reduced pair number is increased by more than one order of magnitude in the field with a relative narrow spatial scale, while it is enhanced at least two times in other case of field with larger spatial scales or even in the quasi-homogeneous region. We also obtain some optimal chirp parameters and spatial scales for the total yield and enhancement factor in different scenarios of the studied external field. These results may provide a theoretical basis for possible experiments in the future.


title: Modeling Ideological Salience and Framing in Polarized Online Groups with Graph Neural Networks and Structured Sparsity

abstract: The increasing polarization of online political discourse calls for computational tools that automatically detect and monitor ideological divides in social media. We introduce a minimally supervised method that leverages the network structure of online discussion forums, specifically Reddit, to detect polarized concepts. We model polarization along the dimensions of salience and framing, drawing upon insights from moral psychology. Our architecture combines graph neural networks with structured sparsity learning and results in representations for concepts and subreddits that capture temporal ideological dynamics such as right-wing and left-wing radicalization.


title: Quantization for biharmonic maps from non-collapsed degenerating Einstein 4-manifolds

abstract: For a sequence of extrinsic or intrinsic biharmonic maps $u_j: M_j\rightarrow N$ from a sequence of non-collapsed degenerating closed Einstein 4-manifolds $(M_j,g_j)$ with bounded Einstein constants, bounded diameters and bounded $L^2$ curvature energy into a compact Riemannian manifold $(N,h)$ with uniformly bounded biharmonic energy, we establish a compactness theory modular finitely many bubbles, which are finite energy biharmonic maps from $\mathbb{R}^4$, or from $\mathbb{R}^4 / \Gamma$ for some nontrivial finite group $\Gamma \subset SO(4)$, or from some complete, noncompact, Ricci flat, non-flat ALE 4-manifold (orbifold). To achieve this, we develop a sophisticated asymptotic analysis for solutions over degenerating neck regions.


title: Global Higher Integrability of the Gradient of the A-Laplace Equation Solution

abstract: In this paper, we establish higher integrability of the gradient of the solution of the quasilinear elliptic equation $\Delta_Au=\text{div}\left(\frac{a(|F|)}{|F|}F\right)$ in $\mathbb{R}^n$, where $\Delta_Au$ is the so called A-Laplace operator.


title: Evidence of energy-, recombination-, and photon-limited escape regimes in giant planet H/He atmospheres

abstract: Hydrodynamic escape is the most efficient atmospheric mechanism of planetary mass loss and has a large impact on planetary evolution. Three hydrodynamic escape regimes have been identified theoretically: energy-limited, recombination-limited, and photon-limited. However, no evidence of these regimes had been reported until now. Here, we report evidence of these three regimes via an analysis of helium I triplet at 10830 angstroms and Ly-$\alpha$ absorption involving a 1D hydrodynamic model that allows us to estimate hydrogen recombination and advection rates. In particular, we show that HD 209458 b is in the energy-limited regime, HD 189733 b is in the recombination-limited regime, and GJ 3470 b is in the photon-limited regime. These exoplanets can be considered as benchmark cases for their respective regimes.


title: Degenerate Fubini-type polynomials associated with degenerate Apostol-Bernoulli and Apostol-Euler polynomials of order {\alpha}

abstract: In this paper, by introducing the degenerate Fubini-type polynomials, we give several relations with the help of the Fa\`a di Bruno formula and some properties of Bell polynomials, and generating function methods. Also, we derive some new explicit formulas and recurrence relations for Fubini-type polynomials and numbers. Associating the degenerate Fubini-type polynomials newly defined here with degenerate Apostol-Bernoulli polynomials and degenerate Apostol-Euler polynomials of order {\alpha} enables us to present additional relations for some degenerate special polynomials and numbers.


title: Small-Scale 5G Testbeds for Network Slicing Deployment: A Systematic Review

abstract: Developing specialized cloud-based and open-source testbeds is a practical approach to investigate network slicing functionalities in the fifth-generation (5G) mobile networks. This paper provides a comprehensive review of most of the existing cost-efficient and small-scale testbeds that partially or fully deploy network slicing. First, we present relevant software packages for the three main functional blocks of the ETSI NFV MANO framework and for emulating the access and core network domains. Second, we define primary and secondary design criteria for deploying network slicing testbeds. These design criteria are later used for comparison between the testbeds. Third, we present the state-of-the-art testbeds, including their design objectives, key technologies, network slicing deployment, and experiments. Next, we evaluate the testbeds according to the defined design criteria and present an in-depth summary table. This assessment concludes with the superiority of some of them over the rest and the most dominant software packages satisfying the ETSI NFV MANO framework. Finally, challenges, potential solutions, and future works of network slicing testbeds are discussed.


title: CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP

abstract: Humans can learn a new language task efficiently with only few examples, by leveraging their knowledge obtained when learning prior tasks. In this paper, we explore whether and how such cross-task generalization ability can be acquired, and further applied to build better few-shot learners across diverse NLP tasks. We introduce CrossFit, a problem setup for studying cross-task generalization ability, which standardizes seen/unseen task partitions, data access during different learning stages, and the evaluation protocols. To instantiate different seen/unseen task partitions in CrossFit and facilitate in-depth analysis, we present the NLP Few-shot Gym, a repository of 160 diverse few-shot NLP tasks created from open-access NLP datasets and converted to a unified text-to-text format. Our analysis reveals that the few-shot learning ability on unseen tasks can be improved via an upstream learning stage using a set of seen tasks. We also observe that the selection of upstream learning tasks can significantly influence few-shot performance on unseen tasks, asking further analysis on task similarity and transferability.


title: LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding

abstract: Multimodal pre-training with text, layout, and image has achieved SOTA performance for visually-rich document understanding tasks recently, which demonstrates the great potential for joint learning across different modalities. In this paper, we present LayoutXLM, a multimodal pre-trained model for multilingual document understanding, which aims to bridge the language barriers for visually-rich document understanding. To accurately evaluate LayoutXLM, we also introduce a multilingual form understanding benchmark dataset named XFUND, which includes form understanding samples in 7 languages (Chinese, Japanese, Spanish, French, Italian, German, Portuguese), and key-value pairs are manually labeled for each language. Experiment results show that the LayoutXLM model has significantly outperformed the existing SOTA cross-lingual pre-trained models on the XFUND dataset. The pre-trained LayoutXLM model and the XFUND dataset are publicly available at https://aka.ms/layoutxlm.


title: Invariant Subspace Approach to Boolean (Control) Networks

abstract: A logical function can be used to characterizing a property of a state of Boolean network (BN), which is considered as an aggregation of states. To illustrate the dynamics of a set of logical functions, which characterize our concerned properties of a BN, the invariant subspace containing the set of logical functions is proposed, and its properties are investigated. Then the invariant subspace of Boolean control network (BCN) is also proposed. The dynamics of invariant subspace of BCN is also invariant. Finally, using outputs as the set of logical functions, the minimum realization of BCN is proposed, which provides a possible solution to overcome the computational complexity of large scale BNs/BCNs.


title: Multi-scale Self-calibrated Network for Image Light Source Transfer

abstract: Image light source transfer (LLST), as the most challenging task in the domain of image relighting, has attracted extensive attention in recent years. In the latest research, LLST is decomposed three sub-tasks: scene reconversion, shadow estimation, and image re-rendering, which provides a new paradigm for image relighting. However, many problems for scene reconversion and shadow estimation tasks, including uncalibrated feature information and poor semantic information, are still unresolved, thereby resulting in insufficient feature representation. In this paper, we propose novel down-sampling feature self-calibrated block (DFSB) and up-sampling feature self-calibrated block (UFSB) as the basic blocks of feature encoder and decoder to calibrate feature representation iteratively because the LLST is similar to the recalibration of image light source. In addition, we fuse the multi-scale features of the decoder in scene reconversion task to further explore and exploit more semantic information, thereby providing more accurate primary scene structure for image re-rendering. Experimental results in the VIDIT dataset show that the proposed approach significantly improves the performance for LLST.


title: On balanced characteristic functions of canonical cliques in Paley graphs of square order

abstract: In this paper we prove that balanced characteristic functions of canonical cliques in a Paley graph of square order $P(q^2)$ span the $\frac{-1+q}{2}$-eigenspace of the graph. This is the first of two steps to a second proof of the analogue of Erd\"os-Ko-Rado theorem for Paley graphs of square order (the first proof was given by A. Blokhuis in 1984).


title: On the Influence of Masking Policies in Intermediate Pre-training

abstract: Current NLP models are predominantly trained through a two-stage "pre-train then fine-tune" pipeline. Prior work has shown that inserting an intermediate pre-training stage, using heuristic masking policies for masked language modeling (MLM), can significantly improve final performance. However, it is still unclear (1) in what cases such intermediate pre-training is helpful, (2) whether hand-crafted heuristic objectives are optimal for a given task, and (3) whether a masking policy designed for one task is generalizable beyond that task. In this paper, we perform a large-scale empirical study to investigate the effect of various masking policies in intermediate pre-training with nine selected tasks across three categories. Crucially, we introduce methods to automate the discovery of optimal masking policies via direct supervision or meta-learning. We conclude that the success of intermediate pre-training is dependent on appropriate pre-train corpus, selection of output format (i.e., masked spans or full sentence), and clear understanding of the role that MLM plays for the downstream task. In addition, we find our learned masking policies outperform the heuristic of masking named entities on TriviaQA, and policies learned from one task can positively transfer to other tasks in certain cases, inviting future research in this direction.


title: Joule-Thomson expansion of Lower-dimensional black hole

abstract: The Joule-Thomson expansion is extended to the lower-dimensional regime by considering the rotating BTZ metric in the (2+1)-dimensional space-time. Specifically, the properties of three important aspects of the Joule-Thomson expansion, namely the Joule-Thomson coefficient, the inversion curve and the isenthalpic curve are focused on. The divergence point of the Joule-Thomson coefficient and the zero point of the Hawking temperature are studied. The inversion temperature curves and isenthalpic curves in the $T-P$ plane are obtained and the cooling-heating regions are determined. Furthermore, the minimum inversion temperature is found to be zero, and the black hole becomes an extremal black hole. The ratio between the minimum inversion temperature and the critical temperature for the BTZ black hole doesn't exist, since the BTZ black hole does not have the critical behavior in $P_c$, $T_c$ and $V_c$.


title: A Rank based Adaptive Mutation in Genetic Algorithm

abstract: Traditionally Genetic Algorithm has been used for optimization of unimodal and multimodal functions. Earlier researchers worked with constant probabilities of GA control operators like crossover, mutation etc. for tuning the optimization in specific domains. Recent advancements in this field witnessed adaptive approach in probability determination. In Adaptive mutation primarily poor individuals are utilized to explore state space, so mutation probability is usually generated proportionally to the difference between fitness of best chromosome and itself (fMAX - f). However, this approach is susceptible to nature of fitness distribution during optimization. This paper presents an alternate approach of mutation probability generation using chromosome rank to avoid any susceptibility to fitness distribution. Experiments are done to compare results of simple genetic algorithm (SGA) with constant mutation probability and adaptive approaches within a limited resource constraint for unimodal, multimodal functions and Travelling Salesman Problem (TSP). Measurements are done for average best fitness, number of generations evolved and percentage of global optimum achievements out of several trials. The results demonstrate that the rank-based adaptive mutation approach is superior to fitness-based adaptive approach as well as SGA in a multimodal problem space.


title: Boundaries of graphs of relatively hyperbolic groups with cyclic edge groups

abstract: We prove that the fundamental group of a finite graph of convergence groups with parabolic edge groups is a convergence group. Using this result, under some mild assumptions, we prove a combination theorem for a graph of convergence groups with dynamically quasi-convex edge groups (Theorem 1.3). To prove these results, we use a modification of Dahmani's technique [Dah03]. Then we show that the fundamental group of a graph of relatively hyperbolic groups with edge groups either parabolic or infinite cyclic is relatively hyperbolic and construct Bowditch boundary. Finally, we show that the homeomorphism type of Bowditch boundary of the fundamental group of a graph of relatively hyperbolic groups with parabolic edge groups is determined by the homeomorphism type of the Bowditch boundaries of vertex groups (under some additional hypotheses)(Theorem 7.1). In the last section of the paper, we give some applications and examples.


title: Acoustic non-Hermitian skin effect from twisted winding topology

abstract: The recently discovered non-Hermitian skin effect (NHSE) manifests the breakdown of current classification of topological phases in energy-nonconservative systems, and necessitates the introduction of non-Hermitian band topology. So far, all NHSE observations are based on one type of non-Hermitian band topology, in which the complex energy spectrum winds along a closed loop. As recently characterized along a synthetic dimension on a photonic platform, non-Hermitian band topology can exhibit almost arbitrary windings in momentum space, but their actual phenomena in real physical systems remain unclear. Here, we report the experimental realization of NHSE in a one-dimensional (1D) non-reciprocal acoustic crystal. With direct acoustic measurement, we demonstrate that a twisted winding, whose topology consists of two oppositely oriented loops in contact rather than a single loop, will dramatically change the NHSE, following previous predictions of unique features such as the bipolar localization and the Bloch point for a Bloch-wave-like extended state. This work reveals previously unnoticed features of NHSE, and provides the observation of physical phenomena originating from complex non-Hermitian winding topology.


title: Lesion-Inspired Denoising Network: Connecting Medical Image Denoising and Lesion Detection

abstract: Deep learning has achieved notable performance in the denoising task of low-quality medical images and the detection task of lesions, respectively. However, existing low-quality medical image denoising approaches are disconnected from the detection task of lesions. Intuitively, the quality of denoised images will influence the lesion detection accuracy that in turn can be used to affect the denoising performance. To this end, we propose a play-and-plug medical image denoising framework, namely Lesion-Inspired Denoising Network (LIDnet), to collaboratively improve both denoising performance and detection accuracy of denoised medical images. Specifically, we propose to insert the feedback of downstream detection task into existing denoising framework by jointly learning a multi-loss objective. Instead of using perceptual loss calculated on the entire feature map, a novel region-of-interest (ROI) perceptual loss induced by the lesion detection task is proposed to further connect these two tasks. To achieve better optimization for overall framework, we propose a customized collaborative training strategy for LIDnet. On consideration of clinical usability and imaging characteristics, three low-dose CT images datasets are used to evaluate the effectiveness of the proposed LIDnet. Experiments show that, by equipping with LIDnet, both of the denoising and lesion detection performance of baseline methods can be significantly improved.


title: Tutorial on logistic-regression calibration and fusion: Converting a score to a likelihood ratio

abstract: Logistic-regression calibration and fusion are potential steps in the calculation of forensic likelihood ratios. The present paper provides a tutorial on logistic-regression calibration and fusion at a practical conceptual level with minimal mathematical complexity. A score is log-likelihood-ratio like in that it indicates the degree of similarity of a pair of samples while taking into consideration their typicality with respect to a model of the relevant population. A higher-valued score provides more support for the same-origin hypothesis over the different-origin hypothesis than does a lower-valued score; however, the absolute values of scores are not interpretable as log likelihood ratios. Logistic-regression calibration is a procedure for converting scores to log likelihood ratios, and logistic-regression fusion is a procedure for converting parallel sets of scores from multiple forensic-comparison systems to log likelihood ratios. Logistic-regression calibration and fusion were developed for automatic speaker recognition and are popular in forensic voice comparison. They can also be applied in other branches of forensic science, a fingerprint/fingermark example is provided.


title: Determination of the up/down-quark mass within QCD sum rules in the scalar channel

abstract: In this work, we determine up/down-quark mass $m_{q=u/d}$ in the isoscalar scalar channel from both the Shifman-Vainshtein-Zakharov (SVZ) and the Monte-Carlo-based QCD sum rules. The relevant spectral function, including the contributions from the $f_0(500)$, $f_0(980)$ and $f_0(1370)$ resonances, is determined from a sophisticated $U(3)$ chiral study. Via the traditional SVZ QCD sum rules, we give the prediction to the average light-quark mass $m_q(2 \, \text{GeV})=\frac{1}{2}(m_u(2 \, \text{GeV}) + m_d(2 \, \text{GeV}))=(3.46^{+0.16}_{-0.22} \pm 0.33) \, \text{MeV}$. Meanwhile, by considering the uncertainties of the input QCD parameters and the spectral functions of the isoscalar scalar channel, we obtain $m_q (2\, \text{GeV}) = (3.44 \pm 0.14 \pm 0.32) \, \text{MeV}$ from the Monte-Carlo-based QCD sum rules. Both results are perfectly consistent with each other, and nicely agree with the Particle Data Group value within the uncertainties.


title: On the definition of the domain growth rate constant on a two dimensional substrate

abstract: In chemical vapor deposition (CVD) methods, the domain grows by attachment of diffusing surface bound species on the substrate to an island of solid domain. We formulate the process of single domain growth under two-dimensional diffusion by taking into account the movement of the domain boundary. We first discuss two types of definition of the domain area growth rate constant; the one defined through the domain size divided by the time duration of CVD growth and the other defined through the area divided by time. Then, we show that the domain size is proportional to time for the reaction limited growth and the domain area is proportional to time for the diffusion limited growth. We also show that the domain area growth rate changes from the reaction limited growth to the diffusion limited growth as the domain size increases beyond a characteristic size.


title: Maximal Branching Processes in Random Environment

abstract: The work continues the author's many-year research in theory of maximal branching processes, which are obtained from classical branching processes by replacing the summation of descendant numbers with taking the maximum. One can say that in each generation, descendants of only one particle survive, namely those of the particle that has the largest number of descendants. Earlier, the author generalized processes with integer values to processes with arbitrary nonnegative values, investigated their properties, and proved limit theorems. Then processes with several types of particles were introduced and studied. In the present paper we introduce the notion of maximal branching processes in random environment (with a single type of particles) and an important case of a "power-law" random environment. In the latter case, properties of maximal branching processes are studied and the ergodic theorem is proved. As applications, we consider gated infinite-server queues.


title: On Training Sketch Recognizers for New Domains

abstract: Sketch recognition algorithms are engineered and evaluated using publicly available datasets contributed by the sketch recognition community over the years. While existing datasets contain sketches of a limited set of generic objects, each new domain inevitably requires collecting new data for training domain specific recognizers. This gives rise to two fundamental concerns: First, will the data collection protocol yield ecologically valid data? Second, will the amount of collected data suffice to train sufficiently accurate classifiers? In this paper, we draw attention to these two concerns. We show that the ecological validity of the data collection protocol and the ability to accommodate small datasets are significant factors impacting recognizer accuracy in realistic scenarios. More specifically, using sketch-based gaming as a use case, we show that deep learning methods, as well as more traditional methods, suffer significantly from dataset shift. Furthermore, we demonstrate that in realistic scenarios where data is scarce and expensive, standard measures taken for adapting deep learners to small datasets fall short of comparing favorably with alternatives. Although transfer learning, and extensive data augmentation help deep learners, they still perform significantly worse compared to standard setups (e.g., SVMs and GBMs with standard feature representations). We pose learning from small datasets as a key problem for the deep sketch recognition field, one which has been ignored in the bulk of the existing literature.


title: The initial boundary value problem in General Relativity: the umbilic case

abstract: We give a short proof of local well-posedness for the initial boundary value problem in general relativity with sole boundary condition the requirement that the boundary is umbilic. This includes as a special case the totally geodesic boundary condition that we had previously addressed in [8]. The proof is based on wave coordinates and the key observation that the momentum constraint is always valid for umbilic boundaries. This allows for a greater freedom in the choice of boundary conditions, since imposing the umbilic condition also provides Neumann boundary conditions for three of the four wave coordinates conditions. Moreover, the umbilic condition, being geometric, implies that geometric uniqueness in the sense of Friedrich holds in this specific case.


title: Let's See Clearly: Contaminant Artifact Removal for Moving Cameras

abstract: Contaminants such as dust, dirt and moisture adhering to the camera lens can greatly affect the quality and clarity of the resulting image or video. In this paper, we propose a video restoration method to automatically remove these contaminants and produce a clean video. Our approach first seeks to detect attention maps that indicate the regions that need to be restored. In order to leverage the corresponding clean pixels from adjacent frames, we propose a flow completion module to hallucinate the flow of the background scene to the attention regions degraded by the contaminants. Guided by the attention maps and completed flows, we propose a recurrent technique to restore the input frame by fetching clean pixels from adjacent frames. Finally, a multi-frame processing stage is used to further process the entire video sequence in order to enforce temporal consistency. The entire network is trained on a synthetic dataset that approximates the physical lighting properties of contaminant artifacts. This new dataset and our novel framework lead to our method that is able to address different contaminants and outperforms competitive restoration approaches both qualitatively and quantitatively.


title: Topology of critical chiral phases: multiband insulators and superconductors

abstract: Recent works have proved the existence of symmetry-protected edge states in certain one-dimensional topological band insulators and superconductors at the gap-closing points which define quantum phase transitions between two topologically nontrivial phases. We show how this picture generalizes to multiband critical models belonging to any of the chiral symmetry classes AIII, BDI, or CII of noninteracting fermions in one dimension.


title: An Improved Discriminative Optimization for 3D Rigid Point Cloud Registration

abstract: The Discriminative Optimization (DO) algorithm has been proved much successful in 3D point cloud registration. In the original DO, the feature (descriptor) of two point cloud was defined as a histogram, and the element of histogram indicates the weights of scene points in "front" or "back" side of a model point. In this paper, we extended the histogram which indicate the sides from "front-back" to "front-back", "up-down", and "clockwise-anticlockwise". In addition, we reweighted the extended histogram according to the model points' distribution. We evaluated the proposed Improved DO on the Stanford Bunny and Oxford SensatUrban dataset, and compared it with six classical State-Of-The-Art point cloud registration algorithms. The experimental result demonstrates our algorithm achieves comparable performance in point registration accuracy and root-mean-sqart-error.


title: Sums of products of Bessel functions and order derivatives of Bessel functions

abstract: In this paper, sums represented in (3) are studied. The expressions are derived in terms of Bessel functions of the first and second kinds and their integrals. Further, we point out the integrals can be written as a Meijer G function.