title: Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements

abstract: Natural language descriptions of user interface (UI) elements such as alternative text are crucial for accessibility and language-based interaction in general. Yet, these descriptions are constantly missing in mobile UIs. We propose widget captioning, a novel task for automatically generating language descriptions for UI elements from multimodal input including both the image and the structural representations of user interfaces. We collected a large-scale dataset for widget captioning with crowdsourcing. Our dataset contains 162,859 language phrases created by human workers for annotating 61,285 UI elements across 21,750 unique UI screens. We thoroughly analyze the dataset, and train and evaluate a set of deep model configurations to investigate how each feature modality as well as the choice of learning strategies impact the quality of predicted captions. The task formulation and the dataset as well as our benchmark models contribute a solid basis for this novel multimodal captioning task that connects language and user interfaces.


title: CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning

abstract: Despite recent successes of reinforcement learning (RL), it remains a challenge for agents to transfer learned skills to related environments. To facilitate research addressing this problem, we propose CausalWorld, a benchmark for causal structure and transfer learning in a robotic manipulation environment. The environment is a simulation of an open-source robotic platform, hence offering the possibility of sim-to-real transfer. Tasks consist of constructing 3D shapes from a given set of blocks - inspired by how children learn to build complex structures. The key strength of CausalWorld is that it provides a combinatorial family of such tasks with common causal structure and underlying factors (including, e.g., robot and object masses, colors, sizes). The user (or the agent) may intervene on all causal variables, which allows for fine-grained control over how similar different tasks (or task distributions) are. One can thus easily define training and evaluation distributions of a desired difficulty level, targeting a specific form of generalization (e.g., only changes in appearance or object mass). Further, this common parametrization facilitates defining curricula by interpolating between an initial and a target task. While users may define their own task distributions, we present eight meaningful distributions as concrete benchmarks, ranging from simple to very challenging, all of which require long-horizon planning as well as precise low-level motor control. Finally, we provide baseline results for a subset of these tasks on distinct training curricula and corresponding evaluation protocols, verifying the feasibility of the tasks in this benchmark.


title: Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task

abstract: The quality of machine translation systems has dramatically improved over the last decade, and as a result, evaluation has become an increasingly challenging problem. This paper describes our contribution to the WMT 2020 Metrics Shared Task, the main benchmark for automatic evaluation of translation. We make several submissions based on BLEURT, a previously published metric based on transfer learning. We extend the metric beyond English and evaluate it on 14 language pairs for which fine-tuning data is available, as well as 4 "zero-shot" language pairs, for which we have no labelled examples. Additionally, we focus on English to German and demonstrate how to combine BLEURT's predictions with those of YiSi and use alternative reference translations to enhance the performance. Empirical results show that the models achieve competitive results on the WMT Metrics 2019 Shared Task, indicating their promise for the 2020 edition.


title: The Hidden Scalar Lagrangians within Horndeski Theory

abstract: In this essay I show that there exists a new way to obtain scalar-tensor field theories by combining a special scalar field on the tangent bundle of a four-dimensional manifold with a scalar field on that manifold. These two scalar fields act as a generating function for the metric tensor. When using these two scalar fields in the Horndeski Lagrangians, we discover, while seeking Friedmann-Lemaitre-Robertson-Walker type cosmological solutions, that hidden in the Horndeski Lagrangians are non-degenerate second-order scalar Lagrangians. In accordance with Ostrogradsky's work, these hidden scalar Lagrangians lead to multiple vacuum solutions, and thereby predict the existence of a multiverse. The multiverse is comprised of numerous different types of individual universes. E.g., some begin explosively, and then coast along exponentially forever at an accelerated rate, while some begin in that manner, and then stop expanding and contract to their original initial stage.


title: Optimal quantum spatial search with one-dimensional long-range interactions

abstract: Continuous-time quantum walks can be used to solve the spatial search problem, which is an essential component for many quantum algorithms that run quadratically faster than their classical counterpart, in $\mathcal O(\sqrt n)$ time for $n$ entries. However the capability of models found in nature is largely unexplored - e.g., in one dimension only nearest-neighbour Hamiltonians have been considered so far, for which the quadratic speedup does not exist. Here, we prove that optimal spatial search, namely with $\mathcal O(\sqrt n)$ run time and large fidelity, is possible in one-dimensional spin chains with long-range interactions that decay as $1/r^\alpha$ with distance $r$. In particular, near unit fidelity is achieved for $\alpha\approx 1$ and, in the limit $n\to\infty$, we find a continuous transition from a region where optimal spatial search does exist ($\alpha<1.5$) to where it does not ($\alpha>1.5$). Numerically, we show that spatial search is robust to dephasing noise and that, for realistic conditions, $\alpha \lesssim 1.2$ should be sufficient to demonstrate optimal spatial search experimentally with near unit fidelity.


title: The impact of applying WildCards to disabled modules for FTK pattern banks on efficiency and data flow

abstract: Online selection is an essential step to collect the most relevant collisions from the very large number of collisions inside the ATLAS detector at the Large Hadron Collider (LHC). The Fast TracKer (FTK) is a hardware based track finder, built to greatly improve the ATLAS trigger system capabilities for identifying interesting physics processes through track-based signatures. The FTK is reconstructing after each Level-1 trigger all tracks with $ p_{\textrm T}>1 $ GeV, such that the high-level trigger system gains access to track information at an early stage. FTK track reconstruction starts with a pattern recognition step. Patterns are found with hits in seven out of eight possible detector layers. Disabled detector modules, as often encountered during LHC operation, lead to efficiency losses. To recover efficiency, WildCards (WC) algorithms are implemented in the FTK system. The WC algorithm recovers inefficiency but also causes high combinatorial background and thus increased data volumes in the FTK system, possibly exceeding hardware limitations. To overcome this, a refined algorithm to select patterns is developed and investigated in this article.


title: Non-Attentive Tacotron: Robust and Controllable Neural TTS Synthesis Including Unsupervised Duration Modeling

abstract: This paper presents Non-Attentive Tacotron based on the Tacotron 2 text-to-speech model, replacing the attention mechanism with an explicit duration predictor. This improves robustness significantly as measured by unaligned duration ratio and word deletion rate, two metrics introduced in this paper for large-scale robustness evaluation using a pre-trained speech recognition model. With the use of Gaussian upsampling, Non-Attentive Tacotron achieves a 5-scale mean opinion score for naturalness of 4.41, slightly outperforming Tacotron 2. The duration predictor enables both utterance-wide and per-phoneme control of duration at inference time. When accurate target durations are scarce or unavailable in the training data, we propose a method using a fine-grained variational auto-encoder to train the duration predictor in a semi-supervised or unsupervised manner, with results almost as good as supervised training.


title: Masked ELMo: An evolution of ELMo towards fully contextual RNN language models

abstract: This paper presents Masked ELMo, a new RNN-based model for language model pre-training, evolved from the ELMo language model. Contrary to ELMo which only uses independent left-to-right and right-to-left contexts, Masked ELMo learns fully bidirectional word representations. To achieve this, we use the same Masked language model objective as BERT. Additionally, thanks to optimizations on the LSTM neuron, the integration of mask accumulation and bidirectional truncated backpropagation through time, we have increased the training speed of the model substantially. All these improvements make it possible to pre-train a better language model than ELMo while maintaining a low computational cost. We evaluate Masked ELMo by comparing it to ELMo within the same protocol on the GLUE benchmark, where our model outperforms significantly ELMo and is competitive with transformer approaches.


title: How Can Self-Attention Networks Recognize Dyck-n Languages?

abstract: We focus on the recognition of Dyck-n ($\mathcal{D}_n$) languages with self-attention (SA) networks, which has been deemed to be a difficult task for these networks. We compare the performance of two variants of SA, one with a starting symbol (SA$^+$) and one without (SA$^-$). Our results show that SA$^+$ is able to generalize to longer sequences and deeper dependencies. For $\mathcal{D}_2$, we find that SA$^-$ completely breaks down on long sequences whereas the accuracy of SA$^+$ is 58.82$\%$. We find attention maps learned by $\text{SA}{^+}$ to be amenable to interpretation and compatible with a stack-based language recognizer. Surprisingly, the performance of SA networks is at par with LSTMs, which provides evidence on the ability of SA to learn hierarchies without recursion.


title: Learning to Locomote: Understanding How Environment Design Matters for Deep Reinforcement Learning

abstract: Learning to locomote is one of the most common tasks in physics-based animation and deep reinforcement learning (RL). A learned policy is the product of the problem to be solved, as embodied by the RL environment, and the RL algorithm. While enormous attention has been devoted to RL algorithms, much less is known about the impact of design choices for the RL environment. In this paper, we show that environment design matters in significant ways and document how it can contribute to the brittle nature of many RL results. Specifically, we examine choices related to state representations, initial state distributions, reward structure, control frequency, episode termination procedures, curriculum usage, the action space, and the torque limits. We aim to stimulate discussion around such choices, which in practice strongly impact the success of RL when applied to continuous-action control problems of interest to animation, such as learning to locomote.


title: Neural Networks as Functional Classifiers

abstract: In recent years, there has been considerable innovation in the world of predictive methodologies. This is evident by the relative domination of machine learning approaches in various classification competitions. While these algorithms have excelled at multivariate problems, they have remained dormant in the realm of functional data analysis. We extend notable deep learning methodologies to the domain of functional data for the purpose of classification problems. We highlight the effectiveness of our method in a number of classification applications such as classification of spectrographic data. Moreover, we demonstrate the performance of our classifier through simulation studies in which we compare our approach to the functional linear model and other conventional classification methods.


title: Program Controls Effectiveness Measurement Framework & Metrics

abstract: Any program that is designed to accomplish certain objectives, needs to establish program level controls pertaining to the overall goal. A critical aspect that determines the success of a program is the quality of the controls and their effectiveness in accomplishing the goal. Traditional Control Maturity Models primarily focus on the efficiency, management, and optimization of controls, while only indirectly measuring control effectiveness which neglects an essential aspect of control efficacy. In this paper, we highlight the ineffectiveness of these models, outline an adaptable program controls framework, and provide an approach to define measurable attributes (metrics) that enable a zero-defect program. To the best of our knowledge, we believe this is the first paper that provides a structured approach to defining a controls measurement framework and creation of effectiveness metrics that can be adopted by a variety of program use cases.


title: Band Assignment in Ultra-Narrowband (UNB) Systems for Massive IoT Access

abstract: In this work, we consider a novel type of Internet of Things (IoT) ultra-narrowband (UNB) network architecture that involves multiple multiplexing bands or channels for uplink transmission. An IoT device can randomly choose any of the multiplexing bands and transmit its packet. Due to hardware constraints, a base station (BS) is able to listen to only one multiplexing band. The hardware constraint is mainly due to the complexity of performing fast Fourier transform (FFT) at a very small sampling interval over the multiplexing bands in order to counter the uncertainty of IoT device frequency and synchronize onto transmissions. The objective is to find an assignment of BSs to multiplexing bands in order to maximize the packet decoding probability (PDP). We develop a learning-based algorithm based on a sub-optimal solution to PDP maximization. The simulation results show that our approach to band assignment achieves near-optimal performance in terms of PDP, while at the same time, significantly exceeding the performance of random assignment. We also develop a heuristic algorithm with no learning overhead based on the locations of the BSs that also outperforms random assignment and serves as a performance reference to our learning-based algorithm.


title: Addressing the Real-world Class Imbalance Problem in Dermatology

abstract: Class imbalance is a common problem in medical diagnosis, causing a standard classifier to be biased towards the common classes and perform poorly on the rare classes. This is especially true for dermatology, a specialty with thousands of skin conditions but many of which have low prevalence in the real world. Motivated by recent advances, we explore few-shot learning methods as well as conventional class imbalance techniques for the skin condition recognition problem and propose an evaluation setup to fairly assess the real-world utility of such approaches. We find the performance of few-show learning methods does not reach that of conventional class imbalance techniques, but combining the two approaches using a novel ensemble improves model performance, especially for rare classes. We conclude that ensembling can be useful to address the class imbalance problem, yet progress can further be accelerated by real-world evaluation setups for benchmarking new methods.


title: Lifespan of solutions to the Strauss type wave system on asymptotically flat space-times

abstract: By assuming certain local energy estimates on $(1+3)$-dimensional asymptotically flat space-time, we study the existence portion of the \emph{Strauss} type wave system. Firstly we give a kind of space-time estimates which are related to the local energy norm that appeared in \cite{MR2944027}. These estimates can be used to prove a series of weighted \emph{Strichartz} and \emph{KSS} type estimates, for wave equations on asymptotically flat space-time. Then we apply the space-time estimates to obtain the lower bound of the lifespan when the nonlinear exponents $p$ and $q\ge 2$. In particular, our bound for the subcritical case is sharp in general and we extend the known region of $(p,q)$ to admit global solutions. In addition, the initial data are not required to be compactly supported, when $p, q>2$.


title: Shi variety corresponding to an affine Weyl group

abstract: Let $W$ be an irreducible Weyl group and $W_a$ its affine Weyl group. In this article we show that there exists a bijection between $W_a$ and the integral points of an affine variety, denoted $\widehat{X}_{W_a}$, which we call the Shi variety of $W_a$. In order to do so, we use Jian-Yi Shi's characterization of alcoves in affine Weyl groups. We then study this variety further. We highlight combinatorial properties of the irreducible components of $\widehat{X}_{W_a}$ and we show how they are related to a fundamental parallelepiped $P_{\mathcal{H}}$.


title: Decreasing the Surgical Errors by Neurostimulation of Primary Motor Cortex and the Associated Brain Activation via Neuroimaging

abstract: Acquisition of fine motor skills is a time-consuming process as it requires frequent repetitions. Transcranial electrical stimulation is a promising means of enhancing simple motor skill development via neuromodulatory mechanisms. Here, we report that non-invasive neurostimulation facilitates the learning of complex fine bimanual motor skills associated with a surgical task. During the training of 17 medical students on the Fundamentals of Laparoscopic Surgery (FLS) pattern cutting task over a period of 12 days, we observed that transcranial direct current stimulation (tDCS) decreased the error level and the variability in performance, compared to the Sham group. By concurrently monitoring the cortical activations of the subjects via functional near-infrared spectroscopy (fNIRS), our study showed that the cortical activation significantly stimulated by tDCS. The lowered performance error and the increased brain activation were retained after one-month post-training. This work supports the use of tDCS to enhance performance accuracy in fine bimanual motor tasks.


title: Proactive Serverless Function Resource Management

abstract: This paper introduces a new primitive to serverless language runtimes called freshen. With freshen, developers or providers specify functionality to perform before a given function executes. This proactive technique allows for overheads associated with serverless functions to be mitigated at execution time, which improves function responsiveness. We show various predictive opportunities exist to run freshen within reasonable time windows. A high-level design and implementation are described, along with preliminary results to show the potential benefits of our scheme.


title: Collision Prediction from UWB Range Measurements

abstract: The ability to predict, and thus react to, oncoming collisions among a set of mobile agents is a fundamental requirement for safe autonomous movement, both human and robotic. This paper addresses systems that use range measurements between mobile agents for the purpose of collision prediction, which involves prediction of the agents' future paths to know if they will collide at any time. One straightforward system would use known-location static anchors to estimate agent coordinates over time, and use the track to predict collision. Fundamentally, no fixed coordinate system is required for collision prediction, so using only the pairwise range between two agents can be used to predict collision. We present lower bound analysis which shows the limitations of this pairwise method. As an alternative anchor-free method, we propose the friend-based autonomous collision prediction and tracking (FACT) method that uses all measured ranges between nearby (unknown location mobile) agents, in a distributed algorithm, to estimate their relative locations and velocities and predict future collisions between agents. Using analysis and simulation, we show the potential for FACT to achieve equal or better collision detection performance compared to other methods, while avoiding the need for anchors. We then build a network of $N$ ultra wideband (UWB) devices and an efficient multi-node protocol which allows all ${\cal O}(N^2)$ pairwise ranges to be measured in $N$ slots. We run experiments with up to six independent robot agents moving and colliding in a 2D plane and up to four anchor nodes to compare the performance of the collision prediction methods. We show that the FACT method can perform better than either other method but without the need for a fixed infrastructure of anchor nodes.


title: Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learning

abstract: Document-level neural machine translation has yielded attractive improvements. However, majority of existing methods roughly use all context sentences in a fixed scope. They neglect the fact that different source sentences need different sizes of context. To address this problem, we propose an effective approach to select dynamic context so that the document-level translation model can utilize the more useful selected context sentences to produce better translations. Specifically, we introduce a selection module that is independent of the translation module to score each candidate context sentence. Then, we propose two strategies to explicitly select a variable number of context sentences and feed them into the translation module. We train the two modules end-to-end via reinforcement learning. A novel reward is proposed to encourage the selection and utilization of dynamic context sentences. Experiments demonstrate that our approach can select adaptive context sentences for different source sentences, and significantly improves the performance of document-level translation methods.


title: Sparse Spectrum Warped Input Measures for Nonstationary Kernel Learning

abstract: We establish a general form of explicit, input-dependent, measure-valued warpings for learning nonstationary kernels. While stationary kernels are ubiquitous and simple to use, they struggle to adapt to functions that vary in smoothness with respect to the input. The proposed learning algorithm warps inputs as conditional Gaussian measures that control the smoothness of a standard stationary kernel. This construction allows us to capture non-stationary patterns in the data and provides intuitive inductive bias. The resulting method is based on sparse spectrum Gaussian processes, enabling closed-form solutions, and is extensible to a stacked construction to capture more complex patterns. The method is extensively validated alongside related algorithms on synthetic and real world datasets. We demonstrate a remarkable efficiency in the number of parameters of the warping functions in learning problems with both small and large data regimes.


title: Uniqueness of weakly reversible and deficiency zero realizations of dynamical systems

abstract: A reaction network together with a choice of rate constants uniquely gives rise to a system of differential equations, according to the law of mass-action kinetics. On the other hand, different networks can generate the same dynamical system under mass-action kinetics. Therefore, the problem of identifying "the" underlying network of a dynamical system is not well-posed, in general. Here we show that the problem of identifying an underlying weakly reversible deficiency zero network is well-posed, in the sense that the solution is unique whenever it exists. This can be very useful in applications because from the perspective of both dynamics and network structure, a weakly reversibly deficiency zero ($\textit{WR}_\textit{0}$) realization is the simplest possible one. Moreover, while mass-action systems can exhibit practically any dynamical behavior, including multistability, oscillations, and chaos, $WR_0$ systems are remarkably stable for any choice of rate constants: they have a unique positive steady state within each invariant polyhedron, and cannot give rise to oscillations or chaotic dynamics. We also prove that both of our hypotheses (i.e., weak reversibility and deficiency zero) are necessary for uniqueness.


title: The Cohen-Macaulay Property of $f$-ideals

abstract: For positive integers $d<n$, let $[n]_d=\{A\in 2^{[n]}\mid |A|=d\}$ where $[n]=:\{1,2,\ldots, n\}$. For a pure $f$-simplicial complex $\Delta$ such that ${\rm dim}(\Delta)={\rm dim}(\Delta^c)$ and $\mathcal{F}(\Delta)\cap \mathcal{F}(\Delta^c)=\emptyset$, we prove that the facet ideal $I(\Delta)$ is Cohen-Macaulay if and only if it has linear resolution. For a $d$-dimensional pure $f$-simplicial complex $\Delta$ such that $\Delta'=:\langle F\mid F\in [n]_d\smallsetminus \mathcal F(\Delta)\rangle$ is an $f$-simplicial complex, we prove that $I(\Delta^c)$ is Cohen-Macaulay if and only if $I(\Delta')$ has linear resolution.


title: Monopoles and Landau-Ginzburg Models III: A Gluing Theorem

abstract: This is the third paper of this series. In \cite{Wang20}, we defined the monopole Floer homology for any pair $(Y,\omega)$, where $Y$ is a compact oriented 3-manifold with toroidal boundary and $\omega$ is a suitable closed 2-form viewed as a decoration. In this paper, we establish a gluing theorem for this Floer homology when two such 3-manifolds are glued suitably along their common boundary, assuming that $\partial Y$ is disconnected, and $\omega$ is small and yet non-vanishing on $\partial Y$. As applications, we construct a monopole Floer 2-functor and the generalized cobordism maps. Using results of Kronheimer-Mrowka and Ni, it is shown that for any such 3-manifold $Y$ that is irreducible, this Floer homology detects the Thurston norm on $H_2(Y,\partial Y;\mathbb{R})$ and the fiberness of $Y$. Finally, we show that our construction recovers the monopole link Floer homology for any link inside a closed 3-manifold.


title: On a variance associated with the distribution of $r_3(n)$ in arithmetic progressions

abstract: There are two questions in analytic number theory which have attracted much attention over the years. The first one is about the asymptotic formula for the variance associated with the distribution of a real sequence in arithmetic progressions, which origins in the work of Barban. The second one is about the function $r_3(n)$, the number of ordered representation of $n$ in the sum of three positive cubes, and several results are recently proved by Robert C. Vaughan. The paper is concerned with the conjunction of these questions, with the application of the Hardy-Littlewood Method and the Farey sequence.


title: The correspondence induced on the pillowcase by the earring tangle

abstract: The earring tangle consists of four strands 4pt x [0,1] inside S^2 x [0,1] and one meridian around one of the strands. Equipping this tangle with a nontrivial SO(3) bundle, we show that its traceless SU(2) flat moduli space is topologically a smooth genus three surface. We also show that the restriction map from this surface to the traceless flat moduli space of the boundary of the earring tangle is a particular Lagrangian immersion into the product of two pillowcases. The latter computation suggests that figure eight bubbling -- a subtle degeneration phenomenon predicted by Bottman and Wehrheim -- appears in the context of traceless character varieties.


title: Analyzing HPC Support Tickets: Experience and Recommendations

abstract: High performance computing (HPC) user support teams are the first line of defense against large-scale problems, as they are often the first to learn of problems reported by users. Developing tools to better assist support teams in solving user problems and tracking issue trends is critical for maintaining system health. Our work examines the Los Alamos National Laboratory HPC Consult Team's user support ticketing system and develops proof of concept tools to automate tasks such as category assignment and similar ticket recommendation. We also generate new categories for reporting and discuss ideas to improve future ticketing systems.


title: Rhythmic Control of Automated Traffic -- Part I: Concept and Properties at Isolated Intersections

abstract: Leveraging the accuracy and consistency of vehicle motion control enabled by the connected and automated vehicle technology, we propose the rhythmic control (RC) scheme that allows vehicles to pass through an intersection in a conflict-free manner with a preset rhythm. The rhythm enables vehicles to proceed at a constant speed without any stop. The RC is capable of breaking the limitation that right of way can only be allocated to non-conflicting movements at a time. It significantly improves the performance of intersection control for automated traffic. Moreover, the RC with a predetermined rhythm does not require intensive computational efforts to dynamically control vehicles, which may possibly lead to frequent accelerations or decelerations. Assuming stationary vehicle arrivals, we conduct theoretical investigation to show that RC can considerably increase intersection capacity and reduce vehicle delay. Finally, the performance of RC is tested in the simulations with both stationary and non-stationary vehicle arrivals at both symmetric and asymmetric intersections.


title: Isoenergetic Two-Photon Excitation Enhances Solvent-to-Solute Excited-State Proton Transfer

abstract: Two-photon excitation is an attractive means for controlling chemistry in both space and time. Isoenergetic one- and two-photon excitations (OPE and TPE) in non-centrosymmetric molecules are often assumed to reach the same excited state and, hence, to produce similar excited-state reactivity. We compare the solvent-to-solute excited-state proton transfer of the super photobase FR0-SB following isoenergetic OPE and TPE. We find up to 62 % increased reactivity following TPE compared to OPE. From steady-state spectroscopy, we rule out the involvement of different excited states and find that OPE and TPE spectra are identical in non-polar solvents but not in polar ones. We propose that differences in the matrix elements that contribute to the two-photon absorption cross sections lead to the observed enhanced isoenergetic reactivity, consistent with the predictions of our high-level coupled-cluster-based computational protocol. We find that polar solvent configurations favor greater dipole moment change between ground and excited states, which enters the probability for two-photon excitations as the absolute value squared. This, in turn, causes a difference in the Franck-Condon region reached via TPE compared to OPE. We conclude that a new method has been found for controlling chemical reactivity via the matrix elements that affect two-photon cross sections, which may be of great utility for spatial and temporal precision chemistry.


title: Deep-Masking Generative Network: A Unified Framework for Background Restoration from Superimposed Images

abstract: Restoring the clean background from the superimposed images containing a noisy layer is the common crux of a classical category of tasks on image restoration such as image reflection removal, image deraining and image dehazing. These tasks are typically formulated and tackled individually due to the diverse and complicated appearance patterns of noise layers within the image. In this work we present the Deep-Masking Generative Network (DMGN), which is a unified framework for background restoration from the superimposed images and is able to cope with different types of noise. Our proposed DMGN follows a coarse-to-fine generative process: a coarse background image and a noise image are first generated in parallel, then the noise image is further leveraged to refine the background image to achieve a higher-quality background image. In particular, we design the novel Residual Deep-Masking Cell as the core operating unit for our DMGN to enhance the effective information and suppress the negative information during image generation via learning a gating mask to control the information flow. By iteratively employing this Residual Deep-Masking Cell, our proposed DMGN is able to generate both high-quality background image and noisy image progressively. Furthermore, we propose a two-pronged strategy to effectively leverage the generated noise image as contrasting cues to facilitate the refinement of the background image. Extensive experiments across three typical tasks for image background restoration, including image reflection removal, image rain steak removal and image dehazing, show that our DMGN consistently outperforms state-of-the-art methods specifically designed for each single task.


title: Minimal Specifications for Non-Human Primate MRI: Challenges in Standardizing and Harmonizing Data Collection

abstract: Recent methodological advances in MRI have enabled substantial growth in neuroimaging studies of non-human primates (NHPs), while open data-sharing through the PRIME-DE initiative has increased the availability of NHP MRI data and the need for robust multi-subject multi-center analyses. Streamlined acquisition and analysis protocols would accelerate and improve these efforts. However, consensus on minimal standards for data acquisition protocols and analysis pipelines for NHP imaging remains to be established, particularly for multi-center studies. Here, we draw parallels between NHP and human neuroimaging and provide minimal guidelines for harmonizing and standardizing data acquisition. We advocate robust translation of widely used open-access toolkits that are well established for analyzing human data. We also encourage the use of validated, automated pre-processing tools for analyzing NHP data sets. These guidelines aim to refine methodological and analytical strategies for small and large-scale NHP neuroimaging data. This will improve reproducibility of results, and accelerate the convergence between NHP and human neuroimaging strategies which will ultimately benefit fundamental and translational brain science.


title: Handling Imbalanced Data: A Case Study for Binary Class Problems

abstract: For several years till date, the major issues in terms of solving for classification problems are the issues of Imbalanced data. Because majority of the machine learning algorithms by default assumes all data are balanced, the algorithms do not take into consideration the distribution of the data sample class. The results tend to be unsatisfactory and skewed towards the majority sample class distribution. This implies that the consequences as a result of using a model built using an Imbalanced data without handling for the Imbalance in the data could be misleading both in practice and theory. Most researchers have focused on the application of Synthetic Minority Oversampling Technique (SMOTE) and Adaptive Synthetic (ADASYN) Sampling Approach in handling data Imbalance independently in their works and have failed to better explain the algorithms behind these techniques with computed examples. This paper focuses on both synthetic oversampling techniques and manually computes synthetic data points to enhance easy comprehension of the algorithms. We analyze the application of these synthetic oversampling techniques on binary classification problems with different Imbalanced ratios and sample sizes.


title: Bias and Variance of Post-processing in Differential Privacy

abstract: Post-processing immunity is a fundamental property of differential privacy: it enables the application of arbitrary data-independent transformations to the results of differentially private outputs without affecting their privacy guarantees. When query outputs must satisfy domain constraints, post-processing can be used to project the privacy-preserving outputs onto the feasible region. Moreover, when the feasible region is convex, a widely adopted class of post-processing steps is also guaranteed to improve accuracy. Post-processing has been applied successfully in many applications including census data-release, energy systems, and mobility. However, its effects on the noise distribution is poorly understood: It is often argued that post-processing may introduce bias and increase variance. This paper takes a first step towards understanding the properties of post-processing. It considers the release of census data and examines, both theoretically and empirically, the behavior of a widely adopted class of post-processing functions.


title: HydroDeep -- A Knowledge Guided Deep Neural Network for Geo-Spatiotemporal Data Analysis

abstract: Due to limited evidence and complex causes of regional climate change, the confidence in predicting fluvial floods remains low. Understanding the fundamental mechanisms intrinsic to geo-spatiotemporal information is crucial to improve the prediction accuracy. This paper demonstrates a hybrid neural network architecture - HydroDeep, that couples a process-based hydro-ecological model with a combination of Deep Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) Network. HydroDeep outperforms the independent CNN's and LSTM's performance by 1.6% and 10.5% respectively in Nash-Sutcliffe efficiency. Also, we show that HydroDeep pre-trained in one region is adept at passing on its knowledge to distant places via unique transfer learning approaches that minimize HydroDeep's training duration for a new region by learning its regional geo-spatiotemporal features in a reduced number of iterations.


title: Constructions of MDS symbol-pair codes with minimum distance seven or eight

abstract: Symbol-pair codes are proposed to guard against pair-errors in symbol-pair read channels. The minimum symbol-pair distance plays a vital role in determining the error-correcting capability and the constructions of symbol-pair codes with largest possible minimum symbol-pair distance is of great importance. Maximum distance separable (\,MDS\,) symbol-pair codes are optimal in the sense that such codes can acheive the Singleton bound. In this paper, for length $5p$, two new classes of MDS symbol-pair codes with minimum symbol-pair distance seven or eight are constructed by utilizing repeated-root cyclic codes over $\mathbb{F}_{p}$, where $p$ is a prime. In addition, we derive a class of MDS symbol-pair codes with minimum symbol-pair distance seven and length $4p$.


title: Confinement on $\mathbb{R}^3 \times \mathbb{S}^1$ and Double-String Collapse

abstract: We study confining strings in ${\cal{N}}=1$ supersymmetric $SU(N_c)$ Yang-Mills theory in the semiclassical regime on $\mathbb{R}^{1,2} \times \mathbb{S}^1$. Static quarks are expected to be confined by double strings composed of two domain walls - which are lines in $\mathbb{R}^2$ - rather than by a single flux tube. Each domain wall carries part of the quarks' chromoelectric flux. We numerically study this mechanism and find that double-string confinement holds for strings of all $N$-alities, except for those between fundamental quarks. We show that, for $N_c \ge 5$, the two domain walls confining unit $N$-ality quarks attract and form non-BPS bound states, collapsing to a single flux line. We determine the $N$-ality dependence of the string tensions for $2 \le N_c \le 10$. Compared to known scaling laws, we find a weaker, almost flat $N$-ality dependence, which is qualitatively explained by the properties of BPS domain walls. We also quantitatively study the behavior of confining strings upon increasing the $\mathbb{S}^1$ size by including the effect of virtual "$W$-bosons" and show that the qualitative features of double-string confinement persist.


title: Targeted Physical-World Attention Attack on Deep Learning Models in Road Sign Recognition

abstract: Real world traffic sign recognition is an important step towards building autonomous vehicles, most of which highly dependent on Deep Neural Networks (DNNs). Recent studies demonstrated that DNNs are surprisingly susceptible to adversarial examples. Many attack methods have been proposed to understand and generate adversarial examples, such as gradient based attack, score based attack, decision based attack, and transfer based attacks. However, most of these algorithms are ineffective in real-world road sign attack, because (1) iteratively learning perturbations for each frame is not realistic for a fast moving car and (2) most optimization algorithms traverse all pixels equally without considering their diverse contribution. To alleviate these problems, this paper proposes the targeted attention attack (TAA) method for real world road sign attack. Specifically, we have made the following contributions: (1) we leverage the soft attention map to highlight those important pixels and skip those zero-contributed areas - this also helps to generate natural perturbations, (2) we design an efficient universal attack that optimizes a single perturbation/noise based on a set of training images under the guidance of the pre-trained attention map, (3) we design a simple objective function that can be easily optimized, (4) we evaluate the effectiveness of TAA on real world data sets. Experimental results validate that the TAA method improves the attack successful rate (nearly 10%) and reduces the perturbation loss (about a quarter) compared with the popular RP2 method. Additionally, our TAA also provides good properties, e.g., transferability and generalization capability. We provide code and data to ensure the reproducibility: https://github.com/AdvAttack/RoadSignAttack.


title: Langsmith: An Interactive Academic Text Revision System

abstract: Despite the current diversity and inclusion initiatives in the academic community, researchers with a non-native command of English still face significant obstacles when writing papers in English. This paper presents the Langsmith editor, which assists inexperienced, non-native researchers to write English papers, especially in the natural language processing (NLP) field. Our system can suggest fluent, academic-style sentences to writers based on their rough, incomplete phrases or sentences. The system also encourages interaction between human writers and the computerized revision system. The experimental results demonstrated that Langsmith helps non-native English-speaker students write papers in English. The system is available at https://emnlp-demo.editor. langsmith.co.jp/.


title: Succinct Navigational Oracles for Families of Intersection Graphs on a Circle

abstract: We consider the problem of designing succinct navigational oracles, i.e., succinct data structures supporting basic navigational queries such as degree, adjacency, and neighborhood efficiently for intersection graphs on a circle, which include graph classes such as {\it circle graphs}, {\it $k$-polygon-circle graphs}, {\it circle-trapezoid graphs}, {\it trapezoid graphs}. The degree query reports the number of incident edges to a given vertex, the adjacency query asks if there is an edge between two given vertices, and the neighborhood query enumerates all the neighbors of a given vertex. We first prove a general lower bound for these intersection graph classes and then present a uniform approach that lets us obtain matching lower and upper bounds for representing each of these graph classes. More specifically, our lower bound proofs use a unified technique to produce tight bounds for all these classes, and this is followed by our data structures which are also obtained from a unified representation method to achieve succinctness for each class. In addition, we prove a lower bound of space for representing {\it trapezoid} graphs and give a succinct navigational oracle for this class of graphs.


title: Convex Obstacles from Travelling Times

abstract: A construction is given for the recovery of a disjoint union of strictly convex smooth planar obstacles from travelling-time information. The obstacles are required to be such that no Euclidean line meets more than two of them.


title: NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training

abstract: We experiment with COVID-Twitter-BERT and RoBERTa models to identify informative COVID-19 tweets. We further experiment with adversarial training to make our models robust. The ensemble of COVID-Twitter-BERT and RoBERTa obtains a F1-score of 0.9096 (on the positive class) on the test data of WNUT-2020 Task 2 and ranks 1st on the leaderboard. The ensemble of the models trained using adversarial training also produces similar result.


title: An ensemble learning approach for software semantic clone detection

abstract: Code clone is a serious problem in software and has the potential to software defects, maintenance overhead, and licensing violations. Therefore, clone detection is important for reducing maintenance effort and improving code quality during software evolution. A variety of clone detection techniques have been proposed to identify similar code in software. However, few of them can efficiently detect semantic clones (functionally similar code without any syntactic resemblance). Recently, several deep learning based clone detectors are proposed to detect semantic clones. However, these approaches have high cost in data labelling and model training. In this paper, we propose a novel approach that leverages word embedding and ensemble learning techniques to detect semantic clones. Our evaluation on a commonly used clone benchmark, BigCloneBench, shows that our approach significantly improves the precision and recall of semantic clone detection, in comparison to a token-based clone detector, SourcererCC, and another deep learning based clone detector, CDLH.


title: Symmetrically Tuned Large-Volume Conic Shell-Cavities for Axion Searches

abstract: In an earlier paper, a new class of thin-shell cavities were proposed to evade the steep frequency scaling of conventional axion haloscopes. In this follow-up work, we see that a generalized conic geometry enables robust frequency-tuning for these large-volume cm-wave cavities. The frequency-defining dimension of a conic shell-cavity changes symmetrically and uniformly during tuning, maintaining a high axion coupling efficiency (the form factor) to an external solenoid field. It is further shown that such tunable geometry is not restricted to circular cones. A general prescription for arbitrary volume-filling conic shell-cavities is developed and direct solutions are obtained for the created numerical models. The largest of the realized designs is a meandering "brain" cavity that is tunable over a frequency range of 20%. The scan rate of this cavity is three orders of magnitude larger than that of a scaled cylindrical cavity used in the current generation experiments. The prospects for such a large improvement in the scan rate should motivate R & D efforts in fabrication and other implementation techniques. If these engineering challenges can be met, cavity-based axion haloscopes can stay competitive at frequencies higher than a few GHz. We propose an experimental configuration at 20 GHz (~ 80 $\mu$eV) using an array of brain cavities and compare it with other proposals for similar frequencies.


title: Higher-order Hermite-Gauss modes as a robust flat beam in interferometric gravitational wave detectors

abstract: Higher-order Laguerre-Gauss (LG) modes have previously been investigated as a candidate for reducing test-mass thermal noise in ground-based gravitational-wave detectors like Advanced LIGO. It has been shown however that LG modes' fragility against mirror surface figure imperfections limits their compatibility with the current state-of-the-art test masses. In this paper we explore the alternative of using higher-order Hermite-Gauss (HG) modes for thermal noise reduction, and show that with the deliberate addition of astigmatism they are orders of magnitude more robust against mirror surface distortions than LG modes of equivalent order. We present simulations of Advanced LIGO-like arm cavities with realistic mirror figures which can support HG$_{33}$ modes with average arm losses and contrast defects in a Fabry-Perot Michelson interferometer configuration which are well below the typical measured values in Advanced LIGO. This demonstrates that the mirror surface flatness errors will not be a limiting factor for the use of these modes in future gravitational-wave detectors.


title: MMGSD: Multi-Modal Gaussian Shape Descriptors for Correspondence Matching in 1D and 2D Deformable Objects

abstract: We explore learning pixelwise correspondences between images of deformable objects in different configurations. Traditional correspondence matching approaches such as SIFT, SURF, and ORB can fail to provide sufficient contextual information for fine-grained manipulation. We propose Multi-Modal Gaussian Shape Descriptor (MMGSD), a new visual representation of deformable objects which extends ideas from dense object descriptors to predict all symmetric correspondences between different object configurations. MMGSD is learned in a self-supervised manner from synthetic data and produces correspondence heatmaps with measurable uncertainty. In simulation, experiments suggest that MMGSD can achieve an RMSE of 32.4 and 31.3 for square cloth and braided synthetic nylon rope respectively. The results demonstrate an average of 47.7% improvement over a provided baseline based on contrastive learning, symmetric pixel-wise contrastive loss (SPCL), as opposed to MMGSD which enforces distributional continuity.


title: Genetic-algorithm-optimized neural networks for gravitational wave classification

abstract: Gravitational-wave detection strategies are based on a signal analysis technique known as matched filtering. Despite the success of matched filtering, due to its computational cost, there has been recent interest in developing deep convolutional neural networks (CNNs) for signal detection. Designing these networks remains a challenge as most procedures adopt a trial and error strategy to set the hyperparameter values. We propose a new method for hyperparameter optimization based on genetic algorithms (GAs). We compare six different GA variants and explore different choices for the GA-optimized fitness score. We show that the GA can discover high-quality architectures when the initial hyperparameter seed values are far from a good solution as well as refining already good networks. For example, when starting from the architecture proposed by George and Huerta, the network optimized over the 20-dimensional hyperparameter space has 78% fewer trainable parameters while obtaining an 11% increase in accuracy for our test problem. Using genetic algorithm optimization to refine an existing network should be especially useful if the problem context (e.g. statistical properties of the noise, signal model, etc) changes and one needs to rebuild a network. In all of our experiments, we find the GA discovers significantly less complicated networks as compared to the seed network, suggesting it can be used to prune wasteful network structures. While we have restricted our attention to CNN classifiers, our GA hyperparameter optimization strategy can be applied within other machine learning settings.


title: Interface-induced field-like optical spin torque in a ferromagnet/heavy metal heterostructure

abstract: The manipulation of magnetization in a metallic ferromagnet by using optical helicity has been much attracted attention for future opto-spintronic devices. The optical helicity induced torques on the magnetization, {\it optical spin torque}, have been observed in ferromagnetic thin films recently. However, the interfacial effect of the optical spin torque in ferromagnet/nonmagnetic heavy metal heterostructures have not been addressed so far, which are widely utilized to efficiently control magnetization via electrical means. Here, we studied optical spin torque vectors in the ferromagnet/nonmagnetic heavy metal heterostructures and observed that in-plane field-like optical spin torque was significantly increased with decreasing ferromagnetic layer thicknesses. The interfacial field-like optical spin torque was explained by the optical Rashba-Edelstein effect caused by the structural inversion symmetry breaking. This work will aid in the efficient optical manipulation of thin film nanomagnets using optical helicity.


title: Pseudo-time-reversal-symmetry-protected topological Bogoliubov excitations of Bose-Einstein condensates in optical lattices

abstract: Bogoliubov excitations of Bose-Einstein condensates in optical lattices may possess band topology in analogous to topological insulators in class AII of fermions. Using the language of the Krein-space theory, this topological property is shown to be protected by a pseudo-time-reversal symmetry that is pseudo-antiunitary and squares to $-1$, with the associated bulk topological invariant also being a $\mathbb Z_2$ index. We construct three equivalent expressions for it, relating to the Pfaffian, the pseudo-time-reversal polarization, and most practically, the Wannier center flow, all adopted from the fermionic case, defined here with respect to the pseudo inner product. In the presence of an additional pseudo-unitary and pseudo-Hermitian inversion symmetry, a simpler expression is derived. We then study two toy models feasible on cold atom platforms to numerically confirm the bulk-boundary correspondence. The Krein-space approach developed in this work is a universal formalism to study all kinds of symmetry-protected topological bosonic Bogoliubov bands.


title: Nucleation of frictional sliding by coalescence of microslip

abstract: The onset of frictional motion is mediated by the dynamic propagation of a rupture front, analogous to a shear crack. The rupture front nucleates quasi-statically in a localized region of the frictional interface and slowly increases in size. When it reaches a critical nucleation length it becomes unstable, propagates dynamically and eventually breaks the entire interface, leading to macroscopic sliding. The nucleation process is particularly important because it determines the stress level at which the frictional interface fails, and therefore, the macroscopic friction strength. However, the mechanisms governing nucleation of frictional rupture fronts are still not well understood. Specifically, our knowledge of the nucleation process along a heterogeneous interface remains incomplete. Here, we study the nucleation of localized slip patches on linear slip-weakening interfaces with deterministic and stochastic heterogeneous friction properties. Using numerical simulations, we analyze the process leading to a slip patch of critical size for systems with varying correlation lengths of the local friction strength. Our deterministic interface model reveals that the growth of the critical nucleation patch at interfaces with small correlation lengths is non smooth due to the coalescence of neighboring slip patches. Existing analytical solutions do not account for this effect, which leads to an overestimation of global interface strength. Conversely, when the correlation length is large, the growth of the slip patch is continuous and our simulations match the analytical solution. Furthermore, nucleation by coalescence is also observed on stochastic interfaces with small correlation length...


title: Plug-and-Play Conversational Models

abstract: There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on large dialogue datasets, such as Reddit. These large conversational models provide little control over the generated responses, and this control is further limited in the absence of annotated conversational datasets for attribute specific generation that can be used for fine-tuning the model. In this paper, we first propose and evaluate plug-and-play methods for controllable response generation, which does not require dialogue specific datasets and does not rely on fine-tuning a large model. While effective, the decoding procedure induces considerable computational overhead, rendering the conversational model unsuitable for interactive usage. To overcome this, we introduce an approach that does not require further computation at decoding time, while also does not require any fine-tuning of a large language model. We demonstrate, through extensive automatic and human evaluation, a high degree of control over the generated conversational responses with regard to multiple desired attributes, while being fluent.


title: Exact Minimax Estimation for Phase Synchronization

abstract: We study the phase synchronization problem with measurements $Y=z^*z^{*H}+\sigma W\in\mathbb{C}^{n\times n}$, where $z^*$ is an $n$-dimensional complex unit-modulus vector and $W$ is a complex-valued Gaussian random matrix. It is assumed that each entry $Y_{jk}$ is observed with probability $p$. We prove that the minimax lower bound of estimating $z^*$ under the squared $\ell_2$ loss is $(1-o(1))\frac{\sigma^2}{2p}$. We also show that both generalized power method and maximum likelihood estimator achieve the error bound $(1+o(1))\frac{\sigma^2}{2p}$. Thus, $\frac{\sigma^2}{2p}$ is the exact asymptotic minimax error of the problem. Our upper bound analysis involves a precise characterization of the statistical property of the power iteration. The lower bound is derived through an application of van Trees' inequality.


title: State and parameter estimation from exact partial state observation in stochastic reaction networks

abstract: We consider chemical reaction networks modeled by a discrete state and continuous in time Markov process for the vector copy number of the species and provide a novel particle filter method for state and parameter estimation based on exact observation of some of the species in continuous time. The conditional probability distribution of the unobserved states is shown to satisfy a system of differential equations with jumps. We provide a method of simulating a process that is a proxy for the vector copy number of the unobserved species along with a weight. The resulting weighted Monte Carlo simulation is then used to compute the conditional probability distribution of the unobserved species. We also show how our algorithm can be adapted for a Bayesian estimation of parameters and for the estimation of a past state value based on observations up to a future time.


title: The Unit-Gompertz Distribution: Characterizations and Properties

abstract: In a recent paper, Mazucheli et al. (2019) introduced the unit-Gompertz (UG) distribution and studied some of its properties. In a complementary work, Anis and De (2020) corrected some of the subtle errors in the original paper and studied some other interesting properties of this new distribution. However, to the best of our knowledge no charcterization results on this distribution have appeared in the literature. This is addressed in the present paper using truncated moments; and some more properties are investigated.


title: High-Order Relation Construction and Mining for Graph Matching

abstract: Graph matching pairs corresponding nodes across two or more graphs. The problem is difficult as it is hard to capture the structural similarity across graphs, especially on large graphs. We propose to incorporate high-order information for matching large-scale graphs. Iterated line graphs are introduced for the first time to describe such high-order information, based on which we present a new graph matching method, called High-order Graph Matching Network (HGMN), to learn not only the local structural correspondence, but also the hyperedge relations across graphs. We theoretically prove that iterated line graphs are more expressive than graph convolution networks in terms of aligning nodes. By imposing practical constraints, HGMN is made scalable to large-scale graphs. Experimental results on a variety of settings have shown that, HGMN acquires more accurate matching results than the state-of-the-art, verifying our method effectively captures the structural similarity across different graphs.


title: Global and Local Analyses of Nonlinear Low-Rank Matrix Recovery Problems

abstract: The restricted isometry property (RIP) is a well-known condition that guarantees the absence of spurious local minima in low-rank matrix recovery problems with linear measurements. In this paper, we introduce a novel property named bound difference property (BDP) to study low-rank matrix recovery problems with nonlinear measurements. Using RIP and BDP jointly, we first focus on the rank-1 matrix recovery problem, for which we propose a new criterion to certify the nonexistence of spurious local minima over the entire space. We then analyze the general case with an arbitrary rank and derive a condition to rule out the possibility of having a spurious solution in a ball around the true solution. The developed conditions lead to much stronger theoretical guarantees than the existing bounds on RIP.


title: Doubling inequalities and critical sets of Dirichlet eigenfunctions

abstract: We study the sharp doubling inequalities for the gradients and upper bounds for the critical sets of Dirichlet eigenfunctions on the boundary and in the interior of compact Riemannian manifolds. Most efforts are devoted to obtaining the sharp doubling inequalities for the gradients. New technique is developed to overcome the difficulties on the unavailability of the double manifold in obtaining doubling inequalities in smooth manifolds. The sharp upper bounds of critical sets in analytic Riemannian manifolds are consequences of the doubling inequalities.


title: Connection Pruning for Deep Spiking Neural Networks with On-Chip Learning

abstract: Long training time hinders the potential of the deep, large-scale Spiking Neural Network (SNN) with the on-chip learning capability to be realized on the embedded systems hardware. Our work proposes a novel connection pruning approach that can be applied during the on-chip Spike Timing Dependent Plasticity (STDP)-based learning to optimize the learning time and the network connectivity of the deep SNN. We applied our approach to a deep SNN with the Time To First Spike (TTFS) coding and has successfully achieved 2.1x speed-up and 64% energy savings in the on-chip learning and reduced the network connectivity by 92.83%, without incurring any accuracy loss. Moreover, the connectivity reduction results in 2.83x speed-up and 78.24% energy savings in the inference. Evaluation of our proposed approach on the Field Programmable Gate Array (FPGA) platform revealed 0.56% power overhead was needed to implement the pruning algorithm.


title: A Noise-Tolerant Quasi-Newton Algorithm for Unconstrained Optimization

abstract: This paper describes an extension of the BFGS and L-BFGS methods for the minimization of a nonlinear function subject to errors. This work is motivated by applications that contain computational noise, employ low-precision arithmetic, or are subject to statistical noise. The classical BFGS and L-BFGS methods can fail in such circumstances because the updating procedure can be corrupted and the line search can behave erratically. The proposed method addresses these difficulties and ensures that the BFGS update is stable by employing a lengthening procedure that spaces out the points at which gradient differences are collected. A new line search, designed to tolerate errors, guarantees that the Armijo-Wolfe conditions are satisfied under most reasonable conditions, and works in conjunction with the lengthening procedure. The proposed methods are shown to enjoy convergence guarantees for strongly convex functions. Detailed implementations of the methods are presented, together with encouraging numerical results.


title: Arc diagrams and 2-term simple-minded collections of preprojective algebras of type $A$

abstract: We study an explicit description of semibricks and 2-term simple-minded collections over preprojective algebras of type $A$ via arc diagrams. We provide a bijection between the set of noncrossoing arc diagrams (resp. the set of double arc diagrams), which is in bijective correspondence with elements of the symmetric group, and the set of semibricks (resp. the set of 2-term simple-minded collections) over the algebra. Moreover we define a mutation and a partial order on the set of double arc diagrams. In particular, we obtain a poset isomorphism between the symmetric group and the set of 2-term simple-minded collections. As an application of our results, we study semibricks of some quotient algebras of the preprojective algebras of type $A$ and we reprove some important results shown by the other authors.


title: Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search

abstract: Quantization Neural Networks (QNN) have attracted a lot of attention due to their high efficiency. To enhance the quantization accuracy, prior works mainly focus on designing advanced quantization algorithms but still fail to achieve satisfactory results under the extremely low-bit case. In this work, we take an architecture perspective to investigate the potential of high-performance QNN. Therefore, we propose to combine Network Architecture Search methods with quantization to enjoy the merits of the two sides. However, a naive combination inevitably faces unacceptable time consumption or unstable training problem. To alleviate these problems, we first propose the joint training of architecture and quantization with a shared step size to acquire a large number of quantized models. Then a bit-inheritance scheme is introduced to transfer the quantized models to the lower bit, which further reduces the time cost and meanwhile improves the quantization accuracy. Equipped with this overall framework, dubbed as Once Quantization-Aware Training~(OQAT), our searched model family, OQATNets, achieves a new state-of-the-art compared with various architectures under different bit-widths. In particular, OQAT-2bit-M achieves 61.6% ImageNet Top-1 accuracy, outperforming 2-bit counterpart MobileNetV3 by a large margin of 9% with 10% less computation cost. A series of quantization-friendly architectures are identified easily and extensive analysis can be made to summarize the interaction between quantization and neural architectures. Codes and models are released at https://github.com/LaVieEnRoseSMZ/OQA


title: Style Attuned Pre-training and Parameter Efficient Fine-tuning for Spoken Language Understanding

abstract: Neural models have yielded state-of-the-art results in deciphering spoken language understanding (SLU) problems; however, these models require a significant amount of domain-specific labeled examples for training, which is prohibitively expensive. While pre-trained language models like BERT have been shown to capture a massive amount of knowledge by learning from unlabeled corpora and solve SLU using fewer labeled examples for adaption, the encoding of knowledge is implicit and agnostic to downstream tasks. Such encoding results in model inefficiencies in parameter usage: an entirely new model is required for every domain. To address these challenges, we introduce a novel SLU framework, comprising a conversational language modeling (CLM) pre-training task and a light encoder architecture. The CLM pre-training enables networks to capture the representation of the language in conversation style with the presence of ASR errors. The light encoder architecture separates the shared pre-trained networks from the mappings of generally encoded knowledge to specific domains of SLU, allowing for the domain adaptation to be performed solely at the light encoder and thus increasing efficiency. With the framework, we match the performance of state-of-the-art SLU results on Alexa internal datasets and on two public ones (ATIS, SNIPS), adding only 4.4% parameters per task.


title: Gravitational Waves from Core-Collapse Supernovae

abstract: We summarize our current understanding of gravitational wave emission from core-collapse supernovae. We review the established results from multi-dimensional simulations and, wherever possible, provide back-of-the-envelope calculations to highlight the underlying physical principles. The gravitational waves are predominantly emitted by protoneutron star oscillations. In slowly rotating cases, which represent the most common type of the supernovae, the oscillations are excited by multi-dimensional hydrodynamic instabilities, while in rare rapidly rotating cases, the protoneutron star is born with an oblate deformation due to the centrifugal force. The gravitational wave signal may be marginally visible with current detectors for a source within our galaxy, while future third-generation instruments will enable more robust and detailed observations. The rapidly rotating models that develop non-axisymmetric instabilities may be visible up to a megaparsec distance with the third-generation detectors. Finally, we discuss strategies for multi-messenger observations of supernovae.


title: Einstein-Podolsky-Rosen entanglement and asymmetric steering between distant macroscopic mechanical and magnonic systems

abstract: We propose a deterministic scheme for establishing hybrid Einstein-Podolsky-Rosen (EPR) entanglement channel between a macroscopic mechanical oscillator and a magnon mode in a distant yttrium-iron-garnet (YIG) sphere across about ten gigahertz of frequency difference. The system consists of a driven electromechanical cavity which is unidirectionally coupled to a distant electromagnonical cavity inside which a YIG sphere is placed. We find that far beyond the sideband-resolved regime in the electromechanical subsystem, stationary phonon-magnon EPR entanglement can be achieved. This is realized by utilizing the output field of the electromechanical cavity being an intermediary which distributes the electromechanical entanglement to the magnons, thus establishing a remote phonon-magnon entanglement. The EPR entanglement is strong enough such that phonon-magnon quantum steering can be attainable in an asymmetric manner. This long-distance macroscopic hybrid EPR entanglement and steering enable potential applications not only in fundamental tests of quantum mechanics at the macro scale, but also in quantum networking and one-sided device-independent quantum cryptography based on magnonics and electromechanics.


title: Abelian Ideals and the Variety of Lagrangian Subalgebras

abstract: For a semisimple algebraic group $G$ of adjoint type with Lie algebra $\mathfrak g$ over the complex numbers, we establish a bijection between the set of closed orbits of the group $G \ltimes \mathfrak g^{\ast}$ acting on the variety of Lagrangian subalgebras of $\mathfrak g \ltimes \mathfrak g^{\ast}$ and the set of abelian ideals of a fixed Borel subalgebra of $\mathfrak g$. In particular, the number of such orbits equals $2^{\text{rk} \mathfrak g}$ by Peterson's theorem on abelian ideals.


title: Thermodynamics of Near BPS Black Holes in AdS$_4$ and AdS$_7$

abstract: We develop the thermodynamics of black holes in AdS$_4$ and AdS$_7$ near their BPS limit. In each setting we study the two distinct deformations orthogonal to the BPS surface as well as their nontrivial interplay with each other and with BPS properties. Our results illuminate recent microscopic calculations of the BPS entropy. We show that these microscopic computations can be leveraged to also describe the near BPS regime, by generalizing the boundary conditions imposed on states.


title: Few-shot Learning for Spatial Regression

abstract: We propose a few-shot learning method for spatial regression. Although Gaussian processes (GPs) have been successfully used for spatial regression, they require many observations in the target task to achieve a high predictive performance. Our model is trained using spatial datasets on various attributes in various regions, and predicts values on unseen attributes in unseen regions given a few observed data. With our model, a task representation is inferred from given small data using a neural network. Then, spatial values are predicted by neural networks with a GP framework, in which task-specific properties are controlled by the task representations. The GP framework allows us to analytically obtain predictions that are adapted to small data. By using the adapted predictions in the objective function, we can train our model efficiently and effectively so that the test predictive performance improves when adapted to newly given small data. In our experiments, we demonstrate that the proposed method achieves better predictive performance than existing meta-learning methods using spatial datasets.


title: Event Representation with Sequential, Semi-Supervised Discrete Variables

abstract: Within the context of event modeling and understanding, we propose a new method for neural sequence modeling that takes partially-observed sequences of discrete, external knowledge into account. We construct a sequential neural variational autoencoder, which uses Gumbel-Softmax reparametrization within a carefully defined encoder, to allow for successful backpropagation during training. The core idea is to allow semi-supervised external discrete knowledge to guide, but not restrict, the variational latent parameters during training. Our experiments indicate that our approach not only outperforms multiple baselines and the state-of-the-art in narrative script induction, but also converges more quickly.


title: Constrained Decoding for Computationally Efficient Named Entity Recognition Taggers

abstract: Current state-of-the-art models for named entity recognition (NER) are neural models with a conditional random field (CRF) as the final layer. Entities are represented as per-token labels with a special structure in order to decode them into spans. Current work eschews prior knowledge of how the span encoding scheme works and relies on the CRF learning which transitions are illegal and which are not to facilitate global coherence. We find that by constraining the output to suppress illegal transitions we can train a tagger with a cross-entropy loss twice as fast as a CRF with differences in F1 that are statistically insignificant, effectively eliminating the need for a CRF. We analyze the dynamics of tag co-occurrence to explain when these constraints are most effective and provide open source implementations of our tagger in both PyTorch and TensorFlow.


title: Refining Semantic Segmentation with Superpixel by Transparent Initialization and Sparse Encoder

abstract: Although deep learning greatly improves the performance of semantic segmentation, its success mainly lies in object central areas without accurate edges. As superpixels are a popular and effective auxiliary to preserve object edges, in this paper, we jointly learn semantic segmentation with trainable superpixels. We achieve it with fully-connected layers with Transparent Initialization (TI) and efficient logit consistency using a sparse encoder. The proposed TI preserves the effects of learned parameters of pretrained networks. This avoids a significant increase of the loss of pretrained networks, which otherwise may be caused by inappropriate parameter initialization of the additional layers. Meanwhile, consistent pixel labels in each superpixel are guaranteed by logit consistency. The sparse encoder with sparse matrix operations substantially reduces both the memory requirement and the computational complexity. We demonstrated the superiority of TI over other parameter initialization methods and tested its numerical stability. The effectiveness of our proposal was validated on PASCAL VOC 2012, ADE20K, and PASCAL Context showing enhanced semantic segmentation edges. With quantitative evaluations on segmentation edges using performance ratio and F-measure, our method outperforms the state-of-the-art.


title: Unsourced Random Access with Coded Compressed Sensing: Integrating AMP and Belief Propagation

abstract: Sparse regression codes with approximate message passing (AMP) decoding have gained much attention in recent times. The concepts underlying this coding scheme extend to unsourced random access with coded compressed sensing (CCS), as first demonstrated by Fengler, Jung, and Caire. Specifically, their approach employs a concatenated coding framework with an inner AMP decoder followed by an outer tree decoder. In their original implementation, these two components work independently of each other, with the tree decoder acting on the static output of the AMP decoder. This article introduces a novel framework where the inner AMP decoder and the outer tree decoder operate in tandem, dynamically passing information back and forth to take full advantage of the underlying CCS structure. This scheme necessitates the redesign of the tree code as to enable belief propagation in a computationally tractable manner. The enhanced architecture exhibits significant performance benefits over a range of system parameters. The error performance of the proposed scheme can be accurately predicted through a set of equations, known as state evolution of AMP. These findings are supported both analytically and through numerical methods.


title: DeepStreet: A deep learning powered urban street network generation module

abstract: In countries experiencing unprecedented waves of urbanization, there is a need for rapid and high quality urban street design. Our study presents a novel deep learning powered approach, DeepStreet (DS), for automatic street network generation that can be applied to the urban street design with local characteristics. DS is driven by a Convolutional Neural Network (CNN) that enables the interpolation of streets based on the areas of immediate vicinity. Specifically, the CNN is firstly trained to detect, recognize and capture the local features as well as the patterns of the existing street network sourced from the OpenStreetMap. With the trained CNN, DS is able to predict street networks' future expansion patterns within the predefined region conditioned on its surrounding street networks. To test the performance of DS, we apply it to an area in and around the Eixample area in the City of Barcelona, a well known example in the fields of urban and transport planning with iconic grid like street networks in the centre and irregular road alignments farther afield. The results show that DS can (1) detect and self cluster different types of complex street patterns in Barcelona; (2) predict both gridiron and irregular street and road networks. DS proves to have a great potential as a novel tool for designers to efficiently design the urban street network that well maintains the consistency across the existing and newly generated urban street network. Furthermore, the generated networks can serve as a benchmark to guide the local plan-making especially in rapidly developing cities.


title: GitEvolve: Predicting the Evolution of GitHub Repositories

abstract: Software development is becoming increasingly open and collaborative with the advent of platforms such as GitHub. Given its crucial role, there is a need to better understand and model the dynamics of GitHub as a social platform. Previous work has mostly considered the dynamics of traditional social networking sites like Twitter and Facebook. We propose GitEvolve, a system to predict the evolution of GitHub repositories and the different ways by which users interact with them. To this end, we develop an end-to-end multi-task sequential deep neural network that given some seed events, simultaneously predicts which user-group is next going to interact with a given repository, what the type of the interaction is, and when it happens. To facilitate learning, we use graph based representation learning to encode relationship between repositories. We map users to groups by modelling common interests to better predict popularity and to generalize to unseen users during inference. We introduce an artificial event type to better model varying levels of activity of repositories in the dataset. The proposed multi-task architecture is generic and can be extended to model information diffusion in other social networks. In a series of experiments, we demonstrate the effectiveness of the proposed model, using multiple metrics and baselines. Qualitative analysis of the model's ability to predict popularity and forecast trends proves its applicability.


title: Robust Instance Tracking via Uncertainty Flow

abstract: Current state-of-the-art trackers often fail due to distractorsand large object appearance changes. In this work, we explore the use ofdense optical flow to improve tracking robustness. Our main insight is that, because flow estimation can also have errors, we need to incorporate an estimate of flow uncertainty for robust tracking. We present a novel tracking framework which combines appearance and flow uncertainty information to track objects in challenging scenarios. We experimentally verify that our framework improves tracking robustness, leading to new state-of-the-art results. Further, our experimental ablations shows the importance of flow uncertainty for robust tracking.


title: Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic

abstract: Video anticipation is the task of predicting one/multiple future representation(s) given limited, partial observation. This is a challenging task due to the fact that given limited observation, the future representation can be highly ambiguous. Based on the nature of the task, video anticipation can be considered from two viewpoints: the level of details and the level of determinism in the predicted future. In this research, we start from anticipating a coarse representation of a deterministic future and then move towards predicting continuous and fine-grained future representations of a stochastic process. The example of the former is video action anticipation in which we are interested in predicting one action label given a partially observed video and the example of the latter is forecasting multiple diverse continuations of human motion given partially observed one. In particular, in this thesis, we make several contributions to the literature of video anticipation...


title: Structural and magnetic properties of epitaxial films of CoIrMnAl equiatomic quaternary Heusler alloy designed from first-principles calculation

abstract: MgO-barrier magnetic tunnel junctions with half-metallic Heusler alloy electrodes attracted much attentions for spintronics applications. However, a couples of issues related to materials still remain to be resolved for practical uses. Recently, quarterly equiatomic Heusler alloys attracted attentions as advanced Heusler alloys. CoIrMnZ (Z = Al, Si, Ga, and Ge) half-metallic Heusler alloys were designed and predicted to have moderate Curie temperatures and to be a lattice-matched with the MgO barrier, being advantageous to traditional Co2 Heusler alloys [T. Roy et al., J. Magn. Magn. Mater. 498, 166092 (2020)]. Here we experimentally investigated structure and magnetic properties for thin films of one of those alloys, CoIrMnAl with a sputtering deposition. We successfully obtained the films with the B2 chemical ordering even with no post-annealing process. The lattice constant for the films annealed at 500-600$^\circ$C approximates the predicted values. The magnetization at 10 K was near 500 kA/m and the Curie temperature was approximately 400 K were observed, which were about 70% of the values predicted for the fully ordered structure. The magnetic properties observed in those B2 ordered films were well explained by ferrimagnetism appeared in B2 ordered CoIrMnAl with full-swap disorders of Co-Ir and Mn-Al and almost full-swap disorder of Co-Mn, predicted from the first-principles calculations.


title: Quantum Approximate Counting with Nonadaptive Grover Iterations

abstract: Approximate Counting refers to the problem where we are given query access to a function $f : [N] \to \{0,1\}$, and we wish to estimate $K = #\{x : f(x) = 1\}$ to within a factor of $1+\epsilon$ (with high probability), while minimizing the number of queries. In the quantum setting, Approximate Counting can be done with $O\left(\min\left(\sqrt{N/\epsilon}, \sqrt{N/K}/\epsilon\right)\right)$ queries. It has recently been shown that this can be achieved by a simple algorithm that only uses "Grover iterations"; however the algorithm performs these iterations adaptively. Motivated by concerns of computational simplicity, we consider algorithms that use Grover iterations with limited adaptivity. We show that algorithms using only nonadaptive Grover iterations can achieve $O\left(\sqrt{N/\epsilon}\right)$ query complexity, which is tight.


title: A note on knot fertility

abstract: We show that a knot whose minimum crossing number $c(K)$ is even and greater than $30$ is not fertile; there exists a knot $K'$ with crossing number less than $c$ such that $K'$ is not obtained from a minimum crossing number diagram of $K$ by suitably changing the over-under information.


title: Pragmatically Informative Color Generation by Grounding Contextual Modifiers

abstract: Grounding language in contextual information is crucial for fine-grained natural language understanding. One important task that involves grounding contextual modifiers is color generation. Given a reference color "green", and a modifier "bluey", how does one generate a color that could represent "bluey green"? We propose a computational pragmatics model that formulates this color generation task as a recursive game between speakers and listeners. In our model, a pragmatic speaker reasons about the inferences that a listener would make, and thus generates a modified color that is maximally informative to help the listener recover the original referents. In this paper, we show that incorporating pragmatic information provides significant improvements in performance compared with other state-of-the-art deep learning models where pragmatic inference and flexibility in representing colors from a large continuous space are lacking. Our model has an absolute 98% increase in performance for the test cases where the reference colors are unseen during training, and an absolute 40% increase in performance for the test cases where both the reference colors and the modifiers are unseen during training.


title: iobes: A Library for Span-Level Processing

abstract: Many tasks in natural language processing, such as named entity recognition and slot-filling, involve identifying and labeling specific spans of text. In order to leverage common models, these tasks are often recast as sequence labeling tasks. Each token is given a label and these labels are prefixed with special tokens such as B- or I-. After a model assigns labels to each token, these prefixes are used to group the tokens into spans. Properly parsing these annotations is critical for producing fair and comparable metrics; however, despite its importance, there is not an easy-to-use, standardized, programmatically integratable library to help work with span labeling. To remedy this, we introduce our open-source library, iobes. iobes is used for parsing, converting, and processing spans represented as token level decisions.


title: Application of the inhomogeneous Kibble-Zurek mechanism to quench dynamics in the transition from a Mott-insulator to a superfluid in a finite system

abstract: We apply the theory of inhomogeneous Kibble-Zurek mechanism to understand quench dynamics from the Mott insulator to the superfluid in a cold Bose gases confined in both a two-dimensional optical lattice and a harmonic trap. The local quench time and the freeze-out region associated with the nonadiabatic transition take a nontrivial positional dependence due to the Mott-lobe structure of the ground state phase diagram of the Bose-Hubbard model. We demonstrate that the quench dynamics through the time-dependent Gutzwiller simulations, revealing inhomogeneous properties of the growth of the superfluid order parameter. The inhomogeneous Kibble-Zurek theory is applicable for the shallow harmonic trap.


title: Quantum oscillator noise spectroscopy via displaced cat states

abstract: Quantum harmonic oscillators are central to many modern quantum technologies. We introduce a method to determine the frequency noise spectrum of oscillator modes through coupling them to a qubit with continuously driven qubit-state-dependent displacements. We reconstruct the noise spectrum using a series of different drive phase and amplitude modulation patterns in conjunction with a data-fusion routine based on convex optimization. We apply the technique to the identification of intrinsic noise in the motional frequency of a single trapped ion with sensitivity to fluctuations at the sub-Hz level in a spectral range from quasi-DC up to 50 kHz.


title: Phase Configuration Learning in Wireless Networks with Multiple Reconfigurable Intelligent Surfaces

abstract: Reconfigurable Intelligent Surfaces (RISs) are recently gaining remarkable attention as a low-cost, hardware-efficient, and highly scalable technology capable of offering dynamic control of electro-magnetic wave propagation. Their envisioned dense deployment over various obstacles of the, otherwise passive, wireless communication environment has been considered as a revolutionary means to transform them into network entities with reconfigurable properties, providing increased environmental intelligence for diverse communication objectives. One of the major challenges with RIS-empowered wireless communications is the low-overhead dynamic configuration of multiple RISs, which according to the current hardware designs have very limited computing and storage capabilities. In this paper, we consider a typical communication pair between two nodes that is assisted by a plurality of RISs, and devise low-complexity supervised learning approaches for the RISs' phase configurations. By assuming common tunable phases in groups of each RIS's unit elements, we present multi-layer perceptron Neural Network (NN) architectures that can be trained either with positioning values or the instantaneous channel coefficients. We investigate centralized and individual training of the RISs, as well as their federation, and assess their computational requirements. Our simulation results, including comparisons with the optimal phase configuration scheme, showcase the benefits of adopting individual NNs at RISs for the link budget performance boosting.


title: Hate is the New Infodemic: A Topic-aware Modeling of Hate Speech Diffusion on Twitter

abstract: Online hate speech, particularly over microblogging platforms like Twitter, has emerged as arguably the most severe issue of the past decade. Several countries have reported a steep rise in hate crimes infuriated by malicious hate campaigns. While the detection of hate speech is one of the emerging research areas, the generation and spread of topic-dependent hate in the information network remain under-explored. In this work, we focus on exploring user behaviour, which triggers the genesis of hate speech on Twitter and how it diffuses via retweets. We crawl a large-scale dataset of tweets, retweets, user activity history, and follower networks, comprising over 161 million tweets from more than $41$ million unique users. We also collect over 600k contemporary news articles published online. We characterize different signals of information that govern these dynamics. Our analyses differentiate the diffusion dynamics in the presence of hate from usual information diffusion. This motivates us to formulate the modelling problem in a topic-aware setting with real-world knowledge. For predicting the initiation of hate speech for any given hashtag, we propose multiple feature-rich models, with the best performing one achieving a macro F1 score of 0.65. Meanwhile, to predict the retweet dynamics on Twitter, we propose RETINA, a novel neural architecture that incorporates exogenous influence using scaled dot-product attention. RETINA achieves a macro F1-score of 0.85, outperforming multiple state-of-the-art models. Our analysis reveals the superlative power of RETINA to predict the retweet dynamics of hateful content compared to the existing diffusion models.


title: An alternative delayed population growth difference equation model

abstract: We propose an alternative delayed population growth difference equation model based on a modification of the Beverton-Holt recurrence, assuming a delay only in the growth contribution that takes into account that those individuals that die during the delay, do not contribute to growth. The model introduced differs from existing delay difference equations in population dynamics, such as the delayed logistic difference equation, which was formulated as a discretization of the Hutchinson model. The analysis of our delayed difference equation model identifies an important critical delay threshold. If the time delay exceeds this threshold, the model predicts that the population will go extinct for all non-negative initial conditions and if it is below this threshold, the population survives and its size converges to a positive globally asymptotically stable equilibrium that is decreasing in size as the delay increases. Firstly, we obtain the local stability results by exploiting the special structure of powers of the Jacobian matrix. Secondly, we show that local stability implies global stability using two different techniques. For one set of parameter values, a contraction mapping result is applied, while for the remaining set of parameter values, we show that the result follows by first proving that the recurrence structure is eventually monotonic in each of its arguments.


title: Q-learning with Language Model for Edit-based Unsupervised Summarization

abstract: Unsupervised methods are promising for abstractive text summarization in that the parallel corpora is not required. However, their performance is still far from being satisfied, therefore research on promising solutions is on-going. In this paper, we propose a new approach based on Q-learning with an edit-based summarization. The method combines two key modules to form an Editorial Agent and Language Model converter (EALM). The agent predicts edit actions (e.t., delete, keep, and replace), and then the LM converter deterministically generates a summary on the basis of the action signals. Q-learning is leveraged to train the agent to produce proper edit actions. Experimental results show that EALM delivered competitive performance compared with the previous encoder-decoder-based methods, even with truly zero paired data (i.e., no validation set). Defining the task as Q-learning enables us not only to develop a competitive method but also to make the latest techniques in reinforcement learning available for unsupervised summarization. We also conduct qualitative analysis, providing insights into future study on unsupervised summarizers.


title: Token-level Adaptive Training for Neural Machine Translation

abstract: There exists a token imbalance phenomenon in natural language as different tokens appear with different frequencies, which leads to different learning difficulties for tokens in Neural Machine Translation (NMT). The vanilla NMT model usually adopts trivial equal-weighted objectives for target tokens with different frequencies and tends to generate more high-frequency tokens and less low-frequency tokens compared with the golden token distribution. However, low-frequency tokens may carry critical semantic information that will affect the translation quality once they are neglected. In this paper, we explored target token-level adaptive objectives based on token frequencies to assign appropriate weights for each target token during training. We aimed that those meaningful but relatively low-frequency words could be assigned with larger weights in objectives to encourage the model to pay more attention to these tokens. Our method yields consistent improvements in translation quality on ZH-EN, EN-RO, and EN-DE translation tasks, especially on sentences that contain more low-frequency tokens where we can get 1.68, 1.02, and 0.52 BLEU increases compared with baseline, respectively. Further analyses show that our method can also improve the lexical diversity of translation.


title: Ultralow Threshold Polariton Condensate in a Monolayer Semiconductor Microcavity at Room Temperature

abstract: Atomically thin transition metal dichalcogenides possess valley dependent functionalities that are usually available only at crogenic temperatures, constrained by various valley depolarization scatterings. The formation of exciton polaritons by coherently superimposing excitons and microcavity photons potentially harnesses the valley polarized polariton polariton interactions for novel valleytronics devices. Robust EPs have been demonstrated at room temperature in TMDs microcavity, however, the coherent polariton lasing and condensation remain elusive. Herein, we demonstrate for the first time the realization of EP condensation in a TMD microcavity at room temperature. The continuous wave pumped EP condensation and lasing with ultralow thresholdsis evidenced by the macroscopic occupation of the ground state, that undergoes a nonlinear increase of the emission and a continuous blueshift, a build up of spatial coherence, and a detuning-controlled threshold. Our work presents a critically important step towards exploiting nonlinear polariton polariton interactions and polaritonic devices with valley functionality at room temperature.