title: Recipe for a General, Powerful, Scalable Graph Transformer

abstract: We propose a recipe on how to build a general, powerful, scalable (GPS) graph Transformer with linear complexity and state-of-the-art results on a diverse set of benchmarks. Graph Transformers (GTs) have gained popularity in the field of graph representation learning with a variety of recent publications but they lack a common foundation about what constitutes a good positional or structural encoding, and what differentiates them. In this paper, we summarize the different types of encodings with a clearer definition and categorize them as being $\textit{local}$, $\textit{global}$ or $\textit{relative}$. The prior GTs are constrained to small graphs with a few hundred nodes, here we propose the first architecture with a complexity linear in the number of nodes and edges $O(N+E)$ by decoupling the local real-edge aggregation from the fully-connected Transformer. We argue that this decoupling does not negatively affect the expressivity, with our architecture being a universal function approximator on graphs. Our GPS recipe consists of choosing 3 main ingredients: (i) positional/structural encoding, (ii) local message-passing mechanism, and (iii) global attention mechanism. We provide a modular framework $\textit{GraphGPS}$ that supports multiple types of encodings and that provides efficiency and scalability both in small and large graphs. We test our architecture on 16 benchmarks and show highly competitive results in all of them, show-casing the empirical benefits gained by the modularity and the combination of different strategies.


title: Quark unitarity triangles

abstract: The angles of all unitarity triangles of the Cabibbo-Kobayashi-Maskawa matrix are determined from the experimental data. Our analysis is independent of the parameterization of the CKM matrix and it is based on the predictions of the unitarity for the angles and the areas of the unitarity triangles. We note that the lengths of the sides of the four unitarity triangles determined from the experimental data do not form a triangle. We resolve this incompatibility by performing a constrained fit, assuming the equality of the area of the unitarity triangles. We demonstrate that the measured data are compatible with the predictions of the unitarity of the Cabibbo-Kobayashi-Maskawa matrix, but there is a $2\sigma$ tension for one of the triangles. We show that the angles of the unitarity triangles obtained by the multiplication of the rows of the CKM matrix can be obtained from the angles obtained by the multiplication of the columns. The equality of those two types of the angles is a simple, but a very powerful test of the general structure of the Standard Model.


title: Investigating Information Inconsistency in Multilingual Open-Domain Question Answering

abstract: Retrieval based open-domain QA systems use retrieved documents and answer-span selection over retrieved documents to find best-answer candidates. We hypothesize that multilingual Question Answering (QA) systems are prone to information inconsistency when it comes to documents written in different languages, because these documents tend to provide a model with varying information about the same topic. To understand the effects of the biased availability of information and cultural influence, we analyze the behavior of multilingual open-domain question answering models with a focus on retrieval bias. We analyze if different retriever models present different passages given the same question in different languages on TyDi QA and XOR-TyDi QA, two multilingualQA datasets. We speculate that the content differences in documents across languages might reflect cultural divergences and/or social biases.


title: Eigenvalues of the laplacian matrices of the cycles with one weighted edge

abstract: In this paper we study the eigenvalues of the laplacian matrices of the cyclic graphs with one edge of weight $\alpha$ and the others of weight $1$. We denote by $n$ the order of the graph and suppose that $n$ tends to infinity. We notice that the characteristic polynomial and the eigenvalues depend only on $\operatorname{Re}(\alpha)$. After that, through the rest of the paper we suppose that $0<\alpha<1$. It is easy to see that the eigenvalues belong to $[0,4]$ and are asymptotically distributed as the function $g(x)=4\sin^2(x/2)$ on $[0,\pi]$. We obtain a series of results about the individual behavior of the eigenvalues. First, we describe more precisely their localization in subintervals of $[0,4]$. Second, we transform the characteristic equation to a form convenient to solve by numerical methods. In particular, we prove that Newton's method converges for every $n\ge3$. Third, we derive asymptotic formulas for all eigenvalues, where the errors are uniformly bounded with respect to the number of the eigenvalue.


title: A Lightweight NMS-free Framework for Real-time Visual Fault Detection System of Freight Trains

abstract: Real-time vision-based system of fault detection (RVBS-FD) for freight trains is an essential part of ensuring railway transportation safety. Most existing vision-based methods still have high computational costs based on convolutional neural networks. The computational cost is mainly reflected in the backbone, neck, and post-processing, i.e., non-maximum suppression (NMS). In this paper, we propose a lightweight NMS-free framework to achieve real-time detection and high accuracy simultaneously. First, we use a lightweight backbone for feature extraction and design a fault detection pyramid to process features. This fault detection pyramid includes three novel individual modules using attention mechanism, bottleneck, and dilated convolution for feature enhancement and computation reduction. Instead of using NMS, we calculate different loss functions, including classification and location costs in the detection head, to further reduce computation. Experimental results show that our framework achieves over 83 frames per second speed with a smaller model size and higher accuracy than the state-of-the-art detectors. Meanwhile, the hardware resource requirements of our method are low during the training and testing process.


title: A CNN with Noise Inclined Module and Denoise Framework for Hyperspectral Image Classification

abstract: Deep Neural Networks have been successfully applied in hyperspectral image classification. However, most of prior works adopt general deep architectures while ignore the intrinsic structure of the hyperspectral image, such as the physical noise generation. This would make these deep models unable to generate discriminative features and provide impressive classification performance. To leverage such intrinsic information, this work develops a novel deep learning framework with the noise inclined module and denoise framework for hyperspectral image classification. First, we model the spectral signature of hyperspectral image with the physical noise model to describe the high intraclass variance of each class and great overlapping between different classes in the image. Then, a noise inclined module is developed to capture the physical noise within each object and a denoise framework is then followed to remove such noise from the object. Finally, the CNN with noise inclined module and the denoise framework is developed to obtain discriminative features and provides good classification performance of hyperspectral image. Experiments are conducted over two commonly used real-world datasets and the experimental results show the effectiveness of the proposed method. The implementation of the proposed method and other compared methods could be accessed at https://github.com/shendu-sw/noise-physical-framework.


title: Linear Algorithms for Robust and Scalable Nonparametric Multiclass Probability Estimation

abstract: Multiclass probability estimation is the problem of estimating conditional probabilities of a data point belonging to a class given its covariate information. It has broad applications in statistical analysis and data science. Recently a class of weighted Support Vector Machines (wSVMs) has been developed to estimate class probabilities through ensemble learning for $K$-class problems (Wu, Zhang and Liu, 2010; Wang, Zhang and Wu, 2019), where $K$ is the number of classes. The estimators are robust and achieve high accuracy for probability estimation, but their learning is implemented through pairwise coupling, which demands polynomial time in $K$. In this paper, we propose two new learning schemes, the baseline learning and the One-vs-All (OVA) learning, to further improve wSVMs in terms of computational efficiency and estimation accuracy. In particular, the baseline learning has optimal computational complexity in the sense that it is linear in $K$. Though not being most efficient in computation, the OVA offers the best estimation accuracy among all the procedures under comparison. The resulting estimators are distribution-free and shown to be consistent. We further conduct extensive numerical experiments to demonstrate finite sample performance.


title: Augmentation-induced Consistency Regularization for Classification

abstract: Deep neural networks have become popular in many supervised learning tasks, but they may suffer from overfitting when the training dataset is limited. To mitigate this, many researchers use data augmentation, which is a widely used and effective method for increasing the variety of datasets. However, the randomness introduced by data augmentation causes inevitable inconsistency between training and inference, which leads to poor improvement. In this paper, we propose a consistency regularization framework based on data augmentation, called CR-Aug, which forces the output distributions of different sub models generated by data augmentation to be consistent with each other. Specifically, CR-Aug evaluates the discrepancy between the output distributions of two augmented versions of each sample, and it utilizes a stop-gradient operation to minimize the consistency loss. We implement CR-Aug to image and audio classification tasks and conduct extensive experiments to verify its effectiveness in improving the generalization ability of classifiers. Our CR-Aug framework is ready-to-use, it can be easily adapted to many state-of-the-art network architectures. Our empirical results show that CR-Aug outperforms baseline methods by a significant margin.


title: Improving CTC-based ASR Models with Gated Interlayer Collaboration

abstract: The CTC-based automatic speech recognition (ASR) models without the external language model usually lack the capacity to model conditional dependencies and textual interactions. In this paper, we present a Gated Interlayer Collaboration (GIC) mechanism to improve the performance of CTC-based models, which introduces textual information into the model and thus relaxes the conditional independence assumption of CTC-based models. Specifically, we consider the weighted sum of token embeddings as the textual representation for each position, where the position-specific weights are the softmax probability distribution constructed via inter-layer auxiliary CTC losses. The textual representations are then fused with acoustic features by developing a gate unit. Experiments on AISHELL-1, TEDLIUM2, and AIDATATANG corpora show that the proposed method outperforms several strong baselines.


title: A weighted $L_p$-regularity theory for parabolic partial differential equations with time measurable pseudo-differential operators

abstract: We obtain the existence, uniqueness, and regularity estimates of the following Cauchy problem \begin{equation}\label{ab eqn} \begin{cases} \partial_t u(t,x)=\psi(t,-i\nabla)u(t,x)+f(t,x),\quad &(t,x)\in(0,T)\times\mathbb{R}^d,\\ u(0,x)=0,\quad & x\in\mathbb{R}^d \end{cases} \end{equation} in (Muckenhoupt) weighted $L_p$-spaces with time-measurable pseudo-differential operators \begin{equation} \label{ab op} \psi(t,-i\nabla)u(t,x):=\mathcal{F}^{-1}\left[\psi(t,\cdot)\mathcal{F}[u](t,\cdot)\right](x). \end{equation} More precisely, we find sufficient conditions of the symbol $\psi(t,\xi)$ (especially depending on the smoothness of the symbol with respect to $\xi$) to guarantee that equation is well-posed in (Muckenhoupt) weighted $L_p$-spaces. Here the symbol $\psi(t,\xi)$ is merely measurable with respect to $t$, and the sufficient smoothness of $\psi(t,\xi)$ with respect to $\xi$ is characterized by a property of each weight. In particular, we prove the existence of a positive constant $N$ such that for any solution $u$ to the equation, \begin{equation} \label{ab est} \int_0^T \int_{\mathbb{R}^d} |(-\Delta)^{\gamma/2} u(t,x) |^p (t^2 + |x|^2)^{\alpha/2} \mathrm{d}x\mathrm{d}t \leq N\int_0^T \int_{\mathbb{R}^d} |f(t,x)|^p (t^2 + |x|^2)^{\alpha/2} \mathrm{d}x\mathrm{d}t \end{equation} and \begin{equation} \label{ab est 2} \int_0^T \left(\int_{\mathbb{R}^d} |(-\Delta)^{\gamma/2} u(t,x) |^p |x|^{\alpha_2} \mathrm{d}x \right)^{q/p} t^{\alpha_1}\mathrm{d}t \leq N\int_0^T \left(\int_{\mathbb{R}^d} |f(t,x) |^p |x|^{\alpha_2} \mathrm{d}x \right)^{q/p} t^{\alpha_1}\mathrm{d}t, \end{equation} where $p,q\in(1,\infty)$, $-d-1<\alpha < (d+1)(p-1)$, $-1 < \alpha_1 < q-1$, $-d <\alpha_2< d(p-1)$, and $\gamma$ is the order of the operator $\psi(t,-i\nabla)$.


title: sat2pc: Estimating Point Cloud of Building Roofs from 2D Satellite Images

abstract: Three-dimensional (3D) urban models have gained interest because of their applications in many use-cases such as urban planning and virtual reality. However, generating these 3D representations requires LiDAR data, which are not always readily available. Thus, the applicability of automated 3D model generation algorithms is limited to a few locations. In this paper, we propose sat2pc, a deep learning architecture that predicts the point cloud of a building roof from a single 2D satellite image. Our architecture combines Chamfer distance and EMD loss, resulting in better 2D to 3D performance. We extensively evaluate our model and perform ablation studies on a building roof dataset. Our results show that sat2pc was able to outperform existing baselines by at least 18.6%. Further, we show that the predicted point cloud captures more detail and geometric characteristics than other baselines.


title: FBNETGEN: Task-aware GNN-based fMRI Analysis via Functional Brain Network Generation

abstract: Functional magnetic resonance imaging (fMRI) is one of the most common imaging modalities to investigate brain functions. Recent studies in neuroscience stress the great potential of functional brain networks constructed from fMRI data for clinical predictions. Traditional functional brain networks, however, are noisy and unaware of downstream prediction tasks, while also incompatible with the deep graph neural network (GNN) models. In order to fully unleash the power of GNNs in network-based fMRI analysis, we develop FBNETGEN, a task-aware and interpretable fMRI analysis framework via deep brain network generation. In particular, we formulate (1) prominent region of interest (ROI) features extraction, (2) brain networks generation, and (3) clinical predictions with GNNs, in an end-to-end trainable model under the guidance of particular prediction tasks. Along with the process, the key novel component is the graph generator which learns to transform raw time-series features into task-oriented brain networks. Our learnable graphs also provide unique interpretations by highlighting prediction-related brain regions. Comprehensive experiments on two datasets, i.e., the recently released and currently largest publicly available fMRI dataset Adolescent Brain Cognitive Development (ABCD), and the widely-used fMRI dataset PNC, prove the superior effectiveness and interpretability of FBNETGEN. The implementation is available at https://github.com/Wayfear/FBNETGEN.


title: Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning

abstract: Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned representation. The situation becomes even more serious in medical imaging, where the clinical data (e.g., MR images with pathology) are limited and scarce while the reliability, generalizability and transparency of the learned model are highly required. To address this problem, we propose to infuse human experts' intelligence and domain knowledge into the training of deep neural networks. The core idea is that we infuse the visual attention information from expert radiologists to proactively guide the deep model to focus on regions with potential pathology and avoid being trapped in learning harmful shortcuts. To do so, we propose a novel eye-gaze-guided vision transformer (EG-ViT) for diagnosis with limited medical image data. We mask the input image patches that are out of the radiologists' interest and add an additional residual connection in the last encoder layer of EG-ViT to maintain the correlations of all patches. The experiments on two public datasets of INbreast and SIIM-ACR demonstrate our EG-ViT model can effectively learn/transfer experts' domain knowledge and achieve much better performance than baselines. Meanwhile, it successfully rectifies the harmful shortcut learning and significantly improves the EG-ViT model's interpretability. In general, EG-ViT takes the advantages of both human expert's prior knowledge and the power of deep neural networks. This work opens new avenues for advancing current artificial intelligence paradigms by infusing human intelligence.


title: R2D2: Robust Data-to-Text with Replacement Detection

abstract: Unfaithful text generation is a common problem for text generation systems. In the case of Data-to-Text (D2T) systems, the factuality of the generated text is particularly crucial for any real-world applications. We introduce R2D2, a training framework that addresses unfaithful Data-to-Text generation by training a system both as a generator and a faithfulness discriminator with additional replacement detection and unlikelihood learning tasks. To facilitate such training, we propose two methods for sampling unfaithful sentences. We argue that the poor entity retrieval capability of D2T systems is one of the primary sources of unfaithfulness, so in addition to the existing metrics, we further propose NER-based metrics to evaluate the fidelity of D2T generations. Our experimental results show that R2D2 systems could effectively mitigate the unfaithful text generation, and they achieve new state-of-the-art results on FeTaQA, LogicNLG, and ToTTo, all with significant improvements.


title: Multiview Textured Mesh Recovery by Differentiable Rendering

abstract: Although having achieved the promising results on shape and color recovery through self-supervision, the multi-layer perceptrons-based methods usually suffer from heavy computational cost on learning the deep implicit surface representation. Since rendering each pixel requires a forward network inference, it is very computational intensive to synthesize a whole image. To tackle these challenges, we propose an effective coarse-to-fine approach to recover the textured mesh from multi-views in this paper. Specifically, a differentiable Poisson Solver is employed to represent the object's shape, which is able to produce topology-agnostic and watertight surfaces. To account for depth information, we optimize the shape geometry by minimizing the differences between the rendered mesh and the predicted depth from multi-view stereo. In contrast to the implicit neural representation on shape and color, we introduce a physically based inverse rendering scheme to jointly estimate the environment lighting and object's reflectance, which is able to render the high resolution image at real-time. The texture of the reconstructed mesh is interpolated from a learnable dense texture grid. We have conducted the extensive experiments on several multi-view stereo datasets, whose promising results demonstrate the efficacy of our proposed approach. The code is available at https://github.com/l1346792580123/diff.


title: Logical Satisfiability of Counterfactuals for Faithful Explanations in NLI

abstract: Evaluating an explanation's faithfulness is desired for many reasons such as trust, interpretability and diagnosing the sources of model's errors. In this work, which focuses on the NLI task, we introduce the methodology of Faithfulness-through-Counterfactuals, which first generates a counterfactual hypothesis based on the logical predicates expressed in the explanation, and then evaluates if the model's prediction on the counterfactual is consistent with that expressed logic (i.e. if the new formula is \textit{logically satisfiable}). In contrast to existing approaches, this does not require any explanations for training a separate verification model. We first validate the efficacy of automatic counterfactual hypothesis generation, leveraging on the few-shot priming paradigm. Next, we show that our proposed metric distinguishes between human-model agreement and disagreement on new counterfactual input. In addition, we conduct a sensitivity analysis to validate that our metric is sensitive to unfaithful explanations.


title: Vehicle Guidance and Tracking Systems

abstract: Our application of command and control is the Aegis Combat System. Major components of this system include missile guidance and missile tracking. To look further into some of the aspects of these systems, an extremely simplified model of the Aegis Combat System will be designed. In this simplified model, a small-scale car will autonomously follow a small-scale remote-controlled car. There will be three major components of this system: the controller and the two small-scale cars. Through this model, the team can demonstrate the real-world application of certain aspects of C2 such as command, communication, and sensor data fusion. Figure 1 shows a picture of the Aegis Combat System.


title: Learning a Better Initialization for Soft Prompts via Meta-Learning

abstract: Prompt tuning (PT) is an effective approach to adapting pre-trained language models to downstream tasks. Without a good initialization, prompt tuning doesn't perform well under few-shot settings. So pre-trained prompt tuning (PPT) is proposed to initialize prompts by leveraging pre-training data. We propose MetaPT (Meta-learned Prompt Tuning) to further improve PPT's initialization by considering latent structure within the pre-training data. Specifically, we introduce the structure by first clustering pre-training data into different auxiliary tasks with unsupervised methods. Then we use these tasks to pre-train prompts with a meta-learning algorithm. Such a process can make prompts learn a better initialization by discovering commonalities among these auxiliary tasks. We evaluate our method on seven downstream tasks. Our MetaPT achieves better and more stable performance than the state-of-the-art method.


title: Mathematical Modelling of TEAM and VTEAM Memristor Model Using VerilogA

abstract: Anyone who looks into the circuitry world will be familiar with the three fundamental circuit elements - capacitor, resistor, and inductor. These circuit elements are defined by the relation between two of the four fundamental circuit variables current, voltage, charge, and flux. However, in 1971, Prof. Leon Chua proposed on the grounds of symmetry that there should be a fourth fundamental circuit element that gives the relation between flux and charge. He named this the memristor, which is short for memory resistor. This theory was then practicallymodeled, in May 2008 when the researchers at HP Labs published a paper announcing a model for a physical realization of a memristor. This report mainly focuses on the model of memristor and its applications. The advantages of variable resistance, flexibility, no leakage current, and compatibility with CMOS. The element memristor exhibits different characteristics for different applications which results in the formation of different models of the memristor. This paper gives a review of different models of the memristor. Memristors devices can be used in many applications such as memory, logic, and neuromorphic systems. A computer model of the memristor would be a useful tool for analyzing circuit behavior to help in developing the application of this memristor is a passive circuit element via simulation. In this paper, various VerilogA model of memristor devices are simulated for sinusoidal inputs and output are verified Various window functions has been used. The circuit analysis of the various memristor models is done


title: The 2022 Encounter of the Outburst Material from Comet 73P/Schwassmann--Wachmann~3

abstract: The encounter of the meteoric material from 73P/Schmassmann--Wachmann~3 produced during the comet's 1995 outburst in May 2022 provides a rare and valuable opportunity to understand a fragmenting comet. Here we explore various ejection configurations and their impact on the meteor outburst detected in the early hours of UT 2022 May 31. We show that the dust must have been ejected $\sim4$ to $5\times$ faster than calculated by water-ice sublimation model to best match the observed meteor activity. As only a small subset of particles with a narrow range of cross-section is expected to have reached the Earth, the large spread of meteor brightness likely indicates the presence of large but porous meteoroids in the trail. Other effects such as an enhanced lunar sodium tail and a visible glow from the meteoroid trail may have also occurred during the encounter.


title: A Correlation Analysis and Visualization of Climate Change using Post-Disaster Heterogeneous Datasets

abstract: There are numerous geo-climatic and human factors that contribute to the occurrence of natural disasters in the real-world scenario. Besides the study of causes and preconditions of such calamities, post-disaster analysis is essential for the efficient management of the disaster situation. This process needs timely and accurate data in light of the increasing frequency and severity of climate change-related extreme weather events. The analysis of disaster data involves the challenging task of integrating multiple heterogeneous sources, data ingestion and visualization. This paper aims at providing a three-dimensional analytical view of disaster data as time-series charts and a statistical model to evaluate the correlation between the occurrence of disasters, climate change and the corresponding economic damages (as a percentage of GDP). Therefore, statistical methodologies are leveraged to play important role in managing disasters, from preparation to recovery and reporting. The graphical representations provide insights on regional trends that follow, related to factors such as the proportion of each type of disaster in the various losses incurred. Therefore, obtaining reliable information about the population, the economy and climate are crucial both for risk management and preparedness and for responding to disasters. The research puts forth a detailed statistical methodology with a spatial dimension to study the impacts on the economy and infrastructure in the aftermath of a disaster thereby ensuring specialized assistance. The inference of the analysis confirmed a positive correlation between climate change and occurrence of natural disasters. Therefore, statistical evidence of an important phenomenon like climate change affecting natural disasters brings awareness among the population in the society to be more environmentally responsible.


title: Low Resource Style Transfer via Domain Adaptive Meta Learning

abstract: Text style transfer (TST) without parallel data has achieved some practical success. However, most of the existing unsupervised text style transfer methods suffer from (i) requiring massive amounts of non-parallel data to guide transferring different text styles. (ii) colossal performance degradation when fine-tuning the model in new domains. In this work, we propose DAML-ATM (Domain Adaptive Meta-Learning with Adversarial Transfer Model), which consists of two parts: DAML and ATM. DAML is a domain adaptive meta-learning approach to learn general knowledge in multiple heterogeneous source domains, capable of adapting to new unseen domains with a small amount of data. Moreover, we propose a new unsupervised TST approach Adversarial Transfer Model (ATM), composed of a sequence-to-sequence pre-trained language model and uses adversarial style training for better content preservation and style transfer. Results on multi-domain datasets demonstrate that our approach generalizes well on unseen low-resource domains, achieving state-of-the-art results against ten strong baselines.


title: Leveraging Locality in Abstractive Text Summarization

abstract: Neural attention models have achieved significant improvements on many natural language processing tasks. However, the quadratic memory complexity of the self-attention module with respect to the input length hinders their applications in long text summarization. Instead of designing more efficient attention modules, we approach this problem by investigating if models with a restricted context can have competitive performance compared with the memory-efficient attention models that maintain a global context by treating the input as a single sequence. Our model is applied to individual pages which contain parts of inputs grouped by the principle of locality during both encoding and decoding. We empirically investigated three kinds of locality in text summarization at different levels of granularity, ranging from sentences to documents. Our experimental results show that our model has a better performance compared with strong baselines with efficient attention modules, and our analysis provides further insights into our locality-aware modeling strategy.


title: An Investigation on Applying Acoustic Feature Conversion to ASR of Adult and Child Speech

abstract: The performance of child speech recognition is generally less satisfactory compared to adult speech due to limited amount of training data. Significant performance degradation is expected when applying an automatic speech recognition (ASR) system trained on adult speech to child speech directly, as a result of domain mismatch. The present study is focused on adult-to-child acoustic feature conversion to alleviate this mismatch. Different acoustic feature conversion approaches, including deep neural network based and signal processing based, are investigated and compared under a fair experimental setting, in which converted acoustic features from the same amount of labeled adult speech are used to train the ASR models from scratch. Experimental results reveal that not all of the conversion methods lead to ASR performance gain. Specifically, as a classic unsupervised domain adaptation method, the statistic matching does not show an effectiveness. A disentanglement-based auto-encoder (DAE) conversion framework is found to be useful and the approach of F0 normalization achieves the best performance. It is noted that the F0 distribution of converted features is an important attribute to reflect the conversion quality, while utilizing an adult-child deep classification model to make judgment is shown to be inappropriate.


title: Visualising Multilevel Regression and Poststratification: Alternatives to the Current Practice

abstract: Surveys provide important evidence for policymaking, decision-making, and understanding of society. However, conducting the large surveys required to provide subpopulation level estimates is expensive and time-consuming. Multilevel Regression and Poststratification (MRP) is a promising method to provide reliable estimates for subpopulations from surveys without the amount of data needed for reliable direct estimates. Graphical displays have been widely used to communicate and diagnose MRP estimates. However, there have been few studies on how visualisation should be performed in this field. Accordingly, this study examines the current practice of MRP visualisation using a systematic literature review. This study also applies MRP to estimate the Trump vote share in the U.S. 2016 presidential election using the Cooperative Congressional Election Study (CCES) data to illustrate the implication of current visualisation practices and explore alternatives for improvement. We find that uncertainty is not often displayed in the current practice, despite its importance for survey inference. The choropleth map is the most frequently used to display MRP estimates even though it only shows point estimates and could hinder the information conveyed. Using various graphical representations, we show that visualisation with uncertainty can illustrate the effect of different model specifications on the estimation result. In addition, this study also proposes a visualisation strategy to also take the bias-variance trade-off into account when evaluating MRP models.


title: New aspect of chiral and axial breaking in QCD

abstract: Violation of the $U(1)$ axial symmetry in QCD is stricter than the chiral $SU(2)$ breaking, simply because of the presence of the quantum axial anomaly. If the QCD gauge coupling is sent to zero, the strength of the $U(1)$ axial breaking coincides with that of the chiral $SU(2)$ breaking, which we shall in short call an axial-chiral coincidence. This coincidence is trivial since QCD then becomes a non-interacting theory. Actually, there exists another limit in the QCD parameter space, where an axial-chiral coincidence occurs even with nonzero QCD gauge coupling, that can be dubbed a nontrivial coincidence: it is the case with the massive light quarks $(m_l\neq 0)$ and the massless strange quark ($m_s=0$), due to the flavor-singlet nature of the topological susceptibility. This coincidence is robust and tied to the anomalous chiral Ward-Takahashi identity, which is operative even at hot QCD. This implies that the chiral $SU(2)$ symmetry is restored simultaneously with the $U(1)$ axial symmetry at high temperatures. This simultaneous restoration is independent of $m_l (\neq 0)$, hence is irrespective to the order of the chiral phase transition. In this paper, we discuss how the real-life QCD can be evolved from the nontrivial chiral-axial coincidence limit, by working on a Nambu-Jona-Lasinio model with the $U(1)$ axial anomaly contribution properly incorporated. It is shown that at high temperatures the large differences between the restorations of the chiral $SU(2)$ symmetry and the $U(1)$ axial symmetry for two light quarks and a sufficiently large current mass for the strange quark is induced by a significant interference of the topological susceptibility. Thus the deviation from the nontrivial coincidence, which is monitored by the strange quark mass controlling the topological susceptibility, provides a new way of understanding the chiral $SU(2)$ and $U(1)$ axial breaking in QCD.


title: On a variational theorem of Gauduchon and torsion-critical manifolds

abstract: In 1984, Gauduchon considered the functional of $L^2$-norm of his torsion $1$-form on a compact Hermitian manifold. He obtained the Euler-Lagrange equation for this functional, and showed that in dimension $2$ the critical metrics must be balanced (namely with vanishing torsion $1$-form). In this note we extend his result to higher dimensions, and show that critical metrics are balanced in all dimensions. We also consider the $L^2$-norm of the full Chern torsion, and show by examples that there are critical points of this functional that are not K\"ahler.


title: A Convergence Theory for Over-parameterized Variational Quantum Eigensolvers

abstract: The Variational Quantum Eigensolver (VQE) is a promising candidate for quantum applications on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. Despite a lot of empirical studies and recent progress in theoretical understanding of VQE's optimization landscape, the convergence for optimizing VQE is far less understood. We provide the first rigorous analysis of the convergence of VQEs in the over-parameterization regime. By connecting the training dynamics with the Riemannian Gradient Flow on the unit-sphere, we establish a threshold on the sufficient number of parameters for efficient convergence, which depends polynomially on the system dimension and the spectral ratio, a property of the problem Hamiltonian, and could be resilient to gradient noise to some extent. We further illustrate that this overparameterization threshold could be vastly reduced for specific VQE instances by establishing an ansatz-dependent threshold paralleling our main result. We showcase that our ansatz-dependent threshold could serve as a proxy of the trainability of different VQE ansatzes without performing empirical experiments, which hence leads to a principled way of evaluating ansatz design. Finally, we conclude with a comprehensive empirical study that supports our theoretical findings.


title: On the assembly of $C^1-$stationary points of a polyconvex functional and finite BOP-theory

abstract: In this work the following energy is considered $I(u)=\int\limits_B{\frac{1}{2}|\nabla u|^2+\rho(\det\nabla u)\;dx},$ where $B\subset\mathbb{R}^2$ denotes the unit ball, $u\in W^{1,2}(B,\mathbb{R}^2),$ and $\rho:\mathbb{R}\rightarrow\mathbb{R}_0^+$ smooth and convex with $\rho(s)=0$ for all $s\le0$ and $\rho$ becomes affine when $s$ exceeds some value $s_0>0.$ Additionally, we may impose $(M\in \mathbb{N}\setminus\{0\})-$covering maps as boundary conditions in a suitable fashion. For such situations we then construct radially symmetric $M-$covering stationary points of the energy, which are at least $C^1$ (in some circumstances even $C^\infty),$ and verify more refined properties, which these stationary points need to satisfy. We do so by following the strategy first and foremost developed by P. Bauman, N. C. Owen, and D. Phillips (BOP) confirming and generalising that the method remains valid beyond the $M=2-$case for an arbitrary $M.$ Furthermore, as far as we know, this is the first treatise of BOP-theory in finite elasticity. The finiteness, not imposing such strict conditions, allows for a richer class of possible behaviours of the stationary points, making it more difficult to completely determine them.


title: Constraints on the two-dimensional pseudo-spin 1/2 Mott insulator description of Sr$_2$IrO$_4$

abstract: Sr$_{2}$IrO$_{4}$ has often been described via a simple, one-band pseudo-spin 1/2 model, subject to electron-electron interactions, on a square lattice, fostering analogies with cuprate superconductors, believed to be well described by a similar model. In this work we argue - based on a detailed study of the low-energy electronic structure by circularly polarized spin and angle-resolved photoemission spectroscopy combined with dynamical mean-field theory calculations - that a pseudo-spin 1/2 model fails to capture the full complexity of the system. We show instead that a realistic multi-band Hubbard Hamiltonian, accounting for the full correlated $t_{2g}$ manifold, provides a detailed description of the interplay between spin-orbital entanglement and electron-electron interactions, and yields quantitative agreement with experiments. Our analysis establishes that the $j_{3/2}$ states make up a substantial percentage of the low energy spectral weight, i.e. approximately 74% as determined from the integration of the $j$-resolved spectral function in the $0$ to $-1.64$ eV energy range. The results in our work are not only of relevance to iridium based materials, but more generally to the study of multi-orbital materials with closely spaced energy scales.


title: GisPy: A Tool for Measuring Gist Inference Score in Text

abstract: Decision making theories such as Fuzzy-Trace Theory (FTT) suggest that individuals tend to rely on gist, or bottom-line meaning, in the text when making decisions. In this work, we delineate the process of developing GisPy, an open-source tool in Python for measuring the Gist Inference Score (GIS) in text. Evaluation of GisPy on documents in three benchmarks from the news and scientific text domains demonstrates that scores generated by our tool significantly distinguish low vs. high gist documents. Our tool is publicly available to use at: https://github.com/phosseini/GisPy.


title: Conditional set generation using Seq2seq models

abstract: Conditional set generation learns a mapping from an input sequence of tokens to a set. Several NLP tasks, such as entity typing and dialogue emotion tagging, are instances of set generation. Seq2Seq models, a popular choice for set generation, treat a set as a sequence and do not fully leverage its key properties, namely order-invariance and cardinality. We propose a novel algorithm for effectively sampling informative orders over the combinatorial space of label orders. We jointly model the set cardinality and output by prepending the set size and taking advantage of the autoregressive factorization used by Seq2Seq models. Our method is a model-independent data augmentation approach that endows any Seq2Seq model with the signals of order-invariance and cardinality. Training a Seq2Seq model on this augmented data (without any additional annotations) gets an average relative improvement of 20% on four benchmark datasets across various models: BART, T5, and GPT-3. Code to use SETAUG available at: https://setgen.structgen.com.


title: Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents

abstract: We argue that disentangling content selection from the budget used to cover salient content improves the performance and applicability of abstractive summarizers. Our method, FactorSum, does this disentanglement by factorizing summarization into two steps through an energy function: (1) generation of abstractive summary views; (2) combination of these views into a final summary, following a budget and content guidance. This guidance may come from different sources, including from an advisor model such as BART or BigBird, or in oracle mode -- from the reference. This factorization achieves significantly higher ROUGE scores on multiple benchmarks for long document summarization, namely PubMed, arXiv, and GovReport. Most notably, our model is effective for domain adaptation. When trained only on PubMed samples, it achieves a 46.29 ROUGE-1 score on arXiv, which indicates a strong performance due to more flexible budget adaptation and content selection less dependent on domain-specific textual structure.


title: End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Models

abstract: We propose end-to-end multimodal fact-checking and explanation generation, where the input is a claim and a large collection of web sources, including articles, images, videos, and tweets, and the goal is to assess the truthfulness of the claim by retrieving relevant evidence and predicting a truthfulness label (e.g., support, refute or not enough information), and to generate a statement to summarize and explain the reasoning and ruling process. To support this research, we construct Mocheg, a large-scale dataset consisting of 15,601 claims where each claim is annotated with a truthfulness label and a ruling statement, and 33,880 textual paragraphs and 12,112 images in total as evidence. To establish baseline performances on Mocheg, we experiment with several state-of-the-art neural architectures on the three pipelined subtasks: multimodal evidence retrieval, claim verification, and explanation generation, and demonstrate that the performance of the state-of-the-art end-to-end multimodal fact-checking does not provide satisfactory outcomes. To the best of our knowledge, we are the first to build the benchmark dataset and solutions for end-to-end multimodal fact-checking and explanation generation. The dataset, source code and model checkpoints are available at https://github.com/VT-NLP/Mocheg.


title: Coiling of cellular protrusions around extracellular fibers

abstract: Protrusions at the leading-edge of a cell play an important role in sensing the extracellular cues, during cellular spreading and motility. Recent studies provided indications that these protrusions wrap (coil) around the extra-cellular fibers. The details of this coiling process, and the mechanisms that drive it, are not well understood. We present a combined theoretical and experimental study of the coiling of cellular protrusions on fibers of different geometry. Our theoretical model describes membrane protrusions that are produced by curved membrane proteins that recruit the protrusive forces of actin polymerization, and identifies the role of bending and adhesion energies in orienting the leading-edges of the protrusions along the azimuthal (coiling) direction. Our model predicts that the cell's leading-edge coils on round fibers, but the coiling ceases for a fiber of elliptical (flat) cross-section. These predictions are verified by 3D visualization and quantitation of coiling on suspended fibers using Dual-View light-sheet microscopy (diSPIM). Overall, we provide a theoretical framework supported by high spatiotemporal resolution experiments capable of resolving coiling of cellular protrusions around extracellular fibers of varying diameters.


title: Bayesian Multiscale Analysis of the Cox Model

abstract: Piecewise constant priors are routinely used in the Bayesian Cox proportional hazards model for survival analysis. Despite its popularity, large sample properties of this Bayesian method are not yet well understood. This work provides a unified theory for posterior distributions in this setting, not requiring the priors to be conjugate. We first derive contraction rate results for wide classes of histogram priors on the unknown hazard function and prove asymptotic normality of linear functionals of the posterior hazard in the form of Bernstein--von Mises theorems. Second, using recently developed multiscale techniques, we derive functional limiting results for the cumulative hazard and survival function. Frequentist coverage properties of Bayesian credible sets are investigated: we prove that certain easily computable credible bands for the survival function are optimal frequentist confidence bands. We conduct simulation studies that confirm these predictions, with an excellent behavior particularly in finite samples. Our results suggest that the Bayesian approach can provide an easy solution to obtain both the coefficients estimate and the credible bands for survival function in practice.


title: Improve Event Extraction via Self-Training with Gradient Guidance

abstract: Data scarcity has been the main factor that hinders the progress of event extraction. To overcome this issue, we propose a Self-Training with Feedback (STF) framework that leverages the large-scale unlabeled data and acquires feedback for each new event prediction from the unlabeled data by comparing it to the Abstract Meaning Representation (AMR) graph of the same sentence. Specifically, STF consists of (1) a base event extraction model trained on existing event annotations and then applied to large-scale unlabeled corpora to predict new event mentions as pseudo training samples, and (2) a novel scoring model that takes in each new predicted event trigger, an argument, its argument role, as well as their paths in the AMR graph to estimate a compatibility score indicating the correctness of the pseudo label. The compatibility scores further act as feedback to encourage or discourage the model learning on the pseudo labels during self-training. Experimental results on three benchmark datasets, including ACE05-E, ACE05-E+, and ERE, demonstrate the effectiveness of the STF framework on event extraction, especially event argument extraction, with significant performance gain over the base event extraction models and strong baselines. Our experimental analysis further shows that STF is a generic framework as it can be applied to improve most, if not all, event extraction models by leveraging large-scale unlabeled data, even when high-quality AMR graph annotations are not available.


title: Fine-grained Contrastive Learning for Relation Extraction

abstract: Recent relation extraction (RE) works have shown encouraging improvements by conducting contrastive learning on silver labels generated by distant supervision before fine-tuning on gold labels. Existing methods typically assume all these silver labels are accurate and treat them equally; however, distant supervision is inevitably noisy -- some silver labels are more reliable than others. In this paper, we propose fine-grained contrastive learning (FineCL) for RE, which leverages fine-grained information about which silver labels are and are not noisy to improve the quality of learned relationship representations for RE. We first assess the quality of silver labels via a simple and automatic approach we call "learning order denoising," where we train a language model to learn these relations and record the order of learned training instances. We show that learning order largely corresponds to label accuracy -- early-learned silver labels have, on average, more accurate labels than later-learned silver labels. Then, during pre-training, we increase the weights of accurate labels within a novel contrastive learning objective. Experiments on several RE benchmarks show that FineCL makes consistent and significant performance gains over state-of-the-art methods.


title: On Hermitian Eisenstein series of degree 2

abstract: We consider the Hermitian Eisenstein series $E^{(\mathbb{K})}_k$ of degree $2$ and weight $k$ associated with an imaginary-quadratic number field $\mathbb{K}$ and determine the influence of $\mathbb{K}$ on the arithmetic and the growth of its Fourier coefficients. We find that they satisfy the identity $E^{{(\mathbb{K})}^2}_4 = E^{{(\mathbb{K})}}_8$, which is well-known for Siegel modular forms of degree $2$, if and only if $\mathbb{K} = \mathbb{Q} (\sqrt{-3})$. As an application, we show that the Eisenstein series $E^{(\mathbb{K})}_k$, $k=4,6,8,10,12$ are algebraically independent whenever $\mathbb{K}\neq \mathbb{Q}(\sqrt{-3})$. The difference between the Siegel and the restriction of the Hermitian to the Siegel half-space is a cusp form in the Maass space that does not vanish identically for sufficiently large weight; however, when the weight is fixed, we will see that it tends to $0$ as the discriminant tends to $-\infty$. Finally, we show that these forms generate the space of cusp forms in the Maass Spezialschar as a module over the Hecke algebra as $\mathbb{K}$ varies over imaginary-quadratic number fields.


title: Federated Self-supervised Learning for Heterogeneous Clients

abstract: Federated Learning has become an important learning paradigm due to its privacy and computational benefits. As the field advances, two key challenges that still remain to be addressed are: (1) system heterogeneity - variability in the compute and/or data resources present on each client, and (2) lack of labeled data in certain federated settings. Several recent developments have tried to overcome these challenges independently. In this work, we propose a unified and systematic framework, \emph{Heterogeneous Self-supervised Federated Learning} (Hetero-SSFL) for enabling self-supervised learning with federation on heterogeneous clients. The proposed framework allows collaborative representation learning across all the clients without imposing architectural constraints or requiring presence of labeled data. The key idea in Hetero-SSFL is to let each client train its unique self-supervised model and enable the joint learning across clients by aligning the lower dimensional representations on a common dataset. The entire training procedure could be viewed as self and peer-supervised as both the local training and the alignment procedures do not require presence of any labeled data. As in conventional self-supervised learning, the obtained client models are task independent and can be used for varied end-tasks. We provide a convergence guarantee of the proposed framework for non-convex objectives in heterogeneous settings and also empirically demonstrate that our proposed approach outperforms the state of the art methods by a significant margin.


title: A Multi-domain Magneto Tunnel Junction for Racetrack Nanowire Strips

abstract: Domain-wall memory (DWM) has SRAM class access performance, low energy, high endurance, high density, and CMOS compatibility. Recently, shift reliability and processing-using-memory (PuM) proposals developed a need to count the number of parallel or anti-parallel domains in a portion of the DWM nanowire. In this paper we propose a multi-domain magneto-tunnel junction (MTJ) that can detect different resistance levels as a function of a the number of parallel or anti-parallel domains. Using detailed micromagnetic simulation with LLG, we demonstrate the multi-domain MTJ, study the benefit of its macro-size on resilience to process variation and present a macro-model for scaling the size of the multi-domain MTJ. Our results indicate scalability to seven-domains while maintaining a 16.3mV sense margin.


title: ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection

abstract: Hate speech detection is complex; it relies on commonsense reasoning, knowledge of stereotypes, and an understanding of social nuance that differs from one culture to the next. It is also difficult to collect a large-scale hate speech annotated dataset. In this work, we frame this problem as a few-shot learning task, and show significant gains with decomposing the task into its "constituent" parts. In addition, we see that infusing knowledge from reasoning datasets (e.g. Atomic2020) improves the performance even further. Moreover, we observe that the trained models generalize to out-of-distribution datasets, showing the superiority of task decomposition and knowledge infusion compared to previously used methods. Concretely, our method outperforms the baseline by 17.83% absolute gain in the 16-shot case.


title: Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts

abstract: Question-answering datasets require a broad set of reasoning skills. We show how to use question decompositions to teach language models these broad reasoning skills in a robust fashion. Specifically, we use widely available QDMR representations to programmatically create hard-to-cheat synthetic contexts for real questions in six multi-step reasoning datasets. These contexts are carefully designed to avoid reasoning shortcuts prevalent in real contexts that prevent models from learning the right skills. This results in a pretraining dataset, named TeaBReaC, containing 525K multi-step questions (with associated formal programs) covering about 900 reasoning patterns. We show that pretraining standard language models (LMs) on TeaBReaC before fine-tuning them on target datasets improves their performance by up to 13 F1 points across 4 multi-step QA datasets, with up to 21 point gain on more complex questions. The resulting models also demonstrate higher robustness, with a 5-8 F1 point improvement on two contrast sets. Furthermore, TeaBReaC pretraining substantially improves model performance and robustness even when starting with numerate LMs pretrained using recent methods (e.g., PReasM, POET). Our work thus shows how to effectively use decomposition-guided contexts to robustly teach multi-step reasoning.


title: Influence of the Pauli exclusion principle on the alpha decay

abstract: In this study, the effects of repulsive nucleon-nucleon interactions arising from the Pauli exclusion principle were examined regarding the half-lives of heavy even-even nuclei with $84\leq Z\leq92$. The Pauli exclusion principle is applied to our investigations by renormalizing the nucleon-nucleon interactions according to the Bohr-Sommerfeld quantization condition. It is also applied to the double-folding ($DF$) formalism as a modification term by investigating the kinetic energy variation at the overlapping regions between the densities of the alpha and daughter nuclei. The standard deviation for the calculated half-lives from their corresponded experimental data is 0.340 for the renormalized DF formalism. Its value reduces to 0.309 for the DF formalism modified with the kinetic energy contribution estimated by the extended Thomas-Fermi approach. The calculated $\alpha$ decay half-lives are more consistent with experimental data if the kinetic energy contribution is associated with the DF formalism.


title: A Survey of Graph-Theoretic Approaches for Analyzing the Resilience of Networked Control Systems

abstract: As the scale of networked control systems increases and interactions between different subsystems become more sophisticated, questions of the resilience of such networks increase in importance. The need to redefine classical system and control-theoretic notions using the language of graphs has recently started to gain attention as a fertile and important area of research. This paper presents an overview of graph-theoretic methods for analyzing the resilience of networked control systems. We discuss various distributed algorithms operating on networked systems and investigate their resilience against adversarial actions by looking at the structural properties of their underlying networks. We present graph-theoretic methods to quantify the attack impact, and reinterpret some system-theoretic notions of robustness from a graph-theoretic standpoint to mitigate the impact of the attacks. Moreover, we discuss miscellaneous problems in the security of networked control systems which use graph-theory as a tool in their analyses. We conclude by introducing some avenues for further research in this field.


title: Integrable magnetic geodesic flows on 2-surfaces

abstract: We study the magnetic geodesic flows on 2-surfaces having an additional first integral which is independent of the Hamiltonian at a fixed energy level. The following two cases are considered: when there exists a quadratic in momenta integral, and also the case of a rational in momenta integral with a linear numerator and denominator. In both cases certain semi-Hamiltonian systems of PDEs appear. In this paper we construct exact solutions (generally speaking, local ones) to these systems: in the first case via the generalized hodograph method, in the second case via the Legendre transformation and the method of separation of variables.


title: Interpolation and duality in spaces of pseudocontinuable functions

abstract: Given an inner function $\theta$ on the unit disk, let $K^p_\theta:=H^p\cap\theta\bar z\bar{H^p}$ be the associated star-invariant subspace of the Hardy space $H^p$. Also, we put $K_{*\theta}:=K^2_\theta\cap{\rm BMO}$. Assuming that $B=B_{\mathcal Z}$ is an interpolating Blaschke product with zeros $\mathcal Z=\{z_j\}$, we characterize, for a number of smoothness classes $X$, the sequences of values $\mathcal W=\{w_j\}$ such that the interpolation problem $f\big|_{\mathcal Z}=\mathcal W$ has a solution $f$ in $K^2_B\cap X$. Turning to the case of a general inner function $\theta$, we further establish a non-duality relation between $K^1_\theta$ and $K_{*\theta}$. Namely, we prove that the latter space is properly contained in the dual of the former, unless $\theta$ is a finite Blaschke product. From this we derive an amusing non-interpolation result for functions in $K_{*B}$, with $B=B_{\mathcal Z}$ as above.


title: Using Loaded N-port Structures to Achieve the Continuous-Space Electromagnetic Channel Capacity Bound

abstract: A method for achieving the continuous-space electromagnetic channel capacity bound using loaded N-port structures is described. It is relevant for the design of compact multiple-input multiple-output (MIMO) antennas that can achieve channel capacity bounds when constrained by size. The method is not restricted to a specific antenna configuration and a closed-form expression for the channel capacity limits are provided with various constraints. Furthermore, using loaded N-port structures to represent arbitrary antenna geometries, an efficient optimization approach is proposed for finding the optimum MIMO antenna design that achieves the channel capacity bounds. Simulation results of the channel capacity bounds achieved using our MIMO antenna design with one square wavelength size are provided. These show that at least 18 ports can be supported in one square wavelength and achieve the continuous-space electromagnetic channel capacity bound. The results demonstrate that our method can link continuous-space electromagnetic channel capacity bounds to MIMO antenna design.


title: The Dialog Must Go On: Improving Visual Dialog via Generative Self-Training

abstract: Visual dialog (VisDial) is a task of answering a sequence of questions grounded in an image, using the dialog history as context. Prior work has trained the dialog agents solely on VisDial data via supervised learning or leveraged pre-training on related vision-and-language datasets. This paper presents a semi-supervised learning approach for visually-grounded dialog, called Generative Self-Training (GST), to leverage unlabeled images on the Web. Specifically, GST first retrieves in-domain images through out-of-distribution detection and generates synthetic dialogs regarding the images via multimodal conditional text generation. GST then trains a dialog agent on the synthetic and the original VisDial data. As a result, GST scales the amount of training data up to an order of magnitude that of VisDial (1.2M to 12.9M QA data). For robust training of the synthetic dialogs, we also propose perplexity-based data selection and multimodal consistency regularization. Evaluation on VisDial v1.0 and v0.9 datasets shows that GST achieves new state-of-the-art results on both datasets. We further observe the robustness of GST against both visual and textual adversarial attacks. Finally, GST yields strong performance gains in the low-data regime. Code is available at https://github.com/gicheonkang/gst-visdial.


title: Maximising the Influence of Temporary Participants in Opinion Formation

abstract: DeGroot-style opinion formation presumes a continuous interaction among agents of a social network. Hence, it cannot handle agents external to the social network that interact only temporarily with the permanent ones. Many real-world organisations and individuals fall into such a category. For instance, a company tries to persuade as many as possible to buy its products and, due to various constraints, can only exert its influence for a limited amount of time. We propose a variant of the DeGroot model that allows an external agent to interact with the permanent ones for a preset period of time. We obtain several insights on maximising an external agent's influence in opinion formation by analysing and simulating the variant.


title: Deadlock-Free Method for Multi-Agent Pickup and Delivery Problem Using Priority Inheritance with Temporary Priority

abstract: This paper proposes a control method for the multi-agent pickup and delivery problem (MAPD problem) by extending the priority inheritance with backtracking (PIBT) method to make it applicable to more general environments. PIBT is an effective algorithm that introduces a priority to each agent, and at each timestep, the agents, in descending order of priority, decide their next neighboring locations in the next timestep through communications only with the local agents. Unfortunately, PIBT is only applicable to environments that are modeled as a bi-connected area, and if it contains dead-ends, such as tree-shaped paths, PIBT may cause deadlocks. However, in the real-world environment, there are many dead-end paths to locations such as the shelves where materials are stored as well as loading/unloading locations to transportation trucks. Our proposed method enables MAPD tasks to be performed in environments with some tree-shaped paths without deadlock while preserving the PIBT feature; it does this by allowing the agents to have temporary priorities and restricting agents' movements in the trees. First, we demonstrate that agents can always reach their delivery without deadlock. Our experiments indicate that the proposed method is very efficient, even in environments where PIBT is not applicable, by comparing them with those obtained using the well-known token passing method as a baseline.


title: GENEVA: Benchmarking Generalizability for Event Argument Extraction with Hundreds of Event Types and Argument Roles

abstract: Recent works in Event Argument Extraction (EAE) have focused on improving model generalizability to cater to new events and domains. However, standard benchmarking datasets like ACE and ERE cover less than 40 event types and 25 entity-centric argument roles. Limited diversity and coverage hinder these datasets from adequately evaluating the generalizability of EAE models. In this paper, we first contribute by creating a large and diverse EAE ontology. This ontology is created by transforming FrameNet, a comprehensive semantic role labeling (SRL) dataset for EAE, by exploiting the similarity between these two tasks. Then, exhaustive human expert annotations are collected to build the ontology, concluding with 115 events and 220 argument roles, with a significant portion of roles not being entities. We utilize this ontology to further introduce GENEVA, a diverse generalizability benchmarking dataset comprising four test suites, aimed at evaluating models' ability to handle limited data and unseen event type generalization. We benchmark six EAE models from various families. The results show that owing to non-entity argument roles, even the best-performing model can only achieve 39% F1 score, indicating how GENEVA provides new challenges for generalization in EAE. Overall, our large and diverse EAE ontology can aid in creating more comprehensive future resources, while GENEVA is a challenging benchmarking dataset encouraging further research for improving generalizability in EAE. The code and data can be found at https://github.com/PlusLabNLP/GENEVA.


title: Memorization in NLP Fine-tuning Methods

abstract: Large language models are shown to present privacy risks through memorization of training data, and several recent works have studied such risks for the pre-training phase. Little attention, however, has been given to the fine-tuning phase and it is not well understood how different fine-tuning methods (such as fine-tuning the full model, the model head, and adapter) compare in terms of memorization risk. This presents increasing concern as the "pre-train and fine-tune" paradigm proliferates. In this paper, we empirically study memorization of fine-tuning methods using membership inference and extraction attacks, and show that their susceptibility to attacks is very different. We observe that fine-tuning the head of the model has the highest susceptibility to attacks, whereas fine-tuning smaller adapters appears to be less vulnerable to known extraction attacks.


title: Re-Examining Calibration: The Case of Question Answering

abstract: For users to trust model predictions, they need to understand model outputs, particularly their confidence - calibration aims to adjust (calibrate) models' confidence to match expected accuracy. We argue that the traditional calibration evaluation does not promote effective calibrations: for example, it can encourage always assigning a mediocre confidence score to all predictions, which does not help users distinguish correct predictions from wrong ones. Building on those observations, we propose a new calibration metric, MacroCE, that better captures whether the model assigns low confidence to wrong predictions and high confidence to correct predictions. Focusing on the practical application of open-domain question answering, we examine conventional calibration methods applied on the widely-used retriever-reader pipeline, all of which do not bring significant gains under our new MacroCE metric. Toward better calibration, we propose a new calibration method (ConsCal) that uses not just final model predictions but whether multiple model checkpoints make consistent predictions. Altogether, we provide an alternative view of calibration along with a new metric, re-evaluation of existing calibration methods on our metric, and proposal of a more effective calibration method.


title: Electronic Mach-Zehnder interference in a bipolar hybrid monolayer-bilayer graphene junction

abstract: Graphene matter in a strong magnetic field, realizing one-dimensional quantum Hall channels, provides a unique platform for studying electron interference. Here, using the Landauer-B\"uttiker formalism along with the tight-binding model, we investigate the quantum Hall (QH) effects in unipolar and bipolar monolayer-bilayer graphene (MLG-BLG) junctions. We find that a Hall bar made of an armchair MLG-BLG junction in the bipolar regime results in valley-polarized edge-channel interferences and can operate a fully tunable Mach-Zehnder (MZ) interferometer device. Investigation of the bar-width and magnetic-field dependence of the conductance oscillations shows that the MZ interference in such structures can be drastically affected by the type of (zigzag) edge termination of the second layer in the BLG region [composed of vertical dimer or non-dimer atoms]. Our findings reveal that both interfaces exhibit a double set of Aharonov-Bohm interferences, with the one between two oppositely valley-polarized edge channels dominating and causing a large-amplitude conductance oscillation ranging from 0 to $ 2 e^2 / h$. We explain and analyze our findings by analytically solving the Dirac-Weyl equation for a gated semi-infinite MLG-BLG junction.


title: The Calder\'on problem for space-time fractional parabolic operators with variable coefficients

abstract: We study an inverse problem for variable coefficient fractional parabolic operators of the form $(\partial_t -\operatorname{div}(A(x) \nabla_x)^s + q(x,t)$ for $s\in(0,1)$ and show the unique recovery of $q$ from exterior measured data. Similar to the fractional elliptic case, we use Runge type approximation argument which is obtained via a global weak unique continuation property. The proof of such a unique continuation result involves a new Carleman estimate for the associated variable coefficient extension operator. In the latter part of the work, we prove analogous unique determination results for fractional parabolic operators with drift.


title: Exact Phase Transitions in Deep Learning

abstract: This work reports deep-learning-unique first-order and second-order phase transitions, whose phenomenology closely follows that in statistical physics. In particular, we prove that the competition between prediction error and model complexity in the training loss leads to the second-order phase transition for nets with one hidden layer and the first-order phase transition for nets with more than one hidden layer. The proposed theory is directly relevant to the optimization of neural networks and points to an origin of the posterior collapse problem in Bayesian deep learning.


title: Boosted displaced decay of right-handed neutrinos at CMS, ATLAS and MATHUSLA

abstract: We investigate boosted displaced signatures in the Type-I seesaw mechanism associated with the $B-L$ gauge symmetry. Such events arise from decays of right-handed neutrinos depending on their Yukawa couplings and masses. Considering two scenarios: (a) three degenerate right-handed neutrinos whose Yukawa couplings are reconstructed from the observed neutrino masses and mixing; (b) only one right-handed neutrino which decouples from the observed neutrino mass generation and thus its coupling can be arbitrarily small, a detailed PYTHIA based simulation is performed to determine the parameter regions of the $B-L$ gauge boson mass, the neutrino Yukawa couplings, and the right-handed neutrino mass sensitive to CMS, ATLAS, proposed FCC-hh detector and MATHUSLA at the centre of mass energies of 14, 27 and 100 TeV via displaced signatures. We also show in detail how the boost effect enhances the displaced decay lengths, especially for the longitudinal ones, and hinders the probe of Majorana nature of neutrinos.


title: Text-to-Face Generation with StyleGAN2

abstract: Synthesizing images from text descriptions has become an active research area with the advent of Generative Adversarial Networks. The main goal here is to generate photo-realistic images that are aligned with the input descriptions. Text-to-Face generation (T2F) is a sub-domain of Text-to-Image generation (T2I) that is more challenging due to the complexity and variation of facial attributes. It has a number of applications mainly in the domain of public safety. Even though several models are available for T2F, there is still the need to improve the image quality and the semantic alignment. In this research, we propose a novel framework, to generate facial images that are well-aligned with the input descriptions. Our framework utilizes the high-resolution face generator, StyleGAN2, and explores the possibility of using it in T2F. Here, we embed text in the input latent space of StyleGAN2 using BERT embeddings and oversee the generation of facial images using text descriptions. We trained our framework on attribute-based descriptions to generate images of 1024x1024 in resolution. The images generated exhibit a 57% similarity to the ground truth images, with a face semantic distance of 0.92, outperforming state-of-the-artwork. The generated images have a FID score of 118.097 and the experimental results show that our model generates promising images.


title: On the asymptotic limit of steady state Poisson--Nernst--Planck equations with steric effects

abstract: When ions are crowded, the effect of steric repulsion between ions becomes significant and the conventional Poisson--Boltzmann (PB) equation (without steric effect) should be modified. For this purpose, we study the asymptotic limit of steady state Poisson--Nernst--Planck equations with steric effects (PNP-steric equations). By the assumptions of steric effects, we transform steady state PNP-steric equations into a PB equation with steric effects (PB-steric equation) which has a parameter $\Lambda$ and positive constants $\lambda_i$'s (depend on the radii of ions and solvent molecules). The nonlinear term of PB-steric equation is mainly determined by a Lambert type function which represents the concentration of solvent molecules. As $\Lambda=0$, the PB-steric equation becomes the conventional PB equation but as $\Lambda>0$, a large $\Lambda$ makes the steric repulsion (between ions and solvent molecules) stronger. This motivates us to find the asymptotic limit of PB-steric equation as $\Lambda$ goes to infinity. Under the Robin (or Neumann) boundary condition, we prove theoretically and numerically that the PB-steric equation has a unique solution $\phi_\Lambda$ which converges to solution $\phi^*$ of a modified PB (mPB) equation as $\Lambda$ tends to infinity. Our results show that the limiting equation of PB-steric equation (as $\Lambda$ goes to infinity) is a mPB equation which has the same form (up to scalar multiples) as those mPB equations in \cite{1942bikerman,1997borukhov,2007kilic,2009li,2009li2,2013li,2011lu}. Therefore, the PB-steric equation can be regarded as a generalized model of mPB equations.


title: Machine Translation Robustness to Natural Asemantic Variation

abstract: Current Machine Translation (MT) models still struggle with more challenging input, such as noisy data and tail-end words and phrases. Several works have addressed this robustness issue by identifying specific categories of noise and variation then tuning models to perform better on them. An important yet under-studied category involves minor variations in nuance (non-typos) that preserve meaning w.r.t. the target language. We introduce and formalize this category as Natural Asemantic Variation (NAV) and investigate it in the context of MT robustness. We find that existing MT models fail when presented with NAV data, but we demonstrate strategies to improve performance on NAV by fine-tuning them with human-generated variations. We also show that NAV robustness can be transferred across languages and find that synthetic perturbations can achieve some but not all of the benefits of organic NAV data.


title: Toward Discovering Options that Achieve Faster Planning

abstract: We propose a new objective for option discovery that emphasizes the computational advantage of using options in planning. In a sequential machine, the speed of planning is proportional to the number of elementary operations used to achieve a good policy. For episodic tasks, the number of elementary operations depends on the number of options composed by the policy in an episode and the number of options being considered at each decision point. To reduce the amount of computation in planning, for a given set of episodic tasks and a given number of options, our objective prefers options with which it is possible to achieve a high return by composing few options, and also prefers a smaller set of options to choose from at each decision point. We develop an algorithm that optimizes the proposed objective. In a variant of the classic four-room domain, we show that 1) a higher objective value is typically associated with fewer number of elementary planning operations used by the option-value iteration algorithm to obtain a near-optimal value function, 2) our algorithm achieves an objective value that matches it achieved by two human-designed options 3) the amount of computation used by option-value iteration with options discovered by our algorithm matches it with the human-designed options, 4) the options produced by our algorithm also make intuitive sense--they seem to move to and terminate at the entrances of rooms.


title: Unveiling the relative timing jitter in counter propagating all normal dispersion (CANDi) dual-comb fiber laser

abstract: Counter-propagating all-normal dispersion (CANDi) fiber laser is an emerging high-energy single-cavity dual-comb laser source. Its relative timing jitter (RTJ), a critical parameter for dual-comb timing precision and spectral resolution, has not been comprehensively investigated. In this paper, we enhance the state-of-the-art CANDi fiber laser pulse energy from 1 nJ to 8 nJ. We then introduce a novel reference-free RTJ characterization technique that provides shot-to-shot measurement capability at femtosecond precision for the first time. The measurement noise floor reaches 1.6x10-7 fs2/Hz, and the corresponding integrated measurement precision is only 1.8 fs (1 kHz, 20 MHz). With this new characterization tool, we are able to study the physical origin of CANDi laser's RTJ in detail. We first verify that the cavity length fluctuation does not contribute to the RTJ. Then we measure the integrated RTJ to be 39 fs (1 kHz, 20 MHz) and identify the pump relative intensity noise (RIN) to be the dominant factor responsible for it. In particular, pump RIN is coupled to the RTJ through the Gordon-Haus effect. Finally, solutions to reduce the free-running CANDi laser's RTJ are discussed. This work provides a general guideline to improve the performance of compact single-cavity dual-comb systems like CANDi laser benefitting various dual-comb applications.


title: Vanishing Noether Current in Weyl Invariant Gravities

abstract: We revisit the issue that the Noether current associated with a local scale symmtery, or equivalently the Weyl symmetry, identically vanishes. Based on only the second Noether theorem for a local symmetry, we prove that the Noether current associated with the Weyl symmetry is in general vanishing in any Weyl invariant gravitational theories in four dimensional Riemannian geometry. We also clarify the reason: The Weyl transformation is non-dynamical in the sense that it does not contain the derivative term of the transformation parameter as opposed to the conventional gauge transformation. Finally, we apply this result to a quantum theory of a general Weyl invariant gravity and derive currents associated with choral symmetry, which is the $IOSp(10|10)$ supersymmetry.


title: Centre Vortex Structure of QCD-Vacuum Fields and Confinement

abstract: The non-trivial ground-state vacuum fields of QCD form the foundation of matter. Using modern visualisation techniques, this presentation examines the microscopic structure of these fields. Of particular interest are the centre vortices identified within the ground-state fields of lattice QCD. Our current focus is on understanding the manner in which dynamical fermions in the QCD vacuum alter the centre-vortex structure. The impact of dynamical fermions is significant and provides new insights into the role of centre vortices in underpinning both confinement and dynamical chiral symmetry breaking in QCD.


title: Structure Aware and Class Balanced 3D Object Detection on nuScenes Dataset

abstract: 3-D object detection is pivotal for autonomous driving. Point cloud based methods have become increasingly popular for 3-D object detection, owing to their accurate depth information. NuTonomy's nuScenes dataset greatly extends commonly used datasets such as KITTI in size, sensor modalities, categories, and annotation numbers. However, it suffers from severe class imbalance. The Class-balanced Grouping and Sampling paper addresses this issue and suggests augmentation and sampling strategy. However, the localization precision of this model is affected by the loss of spatial information in the downscaled feature maps. We propose to enhance the performance of the CBGS model by designing an auxiliary network, that makes full use of the structure information of the 3D point cloud, in order to improve the localization accuracy. The detachable auxiliary network is jointly optimized by two point-level supervisions, namely foreground segmentation and center estimation. The auxiliary network does not introduce any extra computation during inference, since it can be detached at test time.


title: Molecular Absorption Effect: A Double-edged Sword of Terahertz Communications

abstract: Communications in the terahertz band (THz) (0.1--10~THz) have been regarded as a promising technology for future 6G and beyond wireless systems, to overcome the challenges of evergrowing wireless data traffic and crowded spectrum. As the frequency increases from the microwave band to the THz band, new spectrum features pose unprecedented challenges to wireless communication system design. The molecular absorption effect is one of the new THz spectrum properties, which enlarges the path loss and noise at specific frequencies. This brings in a double-edged sword for THz wireless communication systems. On one hand, from the data rate viewpoint, molecular absorption is detrimental, since it mitigates the received signal power and degrades the channel capacity. On the other hand, it is worth noticing that for wireless security and covertness, the molecular absorption effect can be utilized to safeguard THz communications among users. In this paper, the features of the molecular absorption effect and their impact on the THz system design are analyzed under various scenarios, with the ultimate goal of providing guidelines to how better exploit this unique THz phenomenon. Specifically, since the molecular absorption greatly depends on the propagation medium, different communication scenarios consisting of various media are discussed, including terrestrial, air and space, sea surface and nano-scale communications. Furthermore, two novel molecular absorption enlightened secure and covert communication schemes are presented, where the molecular absorption effect is utilized as the key and unique feature to boost security and covertness.


title: Existence and multiplicity of solutions for a class of Kirchhoff type $(\Phi_1,\Phi_2)$-Laplacian system with locally super-linear condition in $\mathbb{R}^N$

abstract: We investigate the existence and multiplicity of weak solutions for a nonlinear Kirchhoff type quasilinear elliptic system on the whole space $\mathbb{R}^N$. We assume that the nonlinear term satisfies the locally super-$(m_1,m_2)$ condition, that is, $\lim_{|(u,v)|\rightarrow+\infty}\frac{F(x,u,v)}{|u|^{m_1}+|v|^{m_2}}=+\infty \mbox{ for a.e. } x \in G$ where $G$ is a domain in $\mathbb{R}^N$, which is weaker than the well-known Ambrosseti-Rabinowitz condition and the naturally global restriction, $\lim_{|(u,v)|\rightarrow+\infty}\frac{F(x,u,v)}{|u|^{m_1}+|v|^{m_2}}=+\infty \mbox{ for a.e. } x \in \mathbb{R}^N$. We obtain that system has at least one weak solution by using the classical Mountain Pass Theorem. To a certain extent, our theorems extend the results of Tang-Lin-Yu [Journal of Dynamics and Differential Equations, 2019, 31(1): 369-383]. Moreover, under the above naturally global restriction, we obtain that system has infinitely many weak solutions of high energy by using the Symmetric Mountain Pass Theorem, which is different from those results of Wang-Zhang-Fang [Journal of Nonlinear Sciences and Applications, 2017, 10(7): 3792-3814] even if we consider the system on the bounded domain with Dirichlet boundary condition.


title: Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset

abstract: Research in massively multilingual image captioning has been severely hampered by a lack of high-quality evaluation datasets. In this paper we present the Crossmodal-3600 dataset (XM3600 in short), a geographically diverse set of 3600 images annotated with human-generated reference captions in 36 languages. The images were selected from across the world, covering regions where the 36 languages are spoken, and annotated with captions that achieve consistency in terms of style across all languages, while avoiding annotation artifacts due to direct translation. We apply this benchmark to model selection for massively multilingual image captioning models, and show superior correlation results with human evaluations when using XM3600 as golden references for automatic metrics.


title: TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation

abstract: Direct speech-to-speech translation (S2ST) with discrete units leverages recent progress in speech representation learning. Specifically, a sequence of discrete representations derived in a self-supervised manner are predicted from the model and passed to a vocoder for speech reconstruction, while still facing the following challenges: 1) Acoustic multimodality: the discrete units derived from speech with same content could be indeterministic due to the acoustic property (e.g., rhythm, pitch, and energy), which causes deterioration of translation accuracy; 2) high latency: current S2ST systems utilize autoregressive models which predict each unit conditioned on the sequence previously generated, failing to take full advantage of parallelism. In this work, we propose TranSpeech, a speech-to-speech translation model with bilateral perturbation. To alleviate the acoustic multimodal problem, we propose bilateral perturbation (BiP), which consists of the style normalization and information enhancement stages, to learn only the linguistic information from speech samples and generate more deterministic representations. With reduced multimodality, we step forward and become the first to establish a non-autoregressive S2ST technique, which repeatedly masks and predicts unit choices and produces high-accuracy results in just a few cycles. Experimental results on three language pairs demonstrate that BiP yields an improvement of 2.9 BLEU on average compared with a baseline textless S2ST model. Moreover, our parallel decoding shows a significant reduction of inference latency, enabling speedup up to 21.4x than autoregressive technique. Audio samples are available at \url{https://TranSpeech.github.io/}


title: Accelerating Diffusion Models via Early Stop of the Diffusion Process

abstract: Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a sample in DDPMs can be regarded as iteratively denoising a randomly sampled Gaussian noise. However, in practice DDPMs often need hundreds even thousands of denoising steps to obtain a high-quality sample from the Gaussian noise, leading to extremely low inference efficiency. In this work, we propose a principled acceleration strategy, referred to as Early-Stopped DDPM (ES-DDPM), for DDPMs. The key idea is to stop the diffusion process early where only the few initial diffusing steps are considered and the reverse denoising process starts from a non-Gaussian distribution. By further adopting a powerful pre-trained generative model, such as GAN and VAE, in ES-DDPM, sampling from the target non-Gaussian distribution can be efficiently achieved by diffusing samples obtained from the pre-trained generative model. In this way, the number of required denoising steps is significantly reduced. In the meantime, the sample quality of ES-DDPM also improves substantially, outperforming both the vanilla DDPM and the adopted pre-trained generative model. On extensive experiments across CIFAR-10, CelebA, ImageNet, LSUN-Bedroom and LSUN-Cat, ES-DDPM obtains promising acceleration effect and performance improvement over representative baseline methods. Moreover, ES-DDPM also demonstrates several attractive properties, including being orthogonal to existing acceleration methods, as well as simultaneously enabling both global semantic and local pixel-level control in image generation.


title: The algebra of thin measurable operators is directly finite

abstract: Let $\mathcal{M}$ be a semifinite von Neumann algebra on a Hilbert space $\mathcal{H}$ equipped with a faithful normal semifinite trace $\tau$, $S(\mathcal{M},\tau)$ be the ${}^*$-algebra of all $\tau$-measurable operators. Let $S_0(\mathcal{M},\tau)$ be the ${}^*$-algebra of all $\tau$-compact operators and $T(\mathcal{M},\tau)=S_0(\mathcal{M},\tau)+\mathbb{C}I$ be the ${}^*$-algebra of all operators $X=A+\lambda I$ with $A\in S_0(\mathcal{M},\tau)$ and $\lambda \in \mathbb{C}$. We prove that every operator of $T(\mathcal{M},\tau)$ that is left-invertible in $T(\mathcal{M},\tau)$ is in fact invertible in $T(\mathcal{M},\tau)$. It is a generalization of Sterling Berberian theorem (1982) on the subalgebra of thin operators in $\mathcal{B} (\mathcal{H})$. For the singular value function $\mu(t; Q)$ of $Q=Q^2\in S(\mathcal{M},\tau)$ we have $\mu(t; Q)\in \{0\}\bigcup [1, +\infty)$ for all $t>0$. It gives the positive answer to the question posed by Daniyar Mushtari in 2010.


title: Faddeev fixed-center approximation to the $D\bar{D}K$ system and the hidden charm $K_{c\bar{c}}(4180)$ state

abstract: We perform a theoretical study on the $D\bar{D}K$ three body system, using the fixed center approximation to the Faddeev equations, considering the interaction between $D$ and $K$, $D$ and $\bar{D}$ from the chiral unitary approach. We assume the scattering of $K$ meson on a clusterized system $D\bar{D}$, where a scalar meson $X(3720)$ could be formed. Thanks to the strong $DK$ interaction, where the scalar $D^*_{s0}(2317)$ meson is dynamically generated, a resonance structure shows up in the modulus squared of the three body $K$-$(D\bar{D})_{X(3720)}$ scattering amplitude and supports that a $D\bar{D}K$ bound state can be formed. The result is in agreement with previous theoretical studies, which claim a new excited hidden charm $K$ meson, $K_{c\bar{c}}(4180)$ with quantum numbers $I(J^P) = \frac{1}{2}(0^-)$ and mass about $4180$ MeV. It is expected that these theoretical results motivate its search in experimental measurements.


title: Segmenting Numerical Substitution Ciphers

abstract: Deciphering historical substitution ciphers is a challenging problem. Example problems that have been previously studied include detecting cipher type, detecting plaintext language, and acquiring the substitution key for segmented ciphers. However, attacking unsegmented, space-free ciphers is still a challenging task. Segmentation (i.e. finding substitution units) is the first step towards cracking those ciphers. In this work, we propose the first automatic methods to segment those ciphers using Byte Pair Encoding (BPE) and unigram language models. Our methods achieve an average segmentation error of 2\% on 100 randomly-generated monoalphabetic ciphers and 27\% on 3 real homophonic ciphers. We also propose a method for solving non-deterministic ciphers with existing keys using a lattice and a pretrained language model. Our method leads to the full solution of the IA cipher; a real historical cipher that has not been fully solved until this work.


title: LOPS: Learning Order Inspired Pseudo-Label Selection for Weakly Supervised Text Classification

abstract: Weakly supervised text classification methods typically train a deep neural classifier based on pseudo-labels. The quality of pseudo-labels is crucial to final performance but they are inevitably noisy due to their heuristic nature, so selecting the correct ones has a huge potential for performance boost. One straightforward solution is to select samples based on the softmax probability scores in the neural classifier corresponding to their pseudo-labels. However, we show through our experiments that such solutions are ineffective and unstable due to the erroneously high-confidence predictions from poorly calibrated models. Recent studies on the memorization effects of deep neural models suggest that these models first memorize training samples with clean labels and then those with noisy labels. Inspired by this observation, we propose a novel pseudo-label selection method LOPS that takes learning order of samples into consideration. We hypothesize that the learning order reflects the probability of wrong annotation in terms of ranking, and therefore, propose to select the samples that are learnt earlier. LOPS can be viewed as a strong performance-boost plug-in to most of existing weakly-supervised text classification methods, as confirmed in extensive experiments on four real-world datasets.


title: Orbital hybridization and electrostatic interaction in a double molecule transistor

abstract: Understanding the intermolecular interactions and utilize these interactions to effectively control the transport behavior of single molecule is the key step from single molecule device to molecular circuits1-6. Although many single molecule detection techniques are used to detect the molecular interaction at single-molecule level1,4,5,7,8, probing and tuning the intermolecular interaction all by electrical approaches has not been demonstrated. In this work, we successful assemble a double molecule transistor incorporating two manganese phthalocyanine molecules, on which we probe and tune the interaction in situ by implementing electrical manipulation on molecular orbitals using gate voltage. Orbital levels of the two molecules couple to each other and couple to the universal gate differently. Electrostatic interaction is observed when single electron changing in one molecule alters the transport behavior of the other, providing the information about the dynamic process of electron sequent tunneling through a molecule. Orbital hybridization is found when two orbital levels are put into degeneracy under non-equilibrium condition, making the tunneling electrons no longer localized to a specific molecule but shared by two molecules, offering a new mechanism to control charge transfer between non-covalent molecules. Current work offer a forelook into working principles of functional electrical unit based on single molecules.


title: Monotonicity, convexity, and inequalities for functions involving gamma function

abstract: In this paper, we study some properties such as the monotonicity, logarithmically complete monotonicity, logarithmic convexity, and geometric convexity, of the combinations of gamma function and power function. The results we obtain generalize some related known results for parameters with specific values.


title: Systematic bias due to eccentricity in parameter estimation for merging binary neutron stars

abstract: We study the impact of eccentricity on gravitational-wave parameter estimation for binary neutron star systems. For signals with small eccentricity injected into the advanced LIGO sensitivity, we perform Bayesian parameter estimation using the circular waveform model and show how the recovered parameters can be biased from their true values, focusing on the intrinsic parameters the chirp mass ($M_c$), the symmetric mass ratio ($\eta$), and the tidal deformability ($\tilde{\lambda}$). By comparing the results between the Bayesian and the analytic Fisher-Cutler-Vallisneri (FCV) methods, we obtain the valid criteria for the FCV approach. Employing the FCV method and using the realistic population of binary neutron star sources distributed in the $m_1$-$m_2$-$e_0$ space, where $e_0$ indicates the eccentricity at 10Hz, we calculate the measurement errors ($\sigma_{\theta}$) and the systematic biases ($\Delta \theta/\sigma_{\theta}$) and obtain their generalized distributions in the range of $0 \leq e_0 \leq 0.025$. We find that for all of the three parameters, the biases increase with increasing $e_0$, and this increase is faster for larger $e_0$. The bias is mainly dependent on the value of $e_0$ and weakly dependent on the component masses, and thus the distribution shows a narrow band in the $e_0$-$\Delta \theta/\sigma_{\theta}$ plane. We present various posterior examples to illustrate our new findings, such as the bimodality of posteriors. In particular, we give a specific injection-recovery example to demonstrate the importance of including eccentricity in parameter estimation to avoid incorrect predictions of the neutron star equation of state.