title: Fast and Reliable Formal Verification of Smart Contracts with the Move Prover

abstract: The Move Prover (MVP) is a formal verifier for smart contracts written in the Move programming language. MVP has an expressive specification language, and is fast and reliable enough that it can be run routinely by developers and in integration testing in a few minutes. Besides the simplicity of smart contracts and the Move language, three transformations are responsible for the practicality of MVP: (1) an alias-free memory model, (2) fine-grained invariant checking, and (3) monomorphization. The entirety of the Move code for the Diem blockchain has been extensively specified and can be completely verified by MVP in a few minutes. Changes in the Diem framework must be successfully verified before being integrated into the open source repository on GitHub.


title: Spatio-temporal extreme event modeling of terror insurgencies

abstract: Extreme events with potential deadly outcomes, such as those organized by terror groups, are highly unpredictable in nature and an imminent threat to society. In particular, quantifying the likelihood of a terror attack occurring in an arbitrary space-time region and its relative societal risk, would facilitate informed measures that would strengthen national security. This paper introduces a novel self-exciting marked spatio-temporal model for attacks whose inhomogeneous baseline intensity is written as a function of covariates. Its triggering intensity is succinctly modeled with a Gaussian Process prior distribution to flexibly capture intricate spatio-temporal dependencies between an arbitrary attack and previous terror events. By inferring the parameters of this model, we highlight specific space-time areas in which attacks are likely to occur. Furthermore, by measuring the outcome of an attack in terms of the number of casualties it produces, we introduce a novel mixture distribution for the number of casualties. This distribution flexibly handles low and high number of casualties and the discrete nature of the data through a {\it Generalized ZipF} distribution. We rely on a customized Markov chain Monte Carlo (MCMC) method to estimate the model parameters. We illustrate the methodology with data from the open source Global Terrorism Database (GTD) that correspond to attacks in Afghanistan from 2013-2018. We show that our model is able to predict the intensity of future attacks for 2019-2021 while considering various covariates of interest such as population density, number of regional languages spoken, and the density of population supporting the opposing government.


title: Orthogonal Transforms for Signals on Directed Graphs

abstract: In this paper we consider the problem of defining transforms for signals on directed graphs, with a specific focus on defective graphs where the corresponding graph operator cannot be diagonalized. Our proposed method is based on the Schur decomposition and leads to a series of embedded invariant subspaces for which orthogonal basis are available. As compared to diffusion wavelets, our method is more flexible in the generation of subspaces, but these subspaces can only be approximately orthogonal.


title: Counting Objects by Diffused Index: geometry-free and training-free approach

abstract: Counting objects is a fundamental but challenging problem. In this paper, we propose diffusion-based, geometry-free, and learning-free methodologies to count the number of objects in images. The main idea is to represent each object by a unique index value regardless of its intensity or size, and to simply count the number of index values. First, we place different vectors, refer to as seed vectors, uniformly throughout the mask image. The mask image has boundary information of the objects to be counted. Secondly, the seeds are diffused using an edge-weighted harmonic variational optimization model within each object. We propose an efficient algorithm based on an operator splitting approach and alternating direction minimization method, and theoretical analysis of this algorithm is given. An optimal solution of the model is obtained when the distributed seeds are completely diffused such that there is a unique intensity within each object, which we refer to as an index. For computational efficiency, we stop the diffusion process before a full convergence, and propose to cluster these diffused index values. We refer to this approach as Counting Objects by Diffused Index (CODI). We explore scalar and multi-dimensional seed vectors. For Scalar seeds, we use Gaussian fitting in histogram to count, while for vector seeds, we exploit a high-dimensional clustering method for the final step of counting via clustering. The proposed method is flexible even if the boundary of the object is not clear nor fully enclosed. We present counting results in various applications such as biological cells, agriculture, concert crowd, and transportation. Some comparisons with existing methods are presented.


title: Unity yield of deterministically positioned quantum dot single photon sources

abstract: We report on a platform for the production of single photon devices with a fabrication yield of 100%. The sources are based on InAsP quantum dots embedded within position-controlled bottom-up InP nanowires. Using optimized growth conditions, we produce large arrays of structures having highly uniform geometries. Collection efficiencies are as high as 83% and multiphoton emission probabilities as low as 0.6% with the distribution away from optimal values associated with the excitation of other charge complexes and re-excitation processes, respectively, inherent to the above-band excitation employed. Importantly, emission peak lineshapes have Lorentzian profiles indicating that linewidths are not limited by inhomogeneous broadening but rather pure dephasing, likely elastic carrier-phonon scattering due to a high phonon occupation. This work establishes nanowire-based devices as a viable route for the scalable fabrication of efficient single photon sources and provides a valuable resource for hybrid on-chip platforms currently being developed.


title: Dropping diversity of products of large US firms: Models and measures

abstract: It is widely assumed that in our lifetimes the products available in the global economy have become more diverse. This assumption is difficult to investigate directly, however, because it is difficult to collect the necessary data about every product in an economy each year. We solve this problem by mining publicly available textual descriptions of the products of every large US firms each year from 1997 to 2017. Although many aspects of economic productivity have been steadily rising during this period, our text-based measurements show that the diversity of the products of at least large US firms has steadily declined. This downward trend is visible using a variety of product diversity metrics, including some that depend on a measurement of the similarity of the products of every single pair of firms. The current state of the art in comprehensive and detailed firm-similarity measurements is a Boolean word vector model due to Hoberg and Phillips. We measure diversity using firm-similarities from this Boolean model and two more sophisticated variants, and we consistently observe a significant dropping trend in product diversity. These results make it possible to frame and start to test specific hypotheses for explaining the dropping product diversity trend.


title: Existence and convergence of a discontinuous Galerkin method for the incompressible three-phase flow problem in porous media

abstract: This paper presents and analyzes a discontinuous Galerkin method for the incompressible three-phase flow problem in porous media. We use a first order time extrapolation which allows us to solve the equations implicitly and sequentially. We show that the discrete problem is well-posed, and obtain a priori error estimates. Our numerical results validate the theoretical results, i.e. the algorithm converges with first order.


title: Modification of transition radiation by three-dimensional topological insulators

abstract: We study how transition radiation is modified by the presence of a generic magnetoelectric medium with a special focus on topological insulators. To this end, we use the Green's function for the electromagnetic field in presence of a plane interface between two topological insulators with different topological parameters, permittivities and permeabilities. We employ the far-field approximation together with the steepest descent method to obtain approximate analytical expressions for the electromagnetic field. Through this method we find that the electric field is a superposition of spherical waves and lateral waves. Contributions of both kind can be attributed to a purely topological origin. After computing the angular distribution of the radiation, we find that in a region far from the interface the main contribution to the radiation comes from the spherical waves. We present typical radiation patterns for the topological insulator TlBiSe$_2$ and the magnetoelectric TbPO$_4$. In the ultra-relativistic case, the additional contributions from the magnetoelectric coupling appreciably enhance the global maximum of the angular distribution. We also present an analytic expression for the frequency distribution of the radiation for this case. We find that in the limit where the permittivities are equal there still exists transition radiation of the order of the square of the topological parameter with a pure topological origin.


title: Training Dynamics for Text Summarization Models

abstract: Pre-trained language models (e.g. BART) have shown impressive results when fine-tuned on large summarization datasets. However, little is understood about this fine-tuning process, including what knowledge is retained from pre-training time or how content selection and generation strategies are learnt across iterations. In this work, we analyze the training dynamics for generation models, focusing on summarization. Across different datasets (CNN/DM, XSum, MediaSum) and summary properties, such as abstractiveness and hallucination, we study what the model learns at different stages of its fine-tuning process. We find that a propensity to copy the input is learned early in the training process consistently across all datasets studied. On the other hand, factual errors, such as hallucination of unsupported facts, are learnt in the later stages, though this behavior is more varied across domains. Based on these observations, we explore complementary approaches for modifying training: first, disregarding high-loss tokens that are challenging to learn and second, disregarding low-loss tokens that are learnt very quickly in the latter stages of the training process. We show that these simple training modifications allow us to configure our model to achieve different goals, such as improving factuality or improving abstractiveness.


title: Hurwitz equivalence of reflection factorizations in $G_7$

abstract: We prove that two reflection factorizations of a given element in an exceptional rank-2 complex reflection group of tetrahedral type are Hurwitz-equivalent if and only if they generate the same subgroup and have the same multiset of conjugacy classes.


title: Well-posedness and blowup for the dispersion-managed nonlinear Schr\"odinger equation

abstract: We consider the nonlinear Schr\"odinger equation with periodic dispersion management. We first establish global-in-time Strichartz estimates for the underlying linear equation with suitable dispersion maps. As an application, we establish a small-data scattering result for the $3d$ cubic equation. Finally, we use a virial argument to demonstrate the existence of blowup solutions for the $3d$ cubic equation with piecewise constant dispersion map.


title: The radio SZ effect as a probe of the cosmological radio background

abstract: If there is a substantial cosmological radio background, there should be a radio Sunyaev-Zeldovich (SZ) effect that goes along with it. The radio background Comptonization leads to a slight photon excess at all wavelengths, while Comptonization of the CMB at low frequencies leads to a decrement. For levels of the radio background consistent with observations, these effects cancel each other around $\nu\simeq 735~$MHz, with an excess at lower frequencies and a decrement at higher frequencies. Assuming a purely cosmological origin of the observed ARCADE radio excess, at $\nu \lesssim 20\,{\rm GHz}$ the signal scales as $\Delta T / T_{\rm CMB}\simeq 2\,y\left[ (\nu/735\,{\rm MHz})^{-2.59}-1\right]$ with frequency and the Compton-$y$ parameter of the cluster. For a typical cluster, the total radio SZ signal is at the level of $\Delta T\simeq 1\,{\rm mK}$ around the null, with a steep scaling towards radio frequencies. This is above current raw sensitivity limits for many radio facilities at these wavelengths, providing a unique way to confirm the cosmological origin of the ARCADE excess and probe its properties (e.g., redshift dependence and isotropy). We also give an expression to compute the radio-analogue of the kinematic SZ effect, highlighting that this might provide a new tool to probe large-scale velocity fields and the cosmic evolution of the radio background.


title: Gemini: Practical Reconfigurable Datacenter Networks with Topology and Traffic Engineering

abstract: To reduce cost, datacenter network operators are exploring blocking network designs. An example of such a design is a "spine-free" form of a Fat-Tree, in which pods directly connect to each other, rather than via spine blocks. To maintain application-perceived performance in the face of dynamic workloads, these new designs must be able to reconfigure routing and the inter-pod topology. Gemini is a system designed to achieve these goals on commodity hardware while reconfiguring the network infrequently, rendering these blocking designs practical enough for deployment in the near future. The key to Gemini is the joint optimization of topology and routing, using as input a robust estimation of future traffic derived from multiple historical traffic matrices. Gemini "hedges" against unpredicted bursts, by spreading these bursts across multiple paths, to minimize packet loss in exchange for a small increase in path lengths. It incorporates a robust decision algorithm to determine when to reconfigure, and whether to use hedging. Data from tens of production fabrics allows us to categorize these as either low-or high-volatility; these categories seem stable. For the former, Gemini finds topologies and routing with near-optimal performance and cost. For the latter, Gemini's use of multi-traffic-matrix optimization and hedging avoids the need for frequent topology reconfiguration, with only marginal increases in path length. As a result, Gemini can support existing workloads on these production fabrics using a spine-free topology that is half the cost of the existing topology on these fabrics.


title: Least Squares on GPUs in Multiple Double Precision

abstract: This paper describes the application of the code generated by the CAMPARY software to accelerate the solving of linear systems in the least squares sense on Graphics Processing Units (GPUs), in double double, quad double, and octo double precision. The goal is to use accelerators to offset the cost overhead caused by multiple double precision arithmetic. For the blocked Householder QR and the back substitution, of interest are those dimensions at which teraflop performance is attained. The other interesting question is the cost overhead factor that appears each time the precision is doubled. Experimental results are reported on five different NVIDIA GPUs, with a particular focus on the P100 and the V100, both capable of teraflop performance. Thanks to the high Compute to Global Memory Access (CGMA) ratios of multiple double arithmetic, teraflop performance is already attained running the double double QR on 1,024-by-1,024 matrices, both on the P100 and the V100. For the back substitution, the dimension of the upper triangular system must be as high as 17,920 to reach one teraflops on the V100, in quad double precision, and then taking only the times spent by the kernels into account. The lower performance of the back substitution in small dimensions does not prevent teraflop performance of the solver at dimension 1,024, as the time for the QR decomposition dominates. In doubling the precision from double double to quad double and from quad double to octo double, the observed cost overhead factors are lower than the factors predicted by the arithmetical operation counts. This observation correlates with the increased performance for increased precision, which can again be explained by the high CGMA ratios.


title: Shelling with MoS$_2$ Functional CuS@MoS2 Hybrids as Electrocatalysts for the Oxygen Reduction and Hydrogen Evolution Reactions

abstract: The development of noble-metal free electrocatalysts is of high importance for clean energy conversion applications. MoS$_2$ has been considered as a promising low cost catalyst for the hydrogen evolution reaction (HER), however its activity is limited by poor conductivity and low abundance of active sites. Moreover, its suitability as an effective catalyst for other reactions, in particluar the oxygen reduction reaction (ORR), was hardly explored to date. Herein, we show hybrid nanostructures of shelled CuS particles with MoS$_2$ layers, which produces several outcomes: The MoS$_2$ shell is strained and defective, and charge transfer from the core to MoS$_2$ occurs, enabling activation of the basal plane of MoS$_2$. Changing the feed ratio of the precursors led to control over morphology, such that the wrapping of the cores with the shell was continuously varied and characterized. We found an optimal hybrid structure, which provided high electrochemical active surface area and fast charge transfer kinetics, leading to improved activity not only towards HER (overpotential of 225 mV at 10 mA cm$^{-1}$), but also for the sluggish ORR (onset potential 0.87 V vs RHE).


title: Starkit: RoboCup Humanoid KidSize 2021 Worldwide Champion Team Paper

abstract: This article is devoted to the features that were under development between RoboCup 2019 Sydney and RoboCup 2021 Worldwide. These features include vision-related matters, such as detection and localization, mechanical and algorithmic novelties. Since the competition was held virtually, the simulation-specific features are also considered in the article. We give an overview of the approaches that were tried out along with the analysis of their preconditions, perspectives and the evaluation of their performance.


title: FedSLD: Federated Learning with Shared Label Distribution for Medical Image Classification

abstract: Machine learning in medical research, by nature, needs careful attention on obeying the regulations of data privacy, making it difficult to train a machine learning model over gathered data from different medical centers. Failure of leveraging data of the same kind may result in poor generalizability for the trained model. Federated learning (FL) enables collaboratively training a joint model while keeping the data decentralized for multiple medical centers. However, federated optimizations often suffer from the heterogeneity of the data distribution across medical centers. In this work, we propose Federated Learning with Shared Label Distribution (FedSLD) for classification tasks, a method that assumes knowledge of the label distributions for all the participating clients in the federation. FedSLD adjusts the contribution of each data sample to the local objective during optimization given knowledge of the distribution, mitigating the instability brought by data heterogeneity across all clients. We conduct extensive experiments on four publicly available image datasets with different types of non-IID data distributions. Our results show that FedSLD achieves better convergence performance than the compared leading FL optimization algorithms, increasing the test accuracy by up to 5.50 percentage points.


title: Orbits in bootstrapped Newtonian gravity

abstract: Bootstrapped Newtonian gravity is a non-linear version of Newton's law which can be lifted to a fully geometric theory of gravity starting from a modified potential. Here, we study geodesics in the bootstrapped Newtonian effective metric in vacuum and obtain bounds on a free parameter from Solar System data and S-star orbits near our Galaxy centre. These bounds make vacuum bootstrapped Newtonian gravity experimentally indistinguishable from General Relativity.


title: Dicke superradiance in ordered lattices: dimensionality matters

abstract: Dicke superradiance in ordered atomic arrays is a phenomenon where atomic synchronization gives rise to a burst in photon emission. This superradiant burst only occurs if there is one -- or just a few -- dominant decay channels. For a fixed atom number, this happens only below a critical interatomic distance. Here we show that array dimensionality is the determinant factor that drives superradiance. In 2D and 3D arrays, superradiance occurs due to constructive interference, which grows stronger with atom number. This leads to a critical distance that scales sublogarithmically with atom number in 2D, and as a power law in 3D. In 1D arrays, superradiance occurs due to destructive interference that effectively switches off certain decay channels, yielding a critical distance that saturates with atom number. Our results provide a guide to explore many-body decay in state-of-the art experimental setups.


title: On The Ingredients of an Effective Zero-shot Semantic Parser

abstract: Semantic parsers map natural language utterances into meaning representations (e.g., programs). Such models are typically bottlenecked by the paucity of training data due to the required laborious annotation efforts. Recent studies have performed zero-shot learning by synthesizing training examples of canonical utterances and programs from a grammar, and further paraphrasing these utterances to improve linguistic diversity. However, such synthetic examples cannot fully capture patterns in real data. In this paper we analyze zero-shot parsers through the lenses of the language and logical gaps (Herzig and Berant, 2019), which quantify the discrepancy of language and programmatic patterns between the canonical examples and real-world user-issued ones. We propose bridging these gaps using improved grammars, stronger paraphrasers, and efficient learning methods using canonical examples that most likely reflect real user intents. Our model achieves strong performance on two semantic parsing benchmarks (Scholar, Geo) with zero labeled data.


title: A Neural Network Ensemble Approach to System Identification

abstract: We present a new algorithm for learning unknown governing equations from trajectory data, using and ensemble of neural networks. Given samples of solutions $x(t)$ to an unknown dynamical system $\dot{x}(t)=f(t,x(t))$, we approximate the function $f$ using an ensemble of neural networks. We express the equation in integral form and use Euler method to predict the solution at every successive time step using at each iteration a different neural network as a prior for $f$. This procedure yields M-1 time-independent networks, where M is the number of time steps at which $x(t)$ is observed. Finally, we obtain a single function $f(t,x(t))$ by neural network interpolation. Unlike our earlier work, where we numerically computed the derivatives of data, and used them as target in a Lipschitz regularized neural network to approximate $f$, our new method avoids numerical differentiations, which are unstable in presence of noise. We test the new algorithm on multiple examples both with and without noise in the data. We empirically show that generalization and recovery of the governing equation improve by adding a Lipschitz regularization term in our loss function and that this method improves our previous one especially in presence of noise, when numerical differentiation provides low quality target data. Finally, we compare our results with the method proposed by Raissi, et al. arXiv:1801.01236 (2018) and with SINDy.


title: Training Conversational Agents with Generative Conversational Networks

abstract: Rich, open-domain textual data available on the web resulted in great advancements for language processing. However, while that data may be suitable for language processing tasks, they are mostly non-conversational, lacking many phenomena that appear in human interactions and this is one of the reasons why we still have many unsolved challenges in conversational AI. In this work, we attempt to address this by using Generative Conversational Networks to automatically generate data and train social conversational agents. We evaluate our approach on TopicalChat with automatic metrics and human evaluators, showing that with 10% of seed data it performs close to the baseline that uses 100% of the data.


title: Experimental quantification of unsteady leading-edge flow separation

abstract: We propose here a method to experimentally quantify unsteady leading-edge flow separation on aerofoils with finite thickness. The methodology relies on the computation of a leading-edge suction parameter based on measured values of the partial circulation around the leading-edge and the stagnation point location. We validate the computation of the leading-edge suction parameter for both numerical and experimental data under steady and unsteady flow conditions. The leading-order approximation of the definition of the leading-edge suction parameter is proven to be sufficiently accurate for the application to thin aerofoils such as the NACA0009 without a-priori knowledge of the stagnation point location. The higher-order terms including the stagnation point location are required to reliably compute the leading-edge suction parameter on thicker aerofoils such as the NACA0015. The computation of the leading-edge suction parameter from inviscid flow theory does not assume the Kutta condition to be valid at the trailing edge which allows us to compute its value for separated flows. The relation between the leading-edge suction parameter and the evolution of the shear layer height is studied in two different unsteady flow conditions, a fixed aerofoil in a fluctuating free-stream velocity and a pitching aerofoil in a steady free-stream. We demonstrate here that the instantaneous value of the leading-edge suction parameter based on the partial circulation around the leading edge is unambiguously defined for a given flow field and can serve as a directly quantitative measure of the degree of unsteady flow separation at the leading edge.


title: Robust Correlation Clustering with Asymmetric Noise

abstract: Graph clustering problems typically aim to partition the graph nodes such that two nodes belong to the same partition set if and only if they are similar. Correlation Clustering is a graph clustering formulation which: (1) takes as input a signed graph with edge weights representing a similarity/dissimilarity measure between the nodes, and (2) requires no prior estimate of the number of clusters in the input graph. However, the combinatorial optimization problem underlying Correlation Clustering is NP-hard. In this work, we propose a novel graph generative model, called the Node Factors Model (NFM), which is based on generating feature vectors/embeddings for the graph nodes. The graphs generated by the NFM contain asymmetric noise in the sense that there may exist pairs of nodes in the same cluster which are negatively correlated. We propose a novel Correlation Clustering algorithm, called \anormd, using techniques from semidefinite programming. Using a combination of theoretical and computational results, we demonstrate that $\texttt{$\ell_2$-norm-diag}$ recovers nodes with sufficiently strong cluster membership in graph instances generated by the NFM, thereby making progress towards establishing the provable robustness of our proposed algorithm.


title: Multi-class quantum classifiers with tensor network circuits for quantum phase recognition

abstract: Hybrid quantum-classical algorithms based on variational circuits are a promising approach to quantum machine learning problems for near-term devices, but the selection of the variational ansatz is an open issue. Recently, tensor network-inspired circuits have been proposed as a natural choice for such ansatz. Their employment on binary classification tasks provided encouraging results. However, their effectiveness on more difficult tasks is still unknown. Here, we present numerical experiments on multi-class classifiers based on tree tensor network and multiscale entanglement renormalization ansatz circuits. We conducted experiments on image classification with the MNIST dataset and on quantum phase recognition with the XXZ model by Cirq and TensorFlow Quantum. In the former case, we reduced the number of classes to four to match the aimed output based on 2 qubits. The quantum data of the XXZ model consist of three classes of ground states prepared by a checkerboard circuit used for the ansatz of the variational quantum eigensolver, corresponding to three distinct quantum phases. Test accuracy turned out to be 59%-93% and 82%-96% respectively, depending on the model architecture and on the type of preprocessing.


title: Generated Knowledge Prompting for Commonsense Reasoning

abstract: It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting, which consists of generating knowledge from a language model, then providing the knowledge as additional input when answering a question. Our method does not require task-specific supervision for knowledge integration, or access to a structured knowledge base, yet it improves performance of large-scale, state-of-the-art models on four commonsense reasoning tasks, achieving state-of-the-art results on numerical commonsense (NumerSense), general commonsense (CommonsenseQA 2.0), and scientific commonsense (QASC) benchmarks. Generated knowledge prompting highlights large-scale language models as flexible sources of external knowledge for improving commonsense reasoning. Our code is available at https://github.com/liujch1998/GKP


title: Probing as Quantifying Inductive Bias

abstract: Pre-trained contextual representations have led to dramatic performance improvements on a range of downstream tasks. Such performance improvements have motivated researchers to quantify and understand the linguistic information encoded in these representations. In general, researchers quantify the amount of linguistic information through probing, an endeavor which consists of training a supervised model to predict a linguistic property directly from the contextual representations. Unfortunately, this definition of probing has been subject to extensive criticism in the literature, and has been observed to lead to paradoxical and counter-intuitive results. In the theoretical portion of this paper, we take the position that the goal of probing ought to be measuring the amount of inductive bias that the representations encode on a specific task. We further describe a Bayesian framework that operationalizes this goal and allows us to quantify the representations' inductive bias. In the empirical portion of the paper, we apply our framework to a variety of NLP tasks. Our results suggest that our proposed framework alleviates many previous problems found in probing. Moreover, we are able to offer concrete evidence that -- for some tasks -- fastText can offer a better inductive bias than BERT.


title: Tweed and wireframe: accelerated relaxation algorithms for multigrid solution of elliptic PDEs on stretched structured grids

abstract: Two new relaxation schemes are proposed for the smoothing step in the geometric multigrid solution of PDEs on 2D and 3D stretched structured grids. The new schemes are characterized by efficient line relaxation on branched sets of lines of alternating colour, where the lines are constructed to be everywhere orthogonal to the local direction of maximum grid clustering. Tweed relaxation is best suited for grid clustering near the boundaries of the computational domain, whereas wireframe relaxation is best suited for grid clustering near the centre of the computational domain. On strongly stretched grids of these types, multigrid leveraging these new smoothing schemes significantly outperforms multigrid based on other leading relaxation schemes, such as checkerboard and alternating-direction zebra relaxation, for the numerical solution of large linear systems arising from the discretization of elliptic PDEs.


title: Non-Isolated Single-Switch Zeta Based High-Step up DC-DC Converter with Coupled Inductor

abstract: In this paper, a non-isolated high step-up DC-DC converter has been proposed for renewable energy applications. The proposed structure converter has been derived from the fundamental Zeta converter, in both of which only a single switch is employed. The voltage gain ratio has considerably enhanced in this converter with the absence of using switched capacity. To magnify voltage gain of the converter, a coupled-inductor has adopted. Increase and decrease of gain by changing the ratio of coupled-inductor assist the duty cycle. The number of components is low in this structure. The operating principle and evaluation of the proposed converter, considering designing approaches for elements, are discussed in detail. To verify the feasibility of the proposed converter, simulation results have been provided and evaluated.


title: A reduced unified continuum formulation for vascular fluid-structure interaction

abstract: We recently derived the unified continuum and variational multiscale formulation for fluid-structure interaction (FSI) using the Gibbs free energy. Restricting our attention to vascular FSI, we now reduce this arbitrary Lagrangian-Eulerian (ALE) formulation by adopting three assumptions for the vascular wall. The resulting reduced unified continuum formulation achieves monolithic FSI coupling in the Eulerian frame through a simple modification of the fluid boundary integral. While ostensibly similar to the semi-discrete formulation of the coupled momentum method, its underlying derivation does not rely on an assumption of a fictitious body force in the elastodynamics sub-problem and therefore represents a direct simplification of the ALE method. Uniform temporal discretization is performed via the generalized-$\alpha$ scheme. In contrast to the predominant approach yielding only first-order accuracy for pressure, we collocate both pressure and velocity at the intermediate time step to achieve uniform second-order temporal accuracy. In conjunction with quadratic tetrahedral elements, our methodology offers higher-order temporal and spatial accuracy for quantities of clinical interest. Furthermore, without loss of consistency, a segregated predictor multi-corrector algorithm is developed to preserve the same block structure as for the incompressible Navier-Stokes equations in the implicit solver's associated linear system. Block preconditioning of a monolithically coupled FSI system is therefore made possible for the first time. Compared to alternative preconditioners, our three-level nested block preconditioner, which improves representation of the Schur complement, demonstrates robust performance over a wide range of physical parameters. We present verification against Womersley's deformable wall theory and additionally develop practical modeling techniques for clinical applications.


title: Intersection formulas for parities on virtual knots

abstract: We prove that parities on virtual knots come from invariant 1-cycles on the arcs of knot diagrams. In turn, the invariant cycles are determined by quasi-indices on the crossings of the diagrams. The found connection between the parities and the (quasi)-indices allows to define a new series of parities on virtual knots.


title: A Bayesian Approach for Medical Inquiry and Disease Inference in Automated Differential Diagnosis

abstract: We propose a Bayesian approach for both medical inquiry and disease inference, the two major phases in differential diagnosis. Unlike previous work that simulates data from given probabilities and uses ML algorithms on them, we directly use the Quick Medical Reference (QMR) belief network, and apply Bayesian inference in the inference phase and Bayesian experimental design in the inquiry phase. Moreover, we improve the inquiry phase by extending the Bayesian experimental design framework from one-step search to multi-step search. Our approach has some practical advantages as it is interpretable, free of costly training, and able to adapt to new changes without any additional effort. Our experiments show that our approach achieves new state-of-the-art results on two simulated datasets, SymCAT and HPO, and competitive results on two diagnosis dialogue datasets, Muzhi and Dxy.


title: Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning

abstract: Conventional federated learning (FL) trains one global model for a federation of clients with decentralized data, reducing the privacy risk of centralized training. However, the distribution shift across non-IID datasets, often poses a challenge to this one-model-fits-all solution. Personalized FL aims to mitigate this issue systematically. In this work, we propose APPLE, a personalized cross-silo FL framework that adaptively learns how much each client can benefit from other clients' models. We also introduce a method to flexibly control the focus of training APPLE between global and local objectives. We empirically evaluate our method's convergence and generalization behaviors, and perform extensive experiments on two benchmark datasets and two medical imaging datasets under two non-IID settings. The results show that the proposed personalized FL framework, APPLE, achieves state-of-the-art performance compared to several other personalized FL approaches in the literature. The code is publicly available at https://github.com/ljaiverson/pFL-APPLE.


title: DS-TOD: Efficient Domain Specialization for Task Oriented Dialog

abstract: Recent work has shown that self-supervised dialog-specific pretraining on large conversational datasets yields substantial gains over traditional language modeling (LM) pretraining in downstream task-oriented dialog (TOD). These approaches, however, exploit general dialogic corpora (e.g., Reddit) and thus presumably fail to reliably embed domain-specific knowledge useful for concrete downstream TOD domains. In this work, we investigate the effects of domain specialization of pretrained language models (PLMs) for TOD. Within our DS-TOD framework, we first automatically extract salient domain-specific terms, and then use them to construct DomainCC and DomainReddit -- resources that we leverage for domain-specific pretraining, based on (i) masked language modeling (MLM) and (ii) response selection (RS) objectives, respectively. We further propose a resource-efficient and modular domain specialization by means of domain adapters -- additional parameter-light layers in which we encode the domain knowledge. Our experiments with prominent TOD tasks -- dialog state tracking (DST) and response retrieval (RR) -- encompassing five domains from the MultiWOZ benchmark demonstrate the effectiveness of DS-TOD. Moreover, we show that the light-weight adapter-based specialization (1) performs comparably to full fine-tuning in single domain setups and (2) is particularly suitable for multi-domain specialization, where besides advantageous computational footprint, it can offer better TOD performance.


title: Comparing Human and Machine Bias in Face Recognition

abstract: Much recent research has uncovered and discussed serious concerns of bias in facial analysis technologies, finding performance disparities between groups of people based on perceived gender, skin type, lighting condition, etc. These audits are immensely important and successful at measuring algorithmic bias but have two major challenges: the audits (1) use facial recognition datasets which lack quality metadata, like LFW and CelebA, and (2) do not compare their observed algorithmic bias to the biases of their human alternatives. In this paper, we release improvements to the LFW and CelebA datasets which will enable future researchers to obtain measurements of algorithmic bias that are not tainted by major flaws in the dataset (e.g. identical images appearing in both the gallery and test set). We also use these new data to develop a series of challenging facial identification and verification questions that we administered to various algorithms and a large, balanced sample of human reviewers. We find that both computer models and human survey participants perform significantly better at the verification task, generally obtain lower accuracy rates on dark-skinned or female subjects for both tasks, and obtain higher accuracy rates when their demographics match that of the question. Computer models are observed to achieve a higher level of accuracy than the survey participants on both tasks and exhibit bias to similar degrees as the human survey participants.


title: Invertible spectra of finite type

abstract: We describe the necessary and sufficient numerical condition when an element $X$ in the Picard group of $K(2)$-local category at prime $p \geqslant 5$ is of finite type, i.e., $\pi_kX$ is finitely generated as a $\mathbb{Z}_p$-module for all $k \in \mathbb{Z}$.


title: Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networks

abstract: We present a new method for one shot domain adaptation. The input to our method is trained GAN that can produce images in domain A and a single reference image I_B from domain B. The proposed algorithm can translate any output of the trained GAN from domain A to domain B. There are two main advantages of our method compared to the current state of the art: First, our solution achieves higher visual quality, e.g. by noticeably reducing overfitting. Second, our solution allows for more degrees of freedom to control the domain gap, i.e. what aspects of image I_B are used to define the domain B. Technically, we realize the new method by building on a pre-trained StyleGAN generator as GAN and a pre-trained CLIP model for representing the domain gap. We propose several new regularizers for controlling the domain gap to optimize the weights of the pre-trained StyleGAN generator to output images in domain B instead of domain A. The regularizers prevent the optimization from taking on too many attributes of the single reference image. Our results show significant visual improvements over the state of the art as well as multiple applications that highlight improved control.


title: Measurement of the EMC effect in light and heavy nuclei

abstract: Inclusive electron scattering from nuclear targets has been measured to extract the nuclear dependence of the inelastic cross section in Hall C at the Thomas Jefferson National Accelerator facility. Results are presented for 2H, 3He, 4He, 9B, 12C, 63Cu and 197Au at an incident electron beam energy of 5.77 GeV for a range of momentum transfer from Q^2 = 2 to 7 (GeV/c)^2. These data improve the precision of the existing measurements of the EMC effect in the nuclear targets at large x, and allow for more detailed examinations of the A dependence of the EMC effect.


title: The MWA Long Baseline Epoch of Reionisation Survey: I. Improved Source Catalogue for the EoR 0 field

abstract: One of the principal systematic constraints on the Epoch of Reionisation (EoR) experiment is the accuracy of the foreground calibration model. Recent results have shown that highly accurate models of extended foreground sources, and including models for sources in both the primary beam and its sidelobes, are necessary for reducing foreground power. To improve the accuracy of the source models for the EoR fields observed by the Murchison Widefield Array (MWA), we conducted the MWA Long Baseline Epoch of Reionisation Survey (LoBES). This survey consists of multi-frequency observations of the main MWA EoR fields and their eight neighbouring fields using the MWA Phase II extended array. We present the results of the first half of this survey centred on the MWA EoR0 observing field (centred at RA(J2000) 0 h, Dec(J2000) -27 deg). This half of the survey covers an area of 3069 degrees$^2$, with an average rms of 2.1 mJy beam$^{-1}$. The resulting catalogue contains a total of 80824 sources, with 16 separate spectral measurements between 100 and 230 MHz, and spectral modelling for 78$\%$ of these sources. Over this region we estimate that the catalogue is 90$\%$ complete at 32 mJy, and 70$\%$ complete at 10.5~mJy. The overall normalised source counts are found to be in good agreement with previous low-frequency surveys at similar sensitivities. Testing the performance of the new source models we measure lower residual rms values for peeled sources, particularly for extended sources, in a set of MWA Phase I data. The 2-dimensional power spectrum of these data residuals also show improvement on small angular scales -- consistent with the better angular resolution of the LoBES catalogue. It is clear that the LoBES sky models improve upon the current sky model used by the Australian MWA EoR group for the EoR0 field.


title: Simultaneous Monitoring of Multiple People's Vital Sign Leveraging a Single Phased-MIMO Radar

abstract: Vital sign monitoring plays a critical role in tracking the physiological state of people and enabling various health-related applications (e.g., recommending a change of lifestyle, examining the risk of diseases). Traditional approaches rely on hospitalization or body-attached instruments, which are costly and intrusive. Therefore, researchers have been exploring contact-less vital sign monitoring with radio frequency signals in recent years. Early studies with continuous wave radars/WiFi devices work on detecting vital signs of a single individual, but it still remains challenging to simultaneously monitor vital signs of multiple subjects, especially those who locate in proximity. In this paper, we design and implement a time-division multiplexing (TDM) phased-MIMO radar sensing scheme for high-precision vital sign monitoring of multiple people. Our phased-MIMO radar can steer the mmWave beam towards different directions with a micro-second delay, which enables capturing the vital signs of multiple individuals at the same radial distance to the radar. Furthermore, we develop a TDM-MIMO technique to fully utilize all transmitting antenna (TX)-receiving antenna (RX) pairs, thereby significantly boosting the signal-to-noise ratio. Based on the designed TDM phased-MIMO radar, we develop a system to automatically localize multiple human subjects and estimate their vital signs. Extensive evaluations show that under two-subject scenarios, our system can achieve an error of less than 1 beat per minute (BPM) and 3 BPM for breathing rate (BR) and heartbeat rate (HR) estimations, respectively, at a subject-to-radar distance of $1.6~m$. The minimal subject-to-subject angle separation is $40{\deg}$, corresponding to a close distance of $0.5~m$ between two subjects, which outperforms the state-of-the-art.


title: sbp-env: Sampling-based Motion Planners' Testing Environment

abstract: Sampling-based motion planners' testing environment (sbp-env) is a full feature framework to quickly test different sampling-based algorithms for motion planning. sbp-env focuses on the flexibility of tinkering with different aspects of the framework, and had divided the main planning components into two categories (i) samplers and (ii) planners. The focus of motion planning research had been mainly on (i) improving the sampling efficiency (with methods such as heuristic or learned distribution) and (ii) the algorithmic aspect of the planner using different routines to build a connected graph. Therefore, by separating the two components one can quickly swap out different components to test novel ideas.


title: Nalanda: A Socio-Technical Graph for Building Software Analytics Tools at Enterprise Scale

abstract: Software development is information-dense knowledge work that requires collaboration with other developers and awareness of artifacts such as work items, pull requests, and files. With the speed of development increasing, information overload is a challenge for people developing and maintaining these systems. Finding information and people is difficult for software engineers, especially when they work in large software systems or have just recently joined a project. In this paper, we build a large scale data platform named Nalanda platform, which contains two subsystems: 1. A large scale socio-technical graph system, named Nalanda graph system 2. A large scale recommendation system, named Nalanda index system that aims at satisfying the information needs of software developers. The Nalanda graph is an enterprise scale graph with data from 6,500 repositories, with 37,410,706 nodes and 128,745,590 edges. On top of the Nalanda graph system, we built software analytics applications including a newsfeed named MyNalanda, and based on organic growth alone, it has Daily Active Users (DAU) of 290 and Monthly Active Users (MAU) of 590. A preliminary user study shows that 74% of developers and engineering managers surveyed are favorable toward continued use of the platform for information discovery. The Nalanda index system constitutes two indices: artifact index and expert index. It uses the socio-technical graph (Nalanda graph system) to rank the results and provide better recommendations to software developers. A large scale quantitative evaluation shows that the Nalanda index system provides recommendations with an accuracy of 78% for the top three recommendations.


title: Mathematical Responses to the Hole Argument: Then and Now

abstract: We argue that several apparently distinct responses to the hole argument, all invoking formal or mathematical considerations, should be viewed as a unified "mathematical response". We then consider and rebut two prominent critiques of the mathematical response before reflecting on what is ultimately at issue in this literature.


title: Bloch Spectra for High Contrast Elastic Media

abstract: Analytic representation formulas and power series are developed to describe the band structure inside periodic elastic crystals made from high contrast inclusions. We use source free modes associated with structural spectra to represent the solution operator of the Lam\'e system inside phononic crystals. Convergent power series for the Bloch wave spectrum are obtained using the representation formulas. An explicit bound on the convergence radius is given through the structural spectra of the inclusion array and the Dirichlet spectra of the inclusions. Sufficient conditions for the separation of spectral branches of the dispersion relation for any fixed quasi-momentum are identified.


title: Surrogate- and invariance-boosted contrastive learning for data-scarce applications in science

abstract: Deep learning techniques have been increasingly applied to the natural sciences, e.g., for property prediction and optimization or material discovery. A fundamental ingredient of such approaches is the vast quantity of labelled data needed to train the model; this poses severe challenges in data-scarce settings where obtaining labels requires substantial computational or labor resources. Here, we introduce surrogate- and invariance-boosted contrastive learning (SIB-CL), a deep learning framework which incorporates three ``inexpensive'' and easily obtainable auxiliary information sources to overcome data scarcity. Specifically, these are: 1)~abundant unlabeled data, 2)~prior knowledge of symmetries or invariances and 3)~surrogate data obtained at near-zero cost. We demonstrate SIB-CL's effectiveness and generality on various scientific problems, e.g., predicting the density-of-states of 2D photonic crystals and solving the 3D time-independent Schrodinger equation. SIB-CL consistently results in orders of magnitude reduction in the number of labels needed to achieve the same network accuracies.

categories: cs.LG cond-mat.mtrl-sci physics.app-ph physics.optics


title: Bridging the gap between paired and unpaired medical image translation

abstract: Medical image translation has the potential to reduce the imaging workload, by removing the need to capture some sequences, and to reduce the annotation burden for developing machine learning methods. GANs have been used successfully to translate images from one domain to another, such as MR to CT. At present, paired data (registered MR and CT images) or extra supervision (e.g. segmentation masks) is needed to learn good translation models. Registering multiple modalities or annotating structures within each of them is a tedious and laborious task. Thus, there is a need to develop improved translation methods for unpaired data. Here, we introduce modified pix2pix models for tasks CT$\rightarrow$MR and MR$\rightarrow$CT, trained with unpaired CT and MR data, and MRCAT pairs generated from the MR scans. The proposed modifications utilize the paired MR and MRCAT images to ensure good alignment between input and translated images, and unpaired CT images ensure the MR$\rightarrow$CT model produces realistic-looking CT and CT$\rightarrow$MR model works well with real CT as input. The proposed pix2pix variants outperform baseline pix2pix, pix2pixHD and CycleGAN in terms of FID and KID, and generate more realistic looking CT and MR translations.


title: Understanding the Origins of Problem Geomagnetic Storms Associated With "Stealth" Coronal Mass Ejections

abstract: Geomagnetic storms are an important aspect of space weather and can result in significant impacts on space- and ground-based assets. The majority of strong storms are associated with the passage of interplanetary coronal mass ejections (ICMEs) in the near-Earth environment. In many cases, these ICMEs can be traced back unambiguously to a specific coronal mass ejection (CME) and solar activity on the frontside of the Sun. Hence, predicting the arrival of ICMEs at Earth from routine observations of CMEs and solar activity currently makes a major contribution to the forecasting of geomagnetic storms. However, it is clear that some ICMEs, which may also cause enhanced geomagnetic activity, cannot be traced back to an observed CME, or, if the CME is identified, its origin may be elusive or ambiguous in coronal images. Such CMEs have been termed "stealth CMEs." In this review, we focus on these "problem" geomagnetic storms in the sense that the solar/CME precursors are enigmatic and stealthy. We start by reviewing evidence for stealth CMEs discussed in past studies. We then identify several moderate to strong geomagnetic storms (minimum Dst < -50 nT) in solar cycle 24 for which the related solar sources and/or CMEs are unclear and apparently stealthy. We discuss the solar and in situ circumstances of these events and identify several scenarios that may account for their elusive solar signatures. These range from observational limitations (e.g., a coronagraph near Earth may not detect an incoming CME if it is diffuse and not wide enough) to the possibility that there is a class of mass ejections from the Sun that have only weak or hard-to-observe coronal signatures. In particular, some of these sources are only clearly revealed by considering the evolution of coronal structures over longer time intervals than is usually considered. We also review a variety of numerical modelling approaches...


title: Exact big Ramsey degrees for finitely constrained binary free amalgamation classes

abstract: We characterize the big Ramsey degrees of free amalgamation classes in finite binary languages defined by finitely many forbidden irreducible substructures, thus refining the recent upper bounds given by Zucker. Using this characterization, we show that the Fra\"iss\'e limit of each such class admits a strong big Ramsey structure, implying that the automorphism group of the Fra\"iss\'e limit has a metrizable universal completion flow.


title: Covariate Adjustment in Regression Discontinuity Designs

abstract: The Regression Discontinuity (RD) design is a widely used non-experimental method for causal inference and program evaluation. While its canonical formulation only requires a score and an outcome variable, it is common in empirical work to encounter RD analyses where additional variables are used for adjustment. This practice has led to misconceptions about the role of covariate adjustment in RD analysis, from both methodological and empirical perspectives. In this chapter, we review the different roles of covariate adjustment in RD designs, and offer methodological guidance for its correct use.


title: Multi-group Gaussian Processes

abstract: Gaussian processes (GPs) are pervasive in functional data analysis, machine learning, and spatial statistics for modeling complex dependencies. Modern scientific data sets are typically heterogeneous and often contain multiple known discrete subgroups of samples. For example, in genomics applications samples may be grouped according to tissue type or drug exposure. In the modeling process it is desirable to leverage the similarity among groups while accounting for differences between them. While a substantial literature exists for GPs over Euclidean domains $\mathbb{R}^p$, GPs on domains suitable for multi-group data remain less explored. Here, we develop a multi-group Gaussian process (MGGP), which we define on $\mathbb{R}^p\times \mathscr{C}$, where $\mathscr{C}$ is a finite set representing the group label. We provide general methods to construct valid (positive definite) covariance functions on this domain, and we describe algorithms for inference, estimation, and prediction. We perform simulation experiments and apply MGGP to gene expression data to illustrate the behavior and advantages of the MGGP in the joint modeling of continuous and categorical variables.


title: Evaluating the Faithfulness of Importance Measures in NLP by Recursively Masking Allegedly Important Tokens and Retraining

abstract: To explain NLP models a popular approach is to use importance measures, such as attention, which inform input tokens are important for making a prediction. However, an open question is how well these explanations accurately reflect a model's logic, a property called faithfulness. To answer this question, we propose Recursive ROAR, a new faithfulness metric. This works by recursively masking allegedly important tokens and then retraining the model. The principle is that this should result in worse model performance compared to masking random tokens. The result is a performance curve given a masking-ratio. Furthermore, we propose a summarizing metric using relative area-between-curves (RACU), which allows for easy comparison across papers, models, and tasks. We evaluate 4 different importance measures on 8 different datasets, using both LSTM-attention models and RoBERTa models. We find that the faithfulness of importance measures is both model-dependent and task-dependent. This conclusion contradicts previous evaluations in both computer vision and faithfulness of attention literature.


title: Invariant Language Modeling

abstract: Large pretrained language models are critical components of modern NLP pipelines. Yet, they suffer from spurious correlations, poor out-of-domain generalization, and biases. Inspired by recent progress in causal machine learning, in particular the invariant risk minimization (IRM) paradigm, we propose invariant language modeling, a framework for learning invariant representations that generalize better across multiple environments. In particular, we adapt a game-theoretic formulation of IRM (IRM-games) to language models, where the invariance emerges from a specific training schedule in which all the environments compete to optimize their own environment-specific loss by updating subsets of the model in a round-robin fashion. We focus on controlled experiments to precisely demonstrate the ability of our method to (i) remove structured noise, (ii) ignore specific spurious correlations without affecting global performance, and (iii) achieve better out-of-domain generalization. These benefits come with a negligible computational overhead compared to standard training, do not require changing the local loss, and can be applied to any language model. We believe this framework is promising to help mitigate spurious correlations and biases in language models.


title: Graph-Theoretic Approach to Quantum Error Correction

abstract: We investigate a novel class of quantum error correcting codes to correct errors on both qubits and higher-state quantum systems represented as qudits. These codes arise from an original graph-theoretic representation of sets of quantum errors. In this new framework, we represent the algebraic conditions for error correction in terms of edge avoidance between graphs providing a visual representation of the interplay between errors and error correcting codes. Most importantly, this framework supports the development of quantum codes that correct against a predetermined set of errors, in contrast to current methods. A heuristic algorithm is presented, providing steps to develop codes that correct against an arbitrary noisy channel. We benchmark the correction capability of reflexive stabilizer codes for the case of single qubit errors by comparison to existing stabilizer codes that are widely used. In addition, we present two instances of optimal encodings: an optimal encoding for fully correlated noise which achieves a higher encoding rate than previously known, and a minimal encoding for single qudit errors on a four-state system.


title: Multilingual unsupervised sequence segmentation transfers to extremely low-resource languages

abstract: We show that unsupervised sequence-segmentation performance can be transferred to extremely low-resource languages by pre-training a Masked Segmental Language Model (Downey et al., 2021) multilingually. Further, we show that this transfer can be achieved by training over a collection of low-resource languages that are typologically similar (but phylogenetically unrelated) to the target language. In our experiments, we transfer from a collection of 10 Indigenous American languages (AmericasNLP, Mager et al., 2021) to K'iche', a Mayan language. We compare our multilingual model to a monolingual (from-scratch) baseline, as well as a model pre-trained on Quechua only. We show that the multilingual pre-trained approach yields consistent segmentation quality across target dataset sizes, exceeding the monolingual baseline in 6/10 experimental settings. Our model yields especially strong results at small target sizes, including a zero-shot performance of 20.6 F1. These results have promising implications for low-resource NLP pipelines involving human-like linguistic units, such as the sparse transcription framework proposed by Bird (2020).


title: A model for the electric field-driven deformation of a drop or vesicle in strong electrolyte solutions

abstract: A model is constructed to describe the arbitrary deformation of a drop or vesicle that contains and is embedded in an electrolyte solution, where the deformation is caused by an applied electric field. The applied field produces an electrokinetic flow or induced charge electro-osmosis. The model is based on the coupled Poisson-Nernst-Planck and Stokes equations. These are reduced or simplified by forming the limit of strong electrolytes, for which ion densities are relatively large, together with the limit of thin Debye layers. Debye layers of opposite polarity form on either side of the drop interface or vesicle membrane, together forming an electrical double layer. Two formulations of the model are given. One utilizes an integral equation for the velocity field on the interface or membrane surface together with a pair of integral equations for the electrostatic potential on the outer faces of the double layer. The other utilizes a form of the stress-balance boundary condition that incorporates the double layer structure into relations between the dependent variables on the layer's outer faces. This constitutes an interfacial boundary condition that drives an otherwise unforced Stokes flow outside the double layer. For both formulations relations derived from the transport of ions in each Debye layer give additional boundary conditions for the potential and ion concentrations outside the double layer.


title: Open Domain Question Answering with A Unified Knowledge Interface

abstract: The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond text, accessing heterogeneous knowledge sources through a unified interface remains an open question. While data-to-text generation has the potential to serve as a universal interface for data and text, its feasibility for downstream tasks remains largely unknown. In this work, we bridge this gap and use the data-to-text method as a means for encoding structured knowledge for ODQA. Specifically, we propose a verbalizer-retriever-reader framework for ODQA over data and text where verbalized tables from Wikipedia and graphs from Wikidata are used as augmented knowledge sources. We show that our Unified Data and Text QA, UDT-QA, can effectively benefit from the expanded knowledge index, leading to large gains over text-only baselines. Notably, our approach sets the single-model state-of-the-art on Natural Questions. Furthermore, our analyses indicate that verbalized knowledge is preferred for answer reasoning for both adapted and hot-swap settings.


title: Nuances in Margin Conditions Determine Gains in Active Learning

abstract: We consider nonparametric classification with smooth regression functions, where it is well known that notions of margin in $E[Y|X]$ determine fast or slow rates in both active and passive learning. Here we elucidate a striking distinction between the two settings. Namely, we show that some seemingly benign nuances in notions of margin -- involving the uniqueness of the Bayes classifier, and which have no apparent effect on rates in passive learning -- determine whether or not any active learner can outperform passive learning rates. In particular, for Audibert-Tsybakov's margin condition (allowing general situations with non-unique Bayes classifiers), no active learner can gain over passive learning in commonly studied settings where the marginal on $X$ is near uniform. Our results thus negate the usual intuition from past literature that active rates should improve over passive rates in nonparametric settings.


title: Robustness Challenges in Model Distillation and Pruning for Natural Language Understanding

abstract: Recent work has focused on compressing pre-trained language models (PLMs) like BERT where the major focus has been to improve the in-distribution performance for downstream tasks. However, very few of these studies have analyzed the impact of compression on the generalizability and robustness of compressed models for out-of-distribution (OOD) data. Towards this end, we study two popular model compression techniques including knowledge distillation and pruning and show that the compressed models are significantly less robust than their PLM counterparts on OOD test sets although they obtain similar performance on in-distribution development sets for a task. Further analysis indicates that the compressed models overfit on the shortcut samples and generalize poorly on the hard ones. We further leverage this observation to develop a regularization strategy for robust model compression based on sample uncertainty. Experimental results on several natural language understanding tasks demonstrate that our bias mitigation framework improves the OOD generalization of the compressed models, while not sacrificing the in-distribution task performance.


title: Understanding Dataset Difficulty with $\mathcal{V}$-Usable Information

abstract: Estimating the difficulty of a dataset typically involves comparing state-of-the-art models to humans; the bigger the performance gap, the harder the dataset is said to be. However, this comparison provides little understanding of how difficult each instance in a given distribution is, or what attributes make the dataset difficult for a given model. To address these questions, we frame dataset difficulty -- w.r.t. a model $\mathcal{V}$ -- as the lack of $\mathcal{V}$-$\textit{usable information}$ (Xu et al., 2019), where a lower value indicates a more difficult dataset for $\mathcal{V}$. We further introduce $\textit{pointwise $\mathcal{V}$-information}$ (PVI) for measuring the difficulty of individual instances w.r.t. a given distribution. While standard evaluation metrics typically only compare different models for the same dataset, $\mathcal{V}$-$\textit{usable information}$ and PVI also permit the converse: for a given model $\mathcal{V}$, we can compare different datasets, as well as different instances/slices of the same dataset. Furthermore, our framework allows for the interpretability of different input attributes via transformations of the input, which we use to discover annotation artefacts in widely-used NLP benchmarks.


title: Dataset Knowledge Transfer for Class-Incremental Learning without Memory

abstract: Incremental learning enables artificial agents to learn from sequential data. While important progress was made by exploiting deep neural networks, incremental learning remains very challenging. This is particularly the case when no memory of past data is allowed and catastrophic forgetting has a strong negative effect. We tackle class-incremental learning without memory by adapting prediction bias correction, a method which makes predictions of past and new classes more comparable. It was proposed when a memory is allowed and cannot be directly used without memory, since samples of past classes are required. We introduce a two-step learning process which allows the transfer of bias correction parameters between reference and target datasets. Bias correction is first optimized offline on reference datasets which have an associated validation memory. The obtained correction parameters are then transferred to target datasets, for which no memory is available. The second contribution is to introduce a finer modeling of bias correction by learning its parameters per incremental state instead of the usual past vs. new class modeling. The proposed dataset knowledge transfer is applicable to any incremental method which works without memory. We test its effectiveness by applying it to four existing methods. Evaluation with four target datasets and different configurations shows consistent improvement, with practically no computational and memory overhead.


title: Toward Uncensorable, Anonymous and Private Access Over Satoshi Blockchains

abstract: Providing unrestricted access to sensitive content such as news and software is difficult in the presence of adaptive and resourceful surveillance and censoring adversaries. In this paper we leverage the distributed and resilient nature of commercial Satoshi blockchains to develop the first provably secure, censorship resistant, cost-efficient storage system with anonymous and private access, built on top of commercial cryptocurrency transactions. We introduce max-rate transactions, a practical construct to persist data of arbitrary size entirely in a Satoshi blockchain. We leverage max-rate transactions to develop UWeb, a blockchain-based storage system that charges publishers to self-sustain its decentralized infrastructure. UWeb organizes blockchainstored content for easy retrieval, and enables clients to store and access content with provable anonymity, privacy and censorship resistance properties. We present results from UWeb experiments with writing 268.21 MB of data into the live Litecoin blockchain, including 4.5 months of live-feed BBC articles, and 41 censorship resistant tools. The max-rate writing throughput (183 KB/s) and blockchain utilization (88%) exceed those of state-of-the-art solutions by 2-3 orders of magnitude and broke Litecoin's record of the daily average block size. Our simulations with up to 3,000 concurrent UWeb writers confirm that UWeb does not impact the confirmation delays of financial transactions.


title: Finding Backdoors to Integer Programs: A Monte Carlo Tree Search Framework

abstract: In Mixed Integer Linear Programming (MIP), a (strong) backdoor is a "small" subset of an instance's integer variables with the following property: in a branch-and-bound procedure, the instance can be solved to global optimality by branching only on the variables in the backdoor. Constructing datasets of pre-computed backdoors for widely used MIP benchmark sets or particular problem families can enable new questions around novel structural properties of a MIP, or explain why a problem that is hard in theory can be solved efficiently in practice. Existing algorithms for finding backdoors rely on sampling candidate variable subsets in various ways, an approach which has demonstrated the existence of backdoors for some instances from MIPLIB2003 and MIPLIB2010. However, these algorithms fall short of consistently succeeding at the task due to an imbalance between exploration and exploitation. We propose BaMCTS, a Monte Carlo Tree Search framework for finding backdoors to MIPs. Extensive algorithmic engineering, hybridization with traditional MIP concepts, and close integration with the CPLEX solver have enabled our method to outperform baselines on MIPLIB2017 instances, finding backdoors more frequently and more efficiently.


title: Deep learning-based detection of intravenous contrast in computed tomography scans

abstract: Purpose: Identifying intravenous (IV) contrast use within CT scans is a key component of data curation for model development and testing. Currently, IV contrast is poorly documented in imaging metadata and necessitates manual correction and annotation by clinician experts, presenting a major barrier to imaging analyses and algorithm deployment. We sought to develop and validate a convolutional neural network (CNN)-based deep learning (DL) platform to identify IV contrast within CT scans. Methods: For model development and evaluation, we used independent datasets of CT scans of head, neck (HN) and lung cancer patients, totaling 133,480 axial 2D scan slices from 1,979 CT scans manually annotated for contrast presence by clinical experts. Five different DL models were adopted and trained in HN training datasets for slice-level contrast detection. Model performances were evaluated on a hold-out set and on an independent validation set from another institution. DL models was then fine-tuned on chest CT data and externally validated on a separate chest CT dataset. Results: Initial DICOM metadata tags for IV contrast were missing or erroneous in 1,496 scans (75.6%). The EfficientNetB4-based model showed the best overall detection performance. For HN scans, AUC was 0.996 in the internal validation set (n = 216) and 1.0 in the external validation set (n = 595). The fine-tuned model on chest CTs yielded an AUC: 1.0 for the internal validation set (n = 53), and AUC: 0.980 for the external validation set (n = 402). Conclusion: The DL model could accurately detect IV contrast in both HN and chest CT scans with near-perfect performance.


title: Exact Bias Correction for Linear Adjustment of Randomized Controlled Trials

abstract: In an influential critique of empirical practice, Freedman (2008) showed that the linear regression estimator was biased for the analysis of randomized controlled trials under the randomization model. Under Freedman's assumptions, we derive exact closed-form bias corrections for the linear regression estimator with and without treatment-by-covariate interactions. We show that the limiting distribution of the bias corrected estimator is identical to the uncorrected estimator, implying that the asymptotic gains from adjustment can be attained without introducing any risk of bias. Taken together with results from Lin (2013), our results show that Freedman's theoretical arguments against the use of regression adjustment can be completely resolved with minor modifications to practice.


title: EncT5: A Framework for Fine-tuning T5 as Non-autoregressive Models

abstract: Pre-trained encoder-decoder transformer architectures have become increasingly popular recently with the advent of T5 models. T5 has also become more favorable over other architectures like BERT due to the amount of data that it is pre-trained on, increased scale of model parameter sizes and easy applicability to a diverse set of tasks due to the generative nature of the model. While being able to generalize to a wide variety of tasks, it is not clear that encoder-decoder architectures are the most efficient for fine-tuning tasks that don't require auto-regressive decoding. In this work, we study fine-tuning pre-trained encoder-decoder models for tasks such as classification, multi-label classification, and structured prediction. We propose \textbf{EncT5}, a framework for these problems, and illustrate instantiations for these tasks. Our experiment results show that EncT5 has advantages over T5 such as efficiency and usability out performs BERT when evaluated on publicly available pre-trained checkpoints.


title: COVID-19 Detection in Chest X-ray Images Using Swin-Transformer and Transformer in Transformer

abstract: The Coronavirus Disease 2019 (COVID-19) has spread globally and caused serious damage. Chest X-ray images are widely used for COVID-19 diagnosis and the Artificial Intelligence method can increase efficiency and accuracy. In the Challenge of Chest XR COVID-19 detection in Ethics and Explainability for Responsible Data Science (EE-RDS) conference 2021, we proposed a method that combined Swin Transformer and Transformer in Transformer to classify chest X-ray images as three classes: COVID-19, Pneumonia, and Normal (healthy) and achieved 0.9475 accuracies on the test set.


title: Quillen homology of spectral Lie algebras with application to mod $p$ homology of labeled configuration spaces

abstract: We provide a general method computing the mod $p$ Quillen homology of algebras over a monad that parametrizes the structure of mod $p$ homology of spectral Lie algebras. This is the $E^2$-page of the bar spectral sequence converging to the mod $p$ topological Quillen homology of spectral Lie algebras. The computation of the Quillen homology of the trivial algebra allows us to deduce that the $\mathbb F_p$-linear spectral Lie operad is not formal. As an application, we study the mod $p$ homology of the labeled configuration space $B_k(M;X)$ in a manifold $M$ with labels in a spectrum $X$, which is the mod $p$ topological Quillen homology of a certain spectral Lie algebra by a result of Knudsen. We obtain general upper bounds for the mod $p$ homology of $B_k(M;X)$, as well as explicit computations for small $k$. When $p$ is odd, we observe that the mod $p$ homology of $B_k(M^n;S^r)$ for small $k$ depends on and only on the cohomology ring of the one-point compactification of $M$ when $n+r$ is even. This supplements and contrasts with the result of B\"{o}digheimer-Cohen-Taylor when $n+r$ is odd.


title: TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Models

abstract: Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of missing insights of the automatically derived decisions. In order to increase trust in these methods, this paper presents approaches that help to interpret and explain the results of deep learning algorithms by depicting the anatomical areas which influence the decision of the algorithm most. Moreover, this research presents a unified framework, TorchEsegeta, for applying various interpretability and explainability techniques for deep learning models and generate visual interpretations and explanations for clinicians to corroborate their clinical findings. In addition, this will aid in gaining confidence in such methods. The framework builds on existing interpretability and explainability techniques that are currently focusing on classification models, extending them to segmentation tasks. In addition, these methods have been adapted to 3D models for volumetric analysis. The proposed framework provides methods to quantitatively compare visual explanations using infidelity and sensitivity metrics. This framework can be used by data scientists to perform post-hoc interpretations and explanations of their models, develop more explainable tools and present the findings to clinicians to increase their faith in such models. The proposed framework was evaluated based on a use case scenario of vessel segmentation models trained on Time-of-fight (TOF) Magnetic Resonance Angiogram (MRA) images of the human brain. Quantitative and qualitative results of a comparative study of different models and interpretability methods are presented. Furthermore, this paper provides an extensive overview of several existing interpretability and explainability methods.


title: Metadata Shaping: Natural Language Annotations for the Tail

abstract: Language models (LMs) have made remarkable progress, but still struggle to generalize beyond the training data to rare linguistic patterns. Since rare entities and facts are prevalent in the queries users submit to popular applications such as search and personal assistant systems, improving the ability of LMs to reliably capture knowledge over rare entities is a pressing challenge studied in significant prior work. Noticing that existing approaches primarily modify the LM architecture or introduce auxiliary objectives to inject useful entity knowledge, we ask to what extent we could match the quality of these architectures using a base LM architecture, and only changing the data? We propose metadata shaping, a method in which readily available metadata, such as entity descriptions and categorical tags, are appended to examples based on information theoretic metrics. Intuitively, if metadata corresponding to popular entities overlap with metadata for rare entities, the LM may be able to better reason about the rare entities using patterns learned from similar popular entities. On standard entity-rich tasks (TACRED, FewRel, OpenEntity), with no changes to the LM whatsoever, metadata shaping exceeds the BERT-baseline by up to 5.3 F1 points, and achieves or competes with state-of-the-art results. We further show the improvements are up to 10x larger on examples containing tail versus popular entities.


title: Topological phonons in an inhomogeneously strained silicon-6: Possible evidence of the high temperature spin superfluidity and the second sound of topological phonons

abstract: The superposition of topological phonons and flexoelectronic charge separation in an inhomogeneously strain Si give rise to topological electronic magnetism of phonons. The topological electronic magnetism of phonons is also expected to give rise to stationary spin current or spin superfluidity. In this experimental study, we present possible evidence of spin superfluidity in an inhomogeneously strained p-Si thin films samples. The spin superfluidity is uncovered using non-local resistance measurement. A resonance behavior is observed in a non-local resistance measurement at 10 kHz and between 270 K and 281.55 K, which is attributed to the second sound. The observation of second sound and spatially varying non-local resistance phase are the evidences for spin superfluidity. The spatially varying non-local resistance with opposite phase are also observed in Pt/MgO/p-Si sample. The overall non-local responses can be treated as a standing waveform from temporal magnetic moments of the topological phonons.


title: Meta-Learning with Adjoint Methods

abstract: Model Agnostic Meta Learning (MAML) is widely used to find a good initialization for a family of tasks. Despite its success, a critical challenge in MAML is to calculate the gradient w.r.t. the initialization of a long training trajectory for the sampled tasks, because the computation graph can rapidly explode and the computational cost is very expensive. To address this problem, we propose Adjoint MAML (A-MAML). We view gradient descent in the inner optimization as the evolution of an Ordinary Differential Equation (ODE). To efficiently compute the gradient of the validation loss w.r.t. the initialization, we use the adjoint method to construct a companion, backward ODE. To obtain the gradient w.r.t. the initialization, we only need to run the standard ODE solver twice -- one is forward in time that evolves a long trajectory of gradient flow for the sampled task; the other is backward and solves the adjoint ODE. We need not create or expand any intermediate computational graphs, adopt aggressive approximations, or impose proximal regularizers in the training loss. Our approach is cheap, accurate, and adaptable to different trajectory lengths. We demonstrate the advantage of our approach in both synthetic and real-world meta-learning tasks.


title: Uniqueness of the solution of some nonlinear singular partial differential equations of the second order

abstract: In this paper, we consider a nonlinear Fuchsian type partial differential equation of the second order in the complex domain. Under a very weak assumption, we show the uniqueness of the solution. The result is applied to the problem of analytic continuation of local holomorphic solutions of this equation.


title: The excluded minors for lattice path polymatroids

abstract: We find the excluded minors for the minor-closed class of lattice path polymatroids as a subclass of the minor-closed class of Boolean polymatroids. Like lattice path matroids and Boolean polymatroids, there are infinitely many excluded minors, but they fall into a small number of easily-described types.


title: Escape of Fast Radio Bursts from magnetars' magnetospheres

abstract: We discuss dissipative processes occurring during production and escape of Fast Radio Bursts (FRBs) from magnetars' magnetospheres, the presumed loci of FRBs. High magnetic fields are required in the emission region, both to account for the overall energetics of FRBs, and in order to suppress ``normal'' (non-coherent) radiative losses of radio emitting particles; this limits the emission radii to $\leq {\rm few} \times 10 R_{NS}$. Radiative losses by particles in the strong FRB pulse may occur in the outer regions of the magnetosphere for longer rotation periods, $P\geq 1$ second. These losses are suppressed by several effects: (i) the ponderomotive pre-acceleration of background plasma along the direction of wave propagation (losses reduced approximately as $\gamma_\parallel^{3}$: smaller frequency, $ \propto \gamma_\parallel^2$ in power, and times scales stretched, $ \propto \gamma_\parallel$); this acceleration is non-dissipative and is reversed on the declining part of the pulse; (ii) Landau-Pomeranchuk-Migdal effects (long radiation formation length and ensuing destructive interference of scattered waves). In some cases an FRB pulse may be dissipated on external perturbations (e.g., an incoming pulse of Alfven waves): this may produce a pulse of UV/soft X-rays, a swan song of an FRB, possibly detectable by Chandra.


title: Reactive Task Allocation and Planning for Quadrupedal and Wheeled Robot Teaming

abstract: This paper takes the first step towards a reactive, hierarchical multi-robot task allocation and planning framework given a global Linear Temporal Logic specification. The capabilities of both quadrupedal and wheeled robots are leveraged via a heterogeneous team to accomplish a variety of navigation and delivery tasks. However, when deployed in the real world, all robots can be susceptible to different types of disturbances, including but not limited to locomotion failures, human interventions, and obstructions from the environment. To address these disturbances, we propose task-level local and global reallocation strategies to efficiently generate updated action-state sequences online while guaranteeing the completion of the original task. These task reallocation approaches eliminate reconstructing the entire plan or resynthesizing a new task. To integrate the task planner with low-level inputs, a Behavior Tree execution layer monitors different types of disturbances and employs the reallocation methods to make corresponding recovery strategies. To evaluate this planning framework, dynamic simulations are conducted in a realistic hospital environment with a heterogeneous robot team consisting of quadrupeds and wheeled robots for delivery tasks.


title: NN3A: Neural Network supported Acoustic Echo Cancellation, Noise Suppression and Automatic Gain Control for Real-Time Communications

abstract: Acoustic echo cancellation (AEC), noise suppression (NS) and automatic gain control (AGC) are three often required modules for real-time communications (RTC). This paper proposes a neural network supported algorithm for RTC, namely NN3A, which incorporates an adaptive filter and a multi-task model for residual echo suppression, noise reduction and near-end speech activity detection. The proposed algorithm is shown to outperform both a method using separate models and an end-to-end alternative. It is further shown that there exists a trade-off in the model between residual suppression and near-end speech distortion, which could be balanced by a novel loss weighting function. Several practical aspects of training the joint model are also investigated to push its performance to limit.


title: Unsupervised Natural Language Inference Using PHL Triplet Generation

abstract: Transformer-based models achieve impressive performance on numerous Natural Language Inference (NLI) benchmarks when trained on respective training datasets. However, in certain cases, training samples may not be available or collecting them could be time-consuming and resource-intensive. In this work, we address the above challenge and present an explorative study on unsupervised NLI, a paradigm in which no human-annotated training samples are available. We investigate it under three settings: PH, P, and NPH that differ in the extent of unlabeled data available for learning. As a solution, we propose a procedural data generation approach that leverages a set of sentence transformations to collect PHL (Premise, Hypothesis, Label) triplets for training NLI models, bypassing the need for human-annotated training data. Comprehensive experiments with several NLI datasets show that the proposed approach results in accuracies of up to 66.75%, 65.9%, 65.39% in PH, P, and NPH settings respectively, outperforming all existing unsupervised baselines. Furthermore, fine-tuning our model with as little as ~0.1% of the human-annotated training dataset (500 instances) leads to 12.2% higher accuracy than the model trained from scratch on the same 500 instances. Supported by this superior performance, we conclude with a recommendation for collecting high-quality task-specific data.


title: Controllable Multichannel Speech Dereverberation based on Deep Neural Networks

abstract: Neural network based speech dereverberation has achieved promising results in recent studies. Nevertheless, many are focused on recovery of only the direct path sound and early reflections, which could be beneficial to speech perception, are discarded. The performance of a model trained to recover clean speech degrades when evaluated on early reverberation targets, and vice versa. This paper proposes a novel deep neural network based multichannel speech dereverberation algorithm, in which the dereverberation level is controllable. This is realized by adding a simple floating-point number as target controller of the model. Experiments are conducted using spatially distributed microphones, and the efficacy of the proposed algorithm is confirmed in various simulated conditions.


title: Online Target Q-learning with Reverse Experience Replay: Efficiently finding the Optimal Policy for Linear MDPs

abstract: Q-learning is a popular Reinforcement Learning (RL) algorithm which is widely used in practice with function approximation (Mnih et al., 2015). In contrast, existing theoretical results are pessimistic about Q-learning. For example, (Baird, 1995) shows that Q-learning does not converge even with linear function approximation for linear MDPs. Furthermore, even for tabular MDPs with synchronous updates, Q-learning was shown to have sub-optimal sample complexity (Li et al., 2021;Azar et al., 2013). The goal of this work is to bridge the gap between practical success of Q-learning and the relatively pessimistic theoretical results. The starting point of our work is the observation that in practice, Q-learning is used with two important modifications: (i) training with two networks, called online network and target network simultaneously (online target learning, or OTL) , and (ii) experience replay (ER) (Mnih et al., 2015). While they have been observed to play a significant role in the practical success of Q-learning, a thorough theoretical understanding of how these two modifications improve the convergence behavior of Q-learning has been missing in literature. By carefully combining Q-learning with OTL and reverse experience replay (RER) (a form of experience replay), we present novel methods Q-Rex and Q-RexDaRe (Q-Rex + data reuse). We show that Q-Rex efficiently finds the optimal policy for linear MDPs (or more generally for MDPs with zero inherent Bellman error with linear approximation (ZIBEL)) and provide non-asymptotic bounds on sample complexity -- the first such result for a Q-learning method for this class of MDPs under standard assumptions. Furthermore, we demonstrate that Q-RexDaRe in fact achieves near optimal sample complexity in the tabular setting, improving upon the existing results for vanilla Q-learning.


title: Decoupling for smooth surfaces in $\mathbb{R}^3$

abstract: For each $d\geq 0$, we prove decoupling inequalities in $\mathbb R^3$ for the graphs of all bivariate polynomials of degree at most $d$ with bounded coefficients, with the decoupling constant depending uniformly in $d$ but not the coefficients of each individual polynomial. As a consequence, we prove a decoupling inequality for (a compact piece of) every smooth surface in $\mathbb{R}^3$, which in particular solves a conjecture of Bourgain, Demeter and Kemp.


title: Koopman Operator Theory for Nonlinear Dynamic Modeling using Dynamic Mode Decomposition

abstract: The Koopman operator is a linear operator that describes the evolution of scalar observables (i.e., measurement functions of the states) in an infinitedimensional Hilbert space. This operator theoretic point of view lifts the dynamics of a finite-dimensional nonlinear system to an infinite-dimensional function space where the evolution of the original system becomes linear. In this paper, we provide a brief summary of the Koopman operator theorem for nonlinear dynamics modeling and focus on analyzing several data-driven implementations using dynamical mode decomposition (DMD) for autonomous and controlled canonical problems. We apply the extended dynamic mode decomposition (EDMD) to identify the leading Koopman eigenfunctions and approximate a finite-dimensional representation of the discovered linear dynamics. This allows us to apply linear control approaches towards nonlinear systems without linearization approximations around fixed points. We can then examine the fidelity of using a linear controller based on a Koopman operator approximated system on under-actuated systems with basic maneuvers. We demonstrate the effectiveness of this theory through numerical simulation on two classic dynamical systems are used to show DMD methods of evaluating and approximating the Koopman operator and its effectiveness at linearizing these systems.


title: Prix-LM: Pretraining for Multilingual Knowledge Base Construction

abstract: Knowledge bases (KBs) contain plenty of structured world and commonsense knowledge. As such, they often complement distributional text-based information and facilitate various downstream tasks. Since their manual construction is resource- and time-intensive, recent efforts have tried leveraging large pretrained language models (PLMs) to generate additional monolingual knowledge facts for KBs. However, such methods have not been attempted for building and enriching multilingual KBs. Besides wider application, such multilingual KBs can provide richer combined knowledge than monolingual (e.g., English) KBs. Knowledge expressed in different languages may be complementary and unequally distributed: this implies that the knowledge available in high-resource languages can be transferred to low-resource ones. To achieve this, it is crucial to represent multilingual knowledge in a shared/unified space. To this end, we propose a unified representation model, Prix-LM, for multilingual KB construction and completion. We leverage two types of knowledge, monolingual triples and cross-lingual links, extracted from existing multilingual KBs, and tune a multilingual language encoder XLM-R via a causal language modeling objective. Prix-LM integrates useful multilingual and KB-based factual knowledge into a single model. Experiments on standard entity-related tasks, such as link prediction in multiple languages, cross-lingual entity linking and bilingual lexicon induction, demonstrate its effectiveness, with gains reported over strong task-specialised baselines.