title: Once-for-All Adversarial Training: In-Situ Tradeoff between Robustness and Accuracy for Free

abstract: Adversarial training and its many variants substantially improve deep network robustness, yet at the cost of compromising standard accuracy. Moreover, the training process is heavy and hence it becomes impractical to thoroughly explore the trade-off between accuracy and robustness. This paper asks this new question: how to quickly calibrate a trained model in-situ, to examine the achievable trade-offs between its standard and robust accuracies, without (re-)training it many times? Our proposed framework, Once-for-all Adversarial Training (OAT), is built on an innovative model-conditional training framework, with a controlling hyper-parameter as the input. The trained model could be adjusted among different standard and robust accuracies "for free" at testing time. As an important knob, we exploit dual batch normalization to separate standard and adversarial feature statistics, so that they can be learned in one model without degrading performance. We further extend OAT to a Once-for-all Adversarial Training and Slimming (OATS) framework, that allows for the joint trade-off among accuracy, robustness and runtime efficiency. Experiments show that, without any re-training nor ensembling, OAT/OATS achieve similar or even superior performance compared to dedicatedly trained models at various configurations. Our codes and pretrained models are available at: https://github.com/VITA-Group/Once-for-All-Adversarial-Training.


title: GWSkyNet: a real-time classifier for public gravitational-wave candidates

abstract: The rapid release of accurate sky localization for gravitational-wave candidates is crucial for multi-messenger observations. During the third observing run of Advanced LIGO and Advanced Virgo, automated gravitational-wave alerts were publicly released within minutes of detection. Subsequent inspection and analysis resulted in the eventual retraction of a fraction of the candidates. Updates could be delayed by up to several days, sometimes issued during or after exhaustive multi-messenger followup campaigns. We introduce GWSkyNet, a real-time framework to distinguish between astrophysical events and instrumental artefacts using only publicly available information from the LIGO-Virgo open public alerts. This framework consists of a non-sequential convolutional neural network involving sky maps and metadata. GWSkyNet achieves a prediction accuracy of 93.5% on a testing data set.


title: Skyrmion zoo in graphene at charge neutrality in a strong magnetic field

abstract: As a consequence of the approximate spin-valley symmetry in graphene, the ground state of electrons in graphene at charge neutrality is a particular SU(4) quantum-Hall ferromagnet to minimize their exchange energy. If only the Coulomb interaction is taken into account, this ferromagnet can appeal either to the spin degree of freedom or equivalently to the valley pseudo-spin degree of freedom. This freedom in choice is then limited by subleading energy scales that explicitly break the SU(4) symmetry, the simplest of which is given by the Zeeman effect that orients the spin in the direction of the magnetic field. In addition, there are also valley symmetry breaking terms that can arise from short-range interactions or electron-phonon couplings. Here, we build upon the phase diagram, which has been obtained by Kharitonov [Phys. Rev. B \textbf{85}, 155439 (2012)], in order to identify the different skyrmions that are compatible with these types of quantum-Hall ferromagnets. Similarly to the ferromagnets, the skyrmions at charge neutrality are described by the $\text{Gr}(2,4)$ Grassmannian at the center, which allows us to construct the skyrmion spinors. The different skyrmion types are then obtained by minimizing their energy within a variational approach, with respect to the remaining free parameters that are not fixed by the requirement that the skyrmion at large distances from their center must be compatible with the ferromagnetic background. We show that the different skyrmion types have a clear signature in the local, sublattice-resolved, spin magnetization, which is in principle accessible in scanning-tunneling microscopy and spectroscopy.


title: Data-driven RANS closures for three-dimensional flows around bluff bodies

abstract: In this short note we apply the recently proposed data-driven RANS closure modelling framework of Schmelzer et al. (2020) to fully three-dimensional, high Reynolds number flows: namely wall-mounted cubes and cuboids at Re=40,000, and a cylinder at Re=140,000. For each flow, a new RANS closure is generated using sparse symbolic regression based on LES or DES reference data. This new model is implemented in a CFD solver, and subsequently applied to prediction of the other flows. We see consistent improvements compared to the baseline $k-\omega$ SST model in predictions of mean-velocity in the complete flow domain.


title: Ordered fields dense in their real closure and definable convex valuations

abstract: In this paper, we undertake a systematic model and valuation theoretic study of the class of ordered fields which are dense in their real closure. We apply this study to determine definable henselian valuations on ordered fields, in the language of ordered rings. In light of our results, we re-examine the Shelah-Hasson Conjecture (specialised to ordered fields) and provide an example limiting its valuation theoretic conclusions.


title: Shape related constraints aware generation of Mechanical Designs through Deep Convolutional GAN

abstract: Mechanical product engineering often must comply with manufacturing or geometric constraints related to the shaping process. Mechanical design hence should rely on robust and fast tools to explore complex shapes, typically for design for additive manufacturing (DfAM). Topology optimization is such a powerful tool, yet integrating geometric constraints (shape-related) into it is hard. In this work, we leverage machine learning capability to handle complex geometric and spatial correlations to integrate into the mechanical design process geometry-related constraints at the conceptual level. More precisely, we explore the generative capabilities of recent Deep Learning architectures to enhance mechanical designs, typically for additive manufacturing. In this work, we build a generative Deep-Learning-based approach of topology optimization integrating mechanical conditions in addition to one typical manufacturing condition (the complexity of a design i.e. a geometrical condition). The approach is a dual-discriminator GAN: a generator that takes as input the mechanical and geometrical conditions and outputs a 2D structure and two discriminators, one to ensure that the generated structure follows the mechanical constraints and the other to assess the geometrical constraint. We also explore the generation of designs with a non-uniform material distribution and show promising results. Finally, We evaluate the generated designs with an objective evaluation of all wanted aspects: the mechanical as well as the geometrical constraints.


title: 312-Avoiding Reduced Valid Hook Configurations and Duck Words

abstract: Valid hook configurations are combinatorial objects used to understand West's stack sorting map as well as cumulants in noncommutative probability theory. We show a bijection between reduced valid hook configurations on 312-avoiding permutations with the maximal allowed number of points and 3D-Dyck words, proving a conjecture of Sankar's. We extend to a bijection between all 312-avoiding reduced valid hook configurations and 3D-Dyck words with specified modifications. We show how these can be counted in terms of the number of 3D-Dyck words of length 3k in which exactly i Y's do not have an X immediately before them, the (k,i)-Duck words, and use this relationship to prove several properties about sums of 312-avoiding reduced valid hook configurations, including two more of Sankar's conjectures. We also show that the number of (k,1)-Duck words is given by a variant of the tennis ball numbers.


title: Multi-agent active perception with prediction rewards

abstract: Multi-agent active perception is a task where a team of agents cooperatively gathers observations to compute a joint estimate of a hidden variable. The task is decentralized and the joint estimate can only be computed after the task ends by fusing observations of all agents. The objective is to maximize the accuracy of the estimate. The accuracy is quantified by a centralized prediction reward determined by a centralized decision-maker who perceives the observations gathered by all agents after the task ends. In this paper, we model multi-agent active perception as a decentralized partially observable Markov decision process (Dec-POMDP) with a convex centralized prediction reward. We prove that by introducing individual prediction actions for each agent, the problem is converted into a standard Dec-POMDP with a decentralized prediction reward. The loss due to decentralization is bounded, and we give a sufficient condition for when it is zero. Our results allow application of any Dec-POMDP solution algorithm to multi-agent active perception problems, and enable planning to reduce uncertainty without explicit computation of joint estimates. We demonstrate the empirical usefulness of our results by applying a standard Dec-POMDP algorithm to multi-agent active perception problems, showing increased scalability in the planning horizon.


title: Using graph theory to compute Laplace operators arising in a model for blood flow in capillary network

abstract: Maintaining cerebral blood flow is critical for adequate neuronal function. Previous computational models of brain capillary networks have predicted that heterogeneous cerebral capillary flow patterns result in lower brain tissue partial oxygen pressures. It has been suggested that this may lead to number of diseases such as Alzheimer's disease, acute ischemic stroke, traumatic brain injury and ischemic heart disease. We have previously developed a computational model that was used to describe in detail the effect of flow heterogeneities on tissue oxygen levels. The main result in that paper was that, for a general class of capillary networks, perturbations of segment diameters or conductances always lead to decreased oxygen levels. This result was verified using both numerical simulations and mathematical analysis. However, the analysis depended on a novel conjecture concerning the Laplace operator of functions related to the segment flow rates and how they depend on the conductances. The goal of this paper is to give a mathematically rigorous proof of the conjecture for a general class of networks. The proof depends on determining the number of trees and forests in certain graphs arising from the capillary network.


title: Categorical Wall-Crossing in Landau-Ginzburg Models

abstract: We describe how categorical BPS data including chain complexes of solitons, CPT pairings, and interior amplitudes jump across a wall of marginal stability in two-dimensional $\mathcal{N}=(2,2)$ models. We show that our jump formulas hold if and only if the $A_{\infty}$-categories of half-BPS branes constructed on either side of the wall are homotopy equivalent. These results can be viewed as categorical enhancements of the Cecotti-Vafa wall-crossing formula.


title: Blind Video Temporal Consistency via Deep Video Prior

abstract: Applying image processing algorithms independently to each video frame often leads to temporal inconsistency in the resulting video. To address this issue, we present a novel and general approach for blind video temporal consistency. Our method is only trained on a pair of original and processed videos directly instead of a large dataset. Unlike most previous methods that enforce temporal consistency with optical flow, we show that temporal consistency can be achieved by training a convolutional network on a video with the Deep Video Prior. Moreover, a carefully designed iteratively reweighted training strategy is proposed to address the challenging multimodal inconsistency problem. We demonstrate the effectiveness of our approach on 7 computer vision tasks on videos. Extensive quantitative and perceptual experiments show that our approach obtains superior performance than state-of-the-art methods on blind video temporal consistency. Our source codes are publicly available at github.com/ChenyangLEI/deep-video-prior.


title: Robust Optimization on Unrelated Parallel Machine Scheduling with Setup Times

abstract: The parallel machine scheduling problem has been a popular topic for many years due to its theoretical and practical importance. This paper addresses the robust makespan optimization problem on unrelated parallel machine scheduling with sequence-dependent setup times, where the processing times are uncertain, and the only knowledge is the intervals they take values from. We propose a robust optimization model with min-max regret criterion to formulate this problem. To solve this problem, we prove that the worst-case scenario with the maximum regret for a given solution belongs to a finite set of extreme scenarios. Based on this theoretical analysis, the procedure to obtain the maximum regret is proposed and an enhanced regret evaluation method (ERE) is designed to accelerate this process. A multi-start decomposition-based heuristic algorithm (MDH) is proposed to solve this problem. High-quality initial solutions and an upper bound are examined to help better solve the problem. Computational experiments are conducted to justify the performance of these methods.


title: Pushing The Limit of Type I Codebook For FDD Massive MIMO Beamforming: A Channel Covariance Reconstruction Approach

abstract: There is a fundamental trade-off between the channel representation resolution of codebooks and the overheads of feedback communications in the fifth generation new radio (5G NR) frequency division duplex (FDD) massive multiple-input and multiple-output (MIMO) systems. In particular, two types of codebooks (namely Type I and Type II codebooks) are introduced with different resolution and overhead requirements. Although the Type I codebook based scheme requires lower feedback overhead, its channel state information (CSI) reconstruction and beamforming performance are not as good as those from the Type II codebook based scheme. However, since the Type I codebook based scheme has been widely used in 4G systems for many years, replacing it by the Type II codebook based scheme overnight is too costly to be an option. Therefore, in this paper, using Type I codebook, we leverage advances in cutting plane method to optimize the CSI reconstruction at the base station (BS), in order to close the gap between these two codebook based beamforming schemes. Numerical results based on channel samples from QUAsi Deterministic RadIo channel GenerAtor (QuaDRiGa) are presented to show the excellent performance of the proposed algorithm in terms of beamforming vector acquisition.


title: When Does it Pay Off to Learn a New Skill? Revealing the Complementary Benefit of Cross-Skilling

abstract: This work examines the economic benefits of learning a new skill from a different domain: cross-skilling. To assess this, a network of skills from the job profiles of 14,790 online freelancers is constructed. Based on this skill network, relationships between 3,480 different skills are revealed and marginal effects of learning a new skill can be calculated via workers' wages. The results indicate that learning in-demand skills, such as popular programming languages, is beneficial in general, and that diverse skill sets tend to be profitable, too. However, the economic benefit of a new skill is individual, as it complements the existing skill bundle of each worker. As technological and social transformation is reshuffling jobs' task profiles at a fast pace, the findings of this study help to clarify skill sets required for designing individual re-skilling pathways. This can help to increase employability and reduce labour market shortages.


title: Containment in Monadic Disjunctive Datalog, MMSNP, and Expressive Description Logics

abstract: We study query containment in three closely related formalisms: monadic disjunctive Datalog (MDDLog), MMSNP (a logical generalization of constraint satisfaction problems), and ontology-mediated queries (OMQs) based on expressive description logics and unions of conjunctive queries. Containment in MMSNP was known to be decidable due to a result by Feder and Vardi, but its exact complexity has remained open. We prove 2NEXPTIME-completeness and extend this result to monadic disjunctive Datalog and to OMQs.


title: On the calibration of Astigmatism particle tracking velocimetryfor suspensions of different volume fractions

abstract: In the present study we demonstrate for the first time how Astigmatism Particle Tracking Velocimetry (APTV) can be utilized to measure suspensions dynamics. Measurements were successfully performed in monodisperse, refractive index matched suspensions of up to a volume fraction of $\Phi=19.9\%$. For this, a small percentage of the particles is labeled with fluorescent dye acting as tracers for the particle tracking procedure. Calibration results show, that a slight deviation of the refractive index of liquid and particles leads to a strong shape change of the calibration curve with respect to the unladen case. This effect becomes more severe along the channel height. To compensate the shape change of the calibration curves the interpolation technique developed by Brockmann et al. (Experiments in Fluids, 61(2), 67, \citeyear{brockmann2020utilizing}) is adapted. Using this technique, the interpolation procedure is applied to suspensions with 6 different volume fractions ranging from $\Phi<0.01\%$ to $\Phi=19.9\%$. To determine the effect of volume fraction on the perfomance of the method, the depth reconstruction error $\sigma_z$ and the measurement volume depth $\Delta z$, obtained in different calibration measurements, are estimated. Here, a relative position reconstruction accuracy of $\sigma_z$/$\Delta z$=0.90\% and $\sigma_z$/$\Delta z$=2.53\% is achieved for labeled calibration particles in dilute ($\Phi<0.01\%$) and semi-dilute ($\Phi\approx19.9\%$) suspensions, respectively. The measurement technique is validated for a laminar flow in a straight rectangular channel with a cross-sectional area of 2.55$\times$30\,mm$^2$. Uncertainties of 1.39\% and 3.34\% for the in-plane and 9.04\% and 22.57\% for the out-of-plane velocity with respect to the maximum streamwise velocity are achieved, at solid volume fractions of $\Phi<0.01\%$ and $\Phi=19.9\%$, respectively.


title: Spatio-temporal Features for Generalized Detection of Deepfake Videos

abstract: For deepfake detection, video-level detectors have not been explored as extensively as image-level detectors, which do not exploit temporal data. In this paper, we empirically show that existing approaches on image and sequence classifiers generalize poorly to new manipulation techniques. To this end, we propose spatio-temporal features, modeled by 3D CNNs, to extend the generalization capabilities to detect new sorts of deepfake videos. We show that spatial features learn distinct deepfake-method-specific attributes, while spatio-temporal features capture shared attributes between deepfake methods. We provide an in-depth analysis of how the sequential and spatio-temporal video encoders are utilizing temporal information using DFDC dataset arXiv:2006.07397. Thus, we unravel that our approach captures local spatio-temporal relations and inconsistencies in the deepfake videos while existing sequence encoders are indifferent to it. Through large scale experiments conducted on the FaceForensics++ arXiv:1901.08971 and Deeper Forensics arXiv:2001.03024 datasets, we show that our approach outperforms existing methods in terms of generalization capabilities.


title: Quantum theory of Rayleigh scattering

abstract: We develop a quantum theory of atomic Rayleigh scattering. Scattering is considered as a relaxation of incident photons from a selected mode of free space to the reservoir of the other free space modes. Additional excitations of the reservoir states which appear are treated as scattered light. We show that an entangled state of the excited atom and the incident photon is formed during the scattering. Due to entanglement, a photon is never completely absorbed by the atom. We show that even if the selected mode frequency is incommensurable with any atomic transition frequency, the scattered light spectrum has a maximum at the frequency of the selected mode. The linewidth of scattered light is much smaller than that of the spontaneous emission of a single atom, therefore, the process can be considered as elastic. The developed theory does not use the phenomenological concept of virtual level.


title: Photon-added coherent states using the continuous-mode formalism

abstract: The addition of a photon into the same mode as a coherent state produces a nonclassical state that has interesting features, including quadrature squeezing and a sub-Poissonian photon-number distribution. The squeezed nature of photon-added coherent (PAC) states potentially offers an advantage in quantum sensing applications. Previous theoretical works have employed a single-mode treatment of PAC states. Here, we use a continuous-mode approach that allows us to model PAC state pulses. We study the properties of a single-photon and coherent state wavepacket superimposed with variable temporal and spectral overlap. We show that, even without perfect overlap, the state exhibits a sub-Poissonian number distribution, second-order quantum correlations and quadrature squeezing for a weak coherent state. We also include propagation loss in waveguides and study how the fidelity and other properties of PAC state pulses are affected.


title: FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver

abstract: We present FlowPM, a Particle-Mesh (PM) cosmological N-body code implemented in Mesh-TensorFlow for GPU-accelerated, distributed, and differentiable simulations. We implement and validate the accuracy of a novel multi-grid scheme based on multiresolution pyramids to compute large scale forces efficiently on distributed platforms. We explore the scaling of the simulation on large-scale supercomputers and compare it with corresponding python based PM code, finding on an average 10x speed-up in terms of wallclock time. We also demonstrate how this novel tool can be used for efficiently solving large scale cosmological inference problems, in particular reconstruction of cosmological fields in a forward model Bayesian framework with hybrid PM and neural network forward model. We provide skeleton code for these examples and the entire code is publicly available at https://github.com/modichirag/flowpm.


title: From Conjunctive Queries to Instance Queries in Ontology-Mediated Querying

abstract: We consider ontology-mediated queries (OMQs) based on expressive description logics of the ALC family and (unions) of conjunctive queries, studying the rewritability into OMQs based on instance queries (IQs). Our results include exact characterizations of when such a rewriting is possible and tight complexity bounds for deciding rewritability. We also give a tight complexity bound for the related problem of deciding whether a given MMSNP sentence is equivalent to a CSP.


title: The BGG Category for Generalised Reductive Lie Algebras

abstract: A Lie algebra is said to be generalised reductive if it is a direct sum of a semisimple Lie algebra and a commutative radical. In this paper we extend the BGG category $\mathcal{O}$ over complex semisimple Lie algebras to the category $\mathcal {O'}$ over complex generalised reductive Lie algebras. Then we make a preliminary research on the highest weight modules and the projective modules in this new category $\mathcal {O'}$, and generalize some conclusions in the classical case. As a critical difference from the complex semisimple Lie algebra case, we prove that there is no projective module in $\mathcal {O'}$.


title: Efficient design of geographically-defined clusters with spatial autocorrelation

abstract: Clusters form the basis of a number of research study designs including survey and experimental studies. Cluster-based designs can be less costly but also less efficient than individual-based designs due to correlation between individuals within the same cluster. Their design typically relies on \textit{ad hoc} choices of correlation parameters, and is insensitive to variations in cluster design. This article examines how to efficiently design clusters where they are geographically defined by demarcating areas incorporating individuals and households or other units. Using geostatistical models for spatial autocorrelation we generate approximations to within cluster average covariance in order to estimate the effective sample size given particular cluster design parameters. We show how the number of enumerated locations, cluster area, proportion sampled, and sampling method affect the efficiency of the design and consider the optimization problem of choosing the most efficient design subject to budgetary constraints. We also consider how the parameters from these approximations can be interpreted simply in terms of `real-world' quantities and used in design analysis.


title: Hawkes Process Classification through Discriminative Modeling of Text

abstract: Social media has provided a platform for users to gather and share information and stay updated with the news. Such networks also provide a platform to users where they can engage in conversations. However, such micro-blogging platforms like Twitter restricts the length of text. Due to paucity of sufficient word occurrences in such posts, classification of this information is a challenging task using standard tools of natural language processing (NLP). Moreover, high complexity and dynamics of the posts in social media makes text classification a challenging problem. However, considering additional cues in the form of past labels and times associated with the post can be potentially helpful for performing text classification in a better way. To address this problem, we propose models based on the Hawkes process (HP) which can naturally incorporate the temporal features and past labels along with textual features for improving short text classification. In particular, we propose a discriminative approach to model text in HP where the text features parameterize the base intensity and/or the triggering kernel. Another major contribution is to consider kernel to be a function of both time and text, and further use a neural network to model the kernel. This enables modelling and effectively learning the text along with the historical influences for tweet classification. We demonstrate the advantages of the proposed techniques on standard benchmarks for rumour stance classification.


title: Efficient Robust Optimal Transport with Application to Multi-Label Classification

abstract: Optimal transport (OT) is a powerful geometric tool for comparing two distributions and has been employed in various machine learning applications. In this work, we propose a novel OT formulation that takes feature correlations into account while learning the transport plan between two distributions. We model the feature-feature relationship via a symmetric positive semi-definite Mahalanobis metric in the OT cost function. For a certain class of regularizers on the metric, we show that the optimization strategy can be considerably simplified by exploiting the problem structure. For high-dimensional data, we additionally propose suitable low-dimensional modeling of the Mahalanobis metric. Overall, we view the resulting optimization problem as a non-linear OT problem, which we solve using the Frank-Wolfe algorithm. Empirical results on the discriminative learning setting, such as tag prediction and multi-class classification, illustrate the good performance of our approach.


title: STAR: A Schema-Guided Dialog Dataset for Transfer Learning

abstract: We present STAR, a schema-guided task-oriented dialog dataset consisting of 127,833 utterances and knowledge base queries across 5,820 task-oriented dialogs in 13 domains that is especially designed to facilitate task and domain transfer learning in task-oriented dialog. Furthermore, we propose a scalable crowd-sourcing paradigm to collect arbitrarily large datasets of the same quality as STAR. Moreover, we introduce novel schema-guided dialog models that use an explicit description of the task(s) to generalize from known to unknown tasks. We demonstrate the effectiveness of these models, particularly for zero-shot generalization across tasks and domains.


title: The Inhomogeneous Boundary Harnack Principle for Fully Nonlinear and p-Laplace equations

abstract: We prove a boundary Harnack principle in Lipschitz domains with small constant for fully nonlinear and $p$-Laplace type equations with a right hand side, as well as for the Laplace equation on nontangentially accessible domains under extra conditions. The approach is completely new and gives a systematic approach for proving similar results for a variety of equations and geometries.


title: Detecting and Exorcising Statistical Demons from Language Models with Anti-Models of Negative Data

abstract: It's been said that "Language Models are Unsupervised Multitask Learners." Indeed, self-supervised language models trained on "positive" examples of English text generalize in desirable ways to many natural language tasks. But if such models can stray so far from an initial self-supervision objective, a wayward model might generalize in undesirable ways too, say to nonsensical "negative" examples of unnatural language. A key question in this work is: do language models trained on (positive) training data also generalize to (negative) test data? We use this question as a contrivance to assess the extent to which language models learn undesirable properties of text, such as n-grams, that might interfere with the learning of more desirable properties of text, such as syntax. We find that within a model family, as the number of parameters, training epochs, and data set size increase, so does a model's ability to generalize to negative n-gram data, indicating standard self-supervision generalizes too far. We propose a form of inductive bias that attenuates such undesirable signals with negative data distributions automatically learned from positive data. We apply the method to remove n-gram signals from LSTMs and find that doing so causes them to favor syntactic signals, as demonstrated by large error reductions (up to 46% on the hardest cases) on a syntactic subject-verb agreement task.


title: XOR QA: Cross-lingual Open-Retrieval Question Answering

abstract: Multilingual question answering tasks typically assume answers exist in the same language as the question. Yet in practice, many languages face both information scarcity -- where languages have few reference articles -- and information asymmetry -- where questions reference concepts from other cultures. This work extends open-retrieval question answering to a cross-lingual setting enabling questions from one language to be answered via answer content from another language. We construct a large-scale dataset built on questions from TyDi QA lacking same-language answers. Our task formulation, called Cross-lingual Open Retrieval Question Answering (XOR QA), includes 40k information-seeking questions from across 7 diverse non-English languages. Based on this dataset, we introduce three new tasks that involve cross-lingual document retrieval using multi-lingual and English resources. We establish baselines with state-of-the-art machine translation systems and cross-lingual pretrained models. Experimental results suggest that XOR QA is a challenging task that will facilitate the development of novel techniques for multilingual question answering. Our data and code are available at https://nlp.cs.washington.edu/xorqa.


title: On the Erd\H{o}s-Tur\'{a}n additive base conjecture

abstract: In this paper we formulate and prove several variants of the Erd\H{o}s-Tur\'{a}n additive bases conjecture.


title: Global optimality of softmax policy gradient with single hidden layer neural networks in the mean-field regime

abstract: We study the problem of policy optimization for infinite-horizon discounted Markov Decision Processes with softmax policy and nonlinear function approximation trained with policy gradient algorithms. We concentrate on the training dynamics in the mean-field regime, modeling e.g., the behavior of wide single hidden layer neural networks, when exploration is encouraged through entropy regularization. The dynamics of these models is established as a Wasserstein gradient flow of distributions in parameter space. We further prove global optimality of the fixed points of this dynamics under mild conditions on their initialization.


title: Not all parameters are born equal: Attention is mostly what you need

abstract: Transformers are widely used in state-of-the-art machine translation, but the key to their success is still unknown. To gain insight into this, we consider three groups of parameters: embeddings, attention, and feed forward neural network (FFN) layers. We examine the relative importance of each by performing an ablation study where we initialise them at random and freeze them, so that their weights do not change over the course of the training. Through this, we show that the attention and FFN are equally important and fulfil the same functionality in a model. We show that the decision about whether a component is frozen or allowed to train is at least as important for the final model performance as its number of parameters. At the same time, the number of parameters alone is not indicative of a component's importance. Finally, while the embedding layer is the least essential for machine translation tasks, it is the most important component for language modelling tasks.


title: Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Models

abstract: Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built on the idea of perceptual losses. Perceptual loss discourages distortion to certain speech properties and we analyze it using six large-scale pre-trained models: speaker classification, acoustic model, speaker embedding, emotion classification, and two self-supervised speech encoders (PASE+, wav2vec 2.0). We first build a strong baseline (w/o PERL) using Conformer Transformer Networks on the popular enhancement benchmark called VCTK-DEMAND. Using auxiliary models one at a time, we find acoustic event and self-supervised model PASE+ to be most effective. Our best model (PERL-AE) only uses acoustic event model (utilizing AudioSet) to outperform state-of-the-art methods on major perceptual metrics. To explore if denoising can leverage full framework, we use all networks but find that our seven-loss formulation suffers from the challenges of Multi-Task Learning. Finally, we report a critical observation that state-of-the-art Multi-Task weight learning methods cannot outperform hand tuning, perhaps due to challenges of domain mismatch and weak complementarity of losses.


title: Adaptive Mesh Refinement and Coarsening for Diffusion-Reaction Epidemiological Models

abstract: The outbreak of COVID-19 in 2020 has led to a surge in the interest in the mathematical modeling of infectious diseases. Disease transmission may be modeled as compartmental models, in which the population under study is divided into compartments and has assumptions about the nature and time rate of transfer from one compartment to another. Usually, they are composed of a system of ordinary differential equations (ODE's) in time. A class of such models considers the Susceptible, Exposed, Infected, Recovered, and Deceased populations, the SEIRD model. However, these models do not always account for the movement of individuals from one region to another. In this work, we extend the formulation of SEIRD compartmental models to diffusion-reaction systems of partial differential equations to capture the continuous spatio-temporal dynamics of COVID-19. Since the virus spread is not only through diffusion, we introduce a source term to the equation system, representing exposed people who return from travel. We also add the possibility of anisotropic non-homogeneous diffusion. We implement the whole model in \texttt{libMesh}, an open finite element library that provides a framework for multiphysics, considering adaptive mesh refinement and coarsening. Therefore, the model can represent several spatial scales, adapting the resolution to the disease dynamics. We verify our model with standard SEIRD models and show several examples highlighting the present model's new capabilities.


title: Mixed multiplicities of graded families of ideals

abstract: We show the existence (and define) the mixed multiplicities of arbitrary graded families of ideals under mild assumptions. In particular, our methods and results are valid for the case of arbitrary $\mathfrak{m}$-primary graded families. Furthermore, we provide a far-reaching "Volume = Multiplicity formula" for the mixed multiplicities of graded families of ideals.


title: Planning with Submodular Objective Functions

abstract: We study planning with submodular objective functions, where instead of maximizing the cumulative reward, the goal is to maximize the objective value induced by a submodular function. Our framework subsumes standard planning and submodular maximization with cardinality constraints as special cases, and thus many practical applications can be naturally formulated within our framework. Based on the notion of multilinear extension, we propose a novel and theoretically principled algorithmic framework for planning with submodular objective functions, which recovers classical algorithms when applied to the two special cases mentioned above. Empirically, our approach significantly outperforms baseline algorithms on synthetic environments and navigation tasks.


title: Applying the Maximum Entropy Technique to the Gaussian Dispersion Plume Model

abstract: The Maximum Entropy (MaxEnt) technique is applied to the derivation of the Gaussian Dispersion Plume Model as well as to more complex transport phenomena such as the one-dimensional advection equation, the one-dimensional diffusion equation, the one dimensional advection-diffusion equation, and finally to the multi-dimensional advection-diffusion equation. Further application is discussed.


title: Unsupervised Clustering and Performance Prediction of Vortex Wakes from Bio-inspired Propulsors

abstract: An unsupervised machine learning strategy is developed to automatically cluster the vortex wakes of bio-inspired propulsors into groups of similar propulsive thrust and efficiency metrics. A pitching and heaving foil is simulated via computational fluid dynamics with $121$ unique kinematics by varying the frequency, heaving amplitude, and pitching amplitude. A Reynolds averaged Navier-Stokes (RANS) model is employed to simulate the flow over the oscillating foils at $Re=10^6$, computing the propulsive efficiency, thrust coefficient and the unsteady vorticity wake signature. Using a pairwise Pearson correlation it is found that the Strouhal number most strongly influences the thrust coefficient, whereas the relative angle of attack, defined by both the mid-stroke and maximum have the most significant impact on propulsive efficiency. Next, the various kinematics are automatically clustered into distinct groups exclusively using the vorticity footprint in the wake. A convolutional autoencoder is developed to reduce vortex wake images to their most significant features, and a k-means++ algorithm performs the clustering. The results are assessed by comparing clusters to a thrust versus propulsive efficiency map, which confirms that wakes of similar performance metrics are successfully clustered together. This automated clustering has the potential to identify complex vorticity patterns in the wake and modes of propulsion not easily discerned from traditional classification methods.


title: The TRENDS High-contrast Imaging Survey. VIII. Compendium of Benchmark Objects

abstract: The physical properties of faint stellar and substellar objects often rely on indirect, model-dependent estimates. For example, the masses of brown dwarfs are usually inferred using evolutionary models, which are age dependent and have yet to be properly calibrated. With the goal of identifying new benchmark objects to test low-mass stellar and substellar models, we have carried out a comprehensive adaptive optics survey as part of the TaRgetting bENchmark-objects with the Doppler Spectroscopy high-contrast imaging program. Using legacy radial velocity measurements from High Resolution Echelle Spectrometer at Keck, we have identified several dozen stars that show long-term Doppler accelerations. We present follow-up high-contrast observations from the campaign and report the discovery of 31 co-moving companions, as well as 11 strong candidate companions, to solar-type stars with well-determined parallax and metallicity values. Benchmark objects of this nature lend themselves to orbit determinations, dynamical mass estimates, and independent compositional assessment. This compendium of benchmark objects will serve as a convenient test group to substantiate theoretical evolutionary and atmospheric models near the hydrogen fusing limit.


title: The nature and origins of sub-Neptune size planets

abstract: Planets intermediate in size between the Earth and Neptune, and orbiting closer to their host stars than Mercury does the Sun, are the most common type of planet revealed by exoplanet surveys over the last quarter century. Results from NASA's Kepler mission have revealed a bimodality in the radius distribution of these objects, with a relative underabundance of planets between 1.5 and 2.0 $R_{\oplus}$. This bimodality suggests that sub-Neptunes are mostly rocky planets that were born with primary atmospheres a few percent by mass accreted from the protoplanetary nebula. Planets above the radius gap were able to retain their atmospheres ("gas-rich super-Earths"), while planets below the radius gap lost their atmospheres and are stripped cores ("true super-Earths"). The mechanism that drives atmospheric loss for these planets remains an outstanding question, with photoevaporation and core-powered mass loss being the prime candidates. As with the mass-loss mechanism, there are two contenders for the origins of the solids in sub-Neptune planets: the migration model involves the growth and migration of embryos from beyond the ice line, while the drift model involves inward-drifting pebbles that coagulate to form planets close-in. Atmospheric studies have the potential to break degeneracies in interior structure models and place additional constraints on the origins of these planets. However, most atmospheric characterization efforts have been confounded by aerosols. Observations with upcoming facilities are expected to finally reveal the atmospheric compositions of these worlds, which are arguably the first fundamentally new type of planetary object identified from the study of exoplanets.


title: Parameter Reduction in Probabilistic Critical Time Evaluation Using Sensitivity Analysis and PCA

abstract: In this paper, we discuss a method to find the most influential power system parameters to the probabilistic transient stability assessment problem---finding the probability distribution of the critical clearing time. We perform the parameter selection by employing a sensitivity analysis combined with a principal component analysis. First, we determine the sensitivity of the machine angles with respect to all system parameters. Second, we employ the principal component analysis algorithm to identify the most influential parameters in the transient stability problem. By identifying such parameters, we can reduce the number of uncertain parameters to only the influential ones in the probabilistic assessment of transient stability, providing a significant speed-up in the probabilistic analysis of large power systems. The proposed algorithm was tested in the IEEE 14 bus systems and the results obtained show that our method can effectively find the most influential parameters.


title: Rewriting Meaningful Sentences via Conditional BERT Sampling and an application on fooling text classifiers

abstract: Most adversarial attack methods that are designed to deceive a text classifier change the text classifier's prediction by modifying a few words or characters. Few try to attack classifiers by rewriting a whole sentence, due to the difficulties inherent in sentence-level rephrasing as well as the problem of setting the criteria for legitimate rewriting. In this paper, we explore the problem of creating adversarial examples with sentence-level rewriting. We design a new sampling method, named ParaphraseSampler, to efficiently rewrite the original sentence in multiple ways. Then we propose a new criteria for modification, called a sentence-level threaten model. This criteria allows for both word- and sentence-level changes, and can be adjusted independently in two dimensions: semantic similarity and grammatical quality. Experimental results show that many of these rewritten sentences are misclassified by the classifier. On all 6 datasets, our ParaphraseSampler achieves a better attack success rate than our baseline.


title: Strengthening SDN Security: Protocol Dialecting and Downgrade Attacks

abstract: Software-defined networking (SDN) has become a fundamental technology for data centers and 5G networks. In an SDN network, routing and traffic management decisions are made by a centralized controller and communicated to switches via a control channel. Transport Layer Security (TLS) has been proposed as its single security layer; however, use of TLS is optional and connections are still vulnerable to downgrade attacks. In this paper, we propose the strengthening of security assurance using a protocol dialecting approach to provide additional and customizable security. We consider and evaluate two dialecting approaches for OpenFlow protocol operation, adding per-message authentication to the SDN control channel that is independent of TLS and provides robustness against downgrade attacks in the optional case of TLS implementation. Furthermore, we measure the performance impact of using these dialecting primitives in a Mininet experiment. The results show a modest increase of communication latency of less than 22%.


title: Towards Listening to 10 People Simultaneously: An Efficient Permutation Invariant Training of Audio Source Separation Using Sinkhorn's Algorithm

abstract: In neural network-based monaural speech separation techniques, it has been recently common to evaluate the loss using the permutation invariant training (PIT) loss. However, the ordinary PIT requires to try all $N!$ permutations between $N$ ground truths and $N$ estimates. Since the factorial complexity explodes very rapidly as $N$ increases, a PIT-based training works only when the number of source signals is small, such as $N = 2$ or $3$. To overcome this limitation, this paper proposes a SinkPIT, a novel variant of the PIT losses, which is much more efficient than the ordinary PIT loss when $N$ is large. The SinkPIT is based on Sinkhorn's matrix balancing algorithm, which efficiently finds a doubly stochastic matrix which approximates the best permutation in a differentiable manner. The author conducted an experiment to train a neural network model to decompose a single-channel mixture into 10 sources using the SinkPIT, and obtained promising results.


title: Constructing non-semisimple modular categories with relative monoidal centers

abstract: This paper is a contribution to the construction of non-semisimple modular categories. We establish when M\"uger centralizers inside non-semisimple modular categories are also modular. As a consequence, we obtain conditions under which relative monoidal centers give (non-semisimple) modular categories, and we also show that examples include representation categories of small quantum groups. We further derive conditions under which representations of more general quantum groups, braided Drinfeld doubles of Nichols algebras of diagonal type, give (non-semisimple) modular categories.


title: An explicit expression for the minimal polynomial of the Kronecker product of matrices. Explicit formulas for matrix logarithm and matrix exponential

abstract: Using $\mathcal{P}$-canonical forms of matrices, we derive the minimal polynomial of the Kronecker product of a given family of matrices in terms of the minimal polynomials of these matrices. This, allows us to prove that the product $\prod\limits_{i=1}^{m}L(P_{i})$, $L(P_{i})$ is the set of linear recurrence sequences over a field $F$ with characteristic polynomial $P_{i}$, is equal to $L(P)$ where $P$ is the minimal polynomial of the Kronecker product of the companion matrices of $P_{i}$, $1\leq i\leq m$. Also, we show how we deduce from the $\mathcal{P}$-canonical form of an arbitrary complex matrix $A$, the $\mathcal{P}$-canonical form of the matrix function $e^{tA}$ and a logarithm of $A$.


title: Global rigidity of actions by higher rank lattices with dominated splitting

abstract: We prove that any smooth volume-preserving action of a lattice $\Gamma$ in $\textrm{SL}(n,\mathbb{R})$, $n\ge 3$, on a closed $n$-manifold which possesses one element that admits a dominated splitting should be standard. In other words, the manifold is the $n$-flat torus and the action is smoothly conjugate to an affine action. Note that an Anosov diffeomorphism, or more generally, a partial hyperbolic diffeomorphism admits a dominated splitting. We have a topological global rigidity when $\alpha$ is $C^{1}$. Similar theorems hold for an action of a lattice in $\textrm{Sp}(2n,\mathbb{R})$ with $n\ge 2$ and $\textrm{SO}(n,n)$ with $n\ge 5$ on a closed $2n$-manifold.


title: Scene-Agnostic Multi-Microphone Speech Dereverberation

abstract: Neural networks (NNs) have been widely applied in speech processing tasks, and, in particular, those employing microphone arrays. Nevertheless, most existing NN architectures can only deal with fixed and position-specific microphone arrays. In this paper, we present an NN architecture that can cope with microphone arrays whose number and positions of the microphones are unknown, and demonstrate its applicability in the speech dereverberation task. To this end, our approach harnesses recent advances in deep learning on set-structured data to design an architecture that enhances the reverberant log-spectrum. We use noisy and noiseless versions of a simulated reverberant dataset to test the proposed architecture. Our experiments on the noisy data show that the proposed scene-agnostic setup outperforms a powerful scene-aware framework, sometimes even with fewer microphones. With the noiseless dataset we show that, in most cases, our method outperforms the position-aware network as well as the state-of-the-art weighted linear prediction error (WPE) algorithm.


title: Error Bounds of Imitating Policies and Environments

abstract: Imitation learning trains a policy by mimicking expert demonstrations. Various imitation methods were proposed and empirically evaluated, meanwhile, their theoretical understanding needs further studies. In this paper, we firstly analyze the value gap between the expert policy and imitated policies by two imitation methods, behavioral cloning and generative adversarial imitation. The results support that generative adversarial imitation can reduce the compounding errors compared to behavioral cloning, and thus has a better sample complexity. Noticed that by considering the environment transition model as a dual agent, imitation learning can also be used to learn the environment model. Therefore, based on the bounds of imitating policies, we further analyze the performance of imitating environments. The results show that environment models can be more effectively imitated by generative adversarial imitation than behavioral cloning, suggesting a novel application of adversarial imitation for model-based reinforcement learning. We hope these results could inspire future advances in imitation learning and model-based reinforcement learning.


title: Homogeneous Lagrangian foliations on complex space forms

abstract: We classify holomorphic isometric actions on complex space forms all whose orbits are Lagrangian submanifolds, up to orbit equivalence. The only examples are Lagrangian affine subspace foliations of complex Euclidean spaces, and Lagrangian horocycle foliations of complex hyperbolic spaces.


title: Development, Processing and Applications of a UV-Curable Polymer with Surface Active Thiol Groups

abstract: We present here a novel resist formulation with active thiol groups at the surface. The material is UV curable, and can be patterned at the micro- and nanoscale by UV nanoimprint lithography. The resist formulation development, its processing, patterning and surface characterization are presented here. In addition, a possible application, including its use to modify the electrical properties of graphene devices is shown. The cured material is highly transparent, intrinsically hydrophilic and can be made more hydrophilic following a UV-ozone or an O2 plasma activation. We evaluated the hydrophilicity of the polymer for different polymer formulations and curing conditions. In addition, a protocol for patterning of the polymer in the micro and nanoscale by nanoimprinting is given and preliminary etching rates together with the polymer selectivity are measured. The main characteristic and unique advantage of the polymer is that it has thiol functional groups at the surface and in the bulk after curing. These groups allow for direct surface modifications with thiol-based chemistry e.g., thiol-ene reactions. We prove the presence of the thiol groups by Raman spectroscopy and perform a thiol-ene reaction to show the potential of the easy click chemistry. This opens the way for very straightforward surface chemistry on nanoimprinted polymer samples. Furthermore, we show how the polymer improves the electrical properties of a graphene field effect transistor, allowing for optimal performance at ambient conditions.


title: Tight two-level convergence of Linear Parareal and MGRIT: Extensions and implications in practice

abstract: Two of the most popular parallel-in-time methods are Parareal and multigrid-reduction-in-time (MGRIT). Recently, a general convergence theory was developed in Southworth (2019) for linear two-level MGRIT/Parareal that provides necessary and sufficient conditions for convergence, with tight bounds on worst-case convergence factors. This paper starts by providing a new and simplified analysis of linear error and residual propagation of Parareal, wherein the norm of error or residual propagation is given by one over the minimum singular value of a certain block bidiagonal operator. New discussion is then provided on the resulting necessary and sufficient conditions for convergence that arise by appealing to block Toeplitz theory as in Southworth (2019). Practical applications of the theory are discussed, and the convergence bounds demonstrated to predict convergence in practice to high accuracy on two standard linear hyperbolic PDEs: the advection(-diffusion) equation, and the wave equation in first-order form.


title: Fast Approximate CoSimRanks via Random Projections

abstract: Given a graph $G$ with $n$ nodes and two nodes $u,v\in G$, the {\em CoSimRank} value $s(u,v)$ quantifies the similarity between $u$ and $v$ based on graph topology. Compared to SimRank, CoSimRank is shown to be more accurate and effective in many real-world applications, including synonym expansion, lexicon extraction, and entity relatedness in knowledge graphs. The computation of all pairwise CoSimRanks in $G$ is highly expensive and challenging. Existing solutions all focus on devising approximate algorithms for the computation of all pairwise CoSimRanks. To attain a desired absolute accuracy guarantee $\epsilon$, the state-of-the-art approximate algorithm for computing all pairwise CoSimRanks requires $O(n^3\log_2(\ln(\frac{1}{\epsilon})))$ time, which is prohibitively expensive even though $\epsilon$ is large. In this paper, we propose \rsim, a fast randomized algorithm for computing all pairwise CoSimRank values. The basic idea of \rsim is to approximate the $n\times n$ matrix multiplications in CoSimRank computation via random projection. Theoretically, \rsim runs in $O(\frac{n^2\ln(n)}{\epsilon^2}\ln(\frac{1}{\epsilon}))$ time and meanwhile ensures an absolute error of at most $\epsilon$ in each CoSimRank value in $G$ with a high probability. Extensive experiments using six real graphs demonstrate that \rsim is more than orders of magnitude faster than the state of the art. In particular, on a million-edge Twitter graph, \rsim answers the $\epsilon$-approximate ($\epsilon=0.1$) all pairwise CoSimRank query within 4 hours, using a single commodity server, while existing solutions fail to terminate within a day.


title: Effect of geometric parameters on the noise generated by rod-airfoil configuration

abstract: This paper investigates the effect of the geometric parameters -- rod diameter and the distance between the rod and the airfoil -- on the noise generated by rod-airfoil configuration using experimental and numerical techniques. The numerical simulations are carried out using the low-dissipation up-wind scheme and the Delayed-Detached-Eddy Simulation (DDES) approach with Shear-Layer Adapted (SLA) sub-grid length scale (SGS) for a faster transition between RANS and LES. A dual-time stepping strategy, leading to second-order accuracy in space and time, is followed. The Ffowcs-Williams and Hawkings (FWH) technique is used to post-process the pressure fluctuations to predict the far~field acoustics. A corresponding detailed experimental analysis, carried out using phased microphone array techniques in the aeroacoustic wind tunnel at the Brandenburg Technical University at Cottbus, is used for the validation of the numerical method. The key objective of the analysis is to examine the influence of the parameters of the configuration on the noise generation. The results show reasonable agreement with the experimental data in terms of far-field acoustics.


title: Learning Invariances in Neural Networks

abstract: Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to a given symmetry group. We show how to \emph{learn} invariances and equivariances by parameterizing a distribution over augmentations and optimizing the training loss simultaneously with respect to the network parameters and augmentation parameters. With this simple procedure we can recover the correct set and extent of invariances on image classification, regression, segmentation, and molecular property prediction from a large space of augmentations, on training data alone.


title: Spin-polarized tunable photocurrents

abstract: Harnessing the unique features of topological materials for the development of a new generation of topological based devices is a challenge of paramount importance. Using Floquet scattering theory combined with atomistic models we study the interplay between laser illumination, spin and topology in a two-dimensional material with spin-orbit coupling. Starting from a topological phase, we show how laser illumination can selectively disrupt the topological edge states depending on their spin. This is manifested by the generation of pure spin currents and spin-polarized charge photocurrents under linearly and circularly polarized laser-illumination, respectively. Our results open a path for the generation and control of spin-polarized photocurrents.


title: AEGIS: A real-time multimodal augmented reality computer vision based system to assist facial expression recognition for individuals with autism spectrum disorder

abstract: The ability to interpret social cues comes naturally for most people, but for those living with Autism Spectrum Disorder (ASD), some experience a deficiency in this area. This paper presents the development of a multimodal augmented reality (AR) system which combines the use of computer vision and deep convolutional neural networks (CNN) in order to assist individuals with the detection and interpretation of facial expressions in social settings. The proposed system, which we call AEGIS (Augmented-reality Expression Guided Interpretation System), is an assistive technology deployable on a variety of user devices including tablets, smartphones, video conference systems, or smartglasses, showcasing its extreme flexibility and wide range of use cases, to allow integration into daily life with ease. Given a streaming video camera source, each real-world frame is passed into AEGIS, processed for facial bounding boxes, and then fed into our novel deep convolutional time windowed neural network (TimeConvNet). We leverage both spatial and temporal information in order to provide an accurate expression prediction, which is then converted into its corresponding visualization and drawn on top of the original video frame. The system runs in real-time, requires minimal set up and is simple to use. With the use of AEGIS, we can assist individuals living with ASD to learn to better identify expressions and thus improve their social experiences.


title: Asymptotic analysis of extended two-dimensional narrow capture problems

abstract: In this paper we extend our recent work on two-dimensional (2D) diffusive search-and-capture processes with multiple small targets (narrow capture problems) by considering an asymptotic expansion of the Laplace transformed probability flux into each target. The latter determines the distribution of arrival or capture times into an individual target, conditioned on the set of events that result in capture by that target. A characteristic feature of strongly localized perturbations in 2D is that matched asymptotics generates a series expansion in $\nu=-1/\ln \epsilon$ rather than $\epsilon$, $0<\epsilon\ll 1$, where $\epsilon$ specifies the size of each target relative to the size of the search domain. Moreover, it is possible to sum over all logarithmic terms non-perturbatively. We exploit this fact to show how a Taylor expansion in the Laplace variable $s$ for fixed $\nu$ provides an efficient method for obtaining corresponding asymptotic expansions of the splitting probabilities and moments of the conditional FPT densities. We then use our asymptotic analysis to derive new results for two major extensions of the classical narrow capture problem: optimal search strategies under stochastic resetting, and the accumulation of target resources under multiple rounds of search-and-capture.


title: GAZED- Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings

abstract: We present GAZED- eye GAZe-guided EDiting for videos captured by a solitary, static, wide-angle and high-resolution camera. Eye-gaze has been effectively employed in computational applications as a cue to capture interesting scene content; we employ gaze as a proxy to select shots for inclusion in the edited video. Given the original video, scene content and user eye-gaze tracks are combined to generate an edited video comprising cinematically valid actor shots and shot transitions to generate an aesthetic and vivid representation of the original narrative. We model cinematic video editing as an energy minimization problem over shot selection, whose constraints capture cinematographic editing conventions. Gazed scene locations primarily determine the shots constituting the edited video. Effectiveness of GAZED against multiple competing methods is demonstrated via a psychophysical study involving 12 users and twelve performance videos.


title: Conditional independence by typing

abstract: A central goal of probabilistic programming languages (PPLs) is to separate modelling from inference. However, this goal is hard to achieve in practice. Users are often forced to re-write their models in order to improve efficiency of inference or meet restrictions imposed by the PPL. Conditional independence (CI) relationships among parameters are a crucial aspect of probabilistic models that capture a qualitative summary of the specified model and can facilitate more efficient inference. We present an information flow type system for probabilistic programming that captures conditional independence (CI) relationships, and show that, for a well-typed program in our system, the distribution it implements is guaranteed to have certain CI-relationships. Further, by using type inference, we can statically deduce which CI-properties are present in a specified model. As a practical application, we consider the problem of how to perform inference on models with mixed discrete and continuous parameters. Inference on such models is challenging in many existing PPLs, but can be improved through a workaround, where the discrete parameters are used implicitly, at the expense of manual model re-writing. We present a source-to-source semantics-preserving transformation, which uses our CI-type system to automate this workaround by eliminating the discrete parameters from a probabilistic program. The resulting program can be seen as a hybrid inference algorithm on the original program, where continuous parameters can be drawn using efficient gradient-based inference methods, while the discrete parameters are inferred using variable elimination. We implement our CI-type system and its example application in SlicStan: a compositional variant of Stan.


title: Effects of optical lattices on bright solitons in spin-orbit coupled Bose-Einstein condensates

abstract: The stationary bright solitons that appear in the ground state of the spin-orbit coupled Bose-Einstein condensate (SOC-BEC) exhibit nodes. We consider SOC-BEC in combined linear and nonlinear optical lattices and study their effects on the matter-wave bright soliton and find that the parameters of the nonlinear lattice or atomic scattering length can be judiciously manipulated to have useful control over the nodes of the soliton. It is seen that the soliton with large number of nodes is less stable compared to one having fewer number of nodes. We infer that that the synthetic spin-orbit coupling induces instability in the ordinary matter-wave soliton.


title: On the quasi-three dimensional configuration of magnetic clouds

abstract: We develop an optimization approach to model the magnetic field configuration of magnetic clouds, based on a linear-force free formulation in three dimensions. Such a solution, dubbed the Freidberg solution, is kin to the axi-symmetric Lundquist solution, but with more general "helical symmetry". The merit of our approach is demonstrated via its application to two case studies of in-situ measured magnetic clouds. Both yield results of reduced $\chi^2\approx 1$. Case 1 shows a winding flux rope configuration with one major polarity. Case 2 exhibits a double-helix configuration with two flux bundles winding around each other and rooted on regions of mixed polarities. This study demonstrates the three-dimensional complexity of the magnetic cloud structures.


title: Vertical mixing in oil spill modelling

abstract: The main focus of marine oil spill modelling is often on where the oil will end up, i.e., on the horizontal transport. However, due to current shear, wind drag, and the different physical, chemical and biological processes that affect oil differently on the surface and in the water column, modelling the vertical distribution of the oil is essential for modelling the horizontal transport. In this work, we review and present models for a number of physical processes that influence the vertical transport of oil, including wave entrainment, droplet rise, vertical turbulent mixing, and surfacing. We aim to provide enough detail for the reader to be able to understand and implement the models, and to provide references to further reading. Mathematical and numerical details are included, particularly on the advection and diffusion of particles. We also present and discuss some common numerical pitfalls that may be a bit subtle, but which can cause significant errors.


title: Can entanglement hide behind triangle-free graphs?

abstract: We present an alternative approach to unveil a different kind of entanglement in bipartite quantum states whose diagonal zero patterns in suitable matrix representations admit a nice description in terms of triangle-free graphs. Upon application of a local averaging operation, the separability of such states transforms into a simple matrix positivity condition, the violation of which implies the presence of entanglement. We completely characterize the class of triangle-free graphs which allows for nontrivial entanglement detection using the above test. Moreover, we develop a recipe to construct a plethora of unique classes of positive partial transpose (PPT) entangled triangle-free states in arbitrary dimensions. Finally, we link the task of entanglement detection in general states to the well-known graph-theoretic problem of finding triangle-free-induced subgraphs in a given graph.


title: Diophantine approximation and continued fraction expansion for quartic power series over $\mathbb{F}_{3}$

abstract: While Roth's theorem states that the irrationality measure of all the irrational algebraic numbers is 2, and the same holds true over function fields in characteristic zero, some counter-examples were found over function fields in positive characteristic. This was put forward first by Mahler in 1949, in his fundamental paper on Diophantine approximation \cite{M}. It seems that, except for particular elements, as power series with bounded partial quotients, Roth's theorem holds. Until now, only one element, with unbounded partial quotients, discovered by Mills and Robbins \cite{MR} in 1986, has been recognized having this property. It concerns a quartic power series over $\mathbb{F}_{3}$ having a continued fraction expansion with remarkable pattern. This continued fraction expansion was explicitly described by Buck and Robbins \cite{BR}, and later by Lasjaunias \cite{LA2} who used another method somewhat easier. Furthermore, Lasjaunias \cite{LA2} improve the value of its irrationality measure in relation with Roth's theorem. We will see that this power series is included in a large quartic power series family, for which the continued fraction expansion and the irrationality measure can be explicitly given. Moreover, we will study the rational approximation of other examples of quartic power series over $\mathbb{F}_{3}$ and we will extend the set of counter-examples initiated by Mahler.


title: ParaLarH: Parallel FPGA Router based upon Lagrange Heuristics

abstract: Routing of the nets in Field Programmable Gate Array (FPGA) design flow is one of the most time consuming steps. Although Versatile Place and Route (VPR), which is a commonly used algorithm for this purpose, routes effectively, it is slow in execution. One way to accelerate this design flow is to use parallelization. Since VPR is intrinsically sequential, a set of parallel algorithms have been recently proposed for this purpose (ParaLaR and ParaLarPD). These algorithms formulate the routing process as a Linear Program (LP) and solve it using the Lagrange relaxation, the sub-gradient method, and the Steiner tree algorithm. Out of the many metrics available to check the effectiveness of routing, ParaLarPD, which is an improved version of ParaLaR, suffers from large violations in the constraints of the LP problem (which is related to the minimum channel width metric) as well as an easily measurable critical path delay metric that can be improved further. In this paper, we introduce a set of novel Lagrange heuristics that improve the Lagrange relaxation process. When tested on the MCNC benchmark circuits, on an average, this leads to halving of the constraints violation, up to 10% improvement in the minimum channel width, and up to 8% reduction in the critical path delay as obtained from ParaLarPD. We term our new algorithm as ParaLarH. Due to the increased work in the Lagrange relaxation process, as compared to ParaLarPD, ParaLarH does slightly deteriorate the speedup obtained because of parallelization, however, this aspect is easily compensated by using more number of threads.


title: An optical wormhole from hollow disclinations

abstract: We examine the optical properties of two different configurations of an ordered liquid crystal film on a catenoid forming coreless disclinations. We find the effective optical metric from which we obtain the geodesics and wave modes characterizing thus the propagation of light on this surface. We show that the optical metric describes a two-dimensional section of the spacetime of a conical wormhole.


title: What are the Statistical Limits of Offline RL with Linear Function Approximation?

abstract: Offline reinforcement learning seeks to utilize offline (observational) data to guide the learning of (causal) sequential decision making strategies. The hope is that offline reinforcement learning coupled with function approximation methods (to deal with the curse of dimensionality) can provide a means to help alleviate the excessive sample complexity burden in modern sequential decision making problems. However, the extent to which this broader approach can be effective is not well understood, where the literature largely consists of sufficient conditions. This work focuses on the basic question of what are necessary representational and distributional conditions that permit provable sample-efficient offline reinforcement learning. Perhaps surprisingly, our main result shows that even if: i) we have realizability in that the true value function of \emph{every} policy is linear in a given set of features and 2) our off-policy data has good coverage over all features (under a strong spectral condition), then any algorithm still (information-theoretically) requires a number of offline samples that is exponential in the problem horizon in order to non-trivially estimate the value of \emph{any} given policy. Our results highlight that sample-efficient offline policy evaluation is simply not possible unless significantly stronger conditions hold; such conditions include either having low distribution shift (where the offline data distribution is close to the distribution of the policy to be evaluated) or significantly stronger representational conditions (beyond realizability).


title: ${\cal O}(\alpha_sv^2)$ corrections to hadronic decay of vector quarkonia

abstract: Within the nonrelativistic QCD (NRQCD) factorization framework, we compute the ${\mathcal O}(\alpha_s v^2)$ corrections to the hadronic decay rate of vector quarkonia, exemplified by $J/\psi$ and $\Upsilon$. Setting both the renormalization and NRQCD factorization scales to be $m_Q$, we obtain $\Gamma(J/\psi\to {\rm LH})= 0.0716\frac{\alpha_s^3}{m_c^2} \langle \mathcal{O}_1({}^3S_1)\rangle_{J/\psi} [1-1.19\alpha_s+(-5.32+3.03\alpha_s)\langle v^2\rangle_{J/\psi}]$ and $\Gamma(\Upsilon\to {\rm LH})= 0.0716\frac{\alpha_s^3}{m_b^2}\langle\mathcal{O}_1({}^3S_1)\rangle_{\Upsilon}[1-1.56\alpha_s+(-5.32+4.61\alpha_s)\langle v^2\rangle_{\Upsilon}]$. We confirm the previous calculation of $\mathcal{O}(\alpha_s)$ corrections on a diagram-by-diagram basis, with the accuracy significantly improved. For $J/\psi$ hadronic decay, we find that the ${\mathcal O}(\alpha_sv^2)$ corrections are moderate and positive, nevertheless unable to counterbalance the huge negative corrections. On the other hand, the effect of ${\mathcal O}(\alpha_sv^2)$ corrections for $\Upsilon(nS)$ is sensitive to the $\mathcal{O}(v^2)$ NRQCD matrix elements. With the appropriate choice of the NRQCD matrix elements, our theoretical predictions for the decay rates may be consistent with the experimental data for $\Upsilon(1S,2S)\to {\rm LH}$. As a byproduct, we also present the theoretical predictions for the branching ratio of $J/\psi(\Upsilon)\to 3\gamma$ accurate up to $\mathcal{O}(\alpha_s v^2)$.


title: A Visual Analytics Based Decision Making Environment for COVID-19 Modeling and Visualization

abstract: Public health officials dealing with pandemics like COVID-19 have to evaluate and prepare response plans. This planning phase requires not only looking into the spatiotemporal dynamics and impact of the pandemic using simulation models, but they also need to plan and ensure the availability of resources under different spread scenarios. To this end, we have developed a visual analytics environment that enables public health officials to model, simulate, and explore the spread of COVID-19 by supplying county-level information such as population, demographics, and hospital beds. This environment facilitates users to explore spatiotemporal model simulation data relevant to COVID-19 through a geospatial map with linked statistical views, apply different decision measures at different points in time, and understand their potential impact. Users can drill-down to county-level details such as the number of sicknesses, deaths, needs for hospitalization, and variations in these statistics over time. We demonstrate the usefulness of this environment through a use case study and also provide feedback from domain experts. We also provide details about future extensions and potential applications of this work.


title: The subtraction contribution to the muonic-hydrogen Lamb shift: a point for lattice QCD calculations of the polarizability effect

abstract: The proton-polarizability contribution to the muonic-hydrogen Lamb shift is a major source of theoretical uncertainty in the extraction of the proton charge radius. An empirical evaluation of this effect, based on the proton structure functions, requires a systematically improvable calculation of the "subtraction function", possibly using lattice QCD. We consider a different subtraction point, with the aim of accessing the subtraction function directly in lattice calculations. A useful feature of this subtraction point is that the corresponding contribution of the structure functions to the Lamb shift is suppressed. The whole effect is dominated by the subtraction contribution, calculable on the lattice.


title: Magnetic properties and quench dynamics of two interacting ultracold molecules in a trap

abstract: We theoretically investigate the magnetic properties and nonequilibrium dynamics of two interacting ultracold polar and paramagnetic molecules in a one-dimensional harmonic trap in external electric and magnetic fields. The molecules interact via a multichannel two-body contact potential, incorporating the short-range anisotropy of intermolecular interactions. We show that various magnetization states arise from the interplay of the molecular interactions, electronic spins, dipole moments, rotational structures, external fields, and spin-rotation coupling. The rich magnetization diagrams depend primarily on the anisotropy of the intermolecular interaction and the spin-rotation coupling. These specific molecular properties are challenging to calculate or measure. Therefore, we propose the quench dynamics experiments for extracting them from observing the time evolution of the analyzed system. Our results indicate the possibility of controlling the molecular few-body magnetization with the external electric field and pave the way towards studying the magnetization of ultracold molecules trapped in optical tweezers or optical lattices and their application in quantum simulation of molecular multichannel many-body Hamiltonians and quantum information storing.

categories: physics.atom-ph cond-mat.quant-gas physics.chem-ph quant-ph


title: Self-learning Monte-Carlo for non-abelian gauge theory with dynamical fermions

abstract: In this paper, we develop the self-learning Monte-Carlo (SLMC) algorithm for non-abelian gauge theory with dynamical fermions in four dimensions to resolve the autocorrelation problem in lattice QCD. We perform simulations with the dynamical staggered fermions and plaquette gauge action by both in HMC and SLMC for zero and finite temperature to examine the validity of SLMC. We confirm that SLMC can reduce autocorrelation time in non-abelian gauge theory and reproduces results from HMC. For finite temperature runs, we confirm that SLMC reproduces correct results with HMC, including higher-order moments of the Polyakov loop and the chiral condensate. Besides, our finite temperature calculations indicate that four flavor QC${}_2$D with $\hat{m} = 0.5$ is likely in the crossover regime in the Colombia plot.


title: An abstract Logvinenko-Sereda type theorem for spectral subspaces

abstract: We provide an abstract framework for a Logvinenko-Sereda type theorem, where the classical compactness assumption on the support of the Fourier transform is replaced by the assumption that the functions under consideration belong to a spectral subspace associated with a finite energy interval for some lower semibounded self-adjoint operator on a Euclidean $L^2$-space. Our result then provides a bound for the $L^2$-norm of such functions in terms of their $L^2$-norm on a thick subset with a constant explicit in the geometric and spectral parameters. This recovers previous results for functions on the whole space, hyperrectangles, and infinite strips with compact Fourier support and for finite linear combinations of Hermite functions and allows to extend them to other domains. The proof follows the approach by Kovrijkine and is based on Bernstein-type inequalities for the respective functions, complemented with a suitable covering of the underlying domain.


title: Progress towards the first measurement of charm baryon dipole moments

abstract: Electromagnetic dipole moments of short-lived particles are sensitive to physics within and beyond the Standard Model of particle physics but have not been accessible experimentally to date. To perform such measurements it has been proposed to exploit the spin precession of channeled particles in bent crystals at the LHC. Progress that enables the first measurement of charm baryon dipole moments is reported. In particular, the design and characterization on beam of silicon and germanium bent crystal prototypes, the optimization of the experimental setup, and advanced analysis techniques are discussed. Sensitivity studies show that first measurements of $\Lambda_c^+$ and $\Xi_c^+$ baryon dipole moments can be performed in two years of data taking with an experimental setup positioned upstream of the LHCb detector.


title: Stochastic Evolutionary Dynamics of Trust Games with Asymmetric Parameters

abstract: Trusting in others and reciprocating that trust with trustworthy actions are crucial to successful and prosperous societies. The Trust Game has been widely used to quantitatively study trust and trustworthiness, involving a sequential exchange between an investor and a trustee. The deterministic evolutionary game theory predicts no trust and no trustworthiness whereas the behavioural experiments with the one-shot anonymous Trust Game show that people substantially trust and respond trustworthily. To explain these discrepancies, previous works often turn to additional mechanisms, which are borrowed from other games such as Prisoner's Dilemma. Although these mechanisms lead to the evolution of trust and trustworthiness to an extent, the optimal or the most common strategy often involves no trustworthiness. In this paper, we study the impact of asymmetric demographic parameters (e.g. different population sizes) on game dynamics of the Trust Game. We show that, in weak-mutation limit, stochastic evolutionary dynamics with the asymmetric parameters can lead to the evolution of high trust and high trustworthiness without any additional mechanisms in well-mixed finite populations. Even full trust and near full trustworthiness can be the most common strategy. These results are qualitatively different from those of the previous works. Our results thereby demonstrate rich evolutionary dynamics of the asymmetric Trust Game.


title: Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision

abstract: Most music source separation systems require large collections of isolated sources for training, which can be difficult to obtain. In this work, we use musical scores, which are comparatively easy to obtain, as a weak label for training a source separation system. In contrast with previous score-informed separation approaches, our system does not require isolated sources, and score is used only as a training target, not required for inference. Our model consists of a separator that outputs a time-frequency mask for each instrument, and a transcriptor that acts as a critic, providing both temporal and frequency supervision to guide the learning of the separator. A harmonic mask constraint is introduced as another way of leveraging score information during training, and we propose two novel adversarial losses for additional fine-tuning of both the transcriptor and the separator. Results demonstrate that using score information outperforms temporal weak-labels, and adversarial structures lead to further improvements in both separation and transcription performance.


title: Embeddings of quadratic spaces over the field of $p$-adic numbers

abstract: Nondegenerate quadratic forms over $p$-adic fields are classified by their dimension, discriminant, and Hasse invariant. This paper uses these three invariants, elementary facts about $p$-adic fields and the theory of quadratic forms to determine which types of quadratic spaces -- including degenerate cases -- can be embedded in the Euclidean $p$-adic space $(\mathbb{Q}_{p}^{n},x_{1}^{2}+\cdots+x_{n}^{2})$, and the Lorentzian space $(\mathbb{Q}_{p}^{n},x_{1}^{2}+\cdots+x_{n-1}^{2}+\lambda x_{n}^{2})$, where $\mathbb{Q}_{p}$ is the field of $p$-adic numbers, and $\lambda$ is a nonsquare in the finite field $\mathbb{F}_{p}$. Furthermore, the minimum dimension $n$ that admits such an embedding is determined.


title: Bottom-quark production at hadron colliders: fully differential predictions in NNLO QCD

abstract: We report on the first fully differential calculation of the next-to-next-to-leading-order (NNLO) QCD radiative corrections to the production of bottom-quark pairs at hadron colliders. The calculation is performed by using the $q_T$ subtraction formalism to handle and cancel infrared singularities in real and virtual contributions. The computation is implemented in the Matrix framework, thereby allowing us to efficiently compute arbitrary infrared-safe observables in the four-flavour scheme. We present selected predictions for bottom-quark production at the Tevatron and at the LHC at different collider energies, and we perform some comparisons with available experimental results. We find that the NNLO corrections are sizeable, typically of the order of $25$-$35\%$, and they lead to a significant reduction of the perturbative uncertainties. Therefore, their inclusion is crucial for an accurate theoretical description of this process.


title: Development of an optical photon-counting imager with a monolithic Geiger APD array

abstract: We have developed a sensor system based on an optical photon-counting imager with high timing resolution, aiming for highly time-variable astronomical phenomena. The detector is a monolithic Geiger-mode avalanche photodiode array customized in a Multi-Pixel Photon Counter with a response time on the order of nanoseconds. This paper evaluates the basic performance of the sensor and confirms the gain linearity, uniformity, and low dark count. We demonstrate the system's ability to detect the period of a flashing LED, using a data acquisition system developed to obtain the light curve with a time bin of 100 microseconds. The Crab pulsar was observed using a 35-cm telescope without cooling, and the equipment detected optical pulses with a period consistent with the data from the radio ephemeris. Although improvements to the system will be necessary for more reliability, the system has been proven to be a promising device for exploring the time-domain optical astronomy.


title: Lightlike Geodesics and Gravitational Lensing in the Spacetime of an Accelerating Black Hole

abstract: The C-metric is a solution to Einstein's vacuum field equation that describes an accelerating black hole. In this paper we discuss the propagation of light rays and the resulting lensing features in this metric. We first solve the lightlike geodesic equation using elliptic integrals and Jacobi elliptic functions. Then we fix a static observer in the region of outer communication of the C-metric and introduce an orthonormal tetrad to parameterise the directions of the light rays ending at the position of the observer using latitude-longitude coordinates on the observer's celestial sphere. In this parameterisation we rederive the angular radius of the shadow, we formulate a lens equation, and we derive the redshift and the travel time of light rays. We discuss the relevance of our theoretical results for detecting accelerating black holes described by the C-metric and for distinguishing them from non-accelerating black holes.


title: Contrastive Self-Supervised Learning for Wireless Power Control

abstract: We propose a new approach for power control in wireless networks using self-supervised learning. We partition a multi-layer perceptron that takes as input the channel matrix and outputs the power control decisions into a backbone and a head, and we show how we can use contrastive learning to pre-train the backbone so that it produces similar embeddings at its output for similar channel matrices and vice versa, where similarity is defined in an information-theoretic sense by identifying the interference links that can be optimally treated as noise. The backbone and the head are then fine-tuned using a limited number of labeled samples. Simulation results show the effectiveness of the proposed approach, demonstrating significant gains over pure supervised learning methods in both sum-throughput and sample efficiency.


title: Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learning

abstract: Most of existing audio fingerprinting systems have limitations to be used for high-specific audio retrieval at scale. In this work, we generate a low-dimensional representation from a short unit segment of audio, and couple this fingerprint with a fast maximum inner-product search. To this end, we present a contrastive learning framework that derives from the segment-level search objective. Each update in training uses a batch consisting of a set of pseudo labels, randomly selected original samples, and their augmented replicas. These replicas can simulate the degrading effects on original audio signals by applying small time offsets and various types of distortions, such as background noise and room/microphone impulse responses. In the segment-level search task, where the conventional audio fingerprinting systems used to fail, our system using 10x smaller storage has shown promising results. Our code and dataset are available at \url{https://mimbres.github.io/neural-audio-fp/}.


title: Source localization using particle filtering on FPGA for robotic navigation with imprecise binary measurement

abstract: Particle filtering is a recursive Bayesian estimation technique that has gained popularity recently for tracking and localization applications. It uses Monte Carlo simulation and has proven to be a very reliable technique to model non-Gaussian and non-linear elements of physical systems. Particle filters outperform various other traditional filters like Kalman filters in non-Gaussian and non-linear settings due to their non-analytical and non-parametric nature. However, a significant drawback of particle filters is their computational complexity, which inhibits their use in real-time applications with conventional CPU or DSP based implementation schemes. This paper proposes a modification to the existing particle filter algorithm and presents a highspeed and dedicated hardware architecture. The architecture incorporates pipelining and parallelization in the design to reduce execution time considerably. The design is validated for a source localization problem wherein we estimate the position of a source in real-time using the particle filter algorithm implemented on hardware. The validation setup relies on an Unmanned Ground Vehicle (UGV) with a photodiode housing on top to sense and localize a light source. We have prototyped the design using Artix-7 field-programmable gate array (FPGA), and resource utilization for the proposed system is presented. Further, we show the execution time and estimation accuracy of the high-speed architecture and observe a significant reduction in computational time. Our implementation of particle filters on FPGA is scalable and modular, with a low execution time of about 5.62 us for processing 1024 particles and can be deployed for real-time applications.


title: An assessment of European electricity arbitrage using storage systems

abstract: This study analyses the current viability of this business based on a sample of European countries in the year 2019; countries where electricity prices (day-ahead market) and financial conditions show a certain degree of heterogeneity. We basically follow a sequence of three analyses in our study. Firstly, a Linear Mixed-Integrated Programming model has been developed to optimize the arbitrage strategy for each country in the sample. Secondly, using the cash-flows from the optimization model, we calculate two financial indicators (NPV and IRR) in order to select the optimal converter size for each country. Tax and discount rates specific to each country have been used with the calculation of this second rate following the methodology proposed by the Spanish regulator. Thirdly, a mixed linear regression model is proposed in order to investigate the importance of observed and unobserved heterogeneity (at country level) in explaining the business profitability.


title: Mass-conservative and positivity preserving second-order semi-implicit methods for high-order parabolic equations

abstract: We consider a class of finite element approximations for fourth-order parabolic equations that can be written as a system of second-order equations by introducing an auxiliary variable. In our approach, we first solve a variational problem and then an optimization problem to satisfy the desired physical properties of the solution such as conservation of mass, positivity (non-negativity) of solution and dissipation of energy. Furthermore, we show existence and uniqueness of the solution to the optimization problem and we prove that the methods converge to the truncation schemes \cite{Berger1975}. We also propose new conservative truncation methods for high-order parabolic equations. A numerical convergence study is performed and a series of numerical tests are presented to show and compare the efficiency and robustness of the different schemes.


title: Gaussoids are two-antecedental approximations of Gaussian conditional independence structures

abstract: The gaussoid axioms are conditional independence inference rules which characterize regular Gaussian CI structures over a three-element ground set. It is known that no finite set of inference rules completely describes regular Gaussian CI as the ground set grows. In this article we show that the gaussoid axioms logically imply every inference rule of at most two antecedents which is valid for regular Gaussians over any ground set. The proof is accomplished by exhibiting for each inclusion-minimal gaussoid extension of at most two CI statements a regular Gaussian realization. Moreover we prove that all those gaussoids have rational positive-definite realizations inside every $\varepsilon$-ball around the identity matrix. For the proof we introduce the concept of algebraic Gaussians over arbitrary fields and of positive Gaussians over ordered fields and obtain the same two-antecedental completeness of the gaussoid axioms for algebraic and positive Gaussians over all fields of characteristic zero as a byproduct.


title: Challenges in Information-Seeking QA: Unanswerable Questions and Paragraph Retrieval

abstract: Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are provided after the queries are written independently remain challenging. We analyze why answering information-seeking queries is more challenging and where their prevalent unanswerabilities arise, on Natural Questions and TyDi QA. Our controlled experiments suggest two headrooms -- paragraph selection and answerability prediction, i.e. whether the paired evidence document contains the answer to the query or not. When provided with a gold paragraph and knowing when to abstain from answering, existing models easily outperform a human annotator. However, predicting answerability itself remains challenging. We manually annotate 800 unanswerable examples across six languages on what makes them challenging to answer. With this new data, we conduct per-category answerability prediction, revealing issues in the current dataset collection as well as task formulation. Together, our study points to avenues for future research in information-seeking question answering, both for dataset creation and model development.


title: Lefschetz fibrations with arbitrary signature

abstract: We develop techniques to construct explicit symplectic Lefschetz fibrations over the 2-sphere with any prescribed signature and any spin type when the signature is divisible by 16. This solves a long-standing conjecture on the existence of such fibrations with positive signature. As applications, we produce symplectic 4-manifolds that are homeomorphic but not diffeomorphic to connected sums of S^2 x S^2, with the smallest topology known to date, as well as larger examples as symplectic Lefschetz fibrations.