title: Design study for a 500 MeV positron beam at the Mainz Microtron MAMI

abstract: A design study has been performed for a positron beam with an energy of 500 MeV to be realized at the applied physics area of the Mainz Microtron MAMI. Positrons will be created after pair conversion of bremsstrahlung, produced by the 855 MeV electron beam af MAMI in a tungsten converter target. From the two conceivable geometries (i) pair conversion in the bremsstrahlung converter target itself, and (ii) bremsstrahlung pair conversion in a separated lead foil, the former was considered in detail. Positrons will be energy selected within an outside open electron beam-line bending magnet, and bent back by an additional sector magnet. Magnetic focusing elements in between are designed to prepare in a well shielded positron target chamber about 6 m away from the target a beam with horizontal and vertical emittances of epsilon_v = 0.055 pi mm mrad (1 sigma), and epsilon_h = 0.12 pi mm mrad (1 sigma), respectively, for a 10 micro m thick amorphous tungsten target and negligible momentum spread. At an accepted positron band width of 1 MeV, spots are expected vertically with an angular spread of 0.064 mrad and a size of 5.0 mm (FWHM), and horizontally with an angular spread of 0.64 mrad and a size of 7.7 mm (FWHM). The positron yield amounts to 13.1 per second, 1 MeV positron energy band width, and 1 nA electron beam current.


title: Vortices in rotating Bose gas interacting via finite range Gaussian potential in a quasi-two-dimensional harmonic trap

abstract: A system of harmonically trapped N=16 spin-$0$ bosons confined in quasi-$2$D symmetrical $x-y$ plane interacting via a finite range repulsive Gaussian potential is studied under an externally impressed rotation to an over all angular velocity $\Omega$ about the $z-$axis. The exact diagonalization (ED) of $n\times n$ many-body Hamiltonian matrix in a given subspace of quantized total angular momentum $0\le L_{z} \le 4N$ is performed using Davidson algorithm. For $N=16 \mbox{and}\ L_{z}=32$, the dimensionality of the Hilbert space turns out to be $n=384559$. The trap velocity $\Omega$ being the Langrange multiplier associated with the angular momentum $L_{z}$ for the rotating systems, the $L_{z}-\Omega$ phase diagram (or stability line) is drawn which determines the critical angular velocities, $\Omega_{\bf c_{i}}, i=1,2..$, at which, for a given angular momentum $L_{z}$, the system goes through a quantum phase transition. %condensate fraction, von-Neumann entropy exhibit abrupt %(quantum phase)jumps. Further with increase in interaction range $\sigma$, the quantum mechanical coherence extends over more and more particles in the system resulting in an enhanced stability of the $i^{th}$ vortical state with angular momentum $L_{z}\left(\Omega_{c_{i}}\right)$ leading to a delayed onset of the the next vortical state $L_{z}\left(\Omega_{c_{i+1}}\right)$ at a higher value of the next critical angular velocity $\Omega_{c_{i+1}}$. There is an increase in the critical angular velocity $\left(\Omega_{\textbf{c}_{i}}, i=1,2,3\cdots\right)$ and in the largest condensate fraction $\lambda_{1}$, calculated using single particle reduced density matrix(SPRDM) eigen-values with increase in the interaction range $\sigma$. We calculated the von-Neumann quantum entropy ($S_{1}$), degree of condensation ($C_{d}$) and the conditional probability density (CPDs).


title: Autoformalization with Large Language Models

abstract: Autoformalization is the process of automatically translating from natural language mathematics to formal specifications and proofs. A successful autoformalization system could advance the fields of formal verification, program synthesis, and artificial intelligence. While the long-term goal of autoformalization seemed elusive for a long time, we show large language models provide new prospects towards this goal. We make the surprising observation that LLMs can correctly translate a significant portion ($25.3\%$) of mathematical competition problems perfectly to formal specifications in Isabelle/HOL. We demonstrate the usefulness of this process by improving a previously introduced neural theorem prover via training on these autoformalized theorems. Our methodology results in a new state-of-the-art result on the MiniF2F theorem proving benchmark, improving the proof rate from $29.6\%$ to $35.2\%$.


title: Guiding Visual Question Answering with Attention Priors

abstract: The current success of modern visual reasoning systems is arguably attributed to cross-modality attention mechanisms. However, in deliberative reasoning such as in VQA, attention is unconstrained at each step, and thus may serve as a statistical pooling mechanism rather than a semantic operation intended to select information relevant to inference. This is because at training time, attention is only guided by a very sparse signal (i.e. the answer label) at the end of the inference chain. This causes the cross-modality attention weights to deviate from the desired visual-language bindings. To rectify this deviation, we propose to guide the attention mechanism using explicit linguistic-visual grounding. This grounding is derived by connecting structured linguistic concepts in the query to their referents among the visual objects. Here we learn the grounding from the pairing of questions and images alone, without the need for answer annotation or external grounding supervision. This grounding guides the attention mechanism inside VQA models through a duality of mechanisms: pre-training attention weight calculation and directly guiding the weights at inference time on a case-by-case basis. The resultant algorithm is capable of probing attention-based reasoning models, injecting relevant associative knowledge, and regulating the core reasoning process. This scalable enhancement improves the performance of VQA models, fortifies their robustness to limited access to supervised data, and increases interpretability.


title: DisinfoMeme: A Multimodal Dataset for Detecting Meme Intentionally Spreading Out Disinformation

abstract: Disinformation has become a serious problem on social media. In particular, given their short format, visual attraction, and humorous nature, memes have a significant advantage in dissemination among online communities, making them an effective vehicle for the spread of disinformation. We present DisinfoMeme to help detect disinformation memes. The dataset contains memes mined from Reddit covering three current topics: the COVID-19 pandemic, the Black Lives Matter movement, and veganism/vegetarianism. The dataset poses multiple unique challenges: limited data and label imbalance, reliance on external knowledge, multimodal reasoning, layout dependency, and noise from OCR. We test multiple widely-used unimodal and multimodal models on this dataset. The experiments show that the room for improvement is still huge for current models.


title: Semantic Embeddings in Semilattices

abstract: To represent anything from mathematical concepts to real-world objects, we have to resort to an encoding. Encodings, such as written language, usually assume a decoder that understands a rich shared code. A semantic embedding is a form of encoding that assumes a decoder with no knowledge, or little knowledge, beyond the basic rules of a mathematical formalism such as an algebra. Here we give a formal definition of a semantic embedding in a semilattice which can be used to resolve machine learning and classic computer science problems. Specifically, a semantic embedding of a problem is here an encoding of the problem as sentences in an algebraic theory that extends the theory of semilattices. We use the recently introduced formalism of finite atomized semilattices to study the properties of the embeddings and their finite models. For a problem embedded in a semilattice, we show that every solution has a model atomized by an irreducible subset of the non-redundant atoms of the freest model of the embedding. We give examples of semantic embeddings that can be used to find solutions for the N-Queen's completion, the Sudoku, and the Hamiltonian Path problems.


title: Location-free Human Pose Estimation

abstract: Human pose estimation (HPE) usually requires large-scale training data to reach high performance. However, it is rather time-consuming to collect high-quality and fine-grained annotations for human body. To alleviate this issue, we revisit HPE and propose a location-free framework without supervision of keypoint locations. We reformulate the regression-based HPE from the perspective of classification. Inspired by the CAM-based weakly-supervised object localization, we observe that the coarse keypoint locations can be acquired through the part-aware CAMs but unsatisfactory due to the gap between the fine-grained HPE and the object-level localization. To this end, we propose a customized transformer framework to mine the fine-grained representation of human context, equipped with the structural relation to capture subtle differences among keypoints. Concretely, we design a Multi-scale Spatial-guided Context Encoder to fully capture the global human context while focusing on the part-aware regions and a Relation-encoded Pose Prototype Generation module to encode the structural relations. All these works together for strengthening the weak supervision from image-level category labels on locations. Our model achieves competitive performance on three datasets when only supervised at a category-level and importantly, it can achieve comparable results with fully-supervised methods with only 25\% location labels on MS-COCO and MPII.


title: On the new coupled complex boundary method in shape optimization framework for solving stationary free boundary problems

abstract: We expose here a novel application of the so-called coupled complex boundary method -- first put forward by Cheng et al. (2014) to deal with inverse source problems -- in the framework of shape optimization for solving the exterior Bernoulli problem, a prototypical model of stationary free boundary problems. The idea of the method is to transform the overdetermined problem to a complex boundary value problem with a complex Robin boundary condition coupling the Dirichlet and Neumann boundary conditions on the free boundary. Then, we optimize the cost function constructed by the imaginary part of the solution in the whole domain in order to identify the free boundary. We also prove the existence of the shape derivative of the complex state with respect to the domain. Afterwards, we compute the shape gradient of the cost functional, and characterize its shape Hessian at the optimal domain under a strong, and then a mild regularity assumption on the domain. We then examine the instability of the proposed method by proving the compactness of the latter expression. Also, we devise an iterative algorithm based on a Sobolev gradient scheme via finite element method to solve the minimization problem. Finally, we illustrate the applicability of the method through several numerical examples, both in two and three spatial dimensions.


title: Unbiased and Efficient Sampling of Dependency Trees

abstract: Most computational models of dependency syntax consist of distributions over spanning trees. However, the majority of dependency treebanks require that every valid dependency tree has a single edge coming out of the ROOT node, a constraint that is not part of the definition of spanning trees. For this reason all standard inference algorithms for spanning trees are suboptimal for inference over dependency trees. Zmigrod et al. (2021b) proposed algorithms for sampling with and without replacement from the dependency tree distribution that incorporate the single-root constraint. In this paper we show that their fastest algorithm for sampling with replacement, Wilson-RC, is in fact producing biased samples and we provide two alternatives that are unbiased. Additionally, we propose two algorithms (one incremental, one parallel) that reduce the asymptotic runtime of algorithm for sampling k trees without replacement to O(kn3). These algorithms are both asymptotically and practically more efficient.


title: The range of Hilbert operator and Derivative-Hilbert operator acting on $H^1$

abstract: Let $\mu$ be a positive Borel measure on the interval $[0,1)$. The Hankel matrix $\mathcal{H}_{\mu}=(\mu_{n,k})_{n,k\geq0}$ with entries $\mu_{n,k}=\mu_{n+k}$, where $\mu_n=\int_{[0,1)}t^{n}d\mu(t)$. For $f(z)=\sum_{n=0}^{\infty}a_nz^n$ is an analytic function in $\mathbb{D}$, the Hilbert operator is defined by $$\mathcal{H}_{\mu}(f)(z)=\sum_{n=0}^{\infty}\Bigg(\sum_{k=0}^{\infty}\mu_{n,k}a_k\Bigg)z^n, \quad z\in \mathbb{D}.$$ The Derivative-Hilbert operator is defined as $$\mathcal{DH}_{\mu}(f)(z)=\sum_{n=0}^{\infty}\Bigg(\sum_{k=0}^{\infty}\mu_{n,k}a_k\Bigg)(n+1)z^n, \quad z\in \mathbb{D}.$$ In this paper, we determine the range of the Hilbert operator and Derivative-Hilbert operator acting on $H^{\infty}$.


title: A Compressed Gradient Tracking Method for Decentralized Optimization with Linear Convergence

abstract: Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multi-agent network using only local computation and peer-to-peer communication. In this paper, we propose a novel compressed gradient tracking algorithm (C-GT) that combines gradient tracking technique with communication compression. In particular, C-GT is compatible with a general class of compression operators that unifies both unbiased and biased compressors. We show that C-GT inherits the advantages of gradient tracking-based algorithms and achieves linear convergence rate for strongly convex and smooth objective functions. Numerical examples complement the theoretical findings and demonstrate the efficiency and flexibility of the proposed algorithm.


title: Cloud-cloud collision and star formation in G323.18+0.15

abstract: We studied the cloud-cloud collision candidate G323.18+0.15 based on signatures of induced filaments, clumps, and star formation. We used archival molecular spectrum line data from the SEDIGISM $^{13}$CO($J$\,=\,2--1) survey, from the Mopra southern Galactic plane CO survey, and infrared to radio data from the GLIMPSE, MIPS, Hi-GAL, and SGPS surveys. Our new result shows that the G323.18+0.15 complex is 3.55kpc away from us and consists of three cloud components, G323.18a, G323.18b, and G323.18c. G323.18b shows a perfect U-shape structure, which can be fully complemented by G323.18a, suggesting a collision between G323.18a and the combined G323.18bc filamentary structure. One dense compressed layer (filament) is formed at the bottom of G323.18b, where we detect a greatly increased velocity dispersion. The bridge with an intermediate velocity in a position-velocity diagram appears between G323.18a and G323.18b, which corresponds to the compressed layer. G323.18a plus G323.18b as a whole are probably not gravitationally bound. This indicates that high-mass star formation in the compressed layer may have been caused by an accidental event. The column density in the compressed layer of about $1.36 \times 10^{22}$cm$^{-2}$ and most of the dense clumps and high-mass stars are located there. The average surface density of classI and classII young stellar objects (YSOs) inside the G323.18+0.15 complex is much higher than the density in the surroundings. The timescale of the collision between G323.18a and G323.18b is $1.59$Myr. This is longer than the typical lifetime of classI YSOs and is comparable to the lifetime of classII YSOs.


title: 3D printed acoustically programmable soft microactuators

abstract: The concept of creating all-mechanical soft microrobotic systems has great potential to address outstanding challenges in biomedical applications, and introduce more sustainable and multifunctional products. To this end, magnetic fields and light have been extensively studied as potential energy sources. On the other hand, coupling the response of materials to pressure waves has been overlooked despite the abundant use of acoustics in nature and engineering solutions. Here, we show that programmed commands can be contained on 3D nanoprinted polymer systems with the introduction of selectively excited air bubbles and rationally designed compliant mechanisms. A repertoire of micromechanical systems is engineered using experimentally validated computational models that consider the effects of primary and secondary pressure fields on entrapped air bubbles and the surrounding fluid. Coupling the dynamics of bubble oscillators reveals rich acoustofluidic interactions that can be programmed in space and time. We prescribe kinematics by harnessing the forces generated through these interactions to deform structural elements, which can be remotely reconfigured on-demand with the incorporation of mechanical switches. These basic micromechanical systems will serve as the building blocks for the development of a novel class of untethered soft microrobots powered and controlled by acoustic signals.


title: On non-detectability of non-computability and the degree of non-computability of solutions of circuit and wave equations on digital computers

abstract: It is known that there exist mathematical problems of practical relevance which cannot be computed on a Turing machine. An important example is the calculation of the first derivative of continuously differentiable functions. This paper precisely classifies the non-computability of the first derivative, and of the maximum-norm of the first derivative in the Zheng-Weihrauch hierarchy. Based on this classification, the paper investigates whether it is possible that a Turing machine detects this non-computability of the first derivative by observing the data of the problem, and whether it is possible to detect upper bounds for the peak value of the first derivative of continuously differentiable functions. So from a practical point of view, the question is whether it is possible to implement an exit-flag functionality for observing non-computability of the first derivative. This paper even studies two different types of exit-flag functionality. A strong one, where the Turing machine always has to stop, and a weak one, where the Turing machine stops if and only if the input lies within the corresponding set of interest. It will be shown that non-computability of the first derivative is not detectable by a Turing machine for two concrete examples, namely for the problem of computing the input--output behavior of simple analog circuits and for solutions of the three-dimensional wave equation. In addition, it is shown that it is even impossible to detect an upper bound for the maximum norm of the first derivative. In particular, it is shown that all three problems are not even semidecidable. Finally, we briefly discuss implications of these results for analog and quantum computing.


title: Primitive3D: 3D Object Dataset Synthesis from Randomly Assembled Primitives

abstract: Numerous advancements in deep learning can be attributed to the access to large-scale and well-annotated datasets. However, such a dataset is prohibitively expensive in 3D computer vision due to the substantial collection cost. To alleviate this issue, we propose a cost-effective method for automatically generating a large amount of 3D objects with annotations. In particular, we synthesize objects simply by assembling multiple random primitives. These objects are thus auto-annotated with part labels originating from primitives. This allows us to perform multi-task learning by combining the supervised segmentation with unsupervised reconstruction. Considering the large overhead of learning on the generated dataset, we further propose a dataset distillation strategy to remove redundant samples regarding a target dataset. We conduct extensive experiments for the downstream tasks of 3D object classification. The results indicate that our dataset, together with multi-task pretraining on its annotations, achieves the best performance compared to other commonly used datasets. Further study suggests that our strategy can improve the model performance by pretraining and fine-tuning scheme, especially for the dataset with a small scale. In addition, pretraining with the proposed dataset distillation method can save 86\% of the pretraining time with negligible performance degradation. We expect that our attempt provides a new data-centric perspective for training 3D deep models.


abstract: Are Large Pre-Trained Language Models Leaking Your Personal Information? In this paper, we analyze whether Pre-Trained Language Models (PLMs) are prone to leaking personal information. Specifically, we query PLMs for email addresses with contexts of the email address or prompts containing the owner's name. We find that PLMs do leak personal information due to memorization. However, since the models are weak at association, the risk of specific personal information being extracted by attackers is low. We hope this work could help the community to better understand the privacy risk of PLMs and bring new insights to make PLMs safe.


title: Pneumococcus and the stress-gradient hypothesis: a trade-off links $R_0$ and susceptibility to co-colonization across countries

abstract: Modern molecular technologies have revolutionized our understanding of bacterial epidemiology, but reported data across different settings remain under-integrated in common theoretical frameworks. Pneumococcus serotype co-colonization, caused by the polymorphic bacteria Streptococcus pneumoniae, has been increasingly investigated in recent years. While the global genomic diversity and serotype distribution of S. pneumoniae are well-characterized, there is limited information on how co-colonization patterns vary globally, critical for understanding bacterial evolution and dynamics. Gathering a rich dataset of cross-sectional pneumococcal colonization studies in the literature, we quantified patterns of transmission intensity and co-colonization prevalence in children populations across 17 geographic locations. Fitting these data to an SIS model with co-colonization under the assumption of similarity among interacting strains, our analysis reveals strong patterns of negative co-variation between transmission intensity ($R_0$) and susceptibility to co-colonization ($k$). In support of the stress-gradient hypothesis in ecology (SGH), pneumococcus serotypes appear to compete more in high-transmission settings and less in low-transmission settings, a trade-off which ultimately leads to a conserved ratio of single to co-colonization $\mu=1/(R_0-1)k$. Within our mathematical model, such conservation suggests preservation of 'stability-diversity-complexity' regimes in multi-strain coexistence. We find no major study differences in serotype composition, pointing to underlying adaptation of the same set of serotypes across environments. Our work highlights that understanding pneumococcus transmission patterns from global epidemiological data can benefit from simple analytical approaches that account for quasi-neutrality among strains, co-colonization, as well as variable environmental adaptation.


title: Multimodal Knowledge Alignment with Reinforcement Learning

abstract: Large language models readily adapt to novel settings, even without task-specific training data. Can their zero-shot capacity be extended to multimodal inputs? In this work, we propose ESPER which extends language-only zero-shot models to unseen multimodal tasks, like image and audio captioning. Our key novelty is to use reinforcement learning to align multimodal inputs to language model generations without direct supervision: for example, in the image case our reward optimization relies only on cosine similarity derived from CLIP, and thus requires no additional explicitly paired (image, caption) data. Because the parameters of the language model are left unchanged, the model maintains its capacity for zero-shot generalization. Experiments demonstrate that ESPER outperforms baselines and prior work on a variety of zero-shot tasks; these include a new benchmark we collect+release, ESP dataset, which tasks models with generating several diversely-styled captions for each image.


title: On the duality gap and Gale's example in conic linear programming

abstract: The aim of this paper is to revisit some duality results in conic linear programming and to answer an open problem related to the duality gap function for Gale's example.


title: Robust Differential Dynamic Programming

abstract: Differential Dynamic Programming is an optimal control technique often used for trajectory generation. Many variations of this algorithm have been developed in the literature, including algorithms for stochastic dynamics or state and input constraints. In this contribution, we develop a robust version of Differential Dynamic Programming that uses generalized plants and multiplier relaxations for uncertainties. To this end, we study a version of the Bellman principle and use convex relaxations to account for uncertainties in the dynamic program. The resulting algorithm can be seen as a robust trajectory generation tool for nonlinear systems.


title: NTIRE 2022 Challenge on High Dynamic Range Imaging: Methods and Results

abstract: This paper reviews the challenge on constrained high dynamic range (HDR) imaging that was part of the New Trends in Image Restoration and Enhancement (NTIRE) workshop, held in conjunction with CVPR 2022. This manuscript focuses on the competition set-up, datasets, the proposed methods and their results. The challenge aims at estimating an HDR image from multiple respective low dynamic range (LDR) observations, which might suffer from under- or over-exposed regions and different sources of noise. The challenge is composed of two tracks with an emphasis on fidelity and complexity constraints: In Track 1, participants are asked to optimize objective fidelity scores while imposing a low-complexity constraint (i.e. solutions can not exceed a given number of operations). In Track 2, participants are asked to minimize the complexity of their solutions while imposing a constraint on fidelity scores (i.e. solutions are required to obtain a higher fidelity score than the prescribed baseline). Both tracks use the same data and metrics: Fidelity is measured by means of PSNR with respect to a ground-truth HDR image (computed both directly and with a canonical tonemapping operation), while complexity metrics include the number of Multiply-Accumulate (MAC) operations and runtime (in seconds).


title: Real-Time Video Deblurring via Lightweight Motion Compensation

abstract: While motion compensation greatly improves video deblurring quality, separately performing motion compensation and video deblurring demands huge computational overhead. This paper proposes a real-time video deblurring framework consisting of a lightweight multi-task unit that supports both video deblurring and motion compensation in an efficient way. The multi-task unit is specifically designed to handle large portions of the two tasks using a single shared network, and consists of a multi-task detail network and simple networks for deblurring and motion compensation. The multi-task unit minimizes the cost of incorporating motion compensation into video deblurring and enables real-time deblurring. Moreover, by stacking multiple multi-task units, our framework provides flexible control between the cost and deblurring quality. We experimentally validate the state-of-the-art deblurring quality of our approach, which runs at a much faster speed compared to previous methods, and show practical real-time performance (30.99dB@30fps measured in the DVD dataset).


title: MoCoViT: Mobile Convolutional Vision Transformer

abstract: Recently, Transformer networks have achieved impressive results on a variety of vision tasks. However, most of them are computationally expensive and not suitable for real-world mobile applications. In this work, we present Mobile Convolutional Vision Transformer (MoCoViT), which improves in performance and efficiency by introducing transformer into mobile convolutional networks to leverage the benefits of both architectures. Different from recent works on vision transformer, the mobile transformer block in MoCoViT is carefully designed for mobile devices and is very lightweight, accomplished through two primary modifications: the Mobile Self-Attention (MoSA) module and the Mobile Feed Forward Network (MoFFN). MoSA simplifies the calculation of the attention map through Branch Sharing scheme while MoFFN serves as a mobile version of MLP in the transformer, further reducing the computation by a large margin. Comprehensive experiments verify that our proposed MoCoViT family outperform state-of-the-art portable CNNs and transformer neural architectures on various vision tasks. On ImageNet classification, it achieves 74.5% top-1 accuracy at 147M FLOPs, gaining 1.2% over MobileNetV3 with less computations. And on the COCO object detection task, MoCoViT outperforms GhostNet by 2.1 AP in RetinaNet framework.


title: A Zipf's Law-based Text Generation Approach for Addressing Imbalance in Entity Extraction

abstract: Entity extraction is critical in the intelligent advancement across diverse domains. Nevertheless, a challenge to its effectiveness arises from the data imbalance. This paper proposes a novel approach by viewing the issue through the quantitative information, recognizing that entities exhibit certain levels of commonality while others are scarce, which can be reflected in the quantifiable distribution of words. The Zipf's Law emerges as a well-suited adoption, and to transition from words to entities, words within the documents are classified as common and rare ones. Subsequently, sentences are classified into common and rare ones, and are further processed by text generation models accordingly. Rare entities within the generated sentences are then labeled using human-designed rules, serving as a supplement to the raw dataset, thereby mitigating the imbalance problem. The study presents a case of extracting entities from technical documents, and experimental results from two datasets prove the effectiveness of the proposed method. Furthermore, the significance of Zipf's law in driving the progress of AI is discussed, broadening the reach and coverage of Informetrics. This paper presents a successful demonstration of extending Informetrics to interface with AI through Zipf's Law.


title: A Central Limit Theorem for Counting Functions Related to Symplectic Lattices and Bounded Sets

abstract: We use a method developed by Bj\"orklund and Gorodnik to show a central limit theorem (as $T$ tends to $\infty$) for the counting functions $\# \left( \Lambda \cap \Omega_T \right)$ where $\Lambda$ ranges over the space $Y_{2d}$ of symplectic lattices in $\mathbb{R}^{2d}$ ($d \geqslant 4$). Here $\lbrace \Omega_T \rbrace_T$ is a certain family of bounded domains in $\mathbb{R}^{2d}$ that can be tessellated by means of the action of a diagonal semigroup contained in $\mathrm{Sp}(2d, \mathbb{R})$. In the process we obtain new $L^p$ bounds on a certain height function on $Y_{2d}$ originally introduced by Schmidt.


title: Stability of non-topological string in supersymmetric $SU(2)\times U(1)$ gauge theory

abstract: We construct a non-topological string solution for a supersymmetric gauge theory with $SU(2)\times U(1)$ gauge symmetry which is spontaneously broken to $U(1)$ by developing the vacuum expectation value of two doublet Higgses. It is a supersymmetric extension of the electroweak string while supersymmetry is unbroken. We discuss the classical stability of the non-topological string by perturbations. We show that the classical stability are determined only by two parameters, and that the allowed region becomes essentially the same as in the electroweak string.


title: TreEnhance: A Tree Search Method For Low-Light Image Enhancement

abstract: In this paper we present TreEnhance, an automatic method for low-light image enhancement capable of improving the quality of digital images. The method combines tree search theory, and in particular the Monte Carlo Tree Search (MCTS) algorithm, with deep reinforcement learning. Given as input a low-light image, TreEnhance produces as output its enhanced version together with the sequence of image editing operations used to obtain it. During the training phase, the method repeatedly alternates two main phases: a generation phase, where a modified version of MCTS explores the space of image editing operations and selects the most promising sequence, and an optimization phase, where the parameters of a neural network, implementing the enhancement policy, are updated. Two different inference solutions are proposed for the enhancement of new images: one is based on MCTS and is more accurate but more time and memory consuming; the other directly applies the learned policy and is faster but slightly less precise. As a further contribution, we propose a guided search strategy that "reverses" the enhancement procedure that a photo editor applied to a given input image. Unlike other methods from the state of the art, TreEnhance does not pose any constraint on the image resolution and can be used in a variety of scenarios with minimal tuning. We tested the method on two datasets: the Low-Light dataset and the Adobe Five-K dataset obtaining good results from both a qualitative and a quantitative point of view.


title: Does Your Model Classify Entities Reasonably? Diagnosing and Mitigating Spurious Correlations in Entity Typing

abstract: Entity typing aims at predicting one or more words that describe the type(s) of a specific mention in a sentence. Due to shortcuts from surface patterns to annotated entity labels and biased training, existing entity typing models are subject to the problem of spurious correlations. To comprehensively investigate the faithfulness and reliability of entity typing methods, we first systematically define distinct kinds of model biases that are reflected mainly from spurious correlations. Particularly, we identify six types of existing model biases, including mention-context bias, lexical overlapping bias, named entity bias, pronoun bias, dependency bias, and overgeneralization bias. To mitigate model biases, we then introduce a counterfactual data augmentation method. By augmenting the original training set with their debiased counterparts, models are forced to fully comprehend sentences and discover the fundamental cues for entity typing, rather than relying on spurious correlations for shortcuts. Experimental results on the UFET dataset show our counterfactual data augmentation approach helps improve generalization of different entity typing models with consistently better performance on both the original and debiased test sets.


title: Flavon Signatures at the HL-LHC

abstract: The detection of a single Higgs boson at the Large Hadron Collider (LHC) has allowed one to probe some properties of it, including the Yukawa and gauge couplings. However, in order to probe the Higgs potential, one has to rely on new production mechanisms, such as Higgs pair production. In this paper, we show that such a channel is also sensitive to the production and decay of a so-called `Flavon' field ($H_F$), a new scalar state that arises in models that attempt to explain the hierarchy of the Standard Model (SM) fermion masses. Our analysis also focuses on the other decay channels involving the Flavon particle, specifically the decay of the Flavon to a pair of $Z$ bosons ($H_F \to Z Z$) and the concurrent production of a top quark and charm quark ($H_F\to tc$), having one or more leptons in the final states. In particular, we show that, with 3000 fb$^{-1}$ of accumulated data at 14 TeV (the Run 3 stage) of the LHC an heavy Flavon $H_F$ with mass $M_{H_F} \simeq 2m_t $ can be explored with $3\sigma -5\sigma $ significance through these channels.


title: On the Interpretability of Regularisation for Neural Networks Through Model Gradient Similarity

abstract: Most complex machine learning and modelling techniques are prone to over-fitting and may subsequently generalise poorly to future data. Artificial neural networks are no different in this regard and, despite having a level of implicit regularisation when trained with gradient descent, often require the aid of explicit regularisers. We introduce a new framework, Model Gradient Similarity (MGS), that (1) serves as a metric of regularisation, which can be used to monitor neural network training, (2) adds insight into how explicit regularisers, while derived from widely different principles, operate via the same mechanism underneath by increasing MGS, and (3) provides the basis for a new regularisation scheme which exhibits excellent performance, especially in challenging settings such as high levels of label noise or limited sample sizes.


title: Asking the Right Questions in Low Resource Template Extraction

abstract: Information Extraction (IE) researchers are mapping tasks to Question Answering (QA) in order to leverage existing large QA resources, and thereby improve data efficiency. Especially in template extraction (TE), mapping an ontology to a set of questions can be more time-efficient than collecting labeled examples. We ask whether end users of TE systems can design these questions, and whether it is beneficial to involve an NLP practitioner in the process. We compare questions to other ways of phrasing natural language prompts for TE. We propose a novel model to perform TE with prompts, and find it benefits from questions over other styles of prompts, and that they do not require an NLP background to author.


title: LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution

abstract: While coreference resolution typically involves various linguistic challenges, recent models are based on a single pairwise scorer for all types of pairs. We present LingMess, a new coreference model that defines different categories of coreference cases and optimize multiple pairwise scorers, where each scorer learns a specific set of linguistic challenges. Our model substantially improves pairwise scores for most categories and outperforms cluster-level performance on Ontonotes and 5 additional datasets. Our model is available in https://github.com/shon-otmazgin/lingmess-coref


title: Anderson and many-body localization in the presence of spatially correlated classical noise

abstract: We study the effect of spatially correlated classical noise on both Anderson and many-body localization of a disordered fermionic chain. By analyzing the evolution of the particle density imbalance following a quench from an initial charge density wave state, we find prominent signatures of localization also in the presence of the time-dependent noise, even though the system eventually relaxes to the infinite temperature state. In particular, for sufficiently strong static disorder we observe the onset of metastability, which becomes more prominent the stronger the spatial correlations of the noise. In this regime we find that the imbalance decays as a stretched-exponential - a behavior characteristic of glassy systems. We identify a simple scaling behavior of the relevant relaxation times in terms of the static disorder and of the noise correlation length. We discuss how our results could be exploited to extract information about the localization length in experimental setups.


title: UniInst: Unique Representation for End-to-End Instance Segmentation

abstract: Existing instance segmentation methods have achieved impressive performance but still suffer from a common dilemma: redundant representations (e.g., multiple boxes, grids, and anchor points) are inferred for one instance, which leads to multiple duplicated predictions. Thus, mainstream methods usually rely on a hand-designed non-maximum suppression (NMS) post-processing step to select the optimal prediction result, which hinders end-to-end training. To address this issue, we propose a box-free and NMS-free end-to-end instance segmentation framework, termed UniInst, that yields only one unique representation for each instance. Specifically, we design an instance-aware one-to-one assignment scheme, namely Only Yield One Representation (OYOR), which dynamically assigns one unique representation to each instance according to the matching quality between predictions and ground truths. Then, a novel prediction re-ranking strategy is elegantly integrated into the framework to address the misalignment between the classification score and the mask quality, enabling the learned representation to be more discriminative. With these techniques, our UniInst, the first FCN-based box-free and NMS-free instance segmentation framework, achieves competitive performance, e.g., 39.0 mask AP using ResNet-50-FPN and 40.2 mask AP using ResNet-101-FPN, against mainstream methods on COCO test-dev 2017. Moreover, the proposed instance-aware method is robust to occlusion scenes, outperforming common baselines by remarkable mask AP on the heavily-occluded OCHuman benchmark. Code is available at https://github.com/b03505036/UniInst.


title: Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation

abstract: In this paper, we explore the challenging problem of performing a generative task in a target language when labeled data is only available in English, using summarization as a case study. We assume a strict setting with no access to parallel data or machine translation and find that common transfer learning approaches struggle in this setting, as a generative multilingual model fine-tuned purely on English catastrophically forgets how to generate non-English. Given the recent rise of parameter-efficient adaptation techniques, we conduct the first investigation into how one such method, prompt tuning (Lester et al., 2021), can overcome catastrophic forgetting to enable zero-shot cross-lingual generation. Our experiments show that parameter-efficient prompt tuning provides gains over standard fine-tuning when transferring between less-related languages, e.g., from English to Thai. However, a significant gap still remains between these methods and fully-supervised baselines. To improve cross-lingual transfer further, we explore several approaches, including: (1) mixing in unlabeled multilingual data, and (2) explicitly factoring prompts into recombinable language and task components. Our approaches can provide further quality gains, suggesting that robust zero-shot cross-lingual generation is within reach.


title: Fast Inference and Transfer of Compositional Task Structures for Few-shot Task Generalization

abstract: We tackle real-world problems with complex structures beyond the pixel-based game or simulator. We formulate it as a few-shot reinforcement learning problem where a task is characterized by a subtask graph that defines a set of subtasks and their dependencies that are unknown to the agent. Different from the previous meta-rl methods trying to directly infer the unstructured task embedding, our multi-task subtask graph inferencer (MTSGI) first infers the common high-level task structure in terms of the subtask graph from the training tasks, and use it as a prior to improve the task inference in testing. Our experiment results on 2D grid-world and complex web navigation domains show that the proposed method can learn and leverage the common underlying structure of the tasks for faster adaptation to the unseen tasks than various existing algorithms such as meta reinforcement learning, hierarchical reinforcement learning, and other heuristic agents.


title: Investigating Lexical Replacements for Arabic-English Code-Switched Data Augmentation

abstract: Data sparsity is a main problem hindering the development of code-switching (CS) NLP systems. In this paper, we investigate data augmentation techniques for synthesizing dialectal Arabic-English CS text. We perform lexical replacements using word-aligned parallel corpora where CS points are either randomly chosen or learnt using a sequence-to-sequence model. We compare these approaches against dictionary-based replacements. We assess the quality of the generated sentences through human evaluation and evaluate the effectiveness of data augmentation on machine translation (MT), automatic speech recognition (ASR), and speech translation (ST) tasks. Results show that using a predictive model results in more natural CS sentences compared to the random approach, as reported in human judgements. In the downstream tasks, despite the random approach generating more data, both approaches perform equally (outperforming dictionary-based replacements). Overall, data augmentation achieves 34% improvement in perplexity, 5.2% relative improvement on WER for ASR task, +4.0-5.1 BLEU points on MT task, and +2.1-2.2 BLEU points on ST over a baseline trained on available data without augmentation.


title: Few-shot Reranking for Multi-hop QA via Language Model Prompting

abstract: We study few-shot reranking for multi-hop QA with open-domain questions. To alleviate the need for a large number of labeled question-document pairs for retriever training, we propose PromptRank, which relies on large language models prompting for multi-hop path reranking. PromptRank first constructs an instruction-based prompt that includes a candidate document path and then computes the relevance score between a given question and the path based on the conditional likelihood of the question given the path prompt according to a language model. PromptRank yields strong retrieval performance on HotpotQA with only 128 training examples compared to state-of-the-art methods trained on thousands of examples -- 73.6 recall@10 by PromptRank vs. 77.8 by PathRetriever and 77.5 by multi-hop dense retrieval. Code available at https://github.com/mukhal/PromptRank


title: Surface energy coefficient of a N2LO Skyrme energy functional : a semiclassical Extended Thomas-Fermi approach

abstract: We generalize to N2LO Skyrme functionals the semi-classical approach of Grammaticos and Voros in order to calculate the Extended Thomas Fermi expressions of the new densities and currents appearing at the N2LO level. Within a one dimensional symmetric semi infinite nuclear matter model and using a simple Fermi-like density profile, we obtain an easy-to-use formula for the surface energy including the contributions of the central, density-dependent and spin-orbit terms up to $\hbar^2$. Such a formula can be easily used as a first attempt to constrain the surface properties of new N2LO Skyrme parametrizations. The N2LO parametrization tested in this paper is shown to exhibit a shift (compared to a full Hartree-Fock calculation) which is quantitatively similar to the one obtained with the traditional Skyrme parametrizations.


title: Group reciprocity and the evolution of stereotyping

abstract: Stereotypes are generalized beliefs about groups of people, which are used to make decisions and judgments about them. Although such heuristics can be useful when decisions must be made quickly, or when information is lacking, they can also serve as the basis for prejudice and discrimination. In this paper we study the evolution of stereotypes through group reciprocity. We characterize the warmth of a stereotype as the willingness to cooperate with an individual based solely on the identity of the group they belong to. We show that when stereotypes are coarse, such group reciprocity is less likely to evolve, and stereotypes tend to be negative. We also show that, even when stereotypes are broadly positive, individuals are often overly pessimistic about the willingness of those they stereotype to cooperate. We then show that the tendency for stereotyping itself to evolve is driven by the costs of cognition, so that more people are stereotyped with greater coarseness as costs increase. Finally we show that extrinsic "shocks", in which the benefits of cooperation are suddenly reduced, can cause stereotype warmth and judgement bias to turn sharply negative, consistent with the view that economic and other crises are drivers of out-group animosity.


title: Connections between Kuratowski partitions of Baire spaces, measurable cardinals and precipitous ideals

abstract: In this paper we present a few properties of $K$-partitions, which are partitions of Baire spaces such that all subfamilies of such a partition sum to a set with the Baire property. Among the result proven we have general existence result that state that the existence of any $K$-partition implies the existence of $K$-partition of a metrizable space as well as existence of $K$-partition of a compact space implies the existence of $K$-partition of a completely metrizable space. We also prove some connections between existence of $K$-partitions and existence of precipitous ideals as well as measurable cardinals. There are also outlined possible connection with real-measurable cardinals, extensions of Lebesgue measure on the closed interval and density topologies.


title: Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages

abstract: Scaling multilingual representation learning beyond the hundred most frequent languages is challenging, in particular to cover the long tail of low-resource languages. A promising approach has been to train one-for-all multilingual models capable of cross-lingual transfer, but these models often suffer from insufficient capacity and interference between unrelated languages. Instead, we move away from this approach and focus on training multiple language (family) specific representations, but most prominently enable all languages to still be encoded in the same representational space. To achieve this, we focus on teacher-student training, allowing all encoders to be mutually compatible for bitext mining, and enabling fast learning of new languages. We introduce a new teacher-student training scheme which combines supervised and self-supervised training, allowing encoders to take advantage of monolingual training data, which is valuable in the low-resource setting. Our approach significantly outperforms the original LASER encoder. We study very low-resource languages and handle 50 African languages, many of which are not covered by any other model. For these languages, we train sentence encoders, mine bitexts, and validate the bitexts by training NMT systems.


title: Structural obstruction to the simplicity of the eigenvalue zero in chemical reaction networks

abstract: Multistationarity is the property of a system to exhibit two distinct equilibria (steady-states) under otherwise identical conditions, and it is a phenomenon of recognized importance for biochemical systems. Multistationarity may appear in the parameter space as a consequence of saddle-node bifurcations, which necessarily require a simple eigenvalue zero of the Jacobian, at the bifurcating equilibrium. Matrices with a simple eigenvalue zero are generic in the set of singular matrices: any system whose Jacobian has an algebraically multiple eigenvalue zero can be perturbed to a system whose Jacobian has a simple eigenvalue zero. Thus, one would expect that in applications singular Jacobians are always with a simple eigenvalue zero. However, chemical reaction networks typically consider a fixed network structure, while the freedom rests with the various and different choices of kinetics. Here we present an example of a chemical reaction network, whose Jacobian is either nonsingular or has an algebraically multiple eigenvalue zero. The structural obstruction to the simplicity of the eigenvalue zero is based on the network alone, and it is independent of the value of concentrations and the choice of kinetics. This in particular constitutes an obstruction to standard saddle-node bifurcations.


title: Optimizing UAV Recharge Scheduling for Heterogeneous and Persistent Aerial Service

abstract: The adoption of UAVs in communication networks is becoming reality thanks to the deployment of advanced solutions for connecting UAVs and using them as communication relays. However, the use of UAVs introduces novel energy constraints and scheduling challenges in the dynamic management of network devices, due to the need to call back and recharge, or substitute, UAVs that run out of energy. In this paper, we design UAV recharging schemes under realistic assumptions on limited flight times and time consuming charging operations. Such schemes are designed to minimize the size of the fleet to be devoted to a persistent service of a set of aerial locations, hence its cost. We consider a fleet of homogeneous UAVs both under homogeneous and heterogeneous service topologies. For UAVs serving aerial locations with homogeneous distances to a recharge station, we design a simple scheduling, that we name HORR, which we prove to be feasible and optimal, in the sense that it uses the minimum possible number of UAVs to guarantee the coverage of the aerial service locations. For the case of non-evenly distributed aerial locations, we demonstrate that the problem becomes NP-hard, and design a lightweight recharging scheduling scheme, PHERR, that extends the operation of HORR to the heterogeneous case, leveraging the partitioning of the set of service locations. We show that PHERR is near-optimal because it approaches the performance limits identified through a lower bound that we formulate on the total fleet size.


title: Hidden magnetic order on a kagome lattice for KV3Sb5

abstract: KV3Sb5 has recently attracted a considerable attention, due to its low temperature superconducting properties, which are heralded by a charge density wave. The apparent presence of a very weak magnetism does not result in long range ordering. We propose a model compatible with a detectable internal magnetic field with no evidence of magnetic long-range order. It invokes higher order terms in the vanadium magnetization density compatible with the presence of a "hidden order" of Dirac (polar) multipoles. The Dirac dipole, known as an anapole or toroidal dipole, is one of a family of electronic multipoles visible in x-ray and magnetic neutron diffraction while undetectable with standard laboratory-based techniques. Two plausible hidden orders are studied with a view to testing in future x-ray and neutron Bragg diffraction experiments whether they are trustworthy. One candidate is magneto-electric and restricted to the linear type, while the other candidate cannot show a magneto-electric effect of any type. The latter hosts a vanadium entity that is both a true scalar and magnetic, and its presence epitomizes an absence of loop currents. Diffraction patterns for the two proposed hidden magnetic orders are distinctly different, fortunately. Corresponding scattering amplitudes for resonant x-ray and neutron Bragg diffraction are calculated with standard chemical and magnetic symmetry tools, and atomic physics.


title: Leading edge vortex formation and wake trajectory: Synthesizing measurements, analysis, and machine learning

abstract: The strength and trajectory of a leading edge vortex (LEV) formed by a pitching-heaving hydrofoil (chord $c$) is studied. The LEV is identified using the $Q$-criterion method, which is calculated from the 2D velocity field obtained from PIV measurements. The relative angle of attack at mid-stroke, ${\alpha_{T/4}} $, proves to be an effective method of combining heave amplitude ($h_0/c$), pitch amplitude ($\theta_0$), and reduced frequency ($f^*$) into a single variable that predicts the maximum value of $Q$ over a wide range of operating conditions. Once the LEV separates from the foil, it travels downstream and rapidly weakens and diffuses. The downstream trajectory of the LEV has two characteristic shapes. At low values of ${\alpha_{T/4}}$, it travels straight downstream after separating from the foil, while at higher values of ${\alpha_{T/4}} $, an accompanying Trailing Edge Vortex (TEV) forms and the induced velocity generates a cross-stream component to the vortex trajectories. This behavior is accurately predicted using a potential flow model for the LEV and TEV. Supervised machine learning algorithms, namely Support Vector Regression and Gaussian Process Regression, are used to create regression models that predicts the vortex strength, shape and trajectory during growth and after separation. The regression model successfully captures the features of two vortex regimes observed at different values of ${\alpha_{T/4}} $. However, the predicted LEV trajectories are somewhat smoother than observed in the experiments. The strengths of the vortex is often under-predicted. Both of these shortcomings may be attributed to the relatively small size of the training data set.


title: Large deviations theory for noisy non-linear electronics: CMOS inverter as a case study

abstract: The latest generation of transistors are nanoscale devices whose performance and reliability are limited by thermal noise in low-power applications. Therefore developing efficient methods to compute the voltage and current fluctuations in such non-linear electronic circuits is essential. Traditional approaches commonly rely on adding Gaussian white noise to the macroscopic dynamical circuit laws, but do not capture rare fluctuations and lead to thermodynamic inconsistencies. A correct and thermodynamically consistent approach can be achieved by describing single-electron transfers as Poisson jump processes accounting for charging effects. But such descriptions can be computationally demanding. To address this issue, we consider the macroscopic limit which corresponds to scaling up the physical dimensions of the transistor and resulting in an increase of the number of electrons on the conductors. In this limit, the thermal fluctuations satisfy a Large Deviations Principle which we show is also remarkably precise in settings involving only a few tens of electrons, by comparing our results with Gillespie simulations and spectral methods. Traditional approaches are recovered by resorting to an ad hoc diffusive approximation introducing inconsistencies. To illustrate these findings, we consider a low-power CMOS inverter, or NOT gate, which is a basic primitive in electronic design. Voltage (resp. current) fluctuations are obtained analytically (semi-analytically) and reveal interesting features.


title: MAPLE-X: Latency Prediction with Explicit Microprocessor Prior Knowledge

abstract: Deep neural network (DNN) latency characterization is a time-consuming process and adds significant cost to Neural Architecture Search (NAS) processes when searching for efficient convolutional neural networks for embedded vision applications. DNN Latency is a hardware dependent metric and requires direct measurement or inference on target hardware. A recently introduced latency estimation technique known as MAPLE predicts DNN execution time on previously unseen hardware devices by using hardware performance counters. Leveraging these hardware counters in the form of an implicit prior, MAPLE achieves state-of-the-art performance in latency prediction. Here, we propose MAPLE-X which extends MAPLE by incorporating explicit prior knowledge of hardware devices and DNN architecture latency to better account for model stability and robustness. First, by identifying DNN architectures that exhibit a similar latency to each other, we can generate multiple virtual examples to significantly improve the accuracy over MAPLE. Secondly, the hardware specifications are used to determine the similarity between training and test hardware to emphasize training samples captured from comparable devices (domains) and encourages improved domain alignment. Experimental results using a convolution neural network NAS benchmark across different types of devices, including an Intel processor that is now used for embedded vision applications, demonstrate a 5% improvement over MAPLE and 9% over HELP. Furthermore, we include ablation studies to independently assess the benefits of virtual examples and hardware-based sample importance.


title: Implicit Function Theorem: Estimates on the size of the domain

abstract: In this article, we present explicit estimates of the size of the domain on which the Implicit Function Theorem and the Inverse Function Theorem are valid. For maps that are twice continuously differentiable, these estimates depend upon the magnitude of the first-order derivatives evaluated at the point of interest, and a bound on the second-order derivatives over a region of interest. One of the key contributions of this article is that the estimates presented require minimal numerical computation. In particular, these estimates are arrived at without any intermediate optimization procedures. We then present three applications in optimization and systems and control theory where the computation of such bounds turns out to be important. First, in electrical networks, the power flow operations can be written as Quadratically Constrained Quadratic Programs (QCQPs), and we utilize our bounds to compute the size of permissible power variations to ensure stable operations of the power system network. Second, the robustness margin of positive definite solutions to the Algebraic Riccati Equation (frequently encountered in control problems) subject to perturbations in the system matrices are computed with the aid of our bounds. Finally, we employ these bounds to provide quantitative estimates of the size of the domains for feedback linearization of discrete-time control systems.


title: DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning

abstract: Building a universal conversational agent has been a long-standing goal of the dialogue research community. Most previous works only focus on a small set of dialogue tasks. In this work, we aim to build a unified dialogue foundation model (DFM) which can be used to solve massive diverse dialogue tasks. To achieve this goal, a large-scale well-annotated dialogue dataset with rich task diversity (DialogZoo) is collected. We introduce a framework to unify all dialogue tasks and propose novel auxiliary self-supervised tasks to achieve stable training of DFM on the highly diverse large scale DialogZoo corpus. Experiments show that, compared with models of the same size, DFM can achieve state-of-the-art or competitive performance on very rich cross-domain downstream dialogue tasks. This demonstrates that DFM largely extends the ability of unified dialogue pre-trained model.


title: Exchanging replicas with unequal cost, infinitely and permanently

abstract: We developed a replica exchange method that is effectively parallelizable even if the computational cost of the Monte Carlo moves in the parallel replicas are considerably different, for instance, because the replicas run on different type of processor units or because of the algorithmic complexity. To prove detailed-balance, we make a paradigm shift from the common conceptual viewpoint in which the set of parallel replicas represents a high-dimensional superstate, to an ensemble based criterion in which the other ensembles represent an environment that might or might not participate in the Monte Carlo move. In addition, based on a recent algorithm for computing permanents, we effectively increase the exchange rate to infinite without the steep factorial scaling as function of the number of replicas. We illustrate the effectiveness of the replica exchange methodology by combining it with a quantitative path sampling method, replica exchange transition interface sampling (RETIS), in which the costs for a Monte Carlo move can vary enormously as paths in a RETIS algorithm do not have the same length and the average path lengths tend to vary considerably for the different path ensembles that run in parallel. This combination, coined $\infty$RETIS, was tested on three model systems.


title: Hybrid III-V/SiGe solar cells on Si substrates and porous Si substrates

abstract: A tandem GaAsP/SiGe solar cell has been developed employing group-IV reverse buffer layers grown on silicon substrates with a subsurface porous layer. Reverse buffer layers facilitate a reduction in the threading dislocation density with limited thicknesses, but ease the appearance of cracks, as observed in previous designs grown on regular Si substrates. In this new design, a porous silicon layer has been incorporated close to the substrate surface. The ductility of this layer helps repress the propagation of cracks, diminishing the problems of low shunt resistance and thus improving solar cell performance. The first results of this new architecture are presented here.


title: QAMPARI: An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphs

abstract: Existing benchmarks for open-domain question answering (ODQA) typically focus on questions whose answers can be extracted from a single paragraph. By contrast, many natural questions, such as "What players were drafted by the Brooklyn Nets?" have a list of answers. Answering such questions requires retrieving and reading from many passages, in a large corpus. We introduce QAMPARI, an ODQA benchmark, where question answers are lists of entities, spread across many paragraphs. We created QAMPARI by (a) generating questions with multiple answers from Wikipedia's knowledge graph and tables, (b) automatically pairing answers with supporting evidence in Wikipedia paragraphs, and (c) manually paraphrasing questions and validating each answer. We train ODQA models from the retrieve-and-read family and find that QAMPARI is challenging in terms of both passage retrieval and answer generation, reaching an F1 score of 32.8 at best. Our results highlight the need for developing ODQA models that handle a broad range of question types, including single and multi-answer questions.


title: Metric enrichment, finite generation, and the path comonad

abstract: We prove a number of results involving categories enriched over \textsc{CMet}, the category of complete metric spaces with possibly infinite distances. The category \textsc{CPMet} of intrinsic complete metric spaces is locally $\aleph_1$-presentable, closed monoidal, and comonadic over \textsc{CMet}. We also prove that the category \textsc{CCMet} of convex complete metric spaces is not closed monoidal and characterize the isometry-$\aleph_0$-generated objects in \textsc{CMet}, \textsc{CPMet} and \textsc{CCMet}, answering questions by Di Liberti and Rosick\'{y}. Other results include the automatic completeness of a colimit of bi-Lipschitz morphisms of complete metric spaces and a characterization of those pairs (metric space, unital $C^*$-algebra) that have a tensor product in the \textsc{CMet}-enriched category of unital $C^*$-algebras.


title: Trilateration-Based Device-Free Sensing: Two Base Stations and One Passive IRS Are Sufficient

abstract: The classic trilateration technique can localize each target based on its distances to three anchors with known coordinates. Usually, this technique requires all the anchors and targets, e.g., the satellites and the mobile phones in Global Navigation Satellite System (GNSS), to actively transmit/receive radio signals such that the delay of the one-way radio signal propagated between each anchor and each target can be measured. Excitingly, this paper will show that the trilateration technique can be generalized to the scenario where one of the three anchors and all the targets merely reflect the radio signals passively as in radar networks, even if the propagation delay between the passive IRS and the passive targets is difficult to be measured directly, and the data association issue for multi-sensor multi-target tracking arises. Specifically, we consider device-free sensing in a cellular network consisting of two base stations (BSs), one passive intelligent reflecting surface (IRS), and multiple passive targets, to realize integrated sensing and communication (ISAC). The two BSs transmit the orthogonal frequency division multiplexing (OFDM) signals in the downlink and estimate the locations of the targets based on their reflected signals via/not via the IRS. We propose an efficient trilateration-based strategy that can first estimate the distances of each target to the two BSs and the IRS and then localize the targets. Numerical results show that the considered networked sensing architecture with heterogenous anchors can outperform its counterpart with three BSs.


title: Measurement incompatibility vs. Bell non-locality: an approach via tensor norms

abstract: Measurement incompatibility and quantum non-locality are two key features of quantum theory. Violations of Bell inequalities require quantum entanglement and incompatibility of the measurements used by the two parties involved in the protocol. We analyze the converse question: for which Bell inequalities is the incompatibility of measurements enough to ensure a quantum violation? We relate the two questions by comparing two tensor norms on the space of dichotomic quantum measurements: one characterizing measurement compatibility and the second one characterizing violations of a given Bell inequality. We provide sufficient conditions for the equivalence of the two notions in terms of the matrix describing the correlation Bell inequality. We show that the CHSH inequality and its variants are the only ones satisfying it.


title: The MAPS foil

abstract: We present a method of embedding a Monolithic Active Pixel Sensor (MAPS) into a flexible printed circuit board (FPC) and its interconnection by means of through-hole copper plating. The resulting assembly, baptised "MAPS foil", is a flexible, light, protected, and fully integrated detector module. By using widely available printed circuit board manufacturing techniques, the production of these devices can be scaled easily in size and volume, making it a compelling candidate for future large-scale applications. A first series of prototypes that embed the ALPIDE chip has been produced, functionally tested, and shown to be working.


title: Quantum transport of a spin-1 chiral fermion

abstract: We theoretically study the quantum transport in a three-dimensional spin-1 chiral fermion system in the presence of impurity scattering. Within the self-consistent Born approximation, we find peak structure of the density of states and significant suppression of electrical conductivity around the zero energy. The zero-energy conductivity depends less on impurity concentration, unlike a Weyl fermion. These properties originate from the flat band structure of spin-1 chiral fermion.


title: Uncertainty evaluation of peak energy of giant dipole resonance propagated from uncertainties of Skyrme parameters

abstract: We evaluate uncertainty of peak energy of giant dipole resonance (GDR), propagated from uncertainty of parameters of Skyrme interaction. The Monte Carlo calculation of the random phase approximation using randomized Skyrme parameters is performed. Under the condition that the correlations between each of the Skyrme parameters is considered, the GDR peak energy has the uncertainty of $\sim$ 1 MeV irrespective of nuclear mass and is strongly correlated with the Skyrme parameters, in present calculations. This serves a guide for a new parametrization of effective interactions.


title: Discovering Language-neutral Sub-networks in Multilingual Language Models

abstract: Multilingual pre-trained language models transfer remarkably well on cross-lingual downstream tasks. However, the extent to which they learn language-neutral representations (i.e., shared representations that encode similar phenomena across languages), and the effect of such representations on cross-lingual transfer performance, remain open questions. In this work, we conceptualize language neutrality of multilingual models as a function of the overlap between language-encoding sub-networks of these models. We employ the lottery ticket hypothesis to discover sub-networks that are individually optimized for various languages and tasks. Our evaluation across three distinct tasks and eleven typologically-diverse languages demonstrates that sub-networks for different languages are topologically similar (i.e., language-neutral), making them effective initializations for cross-lingual transfer with limited performance degradation.


title: InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning

abstract: Instruction tuning is an emergent paradigm in NLP wherein natural language instructions are leveraged with language models to induce zero-shot performance on unseen tasks. Instructions have been shown to enable good performance on unseen tasks and datasets in both large and small language models. Dialogue is an especially interesting area to explore instruction tuning because dialogue systems perform multiple kinds of tasks related to language (e.g., natural language understanding and generation, domain-specific interaction), yet instruction tuning has not been systematically explored for dialogue-related tasks. We introduce InstructDial, an instruction tuning framework for dialogue, which consists of a repository of 48 diverse dialogue tasks in a unified text-to-text format created from 59 openly available dialogue datasets. Next, we explore cross-task generalization ability on models tuned on InstructDial across diverse dialogue tasks. Our analysis reveals that InstructDial enables good zero-shot performance on unseen datasets and tasks such as dialogue evaluation and intent detection, and even better performance in a few-shot setting. To ensure that models adhere to instructions, we introduce novel meta-tasks. We establish benchmark zero-shot and few-shot performance of models trained using the proposed framework on multiple dialogue tasks.


title: Training Language Models with Memory Augmentation

abstract: Recent work has improved language models (LMs) remarkably by equipping them with a non-parametric memory component. However, most existing approaches only introduce mem-ories at testing time or represent them using a separately trained encoder, resulting in suboptimal training of the language model. In this work, we present TRIME, a novel yet simple training approach designed for training LMs with memory augmentation. Our approach uses a training objective that directly takes in-batch examples as accessible memory. We also present new methods for memory construction and data batching, which are used for adapting to different sets of memories--local, long-term, and external memory--at testing time. We evaluate TRIME on multiple language modeling and machine translation benchmarks and show that it is able to achieve significant improvements across all the settings. Concretely, TRIME reduces the perplexity from 18.70 to 15.37 on WIKITEXT-103, by effectively leveraging a large memory set from the training corpus. Compared to standard LM training, TRIME adds negligible computational overhead and is compatible with different neural architectures, making it a versatile solution for training memory-augmented LMs.


title: Chiral correlation of drag currents inducing optical activity of twisted bilayer graphene

abstract: The mechanisms of optical activity and quantum transport of twisted bilayer graphene are studied. The formation of unique electron states in the bilayer systems is studied using an effective continuum model. Such states are shown to support the correlation of transverse motions of electrons in two graphene layers. Because of the chiral structure of the atomic lattices, the contribution of such drag correlations is incompletely cancelled, thus resulting in a drag term of the optical conductivity tensor. We show that the drag term of the conductivity is the manifestation of the spatial dispersion. We show how to analyze and calculate the components of the conductivity tensors that governs the optical activity of the systems. The DC conductivity of the twisted bilayer graphene system is also calculated. It shows the existence of a quantum conductivity value $\propto e^2/h$ at the intrinsic Fermi energy.


title: Evaluating the Diversity, Equity and Inclusion of NLP Technology: A Case Study for Indian Languages

abstract: In order for NLP technology to be widely applicable, fair, and useful, it needs to serve a diverse set of speakers across the world's languages, be equitable, i.e., not unduly biased towards any particular language, and be inclusive of all users, particularly in low-resource settings where compute constraints are common. In this paper, we propose an evaluation paradigm that assesses NLP technologies across all three dimensions. While diversity and inclusion have received attention in recent literature, equity is currently unexplored. We propose to address this gap using the Gini coefficient, a well-established metric used for estimating societal wealth inequality. Using our paradigm, we highlight the distressed state of current technologies for Indian (IN) languages (a linguistically large and diverse set, with a varied speaker population), across all three dimensions. To improve upon these metrics, we demonstrate the importance of region-specific choices in model building and dataset creation, and more importantly, propose a novel, generalisable approach to optimal resource allocation during fine-tuning. Finally, we discuss steps to mitigate these biases and encourage the community to employ multi-faceted evaluation when building linguistically diverse and equitable technologies.


title: Language Anisotropic Cross-Lingual Model Editing

abstract: Multilingual pre-trained language models can learn task-specific abilities or memorize facts across multiple languages but inevitably make undesired predictions with specific inputs. Under similar observation, model editing aims to post-hoc calibrate a model targeted to specific inputs with keeping the model's raw behavior. However, existing work only studies the monolingual scenario, which lacks the cross-lingual transferability to perform editing simultaneously across languages. In this work, we focus on cross-lingual model editing. Firstly, we define the cross-lingual model editing task and corresponding metrics, where an edit in one language propagates to the others. Next, we propose a framework to naturally adapt monolingual model editing approaches to the cross-lingual scenario using parallel corpus. Further, we propose language anisotropic editing to improve cross-lingual editing by amplifying different subsets of parameters for each language. On the newly defined cross-lingual model editing task, we empirically demonstrate the failure of monolingual baselines in propagating the edit to multiple languages and the effectiveness of the proposed language anisotropic model editing. Our code is publicly available at https://github.com/franklear/LiME.


title: Suppressed superexchange interactions in the cuprates by bond-stretching oxygen phonons

abstract: We study a multi-orbital Hubbard--Su-Schrieffer-Heeger model for the one-dimensional (1D) corner-shared cuprates in the adiabatic and nonadiabatic limits using the exact diagonalization and determinant quantum Monte Carlo methods. Our results demonstrate that lattice dimerization can be achieved only over a narrow range of couplings slightly below a critical coupling $g_c$ at half-filling. Beyond this critical coupling, the sign of the effective hopping changes, and the lattice becomes unstable. We also examine the model's temperature-dependent uniform magnetic susceptibility and the dynamical magnetic susceptibility and compare them to the results of an effective spin-$1/2$ Heisenberg model. In doing so, we numerically demonstrate that the lattice fluctuation induced by the $e$-ph interaction suppresses the effective superexchange interaction. Our results elucidate the effect of bond-stretching phonons in the parent cuprate compounds in general and are particularly relevant to 1D cuprates, where strong $e$-ph interactions have recently been inferred.


title: Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learning

abstract: There is a rising interest in further exploring the zero-shot learning potential of large pre-trained language models (PLMs). A new paradigm called data-generation-based zero-shot learning has achieved impressive success. In this paradigm, the synthesized data from the PLM acts as the carrier of knowledge, which is used to train a task-specific model with orders of magnitude fewer parameters than the PLM, achieving both higher performance and efficiency than prompt-based zero-shot learning methods on PLMs. The main hurdle of this approach is that the synthesized data from PLM usually contains a significant portion of low-quality samples. Fitting on such data will greatly hamper the performance of the task-specific model, making it unreliable for deployment. Previous methods remedy this issue mainly by filtering synthetic data using heuristic metrics(e.g., output confidence), or refining the data with the help of a human expert, which comes with excessive manual tuning or expensive costs. In this paper, we propose a novel noise-robust re-weighting framework SunGen to automatically construct high-quality data for zero-shot classification problems. Our framework features the ability to learn the sample weights indicating data quality without requiring any human annotation. We theoretically and empirically verify the ability of our method to help construct good-quality synthetic datasets. Notably, SunGen-LSTM yields a 9.8% relative improvement than the baseline on average accuracy across eight different established text classification tasks.


title: Optimizing Test-Time Query Representations for Dense Retrieval

abstract: Recent developments of dense retrieval rely on quality representations of queries and contexts from pre-trained query and context encoders. In this paper, we introduce TOUR (Test-Time Optimization of Query Representations), which further optimizes instance-level query representations guided by signals from test-time retrieval results. We leverage a cross-encoder re-ranker to provide fine-grained pseudo labels over retrieval results and iteratively optimize query representations with gradient descent. Our theoretical analysis reveals that TOUR can be viewed as a generalization of the classical Rocchio algorithm for pseudo relevance feedback, and we present two variants that leverage pseudo-labels as hard binary or soft continuous labels. We first apply TOUR on phrase retrieval with our proposed phrase re-ranker, and also evaluate its effectiveness on passage retrieval with an off-the-shelf re-ranker. TOUR greatly improves end-to-end open-domain question answering accuracy, as well as passage retrieval performance. TOUR also consistently improves direct re-ranking by up to 2.0% while running 1.3-2.4x faster with an efficient implementation.


title: Crystal invariant theory II: Pseudo-energies

abstract: The geometric crystal operators and geometric $R$-matrices (or geometric Weyl group actions) give commuting actions on the field of rational functions in $mn$ variables. We study the invariants of various combinations of these actions, which we view as "crystal analogues" of the invariants of $S_m$, ${\rm SL}_m$, $S_n \times S_m$, ${\rm SL}_n \times \, S_m$, and ${\rm SL}_n \times {\rm SL}_m$ acting on the polynomial ring in an $m \times n$ matrix of variables. The polynomial invariants of the $S_m$-action generated by the ${\rm GL}_m$-geometric $R$-matrices were described by Lam and the third-named author as the ring of loop symmetric functions. In a previous paper of the authors, the polynomial invariants of the ${\rm GL}_m$-geometric crystal operators were described as a subring of the ring of loop symmetric functions. In this paper, we give conjectural generating sets for the fields of rational invariants in the remaining cases, and we give formulas expressing a large class of loop symmetric functions in terms of these conjectural generators. Our results include new positive formulas for the central charge and energy function of a product of single-row geometric crystals, and a new derivation of Kirillov and Berenstein's piecewise-linear formula for cocharge. The formulas manifest the symmetries possessed by these functions.


title: TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data

abstract: Existing auto-regressive pre-trained language models (PLMs) like T5 and BART, have been well applied to table question answering by UNIFIEDSKG and TAPEX, respectively, and demonstrated state-of-the-art results on multiple benchmarks. However, auto-regressive PLMs are challenged by recent emerging numerical reasoning datasets, such as TAT-QA, due to the error-prone implicit calculation. In this paper, we present TaCube, to pre-compute aggregation/arithmetic results for the table in advance, so that they are handy and readily available for PLMs to answer numerical reasoning questions. TaCube systematically and comprehensively covers a collection of computational operations over table segments. By simply concatenating TaCube to the input sequence of PLMs, it shows significant experimental effectiveness. TaCube promotes the F1 score from 49.6% to 66.2% on TAT-QA and achieves new state-of-the-art results on WikiTQ (59.6% denotation accuracy). TaCube's improvements on numerical reasoning cases are even more notable: on TAT-QA, TaCube promotes the exact match accuracy of BART-large by 39.6% on sum, 52.5% on average, 36.6% on substraction, and 22.2% on division. We believe that TaCube is a general and portable pre-computation solution that can be potentially integrated to various numerical reasoning frameworks


title: Rethinking Fano's Inequality in Ensemble Learning

abstract: We propose a fundamental theory on ensemble learning that answers the central question: what factors make an ensemble system good or bad? Previous studies used a variant of Fano's inequality of information theory and derived a lower bound of the classification error rate on the basis of the $\textit{accuracy}$ and $\textit{diversity}$ of models. We revisit the original Fano's inequality and argue that the studies did not take into account the information lost when multiple model predictions are combined into a final prediction. To address this issue, we generalize the previous theory to incorporate the information loss, which we name $\textit{combination loss}$. Further, we empirically validate and demonstrate the proposed theory through extensive experiments on actual systems. The theory reveals the strengths and weaknesses of systems on each metric, which will push the theoretical understanding of ensemble learning and give us insights into designing systems.


title: Probabilistic model-error assessment of deep learning proxies: an application to real-time inversion of borehole electromagnetic measurements

abstract: The advent of fast sensing technologies allows for real-time model updates in many applications where the model parameters are uncertain. Bayesian algorithms, such as ensemble smoothers, offer a real-time probabilistic inversion accounting for uncertainties. However, they rely on the repeated evaluation of the computational models, and deep neural network (DNN) based proxies can be useful to address this computational bottleneck. This paper studies the effects of the approximate nature of the deep learned models and associated model errors during the inversion of extra-deep borehole electromagnetic (EM) measurements, which are critical for geosteering. Using a deep neural network (DNN) as a forward model allows us to perform thousands of model evaluations within seconds, which is very useful for quantifying uncertainties and non-uniqueness in real-time. While significant efforts are usually made to ensure the accuracy of the DNN models, it is known that they contain unknown model errors in the regions not covered by the training data. When DNNs are utilized during inversion of EM measurements, the effects of the model errors could manifest themselves as a bias in the estimated input parameters and, consequently, might result in a low-quality geosteering decision. We present numerical results highlighting the challenges associated with the inversion of EM measurements while neglecting model error. We further demonstrate the utility of a recently proposed flexible iterative ensemble smoother in reducing the effect of model bias by capturing the unknown model errors, thus improving the quality of the estimated subsurface properties for geosteering operation. Moreover, we describe a procedure for identifying inversion multimodality and propose possible solutions to alleviate it in real-time.


title: Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations

abstract: Despite recent explosion of interests in in-context learning, the underlying mechanism and the precise impact of the quality of demonstrations remain elusive. Intuitively, ground-truth labels should have as much impact in in-context learning (ICL) as supervised learning, but recent work reported that the input-label correspondence is significantly less important than previously thought. Intrigued by this counter-intuitive observation, we re-examine the importance of ground-truth labels in in-context learning. With the introduction of two novel metrics, namely Label-Correctness Sensitivity and Ground-truth Label Effect Ratio (GLER), we were able to conduct quantifiable analysis on the impact of ground-truth label demonstrations. Through extensive analyses, we find that the correct input-label mappings can have varying impacts on the downstream in-context learning performances, depending on the experimental configuration. Through additional studies, we identify key components, such as the verbosity of prompt templates and the language model size, as the controlling factor to achieve more noise-resilient ICL.


title: Deterministic Massively Parallel Algorithms for Ruling Sets

abstract: In this paper we present a deterministic $O(\log\log n)$-round algorithm for the 2-ruling set problem in the Massively Parallel Computation model with $\tilde{O}(n)$ memory; this algorithm also runs in $O(\log\log n)$ rounds in the Congested Clique model. This is exponentially faster than the fastest known deterministic 2-ruling set algorithm for these models, which is simply the $O(\log \Delta)$-round deterministic Maximal Independent Set algorithm due to Czumaj, Davies, and Parter (SPAA 2020). Our result is obtained by derandomizing the 2-ruling set algorithm of Kothapalli and Pemmaraju (FSTTCS 2012).


title: Local transformation of the Electronic Structure and Generation of Free Carriers in Cuprates and Ferropnictides under Heterovalent and Isovalent Doping

abstract: We have previously shown that most of the anomalies in the superconducting characteristics of cuprates and ferropnictides observed at dopant concentrations within the superconducting dome, as well as the position of the domes in the phase diagrams, do not require knowledge of the details of their electronic structure for explanation, but can be understood and calculated with high accuracy within the framework of a simple model describing the cluster structure of the superconducting phase. This fact suggests a change in the paradigm that forms our understanding of HTSC. In this paper, we propose a unified view on the transformation of the electronic structure of cuprates and ferropnictides upon heterovalent and isovalent doping, based on the assumption of self-localization of doped carriers. In this representation, in undoped cuprates and ferropnictides, which initially have different electronic structures (Mott insulator and semimetal), local doping forms percolation clusters with the same electronic structure of a self-doped excitonic insulator where a specific mechanism of superconducting pairing is implemented, which is genetically inherent in such a system. The proposed model includes a mechanism for generating additional free carriers under heterovalent and isovalent doping and makes it possible to predict their sign, which, in the general case, does not coincide with the sign of doped carriers.


title: ProsocialDialog: A Prosocial Backbone for Conversational Agents

abstract: Most existing dialogue systems fail to respond properly to potentially unsafe user utterances by either ignoring or passively agreeing with them. To address this issue, we introduce ProsocialDialog, the first large-scale multi-turn dialogue dataset to teach conversational agents to respond to problematic content following social norms. Covering diverse unethical, problematic, biased, and toxic situations, ProsocialDialog contains responses that encourage prosocial behavior, grounded in commonsense social rules (i.e., rules-of-thumb, RoTs). Created via a human-AI collaborative framework, ProsocialDialog consists of 58K dialogues, with 331K utterances, 160K unique RoTs, and 497K dialogue safety labels accompanied by free-form rationales. With this dataset, we introduce a dialogue safety detection module, Canary, capable of generating RoTs given conversational context, and a socially-informed dialogue agent, Prost. Empirical results show that Prost generates more socially acceptable dialogues compared to other state-of-the-art language and dialogue models in both in-domain and out-of-domain settings. Additionally, Canary effectively guides conversational agents and off-the-shelf language models to generate significantly more prosocial responses. Our work highlights the promise and importance of creating and steering conversational AI to be socially responsible.


title: Large Language Models are Few-Shot Clinical Information Extractors

abstract: A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and annotations. In this work, we show that large language models, such as InstructGPT, perform well at zero- and few-shot information extraction from clinical text despite not being trained specifically for the clinical domain. Whereas text classification and generation performance have already been studied extensively in such models, here we additionally demonstrate how to leverage them to tackle a diverse set of NLP tasks which require more structured outputs, including span identification, token-level sequence classification, and relation extraction. Further, due to the dearth of available data to evaluate these systems, we introduce new datasets for benchmarking few-shot clinical information extraction based on a manual re-annotation of the CASI dataset for new tasks. On the clinical extraction tasks we studied, the GPT-3 systems significantly outperform existing zero- and few-shot baselines.


title: Infinite families of homogeneous Bismut Ricci flat manifolds

abstract: Starting from compact symmetric spaces of inner type, we provide infinite families of compact homogeneous spaces carrying invariant non-flat Bismut connections with vanishing Ricci tensor. These examples turn out to be generalized symmetric spaces of order $4$ and (up to coverings) can be realized as minimal submanifolds of the Bismut flat model spaces, namely compact Lie groups. This construction generalizes the standard Cartan embedding of symmetric spaces.


title: Understanding Natural Language in Context

abstract: Recent years have seen an increasing number of applications that have a natural language interface, either in the form of chatbots or via personal assistants such as Alexa (Amazon), Google Assistant, Siri (Apple), and Cortana (Microsoft). To use these applications, a basic dialog between the robot and the human is required. While this kind of dialog exists today mainly within "static" robots that do not make any movement in the household space, the challenge of reasoning about the information conveyed by the environment increases significantly when dealing with robots that can move and manipulate objects in our home environment. In this paper, we focus on cognitive robots, which have some knowledge-based models of the world and operate by reasoning and planning with this model. Thus, when the robot and the human communicate, there is already some formalism they can use - the robot's knowledge representation formalism. Our goal in this research is to translate natural language utterances into this robot's formalism, allowing much more complicated household tasks to be completed. We do so by combining off-the-shelf SOTA language models, planning tools, and the robot's knowledge-base for better communication. In addition, we analyze different directive types and illustrate the contribution of the world's context to the translation process.


title: The quadrupole in the local Hubble parameter: first constraints using Type Ia supernova data and forecasts for future surveys

abstract: The cosmological principle asserts that the Universe looks spatially homogeneous and isotropic on sufficiently large scales. Given the fundamental implications of the cosmological principle, it is important to empirically test its validity on various scales. In this paper, we use the Type Ia supernova (SN~Ia) magnitude-redshift relation, from both the Pantheon and JLA compilations, to constrain theoretically motivated anisotropies in the Hubble flow. In particular, we constrain the quadrupole moment in the effective Hubble parameter and the dipole moment in the effective deceleration parameter. We find no significant quadrupole term regardless of the redshift frame we use. Our results are consistent with the theoretical expectation of a quadrupole moment of a few percent at scales of $\sim 100 h^{-1}$ Mpc. We place an upper limit of a $\sim 10\%$ quadrupole amplitude relative to the monopole, $H_0$, at these scales. We find that we can detect a $\sim 7\%$ quadrupole moment at the 5$\sigma$ level, for a forecast low-$z$ sample of 1055 SNe~Ia. We find an exponentially decaying dipole moment of the deceleration parameter varies in significance depending on the redshift frame we use. In the heliocentric frame, as expected, it is detected at $\sim 3 \sigma$ significance. In the rest-frame of the cosmic microwave background (CMB), we find a marginal $\sim 2 \sigma$ dipole, however, after applying peculiar velocity corrections, the dipole is insignificant. Finally, we find the best-fit frame of rest relative to the supernovae to differ from that of the CMB.