title: Adapters for Enhanced Modeling of Multilingual Knowledge and Text

abstract: Large language models appear to learn facts from the large text corpora they are trained on. Such facts are encoded implicitly within their many parameters, making it difficult to verify or manipulate what knowledge has been learned. Language models have recently been extended to multilingual language models (MLLMs), enabling knowledge to be learned across hundreds of languages. Meanwhile, knowledge graphs contain facts in an explicit triple format, which require careful and costly curation and are only available in a few high-resource languages, restricting their research and application. To address these issues, we propose to enhance MLLMs with knowledge from multilingual knowledge graphs (MLKGs) so as to tackle language and knowledge graph tasks across many languages, including low-resource ones. Specifically, we introduce a lightweight adapter set to enhance MLLMs with cross-lingual entity alignment and facts from MLKGs for many languages. Experiments on common benchmarks show that such enhancement benefits both MLLMs and MLKGs, achieving: (1) comparable or improved performance for knowledge graph completion and entity alignment relative to baselines, especially for low-resource languages (for which knowledge graphs are unavailable); and (2) improved MLLM performance on language understanding tasks that require multilingual factual knowledge; all while maintaining performance on other general language tasks.


title: Square of Planar Graphs of Max Degree Four without Five Cycles

abstract: We show that the choosability of the square of planar graphs of max degree 4 without five cycles is at most 12. Keywords: planar graph, choosability AMS Mathematics Subject Classification: 05C15


title: A Simpler Method for Understanding Emergency Shelter Access Patterns

abstract: The Simplified Access Metric (SAM) is a new approach for characterizing emergency shelter access patterns as a measure of shelter client vulnerability. The goal of SAM is to provide shelter operators with an intuitive way to understand access patterns that can be implemented by non-technical staff using spreadsheet operations. Client data from a large North American shelter will be used to demonstrate that SAM produces similar results to traditional transitional, episodic and chronic client cluster analysis. Since SAM requires less data than cluster analysis, it is also able to generate a real time picture of how shelter access patterns are affected by external factors. Timelines generated from nine years of shelter client data using SAM demonstrate the impact of Housing First programming and the COVID-19 lockdown on how people access shelter. Finally, SAM allows shelter staff to move beyond assigning transitional, episodic and chronic labels and instead use the "soft" output of SAM directly as a measure of vulnerability.


title: Epistemic-Pragmatist Interpretations of Quantum Mechanics: A Comparative Assessment

abstract: In this paper, we investigate similarities and differences between the main neo-Copenhagen (or "epistemic-pragmatist") interpretations of quantum mechanics, here identified as those defined by the rejection of an ontological nature of the quantum states and the simultaneous avoidance of hidden variables, while maintaining the quantum formalism unchanged. We argue that there is a single general interpretive framework with a common core to which all these interpretations are committed, so that they can be regarded as different instances of it, with some of their differences being mostly a matter of emphasis and degree. We also identify, however, remaining differences of a more substantial nature, and we offer a first analysis of them. We also argue that these remaining differences cannot be resolved within the formalism of quantum mechanics itself and identify the more general philosophical considerations that can be used in order to break this interpretation underdetermination.


title: Experimental Flight Testing of a Fault-Tolerant Adaptive Autopilot for Fixed-Wing Aircraft

abstract: This paper presents an adaptive autopilot for fixed-wing aircraft and compares its performance with a fixed-gain autopilot. The adaptive autopilot is constructed by augmenting the autopilot architecture with adaptive control laws that are updated using retrospective cost adaptive control. In order to investigate the performance of the adaptive autopilot, the default gains of the fixed-gain autopilot are scaled to degrade its performance. This scenario provides a venue for determining the ability of the adaptive autopilot to compensate for the degraded fixed-gain autopilot. Next, the performance of the adaptive autopilot is examined under failure conditions by simulating a scenario where one of the control surfaces is assumed to be stuck at an unknown angle. The adaptive autopilot is also tested in physical flight experiments under degraded-nominal conditions, and the resulting performance improvement is examined.


title: Characterization of singular flows of zeroth-order pseudo-differential operators via elliptic eigenfunctions: a numerical study

abstract: The propagation of internal gravity waves in stratified media, such as those found in ocean basins and lakes, leads to the development of geometrical patterns called "attractors". These structures accumulate much of the wave energy and make the fluid flow highly singular. In more analytical terms, the cause of this phenomenon has been attributed to the presence of a continuous spectrum in some nonlocal zeroth-order pseudo-differential operators. In this work, we analyze the generation of these attractors from a numerical analysis perspective. First, we propose a high-order pseudo-spectral method to solve the evolution problem (whose long-term behaviour is known to be not square-integrable). Then, we use similar tools to discretize the corresponding eigenvalue problem. Since the eigenvalues are embedded in a continuous spectrum, we compute them using viscous approximations. Finally, we explore the effect that the embedded eigenmodes have on the long-term evolution of the system.


title: Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlook

abstract: In recent years, reinforcement learning and bandits have transformed a wide range of real-world applications including healthcare, finance, recommendation systems, robotics, and last but not least, the speech and natural language processing. While most speech and language applications of reinforcement learning algorithms are centered around improving the training of deep neural networks with its flexible optimization properties, there are still many grounds to explore to utilize the benefits of reinforcement learning, such as its reward-driven adaptability, state representations, temporal structures and generalizability. In this survey, we present an overview of recent advancements of reinforcement learning and bandits, and discuss how they can be effectively employed to solve speech and natural language processing problems with models that are adaptive, interactive and scalable.


title: The ergodicity of nonlinear Fokker-Planck flows in $L^1(\mathbb R^d)$

abstract: One proves in this work that the nonlinear semigroup $S(t)$ in $L^1(\mathbb R^d)$, $d\geq 3$, associated with the nonlinear Fokker-Planck equation $u_t-\Delta\beta(u)+\text{div}(Db(u)u){=}0$, $u(0)=u_0$ in $(0,\infty)\times\mathbb R^d$, under suitable conditions on the coefficients $\beta:\mathbb R\to\mathbb R$, $D:\mathbb R^d\to\mathbb R^d$ and $b:\mathbb R\to\mathbb R$, is mean ergodic. In particular, this implies the mean ergodicity of the time marginal laws of the solutions to the corresponding McKean-Vlasov stochastic differential equation. This completes the results established in [7] on the nature of the corresponding omega-set $\omega(u_0)$ for $S(t)$ in the case where the flow $S(t)$ in $L^1(\mathbb R^d)$ has not a fixed point and so the corresponding stationary Fokker-Planck equation has no solutions.


title: Deploying a Steered Query Optimizer in Production at Microsoft

abstract: Modern analytical workloads are highly heterogeneous and massively complex, making generic query optimizers untenable for many customers and scenarios. As a result, it is important to specialize these optimizers to instances of the workloads. In this paper, we continue a recent line of work in steering a query optimizer towards better plans for a given workload, and make major strides in pushing previous research ideas to production deployment. Along the way we solve several operational challenges including, making steering actions more manageable, keeping the costs of steering within budget, and avoiding unexpected performance regressions in production. Our resulting system, QQ-advisor, essentially externalizes the query planner to a massive offline pipeline for better exploration and specialization. We discuss various aspects of our design and show detailed results over production SCOPE workloads at Microsoft, where the system is currently enabled by default.


title: VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

abstract: There has been a growing interest in solving Visual Question Answering (VQA) tasks that require the model to reason beyond the content present in the image. In this work, we focus on questions that require commonsense reasoning. In contrast to previous methods which inject knowledge from static knowledge bases, we investigate the incorporation of contextualized knowledge using Commonsense Transformer (COMET), an existing knowledge model trained on human-curated knowledge bases. We propose a method to generate, select, and encode external commonsense knowledge alongside visual and textual cues in a new pre-trained Vision-Language-Commonsense transformer model, VLC-BERT. Through our evaluation on the knowledge-intensive OK-VQA and A-OKVQA datasets, we show that VLC-BERT is capable of outperforming existing models that utilize static knowledge bases. Furthermore, through a detailed analysis, we explain which questions benefit, and which don't, from contextualized commonsense knowledge from COMET.


title: Integrable heat conduction model

abstract: We consider a stochastic process of heat conduction where energy is redistributed along a chain between nearest neighbor sites via an improper beta distribution. Similar to the well-known Kipnis-Marchioro-Presutti (KMP) model, the finite chain is coupled at its ends with two reservoirs that break the conservation of energy when working at different temperatures. At variance with KMP, the model considered here is integrable and one can write in a closed form the $n$-point correlation functions of the non-equilibrium steady state. As a consequence of the exact solution one can directly prove that the system is in a `local equilibrium' and described at the macro-scale by a product measure. Integrability manifests itself through the description of the model via the open Heisenberg chain with non-compact spins. The algebraic formulation of the model allows to interpret its duality relation with a purely absorbing particle system as a change of representation.

categories: cond-mat.stat-mech hep-th math-ph math.MP math.PR


title: Predicting Long-Term Citations from Short-Term Linguistic Influence

abstract: A standard measure of the influence of a research paper is the number of times it is cited. However, papers may be cited for many reasons, and citation count offers limited information about the extent to which a paper affected the content of subsequent publications. We therefore propose a novel method to quantify linguistic influence in timestamped document collections. There are two main steps: first, identify lexical and semantic changes using contextual embeddings and word frequencies; second, aggregate information about these changes into per-document influence scores by estimating a high-dimensional Hawkes process with a low-rank parameter matrix. We show that this measure of linguistic influence is predictive of $\textit{future}$ citations: the estimate of linguistic influence from the two years after a paper's publication is correlated with and predictive of its citation count in the following three years. This is demonstrated using an online evaluation with incremental temporal training/test splits, in comparison with a strong baseline that includes predictors for initial citation counts, topics, and lexical features.


title: Powell's Conjecture on the Goeritz group of $S^3$ is stably true

abstract: In 1980 J. Powell proposed that, for every genus $g$, five specific elements suffice to generate the Goeritz group $\mathcal {G}_g$ of genus $g$ Heegaard splittings of $S^3$. Powell's Conjecture remains undecided for $g \geq 4$. Let $\mathcal{P}_g \subset \mathcal {G}_g$ denote the subgroup generated by Powell's elements. Here we show that, for each genus $g$, the natural function $\mathcal {G}_g \to \mathcal {G}_{g+1}/\mathcal {P}_{g+1}$ is trivial.


title: Budget-Constrained Bounds for Mini-Batch Estimation of Optimal Transport

abstract: Optimal Transport (OT) is a fundamental tool for comparing probability distributions, but its exact computation remains prohibitive for large datasets. In this work, we introduce novel families of upper and lower bounds for the OT problem constructed by aggregating solutions of mini-batch OT problems. The upper bound family contains traditional mini-batch averaging at one extreme and a tight bound found by optimal coupling of mini-batches at the other. In between these extremes, we propose various methods to construct bounds based on a fixed computational budget. Through various experiments, we explore the trade-off between computational budget and bound tightness and show the usefulness of these bounds in computer vision applications.


title: On the Robustness of Dataset Inference

abstract: Machine learning (ML) models are costly to train as they can require a significant amount of data, computational resources and technical expertise. Thus, they constitute valuable intellectual property that needs protection from adversaries wanting to steal them. Ownership verification techniques allow the victims of model stealing attacks to demonstrate that a suspect model was in fact stolen from theirs. Although a number of ownership verification techniques based on watermarking or fingerprinting have been proposed, most of them fall short either in terms of security guarantees (well-equipped adversaries can evade verification) or computational cost. A fingerprinting technique, Dataset Inference (DI), has been shown to offer better robustness and efficiency than prior methods. The authors of DI provided a correctness proof for linear (suspect) models. However, in a subspace of the same setting, we prove that DI suffers from high false positives (FPs) -- it can incorrectly identify an independent model trained with non-overlapping data from the same distribution as stolen. We further prove that DI also triggers FPs in realistic, non-linear suspect models. We then confirm empirically that DI in the black-box setting leads to FPs, with high confidence. Second, we show that DI also suffers from false negatives (FNs) -- an adversary can fool DI (at the cost of incurring some accuracy loss) by regularising a stolen model's decision boundaries using adversarial training, thereby leading to an FN. To this end, we demonstrate that black-box DI fails to identify a model adversarially trained from a stolen dataset -- the setting where DI is the hardest to evade. Finally, we discuss the implications of our findings, the viability of fingerprinting-based ownership verification in general, and suggest directions for future work.


title: The spiral arms of galaxies

abstract: The most important theory of the spiral arms of galaxies is the density wave theory based on the Lin-Shu dispersion relation. However, the density waves move with the group velocity towards the inner Lindblad resonance and tend to disappear. Various mechanisms to replenish the spiral waves have been proposed. Nonlinear effects play an important role near the inner and outer Lindblad resonances and corotation. The orbits supporting the spiral arms are precessing ellipses in normal galaxies that extend up to the 4/1 resonance. On the other hand, in barred galaxies the spiral arms extend along the manifolds of the unstable periodic orbits at the ends of the bar and they are composed of chaotic orbits. However these chaotic orbits can be found analytically.


title: Global stability of perturbed complex-balanced systems

abstract: A class of polynomial dynamical systems called complex-balanced are locally stable and conjectured to be globally stable. In general, complex-balancing is not a robust property, i.e., small changes in parameter values may result in the loss of the complex-balanced property. We show that robustly permanent complex-balanced systems are globally stable even after the rate constants have been perturbed.


title: Vitruvio: 3D Building Meshes via Single Perspective Sketches

abstract: Today's architectural engineering and construction (AEC) software require a learning curve to generate a three-dimension building representation. This limits the ability to quickly validate the volumetric implications of an initial design idea communicated via a single sketch. Allowing designers to translate a single sketch to a 3D building will enable owners to instantly visualize 3D project information without the cognitive load required. If previous state-of-the-art (SOTA) data-driven methods for single view reconstruction (SVR) showed outstanding results in the reconstruction process from a single image or sketch, they lacked specific applications, analysis, and experiments in the AEC. Therefore, this research addresses this gap, introducing the first deep learning method focused only on buildings that aim to convert a single sketch to a 3D building mesh: Vitruvio. Vitruvio adapts Occupancy Network for SVR tasks on a specific building dataset (Manhattan 1K). This adaptation brings two main improvements. First, it accelerates the inference process by more than 26% (from 0.5s to 0.37s). Second, it increases the reconstruction accuracy (measured by the Chamfer Distance) by 18%. During this adaptation in the AEC domain, we evaluate the effect of the building orientation in the learning procedure since it constitutes an important design factor. While aligning all the buildings to a canonical pose improved the overall quantitative metrics, it did not capture fine-grain details in more complex building shapes (as shown in our qualitative analysis). Finally, Vitruvio outputs a 3D-printable building mesh with arbitrary topology and genus from a single perspective sketch, providing a step forward to allow owners and designers to communicate 3D information via a 2D, effective, intuitive, and universal communication medium: the sketch.


title: Toward an Intelligent Tutoring System for Argument Mining in Legal Texts

abstract: We propose an adaptive environment (CABINET) to support caselaw analysis (identifying key argument elements) based on a novel cognitive computing framework that carefully matches various machine learning (ML) capabilities to the proficiency of a user. CABINET supports law students in their learning as well as professionals in their work. The results of our experiments focused on the feasibility of the proposed framework are promising. We show that the system is capable of identifying a potential error in the analysis with very low false positives rate (2.0-3.5%), as well as of predicting the key argument element type (e.g., an issue or a holding) with a reasonably high F1-score (0.74).


title: Rejoinder to discussions on "Instrumental variable estimation of the causal hazard ratio"

abstract: We respond to comments on our paper, titled "Instrumental variable estimation of the causal hazard ratio."


title: Hidden Symmetry Protection and Topology in Surface Maxwell Waves

abstract: Since the latter half of the 20th century, the use of metal in optics has become a promising plasmonics field for controlling light at a deep subwavelength scale. Surface plasmon polaritons localized on metal surfaces are crucial in plasmonics. However, despite the long history of plasmonics, the underlying mechanism producing the surface waves is not fully understood. This study unveils the hidden symmetry protection that ensures the existence of degenerated electric zero modes. These zero modes are identified as physical origins of surface plasmon polaritons, and similar zero modes can be directly excited at a temporal boundary. In real space, the zero modes possess vector-field rotation related to surface impedance. Focusing on the surface impedance, we prove the bulk-edge correspondence, which guarantees the existence of surface plasmon polaritons even with nonuniformity. Lastly, we extract the underlying physics in the topological transition between metal and dielectric material using a minimal circuit model with duality. The transition is considered the crossover between electric and magnetic zero modes.


title: Learning Robust Real-World Dexterous Grasping Policies via Implicit Shape Augmentation

abstract: Dexterous robotic hands have the capability to interact with a wide variety of household objects to perform tasks like grasping. However, learning robust real world grasping policies for arbitrary objects has proven challenging due to the difficulty of generating high quality training data. In this work, we propose a learning system (ISAGrasp) for leveraging a small number of human demonstrations to bootstrap the generation of a much larger dataset containing successful grasps on a variety of novel objects. Our key insight is to use a correspondence-aware implicit generative model to deform object meshes and demonstrated human grasps in order to generate a diverse dataset of novel objects and successful grasps for supervised learning, while maintaining semantic realism. We use this dataset to train a robust grasping policy in simulation which can be deployed in the real world. We demonstrate grasping performance with a four-fingered Allegro hand in both simulation and the real world, and show this method can handle entirely new semantic classes and achieve a 79% success rate on grasping unseen objects in the real world.


title: Online Critical-State Detection of Sepsis Among ICU Patients using Jensen-Shannon Divergence

abstract: Sepsis is a severe medical condition caused by a dysregulated host response to infection that has a high incidence and mortality rate. Even with such a high-level occurrence rate, the detection and diagnosis of sepsis continues to pose a challenge. There is a crucial need to accurately forecast the onset of sepsis promptly while also identifying the specific physiologic anomalies that contribute to this prediction in an interpretable fashion. This study proposes a novel approach to quantitatively measure the difference between patients and a reference group using non-parametric probability distribution estimates and highlight when abnormalities emerge using a Jensen-Shannon divergence-based single sample analysis approach. We show that we can quantitatively distinguish between these two groups and offer a measurement of divergence in real time while simultaneously identifying specific physiologic factors contributing to patient outcomes. We demonstrate our approach on a real-world dataset of patients admitted to Atlanta, Georgia's Grady Hospital.


title: Lecture Notes on Modular Infinity Operads and Grothendieck-Teichmueller Theory

abstract: These notes represent the transcript of three, 90 minute lectures given by the second author at the CRM in Barcelona in 2021 as part of the "Higher Structures and Operadic Calculus" workshop. The goal of the series was to introduce and motivate modular infinity operads via their application to what is often called "Grothendieck-Teichmueller" theory.


title: NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fields

abstract: We propose a novel geometric and photometric 3D mapping pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical volumetric neural radiance fields. Our insight is that dense monocular SLAM provides the right information to fit a neural radiance field of the scene in real-time, by providing accurate pose estimates and depth-maps with associated uncertainty. With our proposed uncertainty-based depth loss, we achieve not only good photometric accuracy, but also great geometric accuracy. In fact, our proposed pipeline achieves better geometric and photometric accuracy than competing approaches (up to 179% better PSNR and 86% better L1 depth), while working in real-time and using only monocular images.


title: MISm: A Medical Image Segmentation Metric for Evaluation of weak labeled Data

abstract: Performance measures are an important tool for assessing and comparing different medical image segmentation algorithms. Unfortunately, the current measures have their weaknesses when it comes to assessing certain edge cases. These limitations arouse when images with a very small region of interest or without a region of interest at all are assessed. As a solution for these limitations, we propose a new medical image segmentation metric: MISm. To evaluate MISm, the popular metrics in the medical image segmentation and MISm were compared using images of magnet resonance tomography from several scenarios. In order to allow application in the community and reproducibility of experimental results, we included MISm in the publicly available evaluation framework MISeval: https://github.com/frankkramer-lab/miseval/tree/master/miseval


title: Large-scale optical characterization of solid-state quantum emitters

abstract: Solid-state quantum emitters have emerged as a leading quantum memory for quantum networking applications. However, standard optical characterization techniques are neither efficient nor repeatable at scale. In this work, we introduce and demonstrate spectroscopic techniques that enable large-scale, automated characterization of color centers. We first demonstrate the ability to track color centers by registering them to a fabricated machine-readable global coordinate system, enabling systematic comparison of the same color center sites over many experiments. We then implement resonant photoluminescence excitation in a widefield cryogenic microscope to parallelize resonant spectroscopy, achieving two orders of magnitude speed-up over confocal microscopy. Finally, we demonstrate automated chip-scale characterization of color centers and devices at room temperature, imaging thousands of microscope fields of view. These tools will enable accelerated identification of useful quantum emitters at chip-scale, enabling advances in scaling up color center platforms for quantum information applications, materials science, and device design and characterization.


title: Collision trajectories and regularisation of two-body problem on $S^2$

abstract: In this paper, we investigate collision orbits of two identical bodies placed on the surface of a two-dimensional sphere and interacting via an attracting potential of the form $V(q)=-\cot(q)$, where $q$ is the angle formed by the position vectors of the two bodies. We describe the $\omega$-limit set of the variables in the symplectically reduced system corresponding to initial data that lead to collisions. Furthermore we provide a geometric description of the dynamics. Lastly, we regularise the system and investigate its behaviour on near collision orbits. This involves the study of completely degenerate equilibria and the use of high-dimensional non-homogenous blow-ups.


title: Filming Enhanced Ionization in an Ultrafast Triatomic Slingshot

abstract: Filming atomic motion within molecules is an active pursuit of molecular physics and quantum chemistry. A promising method is laser-induced Coulomb Explosion Imaging (CEI) where a laser pulse rapidly ionizes many electrons from a molecule, causing the remaining ions to undergo Coulomb repulsion. The ion momenta are used to reconstruct the molecular geometry which is tracked over time (i.e. filmed) by ionizing at an adjustable delay with respect to the start of interatomic motion. Results are distorted, however, by ultrafast motion during the ionizing pulse. We studied this effect in water and filmed the rapid "slingshot" motion that enhances ionization and distorts CEI results. Our investigation uncovered both the geometry and mechanism of the enhancement which may inform CEI experiments in many other polyatomic molecules.

categories: physics.chem-ph physics.atom-ph physics.optics quant-ph


title: Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image

abstract: Depth information is the foundation of perception, essential for autonomous driving, robotics, and other source-constrained applications. Promptly obtaining accurate and efficient depth information allows for a rapid response in dynamic environments. Sensor-based methods using LIDAR and RADAR obtain high precision at the cost of high power consumption, price, and volume. While due to advances in deep learning, vision-based approaches have recently received much attention and can overcome these drawbacks. In this work, we explore an extreme scenario in vision-based settings: estimate a depth map from one monocular image severely plagued by grid artifacts and blurry edges. To address this scenario, We first design a convolutional attention mechanism block (CAMB) which consists of channel attention and spatial attention sequentially and insert these CAMBs into skip connections. As a result, our novel approach can find the focus of current image with minimal overhead and avoid losses of depth features. Next, by combining the depth value, the gradients of X axis, Y axis and diagonal directions, and the structural similarity index measure (SSIM), we propose our novel loss function. Moreover, we utilize pixel blocks to accelerate the computation of the loss function. Finally, we show, through comprehensive experiments on two large-scale image datasets, i.e. KITTI and NYU-V2, that our method outperforms several representative baselines.


title: Temporally Disentangled Representation Learning

abstract: Recently in the field of unsupervised representation learning, strong identifiability results for disentanglement of causally-related latent variables have been established by exploiting certain side information, such as class labels, in addition to independence. However, most existing work is constrained by functional form assumptions such as independent sources or further with linear transitions, and distribution assumptions such as stationary, exponential family distribution. It is unknown whether the underlying latent variables and their causal relations are identifiable if they have arbitrary, nonparametric causal influences in between. In this work, we establish the identifiability theories of nonparametric latent causal processes from their nonlinear mixtures under fixed temporal causal influences and analyze how distribution changes can further benefit the disentanglement. We propose \textbf{\texttt{TDRL}}, a principled framework to recover time-delayed latent causal variables and identify their relations from measured sequential data under stationary environments and under different distribution shifts. Specifically, the framework can factorize unknown distribution shifts into transition distribution changes under fixed and time-varying latent causal relations, and under observation changes in observation. Through experiments, we show that time-delayed latent causal influences are reliably identified and that our approach considerably outperforms existing baselines that do not correctly exploit this modular representation of changes. Our code is available at: \url{https://github.com/weirayao/tdrl}.


title: Learning to forecast vegetation greenness at fine resolution over Africa with ConvLSTMs

abstract: Forecasting the state of vegetation in response to climate and weather events is a major challenge. Its implementation will prove crucial in predicting crop yield, forest damage, or more generally the impact on ecosystems services relevant for socio-economic functioning, which if absent can lead to humanitarian disasters. Vegetation status depends on weather and environmental conditions that modulate complex ecological processes taking place at several timescales. Interactions between vegetation and different environmental drivers express responses at instantaneous but also time-lagged effects, often showing an emerging spatial context at landscape and regional scales. We formulate the land surface forecasting task as a strongly guided video prediction task where the objective is to forecast the vegetation developing at very fine resolution using topography and weather variables to guide the prediction. We use a Convolutional LSTM (ConvLSTM) architecture to address this task and predict changes in the vegetation state in Africa using Sentinel-2 satellite NDVI, having ERA5 weather reanalysis, SMAP satellite measurements, and topography (DEM of SRTMv4.1) as variables to guide the prediction. Ours results highlight how ConvLSTM models can not only forecast the seasonal evolution of NDVI at high resolution, but also the differential impacts of weather anomalies over the baselines. The model is able to predict different vegetation types, even those with very high NDVI variability during target length, which is promising to support anticipatory actions in the context of drought-related disasters.


title: Extending Lagrangian transformations to nonconvex scalar conservation laws

abstract: The present paper studies a method of finding Lagrangian transformations, in the form of particle paths, for all scalar conservation laws having a smooth flux. These are found using the notion of weak diffeomorphisms. More precisely, from any given scalar conservation law, we derive a Temple system having one linearly degenerate and one genuinely nonlinear family. We modify the system to make it strictly hyperbolic and prove an existence result for it. Finally we establish that entropy admissible weak solutions to this system are equivalent to those of the scalar equation. This method also determines the associated weak diffeomorphism.


title: ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphs

abstract: Knowledge Graph Question Answering (KGQA) involves retrieving entities as answers from a Knowledge Graph (KG) using natural language queries. The challenge is to learn to reason over question-relevant KG facts that traverse KG entities and lead to the question answers. To facilitate reasoning, the question is decoded into instructions, which are dense question representations used to guide the KG traversals. However, if the derived instructions do not exactly match the underlying KG information, they may lead to reasoning under irrelevant context. Our method, termed ReaRev, introduces a new way to KGQA reasoning with respect to both instruction decoding and execution. To improve instruction decoding, we perform reasoning in an adaptive manner, where KG-aware information is used to iteratively update the initial instructions. To improve instruction execution, we emulate breadth-first search (BFS) with graph neural networks (GNNs). The BFS strategy treats the instructions as a set and allows our method to decide on their execution order on the fly. Experimental results on three KGQA benchmarks demonstrate the ReaRev's effectiveness compared with previous state-of-the-art, especially when the KG is incomplete or when we tackle complex questions. Our code is publicly available at https://github.com/cmavro/ReaRev_KGQA.


title: An Effective Approach for Multi-label Classification with Missing Labels

abstract: Compared with multi-class classification, multi-label classification that contains more than one class is more suitable in real life scenarios. Obtaining fully labeled high-quality datasets for multi-label classification problems, however, is extremely expensive, and sometimes even infeasible, with respect to annotation efforts, especially when the label spaces are too large. This motivates the research on partial-label classification, where only a limited number of labels are annotated and the others are missing. To address this problem, we first propose a pseudo-label based approach to reduce the cost of annotation without bringing additional complexity to the existing classification networks. Then we quantitatively study the impact of missing labels on the performance of classifier. Furthermore, by designing a novel loss function, we are able to relax the requirement that each instance must contain at least one positive label, which is commonly used in most existing approaches. Through comprehensive experiments on three large-scale multi-label image datasets, i.e. MS-COCO, NUS-WIDE, and Pascal VOC12, we show that our method can handle the imbalance between positive labels and negative labels, while still outperforming existing missing-label learning approaches in most cases, and in some cases even approaches with fully labeled datasets.


title: Switching between Mott-Hubbard and Hund physics in moir\'e quantum simulators

abstract: Mott-Hubbard and Hund electron correlations have been realized thus far in separate classes of materials. Here, we show that a single moir\'e homobilayer encompasses both kinds of physics in a controllable manner. We develop a microscopic multiband model that we solve by dynamical mean-field theory to nonperturbatively address the local many-body correlations. We demonstrate how tuning with twist angle, dielectric screening, and hole density allows us to switch between Mott-Hubbard and Hund correlated states in a twisted WSe$_2$ bilayer. The underlying mechanism is based on controlling Coulomb-interaction-driven orbital polarization and the energetics of concomitant local singlet and triplet spin configurations. From a comparison to recent experimental transport data, we find signatures of a filling-controlled transition from a triplet charge-transfer insulator to a Hund-Mott metal. Our finding establishes twisted transition metal dichalcogenides as a tunable platform for exotic phases of quantum matter emerging from large local spin moments.


title: The unramified computation of a Shimura integral for $\mathrm{SL}(2)\times \mathrm{GL}(2)$

abstract: In this note, we revisit the Rankin-Selberg integral of Shimura type for generic representations of $\mathrm{SL}_2\times \mathrm{GL}_2$, constructed by Ginzburg, Rallis, and Soudry. We give a different and more ``intrinsic'' proof of the unramified computation. In contrast to their proof we avoid local functional equation for the general linear groups but use the Casselman-Shalika formulas for unramified Whittaker functions for $\mathrm{SL}_2$ and $\mathrm{GL}_2$.


title: Boosting Kidney Stone Identification in Endoscopic Images Using Two-Step Transfer Learning

abstract: Knowing the cause of kidney stone formation is crucial to establish treatments that prevent recurrence. There are currently different approaches for determining the kidney stone type. However, the reference ex-vivo identification procedure can take up to several weeks, while an in-vivo visual recognition requires highly trained specialists. Machine learning models have been developed to provide urologists with an automated classification of kidney stones during an ureteroscopy; however, there is a general lack in terms of quality of the training data and methods. In this work, a two-step transfer learning approach is used to train the kidney stone classifier. The proposed approach transfers knowledge learned on a set of images of kidney stones acquired with a CCD camera (ex-vivo dataset) to a final model that classifies images from endoscopic images (ex-vivo dataset). The results show that learning features from different domains with similar information helps to improve the performance of a model that performs classification in real conditions (for instance, uncontrolled lighting conditions and blur). Finally, in comparison to models that are trained from scratch or by initializing ImageNet weights, the obtained results suggest that the two-step approach extracts features improving the identification of kidney stones in endoscopic images.


title: An Event Study of the Ethereum Transition to Proof-of-Stake

abstract: On September 15, 2022, the Ethereum network adopted a proof-of-stake (PoS) consensus mechanism. We study the impact on the network and competing platforms in a two month event window around the Beacon chain merge. We find that the transition to PoS has reduced energy consumption by 99.98%. Miners have not transformed into validators, and total block reward income (in USD) has fallen by 97%, though transaction fees (in ETH) for Ether have increased nearly 10%. The Herfindahl index for the top 10 is 1,009; the network is 19% less concentrated after the merge. Ethereum supply growth has been deflationary since the merge. The time between consecutive blocks is now steady at 12 seconds and transactions per day are up 7.0%. On Polygon, Matic fees rose but token fees fell. Polygon also slows, processing 3.3% fewer transactions per day. Solana's fees fall by $0.0003, and transactions per day are down 48%. Stablecoin transfer volumes fall on Ethereum and Polygon, but rise on Solana.


title: On the boundary complex of the $k$-Cauchy-Fueter complex

abstract: The $k$-Cauchy-Fueter complex, $k=0,1,\ldots$, in quaternionic analysis are the counterpart of the Dolbeault complex in the theory of several complex variables. In this paper, we construct explicitly boundary complexes of these complexes on boundaries of domains, corresponding to the tangential Cauchy-Riemann complex in complex analysis.They are only known boundary complexes outside of complex analysis that have interesting applications to the function theory. As an application, we establish the Hartogs-Bochner extension for $k$-regular functions, the quaternionic counterpart of holomorphic functions. These boundary complexes have a very simple form on a kind of quadratic hypersurfaces, which have the structure of right-type nilpotent Lie groups of step two. They allow us to introduce the quaternionic Monge-Amp\`{e}re operator and opens the door to investigate pluripotential theory on such groups. We also apply abstract duality theorem to boundary complexes to obtain the generalization of Malgrange's vanishing theorem and Hartogs-Bochner extension for $k$-CF functions, the quaternionic counterpart of CR functions, on this kind of groups.


title: Existence of radial global smooth solutions to the pressureless Euler-Poisson equations with quadratic confinement

abstract: We consider the pressureless Euler-Poisson equations with quadratic confinement. For spatial dimension $d\ge 2,\,d\ne 4$, we give a necessary and sufficient condition for the existence of radial global smooth solutions, which is formulated explicitly in terms of the initial data. This condition appears to be much more restrictive than the critical-threshold conditions commonly seen in the study of Euler-type equations. To obtain our results, the key observation is that every characteristic satisfies a periodic ODE system, and the existence of global smooth solution requires the period of every characteristic to be identical.


title: A fast multilevel dimension iteration algorithm for high dimensional numerical integration

abstract: In this paper, we propose and study a fast multilevel dimension iteration (MDI) algorithm for computing arbitrary $d$-dimensional integrals based on tensor product approximations. It reduces the computational complexity (in terms of the CPU time) of a tensor product method from the exponential order $O(N^d)$ to the polynomial order {\color{black} $O(d^3N^2)$ or better}, where $N$ stands for the number of quadrature points in each coordinate direction. As a result, the proposed MDI algorithm effectively circumvents the curse of the dimensionality of tensor product methods for high dimensional numerical integration. The main idea of the proposed MDI algorithm is to compute the function evaluations at all integration points in the cluster and iteratively along each coordinate direction, so lots of computations for function evaluations can be reused in each iteration. This idea is also applicable to any quadrature rule whose integration points have a lattice-like structure.


title: Self-Configuring nnU-Nets Detect Clouds in Satellite Images

abstract: Cloud detection is a pivotal satellite image pre-processing step that can be performed both on the ground and on board a satellite to tag useful images. In the latter case, it can help to reduce the amount of data to downlink by pruning the cloudy areas, or to make a satellite more autonomous through data-driven acquisition re-scheduling of the cloudy areas. We approach this important task with nnU-Nets, a self-reconfigurable framework able to perform meta-learning of a segmentation network over various datasets. Our experiments, performed over Sentinel-2 and Landsat-8 multispectral images revealed that nnU-Nets deliver state-of-the-art cloud segmentation performance without any manual design. Our approach was ranked within the top 7% best solutions (across 847 participating teams) in the On Cloud N: Cloud Cover Detection Challenge, where we reached the Jaccard index of 0.882 over more than 10k unseen Sentinel-2 image patches (the winners obtained 0.897, whereas the baseline U-Net with the ResNet-34 backbone used as an encoder: 0.817, and the classic Sentinel-2 image thresholding: 0.652).


title: Multi-SpacePhish: Extending the Evasion-space of Adversarial Attacks against Phishing Website Detectors using Machine Learning

abstract: Existing literature on adversarial Machine Learning (ML) focuses either on showing attacks that break every ML model, or defenses that withstand most attacks. Unfortunately, little consideration is given to the actual feasibility of the attack or the defense. Moreover, adversarial samples are often crafted in the "feature-space", making the corresponding evaluations of questionable value. Simply put, the current situation does not allow to estimate the actual threat posed by adversarial attacks, leading to a lack of secure ML systems. We aim to clarify such confusion in this paper. By considering the application of ML for Phishing Website Detection (PWD), we formalize the "evasion-space" in which an adversarial perturbation can be introduced to fool a ML-PWD -- demonstrating that even perturbations in the "feature-space" are useful. Then, we propose a realistic threat model describing evasion attacks against ML-PWD that are cheap to stage, and hence intrinsically more attractive for real phishers. After that, we perform the first statistically validated assessment of state-of-the-art ML-PWD against 12 evasion attacks. Our evaluation shows (i) the true efficacy of evasion attempts that are more likely to occur; and (ii) the impact of perturbations crafted in different evasion-spaces. Our realistic evasion attempts induce a statistically significant degradation (3-10% at p<0.05), and their cheap cost makes them a subtle threat. Notably, however, some ML-PWD are immune to our most realistic attacks (p=0.22). Finally, as an additional contribution of this journal publication, we are the first to consider the intriguing case wherein an attacker introduces perturbations in multiple evasion-spaces at the same time. These new results show that simultaneously applying perturbations in the problem- and feature-space can cause a drop in the detection rate from 0.95 to 0.


title: Understanding Inconsistency in Azure Cosmos DB with TLA+

abstract: Beyond implementation correctness of a distributed system, it is equally important to understand exactly what users should expect to see from that system. Even if the system itself works as designed, insufficient understanding of its user-visible semantics can cause bugs in its dependencies. By focusing a formal specification effort on precisely defining the expected user-facing behaviors of the Azure Cosmos DB service at Microsoft, we were able to write a formal specification of the database that was significantly smaller and conceptually simpler than any other specification of Cosmos DB, while representing a wider range of valid user-observable behaviors than existing more detailed specifications. Many of the additional behaviors we documented were previously poorly understood outside of the Cosmos DB development team, even informally, leading to data consistency errors in Microsoft products that depend on it. Using this model, we were able to raise two key issues in Cosmos DB's public-facing documentation, which have since been addressed. We were also able to offer a fundamental solution to a previous high-impact outage within another Azure service that depends on Cosmos DB.


title: Analyzing Privacy Leakage in Machine Learning via Multiple Hypothesis Testing: A Lesson From Fano

abstract: Differential privacy (DP) is by far the most widely accepted framework for mitigating privacy risks in machine learning. However, exactly how small the privacy parameter $\epsilon$ needs to be to protect against certain privacy risks in practice is still not well-understood. In this work, we study data reconstruction attacks for discrete data and analyze it under the framework of multiple hypothesis testing. We utilize different variants of the celebrated Fano's inequality to derive upper bounds on the inferential power of a data reconstruction adversary when the model is trained differentially privately. Importantly, we show that if the underlying private data takes values from a set of size $M$, then the target privacy parameter $\epsilon$ can be $O(\log M)$ before the adversary gains significant inferential power. Our analysis offers theoretical evidence for the empirical effectiveness of DP against data reconstruction attacks even at relatively large values of $\epsilon$.


title: Technical Report: Implementation of Single Packet Number Space in Multi-Path QUIC

abstract: Over the past few of years, we have witnessed increasing interests in the use cases of multi-path QUIC from both industry and academia. For example, Alibaba deployed XLINK, a QoE-driven multi-path QUIC solution, in Taobao short video and showed benefits in both reduced tail latency and video re-buffering. For the time being, the multi-path QUIC protocol is in the process of standardization at the IETF QUIC working group, with the draft recently updated to version 02. The focus of the draft is to provide basic guidance on the implementation so that we can encourage more exploration, testing, and finally, an accelerated adoption of this technology. However, draft-02 has brought up an open issue on whether the multi-path QUIC should be implemented using single packet number space (SPNS) or multiple packet number space (MPNS), as in the current draft, both options co-exist. Knowing that one cannot draw a solid conclusion without experiments, we implement both SPNS and MPNS at Alibaba and measured their performance. The goal is to help the community better understand the implication, and we hope this report can be a useful resource for engineers and researchers who are interested in deploying multi-path QUIC.


title: Mitigating Gender Bias in Face Recognition Using the von Mises-Fisher Mixture Model

abstract: In spite of the high performance and reliability of deep learning algorithms in a wide range of everyday applications, many investigations tend to show that a lot of models exhibit biases, discriminating against specific subgroups of the population (e.g. gender, ethnicity). This urges the practitioner to develop fair systems with a uniform/comparable performance across sensitive groups. In this work, we investigate the gender bias of deep Face Recognition networks. In order to measure this bias, we introduce two new metrics, $\mathrm{BFAR}$ and $\mathrm{BFRR}$, that better reflect the inherent deployment needs of Face Recognition systems. Motivated by geometric considerations, we mitigate gender bias through a new post-processing methodology which transforms the deep embeddings of a pre-trained model to give more representation power to discriminated subgroups. It consists in training a shallow neural network by minimizing a Fair von Mises-Fisher loss whose hyperparameters account for the intra-class variance of each gender. Interestingly, we empirically observe that these hyperparameters are correlated with our fairness metrics. In fact, extensive numerical experiments on a variety of datasets show that a careful selection significantly reduces gender bias. The code used for the experiments can be found at https://github.com/JRConti/EthicalModule_vMF.


title: Edge of Infinity: The Clash between Edge Effect and Infinity Assumption for the Distribution of Charge on a Conducting Plate

abstract: We re-examine a familiar problem given in introductory physics courses, about determining the induced charge distribution on an uncharged ``infinitely-large'' conducting plate when placing parallel to it a uniform charged dielectric plate of the same size. We show that, no matter how large the plates are, the edge effect will always be strong enough to influence the charge distribution deep in the central region, which totally destroyed the infinity assumption (that the surface charge densities on the two sides are uniform and of opposite magnitudes). For a more detailed analysis, we solve Poisson's equation for a similar setting in two-dimensional space and obtain the exact charge distribution, helping us to understand what happens how charge distributes at the central, the asymptotic, and the edge regions.


title: High-energy properties of the graviton scattering in quadratic gravity

abstract: We obtain the matter-graviton scattering amplitude in the gravitational theory of quadratic curvature, which has $R_{\mu\nu}^2$ term in the action. Unitarity bound is not satisfied because of the existence of negative norm states, while an analog of unitarity bound for $S$-matrix unitarity holds due to the cancelation among the positive norm states and negative norm ones in the unitarity summation in the optical theorem. The violation of unitarity bound is a counter example of Llewellyn Smith's conjecture on the relation between tree-level unitarity and renormalizability. We have recently proposed a new conjecture that an analog of the unitarity bound for $S$-matrix unitarity gives the equivalent conditions to those for renormalizability. We show that the gravitational theory of quadratic curvature is a nontrivial example consistent with our conjecture.


title: Experimental observations of fractal landscape dynamics in a dense emulsion

abstract: Many soft and biological materials display so-called 'soft glassy' dynamics; their constituents undergo anomalous random motions and complex cooperative rearrangements. A recent simulation model of one soft glassy material, a coarsening foam, suggested that the random motions of its bubbles are due to the system configuration moving over a fractal energy landscape in high-dimensional space. Here we show that the salient geometrical features of such high-dimensional fractal landscapes can be explored and reliably quantified, using empirical trajectory data from many degrees of freedom, in a model-free manner. For a mayonnaise-like dense emulsion, analysis of the observed trajectories of oil droplets quantitatively reproduces the high-dimensional fractal geometry of the configuration path and its associated energy minima generated using a computational model. That geometry in turn drives the droplets' complex random motion observed in real space. Our results indicate that experimental studies can elucidate whether the similar dynamics in different soft and biological materials may also be due to fractal landscape dynamics.


title: ConnectedUNets++: Mass Segmentation from Whole Mammographic Images

abstract: Deep learning has made a breakthrough in medical image segmentation in recent years due to its ability to extract high-level features without the need for prior knowledge. In this context, U-Net is one of the most advanced medical image segmentation models, with promising results in mammography. Despite its excellent overall performance in segmenting multimodal medical images, the traditional U-Net structure appears to be inadequate in various ways. There are certain U-Net design modifications, such as MultiResUNet, Connected-UNets, and AU-Net, that have improved overall performance in areas where the conventional U-Net architecture appears to be deficient. Following the success of UNet and its variants, we have presented two enhanced versions of the Connected-UNets architecture: ConnectedUNets+ and ConnectedUNets++. In ConnectedUNets+, we have replaced the simple skip connections of Connected-UNets architecture with residual skip connections, while in ConnectedUNets++, we have modified the encoder-decoder structure along with employing residual skip connections. We have evaluated our proposed architectures on two publicly available datasets, the Curated Breast Imaging Subset of Digital Database for Screening Mammography (CBIS-DDSM) and INbreast.


title: Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing

abstract: Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of LLMs in the realm of computer-assisted creativity, we aim to study if LLMs can improve the quality of user-generated content through collaboration. We present CoPoet, a collaborative poetry writing system. In contrast to auto-completing a user's text, CoPoet is controlled by user instructions that specify the attributes of the desired text, such as Write a sentence about `love' or Write a sentence ending in `fly'. The core component of our system is a language model fine-tuned on a diverse collection of instructions for poetry writing. Our model is not only competitive with publicly available LLMs trained on instructions (InstructGPT), but is also capable of satisfying unseen compositional instructions. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from Monarchy to Climate change. Further, the collaboratively written poems are preferred by third-party evaluators over those written without the system.


title: Simplified State Storage Rent for EVM Blockchains

abstract: Uncontrolled growth of blockchain state can adversely affect client performance, decentralization and security. Previous attempts to introduce duration-based state storage pricing or 'storage rent' in Ethereum have stalled, partly because of complexity. We present a new approach with finer granularity to "spread" rent payments across peers. Our proposal shifts the burden of state rent from accounts to transaction senders in a quasi-random manner. This proposal offers a simple path for initial adoption on Ethereum Virtual Machine (EVM) compatible chains, and serve as a foundation to address remaining challenges.


title: Extreme Measures in Continuous Time Conic Finace

abstract: Dynamic spectral risk measures define a claim's valuation bounds as supremum and infimum of expectations of the claim's payoff over a dominated set of measures. The measures at which such extrema are attained are called extreme measures. We determine explicit expressions for their Radon-Nykodim derivatives with respect to the common dominating measure. Based on the formulas found, we estimate the extreme measures in two cases. First, the dominating measure is calibrated to mid prices of options and valuation bounds are given by options bid and ask prices. Second, the dominating measure is estimated from historical mid equity prices and valuation bounds are given by historical 5-day high and low prices. In both experiments, we find that the market determines upper bounds by testing scenarios in which losses are significantly lower than expected under the dominating measure, while lower bounds by ones in which gains are only slightly lower than in the base case.


title: Feng-Shui Compass: A Modern Exploration of Traditional Chinese Environmental Analysis

abstract: The technological advancement in data analysis and sensor technology has contributed to a growth in knowledge of the surrounding environments. Feng Shui, the Chinese philosophy of evaluating a certain environment and how it influences human well-being, can only be determined by self-claimed specialists for the past thousands of years. We developed a device as well as a procedure to evaluate the ambient environment of a room to perform a study that attempts to use sensor data to predict the well-being score of a person in that environment, therefore evaluating the primary aspect of Feng Shui. Our study revealed preliminary results showing great potential for further research with larger experiments.


title: Evaluating Parameter Efficient Learning for Generation

abstract: Parameter efficient learning methods (PERMs) have recently gained significant attention as they provide an efficient way for pre-trained language models (PLMs) to adapt to a downstream task. However, these conclusions are mostly drawn from in-domain evaluations over the full training set. In this paper, we present comparisons between PERMs and finetuning from three new perspectives: (1) the effect of sample and model size to in-domain evaluations, (2) generalization to unseen domains and new datasets, and (3) the faithfulness of generations. Our results show that for in-domain settings (a) there is a cross point of sample size for which PERMs will perform better than finetuning when training with fewer samples, and (b) larger PLMs have larger cross points. For cross-domain and cross-dataset cases, we show that (a) Adapter (Houlsby et al., 2019) performs the best amongst all the PERMs studied here, and (b) it outperforms finetuning if the task dataset is below a certain size. We also compare the faithfulness of generations and show that PERMs can achieve better faithfulness score than finetuning, especially for small training set, by as much as 6%. Finally, we apply Adapter to MT-NLG 530b (Smith et al., 2022) and achieve new state-of-the-art results on Xsum (Narayan et al., 2018) for all ROUGE scores (ROUGE-1 49.17, ROUGE-2 27.20, ROUGE-L 40.98).


title: Halting Migration in Magnetospherically Sculpted Protoplanetary Disks

abstract: We present a physically motivated model for the manner in which a stellar magnetic field sculpts the inner edge of a protoplanetary disk, and examine the consequence for the migration and stopping of sub-Neptune and super-Earth planets. This model incorporates a transition zone exterior to the inner truncation of the disk, where the surface density profile is modified by the diffusion of the stellar magnetic field into the disk. This modification results in a migration trap at the outer edge of the transition zone. We performed simulations of single planet migration, considering a range of stellar magnetic field strengths and magnetic diffusion profiles. Our simulations show a tight relationship between the final locations of planets and the total magnetic budget available for the disk from their host star. We found that a stellar magnetic field between 67 to 180G and a power-law index between 3 and 2.75 can reasonably reproduce the location at which the observed occurrence rate of close-in Super-Earth and Sub-Neptune populations changes slope.


title: Galois descent for motives: the K3 case

abstract: A theorem of Grothendieck tells us that if the Galois action on the Tate module of an abelian variety factors through a smaller field, then the abelian variety, up to isogeny and finite extension of the base, is itself defined over the smaller field. Inspired by this, we give a Galois descent datum for a motive $H$ over a field by asking that the Galois action on an $\ell$-adic realisation factor through a smaller field. We conjecture that this descent datum is effective, that is if a motive $H$ satisfies the above criterion, then it must itself descend to the smaller field. We prove this conjecture for K3 surfaces, under some hypotheses. The proof is based on Madapusi-Pera's extension of the Kuga-Satake construction to arbitrary characteristic.


title: Computing Medial Axis Transform with Feature Preservation via Restricted Power Diagram

abstract: We propose a novel framework for computing the medial axis transform of 3D shapes while preserving their medial features via restricted power diagram (RPD). Medial features, including external features such as the sharp edges and corners of the input mesh surface and internal features such as the seams and junctions of medial axis, are important shape descriptors both topologically and geometrically. However, existing medial axis approximation methods fail to capture and preserve them due to the fundamentally under-sampling in the vicinity of medial features, and the difficulty to build their correct connections. In this paper we use the RPD of medial spheres and its affiliated structures to help solve these challenges. The dual structure of RPD provides the connectivity of medial spheres. The surface restricted power cell (RPC) of each medial sphere provides the tangential surface regions that these spheres have contact with. The connected components (CC) of surface RPC give us the classification of each sphere, to be on a medial sheet, a seam, or a junction. They allow us to detect insufficient sphere sampling around medial features and develop necessary conditions to preserve them. Using this RPD-based framework, we are able to construct high quality medial meshes with features preserved. Compared with existing sampling-based or voxel-based methods, our method is the first one that can preserve not only external features but also internal features of medial axes.


title: Spectral-weight sum rules for the hadronic vacuum polarization

abstract: We develop a number of sum rules comparing spectral integrals involving judiciously chosen weights to integrals over the corresponding Euclidean two-point function. The applications we have in mind are to the hadronic vacuum polarization that determines the most important hadronic correction $a_\mu^{\rm HVP}$ to the muon anomalous magnetic moment. First, we point out how spectral weights may be chosen that emphasize narrow regions in $\sqrt{s}$, providing a tool to investigate emerging discrepancies between data-driven and lattice determinations of $a_\mu^{\rm HVP}$. Alternatively, for a narrow region around the $\rho$ mass, they may allow for a comparison of the dispersive determination of $a_\mu^{\rm HVP}$ with lattice deteruminations zooming in on the region of the well-known BaBar-KLOE discrepancy. Second, we show how such sum rules can in principle be used for carrying out precision comparisons of hadronic-$\tau$-decay-based data and $e^+e^-\to\mbox{hadrons}(\gamma)$-based data, where lattice computations can provide the necessary isospin-breaking corrections.


title: Bridging the Training-Inference Gap for Dense Phrase Retrieval

abstract: Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not exactly reflect the retrieval scenario at inference time. In this paper, we explore how the gap between training and inference in dense retrieval can be reduced, focusing on dense phrase retrieval (Lee et al., 2021) where billions of representations are indexed at inference. Since validating every dense retriever with a large-scale index is practically infeasible, we propose an efficient way of validating dense retrievers using a small subset of the entire corpus. This allows us to validate various training strategies including unifying contrastive loss terms and using hard negatives for phrase retrieval, which largely reduces the training-inference discrepancy. As a result, we improve top-1 phrase retrieval accuracy by 2~3 points and top-20 passage retrieval accuracy by 2~4 points for open-domain question answering. Our work urges modeling dense retrievers with careful consideration of training and inference via efficient validation while advancing phrase retrieval as a general solution for dense retrieval.


title: Spectral Excision and Descent for Almost Perfect Complexes

abstract: We show that almost perfect complexes of commutative ring spectra satisfy excision and $v$-descent. These results generalize Milnor excision for perfect complexes of ordinary commutative rings and $v$-descent for almost perfect complexes of locally noetherian derived stacks by Halpern-Leistner and Preygel, respectively.


title: On the Generation, Structure, and Symmetries of Minimal Prime Graphs

abstract: In this paper we continue the study of prime graphs of finite solvable groups. The prime graph, or Gruenberg-Kegel graph, of a finite group G has vertices consisting of the prime divisors of the order of G and an edge from primes p to q if and only if G contains an element of order pq. Since the discovery of a simple, purely graph theoretical characterization of the prime graphs of solvable groups in 2015 these graphs have been studied in more detail from a graph theoretic angle. In this paper we explore several new aspects of these graphs. We characterize regular reseminant graphs and study the automorphisms of reseminant graphs for arbitrary base graphs. We then study minimal prime graphs on larger vertex sets by a novel regular graph construction for base graphs and by proving results on prime graph properties under graph products. Lastly, we present the first new way, different from vertex duplication, to obtain a new minimal prime graph from a given minimal prime graph.


title: BSDF Importance Baking: A Lightweight Neural Solution to Importance Sampling General Parametric BSDFs

abstract: Parametric Bidirectional Scattering Distribution Functions (BSDFs) are pervasively used because of their flexibility to represent a large variety of material appearances by simply tuning the parameters. While efficient evaluation of parametric BSDFs has been well-studied, high-quality importance sampling techniques for parametric BSDFs are still scarce. Existing sampling strategies either heavily rely on approximations, resulting in high variance, or solely perform sampling on a portion of the whole BSDF slice. Moreover, many of the sampling approaches are specifically paired with certain types of BSDFs. In this paper, we seek an efficient and general way for importance sampling parametric BSDFs. We notice that the nature of importance sampling is the mapping between a uniform distribution and the target distribution. Specifically, when BSDF parameters are given, the mapping that performs importance sampling on a BSDF slice can be simply recorded as a 2D image that we name as importance map. Following this observation, we accurately precompute the importance maps using a mathematical tool named optimal transport. Then we propose a lightweight neural network to efficiently compress the precomputed importance maps. In this way, we have brought parametric BSDF important sampling to the precomputation stage, avoiding heavy runtime computation. Since this process is similar to light baking where a set of images are precomputed, we name our method importance baking. Together with a BSDF evaluation network and a PDF (probability density function) query network, our method enables full multiple importance sampling (MIS) without any revision to the rendering pipeline. Our method essentially performs perfect importance sampling. Compared with previous methods, we demonstrate reduced noise levels on rendering results with a rich set of appearances.


title: Musings on the HashGraph Protocol: Its Security and Its Limitations

abstract: The HashGraph Protocol is a Byzantine fault tolerant atomic broadcast protocol. Its novel use of locally stored metadata allows parties to recover a consistent ordering of their log just by examining their local data, removing the need for a voting protocol. Our paper's first contribution is to present a rewritten proof of security for the HashGraph Protocol that follows the consistency and liveness paradigm used in the atomic broadcast literature. In our second contribution, we show a novel adversarial strategy that stalls the protocol from committing data to the log for an expected exponential number of rounds. This proves tight the exponential upper bound conjectured in the original paper. We believe that our proof of security will make it easier to compare HashGraph with other atomic broadcast protocols and to incorporate its ideas into new constructions. We also believe that our attack might inspire more research into similar attacks for other DAG-based atomic broadcast protocols.


title: Bayesian Methods in Automated Vehicle's Car-following Uncertainties: Enabling Strategic Decision Making

abstract: This paper proposes a methodology to estimate uncertainty in automated vehicle (AV) dynamics in real time via Bayesian inference. Based on the estimated uncertainty, the method aims to continuously monitor the car-following (CF) performance of the AV to support strategic actions to maintain a desired performance. Our methodology consists of three sequential components: (i) the Stochastic Gradient Langevin Dynamics (SGLD) is adopted to estimate parameter uncertainty relative to vehicular dynamics in real time, (ii) dynamic monitoring of car-following stability (local and string-wise), and (iii) strategic actions for control adjustment if anomaly is detected. The proposed methodology provides means to gauge AV car-following performance in real time and preserve desired performance against real time uncertainty that are unaccounted for in the vehicle control algorithm.


title: Reliability of Ideal Indexes

abstract: The Fisher and GEKS are celebrated as ideal bilateral and multilateral indexes due to their superior axiomatic and econ-theoretic properties. The Fisher index is the main index used for constructing CPI by statistical agencies and the GEKS is the index used for compiling PPPs in World Bank's International Comparison Program (ICP). Despite such a high status and the importance attached to these indexes, the stochastic approach to these indexes is not well-developed and no measures of reliability exist for these important economic statistics. The main objective of this paper is to fill this gap. We show how appropriate reliability measures for the Fisher and GEKS indexes, and other ideal price index numbers can be derived and how they should be interpreted and used in practice. In an application to 2017 ICP data on a sample of 173 countries, we estimate the Fisher and GEKS indexes along with their reliability measures, make comparisons with several other notable indexes and discuss the implications.


title: Spin filtering effect in intrinsic 2D magnetic semiconductor Cr2Ge2Te6

abstract: All van der Waals (vdW) Fe3GeTe2/Cr2Ge2Te6/graphite magnetic heterojunctions have been fabricated via mechanical exfoliation and stacking, and their magnetotransport properties are studied in detail. At low bias voltages large negative junction magnetoresistances have been observed and are attributed to spin-conserving tunneling transport across the insulating Cr2Ge2Te6 layer. With increasing bias, a crossover to Fowler-Nordheim tunneling takes place. The negative sign of the tunneling magnetoresistance (TMR) suggests that the bottom of conduction band in Cr2Ge2Te6 belongs to minority spins, opposite to the findings of some first-principles calculations. This work shows that the vdW heterostructures based on 2D magnetic insulators are a valuable platform to gain further insight into spin polarized tunneling transport, which is the basis for pursuing high performance spintronic devices and a large variety of quantum phenomena.


title: FedGRec: Federated Graph Recommender System with Lazy Update of Latent Embeddings

abstract: Recommender systems are widely used in industry to improve user experience. Despite great success, they have recently been criticized for collecting private user data. Federated Learning (FL) is a new paradigm for learning on distributed data without direct data sharing. Therefore, Federated Recommender (FedRec) systems are proposed to mitigate privacy concerns to non-distributed recommender systems. However, FedRec systems have a performance gap to its non-distributed counterpart. The main reason is that local clients have an incomplete user-item interaction graph, thus FedRec systems cannot utilize indirect user-item interactions well. In this paper, we propose the Federated Graph Recommender System (FedGRec) to mitigate this gap. Our FedGRec system can effectively exploit the indirect user-item interactions. More precisely, in our system, users and the server explicitly store latent embeddings for users and items, where the latent embeddings summarize different orders of indirect user-item interactions and are used as a proxy of missing interaction graph during local training. We perform extensive empirical evaluations to verify the efficacy of using latent embeddings as a proxy of missing interaction graph; the experimental results show superior performance of our system compared to various baselines. A short version of the paper is presented in \href{https://federated-learning.org/fl-neurips-2022/}{the FL-NeurIPS'22 workshop}.


title: Implicit Biases in Refereeing: Lessons from NBA Referees

abstract: Implicit biases occur automatically and unintentionally and are particularly present when we have to make split second decisions. One such situations appears in refereeing, where referees have to make an instantaneous decision on a potential violation. In this work we revisit and extend some of the existing work on implicit biases in refereeing. In particular, we focus on refereeing in the NBA and examine three different types of implicit bias; (i) home-vs-away bias, (ii) bias towards individual players or teams, and, (iii) racial bias. For our study, we use play-by-play data and data from the Last Two Minutes reports the league office releases for games that were within 5 points in the last 2 minutes since the 2015 season. Our results indicate that the there is a bias towards the home team - particularly pronounced during the playoffs - but it has been reduced since the COVID-19 pandemic. Furthermore, there is robust statistical evidence that specific players benefit from referee decisions more than expected from pure chance. However, we find no evidence of negative bias towards individual players, or towards specific teams. Finally, our analysis on racial bias indicates the absence of any bias.


title: Multi-party quantum private comparison of size relationship with two third parties based on d-dimensional Bell states

abstract: In this paper, we put forward a multi-party quantum private comparison (MQPC) protocol with two semi-honest third parties (TPs) by adopting d-dimensional Bell states, which can judge the size relationship of private integers from more than two users within one execution of protocol. Each TP is permitted to misbehave on her own but cannot collude with others. In the proposed MQPC protocol, TPs are only required to apply d-dimensional single-particle measurements rather than d-dimensional Bell state measurements. There are no quantum entanglement swapping and unitary operations required in the proposed MQPC protocol. The security analysis validates that the proposed MQPC protocol can resist both the outside attacks and the participant attacks. The proposed MQPC protocol is adaptive for the case that users want to compare the size relationship of their private integers under the control of two supervisors. Furthermore, the proposed MQPC protocol can be used in the strange user environment, because there are not any communication and pre-shared key between each pair of users.


title: Embedded Design of Automatic Pesticide Spraying Robot Control System

abstract: In agriculture, crops need to apply pesticide spraying flow control precisely to reduce costs, protect the environment, and increase yield production. Although there have several variable control methods for spraying flow control because indirect control flow techniques and having a slow response could cause inaccuracy and mismanagement, also noted that those systems also suffer from complicated design and debugging, etc. In this paper, an embedded design of the fuzzy PID variable spraying control method is adopted. The experimental results show that the overshoot of Proportional Integral Derivative (PID) control is 10.76%, and the overshoot of fuzzy PID control is 7.17% which can meet the requirements of an advanced spray control flow system. For further investigation, a novel spray flow control method based on Programmable Logic Control (PLC) is proposed in this paper.


title: Highly Efficient Real-Time Streaming and Fully On-Device Speaker Diarization with Multi-Stage Clustering

abstract: While recent research advances in speaker diarization mostly focus on improving the quality of diarization results, there is also an increasing interest in improving the efficiency of diarization systems. In this paper, we demonstrate that a multi-stage clustering strategy that uses different clustering algorithms for input of different lengths can address multi-faceted challenges of on-device speaker diarization applications. Specifically, a fallback clusterer is used to handle short-form inputs; a main clusterer is used to handle medium-length inputs; and a pre-clusterer is used to compress long-form inputs before they are processed by the main clusterer. Both the main clusterer and the pre-clusterer can be configured with an upper bound of the computational complexity to adapt to devices with different resource constraints. This multi-stage clustering strategy is critical for streaming on-device speaker diarization systems, where the budgets of CPU, memory and battery are tight.


title: First Measurement of $\Lambda$ Electroproduction off Nuclei in the Current and Target Fragmentation Regions

abstract: We report results of $\Lambda$ hyperon production in semi-inclusive deep-inelastic scattering off deuterium, carbon, iron, and lead targets obtained with the CLAS detector and the Continuous Electron Beam Accelerator Facility 5.014~GeV electron beam. These results represent the first measurements of the $\Lambda$ multiplicity ratio and transverse momentum broadening as a function of the energy fraction~($z$) in the current and target fragmentation regions. The multiplicity ratio exhibits a strong suppression at high~$z$~and~an enhancement at~low~$z$. The measured transverse momentum broadening is an order of magnitude greater than that seen for light mesons. This indicates that the propagating entity interacts very strongly with the nuclear medium, which suggests that propagation of diquark configurations in the nuclear medium takes place at least part of the time, even at high~$z$. The trends of these results are qualitatively described by the Giessen Boltzmann-Uehling-Uhlenbeck transport model, particularly for the multiplicity ratios. These observations will potentially open a new era of studies of the structure of the nucleon as well as of strange baryons.


title: Sequential Decision Making on Unmatched Data using Bayesian Kernel Embeddings

abstract: The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given context and an action taken by an agent. In contrast to Bayesian optimization, the arguments of the function are not under agent's control, but are indirectly determined by the agent's action based on a given context. If the information of the features is to be included in the maximization problem, the full conditional distribution of such features, rather than its expectation only, needs to be accounted for. Furthermore, the function is itself unknown, only counting with noisy observations of such function, and potentially requiring the use of unmatched data sets. We propose a novel algorithm for the aforementioned problem which takes into consideration the uncertainty derived from the estimation of both the conditional distribution of the features and the unknown function, by modeling the former as a Bayesian conditional mean embedding and the latter as a Gaussian process. Our algorithm empirically outperforms the current state-of-the-art algorithm in the experiments conducted.


title: XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing

abstract: In-context learning using large language models has recently shown surprising results for semantic parsing tasks such as Text-to-SQL translation. Prompting GPT-3 or Codex using several examples of question-SQL pairs can produce excellent results, comparable to state-of-the-art finetuning-based models. However, existing work primarily focuses on English datasets, and it is unknown whether large language models can serve as competitive semantic parsers for other languages. To bridge this gap, our work focuses on cross-lingual Text-to-SQL semantic parsing for translating non-English utterances into SQL queries based on an English schema. We consider a zero-shot transfer learning setting with the assumption that we do not have any labeled examples in the target language (but have annotated examples in English). This work introduces the XRICL framework, which learns to retrieve relevant English exemplars for a given query to construct prompts. We also include global translation exemplars for a target language to facilitate the translation process for large language models. To systematically evaluate our model, we construct two new benchmark datasets, XSpider and XKaggle-dbqa, which include questions in Chinese, Vietnamese, Farsi, and Hindi. Our experiments show that XRICL effectively leverages large pre-trained language models to outperform existing baselines. Data and code are publicly available at https://github.com/Impavidity/XRICL.


title: Worst-Case Adaptive Submodular Cover

abstract: In this paper, we study the adaptive submodular cover problem under the worst-case setting. This problem generalizes many previously studied problems, namely, the pool-based active learning and the stochastic submodular set cover. The input of our problem is a set of items (e.g., medical tests) and each item has a random state (e.g., the outcome of a medical test), whose realization is initially unknown. One must select an item at a fixed cost in order to observe its realization. There is an utility function which maps a subset of items and their states to a non-negative real number. We aim to sequentially select a group of items to achieve a ``target value'' while minimizing the maximum cost across realizations (a.k.a. worst-case cost). To facilitate our study, we assume that the utility function is \emph{worst-case submodular}, a property that is commonly found in many machine learning applications. With this assumption, we develop a tight $(\log (Q/\eta)+1)$-approximation policy, where $Q$ is the ``target value'' and $\eta$ is the smallest difference between $Q$ and any achievable utility value $\hat{Q}<Q$. We also study a worst-case maximum-coverage problem, a dual problem of the minimum-cost-cover problem, whose goal is to select a group of items to maximize its worst-case utility subject to a budget constraint. To solve this problem, we develop a $(1-1/e)/2$-approximation solution.


title: Structure-based Drug Design with Equivariant Diffusion Models

abstract: Structure-based drug design (SBDD) aims to design small-molecule ligands that bind with high affinity and specificity to pre-determined protein targets. In this paper, we formulate SBDD as a 3D-conditional generation problem and present DiffSBDD, an SE(3)-equivariant 3D-conditional diffusion model that generates novel ligands conditioned on protein pockets. Comprehensive in silico experiments demonstrate the efficiency and effectiveness of DiffSBDD in generating novel and diverse drug-like ligands with competitive docking scores. We further explore the flexibility of the diffusion framework for a broader range of tasks in drug design campaigns, such as off-the-shelf property optimization and partial molecular design with inpainting.


title: DEVILS: Cosmic evolution of SED-derived metallicities and their connection to star-formation histories

abstract: Gas-phase metallicities of galaxies are typically measured through auroral or nebular emission lines, but metallicity also leaves an imprint on the overall spectral energy distribution (SED) of a galaxy and can be estimated through SED fitting. We use the ProSpect SED fitting code with a flexible parametric star formation history and an evolving metallicity history to self-consistently measure metallicities, stellar mass, and other galaxy properties for $\sim90\,000$ galaxies from the Deep Extragalactic VIsible Legacy Survey (DEVILS) and Galaxy and Mass Assembly (GAMA) survey. We use these to trace the evolution of the mass-metallicity relation (MZR) and show that the MZR only evolves in normalisation by $\sim0.1\,$dex at stellar mass $M_\star = 10^{10.5}\,M_\odot$. We find no difference in the MZR between galaxies with and without SED evidence of active galactic nuclei emission at low redshifts ($z<0.3$). Our results suggest an anti-correlation between metallicity and star formation activity at fixed stellar mass for galaxies with $M_\star > 10^{10.5}\,M_\odot$ for $z<0.3$. Using the star formation histories extracted using ProSpect we explore higher-order correlations of the MZR with properties of the star formation history including age, width, and shape. We find that at a given stellar mass, galaxies with higher metallicities formed most of their mass over shorter timescales, and before their peak star formation rate. This work highlights the value of exploring the connection of a galaxy's current gas-phase metallicity to its star formation history in order to understand the physical processes shaping the MZR.


title: Exotic Compact Objects with Two Dark Matter Fluids

abstract: The generic properties of compact objects made of two different fluids of dark matter are studied in a scale invariant approach. We investigate compact objects with a core-shell structure, where the two fluids are separated, and with mixed dark matter components, where both dark matter fluids are immersed within each other. The constellations considered are combinations of incompressible fluids, free and interacting Fermi gases, and equations of state with a vacuum term, i.e. self-bound dark matter. We find novel features in the mass-radius relations for combined dark matter compact objects which distinguishes them from compact objects with a single dark matter fluid and compact stars made of ordinary baryonic matter, as white dwarfs, neutron stars and quark stars. The maximum compactness of certain combined dark matter stars can reach values up to the causality limit for compact stars but not beyond that limit if causality of the dark matter fluids is ensured.


title: Study of Differential Scattering Cross-section using Yukawa term of medium-modified Cornell potential

abstract: In the present work we have studied the Differential Scattering Cross-section for ground states of charmonium and bottomonium in the frame work of the medium modified form of quark-antiquark potential and Born-approximation using the non-relativistic quantum chromo-dynamics approach. To reach this end, quasi-particle (QP) Debye mass depending upon baryonic chemical potential ($\mu$b) and temperature has been employed and hence the variation of Differential Scattering Cross-section with baryonic chemical potential and temperature at fixed value of the scattering angle ($\theta=90^\circ$) has been studied. The variation of Differential Scattering Cross-section with scattering angle $\theta$ (in degree) at fixed temperature and baryonic chemical potential has also been studied. We have also studied the effect of impact parameter and transverse momentum on differential scattering cross-section at $\theta=90^\circ$.


title: Log normal claim models with common shocks

abstract: This paper is concerned with modelling multiple claim arrays that are subject to one or more common shocks. It uses a structure that involves very general forms both idiosyncratic and common shock components of cell means. The dependencies between arrays, or between cells within an array, generated by the shocks are also of very general form. All of this appears in the prior literature, where the idiosyncratic and shock components are additive. This has created the awkwardness of unbalanced shocks. The present paper rectifies this by defining these components as multiplicative. Observations in individuals cells of claim arrays are assumed log normal (later log Tweedie) in order to accommodate the multiplicativity. Conveniently, the log normal case reduced parameter estimation to linear regression, yielding closed form solution of location parameters, and even of dispersion parameters in some cases.


title: Does Joint Training Really Help Cascaded Speech Translation?

abstract: Currently, in speech translation, the straightforward approach - cascading a recognition system with a translation system - delivers state-of-the-art results. However, fundamental challenges such as error propagation from the automatic speech recognition system still remain. To mitigate these problems, recently, people turn their attention to direct data and propose various joint training methods. In this work, we seek to answer the question of whether joint training really helps cascaded speech translation. We review recent papers on the topic and also investigate a joint training criterion by marginalizing the transcription posterior probabilities. Our findings show that a strong cascaded baseline can diminish any improvements obtained using joint training, and we suggest alternatives to joint training. We hope this work can serve as a refresher of the current speech translation landscape, and motivate research in finding more efficient and creative ways to utilize the direct data for speech translation.


title: Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidence

abstract: Question answering models can use rich knowledge sources -- up to one hundred retrieved passages and parametric knowledge in the large-scale language model (LM). Prior work assumes information in such knowledge sources is consistent with each other, paying little attention to how models blend information stored in their LM parameters with that from retrieved evidence documents. In this paper, we simulate knowledge conflicts (i.e., where parametric knowledge suggests one answer and different passages suggest different answers) and examine model behaviors. We find retrieval performance heavily impacts which sources models rely on, and current models mostly rely on non-parametric knowledge in their best-performing settings. We discover a troubling trend that contradictions among knowledge sources affect model confidence only marginally. To address this issue, we present a new calibration study, where models are discouraged from presenting any single answer when presented with multiple conflicting answer candidates in retrieved evidences.


title: DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality

abstract: Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to transfer to the real world due to the gap between simulation and reality. In this paper, we present our techniques to train a) a policy that can perform robust dexterous manipulation on an anthropomorphic robot hand and b) a robust pose estimator suitable for providing reliable real-time information on the state of the object being manipulated. Our policies are trained to adapt to a wide range of conditions in simulation. Consequently, our vision-based policies significantly outperform the best vision policies in the literature on the same reorientation task and are competitive with policies that are given privileged state information via motion capture systems. Our work reaffirms the possibilities of sim-to-real transfer for dexterous manipulation in diverse kinds of hardware and simulator setups, and in our case, with the Allegro Hand and Isaac Gym GPU-based simulation. Furthermore, it opens up possibilities for researchers to achieve such results with commonly-available, affordable robot hands and cameras. Videos of the resulting policy and supplementary information, including experiments and demos, can be found at https://dextreme.org/