title: An active learning approach for improving the performance of equilibrium based chemical simulations

abstract: In this paper, we propose a novel sequential data-driven method for dealing with equilibrium based chemical simulations, which can be seen as a specific machine learning approach called active learning. The underlying idea of our approach is to consider the function to estimate as a sample of a Gaussian process which allows us to compute the global uncertainty on the function estimation. Thanks to this estimation and with almost no parameter to tune, the proposed method sequentially chooses the most relevant input data at which the function to estimate has to be evaluated to build a surrogate model. Hence, the number of evaluations of the function to estimate is dramatically limited. Our active learning method is validated through numerical experiments and applied to a complex chemical system commonly used in geoscience.


title: DBI Inflation and Warped Black Holes

abstract: We study a possible amplification mechanism for the curvature perturbations generated during inflation by a Dirac-Born-Infeld (DBI) inflaton in the presence of a sharp feature in the warp factor. The large growth resulting in the scalar power spectrum is a consequence of the decreasing speed of sound. We obtain analytical approximate expressions for the relevant dynamical quantities both in the slow roll phase and during the transient phase which leads to the amplification. We finally compare our approximations to the exact numerical evolution and give, in such a context, the general rules for building a viable inflationary model leading to, during the subsequent radiation dominated era, an abundant primordial black holes formation.


title: Hand Me Your PIN! Inferring ATM PINs of Users Typing with a Covered Hand

abstract: Automated Teller Machines (ATMs) represent the most used system for withdrawing cash. The European Central Bank reported more than 11 billion cash withdrawals and loading/unloading transactions on the European ATMs in 2019. Although ATMs have undergone various technological evolutions, Personal Identification Numbers (PINs) are still the most common authentication method for these devices. Unfortunately, the PIN mechanism is vulnerable to shoulder-surfing attacks performed via hidden cameras installed near the ATM to catch the PIN pad. To overcome this problem, people get used to covering the typing hand with the other hand. While such users probably believe this behavior is safe enough to protect against mentioned attacks, there is no clear assessment of this countermeasure in the scientific literature. This paper proposes a novel attack to reconstruct PINs entered by victims covering the typing hand with the other hand. We consider the setting where the attacker can access an ATM PIN pad of the same brand/model as the target one. Afterward, the attacker uses that model to infer the digits pressed by the victim while entering the PIN. Our attack owes its success to a carefully selected deep learning architecture that can infer the PIN from the typing hand position and movements. We run a detailed experimental analysis including 58 users. With our approach, we can guess 30% of the 5-digit PINs within three attempts -- the ones usually allowed by ATM before blocking the card. We also conducted a survey with 78 users that managed to reach an accuracy of only 7.92% on average for the same setting. Finally, we evaluate a shielding countermeasure that proved to be rather inefficient unless the whole keypad is shielded.


title: Superconducting dome in ferroelectric-type materials from soft mode instability

abstract: We present a minimal theory of superconductivity enhancement in ferroelectric-type materials. Simple expressions for the optical mode responsible for the soft mode transition are assumed. A key role is played by the anharmonic phonon damping which is modulated by an external control parameter (electron doping or mechanical strain) causing the appearance of the soft mode. It is shown that the enhancement in the superconducting critical temperature $T_{c}$ upon approaching the ferroelectric transition from either side is due to the Stokes electron-phonon scattering processes promoted by strong phonon damping effects.

categories: cond-mat.supr-con cond-mat.mtrl-sci cond-mat.other cond-mat.soft


title: Quickest Inference of Network Cascades with Noisy Information

abstract: We study the problem of estimating the source of a network cascade given a time series of noisy information about the spread. Initially, there is a single vertex affected by the cascade (the source) and the cascade spreads in discrete time steps across the network. The cascade evolution is hidden, but one can observe a time series of noisy signals from each vertex. The time series of a vertex is assumed to be a sequence of i.i.d. samples from a pre-change distribution $Q_0$ before the cascade affects the vertex, and the time series is a sequence of i.i.d. samples from a post-change distribution $Q_1$ once the cascade has affected the vertex. Given the time series of noisy signals, which can be viewed as a noisy measurement of the cascade evolution, we aim to devise a procedure to reliably estimate the cascade source as fast as possible. We investigate Bayesian and minimax formulations of the source estimation problem, and derive near-optimal estimators for simple cascade dynamics and network topologies. In the Bayesian setting, an estimator which observes samples until the error of the Bayes-optimal estimator falls below a threshold achieves optimal performance. In the minimax setting, optimal performance is achieved by designing a novel multi-hypothesis sequential probability ratio test (MSPRT). We find that these optimal estimators require $\log \log n / \log (k - 1)$ observations of the noisy time series when the network topology is a $k$-regular tree, and $(\log n)^{\frac{1}{\ell + 1}}$ observations are required for $\ell$-dimensional lattices. Finally, we discuss how our methods may be extended to cascades on arbitrary graphs.


title: Effects of radiative losses on the relativistic jets of high-mass microquasars

abstract: Context. Relativistic jets are ubiquitous in astrophysics. High Mass Microquasars (HMMQs) are useful labs to study such jets, as they are relatively close and evolve over observable time scales. The ambient medium into which the jet propagates is, however, far from homogeneous. Corresponding simulation studies to date consider various forms of a wind-shaped ambient medium but typically neglect radiative cooling and relativistic effects. Aims. We investigate the dynamical and structural effects of radiative losses and system parameters on relativistic jets in HMMQs, from the jet launch to its propagation over several tens of orbital separations. Methods. We use 3D relativistic hydrodynamical simulations including parameterized radiative cooling derived from relativistic thermal plasma distribution to carry out parameter studies around two fiducial cases inspired by Cygnus X-1 and Cygnus X-3. Results. Radiative losses are found to be more relevant in Cygnus X-3 than Cygnus X-1. Varying jet power, jet temperature, or the wind of the donor star tends to have a larger impact at early times, when the jet forms and instabilities initially develop, than at later times when the jet has reached a turbulent state. Conclusions. Radiative losses may be dynamically and structurally relevant at least in Cygnus X-3 case, and thus should be examined in more detail.


title: Chirality in Astrophysics

abstract: Chirality, or handedness, enters astrophysics in three distinct ways. Magnetic field and vortex lines tend to be helical and have a systematic twist in the northern and southern hemispheres of a star or a galaxy. Helicity is here driven by external factors. Chirality can also enter at the microphysical level and can then be traced back to the parity-breaking weak force. Finally, chirality can arise spontaneously, but this requires not only the presence of an instability, but also the action of nonlinearity. Examples can be found both in magnetohydrodynamics and in astrobiology, where homochirality among biomolecules probably got established at the origin of life. In this review, all three types of chirality production will be explored and compared.


title: Few-Shot Bot: Prompt-Based Learning for Dialogue Systems

abstract: Learning to converse using only a few examples is a great challenge in conversational AI. The current best conversational models, which are either good chit-chatters (e.g., BlenderBot) or goal-oriented systems (e.g., MinTL), are language models (LMs) fine-tuned on large conversational datasets. Training these models is expensive, both in terms of computational resources and time, and it is hard to keep them up to date with new conversational skills. A simple yet unexplored solution is prompt-based few-shot learning (Brown et al. 2020) which does not require gradient-based fine-tuning but instead uses a few examples in the LM context as the only source of learning. In this paper, we explore prompt-based few-shot learning in dialogue tasks. We benchmark LMs of different sizes in nine response generation tasks, which include four knowledge-grounded tasks, a task-oriented generations task, three open-chat tasks, and controlled stylistic generation, and five conversational parsing tasks, which include dialogue state tracking, graph path generation, persona information extraction, document retrieval, and internet query generation. The current largest released LM (GPT-J-6B) using prompt-based few-shot learning, and thus requiring no training, achieves competitive performance to fully trained state-of-the-art models. Moreover, we propose a novel prompt-based few-shot classifier, that also does not require any fine-tuning, to select the most appropriate prompt given a dialogue history. Finally, by combining the power of prompt-based few-shot learning and a Skill Selector, we create an end-to-end chatbot named the Few-Shot Bot (FSB), which automatically selects the most appropriate conversational skill, queries different knowledge bases or the internet, and uses the retrieved knowledge to generate a human-like response, all using only few dialogue examples per skill.


title: Higher dimensional origami constructions

abstract: Origami is an ancient art that continues to yield both artistic and scientific insights to this day. In 2012, Buhler, Butler, de Launey, and Graham extended these ideas even further by developing a mathematical construction inspired by origami -- one in which we iteratively construct points on the complex plane (the "paper") from a set of starting points (or "seed points") and lines through those points with prescribed angles (or the allowable "folds" on our paper). Any two lines with these prescribed angles through the seed points that intersect generate a new point, and by iterating this process for each pair of points formed, we generate a subset of the complex plane. We extend previously known results about the algebraic and geometric structure of these sets to higher dimensions. In the case when the set obtained is a lattice, we explore the relationship between the set of angles and the generators of the lattice and determine how introducing a new angle alters the lattice.


title: On the rising and sinking of granular bubbles and droplets

abstract: Recently, the existence of so-called granular bubbles and droplets has been demonstrated experimentally. Granular bubbles and droplets are clusters of particles that respectively rise and sink if submerged in an aerated and vibrated bed of another granular material of different size and/or density. However, currently there is no model that explains the coherent motion of these clusters and predicts the transition between a rising and sinking motion. Here, we propose an analytical model predicting accurately the neutral buoyancy limit of a granular bubble/droplet. This model allows the compilation of a regime map identifying five distinct regimes of granular bubble/droplet motion.


title: Stellar populations with MEGARA: the inner regions of NGC 7025

abstract: Context. We aim to determine the capabilities of the MEGARA@GTC instrument integral-field unit to study stellar populations and exploit its combination of high spectral (R \sim 6,000, 12,000 and 20,000) and spatial (0.62") resolutions within its 12.5"x11.3" field of view. Aims. We pursue to establish a systematic method through which we can determine the properties of the stellar populations in the observations made with MEGARA, more specifically within the MEGADES legacy project and, for this paper, those of the stellar populations of NGC 7025. Methods. We use MEGARA observations of galaxy NGC 7025. We apply different approaches to estimate the properties of the stellar populations with the highest possible certainty. Numerous tests were also performed to check the reliability of the study. Results. All the studies we conduct (both full spectral fitting and absorption line indices) on the stellar populations of NGC 7025 indicate that the stars that form its bulge have supersolar metallicity and considerably old ages (\sim 10 Gyr), in general. We determined that the bulge of NGC 7025 has a mild negative mass-weighted age gradient using three different combinations of MEGARA spectral setups. Regarding its more detailed star formation history, our results indicate that, besides a rather constant star formation at early epochs, a peak in formation history of the stars in the bulge is also found 3.5-4.5 Gyr ago, partly explaining the mass-weighted age gradients measured. Conclusions. The scenario presented in NGC 7025 is that of an isolated galaxy under secular evolution that about 3.5-4.5 Gyr ago likely experimented a minor merger (mass ratio 1/10) that induced an increase in star formation and also perturbed the morphology of its outer disc. We report on different lessons learned for the ongoing exploitation of the MEGADES survey with GTC.


title: Effects of Different Optimization Formulations in Evolutionary Reinforcement Learning on Diverse Behavior Generation

abstract: Generating various strategies for a given task is challenging. However, it has already proven to bring many assets to the main learning process, such as improved behavior exploration. With the growth in the interest of heterogeneity in solution in evolutionary computation and reinforcement learning, many promising approaches have emerged. To better understand how one guides multiple policies toward distinct strategies and benefit from diversity, we need to analyze further the influence of the reward signal modulation and other evolutionary mechanisms on the obtained behaviors. To that effect, this paper considers an existing evolutionary reinforcement learning framework which exploits multi-objective optimization as a way to obtain policies that succeed at behavior-related tasks as well as completing the main goal. Experiments on the Atari games stress that optimization formulations which do not consider objectives equally fail at generating diversity and even output agents that are worse at solving the problem at hand, regardless of the obtained behaviors.


title: When any three solutions are independent

abstract: Given an algebraic differential equation of order greater than one, it is shown that if there is any nontrivial algebraic relation amongst any number of distinct nonalgebraic solutions, along with their derivatives, then there is already such a relation between three solutions. In the autonomous situation when the equation is over constant parameters the assumption that the order be greater than one can be dropped, and a nontrivial algebraic relation exists already between two solutions. These theorems are deduced as an application of the following model-theoretic result: Suppose $p$ is a stationary nonalgebraic type in the theory of differentially closed fields of characteristic zero; if any three distinct realisations of $p$ are independent then $p$ is minimal. If the type is over the constants then minimality (and complete disintegratedness) already follow from knowing that any two realisations are independent. An algebro-geometric formulation in terms of $D$-varieties is given. The same methods yield also an analogous statement about families of compact K\"ahler manifolds.


title: Decentralized Cooperative Lane Changing at Freeway Weaving Areas Using Multi-Agent Deep Reinforcement Learning

abstract: Frequent lane changes during congestion at freeway bottlenecks such as merge and weaving areas further reduce roadway capacity. The emergence of deep reinforcement learning (RL) and connected and automated vehicle technology provides a possible solution to improve mobility and energy efficiency at freeway bottlenecks through cooperative lane changing. Deep RL is a collection of machine-learning methods that enables an agent to improve its performance by learning from the environment. In this study, a decentralized cooperative lane-changing controller was developed using proximal policy optimization by adopting a multi-agent deep RL paradigm. In the decentralized control strategy, policy learning and action reward are evaluated locally, with each agent (vehicle) getting access to global state information. Multi-agent deep RL requires lower computational resources and is more scalable than single-agent deep RL, making it a powerful tool for time-sensitive applications such as cooperative lane changing. The results of this study show that cooperative lane changing enabled by multi-agent deep RL yields superior performance to human drivers in term of traffic throughput, vehicle speed, number of stops per vehicle, vehicle fuel efficiency, and emissions. The trained RL policy is transferable and can be generalized to uncongested, moderately congested, and extremely congested traffic conditions.


title: Towards a Multi-Agent System Architecture for Supply Chain Management

abstract: Individual business processes have been changing since the Internet was created, and they are now oriented towards a more distributed and collaborative business model, in an e-commerce environment that adapts itself to the competitive and changing market conditions. This paper presents a multi-agent system architecture for supply chain management, which explores different strategies and offers solutions in a distributed e-commerce environment. The system is designed to support different types of interfaces, which allow interoperating with other business models already developed. In order to show how the entire multi-agent system is being developed, the implementation of a collaborative agent is presented and explained.


title: Learning Multi-agent Action Coordination via Electing First-move Agent

abstract: Learning to coordinate actions among agents is essential in complicated multi-agent systems. Prior works are constrained mainly by the assumption that all agents act simultaneously, and asynchronous action coordination between agents is rarely considered. This paper introduces a bi-level multi-agent decision hierarchy for coordinated behavior planning. We propose a novel election mechanism in which we adopt a graph convolutional network to model the interaction among agents and elect a first-move agent for asynchronous guidance. We also propose a dynamically weighted mixing network to effectively reduce the misestimation of the value function during training. This work is the first to explicitly model the asynchronous multi-agent action coordination, and this explicitness enables to choose the optimal first-move agent. The results on Cooperative Navigation and Google Football demonstrate that the proposed algorithm can achieve superior performance in cooperative environments. Our code is available at \url{https://github.com/Amanda-1997/EFA-DWM}.


title: Analyzing the performance of distributed conflict resolution among autonomous vehicles

abstract: This paper presents a study on how cooperation versus non-cooperation, and centralization versus distribution impact the performance of a traffic game of autonomous vehicles. A model using a particle-based, Lagrange representation, is developed, instead of a Eulerian, flow-based one, usual in routing problems of the game-theoretical approach. This choice allows representation of phenomena such as fuel exhaustion, vehicle collision, and wave propagation. The elements necessary to represent interactions in a multi-agent transportation system are defined, including a distributed, priority-based resource allocation protocol, where resources are nodes and links in a spatial network and individual routing strategies are performed. A fuel consumption dynamics is developed in order to account for energy cost and vehicles having limited range. The analysis shows that only the scenarios with cooperative resource allocation can achieve optimal values of either collective cost or equity coefficient, corresponding respectively to the centralized and to the distributed cases.


title: Label-Wise Graph Convolutional Network for Heterophilic Graphs

abstract: Graph Neural Networks (GNNs) have achieved remarkable performance in modeling graphs for various applications. However, most existing GNNs assume the graphs exhibit strong homophily in node labels, i.e., nodes with similar labels are connected in the graphs. They fail to generalize to heterophilic graphs where linked nodes may have dissimilar labels and attributes. Therefore, in this paper, we investigate a novel framework that performs well on graphs with either homophily or heterophily. More specifically, we propose a label-wise message passing mechanism to avoid the negative effects caused by aggregating dissimilar node representations and preserve the heterophilic contexts for representation learning. We further propose a bi-level optimization method to automatically select the model for graphs with homophily/heterophily. Theoretical analysis and extensive experiments demonstrate the effectiveness of our proposed framework for node classification on both homophilic and heterophilic graphs.


title: M\'etodo de Monte Carlo aplicado ao C\'alculo Fracion\'ario

abstract: This article analyzes and develops a method to solve fractional ordinary differential equations using the Monte Carlo Method. A numerical simulation is performed for some differential equations, comparing the results with what exists in the mathematical literature. The Python language is used to create computational models.


title: Breaking Down Multilingual Machine Translation

abstract: While multilingual training is now an essential ingredient in machine translation (MT) systems, recent work has demonstrated that it has different effects in different multilingual settings, such as many-to-one, one-to-many, and many-to-many learning. These training settings expose the encoder and the decoder in a machine translation model with different data distributions. In this paper, we examine how different varieties of multilingual training contribute to learning these two components of the MT model. Specifically, we compare bilingual models with encoders and/or decoders initialized by multilingual training. We show that multilingual training is beneficial to encoders in general, while it only benefits decoders for low-resource languages (LRLs). We further find the important attention heads for each language pair and compare their correlations during inference. Our analysis sheds light on how multilingual translation models work and enables us to propose methods to improve performance by training with highly related languages. Our many-to-one models for high-resource languages and one-to-many models for LRL outperform the best results reported by Aharoni et al. (2019)


title: Design Technology Co-Optimization for Neuromorphic Computing

abstract: We present a design-technology tradeoff analysis in implementing machine-learning inference on the processing cores of a Non-Volatile Memory (NVM)-based many-core neuromorphic hardware. Through detailed circuit-level simulations for scaled process technology nodes, we show the negative impact of design scaling on read endurance of NVMs, which directly impacts their inference lifetime. At a finer granularity, the inference lifetime of a core depends on 1) the resistance state of synaptic weights programmed on the core (design) and 2) the voltage variation inside the core that is introduced by the parasitic components on current paths (technology). We show that such design and technology characteristics can be incorporated in a design flow to significantly improve the inference lifetime.


title: Tellurite glass rods with nanodiamonds as photonic magnetic field and temperature sensors

abstract: We present the results of work on a hybrid material composed of a tellurite glass rod doped with nanodiamonds containing nitrogen-vacancy-nitrogen and paramagnetic nitrogen-vacancy color centers. The reported results include details on tellurite glass and cane fabrication, confocal and wide-field imaging of the nanodiamond distribution in their volume, as well as on the spectroscopic characterization of their fluorescence and Optically Detected Magnetic Resonance measurements of magnetic fields and temperatures. Magnetic fields up to 50 G were examined with a sensitivity of 10$^{-5}$ T Hz$^{-1/2}$ whereas temperature measurements were simultaneously performed with a sensitivity of 74 kHz K$^{-1}$ within the 8 Kelvin range at room temperature. In that way, we demonstrate the suitability of such systems for fiber magneto- and thermometry with a reasonable performance already in the form of glass rods. At the same time, the rods constitute an interesting starting point for further processing into photonic components such as microstructured fibers or fiber tapers for the realization of specialized sensing modalities.


title: Trade-offs of Local SGD at Scale: An Empirical Study

abstract: As datasets and models become increasingly large, distributed training has become a necessary component to allow deep neural networks to train in reasonable amounts of time. However, distributed training can have substantial communication overhead that hinders its scalability. One strategy for reducing this overhead is to perform multiple unsynchronized SGD steps independently on each worker between synchronization steps, a technique known as local SGD. We conduct a comprehensive empirical study of local SGD and related methods on a large-scale image classification task. We find that performing local SGD comes at a price: lower communication costs (and thereby faster training) are accompanied by lower accuracy. This finding is in contrast from the smaller-scale experiments in prior work, suggesting that local SGD encounters challenges at scale. We further show that incorporating the slow momentum framework of Wang et al. (2020) consistently improves accuracy without requiring additional communication, hinting at future directions for potentially escaping this trade-off.


title: Anti-jamming beam alignment in millimeter-wave MIMO systems

abstract: In millimeter-wave (MMW) multiple-input multiple-output (MIMO) communications, users and their corresponding base station (BS) have to align their beam during both initial access and data transmissions to compensate for the high propagation loss. The beam alignment (BA) procedure specified for 5th Generation (5G) New Radio (NR) has been designed to be fast and precise in the presence of non-malicious interference and noise. A smart jammer might exploit this weakness and may launch an attack during the BA phase in order to degrade the accuracy of beam selection and, thus, adversely impacting the end-to-end performance and quality-of-service experienced by the users. In this paper, we study the effects of a jamming attack at MMW frequencies during the BA procedure used to perform initial access for idle users and adaptation/recovery for connected users. We show that the BA procedure adopted in 5G NR is extremely vulnerable to a smart jamming attack and, consequently, we propose a countermeasure based on the idea of randomized probing, which consists of randomly corrupting the probing sequence transmitted by the BS in order to reject the jamming signal at the UE via a subspace-based technique based on orthogonal projections and jamming cancellation. Numerical results corroborate our theoretical findings and show the very satisfactory accuracy of the proposed anti-jamming approach.


title: Reply to "Comment on `Directed motion of spheres by unbiased driving forces in viscous fluids beyond the Stokes' law regime' "

abstract: We refute the criticism expressed in a Comment by P. J. Mart\'{\i}nez and R. Chac\'on [arXiv:2105.09308] on our paper Phys. Rev. E \textbf{97}, 032219 (2018). We first show that our paper is free of any mistakes and that the criticism expressed in the Comment is based on a misunderstanding or misrepresentation of what is actually claimed in our paper. We also show that the argument presented against the general formalism mentioned in the Comment is invalid because it is based on a confusion by the authors of the Comment between the general formalism per se and its lowest order approximation. In fact, the arguments contained in the Comment do not show that such a formalism is in general incorrect, as the authors of the Comment suggest, but rather that the supposedly universal predictions of the theory of ratchet universality are in general incorrect. In addition, we show that other arguments presented in Comment are invalid because they are based on incorrect equations.


title: Active learning and molecular dynamics simulations to find high melting temperature alloys

abstract: Active learning (AL) can drastically accelerate materials discovery; its power has been shown in various classes of materials and target properties. Prior efforts have used machine learning models for the optimal selection of physical experiments or physics-based simulations. However, the latter efforts have been mostly limited to the use of electronic structure calculations and properties that can be obtained at the unit cell level and with negligible noise. We couple AL with molecular dynamics simulations to identify multiple principal component alloys (MPCAs) with high melting temperatures. Building on cloud computing services through nanoHUB, we present a fully autonomous workflow for the efficient exploration of the high dimensional compositional space of MPCAs. We characterize how uncertainties arising from the stochastic nature of the simulations and the acquisition functions used to select simulations affect the convergence of the approach. Interestingly, we find that relatively short simulations with significant uncertainties can be used to efficiently find the desired alloys as the random forest models used for AL average out fluctuations.


title: Dynamic Ramping for Demand Response of Processes and Energy Systems based on Exact Linearization

abstract: The increasing share of volatile renewable electricity production motivates demand response. Substantial potential for demand response is offered by flexible processes and their local multi-energy supply systems. Simultaneous optimization of their schedules can exploit the demand response potential, but leads to numerically challenging problems for nonlinear dynamic processes. In this paper, we propose to capture process dynamics using dynamic ramping constraints. In contrast to traditional static ramping constraints, dynamic ramping constraints are a function of the process state and can capture high-order dynamics. We derive dynamic ramping constraints rigorously for the case of single-input single-output processes that are exactly input-state linearizable. The resulting scheduling problem can be efficiently solved as a mixed-integer linear program. In a case study, we study two flexible reactors and a multi-energy system. The proper representation of process dynamics by dynamic ramping allows for faster transitions compared to static ramping constraints and thus higher economic benefits of demand response. The proposed dynamic ramping approach is sufficiently fast for application in online optimization.


title: Convergence of Laplacian Eigenmaps and its Rate for Submanifolds with Singularities

abstract: In this paper, we give a spectral approximation result for the Laplacian on submanifolds of Euclidean spaces with singularities by the $\epsilon$-neighborhood graph constructed from random points on the submanifold. Our convergence rate for the eigenvalue of the Laplacian is $O\left(\left(\log n/n\right)^{1/(m+2)}\right)$, where $m$ and $n$ denote the dimension of the manifold and the sample size, respectively.


title: Chunked-Cache: On-Demand and Scalable Cache Isolation for Security Architectures

abstract: Shared cache resources in multi-core processors are vulnerable to cache side-channel attacks. Recently proposed defenses have their own caveats: Randomization-based defenses are vulnerable to the evolving attack algorithms besides relying on weak cryptographic primitives, because they do not fundamentally address the root cause for cache side-channel attacks. Cache partitioning defenses, on the other hand, provide the strict resource partitioning and effectively block all side-channel threats. However, they usually rely on way-based partitioning which is not fine-grained and cannot scale to support a larger number of protection domains, e.g., in trusted execution environment (TEE) security architectures, besides degrading performance and often resulting in cache underutilization. To overcome the shortcomings of both approaches, we present a novel and flexible set-associative cache partitioning design for TEE architectures, called Chunked-Cache. Chunked-Cache enables an execution context to "carve" out an exclusive configurable chunk of the cache if the execution requires side-channel resilience. If side-channel resilience is not required, mainstream cache resources are freely utilized. Hence, our solution addresses the security-performance trade-off practically by enabling selective and on-demand utilization of side-channel-resilient caches, while providing well-grounded future-proof security guarantees. We show that Chunked-Cache provides side-channel-resilient cache utilization for sensitive code execution, with small hardware overhead, while incurring no performance overhead on the OS. We also show that it outperforms conventional way-based cache partitioning by 43%, while scaling significantly better to support a larger number of protection domains.


title: Excitonic transport driven by repulsive dipolar interaction in a van der Waals heterostructure

abstract: Dipolar bosonic gases are currently the focus of intensive research due to their interesting many-body physics in the quantum regime. Their experimental embodiments range from Rydberg atoms to GaAs double quantum wells and van der Waals heterostructures built from transition metal dichalcogenides. Although quantum gases are very dilute, mutual interactions between particles could lead to exotic many-body phenomena such as Bose-Einstein condensation and high-temperature superfluidity. Here, we report the effect of repulsive dipolar interactions on the dynamics of interlayer excitons in the dilute regime. By using spatial and time-resolved photoluminescence imaging, we observe the dynamics of exciton transport, enabling a direct estimation of the exciton mobility. The presence of interactions significantly modifies the diffusive transport of excitons, effectively acting as a source of drift force and enhancing the diffusion coefficient by one order of magnitude. The repulsive dipolar interactions combined with the electrical control of interlayer excitons opens up appealing new perspectives for excitonic devices.


title: Data-driven Heuristics for DC optimal transmission switching problem

abstract: The goal of Optimal Transmission Switching (OTS) problem for power systems is to identify a topology of the power grid that minimizes the cost of the system operation while satisfying the operational and physical constraints. Among the most popular methods to solve OTS is to construct approximation via integer linear programming formulations, which often come with big-M inequalities. These big-M inequalities increase, considerably, the difficulty of solving the resulting formulations. Moreover, choosing big-M values optimally is as hard as solving OTS itself. In this paper, we devise two data-driven big-M bound strengthening methods which take network structure, power demands and generation costs into account. We illustrate the robustness of our methods to load changes and impressive runtime improvements of mixed-integer solvers achieved by our methods with extensive experiments on benchmark instances. The speedup by one of the proposed methods is almost 13 times with respect to the exact method.


title: Performance of a Kinetic-Inductance Traveling-Wave Parametric Amplifier at 4 Kelvin: Toward an Alternative to Semiconductor Amplifiers

abstract: Most microwave readout architectures in quantum computing or sensing rely on a semiconductor amplifier at 4 K, typically a high-electron mobility transistor (HEMT). Despite its remarkable noise performance, a conventional HEMT dissipates several milliwatts of power, posing a practical challenge to scale up the number of qubits or sensors addressed in these architectures. As an alternative, we present an amplification chain consisting of a kinetic-inductance traveling-wave parametric amplifier (KI-TWPA) placed at 4 K, followed by a HEMT placed at 70 K, and demonstrate a chain-added noise $T_\Sigma = 6.3\pm0.5$ K between 3.5 and 5.5 GHz. While, in principle, any parametric amplifier can be quantum limited even at 4 K, in practice we find the KI-TWPA's performance limited by the temperature of its inputs, and by an excess of noise $T_\mathrm{ex} = 1.9$ K. The dissipation of the KI-TWPA's rf pump constitutes the main power load at 4 K and is about one percent that of a HEMT. These combined noise and power dissipation values pave the way for the KI-TWPA's use as a replacement for semiconductor amplifiers.


title: Multi-Tailed, Multi-Headed, Spatial Dynamic Memory refined Text-to-Image Synthesis

abstract: Synthesizing high-quality, realistic images from text-descriptions is a challenging task, and current methods synthesize images from text in a multi-stage manner, typically by first generating a rough initial image and then refining image details at subsequent stages. However, existing methods that follow this paradigm suffer from three important limitations. Firstly, they synthesize initial images without attempting to separate image attributes at a word-level. As a result, object attributes of initial images (that provide a basis for subsequent refinement) are inherently entangled and ambiguous in nature. Secondly, by using common text-representations for all regions, current methods prevent us from interpreting text in fundamentally different ways at different parts of an image. Different image regions are therefore only allowed to assimilate the same type of information from text at each refinement stage. Finally, current methods generate refinement features only once at each refinement stage and attempt to address all image aspects in a single shot. This single-shot refinement limits the precision with which each refinement stage can learn to improve the prior image. Our proposed method introduces three novel components to address these shortcomings: (1) An initial generation stage that explicitly generates separate sets of image features for each word n-gram. (2) A spatial dynamic memory module for refinement of images. (3) An iterative multi-headed mechanism to make it easier to improve upon multiple image aspects. Experimental results demonstrate that our Multi-Headed Spatial Dynamic Memory image refinement with our Multi-Tailed Word-level Initial Generation (MSMT-GAN) performs favourably against the previous state of the art on the CUB and COCO datasets.


title: milIE: Modular & Iterative Multilingual Open Information Extraction

abstract: Open Information Extraction (OpenIE) is the task of extracting (subject, predicate, object) triples from natural language sentences. Current OpenIE systems extract all triple slots independently. In contrast, we explore the hypothesis that it may be beneficial to extract triple slots iteratively: first extract easy slots, followed by the difficult ones by conditioning on the easy slots, and therefore achieve a better overall extraction. Based on this hypothesis, we propose a neural OpenIE system, milIE, that operates in an iterative fashion. Due to the iterative nature, the system is also modular -- it is possible to seamlessly integrate rule based extraction systems with a neural end-to-end system, thereby allowing rule based systems to supply extraction slots which milIE can leverage for extracting the remaining slots. We confirm our hypothesis empirically: milIE outperforms SOTA systems on multiple languages ranging from Chinese to Arabic. Additionally, we are the first to provide an OpenIE test dataset for Arabic and Galician.


title: Resonance-enhanced multiphoton ionization in the x-ray regime

abstract: Here, we report on the nonlinear ionization of argon atoms in the short wavelength regime using ultraintense x rays from the European XFEL. After sequential multiphoton ionization, high charge states are obtained. For photon energies that are insufficient to directly ionize a $1s$ electron, a different mechanism is required to obtain ionization to Ar$^{17+}$. We propose this occurs through a two-color process where the second harmonic of the FEL pulse resonantly excites the system via a $1s \rightarrow 2p$ transition followed by ionization by the fundamental FEL pulse, which is a type of x-ray resonance-enhanced multiphoton ionization (REMPI). This resonant phenomenon occurs not only for Ar$^{16+}$, but through multiple lower charge states, where multiple ionization competes with decay lifetimes, making x-ray REMPI distinctive from conventional REMPI. With the aid of state-of-the-art theoretical calculations, we explain the effects of x-ray REMPI on the relevant ion yields and spectral profile.


title: ACOA -- Chronological Analysis of the Exhibition of Artistic Works

abstract: We are currently prioritizing home activities, avoiding human contact, and carrying out external activities mostly by necessity. Therefore, and due to the loss of adhesion to cultural events on the part of the population, the cultural digital transformation process has been boosted, aiming to reach interested communities through digital media. The ACOA platform supports the organization of multiple sources of information related to creative processes behind complex artworks and their trajectories over time. This information is of great interest to conservators and curators, as well as to the general public, as it allows to document changes in the artwork, from the moment it was conceived by the artist, until its most recent exhibition. This platform houses a chronological evolution of the work, through the contextual dissemination of associated multimedia content. Works by the Portuguese artist Ana Vieira (1940-2016) were chosen as case studies for the implementation of the platform.


title: Functionalized high-speed magnon-polaritons resulting from the magnetic antenna effect

abstract: Magnon-polaritons (MPs) refer to a light--magnon coupled state and can potentially act as information carriers, possibly enabling charge-free computation. However, the light--magnon coupling is inherently weak. To achieve sufficiently strong coupling, a large ferromagnet or coupling with a microwave cavity is necessary. Herein, we theoretically propose a fundamental platform for magnonic and magnon--optical information storage devices and discuss the transport properties of MP's. The proposed multi-layered structure overcomes the aforementioned issues. Owing to the waveguide modes, magnons placed in a nanometer-thin layer are strongly coupled with light, exhibiting rich functionalities of thick-layer MPs via the `magnetic antenna effect'. Thus, the thin-layer MPs are faster, and the direction is switchable. The results of this study will enable the integration of ferromagnetic micro and nanostructures for MP-based information devices without any restrictions due to cavities.


title: Memory effects in black phosphorus field effect transistors

abstract: We report the fabrication and the electrical characterization of back-gated field effect transistors with black phosphorus channel. We show that the hysteresis of the transfer characteristic, due to intrinsic defects, can be exploited to realize non-volatile memories. We demonstrate that gate voltage pulses allow to trap and store charge inside the defect states, which enable memory devices with endurance over 200 cycles and retention longer than 30 minutes. We show that the use of a protective poly (methyl methacrylate) layer, positioned on top of the black phosphorus channel, does not affect the electrical properties of the device but avoids the degradation caused by the exposure to air.


title: Trade-off in perpendicular electric field control using negatively biased emissive end-electrodes

abstract: The benefits of thermionic emission from negatively biased electrodes for perpendicular electric field control in a magnetized plasma are examined through its combined effects on the sheath and on the plasma potential variation along magnetic field lines. By increasing the radial current flowing through the plasma thermionic emission is confirmed to improve control over the plasma potential at the sheath edge compared to the case of a cold electrode. Conversely, thermionic emission is shown to be responsible for an increase of the plasma potential drop along magnetic field lines in the quasi-neutral plasma. These results suggest that there exists a trade-off between electric field longitudinal uniformity and amplitude when using negatively biased emissive electrodes to control the perpendicular electric field in a magnetized plasma.


title: Halpern-Type Accelerated and Splitting Algorithms For Monotone Inclusions

abstract: In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called Halpern-type fixed-point iteration in [32], and recently exploited by a number of researchers, including [24, 70]. Firstly, we derive a new variant of the anchored extra-gradient scheme in [70] based on Popov's past extra-gradient method to solve a maximally monotone equation $G(x) = 0$. We show that our method achieves the same $\mathcal{O}(1/k)$ convergence rate (up to a constant factor) as in the anchored extra-gradient algorithm on the operator norm $\Vert G(x_k)\Vert$, , but requires only one evaluation of $G$ at each iteration, where $k$ is the iteration counter. Next, we develop two splitting algorithms to approximate a zero point of the sum of two maximally monotone operators. The first algorithm originates from the anchored extra-gradient method combining with a splitting technique, while the second one is its Popov's variant which can reduce the per-iteration complexity. Both algorithms appear to be new and can be viewed as accelerated variants of the Douglas-Rachford (DR) splitting method. They both achieve $\mathcal{O}(1/k)$ rates on the norm $\Vert G_{\gamma}(x_k)\Vert$ of the forward-backward residual operator $G_{\gamma}(\cdot)$ associated with the problem. We also propose a new accelerated Douglas-Rachford splitting scheme for solving this problem which achieves $\mathcal{O}(1/k)$ convergence rate on $\Vert G_{\gamma}(x_k)\Vert$ under only maximally monotone assumptions. Finally, we specify our first algorithm to solve convex-concave minimax problems and apply our accelerated DR scheme to derive a new variant of the alternating direction method of multipliers (ADMM).


title: mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models

abstract: Recent studies have shown that multilingual pretrained language models can be effectively improved with cross-lingual alignment information from Wikipedia entities. However, existing methods only exploit entity information in pretraining and do not explicitly use entities in downstream tasks. In this study, we explore the effectiveness of leveraging entity representations for downstream cross-lingual tasks. We train a multilingual language model with 24 languages with entity representations and show the model consistently outperforms word-based pretrained models in various cross-lingual transfer tasks. We also analyze the model and the key insight is that incorporating entity representations into the input allows us to extract more language-agnostic features. We also evaluate the model with a multilingual cloze prompt task with the mLAMA dataset. We show that entity-based prompt elicits correct factual knowledge more likely than using only word representations. Our source code and pretrained models are available at https://github.com/studio-ousia/luke.


title: Kronecker Decomposition for GPT Compression

abstract: GPT is an auto-regressive Transformer-based pre-trained language model which has attracted a lot of attention in the natural language processing (NLP) domain due to its state-of-the-art performance in several downstream tasks. The success of GPT is mostly attributed to its pre-training on huge amount of data and its large number of parameters (from ~100M to billions of parameters). Despite the superior performance of GPT (especially in few-shot or zero-shot setup), this overparameterized nature of GPT can be very prohibitive for deploying this model on devices with limited computational power or memory. This problem can be mitigated using model compression techniques; however, compressing GPT models has not been investigated much in the literature. In this work, we use Kronecker decomposition to compress the linear mappings of the GPT-22 model. Our Kronecker GPT-2 model (KnGPT2) is initialized based on the Kronecker decomposed version of the GPT-2 model and then is undergone a very light pre-training on only a small portion of the training data with intermediate layer knowledge distillation (ILKD). Finally, our KnGPT2 is fine-tuned on down-stream tasks using ILKD as well. We evaluate our model on both language modeling and General Language Understanding Evaluation benchmark tasks and show that with more efficient pre-training and similar number of parameters, our KnGPT2 outperforms the existing DistilGPT2 model significantly.


title: A multi-agent description of the influence of higher education on social stratification

abstract: We introduce and discuss a system of one-dimensional kinetic equations describing the influence of higher education in the social stratification of a multi-agent society. The system is obtained by coupling a model for knowledge formation with a kinetic description of the social climbing in which the parameters characterizing the elementary interactions leading to the formation of a social elite are assumed to depend on the degree of knowledge/education of the agents. In addition, we discuss the case in which the education level of an individual is function of the position occupied in the social ranking. With this last assumption we obtain a fully coupled model in which knowledge and social status influence each other. In the last part, we provide several numerical experiments highlighting the role of education in reducing social inequalities and in promoting social mobility.


title: Distributed Resource Allocation Optimization for User-Centric Cell-Free MIMO Networks

abstract: We develop two distributed downlink resource allocation algorithms for user-centric, cell-free, spatially-distributed, multiple-input multiple-output (MIMO) networks. In such networks, each user is served by a subset of nearby transmitters that we call distributed units or DUs. The operation of the DUs in a region is controlled by a central unit (CU). Our first scheme is implemented at the DUs, while the second is implemented at the CUs controlling these DUs. We define a hybrid quality of service metric that enables distributed optimization of system resources in a proportional fair manner. Specifically, each of our algorithms performs user scheduling, beamforming, and power control while accounting for channel estimation errors. Importantly, our algorithm does not require information exchange amongst DUs (CUs) for the DU-distributed (CU-distributed) system, while also smoothly converging. Our results show that our CU-distributed system provides 1.3- to 1.8-fold network throughput compared to the DU-distributed system, with minor increases in complexity and front-haul load - and substantial gains over benchmark schemes like local zero-forcing. We also analyze the trade-offs provided by the CU-distributed system, hence highlighting the significance of deploying multiple CUs in user-centric cell-free networks.


title: Quantum yield and charge diffusion in the Nancy Grace Roman Space Telescope infrared detectors

abstract: The shear signal required for weak lensing analyses is small, so any detector-level effects which distort astronomical images can contaminate the inferred shear. The Nancy Grace Roman Space Telescope (Roman) will fly a focal plane with 18 Teledyne H4RG-10 near infrared (IR) detector arrays; these have never been used for weak lensing and they present unique instrument calibration challenges. A pair of previous investigations (Hirata & Choi 2020; Choi & Hirata 2020) demonstrated that spatiotemporal correlations of flat fields can effectively separate the brighter-fatter effect (BFE) and interpixel capacitance (IPC). Later work (Freudenburg et al. 2020) introduced a Fourier-space treatment of these correlations which allowed the authors to expand to higher orders in BFE, IPC, and classical nonlinearity (CNL). This work expands the previous formalism to include quantum yield and charge diffusion. We test the updated formalism on simulations and show that we can recover input characterization values. We then apply the formalism to visible and IR flat field data from three Roman flight candidate detectors. We fit a 2D Gaussian model to the charge diffusion at 0.5 $\mu$m wavelength, and find variances of $C_{11} = 0.1066\pm 0.0011$ pix$^2$ in the horizontal direction, $C_{22} = 0.1136\pm 0.0012$ pix$^2$ in the vertical direction, and a covariance of $C_{12} = 0.0001\pm 0.0007$ pix$^2$ (stat) for SCA 20829. Last, we convert the asymmetry of the charge diffusion into an equivalent shear signal, and find a contamination of the shear correlation function to be $\xi_+ \sim 10^{-6}$ for each detector. This exceeds Roman's allotted error budget for the measurement by a factor of $\mathcal{O}(10)$ in power (amplitude squared) but can likely be mitigated through standard methods for fitting the point spread function (PSF) since charge diffusion can be treated as a contribution to the PSF.


title: Asymptotic Floquet theory for first order ODEs with finite Fourier series perturbation and its applications to Floquet metamaterials

abstract: Our aim in this paper is twofold. Firstly, we develop a new asymptotic theory for Floquet exponents. We consider a linear system of differential equations with a time-periodic coefficient matrix. Assuming that the coefficient matrix depends analytically on a small parameter, we derive a full asymptotic expansion of its Floquet exponents. Based on this, we prove that only the constant order Floquet exponents of multiplicity higher than one will be perturbed linearly. The required multiplicity can be achieved via folding of the system through certain choices of the periodicity of the coefficient matrix. Secondly, we apply such an asymptotic theory for the analysis of Floquet metamaterials. We provide a characterization of asymptotic exceptional points for a pair of subwavelength resonators with time-dependent material parameters. We prove that asymptotic exceptional points are obtained if the frequency components of the perturbations fulfill a certain ratio, which is determined by the geometry of the dimer of subwavelength resonators.


title: Cluster scattering diagrams and theta functions for reciprocal generalized cluster algebras

abstract: We give a construction of generalized cluster varieties and generalized cluster scattering diagrams for reciprocal generalized cluster algebras, the latter of which were defined by Chekhov and Shapiro. These constructions are analogous to the structures given for ordinary cluster algebras in the work of Gross, Hacking, Keel, and Kontsevich. As a consequence of these constructions, we are also able to construct theta functions for generalized cluster algebras, again in the reciprocal case, and demonstrate a number of their structural properties.


title: Complex psd-minimal polytopes in dimensions two and three

abstract: The extension complexity of a polytope measures its amenability to succinct representations via lifts. There are several versions of extension complexity, including linear, real semidefinite, and complex semidefinite. We focus on the last of these, for which the least is known, and in particular on understanding which polytopes are complex psd-minimal. We prove the existence of an obstruction to complex psd-minimality which is efficiently computable via lattice membership problems. Using this tool, we complete the classification of complex psd-minimal polygons (geometrically as well as combinatorially). In dimension three we exhibit several new examples of complex psd-minimal polytopes and apply our obstruction to rule out many others.


title: ThERESA: Three-Dimensional Eclipse Mapping with Application to Synthetic JWST Data

abstract: Spectroscopic eclipse observations, like those possible with the James Webb Space Telescope, should enable 3D mapping of exoplanet daysides. However, fully-flexible 3D planet models are overly complex for the data and computationally infeasible for data-fitting purposes. Here, we present ThERESA, a method to retrieve the 3D thermal structure of an exoplanet from eclipse observations by first retrieving 2D thermal maps at each wavelength and then placing them vertically in the atmosphere. This approach allows the 3D model to include complex thermal structures with a manageable number of parameters, hastening fit convergence and limiting overfitting. An analysis runs in a matter of days. We enforce consistency of the 3D model by comparing vertical placement of the 2D maps with their corresponding contribution functions. To test this approach, we generated a synthetic JWST NIRISS-like observation of a single hot-Jupiter eclipse using a global circulation model of WASP-76b and retrieved its 3D thermal structure. We find that a model which places the 2D maps at different depths depending on latitude and longitude is preferred over a model with a single pressure for each 2D map, indicating that ThERESA is able to retrieve 3D atmospheric structure from JWST observations. We successfully recover the temperatures of the planet's dayside, the eastward shift of its hotspot, and the thermal inversion. ThERESA is open-source and publicly available as a tool for the community.


title: Dimerization tendencies of the pyrochlore Heisenberg antiferromagnet: A functional renormalization group perspective

abstract: We investigate the ground state properties of the spin-$1/2$ pyrochlore Heisenberg antiferromagnet using pseudofermion functional renormalization group techniques. The first part of our analysis is based on an enhanced parton mean-field approach which takes into account fluctuation effects from renormalized vertex functions. Our implementation of this technique extends earlier approaches and resolves technical difficulties associated with a diagrammatic overcounting. Using various parton ans\"atze for quantum spin liquids, dimerized and nematic states our results indicate a tendency for lattice symmetry breaking in the ground state. While overall quantum spin liquids seem unfavorable in this system, the recently proposed monopole state still shows the strongest support among all spin liquid ans\"atze that we have tested, which is further confirmed by our complementary variational Monte Carlo calculations. In the second part of our investigation, we probe lattice symmetry breaking more directly by applying the pseudofermion functional renormalization group to perturbed systems. Our results from this technique confirm that the system's ground state either exhibits broken $C_3$ rotation symmetry, or a combination of inversion and $C_3$ symmetry breaking.


title: Online False Discovery Rate Control for LORD & SAFFRON Under Positive, Local Dependence

abstract: Online testing procedures assume that hypotheses are observed in sequence, and allow the significance thresholds for upcoming tests to depend on the test statistics observed so far. Some of the most popular online methods include alpha investing, LORD++ (hereafter, LORD), and SAFFRON. These three methods have been shown to provide online control of the "modified" false discovery rate (mFDR) under a condition known as conditional superuniformity. However, to our knowledge, LORD & SAFFRON have only been shown to control the traditional false discovery rate (FDR) under an independence condition on the test statistics. Our work bolsters these results by showing that SAFFRON and LORD additionally ensure online control of the FDR under a "local" form of nonnegative dependence. Further, FDR control is maintained under certain types of adaptive stopping rules, such as stopping after a certain number of rejections have been observed. Because alpha investing can be recovered as a special case of the SAFFRON framework, our results immediately apply to alpha investing as well. In the process of deriving these results, we also formally characterize how the conditional superuniformity assumption implicitly limits the allowed p-value dependencies. This implicit limitation is important not only to our proposed FDR result, but also to many existing mFDR results.


title: Grain splitting is a mechanism for grain coarsening in colloidal polycrystals

abstract: In established theories of grain coarsening, grains disappear either by shrinking or by rotating as a rigid object to coalesce with an adjacent grain. Here we report a third mechanism for grain coarsening, in which a grain splits apart into two regions that rotate in opposite directions to match two adjacent grains' orientations. We experimentally observe both conventional grain rotation and grain splitting in 2D colloidal polycrystals. We find that grain splitting occurs via independently rotating "granules" whose shapes are determined by the underlying triangular lattices of the two merging crystal grains. These granules are so small that existing continuum theories of grain boundary energy are inapplicable, so we introduce a hard sphere model for the free energy of a colloidal polycrystal. We find that during splitting, the system overcomes a free energy barrier before ultimately reaching a lower free energy when splitting is complete. Using simulated splitting events and a simple scaling prediction, we find that the barrier to grain splitting decreases as grain size decreases. Consequently, grain splitting is likely to play an important role in polycrystals with small grains. This discovery suggests that mesoscale models of grain coarsening may offer better predictions in the nanocrystalline regime by including grain splitting.


title: Quantum Computational Quantification of Protein-Ligand Interactions

abstract: We have demonstrated a prototypical hybrid classical and quantum computational workflow for the quantification of protein-ligand interactions. The workflow combines the Density Matrix Embedding Theory (DMET) embedding procedure with the Variational Quantum Eigensolver (VQE) approach for finding molecular electronic ground states. A series of $\beta$-secretase (BACE1) inhibitors is rank-ordered using binding energy differences calculated on the latest superconducting transmon (IBM) and trapped-ion (Honeywell) Noisy Intermediate Scale Quantum (NISQ) devices. This is the first application of real quantum computers to the calculation of protein-ligand binding energies. The results shed light on hardware and software requirements which would enable the application of NISQ algorithms in drug design.


title: Accurate Fine-grained Layout Analysis for the Historical Tibetan Document Based on the Instance Segmentation

abstract: Accurate layout analysis without subsequent text-line segmentation remains an ongoing challenge, especially when facing the Kangyur, a kind of historical Tibetan document featuring considerable touching components and mottled background. Aiming at identifying different regions in document images, layout analysis is indispensable for subsequent procedures such as character recognition. However, there was only a little research being carried out to perform line-level layout analysis which failed to deal with the Kangyur. To obtain the optimal results, a fine-grained sub-line level layout analysis approach is presented. Firstly, we introduced an accelerated method to build the dataset which is dynamic and reliable. Secondly, enhancement had been made to the SOLOv2 according to the characteristics of the Kangyur. Then, we fed the enhanced SOLOv2 with the prepared annotation file during the training phase. Once the network is trained, instances of the text line, sentence, and titles can be segmented and identified during the inference stage. The experimental results show that the proposed method delivers a decent 72.7% average precision on our dataset. In general, this preliminary research provides insights into the fine-grained sub-line level layout analysis and testifies the SOLOv2-based approaches. We also believe that the proposed methods can be adopted on other language documents with various layouts.


title: The Effect of Dark Matter Halo Shape on Bar Buckling and Boxy/Peanut Bulges

abstract: It is well established that bars evolve significantly after they form in galaxy discs, often changing shape both in and out of the disc plane. In some cases they may bend or buckle out of the disc plane resulting in the formation of boxy/peanut/x-shape bulges. In this paper we show that the dark matter halo shape affects bar formation and buckling. We have performed N-body simulations of bar buckling in non-spherical dark matter halos and traced bar evolution for 8 Gyr. We find that bar formation is delayed in oblate halos, resulting in delayed buckling whereas bars form earlier in prolate halos leading to earlier buckling. However, the duration of first buckling remains almost comparable. All the models show two buckling events but the most extreme prolate halo exhibits three distinct buckling features. Bars in prolate halos also show buckling signatures for the longest duration compared to spherical and oblate halos. Since ongoing buckling events are rarely observed, our study suggests that most barred galaxies may have more oblate or spherical halos rather than prolate halos. Our measurement of BPX structures also shows that prolate halos promote bar thickening and disc heating more than oblate and spherical halos.


title: Optimal Distribution Design for Irregular Repetition Slotted ALOHA with Multi-Packet Reception

abstract: Associated with multi-packet reception at the access point, irregular repetition slotted ALOHA (IRSA) holds a great potential in improving the access capacity of massive machine type communication systems. Considering the time-frequency resource efficiency, K = 2 (multi-packet reception capability) may be the most suitable scheme for scenarios that allow smaller resource efficiency in exchange for greater throughput. In this paper, we analytically derive an optimal transmission probability distribution for IRSA with K = 2, which achieves a significant higher load threshold than the existing benchmark distributions. In addition, the energy efficiency optimization in terms of the maximum repetition rate is also presented.


title: Exploring the consequences of chromatic data excision in 21-cm Epoch of Reionization power spectrum observations

abstract: We explore how chromatic RFI flags affect 21-cm power spectrum measurements. We particularly study flags that are coarser than the analysis resolution. We find that such RFI flags produce excess power in the EoR window in much the same way as residual RFI. We use Fast Holographic Deconvolution (FHD) simulations to explain this as a result of chromatic disruptions in the interferometric sampling function of the array. We also use these simulations in conjunction with Error Propagated Power Spectrum with InterLeaved Observed Noise ($\varepsilon$ppsilon) to show that without modifying current flagging strategies or implementing extremely accurate and complete foreground subtraction, 21-cm EoR experiments will fail to make a significant detection. As a mitigation strategy, we find that circumventing the chromatic structure altogether by flagging the entire analysis band when RFI is detected is simple to implement and highly successful. This demands a detection strategy with a low false positive rate in order to prevent excessive data loss.


title: DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization

abstract: Transformer-based models have achieved state-of-the-art performance on short-input summarization. However, they still struggle with summarizing longer text. In this paper, we present DYLE, a novel dynamic latent extraction approach for abstractive long-input summarization. DYLE jointly trains an extractor and a generator and treats the extracted text snippets as the latent variable, allowing dynamic snippet-level attention weights during decoding. To provide adequate supervision, we propose simple yet effective heuristics for oracle extraction as well as a consistency loss term, which encourages the extractor to approximate the averaged dynamic weights predicted by the generator. We evaluate our method on different long-document and long-dialogue summarization tasks: GovReport, QMSum, and arXiv. Experiment results show that DYLE outperforms all existing methods on GovReport and QMSum, with gains up to 6.1 ROUGE, while yielding strong results on arXiv. Further analysis shows that the proposed dynamic weights provide interpretability of our generation process.


title: Containerized Distributed Value-Based Multi-Agent Reinforcement Learning

abstract: Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding data transfer, inter-process communication management, and high requirement of exploration. We propose a containerized learning framework to solve these problems. We pack several environment instances, a local learner and buffer, and a carefully designed multi-queue manager which avoids blocking into a container. Local policies of each container are encouraged to be as diverse as possible, and only trajectories with highest priority are sent to a global learner. In this way, we achieve a scalable, time-efficient, and diverse distributed MARL learning framework with high system throughput. To own knowledge, our method is the first to solve the challenging Google Research Football full game $5\_v\_5$. On the StarCraft II micromanagement benchmark, our method gets $4$-$18\times$ better results compared to state-of-the-art non-distributed MARL algorithms.


title: Simulation of emergence in artificial societies: a practical model-based approach with the EB-DEVS formalism

abstract: Modelling and simulation of complex systems is key to exploring and understanding social processes, benefiting from formal mechanisms to derive global-level properties from local-level interactions. In this paper we extend the body of knowledge on formal methods in complex systems by applying EB-DEVS, a novel formalism tailored for the modelling, simulation and live identification of emergent properties. We guide the reader through the implementation of different classical models for varied social systems to introduce good modelling practices and showcase the advantages and limitations of modelling emergence with EB-DEVS, in particular through its live emergence detection capability. This work provides case study-driven evidence for the neatness and compactness of the approach to modelling communication structures that can be explicit or implicit, static or dynamic, with or without multilevel interactions, and with weak or strong emergent behaviour. Throughout examples we show that EB-DEVS permits conceptualising the analysed societies by incorporating emergent behaviour when required, namely by integrating as a macro-level aggregate the Gini index in the Sugarscape model, Fads and Fashion in the Dissemination of Culture model, size-biased degree distribution in a Preferential Attachment model, happiness index in the Segregation model and quarantines in the SIR epidemic model. In each example we discuss the role of communication structures in the development of multilevel simulation models, and illustrate how micro-macro feedback loops enable the modelling of macro-level properties. Our results stress the relevance of multilevel features to support a robust approach in the modelling and simulation of complex systems.


title: Comment on: Dense entire curves .. [arXiv:1905.01104], by F. Campana and J. Winkelmann

abstract: We construct dense holomorphic curves that do not lift to any ramified cover.


title: MLFC: From 10 to 50 Planners in the Multi-Agent Programming Contest

abstract: In this paper, we describe the strategies used by our team, MLFC, that led us to achieve the 2nd place in the 15th edition of the Multi-Agent Programming Contest. The scenario used in the contest is an extension of the previous edition (14th) "Agents Assemble" wherein two teams of agents move around a 2D grid and compete to assemble complex block structures. We discuss the languages and tools used during the development of our team. Then, we summarise the main strategies that were carried over from our previous participation in the 14th edition and list the limitations (if any) of using these strategies in the latest contest edition. We also developed new strategies that were made specifically for the extended scenario: cartography (determining the size of the map); formal verification of the map merging protocol (to provide assurances that it works when increasing the number of agents); plan cache (efficiently scaling the number of planners); task achievement (forming groups of agents to achieve tasks); and bullies (agents that focus on stopping agents from the opposing team). Finally, we give a brief overview of our performance in the contest and discuss what we believe were our shortcomings.


title: Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models

abstract: Knowledge probing is crucial for understanding the knowledge transfer mechanism behind the pre-trained language models (PLMs). Despite the growing progress of probing knowledge for PLMs in the general domain, specialised areas such as biomedical domain are vastly under-explored. To catalyse the research in this direction, we release a well-curated biomedical knowledge probing benchmark, MedLAMA, which is constructed based on the Unified Medical Language System (UMLS) Metathesaurus. We test a wide spectrum of state-of-the-art PLMs and probing approaches on our benchmark, reaching at most 3% of acc@10. While highlighting various sources of domain-specific challenges that amount to this underwhelming performance, we illustrate that the underlying PLMs have a higher potential for probing tasks. To achieve this, we propose Contrastive-Probe, a novel self-supervised contrastive probing approach, that adjusts the underlying PLMs without using any probing data. While Contrastive-Probe pushes the acc@10 to 28%, the performance gap still remains notable. Our human expert evaluation suggests that the probing performance of our Contrastive-Probe is still under-estimated as UMLS still does not include the full spectrum of factual knowledge. We hope MedLAMA and Contrastive-Probe facilitate further developments of more suited probing techniques for this domain.


title: Excitons in Bulk and Layered Chromium Tri-Halides: From Frenkel to the Wannier-Mott Limit

abstract: Excitons with large binding energies $\sim$2-3 eV in CrX$_{3}$ are historically characterized as being localized (Frenkel) excitons that emerge from the atomic $d{-}d$ transitions between the Cr-3$d$-$t_{2g}$ and $e_{g}$ orbitals. The argument has gathered strength in recent years as the excitons in recently made monolayers are found at almost the same energies as the bulk. The Laporte rule, which restricts such parity forbidden atomic transitions, can relax if, at least, one element is present: spin-orbit coupling, odd-parity phonons or Jahn-Teller distortion. While what can be classified as a purely Frenkel exciton is a matter of definition, we show using an advanced first principles parameter-free approach that these excitons in CrX$_{3}$, in both its bulk and monolayer variants, have band-origin and do not require the relaxation of Laporte rule as a fundamental principle. We show that, the character of these excitons is mostly determined by the Cr-$d$ orbital manifold, nevertheless, they appear only as a consequence of X-p states hybridizing with the Cr-$d$. The hybridization enhances as the halogen atom becomes heavier, bringing the X-$p$ states closer to the Cr-$d$ states in the sequence Cl{\textrightarrow}Br{\textrightarrow}I, with an attendant increase in exciton intensity and decrease in binding energy. By applying a range of different kinds of perturbations, we show that, moderate changes to the two-particle Hamiltonian that essentially modifies the Cr-$d$-X-$p$ hybridization, can alter both the intensities and positions of the exciton peaks. A detailed analysis of several deep lying excitons, with and without strain, reveals that the exciton is most Frenkel like in CrCl$_{3}$ and acquires mixed Frenkel-Wannier character in CrI$_{3}$.

categories: cond-mat.mtrl-sci cond-mat.str-el physics.comp-ph physics.optics


title: MixQG: Neural Question Generation with Mixed Answer Types

abstract: Asking good questions is an essential ability for both human and machine intelligence. However, existing neural question generation approaches mainly focus on the short factoid type of answers. In this paper, we propose a neural question generator, MixQG, to bridge this gap. We combine 9 question answering datasets with diverse answer types, including yes/no, multiple-choice, extractive, and abstractive answers, to train a single generative model. We show with empirical results that our model outperforms existing work in both seen and unseen domains and can generate questions with different cognitive levels when conditioned on different answer types. Our code is released and well-integrated with the Huggingface library to facilitate various downstream applications.


title: Collaborating with Humans without Human Data

abstract: Collaborating with humans requires rapidly adapting to their individual strengths, weaknesses, and preferences. Unfortunately, most standard multi-agent reinforcement learning techniques, such as self-play (SP) or population play (PP), produce agents that overfit to their training partners and do not generalize well to humans. Alternatively, researchers can collect human data, train a human model using behavioral cloning, and then use that model to train "human-aware" agents ("behavioral cloning play", or BCP). While such an approach can improve the generalization of agents to new human co-players, it involves the onerous and expensive step of collecting large amounts of human data first. Here, we study the problem of how to train agents that collaborate well with human partners without using human data. We argue that the crux of the problem is to produce a diverse set of training partners. Drawing inspiration from successful multi-agent approaches in competitive domains, we find that a surprisingly simple approach is highly effective. We train our agent partner as the best response to a population of self-play agents and their past checkpoints taken throughout training, a method we call Fictitious Co-Play (FCP). Our experiments focus on a two-player collaborative cooking simulator that has recently been proposed as a challenge problem for coordination with humans. We find that FCP agents score significantly higher than SP, PP, and BCP when paired with novel agent and human partners. Furthermore, humans also report a strong subjective preference to partnering with FCP agents over all baselines.


title: The Privacy-preserving Padding Problem: Non-negative Mechanisms for Conservative Answers with Differential Privacy

abstract: Differentially private noise mechanisms commonly use symmetric noise distributions. This is attractive both for achieving the differential privacy definition, and for unbiased expectations in the noised answers. However, there are contexts in which a noisy answer only has utility if it is conservative, that is, has known-signed error, which we call a padded answer. Seemingly, it is paradoxical to satisfy the DP definition with one-sided error, but we show how it is possible to bury the paradox into approximate DP's delta parameter. We develop a few mechanisms for one-sided padding mechanisms that always give conservative answers, but still achieve approximate differential privacy. We show how these mechanisms can be applied in a few select areas including making the cardinalities of set intersections and unions revealed in Private Set Intersection protocols differential private and enabling multiparty computation protocols to compute on sparse data which has its exact sizes made differential private rather than performing a fully oblivious more expensive computation.


title: COLIN implies LIN for emergent algebras

abstract: Emergent algebras, first time introduced in arXiv:0907.1520 , are families of quasigroup operations indexed by a commutative group, which satisfy some algebraic relations and also topological (convergence and continuity) relations. Besides sub-riemannian geometry arXiv:math/0608536, they appear as a semantics of a family of graph-rewrite systems related to interaction combinators arXiv:2007.10288, or lambda calculus arXiv:1305.5786 . In arXiv:1807.02058 there is a lambda calculus version of emergent algebras. In this article we prove that for emergent algebras the condition (COLIN), or right-distributivity for emergent algebras, implies (LIN), or left-distributivity for emergent algebras. It means that any emergent algebra which is right-distributive has to come from a commutative group endowed with a family of dilations. This is surprising, because there are many examples of emergent algebras which satisfy (LIN), but not (COLIN), namely those who are associated to non-commutative conical groups, in particular to non-commutative Carnot groups.


title: A QP perspective on topology change in Poisson-Lie T-duality

abstract: We describe topological T-duality and Poisson-Lie T-duality in terms of QP (differential graded symplectic) manifolds and their canonical transformations. Duality is mediated by a QP-manifold on doubled non-abelian "correspondence" space, from which we can perform mutually dual symplectic reductions, where certain canonical transformations play a vital role. In the presence of spectator coordinates, we show how the introduction of "bibundle" structure on correspondence space realises changes in the global fibration structure under Poisson-Lie duality. Our approach can be directly translated to the worldsheet to derive dual string current algebras. Finally, the canonical transformations appearing in our reduction procedure naturally suggest a Fourier-Mukai integral transformation for Poisson-Lie T-duality.


title: Deep Transfer Learning for Blended Source Identification in Galaxy Survey Data

abstract: We present BlendHunter, a proof-of-concept for a deep transfer learning based approach for the automated and robust identification of blended sources in galaxy survey data. We take the VGG-16 network with pre-trained convolutional layers and train the fully connected layers on parametric models of COSMOS images. We test the efficacy of the transfer learning by taking the weights learned on the parametric models and using them to identify blends in more realistic CFIS-like images. We compare the performance of this method to SEP (a Python implementation of SExtractor) as function of noise level and the separation between sources. We find that BlendHunter outperforms SEP by $\sim 15\%$ in terms of classification accuracy for close blends ($<10$ pixel separation between sources) regardless of the noise level used for training. Additionally, the method provides consistent results to SEP for distant blends ($\geq10$ pixel separation between sources) provided the network is trained on data with a relatively close noise standard deviation to the target images. The code and data have been made publicly available to ensure the reproducibility of the results.


title: Loosely coupled, non-iterative time-splitting scheme based on Robin-Robin coupling: unified analysis for parabolic/parabolic and parabolic/hyperbolic problems

abstract: We present a loosely coupled, non-iterative time-splitting scheme based on Robin-Robin coupling conditions. We apply a novel unified analysis for this scheme applied to both a Parabolic/Parabolic coupled system and a Parabolic/Hyperbolic coupled system. We show for both systems that the scheme is stable, and the error converges as $\mathcal{O}\big(\Delta t \sqrt{T +\log{\frac{1}{\Delta t}}}\big)$, where $\Delta t$ is the time step


title: The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color

abstract: Recent work has raised concerns about the inherent limitations of text-only pretraining. In this paper, we first demonstrate that reporting bias, the tendency of people to not state the obvious, is one of the causes of this limitation, and then investigate to what extent multimodal training can mitigate this issue. To accomplish this, we 1) generate the Color Dataset (CoDa), a dataset of human-perceived color distributions for 521 common objects; 2) use CoDa to analyze and compare the color distribution found in text, the distribution captured by language models, and a human's perception of color; and 3) investigate the performance differences between text-only and multimodal models on CoDa. Our results show that the distribution of colors that a language model recovers correlates more strongly with the inaccurate distribution found in text than with the ground-truth, supporting the claim that reporting bias negatively impacts and inherently limits text-only training. We then demonstrate that multimodal models can leverage their visual training to mitigate these effects, providing a promising avenue for future research.


title: Rescaling the isospin triangle argument for constraining $\phi_2$ ($\alpha$): consolidating Belle II and a potential path forward for LHCb

abstract: A rescaling of the SU(2) isospin triangles constraining $\phi_2$ ($\alpha$) that relies on measurements of the experimentally cleaner relative branching fractions, as opposed to those absolute, is proposed. Paving the way towards more systematically sustainable analysis, this method promises to eliminate a dominant systematic at Belle II amongst others, namely the uncertainty on the number of $B \bar B$ pairs in data. Furthermore, a $\phi_2$ constraint in the $B \to \rho \rho$ system at LHCb that is more independent of Belle II input is shown to become viable even without a measurement of $C\!P$ violation in $B^0 \to \rho^+\rho^-$.


title: Top-quark production at approximate N$^3$LO

abstract: I discuss recent theoretical results with soft-gluon corrections for various top-quark production processes through approximate N$^3$LO, including soft anomalous dimensions through three loops. I present numerical results for total cross sections and differential distributions for top-pair and $tW$ production as well as for three-particle final states with a top quark and a Higgs boson. I show that soft-gluon corrections are dominant for a large range of collider energies.


title: Propagation on Multi-relational Graphs for Node Regression

abstract: Recent years have witnessed a rise in real-world data captured with rich structural information that can be conveniently depicted by multi-relational graphs. While inference of continuous node features across a simple graph is rather under-studied by the current relational learning research, we go one step further and focus on node regression problem on multi-relational graphs. We take inspiration from the well-known label propagation algorithm aiming at completing categorical features across a simple graph and propose a novel propagation framework for completing missing continuous features at the nodes of a multi-relational and directed graph. Our multi-relational propagation algorithm is composed of iterative neighborhood aggregations which originate from a relational local generative model. Our findings show the benefit of exploiting the multi-relational structure of the data in several node regression scenarios in different settings.


title: Bound-Preserving Finite-Volume Schemes for Systems of Continuity Equations with Saturation

abstract: We propose finite-volume schemes for general continuity equations which preserve positivity and global bounds that arise from saturation effects in the mobility function. In the case of gradient flows, the schemes dissipate the free energy at the fully discrete level. Moreover, these schemes are generalised to coupled systems of non-linear continuity equations, such as multispecies models in mathematical physics or biology, preserving the bounds and the dissipation of the energy whenever applicable. These results are illustrated through extensive numerical simulations which explore known behaviours in biology and showcase new phenomena not yet described by the literature.


title: Crop Rotation Modeling for Deep Learning-Based Parcel Classification from Satellite Time Series

abstract: While annual crop rotations play a crucial role for agricultural optimization, they have been largely ignored for automated crop type mapping. In this paper, we take advantage of the increasing quantity of annotated satellite data to propose the first deep learning approach modeling simultaneously the inter- and intra-annual agricultural dynamics of parcel classification. Along with simple training adjustments, our model provides an improvement of over 6.3 mIoU points over the current state-of-the-art of crop classification. Furthermore, we release the first large-scale multi-year agricultural dataset with over 300,000 annotated parcels.


title: Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation

abstract: Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level labeling, we present a method for semi-supervised point cloud semantic segmentation to adopt unlabeled point clouds in training to boost the model performance. Inspired by the recent contrastive loss in self-supervised tasks, we propose the guided point contrastive loss to enhance the feature representation and model generalization ability in semi-supervised setting. Semantic predictions on unlabeled point clouds serve as pseudo-label guidance in our loss to avoid negative pairs in the same category. Also, we design the confidence guidance to ensure high-quality feature learning. Besides, a category-balanced sampling strategy is proposed to collect positive and negative samples to mitigate the class imbalance problem. Extensive experiments on three datasets (ScanNet V2, S3DIS, and SemanticKITTI) show the effectiveness of our semi-supervised method to improve the prediction quality with unlabeled data.


title: Non-Gaussianity in inflationary scenarios for primordial black holes

abstract: Working in an idealised framework in which a series of phases of evolution defined by the second slow-roll parameter $\eta$ are matched together, we calculate the reduced bispectrum, $f_{\rm NL}$, for models of inflation with a large peak in their primordial power spectra. We find $f_{\rm NL}$ is typically approximately constant over scales at which the peak is located, and provide an analytic approximation for this value. This allows us to identify the conditions under which $f_{\rm NL}$ is large enough to have a significant impact on the resulting production of primordial black holes (PBHs) and scalar induced gravitational waves (SIGWs). Together with analytic formulae for the gradient of the rise and fall in the power spectrum, this provides a toolkit for designing or quickly analysing inflationary models that produce PBHs and SIGWs.


title: Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm

abstract: Conventional wisdom in pruning Transformer-based language models is that pruning reduces the model expressiveness and thus is more likely to underfit rather than overfit. However, under the trending pretrain-and-finetune paradigm, we postulate a counter-traditional hypothesis, that is: pruning increases the risk of overfitting when performed at the fine-tuning phase. In this paper, we aim to address the overfitting problem and improve pruning performance via progressive knowledge distillation with error-bound properties. We show for the first time that reducing the risk of overfitting can help the effectiveness of pruning under the pretrain-and-finetune paradigm. Ablation studies and experiments on the GLUE benchmark show that our method outperforms the leading competitors across different tasks.


title: Why don't people use character-level machine translation?

abstract: We present a literature and empirical survey that critically assesses the state of the art in character-level modeling for machine translation (MT). Despite evidence in the literature that character-level systems are comparable with subword systems, they are virtually never used in competitive setups in WMT competitions. We empirically show that even with recent modeling innovations in character-level natural language processing, character-level MT systems still struggle to match their subword-based counterparts. Character-level MT systems show neither better domain robustness, nor better morphological generalization, despite being often so motivated. However, we are able to show robustness towards source side noise and that translation quality does not degrade with increasing beam size at decoding time.


title: Attention meets Geometry: Geometry Guided Spatial-Temporal Attention for Consistent Self-Supervised Monocular Depth Estimation

abstract: Inferring geometrically consistent dense 3D scenes across a tuple of temporally consecutive images remains challenging for self-supervised monocular depth prediction pipelines. This paper explores how the increasingly popular transformer architecture, together with novel regularized loss formulations, can improve depth consistency while preserving accuracy. We propose a spatial attention module that correlates coarse depth predictions to aggregate local geometric information. A novel temporal attention mechanism further processes the local geometric information in a global context across consecutive images. Additionally, we introduce geometric constraints between frames regularized by photometric cycle consistency. By combining our proposed regularization and the novel spatial-temporal-attention module we fully leverage both the geometric and appearance-based consistency across monocular frames. This yields geometrically meaningful attention and improves temporal depth stability and accuracy compared to previous methods.


title: BBQ: A Hand-Built Bias Benchmark for Question Answering

abstract: It is well documented that NLP models learn social biases, but little work has been done on how these biases manifest in model outputs for applied tasks like question answering (QA). We introduce the Bias Benchmark for QA (BBQ), a dataset of question sets constructed by the authors that highlight attested social biases against people belonging to protected classes along nine social dimensions relevant for U.S. English-speaking contexts. Our task evaluates model responses at two levels: (i) given an under-informative context, we test how strongly responses reflect social biases, and (ii) given an adequately informative context, we test whether the model's biases override a correct answer choice. We find that models often rely on stereotypes when the context is under-informative, meaning the model's outputs consistently reproduce harmful biases in this setting. Though models are more accurate when the context provides an informative answer, they still rely on stereotypes and average up to 3.4 percentage points higher accuracy when the correct answer aligns with a social bias than when it conflicts, with this difference widening to over 5 points on examples targeting gender for most models tested.