title: Modeling of Energy Consumption and Streaming Video QoE using a Crowdsourcing Dataset

abstract: In the past decade, we have witnessed an enormous growth in the demand for online video services. Recent studies estimate that nowadays, more than 1% of the global greenhouse gas emissions can be attributed to the production and use of devices performing online video tasks. As such, research on the true power consumption of devices and their energy efficiency during video streaming is highly important for a sustainable use of this technology. At the same time, over-the-top providers strive to offer high-quality streaming experiences to satisfy user expectations. Here, energy consumption and QoE partly depend on the same system parameters. Hence, a joint view is needed for their evaluation. In this paper, we perform a first analysis of both end-user power efficiency and Quality of Experience of a video streaming service. We take a crowdsourced dataset comprising 447,000 streaming events from YouTube and estimate both the power consumption and perceived quality. The power consumption is modeled based on previous work which we extended towards predicting the power usage of different devices and codecs. The user-perceived QoE is estimated using a standardized model. Our results indicate that an intelligent choice of streaming parameters can optimize both the QoE and the power efficiency of the end user device. Further, the paper discusses limitations of the approach and identifies directions for future research.


title: Borel $(\alpha,\beta)$-multitransforms and Quantum Leray-Hirsch: integral representations of solutions of quantum differential equations for $\mathbb P^1$-bundles

abstract: In this paper, we address the integration problem of the isomonodromic system of quantum differential equations ($qDE$s) associated with the quantum cohomology of $\mathbb P^1$-bundles on Fano varieties. It is shown that bases of solutions of the $qDE$ of the total space of the $\mathbb P^1$-bundle can be reconstructed from the datum of bases of solutions of the corresponding $qDE$ associated with the base space. This represents a quantum analog of the classical Leray-Hirsch theorem in the context of the isomonodromic approach to quantum cohomology. The reconstruction procedure of the solutions can be performed in terms of some integral transforms, introduced in arXiv:2005.08262, called $Borel$ $(\alpha,\beta)$-$multitransf\!orms$. We emphasize the emergence, in the explicit integral formulas, of an interesting sequence of special functions (closely related to iterated partial derivatives of the B\"ohmer-Tricomi incomplete Gamma function) as integral kernels. Remarkably, these integral kernels have a universal feature, being independent of the specifically chosen $\mathbb P^1$-bundle. When applied to projective bundles on products of projective spaces, our results give Mellin-Barnes integral representations of solutions of $qDE$s. As an example, we show how to integrate the $qDE$ of blow-up of $\mathbb P^2$ at one point via Borel multitransforms of solutions of the $qDE$ of $\mathbb P^1$.


title: Disentangling Causal Effects from Sets of Interventions in the Presence of Unobserved Confounders

abstract: The ability to answer causal questions is crucial in many domains, as causal inference allows one to understand the impact of interventions. In many applications, only a single intervention is possible at a given time. However, in some important areas, multiple interventions are concurrently applied. Disentangling the effects of single interventions from jointly applied interventions is a challenging task -- especially as simultaneously applied interventions can interact. This problem is made harder still by unobserved confounders, which influence both treatments and outcome. We address this challenge by aiming to learn the effect of a single-intervention from both observational data and sets of interventions. We prove that this is not generally possible, but provide identification proofs demonstrating that it can be achieved under non-linear continuous structural causal models with additive, multivariate Gaussian noise -- even when unobserved confounders are present. Importantly, we show how to incorporate observed covariates and learn heterogeneous treatment effects. Based on the identifiability proofs, we provide an algorithm that learns the causal model parameters by pooling data from different regimes and jointly maximizing the combined likelihood. The effectiveness of our method is empirically demonstrated on both synthetic and real-world data.


title: The Design and Regulation of Exchanges: A Formal Approach

abstract: We use formal methods to specify, design, and monitor continuous double auctions, which are widely used to match buyers and sellers at exchanges of foreign currencies, stocks, and commodities. We identify three natural properties of such auctions and formally prove that these properties completely determine the input-output relationship. We then formally verify that a natural algorithm satisfies these properties. All definitions, theorems, and proofs are formalized in an interactive theorem prover. We extract a verified program of our algorithm to build an automated checker that is guaranteed to detect errors in the trade logs of exchanges if they generate transactions that violate any of the natural properties.


title: A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learning

abstract: Open ad hoc teamwork is the problem of training a single agent to efficiently collaborate with an unknown group of teammates whose composition may change over time. A variable team composition creates challenges for the agent, such as the requirement to adapt to new team dynamics and dealing with changing state vector sizes. These challenges are aggravated in real-world applications in which the controlled agent only has a partial view of the environment. In this work, we develop a class of solutions for open ad hoc teamwork under full and partial observability. We start by developing a solution for the fully observable case that leverages graph neural network architectures to obtain an optimal policy based on reinforcement learning. We then extend this solution to partially observable scenarios by proposing different methodologies that maintain belief estimates over the latent environment states and team composition. These belief estimates are combined with our solution for the fully observable case to compute an agent's optimal policy under partial observability in open ad hoc teamwork. Empirical results demonstrate that our solution can learn efficient policies in open ad hoc teamwork in fully and partially observable cases. Further analysis demonstrates that our methods' success is a result of effectively learning the effects of teammates' actions while also inferring the inherent state of the environment under partial observability.


title: Real-world CMB lensing quadratic estimator power spectrum response

abstract: I describe a method to estimate response matrices of Cosmic Microwave Background (CMB) lensing power spectra estimators to the true sky power under realistic conditions. Applicable to all lensing reconstruction pipelines based on quadratic estimators (QE), it uses a small number of Gaussian CMB Monte-Carlos and specially designed QE's in order to obtain sufficiently accurate matrices with little computational effort. This method may be used to improve the modelling of CMB lensing band-powers by incorporating at least some of the non-idealities encountered in CMB lensing reconstruction. These non-idealities always include masking, and often inhomogeneous filtering, either in the harmonic domain or pixel space. I obtain these matrices for Planck latest lensing reconstructions, and then show that the residual couplings induced by masking explain very well the residual multiplicative bias seen on the Planck simulations, removing the need for an empirical correction.


title: Forecast of Cosmological Constraints with Type Ia Supernovae from the Chinese Space Station Telescope

abstract: The 2-m aperture Chinese Space Station Telescope (CSST), which observes at wavelengths ranging from 255 to 1000 nm, is expected to start science operations in 2024. An ultra-deep field observation program covering approximately 10 square degrees is proposed with supernovae (SNe) and other transients as one of its primary science drivers. This paper presents the simulated detection results of type Ia supernovae (SNe Ia) and explores the impact of new datasets on the determinations of cosmological parameters. The simulated observations are conducted with an exposure time of 150 s and cadences of 10, 20, and 30 days. The survey mode covering a total of 80 observations but with a random cadence in the range of 4 to 14 days is also explored. Our simulation results indicate that the CSST can detect up to $\sim 1800$ SNe Ia at z $<$ 1.3. The simulated SNe Ia are then used to constrain the cosmological parameters. The constraint on $\Omega_m$ can be improved by 37.5% using the 10-day cadence sample in comparison with the Pantheon sample. A deeper measurement simulation with a 300 s exposure time together with the Pantheon sample improves the current constraints on $\Omega_m$ by 58.3% and $\omega$ by 47.7%. Taking future ground-based SNe Ia surveys into consideration, the constraints on $\omega$ can be improved by 59.1%. The CSST ultra-deep field observation program is expected to discover large amounts of SNe Ia over a broad redshift span and enhance our understanding of the nature of dark energy.


title: Enabling ISP-less Low-Power Computer Vision

abstract: In order to deploy current computer vision (CV) models on resource-constrained low-power devices, recent works have proposed in-sensor and in-pixel computing approaches that try to partly/fully bypass the image signal processor (ISP) and yield significant bandwidth reduction between the image sensor and the CV processing unit by downsampling the activation maps in the initial convolutional neural network (CNN) layers. However, direct inference on the raw images degrades the test accuracy due to the difference in covariance of the raw images captured by the image sensors compared to the ISP-processed images used for training. Moreover, it is difficult to train deep CV models on raw images, because most (if not all) large-scale open-source datasets consist of RGB images. To mitigate this concern, we propose to invert the ISP pipeline, which can convert the RGB images of any dataset to its raw counterparts, and enable model training on raw images. We release the raw version of the COCO dataset, a large-scale benchmark for generic high-level vision tasks. For ISP-less CV systems, training on these raw images result in a 7.1% increase in test accuracy on the visual wake works (VWW) dataset compared to relying on training with traditional ISP-processed RGB datasets. To further improve the accuracy of ISP-less CV models and to increase the energy and bandwidth benefits obtained by in-sensor/in-pixel computing, we propose an energy-efficient form of analog in-pixel demosaicing that may be coupled with in-pixel CNN computations. When evaluated on raw images captured by real sensors from the PASCALRAW dataset, our approach results in a 8.1% increase in mAP. Lastly, we demonstrate a further 20.5% increase in mAP by using a novel application of few-shot learning with thirty shots each for the novel PASCALRAW dataset, constituting 3 classes.


title: On asymptotically linear elliptic problems

abstract: In this paper we prove the existence of a signed ground state solution in the mountain pass level for a class of asymptotically linear elliptic problems, even when the nonlinearity is just continuous in the second variable. The (strongly) resonant and non-resonant cases are discussed. A multiplicity result is also proved when $f$ is odd with respect to the second variable.


title: The characteristics of flare- and CME-productive solar active regions

abstract: Solar flares and coronal mass ejections (CMEs) cause immediate and adverse effects on the interplanetary space and geospace. The deeper understanding of the mechanisms that produce them and the construction of efficient prediction schemes are of paramount importance. The source regions of flares and CMEs exhibit some common morphological characteristics associated with strongly sheared magnetic polarity inversion lines, indicative of the complex magnetic configurations that store huge amounts of free magnetic energy and helicity. This knowledge is transformed into parameters that can help us distinguish efficiently between quiet, flare-, and CME-productive active regions. Nonetheless, flare and CME prediction still faces a number of challenges. The magnetic field information is constrained at the photosphere and accessed only from one vantage point of observation; the dynamic behavior of active regions is still not fully incorporated into predictions; the stochasticity of flares and CMEs renders their prediction probabilistic. To meet these challenges, new properties have been put forward to describe different aspects of magnetic energy storage mechanisms in active regions and offer the opportunity of parametric studies for over an entire solar cycle. This inventory of predictors now includes information from flow fields, transition region/coronal spectroscopy, data-driven modeling of the coronal magnetic field, as well as parameterizations of dynamic effects from time series. Further work towards these directions may help alleviate the current limitations in observing the magnetic field of higher atmospheric layers. This paper reviews these efforts as well as the importance of transforming new knowledge into more efficient predictors and including new types of data.


title: Low Complexity Convolutional Neural Networks for Equalization in Optical Fiber Transmission

abstract: A convolutional neural network is proposed to mitigate fiber transmission effects, achieving a five-fold reduction in trainable parameters compared to alternative equalizers, and 3.5 dB improvement in MSE compared to DBP with comparable complexity.


title: Unlabelled Sample Compression Schemes for Intersection-Closed Classes and Extremal Classes

abstract: The sample compressibility of concept classes plays an important role in learning theory, as a sufficient condition for PAC learnability, and more recently as an avenue for robust generalisation in adaptive data analysis. Whether compression schemes of size $O(d)$ must necessarily exist for all classes of VC dimension $d$ is unknown, but conjectured to be true by Warmuth. Recently Chalopin, Chepoi, Moran, and Warmuth (2018) gave a beautiful unlabelled sample compression scheme of size VC dimension for all maximum classes: classes that meet the Sauer-Shelah-Perles Lemma with equality. They also offered a counterexample to compression schemes based on a promising approach known as corner peeling. In this paper we simplify and extend their proof technique to deal with so-called extremal classes of VC dimension $d$ which contain maximum classes of VC dimension $d-1$. A criterion is given which would imply that all extremal classes admit unlabelled compression schemes of size $d$. We also prove that all intersection-closed classes with VC dimension $d$ admit unlabelled compression schemes of size at most $11d$.


title: Revisiting the Cox and Munk wave-slope statistics using IASI observations of the sea surface

abstract: We use radiances collected from space by the Infrared Atmospheric Sounder Interferometer (IASI) when looking down at ocean surfaces during the day to remotely determine the probability distribution of wave slopes. This is achieved by using about 300 channels between 3.6 and 4.0 $\mu$m and a physically-based approach which properly takes the contribution of the reflected solar radiation into account. Based on about 150 million observations, the same number of wave-slope probabilities are retrieved for wind speeds up to 15 m/s. We revisit and discuss the methodology proposed by Cox and Munk (CM) to derive their celebrated wave-slope probability distribution function (pdf) from photographs of the sun glitter. We propose an original and robust approach for accurate retrievals of the 7 parameters appearing in the Gram-Charlier representation of the pdf. Our results for the mean square slopes are fully compatible with those of CM, and with the more recent results by Br\'eon and Henriot, but our lower uncertainties enable us to point out departures from the linear wind-speed dependencies and a slight overestimation of the upwind MSS described by the linear fit of CM at moderate wind speed. Our skewness and kurtosis coefficients show clear influences of the wind speed, with a steady decrease of the former and the alongwind kurtosis coefficient being maximal at moderate wind speeds, features that CM could not point out due to the limitations of their measurements. We revisit the renormalization procedure employed by CM to obtain the complete variances from truncated pdf and show that it imposes stringent conditions on the kurtosis coefficients that allow us to determine them accurately, with wind-dependent values specific to the local sea state.


title: Are Pretrained Multilingual Models Equally Fair Across Languages?

abstract: Pretrained multilingual language models can help bridge the digital language divide, enabling high-quality NLP models for lower resourced languages. Studies of multilingual models have so far focused on performance, consistency, and cross-lingual generalisation. However, with their wide-spread application in the wild and downstream societal impact, it is important to put multilingual models under the same scrutiny as monolingual models. This work investigates the group fairness of multilingual models, asking whether these models are equally fair across languages. To this end, we create a new four-way multilingual dataset of parallel cloze test examples (MozArt), equipped with demographic information (balanced with regard to gender and native tongue) about the test participants. We evaluate three multilingual models on MozArt -- mBERT, XLM-R, and mT5 -- and show that across the four target languages, the three models exhibit different levels of group disparity, e.g., exhibiting near-equal risk for Spanish, but high levels of disparity for German.


title: Single-photon hot electron ionization of C$_{70}$

abstract: Gas phase C$_{70}$ molecules have been ionized with single photons of energies between 16 eV and 70 eV and the electron spectra measured with velocity map imaging in coincidence with the ions. The doubly ionized and unfragmented species was present at photon energies of 22 eV and up, and triply charged ions from 55 eV. The low kinetic energy parts of the spectra are explained with thermal emission of transient hot electrons. Deviations at high photon energies are used to determine a value for the initial electron equilibration time. We propose a generally applicable mechanism, named Resonance Ionization Shadowing, for the creation of hot electrons by absorption of above-threshold energy photons.


title: Unsupervised classification of the spectrogram zeros

abstract: The zeros of the spectrogram have proven to be a relevant feature to describe the time-frequency structure of a signal, originated by the destructive interference between components in the time-frequency plane. In this work, a classification of these zeros in three types is introduced, based on the nature of the components that interfere to produce them. Echoing noise-assisted methods, a classification algorithm is proposed based on the addition of independent noise realizations to build a 2D histogram describing the stability of zeros. Features extracted from this histogram are later used to classify the zeros using a non-supervised clusterization algorithm. A denoising approach based on the classification of the spectrogram zeros is also introduced. Examples of the classification of zeros are given for synthetic and real signals, as well as a performance comparison of the proposed denoising algorithm with another zero-based approach.


title: Automorphisms of some variants of fine graphs

abstract: Recently Bowden, Hensel and Webb defined the fine curve graph for surfaces, extending the notion of curve graphs for the study of homeomorphism or diffeomorphism groups of surfaces. Later Long, Margalit, Pham, Verberne and Yao proved that for a closed surface of genus $g\geqslant 2$, the automorphism group of the fine graph is naturally isomorphic to the homeomorphism group of the surface. We extend this result to the torus case $g=1$; in fact our method works for more general surfaces, compact or not, orientable or not. We also discuss the case of a smooth version of the fine graph.


title: FreGAN: Exploiting Frequency Components for Training GANs under Limited Data

abstract: Training GANs under limited data often leads to discriminator overfitting and memorization issues, causing divergent training. Existing approaches mitigate the overfitting by employing data augmentations, model regularization, or attention mechanisms. However, they ignore the frequency bias of GANs and take poor consideration towards frequency information, especially high-frequency signals that contain rich details. To fully utilize the frequency information of limited data, this paper proposes FreGAN, which raises the model's frequency awareness and draws more attention to producing high-frequency signals, facilitating high-quality generation. In addition to exploiting both real and generated images' frequency information, we also involve the frequency signals of real images as a self-supervised constraint, which alleviates the GAN disequilibrium and encourages the generator to synthesize adequate rather than arbitrary frequency signals. Extensive results demonstrate the superiority and effectiveness of our FreGAN in ameliorating generation quality in the low-data regime (especially when training data is less than 100). Besides, FreGAN can be seamlessly applied to existing regularization and attention mechanism models to further boost the performance.


title: A Geometric Perspective on Bayesian and Generalized Fiducial Inference

abstract: Post-data statistical inference concerns making probability statements about model parameters conditional on observed data. When a priori knowledge about parameters is available, post-data inference can be conveniently made from Bayesian posteriors. In the absence of prior information, we may still rely on objective Bayes or generalized fiducial inference (GFI). Inspired by approximate Bayesian computation, we propose a novel characterization of post-data inference with the aid of differential geometry. Under suitable smoothness conditions, we establish that Bayesian posteriors and generalized fiducial distributions (GFDs) can be respectively characterized by absolutely continuous distributions supported on the same differentiable manifold: The manifold is uniquely determined by the observed data and the data generating equation of the fitted model. Our geometric analysis not only sheds light on the connection and distinction between Bayesian inference and GFI, but also allows us to sample from posteriors and GFDs using manifold Markov chain Monte Carlo algorithms. A repeated-measures analysis of variance example is presented to illustrate the sampling procedure.


title: Large-to-small Image Resolution Asymmetry in Deep Metric Learning

abstract: Deep metric learning for vision is trained by optimizing a representation network to map (non-)matching image pairs to (non-)similar representations. During testing, which typically corresponds to image retrieval, both database and query examples are processed by the same network to obtain the representation used for similarity estimation and ranking. In this work, we explore an asymmetric setup by light-weight processing of the query at a small image resolution to enable fast representation extraction. The goal is to obtain a network for database examples that is trained to operate on large resolution images and benefits from fine-grained image details, and a second network for query examples that operates on small resolution images but preserves a representation space aligned with that of the database network. We achieve this with a distillation approach that transfers knowledge from a fixed teacher network to a student via a loss that operates per image and solely relies on coupled augmentations without the use of any labels. In contrast to prior work that explores such asymmetry from the point of view of different network architectures, this work uses the same architecture but modifies the image resolution. We conclude that resolution asymmetry is a better way to optimize the performance/efficiency trade-off than architecture asymmetry. Evaluation is performed on three standard deep metric learning benchmarks, namely CUB200, Cars196, and SOP. Code: https://github.com/pavelsuma/raml


title: Correlations and linewidth of the atomic beam continuous superradiant laser

abstract: We propose a minimalistic model to account for the main properties of a continuous superradiant laser, in which a beam of atoms crosses the mode of a high-finesse Fabry-Perot cavity, and collectively emits light into the cavity mode. We focus on the case of weak single atom - cavity cooperativity, and highlight the relevant regime where decoherence due to the finite transit time dominates over spontaneous emission. We propose an original approach where the dynamics of atoms entering and leaving the cavity is described by a Hamiltonian process. This allows deriving the main dynamical equations for the superradiant laser, without the need for a stochastic approach. We derive analytical conditions for a sustained emission and show that the ultimate linewidth is set by the fundamental quantum fluctuations of the collective atomic dipole. We calculate steady-state values of the two-body correlators and show that the continuous superradiant regime is tied to the growth of atom-atom correlations, although these correlations only have a small impact on the laser linewidth.


title: Ultrafast electron localization and screening in a transition metal dichalcogenide

abstract: The coupling of light to electrical charge carriers in semiconductors is the foundation of many technological applications. Attosecond transient absorption spectroscopy measures simultaneously how excited electrons and the vacancies they leave behind dynamically react to the applied optical fields. In compound semiconductors, these dynamics can be probed via any of their atomic constituents. Often, the atomic species forming the compound contribute comparably to the relevant electronic properties of the material. One therefore expects to observe similar dynamics, irrespective of the choice of atomic species via which it is probed. Here, we show in the two-dimensional transition metal dichalcogenide semiconductor $MoSe_2$, that through a selenium-based transition we observe charge carriers acting independently from each other, while when probed through molybdenum, the collective, many-body motion of the carriers dominates. Such unexpectedly contrasting behavior can be traced back to a strong localization of electrons around molybdenum atoms following absorption of light, which modifies the local fields acting on the carriers. We show that similar behavior in elemental titanium metal carries over to transition metal-containing compounds and is expected to play an essential role for a wide range of such materials. Knowledge of independent particle and collective response is essential for fully understanding these materials.


title: SRF Cavity Emulator for PIP-II LLRF Lab and Field Testing

abstract: There are many stages in the LLRF and RF system development process for any new accelerator that can take advantage of hardware emulation of the high-power RF system and RF cavities. LLRF development, bench testing, control system development and testing of installed systems must happen well before SRF cavities are available for test. The PIP-II Linac has three frequencies of SRF cavities, 162.5 MHz, 325 MHz and 650 MHz and a simple analog emulator design has been chosen that can meet the cavity bandwidth requirements, provide tuning errors to emulate Lorentz force detuning and microphonics for all cavity types. This emulator design utilizes a quartz crystal with a bandwidth of 65Hz at an IF of ~ 4 MHz, providing a Q of ~ 1.3 x 10^7 at 650MHz. This paper will discuss the design and test results of this emulator.


title: Instabilities and turbulence in stellarators from the perspective of global codes

abstract: In this work, a comparison of the global gyrokinetic codes EUTERPE and GENE-3D in stellarator configurations of LHD and W7-X is carried out. In linear simulations with adiabatic electrons, excellent agreement is found in the mode numbers, growth rate and frequency, mode structure, and spatial localization of the most unstable mode in LHD. In W7-X, the dependence of the growth rate and frequency with the mode number is well reproduced by both codes. The codes are also compared in linear simulations with kinetic ions and electrons in W7-X using model profiles, and reasonable agreement is found in the wavenumber of the most unstable modes. A stabilization of small-scale modes in kinetic-electron simulations with respect to the adiabatic-electron case is consistently found in both codes. Nonlinear simulations using adiabatic electrons and model profiles are also studied and the heat fluxes are compared. Very good agreement is found in the turbulent ion heat fluxes in both LHD and W7-X. Two problems that cannot be properly accounted for in local flux tube codes are studied: the localization of instabilities and turbulence over the flux surface and the influence of a background long-wavelength electric field. Good agreement between codes is found with respect to the spatial localization of instabilities and turbulence over the flux surface. The localization of saturated turbulence is found in both codes to be much smaller than that of the linear instabilities and smaller than previously reported in full-surface radially-local simulations. The influence of the electric field on the localization is also found to be smaller in the developed turbulent state than in the linear phase, and smaller than in previous works. A stabilizing effect of a constant electric field on the linearly unstable modes is found in both codes. A moderate reduction of turbulent transport by the radial electric field...


title: High-precision Density Mapping of Marine Debris and Floating Plastics via Satellite Imagery

abstract: Combining multi-spectral satellite data and machine learning has been suggested as a method for monitoring plastic pollutants in the ocean environment. Recent studies have made theoretical progress regarding the identification of marine plastic via machine learning. However, no study has assessed the application of these methods for mapping and monitoring marine-plastic density. As such, this paper comprised of three main components: (1) the development of a machine learning model, (2) the construction of the MAP-Mapper, an automated tool for mapping marine-plastic density, and finally (3) an evaluation of the whole system for out-of-distribution test locations. The findings from this paper leverage the fact that machine learning models need to be high-precision to reduce the impact of false positives on results. The developed MAP-Mapper architectures provide users choices to reach high-precision ($\textit{abbv.}$ -HP) or optimum precision-recall ($\textit{abbv.}$ -Opt) values in terms of the training/test data set. Our MAP-Mapper-HP model greatly increased the precision of plastic detection to 95\%, whilst MAP-Mapper-Opt reaches precision-recall pair of 87\%-88\%. The MAP-Mapper contributes to the literature with the first tool to exploit advanced deep/machine learning and multi-spectral imagery to map marine-plastic density in automated software. The proposed data pipeline has taken a novel approach to map plastic density in ocean regions. As such, this enables an initial assessment of the challenges and opportunities of this method to help guide future work and scientific study.


title: On the Partial Differential L\"{u}roth's Theorem

abstract: We study the L\"{u}roth problem for partial differential fields. The main result is the following partial differential analog of generalized L\"{u}roth's theorem: Let $\mathcal{F}$ be a differential field of characteristic 0 with $m$ derivation operators, $\textbf{u}=u_1,\ldots,u_n$ a set of differential indeterminates over $\mathcal{F}$. We prove that an intermediate differential field $\mathcal{G}$ between $\mathcal{F}$ and $\mathcal{F}\langle \textbf{u}\rangle$ is a simple differential extension of $\mathcal{F}$ if and only if the differential dimension polynomial of $\textbf{u}$ over $\mathcal{G}$ is of the form $\omega_{\textbf{u}/\mathcal{G}}(t)=n{t+m\choose m}-{t+m-s\choose m}$ for some $s\in\mathbb N$. This result generalizes the classical differential L\"uroth's theorem proved by Ritt and Kolchin in the case $m=n=1$. We then present an algorithm to decide whether a given finitely generated differential extension field of $\mathcal{F}$ contained in $\mathcal{F}\langle \textbf{u}\rangle$ is a simple extension, and in the affirmative case, to compute a L\"{u}roth generator. As an application, we solve the proper re-parameterization problem for unirational differential curves.


title: Block Format Error Bounds and Optimal Block Size Selection

abstract: The amounts of data that need to be transmitted, processed, and stored by the modern deep neural networks have reached truly enormous volumes in the last few years calling for the invention of new paradigms both in hardware and software development. One of the most promising and rapidly advancing frontiers here is the creation of new numerical formats. In this work we focus on the family of block floating point numerical formats due to their combination of wide dynamic range, numerical accuracy, and efficient hardware implementation of inner products using simple integer arithmetic. These formats are characterized by a block of mantissas with a shared scale factor. The basic Block Floating Point (BFP) format quantizes the block scales into the nearest powers of two on the right. Its simple modification - Scaled BFP (SBFP) - stores the same scales in full precision and thus allows higher accuracy. In this paper, we study the statistical behavior of both these formats rigorously. We develop asymptotic bounds on the inner product error in SBFP- and BFP-quantized normally distributed vectors. Next, we refine those asymptotic results to finite dimensional settings and derive high-dimensional tight bounds for the same errors. Based on the obtained results we introduce a performance measure assessing accuracy of any block format. This measure allows us to determine the optimal parameters, such as the block size, yielding highest accuracy. In particular, we show that if the precision of the BFP format is fixed at 4 bits, the optimal block size becomes 64. All theoretical derivations are supported by numerical experiments and studies on the weights of publicly available pretrained neural networks.


title: Instance Regularization for Discriminative Language Model Pre-training

abstract: Discriminative pre-trained language models (PrLMs) can be generalized as denoising auto-encoders that work with two procedures, ennoising and denoising. First, an ennoising process corrupts texts with arbitrary noising functions to construct training instances. Then, a denoising language model is trained to restore the corrupted tokens. Existing studies have made progress by optimizing independent strategies of either ennoising or denosing. They treat training instances equally throughout the training process, with little attention on the individual contribution of those instances. To model explicit signals of instance contribution, this work proposes to estimate the complexity of restoring the original sentences from corrupted ones in language model pre-training. The estimations involve the corruption degree in the ennoising data construction process and the prediction confidence in the denoising counterpart. Experimental results on natural language understanding and reading comprehension benchmarks show that our approach improves pre-training efficiency, effectiveness, and robustness. Code is publicly available at https://github.com/cooelf/InstanceReg


title: Tuning Rate of Strategy Revision in Population Games

abstract: We investigate a multi-agent decision problem in population games where each agent in a population makes a decision on strategy selection and revision to engage in repeated games with others. The strategy revision is subject to time delays which represent the time it takes for an agent revising its strategy needs to spend before it can adopt a new strategy and return back to the game. We discuss the effect of the time delays on long-term behavior of the agents' strategy revision. In particular, when the time delays are large, the strategy revision would exhibit oscillation and the agents spend substantial time in "transitioning" between different strategies, which prevents the agents from attaining the Nash equilibrium of the game. As a main contribution of the paper, we propose an algorithm that tunes the rate of the agents' strategy revision and show such tuning approach ensures convergence to the Nash equilibrium. We validate our analytical results using simulations.


title: Components of $V(\rho) \otimes V(\rho)$ and dominant weight polyhedra for affine Kac-Moody Lie algebras

abstract: Kostant asked the following question: Let $\mathfrak{g}$ be a simple Lie algebra over the complex numbers. Let $\lambda$ be a dominant integral weight. Then, $V(\lambda)$ is a component of $V(\rho)\otimes V(\rho)$ if and only if $\lambda \leq 2 \rho$ under the usual Bruhat-Chevalley order on the set of weights. In an earlier work with R. Chirivi and A. Maffei the second author gave an affirmative answer to this question up to a saturation factor. The aim of the current work is to extend this result to untwisted affine Kac-Moody Lie algebra $\mathfrak{g}$ associated to any simple Lie algebra $\mathring{\mathfrak{g}}$ (up to a saturation factor). In fact, we prove the result for affine $sl_n$ without any saturation factor. Our proof requires some additional techniques including the Goddard-Kent-Olive construction and study of the characteristic cone of non-compact polyhedra.


title: Constructing local models for general measurements on bosonic Gaussian states

abstract: We derive a simple sufficient criterion for the locality of correlations obtained from given measurements on a Gaussian quantum state. The criterion is based on the construction of a local-hidden-variable model which works by passing part of the inherent Gaussian noise of the state onto the measurements. We illustrate our result in the setting of displaced photodetection on a two-mode squeezed state. Here, our criterion exhibits the existence of a local-hidden-variable model for a range of parameters where the state is still entangled.


title: GENIE: Higher-Order Denoising Diffusion Solvers

abstract: Denoising diffusion models (DDMs) have emerged as a powerful class of generative models. A forward diffusion process slowly perturbs the data, while a deep model learns to gradually denoise. Synthesis amounts to solving a differential equation (DE) defined by the learnt model. Solving the DE requires slow iterative solvers for high-quality generation. In this work, we propose Higher-Order Denoising Diffusion Solvers (GENIE): Based on truncated Taylor methods, we derive a novel higher-order solver that significantly accelerates synthesis. Our solver relies on higher-order gradients of the perturbed data distribution, that is, higher-order score functions. In practice, only Jacobian-vector products (JVPs) are required and we propose to extract them from the first-order score network via automatic differentiation. We then distill the JVPs into a separate neural network that allows us to efficiently compute the necessary higher-order terms for our novel sampler during synthesis. We only need to train a small additional head on top of the first-order score network. We validate GENIE on multiple image generation benchmarks and demonstrate that GENIE outperforms all previous solvers. Unlike recent methods that fundamentally alter the generation process in DDMs, our GENIE solves the true generative DE and still enables applications such as encoding and guided sampling. Project page and code: https://nv-tlabs.github.io/GENIE.


title: Medha: Microcoded Hardware Accelerator for computing on Encrypted Data

abstract: Homomorphic encryption (HE) enables computation on encrypted data, and hence it has a great potential in privacy-preserving outsourcing of computations to the cloud. Hardware acceleration of HE is crucial as software implementations are very slow. In this paper, we present design methodologies for building a programmable hardware accelerator for speeding up the cloud-side homomorphic evaluations on encrypted data. First, we propose a divide-and-conquer technique that enables homomorphic evaluations in a large polynomial ring $R_{Q,2N}$ to use a hardware accelerator that has been built for the smaller ring $R_{Q,N}$. The technique makes it possible to use a single hardware accelerator flexibly for supporting several HE parameter sets. Next, we present several architectural design methods that we use to realize the flexible and instruction-set accelerator architecture, which we call `Medha'. At every level of the implementation hierarchy, we explore possibilities for parallel processing. Starting from hardware-friendly parallel algorithms for the basic building blocks, we gradually build heavily parallel RNS polynomial arithmetic units. Next, many of these parallel units are interconnected elegantly so that their interconnections require the minimum number of nets, therefore making the overall architecture placement-friendly on the platform. For Medha, we take a memory-conservative design approach and get rid of any off-chip memory access during homomorphic evaluations. Finally, we implement Medha in a Xilinx Alveo U250 FPGA and measure timing performances of the microcoded homomorphic addition, multiplication, key-switching, and rescaling for the leveled HE scheme RNS-HEAAN at 200 MHz clock frequency. For two large parameter sets, Medha achieves accelerations by up to 68x and 78x times respectively compared to a highly optimized software implementation Microsoft SEAL running at 2.3 GHz.


title: Incidence Estimates for Tubes in Complex Space

abstract: In this paper, we prove a complex version of the incidence estimate of Guth, Solomon and Wang for tubes obeying certain strong spacing conditions, and we use one of our new estimates to resolve a discretized variant of Falconer's distance set problem in $\mathbb{C}^2$.


title: Aggregating Layers for Deepfake Detection

abstract: The increasing popularity of facial manipulation (Deepfakes) and synthetic face creation raises the need to develop robust forgery detection solutions. Crucially, most work in this domain assume that the Deepfakes in the test set come from the same Deepfake algorithms that were used for training the network. This is not how things work in practice. Instead, we consider the case where the network is trained on one Deepfake algorithm, and tested on Deepfakes generated by another algorithm. Typically, supervised techniques follow a pipeline of visual feature extraction from a deep backbone, followed by a binary classification head. Instead, our algorithm aggregates features extracted across all layers of one backbone network to detect a fake. We evaluate our approach on two domains of interest - Deepfake detection and Synthetic image detection, and find that we achieve SOTA results.


title: Frequency-Aware Self-Supervised Monocular Depth Estimation

abstract: We present two versatile methods to generally enhance self-supervised monocular depth estimation (MDE) models. The high generalizability of our methods is achieved by solving the fundamental and ubiquitous problems in photometric loss function. In particular, from the perspective of spatial frequency, we first propose Ambiguity-Masking to suppress the incorrect supervision under photometric loss at specific object boundaries, the cause of which could be traced to pixel-level ambiguity. Second, we present a novel frequency-adaptive Gaussian low-pass filter, designed to robustify the photometric loss in high-frequency regions. We are the first to propose blurring images to improve depth estimators with an interpretable analysis. Both modules are lightweight, adding no parameters and no need to manually change the network structures. Experiments show that our methods provide performance boosts to a large number of existing models, including those who claimed state-of-the-art, while introducing no extra inference computation at all.


title: T5 for Hate Speech, Augmented Data and Ensemble

abstract: We conduct relatively extensive investigations of automatic hate speech (HS) detection using different state-of-the-art (SoTA) baselines over 11 subtasks of 6 different datasets. Our motivation is to determine which of the recent SoTA models is best for automatic hate speech detection and what advantage methods like data augmentation and ensemble may have on the best model, if any. We carry out 6 cross-task investigations. We achieve new SoTA on two subtasks - macro F1 scores of 91.73% and 53.21% for subtasks A and B of the HASOC 2020 dataset, where previous SoTA are 51.52% and 26.52%, respectively. We achieve near-SoTA on two others - macro F1 scores of 81.66% for subtask A of the OLID 2019 dataset and 82.54% for subtask A of the HASOC 2021 dataset, where SoTA are 82.9% and 83.05%, respectively. We perform error analysis and use two explainable artificial intelligence (XAI) algorithms (IG and SHAP) to reveal how two of the models (Bi-LSTM and T5) make the predictions they do by using examples. Other contributions of this work are 1) the introduction of a simple, novel mechanism for correcting out-of-class (OOC) predictions in T5, 2) a detailed description of the data augmentation methods, 3) the revelation of the poor data annotations in the HASOC 2021 dataset by using several examples and XAI (buttressing the need for better quality control), and 4) the public release of our model checkpoints and codes to foster transparency.


title: Better Than Whitespace: Information Retrieval for Languages without Custom Tokenizers

abstract: Tokenization is a crucial step in information retrieval, especially for lexical matching algorithms, where the quality of indexable tokens directly impacts the effectiveness of a retrieval system. Since different languages have unique properties, the design of the tokenization algorithm is usually language-specific and requires at least some lingustic knowledge. However, only a handful of the 7000+ languages on the planet benefit from specialized, custom-built tokenization algorithms, while the other languages are stuck with a "default" whitespace tokenizer, which cannot capture the intricacies of different languages. To address this challenge, we propose a different approach to tokenization for lexical matching retrieval algorithms (e.g., BM25): using the WordPiece tokenizer, which can be built automatically from unsupervised data. We test the approach on 11 typologically diverse languages in the MrTyDi collection: results show that the mBERT tokenizer provides strong relevance signals for retrieval "out of the box", outperforming whitespace tokenization on most languages. In many cases, our approach also improves retrieval effectiveness when combined with existing custom-built tokenizers.


title: Descriptive complexity of the generalized spectra of graphs

abstract: Two graphs are cospectral if their respective adjacency matrices have the same multiset of eigenvalues, and generalized cospectral if they are cospectral and so are their complements. We study generalized cospectrality in relation to logical definability. We show that any pair of graphs that are elementary equivalent with respect to the three-variable counting first-order logic $C^3$ are generalized cospectral, and this is not the case with $C^2$, nor with any number of variables if we exclude counting quantifiers. Using this result we provide a new characterization of the well-known class of distance-regular graphs using the logic $C^3$. We also show that, for controllable graphs (it is known that almost all graphs are controllable), the elementary equivalence in $C^2$ coincides with isomorphism.


title: Reversibility, Irreversibility, Friction and nonequilibrium ensembles in N-S equations

abstract: Viscosity, as a physical property of fluids, reflects an average effect over a chaotic microscopic motion described by Hamiltonian equations. It is proposed, as an example, that stationary states of an incompressible fluid subject to a constant force, can be described via several ensembles, in strict analogy with equilibrium Statistcal Mechanics.


title: Equivariance-aware Architectural Optimization of Neural Networks

abstract: Incorporating equivariance to symmetry groups as a constraint during neural network training can improve performance and generalization for tasks exhibiting those symmetries, but such symmetries are often not perfectly nor explicitly present. This motivates algorithmically optimizing the architectural constraints imposed by equivariance. We propose the equivariance relaxation morphism, which preserves functionality while reparameterizing a group equivariant layer to operate with equivariance constraints on a subgroup, as well as the [G]-mixed equivariant layer, which mixes layers constrained to different groups to enable within-layer equivariance optimization. We further present evolutionary and differentiable neural architecture search (NAS) algorithms that utilize these mechanisms respectively for equivariance-aware architectural optimization. Experiments across a variety of datasets show the benefit of dynamically constrained equivariance to find effective architectures with approximate equivariance.


title: Cavity-enhanced zero-phonon emission from an ensemble of G centers in a silicon-on-insulator microring

abstract: We report successful incorporation of an ensemble of G centers in silicon-on-insulator (SOI) microrings using ion implantation and conventional nanofabrication. The coupling between the emitters and the resonant modes of the microrings is studied using continuous-wave and time-resolved microphotoluminescence (PL) experiments. We observe the resonant modes of the microrings on PL spectra, on the wide spectral range that is covered by G centers emission. By finely tuning the size of the microrings, we match their zero-phonon line at 1278 nm with a resonant mode of quality factor around 3000 and volume 7.2 (lambda over n)^3. The zero-phonon line intensity is enhanced by a factor of 5, both in continuous-wave and time-resolved measurements. This is attributed to the Purcell enhancement of zero-phonon spontaneous emission into the resonant mode and quantitatively understood considering the distribution of the G centers dipoles. Despite the enhancement of the zero-phonon emission, we do not observe any sizeable decrease of the average lifetime of the G centers, which points at a low radiative yield (<10%). We reveal the detrimental impact of parasitic defects in heavily implanted silicon, and discuss the perspectives for quantum electrodynamics experiments with individual color centers in lightly implanted SOI rings. Our results provide key information for the development of deterministic single photon sources for integrated quantum photonics.


title: Pulsating H-deficient WDs and pre-WDs observed with TESS: V. Discovery of two new DBV pulsators, WD J152738.4-450207.4 and WD 1708-871, and asteroseismology of the already known DBV stars PG 1351+489, EC 20058-5234, and EC 04207-4748

abstract: The {\sl TESS} space mission has recently demonstrated its great potential to discover new pulsating white dwarf and pre-white dwarf stars, and to detect periodicities with high precision in already known white-dwarf pulsators. We report the discovery of two new pulsating He-rich atmosphere white dwarfs (DBVs) and present a detailed asteroseismological analysis of three already known DBV stars employing observations collected by the {\sl TESS} mission along with ground-based data. We extracted frequencies from the {\sl TESS} light curves of these DBV stars using a standard pre-whitening procedure to derive the potential pulsation frequencies. All the oscillation frequencies that we found are associated with $g$-mode pulsations with periods spanning from $\sim 190$ s to $\sim 936$ s. We find hints of rotation from frequency triplets in some of the targets, including the two new DBVs. For three targets, we find constant period spacings, which allowed us to infer their stellar masses and constrain the harmonic degree $\ell$ of the modes. We also performed period-to-period fit analyses and found an asteroseismological model for three targets, with stellar masses generally compatible with the spectroscopic masses. Obtaining seismological models allowed us to estimate the seismological distances and compare them with the precise astrometric distances measured with {\it Gaia}. We find a good agreement between the seismic and the astrometric distances for three stars (PG~1351+489, EC~20058$-$5234, and EC~04207$-$4748), although for the other two stars (WD~J152738.4$-$50207 and WD~1708$-$871), the discrepancies are substantial. The high-quality data from the {\sl TESS} mission continue to provide important clues to determine the internal structure of pulsating pre-white dwarf and white dwarf stars through the tools of asteroseismology.


title: Like a bilingual baby: The advantage of visually grounding a bilingual language model

abstract: Unlike most neural language models, humans learn language in a rich, multi-sensory and, often, multi-lingual environment. Current language models typically fail to fully capture the complexities of multilingual language use. We train an LSTM language model on images and captions in English and Spanish from MS-COCO-ES. We find that the visual grounding improves the model's understanding of semantic similarity both within and across languages and improves perplexity. However, we find no significant advantage of visual grounding for abstract words. Our results provide additional evidence of the advantages of visually grounded language models and point to the need for more naturalistic language data from multilingual speakers and multilingual datasets with perceptual grounding.


title: A Note on Slice Rank and Matchings in Groups

abstract: A multiplicative 3-matching in a group $G$ is a triple of sets $\{a_i\}, \{b_i\}, \{c_i\} \subset G$ such that $a_ib_jc_k = 1$ if and only if $i=j=k$. Here we record the fact that $\text{PSL}(2,p)$ has no multiplicative 3-matching of size greater than $O(p^{8/3})$, yet the slice rank of its group algebra's multiplication tensor is at least $\Omega(p^3)$ over any field. This gives a negative answer to a conjecture of Petrov.


title: Generating Approximate Ground States of Molecules Using Quantum Machine Learning

abstract: The potential energy surface (PES) of molecules with respect to their nuclear positions is a primary tool in understanding chemical reactions from first principles. However, obtaining this information is complicated by the fact that sampling a large number of ground states over a high-dimensional PES can require a vast number of state preparations. In this work, we propose using a generative quantum machine learning model to prepare quantum states at arbitrary points on the PES. The model is trained using quantum data consisting of ground-state wavefunctions associated with different classical nuclear coordinates. Our approach uses a classical neural network to convert the nuclear coordinates of a molecule into quantum parameters of a variational quantum circuit. The model is trained using a fidelity loss function to optimize the neural network parameters. We show that gradient evaluation is efficient and numerically demonstrate our method's ability to prepare wavefunctions on the PES of hydrogen chains, water, and beryllium hydride. In all cases, we find that a small number of training points are needed to achieve very high overlap with the groundstates in practice. From a theoretical perspective, we further prove limitations on these protocols by showing that if we were able to learn across an avoided crossing using a small number of samples, then we would be able to violate Grover's lower bound. Additionally, we prove lower bounds on the amount of quantum data needed to learn a locally optimal neural network function using arguments from quantum Fisher information. This work further identifies that quantum chemistry can be an important use case for quantum machine learning.


title: Pooling Strategies for Simplicial Convolutional Networks

abstract: The goal of this paper is to introduce pooling strategies for simplicial convolutional neural networks. Inspired by graph pooling methods, we introduce a general formulation for a simplicial pooling layer that performs: i) local aggregation of simplicial signals; ii) principled selection of sampling sets; iii) downsampling and simplicial topology adaptation. The general layer is then customized to design four different pooling strategies (i.e., max, top-k, self-attention, and separated top-k) grounded in the theory of topological signal processing. Also, we leverage the proposed layers in a hierarchical architecture that reduce complexity while representing data at different resolutions. Numerical results on real data benchmarks (i.e., flow and graph classification) illustrate the advantage of the proposed methods with respect to the state of the art.


title: Strong negation in the theory of computable functionals TCF

abstract: We incorporate strong negation in the theory of computable functionals TCF, a common extension of Plotkin's PCF and G\"{o}del's system $\mathbf{T}$, by defining simultaneously strong negation $A^{\mathbf{N}}$ of a formula $A$ and strong negation $P^{\mathbf{N}}$ of a predicate $P$ in TCF. As a special case of the latter, we get strong negation of an inductive and a coinductive predicate of TCF. We prove appropriate versions of the Ex falso quodlibet and of double negation elimination for strong negation in TCF. We introduce the so-called tight formulas of TCF i.e., formulas implied from the weak negation of their strong negation, and the relative tight formulas. We present various case-studies and examples, which reveal the naturality of our definition of strong negation in TCF and justify the use of TCF as a formal system for a large part of Bishop-style constructive mathematics.


title: Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planning

abstract: No-press Diplomacy is a complex strategy game involving both cooperation and competition that has served as a benchmark for multi-agent AI research. While self-play reinforcement learning has resulted in numerous successes in purely adversarial games like chess, Go, and poker, self-play alone is insufficient for achieving optimal performance in domains involving cooperation with humans. We address this shortcoming by first introducing a planning algorithm we call DiL-piKL that regularizes a reward-maximizing policy toward a human imitation-learned policy. We prove that this is a no-regret learning algorithm under a modified utility function. We then show that DiL-piKL can be extended into a self-play reinforcement learning algorithm we call RL-DiL-piKL that provides a model of human play while simultaneously training an agent that responds well to this human model. We used RL-DiL-piKL to train an agent we name Diplodocus. In a 200-game no-press Diplomacy tournament involving 62 human participants spanning skill levels from beginner to expert, two Diplodocus agents both achieved a higher average score than all other participants who played more than two games, and ranked first and third according to an Elo ratings model.


title: Perturbative boundaries of quantum computing: real-time evolution for digitized lambda phi^4 lattice models

abstract: The real time evolution of quantum field theory models can be calculated order by order in perturbation theory. For $\lambda \phi^4$ models, the perturbative series have a zero radius of convergence which in part motivated the design of digitized versions suitable for quantum computing. In agreement with general arguments suggesting that a large field cutoff modifies Dyson's reasoning and improves convergence properties, we show that the harmonic digitizations of $\lambda \phi^4$ lattice field theories lead to weak coupling expansions with a finite radius of convergence. Similar convergence properties are found for strong coupling expansions. We compare the resources needed to calculate the real-time evolution of the digitized models with perturbative expansions to those needed to do so with universal quantum computers. Unless new approximate methods can be designed to calculate long perturbative series for large systems efficiently, it appears that the use of universal quantum computers with digitizations involving a few qubits per site has the potential for more efficient calculations of the real-time evolution for large systems at intermediate coupling.

categories: quant-ph cond-mat.stat-mech hep-lat hep-th


title: Map-free Visual Relocalization: Metric Pose Relative to a Single Image

abstract: Can we relocalize in a scene represented by a single reference image? Standard visual relocalization requires hundreds of images and scale calibration to build a scene-specific 3D map. In contrast, we propose Map-free Relocalization, i.e., using only one photo of a scene to enable instant, metric scaled relocalization. Existing datasets are not suitable to benchmark map-free relocalization, due to their focus on large scenes or their limited variability. Thus, we have constructed a new dataset of 655 small places of interest, such as sculptures, murals and fountains, collected worldwide. Each place comes with a reference image to serve as a relocalization anchor, and dozens of query images with known, metric camera poses. The dataset features changing conditions, stark viewpoint changes, high variability across places, and queries with low to no visual overlap with the reference image. We identify two viable families of existing methods to provide baseline results: relative pose regression, and feature matching combined with single-image depth prediction. While these methods show reasonable performance on some favorable scenes in our dataset, map-free relocalization proves to be a challenge that requires new, innovative solutions.


title: MAgNet: Mesh Agnostic Neural PDE Solver

abstract: The computational complexity of classical numerical methods for solving Partial Differential Equations (PDE) scales significantly as the resolution increases. As an important example, climate predictions require fine spatio-temporal resolutions to resolve all turbulent scales in the fluid simulations. This makes the task of accurately resolving these scales computationally out of reach even with modern supercomputers. As a result, current numerical modelers solve PDEs on grids that are too coarse (3km to 200km on each side), which hinders the accuracy and usefulness of the predictions. In this paper, we leverage the recent advances in Implicit Neural Representations (INR) to design a novel architecture that predicts the spatially continuous solution of a PDE given a spatial position query. By augmenting coordinate-based architectures with Graph Neural Networks (GNN), we enable zero-shot generalization to new non-uniform meshes and long-term predictions up to 250 frames ahead that are physically consistent. Our Mesh Agnostic Neural PDE Solver (MAgNet) is able to make accurate predictions across a variety of PDE simulation datasets and compares favorably with existing baselines. Moreover, MAgNet generalizes well to different meshes and resolutions up to four times those trained on.


title: Experiment Design for Identification of Marine Models

abstract: In this work, experiment design for marine vessels is explored. A dictionary-based approach is used, i.e., a systematic way of choosing the most informative combination of independent experiments out of a predefined set of candidates. This idea is quite general but is here tailored to an instrumental variable (IV) estimator with zero-mean instruments. This type of estimator is well-suited to deal with parameter estimation for second-order modulus models, which is a class of models often used to describe motion of marine vessels. The method is evaluated using both simulated and real data, the latter from a small model ship as well as from a full-scale vessel. Further, a standard motion-planning problem is modified to account for the prior-made choice of information-optimal sub-experiments, which makes it possible to obtain a plan for the complete experiment in the form of a feasible trajectory.


title: Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models

abstract: Fine-tuning large pretrained language models on a limited training corpus usually suffers from poor generalization. Prior works show that the recently-proposed sharpness-aware minimization (SAM) optimization method can improve the model generalization. However, SAM adds a perturbation to each model parameter equally (but not all parameters contribute equally to the optimization of training), which we argue is sub-optimal and will lead to excessive computation. In this paper, we propose a novel optimization procedure, namely FSAM, which introduces a Fisher mask to improve the efficiency and performance of SAM. In short, instead of adding perturbation to all parameters, FSAM uses the Fisher information to identity the important parameters and formulates a Fisher mask to obtain the sparse perturbation, i.e., making the optimizer focus on these important parameters. Experiments on various tasks in GLUE and SuperGLUE benchmarks show that FSAM consistently outperforms the vanilla SAM by 0.67~1.98 average score among four different pretrained models. We also empirically show that FSAM works well in other complex scenarios, e.g., fine-tuning on generation tasks or limited training data. Encouragingly, when training data is limited, FSAM improves the SAM by a large margin, i.e., up to 15.1.


title: Adversarial Contrastive Learning for Evidence-aware Fake News Detection with Graph Neural Networks

abstract: The prevalence and perniciousness of fake news have been a critical issue on the Internet, which stimulates the development of automatic fake news detection in turn. In this paper, we focus on evidence-based fake news detection, where several evidences are utilized to probe the veracity of news (i.e., a claim). Most previous methods first employ sequential models to embed the semantic information and then capture the claim-evidence interaction based on attention mechanisms. Despite their effectiveness, they still suffer from three weaknesses. Firstly, sequential models fail to integrate the relevant information that is scattered far apart in evidences. Secondly, they underestimate much redundant information in evidences may be useless or harmful. Thirdly, insufficient data utilization limits the separability and reliability of representations captured by the model. To solve these problems, we propose a unified Graph-based sEmantic structure mining framework with ConTRAstive Learning, namely GETRAL in short. Specifically, we first model claims and evidences as graph-structured data to capture the long-distance semantic dependency. Consequently, we reduce information redundancy by performing graph structure learning. Then the fine-grained semantic representations are fed into the claim-evidence interaction module for predictions. Finally, an adversarial contrastive learning module is applied to make full use of data and strengthen representation learning. Comprehensive experiments have demonstrated the superiority of GETRAL over the state-of-the-arts and validated the efficacy of semantic mining with graph structure and contrastive learning.


title: Capturing Global Structural Information in Long Document Question Answering with Compressive Graph Selector Network

abstract: Long document question answering is a challenging task due to its demands for complex reasoning over long text. Previous works usually take long documents as non-structured flat texts or only consider the local structure in long documents. However, these methods usually ignore the global structure of the long document, which is essential for long-range understanding. To tackle this problem, we propose Compressive Graph Selector Network (CGSN) to capture the global structure in a compressive and iterative manner. The proposed model mainly focuses on the evidence selection phase of long document question answering. Specifically, it consists of three modules: local graph network, global graph network and evidence memory network. Firstly, the local graph network builds the graph structure of the chunked segment in token, sentence, paragraph and segment levels to capture the short-term dependency of the text. Secondly, the global graph network selectively receives the information of each level from the local graph, compresses them into the global graph nodes and applies graph attention to the global graph nodes to build the long-range reasoning over the entire text in an iterative way. Thirdly, the evidence memory network is designed to alleviate the redundancy problem in the evidence selection by saving the selected result in the previous steps. Extensive experiments show that the proposed model outperforms previous methods on two datasets.


title: Phase transitions for nonsingular Bernoulli actions

abstract: Inspired by the phase transition results for nonsingular Gaussian actions introduced in arXiv:1911.04272, we prove several phase transition results for nonsingular Bernoulli actions. For generalized Bernoulli actions arising from groups acting on trees, we are able to give a very precise description of their ergodic theoretical properties in terms of the Poincar\'e exponent of the group.


title: Pound-Drever-Hall locking scheme free from Trojan operating points

abstract: The Pound-Drever-Hall (PDH) technique is a popular method for stabilizing the frequency of a laser to a stable optical resonator or, vice versa, the length of a resonator to the frequency of a stable laser. We propose a refinement of the technique yielding an "infinite" dynamic (capture) range so that a resonator is correctly locked to the seed frequency, even after large perturbations. The stable but off-resonant lock points (also called Trojan operating points), present in conventional PDH error signals, are removed by phase modulating the seed laser at a frequency corresponding to half the free spectral range of the resonator. We verify the robustness of our scheme experimentally by realizing an injection-seeded Yb:YAG thin-disk laser. We also give an analytical formulation of the PDH error signal for arbitrary modulation frequencies and discuss the parameter range for which our PDH locking scheme guarantees correct locking. Our scheme is simple as it does not require additional electronics apart from the standard PDH setup and is particularly suited to realize injection-seeded lasers and injection-seeded optical parametric oscillators.


title: A new shape optimization approach for fracture propagation

abstract: Within this work, we present a novel approach to fracture simulations based on shape optimization techniques. Contrary to widely-used phase-field approaches in literature the proposed method does not require a specified 'length-scale' parameter defining the diffused interface region of the phase-field. We provide the formulation and discuss the used solution approach. We conclude with some numerical comparisons with well-established single-edge notch tension and shear tests.


title: Exploring SMEFT operators in the tHq production at the LHC

abstract: We study the top-quark production along with a Higgs boson and a jet (tHq) at the LHC experiment within the framework of the Standard Model Effective Field Theory (SMEFT). A strategy is developed to constrain the Wilson Coefficients (WC) corresponding to the associated SMEFT operators using the latest LHC measurements. The best-fit values of these WCs are presented. Finally, we demonstrate the feasibility of finding the effects of these operators on various kinematical observables of the tHq process at the LHC. We find that for a set of best-fitted values of the considered WCs, the excess of signal over the backgrounds can be achieved with a reasonable significance at the center of mass energy $\sqrt{s}=13$ TeV and for integrated luminosity options ${\cal L}=$300 $\rm fb^{-1}$ and 3000 $\rm fb^{-1}$.


title: Isotropization of a rotating and longitudinally expanding $\phi^4$ scalar system

abstract: We present numerical simulations for the evolution of an expanding system of massless scalar fields with quartic coupling. By setting a rotating, non-isotropic initial configuration, we compute the energy density, the transverse and longitudinal pressures and the angular momentum of the system. We compare the time scales associated with the isotropization and the decay of the initial angular momentum due to the expansion, and show that even for fairly large initial angular momentum, it decays significantly faster than the pressure anisotropy.


title: Quasar and galaxy classification using Gaia EDR3 and CatWise2020

abstract: In this work, we assess the combined use of Gaia photometry and astrometry with infrared data from CatWISE in improving the identification of extragalactic sources compared to the classification obtained using Gaia data. We evaluate different input feature configurations and prior functions, with the aim of presenting a classification methodology integrating prior knowledge stemming from realistic class distributions in the universe. In our work, we compare different classifiers, namely Gaussian Mixture Models (GMMs), XGBoost and CatBoost, and classify sources into three classes - star, quasar, and galaxy, with the target quasar and galaxy class labels obtained from SDSS16 and the star label from Gaia EDR3. In our approach, we adjust the posterior probabilities to reflect the intrinsic distribution of extragalactic sources in the universe via a prior function. We introduce two priors, a global prior reflecting the overall rarity of quasars and galaxies, and a mixed prior that incorporates in addition the distribution of the these sources as a function of Galactic latitude and magnitude. Our best classification performances, in terms of completeness and purity of the galaxy and quasar classes, are achieved using the mixed prior for sources at high latitudes and in the magnitude range G = 18.5 to 19.5. We apply our identified best-performing classifier to three application datasets from Gaia DR3, and find that the global prior is more conservative in what it considers to be a quasar or a galaxy compared to the mixed prior. In particular, when applied to the pure quasar and galaxy candidates samples, we attain a purity of 97% for quasars and 99.9% for galaxies using the global prior, and purities of 96% and 99% respectively using the mixed prior. We conclude our work by discussing the importance of applying adjusted priors portraying realistic class distributions in the universe.


title: Extracting Meaningful Attention on Source Code: An Empirical Study of Developer and Neural Model Code Exploration

abstract: The high effectiveness of neural models of code, such as OpenAI Codex and AlphaCode, suggests coding capabilities of models that are at least comparable to those of humans. However, previous work has only used these models for their raw completion, ignoring how the model reasoning, in the form of attention weights, can be used for other downstream tasks. Disregarding the attention weights means discarding a considerable portion of what those models compute when queried. To profit more from the knowledge embedded in these large pre-trained models, this work compares multiple approaches to post-process these valuable attention weights for supporting code exploration. Specifically, we compare to which extent the transformed attention signal of CodeGen, a large and publicly available pretrained neural model, agrees with how developers look at and explore code when each answering the same sense-making questions about code. At the core of our experimental evaluation, we collect, manually annotate, and open-source a novel eye-tracking dataset comprising 25 developers answering sense-making questions on code over 92 sessions. We empirically evaluate five attention-agnostic heuristics and ten attention-based post processing approaches of the attention signal against our ground truth of developers exploring code, including the novel concept of follow-up attention which exhibits the highest agreement. Beyond the dataset contribution and the empirical study, we also introduce a novel practical application of the attention signal of pre-trained models with completely analytical solutions, going beyond how neural models' attention mechanisms have traditionally been used.


title: The Sphaleron Rate from 4D Euclidean Lattices

abstract: We develop a new method to determine thermal activation rates, such as for bubble nucleation, topology change, \textsl{etc.}, using 4-dimensional Euclidean methods. This allows nonperturbative study on the lattice. We then investigate the strong sphaleron rate in pure-glue QCD at temperatures between 1.3 $\Tc$ and 1000 $T_\mathrm{c}$, making contact with previous results but extending them down close to the critical temperature. The extension to full QCD will be straightforward. Limitations of the proposal (the inability to compute a certain dynamical prefactor, puzzling large-volume behavior, and the inability to treat temperatures $T < 1.3 \, T_\mathrm{c}$) are also discussed.


title: Detect, Distill and Update: Learned DB Systems Facing Out of Distribution Data

abstract: Machine Learning (ML) is changing DBs as many DB components are being replaced by ML models. One open problem in this setting is how to update such ML models in the presence of data updates. We start this investigation focusing on data insertions (dominating updates in analytical DBs). We study how to update neural network (NN) models when new data follows a different distribution (a.k.a. it is "out-of-distribution" -- OOD), rendering previously-trained NNs inaccurate. A requirement in our problem setting is that learned DB components should ensure high accuracy for tasks on old and new data (e.g., for approximate query processing (AQP), cardinality estimation (CE), synthetic data generation (DG), etc.). This paper proposes a novel updatability framework (DDUp). DDUp can provide updatability for different learned DB system components, even based on different NNs, without the high costs to retrain the NNs from scratch. DDUp entails two components: First, a novel, efficient, and principled statistical-testing approach to detect OOD data. Second, a novel model updating approach, grounded on the principles of transfer learning with knowledge distillation, to update learned models efficiently, while still ensuring high accuracy. We develop and showcase DDUp's applicability for three different learned DB components, AQP, CE, and DG, each employing a different type of NN. Detailed experimental evaluation using real and benchmark datasets for AQP, CE, and DG detail DDUp's performance advantages.


title: Finding the global semantic representation in GAN through Frechet Mean

abstract: The ideally disentangled latent space in GAN involves the global representation of latent space with semantic attribute coordinates. In other words, considering that this disentangled latent space is a vector space, there exists the global semantic basis where each basis component describes one attribute of generated images. In this paper, we propose an unsupervised method for finding this global semantic basis in the intermediate latent space in GANs. This semantic basis represents sample-independent meaningful perturbations that change the same semantic attribute of an image on the entire latent space. The proposed global basis, called Fr\'echet basis, is derived by introducing Fr\'echet mean to the local semantic perturbations in a latent space. Fr\'echet basis is discovered in two stages. First, the global semantic subspace is discovered by the Fr\'echet mean in the Grassmannian manifold of the local semantic subspaces. Second, Fr\'echet basis is found by optimizing a basis of the semantic subspace via the Fr\'echet mean in the Special Orthogonal Group. Experimental results demonstrate that Fr\'echet basis provides better semantic factorization and robustness compared to the previous methods. Moreover, we suggest the basis refinement scheme for the previous methods. The quantitative experiments show that the refined basis achieves better semantic factorization while constrained on the same semantic subspace given by the previous method.


title: Disorder effects on the metastability of classical Heisenberg ferromagnets

abstract: In the present work, we investigate the effects of disorder on the reversal time ($\tau$) of classical anisotropic Heisenberg ferromagnets in three dimensions by means of Monte Carlo simulations. Starting from the pure system, our analysis suggests that $\tau$ increases with increasing anisotropy strength. On the other hand, for the case of randomly distributed anisotropy, generated from various statistical distributions, a set of results is obtained: (i) For both bimodal and uniform distributions the variation of $\tau$ with the strength of anisotropy strongly depends on temperature. (ii) At lower temperatures, the decrement in $\tau$ with increasing width of the distribution is more prominent. (iii) For the case of normally distributed anisotropy, the variation of $\tau$ with the width of the distribution is non-monotonic, featuring a minimum value that decays exponentially with the temperature. Finally, we elaborate on the joint effect of longitudinal ($h_z$) and transverse ($h_x$) fields on $\tau$, which appear to obey a scaling behavior of the form $\tau h_z^{n} \sim f(h_x)$.


title: Quantum metrology using time-frequency as quantum continuous variables: Resources, sub shot-noise precision and phase space representation

abstract: We study the role of the electromagnetic field's frequency in time precision measurements using single photons as a paradigmatic system. For such, we independently identify the contributions of intensity and spectral resources and show that both can play a role on the scaling of the precision of parameter estimation with the number of probes. We show in particular that it is possible to observe a quadratic scaling using quantum mode correlations only and explicit the mathematical expression of states saturating the Heisenberg limit. We also provide a geometrical and phase space interpretation of our results, and observe a curious quantum-to-classical-like transition on scaling by modifying the spectral variance of states. Our results connect discrete and continuous aspects of single photons and quantum optics by considering from a quantum mechanical perspective the role of frequency.


title: On the Interpolation of Contextualized Term-based Ranking with BM25 for Query-by-Example Retrieval

abstract: Term-based ranking with pre-trained transformer-based language models has recently gained attention as they bring the contextualization power of transformer models into the highly efficient term-based retrieval. In this work, we examine the generalizability of two of these deep contextualized term-based models in the context of query-by-example (QBE) retrieval in which a seed document acts as the query to find relevant documents. In this setting -- where queries are much longer than common keyword queries -- BERT inference at query time is problematic as it involves quadratic complexity. We investigate TILDE and TILDEv2, both of which leverage BERT tokenizer as their query encoder. With this approach, there is no need for BERT inference at query time, and also the query can be of any length. Our extensive evaluation on the four QBE tasks of SciDocs benchmark shows that in a query-by-example retrieval setting TILDE and TILDEv2 are still less effective than a cross-encoder BERT ranker. However, we observe that BM25 could show a competitive ranking quality compared to TILDE and TILDEv2 which is in contrast to the findings about the relative performance of these three models on retrieval for short queries reported in prior work. This result raises the question about the use of contextualized term-based ranking models being beneficial in QBE setting. We follow-up on our findings by studying the score interpolation between the relevance score from TILDE (TILDEv2) and BM25. We conclude that these two contextualized term-based ranking models capture different relevance signals than BM25 and combining the different term-based rankers results in statistically significant improvements in QBE retrieval. Our work sheds light on the challenges of retrieval settings different from the common evaluation benchmarks.


title: ViFiCon: Vision and Wireless Association Via Self-Supervised Contrastive Learning

abstract: We introduce ViFiCon, a self-supervised contrastive learning scheme which uses synchronized information across vision and wireless modalities to perform cross-modal association. Specifically, the system uses pedestrian data collected from RGB-D camera footage as well as WiFi Fine Time Measurements (FTM) from a user's smartphone device. We represent the temporal sequence by stacking multi-person depth data spatially within a banded image. Depth data from RGB-D (vision domain) is inherently linked with an observable pedestrian, but FTM data (wireless domain) is associated only to a smartphone on the network. To formulate the cross-modal association problem as self-supervised, the network learns a scene-wide synchronization of the two modalities as a pretext task, and then uses that learned representation for the downstream task of associating individual bounding boxes to specific smartphones, i.e. associating vision and wireless information. We use a pre-trained region proposal model on the camera footage and then feed the extrapolated bounding box information into a dual-branch convolutional neural network along with the FTM data. We show that compared to fully supervised SoTA models, ViFiCon achieves high performance vision-to-wireless association, finding which bounding box corresponds to which smartphone device, without hand-labeled association examples for training data.


title: Scanning cavity microscopy of a single-crystal diamond membrane

abstract: Spin-bearing color centers in the solid state are promising candidates for the realization of quantum networks and distributed quantum computing. A remaining key challenge is their efficient and reliable interfacing to photons. Incorporating minimally processed membranes into open-access microcavities represents a promising route for Purcellenhanced spin-photon interfaces: it enables significant emission enhancement and efficient photon collection, minimizes deteriorating influence on the quantum emitter, and allows for full spatial and spectral tunability, key for controllably addressing suitable emitters with desired optical and spin properties. Here, we study the properties of a high-finesse fiber Fabry-P\'erot microcavity with integrated single-crystal diamond membranes by scanning cavity microscopy. We observe spatially resolved the effects of the diamond-air interface on the cavity mode structure: a strong correlation of the cavity finesse and mode structure with the diamond thickness and surface topography, significant transverse-mode mixing under diamond-like conditions, and mode-character-dependent polarization-mode splitting. Our results reveal the influence of the diamond surface on the achievable Purcell enhancement, which helps to clarify the route towards optimized spin-photon interfaces.


title: Topological charge pumping with subwavelength Raman lattices

abstract: Recent experiments demonstrated deeply subwavelength lattices using atoms with $N$ internal states Raman-coupled with lasers of wavelength $\lambda$. The resulting unit cell was $\lambda/2N$ in extent, an $N$-fold reduction compared to the usual $\lambda/2$ periodicity of an optical lattice. For resonant Raman coupling, this lattice consists of $N$ independent sinusoidal potentials (with period $\lambda/2$) displaced by $\lambda/2N$ from each other. We show that detuning from Raman resonance induces tunneling between these potentials. Periodically modulating the detuning couples the $s$- and $p$-bands of the potentials, creating a pair of coupled subwavelength Rice--Mele chains. This operates as a novel topological charge pump that counter-intuitively can give half the displacement per pump cycle of each individual Rice--Mele chain separately. We analytically describe this behavior in terms of infinite-system Chern numbers, and numerically identify the associated finite-system edge states.


title: Rates of convergence in the free central limit theorem

abstract: We study the free central limit theorem for not necessarily identically distributed free random variables where the limiting distribution is the semicircle distribution. Starting from an estimate for the Kolmogorov distance between the measure of suitably normalized sums of free random variables and the semicircle distribution without any moment condition, we show the free Lindeberg central limit theorem and improve the known results on rates of convergence under the conditions of the existence of the third moments.


title: DeepMLE: A Robust Deep Maximum Likelihood Estimator for Two-view Structure from Motion

abstract: Two-view structure from motion (SfM) is the cornerstone of 3D reconstruction and visual SLAM (vSLAM). Many existing end-to-end learning-based methods usually formulate it as a brute regression problem. However, the inadequate utilization of traditional geometry model makes the model not robust in unseen environments. To improve the generalization capability and robustness of end-to-end two-view SfM network, we formulate the two-view SfM problem as a maximum likelihood estimation (MLE) and solve it with the proposed framework, denoted as DeepMLE. First, we propose to take the deep multi-scale correlation maps to depict the visual similarities of 2D image matches decided by ego-motion. In addition, in order to increase the robustness of our framework, we formulate the likelihood function of the correlations of 2D image matches as a Gaussian and Uniform mixture distribution which takes the uncertainty caused by illumination changes, image noise and moving objects into account. Meanwhile, an uncertainty prediction module is presented to predict the pixel-wise distribution parameters. Finally, we iteratively refine the depth and relative camera pose using the gradient-like information to maximize the likelihood function of the correlations. Extensive experimental results on several datasets prove that our method significantly outperforms the state-of-the-art end-to-end two-view SfM approaches in accuracy and generalization capability.


title: Autonomous Asteroid Characterization Through Nanosatellite Swarming

abstract: This paper first defines a class of estimation problem called simultaneous navigation and characterization (SNAC), which is a superset of simultaneous localization and mapping (SLAM). A SNAC framework is then developed for the Autonomous Nanosatellite Swarming (ANS) mission concept to autonomously navigate about and characterize an asteroid including the asteroid gravity field, rotational motion, and 3D shape. The ANS SNAC framework consists of three modules: 1) multi-agent optical landmark tracking and 3D point reconstruction using stereovision, 2) state estimation through a computationally efficient and robust unscented Kalman filter, and 3) reconstruction of an asteroid spherical harmonic shape model by leveraging a priori knowledge of the shape properties of celestial bodies. Despite significant interest in asteroids, there are several limitations to current asteroid rendezvous mission concepts. First, completed missions heavily rely on human oversight and Earth-based resources. Second, proposed solutions to increase autonomy make oversimplifying assumptions about state knowledge and information processing. Third, asteroid mission concepts often opt for high size, weight, power, and cost (SWaP-C) avionics for environmental measurements. Finally, such missions often utilize a single spacecraft, neglecting the benefits of distributed space systems. In contrast, ANS is composed of multiple autonomous nanosatellites equipped with low SWaP-C avionics. The ANS SNAC framework is validated through a numerical simulation of three spacecraft orbiting asteroid 433 Eros. The simulation results demonstrate that the proposed architecture provides autonomous and accurate SNAC in a safe manner without an a priori shape model and using only low SWaP-C avionics.


title: Robust and Controllable Object-Centric Learning through Energy-based Models

abstract: Humans are remarkably good at understanding and reasoning about complex visual scenes. The capability to decompose low-level observations into discrete objects allows us to build a grounded abstract representation and identify the compositional structure of the world. Accordingly, it is a crucial step for machine learning models to be capable of inferring objects and their properties from visual scenes without explicit supervision. However, existing works on object-centric representation learning either rely on tailor-made neural network modules or strong probabilistic assumptions in the underlying generative and inference processes. In this work, we present \ours, a conceptually simple and general approach to learning object-centric representations through an energy-based model. By forming a permutation-invariant energy function using vanilla attention blocks readily available in Transformers, we can infer object-centric latent variables via gradient-based MCMC methods where permutation equivariance is automatically guaranteed. We show that \ours can be easily integrated into existing architectures and can effectively extract high-quality object-centric representations, leading to better segmentation accuracy and competitive downstream task performance. Further, empirical evaluations show that \ours's learned representations are robust against distribution shift. Finally, we demonstrate the effectiveness of \ours in systematic compositional generalization, by re-composing learned energy functions for novel scene generation and manipulation.


title: On the convexity of the quaternionic essential numerical range

abstract: The numerical range in the quaternionic setting is, in general, a non convex subset of the quaternions. The essential numerical range is a refinement of the numerical range that only keeps the elements that have, in a certain sense, infinite multiplicity. We prove that the essential numerical range of a bounded linear operator on a quaternionic Hilbert space is convex. A quaternionic analogue of Lancaster theorem, relating the closure of the numerical range and its essential numerical range, is also provided.


title: Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval

abstract: Inverted file structure is a common technique for accelerating dense retrieval. It clusters documents based on their embeddings; during searching, it probes nearby clusters w.r.t. an input query and only evaluates documents within them by subsequent codecs, thus avoiding the expensive cost of exhaustive traversal. However, the clustering is always lossy, which results in the miss of relevant documents in the probed clusters and hence degrades retrieval quality. In contrast, lexical matching, such as overlaps of salient terms, tends to be strong feature for identifying relevant documents. In this work, we present the Hybrid Inverted Index (HI$^2$), where the embedding clusters and salient terms work collaboratively to accelerate dense retrieval. To make best of both effectiveness and efficiency, we devise a cluster selector and a term selector, to construct compact inverted lists and efficiently searching through them. Moreover, we leverage simple unsupervised algorithms as well as end-to-end knowledge distillation to learn these two modules, with the latter further boosting the effectiveness. Based on comprehensive experiments on popular retrieval benchmarks, we verify that clusters and terms indeed complement each other, enabling HI$^2$ to achieve lossless retrieval quality with competitive efficiency across various index settings. Our code and checkpoint are publicly available at https://github.com/namespace-Pt/Adon/tree/HI2.


title: From point processes to quantum optics and back

abstract: Some fifty years ago, in her seminal PhD thesis, Odile Macchi introduced permanental and determinantal point processes. Her initial motivation was to provide models for the set of detection times in fundamental bosonic or fermionic optical experiments, respectively. After two rather quiet decades, these point processes have quickly become standard examples of point processes with nontrivial, yet tractable, correlation structures. In particular, determinantal point processes have been since the 1990s a technical workhorse in random matrix theory and combinatorics, and a standard model for repulsive point patterns in machine learning and spatial statistics since the 2010s. Meanwhile, our ability to experimentally probe the correlations between detection events in bosonic and fermionic optics has progressed tremendously. In Part I of this survey, we provide a modern introduction to the concepts in Macchi's thesis and their physical motivation, under the combined eye of mathematicians, physicists, and signal processers. Our objective is to provide a shared basis of knowledge for later cross-disciplinary work on point processes in quantum optics, and reconnect with the physical roots of permanental and determinantal point processes.

categories: math-ph eess.SP math.MP math.PR quant-ph