title: Marvin: an Innovative Omni-Directional Robotic Assistant for Domestic Environments

abstract: Population ageing and pandemics recently demonstrate to cause isolation of elderly people in their houses, generating the need for a reliable assistive figure. Robotic assistants are the new frontier of innovation for domestic welfare, and elderly monitoring is one of the services a robot can handle for collective well-being. Despite these emerging needs, in the actual landscape of robotic assistants there are no platform which successfully combines a reliable mobility in cluttered domestic spaces, with lightweight and offline Artificial Intelligence (AI) solutions for perception and interaction. In this work, we present Marvin, a novel assistive robotic platform we developed with a modular layer-based architecture, merging a flexible mechanical design with cutting-edge AI for perception and vocal control. We focus the design of Marvin on three target service functions: monitoring of elderly and reduced-mobility subjects, remote presence and connectivity, and night assistance. Compared to previous works, we propose a tiny omnidirectional platform, which enables agile mobility and effective obstacle avoidance. Moreover, we design a controllable positioning device, which easily allows the user to access the interface for connectivity and extends the visual range of the camera sensor. Nonetheless, we delicately consider the privacy issues arising from private data collection on cloud services, a critical aspect of commercial AI-based assistants. To this end, we demonstrate how lightweight deep learning solutions for visual perception and vocal command can be adopted, completely running offline on the embedded hardware of the robot.


title: PERF: Performant, Explicit Radiance Fields

abstract: We present a novel way of approaching image-based 3D reconstruction based on radiance fields. The problem of volumetric reconstruction is formulated as a non-linear least-squares problem and solved explicitly without the use of neural networks. This enables the use of solvers with a higher rate of convergence than what is typically used for neural networks, and fewer iterations are required until convergence. The volume is represented using a grid of voxels, with the scene surrounded by a hierarchy of environment maps. This makes it possible to get clean reconstructions of 360{\deg} scenes where the foreground and background is separated. A number of synthetic and real scenes from well known benchmark-suites are successfully reconstructed with quality on par with state-of-the-art methods, but at significantly reduced reconstruction times.


title: Discrete degree of symmetry of manifolds

abstract: We define the discrete degree of symmetry $disc-sym(X)$ of a closed $n$-manifold $X$ as the biggest $m\geq 0$ such that $X$ supports an effective action of $({\mathbf Z}/r)^m$ for arbitrarily big values of $r$. We prove that if $X$ is connected then $disc-sym(X)\leq 3n/2$. We propose the question of whether for every closed connected $n$-manifold $X$ the inequality $disc-sym(X)\leq n$ holds true, and whether the only closed connected $n$-manifold $X$ for which $disc-sym(X)=n$ is the torus $T^n$. We prove partial results providing evidence for an affirmative answer to this question.


title: Complete 3D MHD simulations of the current quench phase of ITER mitigated disruptions

abstract: Complete 3D simulations of the current quench phase of ITER disruptions are key to predict asymmetric forces acting into the ITER wall. We present for the first time such simulations for ITER mitigated disruptions at realistic Lundquist numbers. For these strongly mitigated disruptions, we find that the edge safety factor remains above 2 and the maximal integral horizontal forces remain below 1 MN. The maximal integral vertical force is found to be 13 MN and arises in a time scale given by the resistive wall time as expected from theoretical considerations. In this respect, the vertical force arises after the plasma current has completely decayed, showing the importance of continuing the simulations also in the absence of plasma current. We conclude that the horizontal wall force rotation is not a concern for these strongly mitigated disruptions in ITER, since when the wall forces form, there are no remaining sources of rotation.


title: Random multi-player games

abstract: The study of evolutionary games with pairwise local interactions has been of interest to many different disciplines. Also local interactions with multiple opponents had been considered, although always for a fixed amount of players. In many situations, however, interactions between different numbers of players in each round could take place, and this case can not be reduced to pairwise interactions. In this work we formalize and generalize the definition of evolutionary stable strategy (ESS) to be able to include a scenario in which the game is played by two players with probability $p$, and by three players with the complementary probability $1-p$. We show the existence of equilibria in pure and mixed strategies depending on the probability $p$, on a concrete example of the duel-truel game. We find a range of $p$ values for which the game has a mixed equilibrium and the proportion of players in each strategy depends on the particular value of $p$. We prove that each of these mixed equilibrium points are ESS. A more realistic way to study this dynamics with high-order interactions is to look at how it evolves in complex networks. We introduce and study an agent-based model on a network with a fixed number of nodes, which evolves as the replicator equation predicts. By studying the dynamics of this model on random networks we find that the phase transitions between the pure and mixed equilibria depend on the probability $p$ and also on the mean degree of the network.


title: Interplay between multipole expansion of exchange interaction and Coulomb correlation of exciton in colloidal II-VI quantum dots

abstract: We study the effect of Coulomb correlation on the emission properties of the ground state exciton in zincblende CdSe/ZnS core-shell and in wurtzite ZnO quantum dots. We validate our theory model by comparing results of computed exciton energies of CdSe/ZnS quantum dots to photoluminescence and scanning near-field optical microscopy measurements. We use that to estimate the diameter of the quantum dots using a simple model based on infinitely deep quantum well and compare the results with the statistics of the atomic force microscopy scans of CdSe/ZnS dots, obtaining excellent agreement. Thereafter, we compute the energy fine structure of exciton, finding striking difference between properties of zincblende CdSe/ZnS and wurtzite ZnO dots. While in the former the fine structure is dominated by the dipole terms of the multipole expansion of the exchange interaction, in the latter system that is mostly influenced by Coulomb correlation. Furthermore, the correlation sizeably influences also the exciton binding energy and emission radiative rate in~ZnO dots.


title: Well-posed formulation of Einstein-Maxwell effective field theory

abstract: We consider the well-posedness of the initial value problem for Einstein-Maxwell theory modified by higher derivative effective field theory corrections. Field redefinitions can be used to bring the leading parity-symmetric 4-derivative corrections to a form which gives second order equations of motion. We show that a recently introduced "modified harmonic" gauge condition can be used to obtain a formulation of these theories which admits a well-posed initial value problem when the higher derivative corrections to the equations of motion are small.


title: Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity

abstract: Gradient descent ascent (GDA), the simplest single-loop algorithm for nonconvex minimax optimization, is widely used in practical applications such as generative adversarial networks (GANs) and adversarial training. Albeit its desirable simplicity, recent work shows inferior convergence rates of GDA in theory even assuming strong concavity of the objective on one side. This paper establishes new convergence results for two alternative single-loop algorithms -- alternating GDA and smoothed GDA -- under the mild assumption that the objective satisfies the Polyak-Lojasiewicz (PL) condition about one variable. We prove that, to find an $\epsilon$-stationary point, (i) alternating GDA and its stochastic variant (without mini batch) respectively require $O(\kappa^{2} \epsilon^{-2})$ and $O(\kappa^{4} \epsilon^{-4})$ iterations, while (ii) smoothed GDA and its stochastic variant (without mini batch) respectively require $O(\kappa \epsilon^{-2})$ and $O(\kappa^{2} \epsilon^{-4})$ iterations. The latter greatly improves over the vanilla GDA and gives the hitherto best known complexity results among single-loop algorithms under similar settings. We further showcase the empirical efficiency of these algorithms in training GANs and robust nonlinear regression.


title: Comparison of Markov chains via weak Poincar\'e inequalities with application to pseudo-marginal MCMC

abstract: We investigate the use of a certain class of functional inequalities known as weak Poincar\'e inequalities to bound convergence of Markov chains to equilibrium. We show that this enables the straightforward and transparent derivation of subgeometric convergence bounds for methods such as the Independent Metropolis--Hastings sampler and pseudo-marginal methods for intractable likelihoods, the latter being subgeometric in many practical settings. These results rely on novel quantitative comparison theorems between Markov chains. Associated proofs are simpler than those relying on drift/minorization conditions and the tools developed allow us to recover and further extend known results as particular cases. We are then able to provide new insights into the practical use of pseudo-marginal algorithms, analyse the effect of averaging in Approximate Bayesian Computation (ABC) and the use of products of independent averages, and also to study the case of lognormal weights relevant to particle marginal Metropolis--Hastings (PMMH).


title: Crossover from exciton-polariton condensation to photon lasing in an optical trap

abstract: Optical trapping has been proven to be an effective method of separating exciton-polariton condensates from the incoherent high-energy excitonic reservoir located at the pumping laser position. This technique has significantly improved the coherent properties of exciton-polariton condensates, when compared to a quasi-homogeneous spot excitation scheme. Here, we compare two experimental methods on a sample, where a single spot excitation experiment allowed only to observe photonic lasing in the weak coupling regime. In contrast, the ring-shaped excitation resulted in the two-threshold behavior, where an exciton-polariton condensate manifests itself at the first and photon lasing at the second threshold. Both lasing regimes are trapped in an optical potential created by the pump. We interpret the origin of this confining potential in terms of repulsive interactions of polaritons with the reservoir at the first threshold and as a result of the excessive free-carrier induced refractive index change of the microcavity at the second threshold. This observation offers a way to achieve multiple phases of photonic condensates in samples, e.g., containing novel materials as an active layer, where two-threshold behavior is impossible to achieve with a single excitation spot.


title: FLiMS: a Fast Lightweight 2-way Merger for Sorting

abstract: In this paper, we present FLiMS, a highly-efficient and simple parallel algorithm for merging two sorted lists residing in banked and/or wide memory. On FPGAs, its implementation uses fewer hardware resources than the state-of-the-art alternatives, due to the reduced number of comparators and elimination of redundant logic found on prior attempts. In combination with the distributed nature of the selector stage, a higher performance is achieved for the same amount of parallelism or higher. This is useful in many applications such as in parallel merge trees to achieve high-throughput sorting, where the resource utilisation of the merger is critical for building large trees and internalising the workload for fast computation. Also presented are efficient variations of FLiMS for optimizing throughput for skewed datasets, achieving stable sorting or using fewer dequeue signals. Additionally, FLiMS is shown to perform well as conventional software on modern CPUs supporting single-instruction multiple-data (SIMD) instructions, surpassing the performance of some standard libraries for sorting.


title: Charges and Fluxes on (Perturbed) Non-expanding Horizons

abstract: In a companion paper we showed that the symmetry group $\mathfrak{G}$ of non-expanding horizons (NEHs) is a 1-dimensional extension of the Bondi-Metzner-Sachs group $\mathfrak{G}$ at $\mathcal{I}^{+}$. For each infinitesimal generator of $\mathfrak{G}$, we now define a charge and a flux on NEHs as well as perturbed NEHs. The procedure uses the covariant phase space framework in presence of internal null boundaries $\mathcal{N}$. However, $\mathcal{N}$ is required to be an NEH or a perturbed NEH. Consequently, charges and fluxes associated with generators of $\mathfrak{G}$ are free of physically unsatisfactory features that can arise if $\mathcal{N}$ is allowed to be a general null boundary. In particular, all fluxes vanish if $\mathcal{N}$ is an NEH, just as one would hope; and fluxes associated with symmetries representing `time-translations' are positive definite on perturbed NEHs. These results hold for zero as well as non-zero cosmological constant. In the asymptotically flat case, as noted in \cite{akkl1}, $\mathcal{I}^\pm$ are NEHs in the conformally completed space-time but with an extra structure that reduces $\mathfrak{G}$ to $\mathfrak{B}$. The flux expressions at $\mathcal{N}$ reflect this synergy between NEHs and $\mathcal{I}^{+}$. In a forthcoming paper, this close relation between NEHs and $\mathcal{I}^{+}$ will be used to develop gravitational wave tomography, enabling one to deduce horizon dynamics directly from the waveforms at $\mathcal{I}^{+}$.


title: Interaction-Aware Sensitivity Analysis for Aerodynamic Optimization Results using Information Theory

abstract: An important issue during an engineering design process is to develop an understanding which design parameters have the most influence on the performance. Especially in the context of optimization approaches this knowledge is crucial in order to realize an efficient design process and achieve high-performing results. Information theory provides powerful tools to investigate these relationships because measures are model-free and thus also capture non-linear relationships, while requiring only minimal assumptions on the input data. We therefore propose to use recently introduced information-theoretic methods and estimation algorithms to find the most influential input parameters in optimization results. The proposed methods are in particular able to account for interactions between parameters, which are often neglected but may lead to redundant or synergistic contributions of multiple parameters. We demonstrate the application of these methods on optimization data from aerospace engineering, where we first identify the most relevant optimization parameters using a recently introduced information-theoretic feature-selection algorithm that accounts for interactions between parameters. Second, we use the novel partial information decomposition (PID) framework that allows to quantify redundant and synergistic contributions between selected parameters with respect to the optimization outcome to identify parameter interactions. We thus demonstrate the power of novel information-theoretic approaches in identifying relevant parameters in optimization runs and highlight how these methods avoid the selection of redundant parameters, while detecting interactions that result in synergistic contributions of multiple parameters.


title: Disentangling the formation mechanisms of nuclear star clusters

abstract: Nuclear star clusters (NSCs) are massive star clusters found ubiquitously in the centres of galaxies, from the dwarf regime to massive ellipticals and spirals. The fraction of nucleated galaxies is as high as $>$ 90 % at $M_{\text{gal}} \sim 10^9 M_\odot$. However, how NSC formation mechanisms work in different regimes and what determines galaxy nucleation is still unclear. The dissipationless accretion of infalling globular clusters (GCs) and the in situ formation of stars directly at the galactic centre likely operate to grow NSCs in most galaxies; however, their efficiency has been difficult to assess observationally. Here, we provide, for the first time, a quantitative determination of the relative strength of these processes in the build-up of individual NSCs. Using a semi-analytical model of NSC formation based on the orbital evolution of inspiraling GCs, together with observed NSC and GC system properties, we derived the mass fraction of in situ born stars $f_\text{in, NSC}$ for 119 galaxies with masses from $3 \times 10^{7}$ to $3 \times 10^{11} M_\odot$, in the Local Volume, the Fornax, and Virgo galaxy clusters. Our analysis reveals that the NSC mass, as well as the ratio of NSC to the total GC system mass, are strong indicators of the dominant NSC formation channel, and not the total galaxy stellar mass as previously suggested. More massive NSCs formed predominantly via the in situ formation of stars ($f_\text{in, NSC} \sim 0.9$), while the lower-mass NSCs are expected to have formed predominantly through the merger of GCs ($f_\text{in, NSC} \sim 0.2$). The results of this simple model are in agreement with recent independent estimates of the dominant NSC formation channel from recent stellar population analysis.


title: Eigenspace Restructuring: a Principle of Space and Frequency in Neural Networks

abstract: Understanding the fundamental principles behind the massive success of neural networks is one of the most important open questions in deep learning. However, due to the highly complex nature of the problem, progress has been relatively slow. In this note, through the lens of infinite-width networks, a.k.a. neural kernels, we present one such principle resulting from hierarchical localities. It is well-known that the eigenstructure of infinite-width multilayer perceptrons (MLPs) depends solely on the concept frequency, which measures the order of interactions. We show that the topologies from deep convolutional networks (CNNs) restructure the associated eigenspaces into finer subspaces. In addition to frequency, the new structure also depends on the concept space, which measures the spatial distance among nonlinear interaction terms. The resulting fine-grained eigenstructure dramatically improves the network's learnability, empowering them to simultaneously model a much richer class of interactions, including Long-Range-Low-Frequency interactions, Short-Range-High-Frequency interactions, and various interpolations and extrapolations in-between. Additionally, model scaling can improve the resolutions of interpolations and extrapolations and, therefore, the network's learnability. Finally, we prove a sharp characterization of the generalization error for infinite-width CNNs of any depth in the high-dimensional setting. Two corollaries follow: (1) infinite-width deep CNNs can break the curse of dimensionality without losing their expressivity, and (2) scaling improves performance in both the finite and infinite data regimes.


title: Decentralized Spectrum Access System: Vision, Challenges, and a Blockchain Solution

abstract: Spectrum access system (SAS) is widely considered the de facto solution to coordinating dynamic spectrum sharing (DSS) and protecting incumbent users. The current SAS paradigm prescribed by the FCC for the CBRS band and standardized by the WInnForum follows a centralized service model in that a spectrum user subscribes to a SAS server for spectrum allocation service. This model, however, neither tolerates SAS server failures (crash or Byzantine) nor resists dishonest SAS administrators, leading to serious concerns on SAS system reliability and trustworthiness. This is especially concerning for the evolving DSS landscape where an increasing number of SAS service providers and heterogeneous user requirements are coming up. To address these challenges, we propose a novel blockchain-based decentralized SAS architecture called BD-SAS that provides SAS services securely and efficiently, without relying on the trust of each individual SAS server for the overall system trustworthiness. In BD-SAS, a global blockchain (G-Chain) is used for spectrum regulatory compliance while smart contract-enabled local blockchains (L-Chains) are instantiated in individual spectrum zones for automating spectrum access assignment per user request. We hope our vision of a decentralized SAS, the BD-SAS architecture, and discussion on future challenges can open up a new direction towards reliable spectrum management in a decentralized manner.


title: Effective Hamiltonians in Nonrelativistic Quantum Electrodynamics

abstract: In this paper, we consider some second-order effective Hamiltonians describing the interaction of the quantum electromagnetic field with atoms or molecules in the nonrelativistic limit. Our procedure is valid only for off-energy-shell processes, specifically virtual processes such as those relevant for ground-state energy shifts and dispersion van der Waals and Casimir-Polder interactions, while on-energy-shell processes are excluded. These effective Hamiltonians allow for a considerable simplification of the calculation of radiative energy shifts, dispersion, and Casimir-Polder interactions, including in the presence of boundary conditions. They can also provide clear physical insights into the processes involved. We clarify that the form of the effective Hamiltonian depends on the field states considered, and consequently different expressions can be obtained, each of them with a well-defined range of validity and possible applications. We also apply our results to some specific cases, mainly the Lamb shift, the Casimir-Polder atom-surface interaction, and the dispersion interactions between atoms, molecules, or, in general, polarizable bodies.


title: AAAI FSS-21: Artificial Intelligence in Government and Public Sector Proceedings

abstract: Proceedings of the AAAI Fall Symposium on Artificial Intelligence in Government and Public Sector, Washington, DC, USA, November 4-6, 2021


title: Intelligent Transportation Systems Using External Infrastructure: A Literature Survey

abstract: The main problems in transportation are accidents, increasingly slow traffic flow, and pollution. An intelligent transportation system (ITS) using external infrastructure can overcome these problems. For this reason, the number of such systems is increasing dramatically, and therefore requires an adequate overview. To the best of our knowledge, no current systematic review of existing ITS solutions exists. To fill this knowledge gap, our paper provides an overview of existing ITS that use external infrastructure worldwide. Accordingly, this paper addresses current questions and challenges. For this purpose, we performed a literature review of documents that describe existing ITS solutions from 2009 until today. We categorized the results according to technology levels and analyzed its hardware system setup and value-added contributions. In doing so, we made the ITS solutions comparable and highlighted past development alongside current trends. We analyzed more than 357 papers, including 52 test bed projects. In summary, current ITSs can deliver accurate information about individuals in traffic situations in real-time. However, further research into ITS should focus on more reliable perception of the traffic using modern sensors, plug-and-play mechanisms, and secure real-time distribution of the digital twins in a decentralized manner. By addressing these topics, the development of intelligent transportation systems will be able to take a step towards its comprehensive roll-out.


title: Boundary driven $XYZ$ chain: Exact inhomogeneous triangular matrix product ansatz

abstract: We construct an explicit matrix product ansatz for the steady state of a boundary driven $XY\!Z$ spin-$\tfrac{1}{2}$ chain for arbitrary local polarizing channels at the chain's ends. The ansatz, where the Lax operators are written explicitly in terms of infinite-dimensional bidiagonal (triangular) site-dependent matrices, becomes exact either in the (Zeno) limit of infinite dissipation strength, or thermodynamic limit of infinite chain length. The solution is based on an extension of the newly discovered family of separable eigenstates of the model.

categories: cond-mat.stat-mech math-ph math.MP quant-ph


title: Possible evidence for shock-cooling in the accretion flow of the luminous Seyfert galaxy PG1211+143

abstract: Short-term variability and multiple velocity components in the powerful highly ionized wind of the archetypal UFO PG1211+143 are indicative of inner disc instabilities or short-lived accretion events. The recent detection of a high velocity inflow offered the first direct observational support for the latter scenario, where matter approaching at a high inclination to the black hole spin plane may result in warping and tearing of the inner accretion disc, with subsequent inter-ring collisions producing shocks, loss of rotational support and rapid mass infall. Here we identify a variable continuum component in the same data set, well-modelled by a hot thermal Comptonised spectrum that could represent cooling radiation from the shocked gas.


title: A Schwartz-Zippel Type Estimate for Homogenous Finite Field Polynomials

abstract: In this paper, we obtain a Schwartz-Zippel type estimate for homogenous finite field polynomials. Specifically, we use a probabilistic recursion technique to find upper and lower bounds for the number of zeros of a homogenous polynomial and illustrate our result with two examples involving perfect matching in bipartite graphs and common zeros in a collection of polynomials, respectively.


title: Introduction to Koopman-von Neumann Mechanics

abstract: This work is to consolidate current literature on Koopman-von Neumann (KvN) Mechanics into a simple and easy to understand text. KvN Mechanics is a branch of Classical Mechanics that has been recast into the mathematical language of Quantum Mechanics. KvN Mechanics utilizes a Hilbert phase space with operators to calculate the expectation values of observables of interest (expectation values such as position, momentum, etc.) It is an important tool in statistical physics and guide to illuminate the mysterious relationship between Quantum and Classical Physics. A lot of important applications of KvN Mechanics have been developed in the last decade.


title: How to Avoid Trivial Solutions in Physics-Informed Neural Networks

abstract: The advent of scientific machine learning (SciML) has opened up a new field with many promises and challenges in the field of simulation science by developing approaches at the interface of physics- and data-based modelling. To this end, physics-informed neural networks (PINNs) have been introduced in recent years, which cope for the scarcity in training data by incorporating physics knowledge of the problem at so-called collocation points. In this work, we investigate the prediction performance of PINNs with respect to the number of collocation points used to enforce the physics-based penalty terms. We show that PINNs can fail, learning a trivial solution that fulfills the physics-derived penalty term by definition. We have developed an alternative sampling approach and a new penalty term enabling us to remedy this core problem of PINNs in data-scarce settings with competitive results while reducing the amount of collocation points needed by up to 80 \% for benchmark problems.


title: Reward-Based Environment States for Robot Manipulation Policy Learning

abstract: Training robot manipulation policies is a challenging and open problem in robotics and artificial intelligence. In this paper we propose a novel and compact state representation based on the rewards predicted from an image-based task success classifier. Our experiments, using the Pepper robot in simulation with two deep reinforcement learning algorithms on a grab-and-lift task, reveal that our proposed state representation can achieve up to 97% task success using our best policies.


title: $\beta^-{\rm p}$ and $\beta^-\alpha$ decay of the $^{11}$Be neutron halo ground state

abstract: Beta-delayed proton emission from the neutron halo ground state of $^{11}$Be raised much attention due to the unusually high decay rate. It was argued that this may be due to the existence of a resonance just above the proton decay threshold. In this Letter, we use the lenses of real-energy continuum shell model to describe several observables including the Gamow-Teller rates for the $\beta^-$-delayed $\alpha$ and proton decays, and argue that, within our model, the large $\beta^-{\rm p}$ branching ratio cannot be reconciled with other data.


title: Smooth test for equality of copulas

abstract: A smooth test to simultaneously compare $K$ copulas, where $K \geq 2$ is proposed. The $K$ observed populations can be paired, and the test statistic is constructed based on the differences between moment sequences, called copula coefficients. These coefficients characterize the copulas, even when the copula densities may not exist. The procedure employs a two-step data-driven procedure. In the initial step, the most significantly different coefficients are selected for all pairs of populations. The subsequent step utilizes these coefficients to identify populations that exhibit significant differences. To demonstrate the effectiveness of the method, we provide illustrations through numerical studies and application to two real datasets.


title: Microwave susceptibility observation of interacting many-body Andreev states

abstract: Electrostatic charging affects the many-body spectrum of Andreev states, yet its influence on their microwave properties has not been elucidated. We developed a circuit quantum electrodynamics probe that, in addition to transition spectroscopy, measures the microwave susceptibility of different states of a semiconductor nanowire weak link with a single dominant (spin-degenerate) Andreev level. We found that the microwave susceptibility does not exhibit a particle-hole symmetry, which we qualitatively explain as an influence of Coulomb interaction. Moreover, our state-selective measurement reveals a large, $\pi$-phase shifted contribution to the response common to all many-body states which can be interpreted as arising from a phase-dependent continuum in the superconducting density of states.


title: Signatures of interactions in the Andreev spectrum of nanowire Josephson junctions

abstract: We performed microwave spectroscopy of an InAs nanowire between superconducting contacts implementing a finite-length, multi-channel Josephson weak link. Certain features in the spectra, such as the splitting by spin-orbit interactions of the transition lines among Andreev states, have been already understood in terms of non-interacting models. However, we identify here additional transitions, which evidence the presence of Coulomb interactions. By combining experimental measurements and model calculations, we reach a qualitative understanding of these very rich Andreev spectra.


title: Seq-Masks: Bridging the gap between appearance and gait modeling for video-based person re-identification

abstract: ideo-based person re-identification (Re-ID) aims to match person images in video sequences captured by disjoint surveillance cameras. Traditional video-based person Re-ID methods focus on exploring appearance information, thus, vulnerable against illumination changes, scene noises, camera parameters, and especially clothes/carrying variations. Gait recognition provides an implicit biometric solution to alleviate the above headache. Nonetheless, it experiences severe performance degeneration as camera view varies. In an attempt to address these problems, in this paper, we propose a framework that utilizes the sequence masks (SeqMasks) in the video to integrate appearance information and gait modeling in a close fashion. Specifically, to sufficiently validate the effectiveness of our method, we build a novel dataset named MaskMARS based on MARS. Comprehensive experiments on our proposed large wild video Re-ID dataset MaskMARS evidenced our extraordinary performance and generalization capability. Validations on the gait recognition metric CASIA-B dataset further demonstrated the capability of our hybrid model.


title: Law of Large Numbers for Permanents of Random Constrained Matrices

abstract: Permanents of random matrices with independent and identically distributed (i.i.d.) entries have extensively studied in literature and convergence and concentration properties are known under varying assumptions on the distributions. In this paper we consider constrained~\(n \times n\) random matrices where each row has a deterministic number~\(r = r(n)\) zero entries and the rest of the entries are independent random variables that are positive almost surely. The positions of the zeros within each row are also random and we establish sufficient conditions for the existence of a weak law of large numbers for the permanent, appropriately scaled and centred. As a special case, we see that if~\(r\) grows faster than~\(\sqrt{n},\) then the permanent of a randomly chosen constrained~\(0-1\) matrix is concentrated around the van der Waerden bound with high probability, i.e. with probability converging to one as~\(n \rightarrow \infty.\)


title: Preallocation-based Combinatorial Auction for Efficient Fair Channel Assignments in Multi-Connectivity Networks

abstract: We consider a general multi-connectivity framework, intended for ultra-reliable low-latency communications (URLLC) services, and propose a novel, preallocation-based combinatorial auction approach for the efficient allocation of channels. We compare the performance of the proposed method with several other state-of-the-art and alternative channel-allocation algorithms. The two proposed performance metrics are the capacity-based and the utility-based context. In the first case, every unit of additional capacity is regarded as beneficial for any tenant, independent of the already allocated quantity, and the main measure is the total throughput of the system. In the second case, we assume a minimal and maximal required capacity value for each tenant, and consider the implied utility values accordingly. In addition to the total system performance, we also analyze fairness and computational requirements in both contexts. We conclude that at the cost of higher but still plausible computational time, the fairness-enhanced version of the proposed preallocation based combinatorial auction algorithm outperforms every other considered method when one considers total system performance and fairness simultaneously, and performs especially well in the utility context. Therefore, the proposed algorithm may be regarded as candidate scheme for URLLC channel allocation problems, where minimal and maximal capacity requirements have to be considered.


title: Material radiopurity control in the XENONnT experiment

abstract: The selection of low-radioactive construction materials is of the utmost importance for rare-event searches and thus critical to the XENONnT experiment. Results of an extensive radioassay program are reported, in which material samples have been screened with gamma-ray spectroscopy, mass spectrometry, and $^{222}$Rn emanation measurements. Furthermore, the cleanliness procedures applied to remove or mitigate surface contamination of detector materials are described. Screening results, used as inputs for a XENONnT Monte Carlo simulation, predict a reduction of materials background ($\sim$17%) with respect to its predecessor XENON1T. Through radon emanation measurements, the expected $^{222}$Rn activity concentration in XENONnT is determined to be 4.2$\,(^{+0.5}_{-0.7})\,\mu$Bq/kg, a factor three lower with respect to XENON1T. This radon concentration will be further suppressed by means of the novel radon distillation system.


title: On Fair Selection in the Presence of Implicit and Differential Variance

abstract: Discrimination in selection problems such as hiring or college admission is often explained by implicit bias from the decision maker against disadvantaged demographic groups. In this paper, we consider a model where the decision maker receives a noisy estimate of each candidate's quality, whose variance depends on the candidate's group -- we argue that such differential variance is a key feature of many selection problems. We analyze two notable settings: in the first, the noise variances are unknown to the decision maker who simply picks the candidates with the highest estimated quality independently of their group; in the second, the variances are known and the decision maker picks candidates having the highest expected quality given the noisy estimate. We show that both baseline decision makers yield discrimination, although in opposite directions: the first leads to underrepresentation of the low-variance group while the second leads to underrepresentation of the high-variance group. We study the effect on the selection utility of imposing a fairness mechanism that we term the $\gamma$-rule (it is an extension of the classical four-fifths rule and it also includes demographic parity). In the first setting (with unknown variances), we prove that under mild conditions, imposing the $\gamma$-rule increases the selection utility -- here there is no trade-off between fairness and utility. In the second setting (with known variances), imposing the $\gamma$-rule decreases the utility but we prove a bound on the utility loss due to the fairness mechanism.


title: autohaem: 3D printed devices for automated preparation of blood smears

abstract: The process of making blood smears is common in both research and clinical settings, for investigating the health of blood cells and the presence of blood-borne parasites. It is very often carried out manually. We focus here on smears for malaria diagnosis and research which are frequently analyzed by optical microscopy and require a high quality. Automating the smear preparation promises to increase throughput and to improve the quality and consistency of the smears. We present here two devices (manual and motorized) designed to aid in the making of blood smears. These are fully documented, open-source hardware, and an important principle was to make them easily fabricated locally anywhere. Designs and assembly instructions are freely available under an open license. We also describe an image analysis pipeline for characterizing the quality of smears, and use it to optimize the settings and tunable parameters in the two devices. The devices perform as well as expert human operators, while not requiring a trained operator and offering potential advantages in reproducibility and standardization across facilities.


title: Truthful Cake Sharing

abstract: The classic cake cutting problem concerns the fair allocation of a heterogeneous resource among interested agents. In this paper, we study a public goods variant of the problem, where instead of competing with one another for the cake, the agents all share the same subset of the cake which must be chosen subject to a length constraint. We focus on the design of truthful and fair mechanisms in the presence of strategic agents who have piecewise uniform utilities over the cake. On the one hand, we show that the leximin solution is truthful and moreover maximizes an egalitarian welfare measure among all truthful and position oblivious mechanisms. On the other hand, we demonstrate that the maximum Nash welfare solution is truthful for two agents but not in general. Our results assume that mechanisms can block each agent from accessing parts that the agent does not claim to desire; we provide an impossibility result when blocking is not allowed.


title: Accessing glue through photoproduction measurements at GlueX

abstract: Photoproduction experiments are a key tool in the investigation of the spectrum of hadronic states and the way gluons contribute to this spectrum. The GlueX experiment, located at Jefferson Lab, features a linearly polarized tagged photon beam and its detector system is optimized to measure a wide range of neutral and charged final states. GlueX offers unique capabilities to study the spectrum of hadrons and is dedicated to the search for hybrid mesons, states with gluonic degrees of freedom. This talk presents first results from our initial campaign of data taking which finished in 2018.


title: Preemptive Image Robustification for Protecting Users against Man-in-the-Middle Adversarial Attacks

abstract: Deep neural networks have become the driving force of modern image recognition systems. However, the vulnerability of neural networks against adversarial attacks poses a serious threat to the people affected by these systems. In this paper, we focus on a real-world threat model where a Man-in-the-Middle adversary maliciously intercepts and perturbs images web users upload online. This type of attack can raise severe ethical concerns on top of simple performance degradation. To prevent this attack, we devise a novel bi-level optimization algorithm that finds points in the vicinity of natural images that are robust to adversarial perturbations. Experiments on CIFAR-10 and ImageNet show our method can effectively robustify natural images within the given modification budget. We also show the proposed method can improve robustness when jointly used with randomized smoothing.


title: Geometry of inhomogeneous Poisson brackets, multicomponent Harry Dym hierarchies and multicomponent Hunter-Saxton equations

abstract: We introduce a natural class of multicomponent local Poisson structures $\mathcal P_k + \mathcal P_1$, where $\mathcal P_1$ is a local Poisson bracket of order one and $\mathcal P_k$ is a homogeneous Poisson bracket of odd order $k$ under assumption that is has Darboux coordinates (Darboux-Poisson bracket) and non-degenerate. For such brackets we obtain the general formulas in arbitrary coordinates, find normal forms (related to Frobenius triples) and provide the description of the Casimirs, using purely algebraic procedure. In two-component case we completely classify such brackets up to the point transformation. From the description of Casimirs we derive new Harry Dym (HD) hierarchies and new Hunter-Saxton (HS) equations for arbitrary number of components. In two component case our HS equation differs from the well-known HS2 equation.


title: OPM, a collection of Optimization Problems in Matlab

abstract: OPM is a small collection of CUTEst unconstrained and bound-constrained nonlinear optimization problems, which can be used in Matlab for testing optimization algorithms directly (i.e. without installing additional software).


title: HeadNeRF: A Real-time NeRF-based Parametric Head Model

abstract: In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs, and supports directly controlling the generated images' rendering pose and various semantic attributes. Different from existing related parametric models, we use the neural radiance fields as a novel 3D proxy instead of the traditional 3D textured mesh, which makes that HeadNeRF is able to generate high fidelity images. However, the computationally expensive rendering process of the original NeRF hinders the construction of the parametric NeRF model. To address this issue, we adopt the strategy of integrating 2D neural rendering to the rendering process of NeRF and design novel loss terms. As a result, the rendering speed of HeadNeRF can be significantly accelerated, and the rendering time of one frame is reduced from 5s to 25ms. The well designed loss terms also improve the rendering accuracy, and the fine-level details of the human head, such as the gaps between teeth, wrinkles, and beards, can be represented and synthesized by HeadNeRF. Extensive experimental results and several applications demonstrate its effectiveness. The trained parametric model is available at https://github.com/CrisHY1995/headnerf.


title: DistilCSE: Effective Knowledge Distillation For Contrastive Sentence Embeddings

abstract: Large-scale contrastive learning models can learn very informative sentence embeddings, but are hard to serve online due to the huge model size. Therefore, they often play the role of "teacher", transferring abilities to small "student" models through knowledge distillation. However, knowledge distillation inevitably brings some drop in embedding effect. To tackle that, we propose an effective knowledge distillation framework for contrastive sentence embeddings, termed DistilCSE. It first applies knowledge distillation on a large amount of unlabeled data, and then fine-tunes student models through contrastive learning on limited labeled data. To achieve better distillation results, we further propose Contrastive Knowledge Distillation (CKD). CKD uses InfoNCE as the loss function in knowledge distillation, enhancing the objective consistency among teacher model training, knowledge distillation, and student model fine-tuning. Extensive experiments show that student models trained with the proposed DistilCSE and CKD suffer from little or even no performance decrease and consistently outperform the corresponding counterparts of the same parameter size. Impressively, our 110M student model outperforms the latest state-of-the-art model, i.e., Sentence-T5 (11B), with only 1% parameters and 0.25% unlabeled data.


title: A note on non-uniform points for projections of hypersurfaces

abstract: Let X be an irreducible, reduced complex projective hypersurface of degree d. A uniform point for X is a point P such that the projection of X from P has maximal monodromy. We extend and improve some results concerning the finiteness of the locus of non-uniform points for projections of hypersurfaces obtained by the authors and Cuzzucoli only for P not contained in X.


title: Fast and scalable neuroevolution deep learning architecture search for multivariate anomaly detection

abstract: Neuroevolution is one of the methodologies that can be used for learning optimal architecture during training. It uses evolutionary algorithms to generate the topology of artificial neural networks and its parameters. The main benefits are that it is scalable and can be fully or partially non gradient method. In this work, a modified neuroevolution technique is presented which incorporates multi-level optimisation. The presented approach adapts evolution strategies for evolving an ensemble model based on the bagging technique, using genetic operators for optimising single anomaly detection models, reducing the training dataset to speedup the search process and perform non-gradient fine tuning. Multivariate anomaly detection as an unsupervised learning task is the case study upon which the presented approach is tested. Single model optimisation is based on mutation and crossover operators and is focused on finding optimal window sizes, the number of layers, layer depths, hyperparameters etc. to boost the anomaly detection scores of new and already known models. The proposed framework and its protocol shows that it is possible to find architecture within a reasonable time frame which can boost all well known multivariate anomaly detection deep learning architectures. The work concentrates on improvements to the multi-level neuroevolution approach for anomaly detection. The main modifications are in the methods of mixing groups and single model evolution, non-gradient fine tuning and a voting mechanism. The presented framework can be used as an efficient learning network architecture method for any different unsupervised task where autoencoder architectures can be used. The tests were run on SWAT, WADI, MSL and SMAP datasets and the presented approach evolved the architectures that achieved the best scores among other deep learning models.


title: Bridged Hamiltonian Cycles in Sub-critical Random Geometric Graphs

abstract: In this paper, we consider a random geometric graph (RGG)~\(G\) on~\(n\) nodes with adjacency distance~\(r_n\) just below the Hamiltonicity threshold and construct Hamiltonian cycles using additional edges called bridges. The bridges by definition do not belong to~\(G\) and we are interested in estimating the number of bridges and the maximum bridge length, needed for constructing a Hamiltonian cycle. In our main result, we show that with high probability, i.e. with probability converging to one as~\(n \rightarrow \infty,\) we can obtain a Hamiltonian cycle with maximum bridge length a constant multiple of~\(r_n\) and containing an arbitrarily small fraction of edges as bridges. We use a combination of backbone construction and iterative cycle merging to obtain the desired Hamiltonian cycle.


title: Sequential Motifs in Observed Walks

abstract: The structure of complex networks can be characterized by counting and analyzing network motifs. Motifs are small subgraphs that occur repeatedly in a network, such as triangles or chains. Recent work has generalized motifs to temporal and dynamic network data. However, existing techniques do not generalize to sequential or trajectory data, which represents entities moving through the nodes of a network, such as passengers moving through transportation networks. The unit of observation in these data is fundamentally different, since we analyze full observations of trajectories (e.g., a trip from airport A to airport C through airport B), rather than independent observations of edges or snapshots of graphs over time. In this work, we define sequential motifs in trajectory data, which are small, directed, and edge-weighted subgraphs corresponding to patterns in observed sequences. We draw a connection between counting and analysis of sequential motifs and Higher-Order Network (HON) models. We show that by mapping edges of a HON, specifically a $k$th-order DeBruijn graph, to sequential motifs, we can count and evaluate their importance in observed data. We test our methodology with two datasets: (1) passengers navigating an airport network and (2) people navigating the Wikipedia article network. We find that the most prevalent and important sequential motifs correspond to intuitive patterns of traversal in the real systems, and show empirically that the heterogeneity of edge weights in an observed higher-order DeBruijn graph has implications for the distributions of sequential motifs we expect to see across our null models.


title: Hybrid Quantum-Classical Multi-cut Benders Approach with a Power System Application

abstract: Leveraging the current generation of quantum devices to solve optimization problems of practical interest necessitates the development of hybrid quantum-classical (HQC) solution approaches. In this paper, a multi-cut Benders decomposition (BD) approach that exploits multiple feasible solutions of the master problem (MP) to generate multiple valid cuts is adapted, so as to be used as an HQC solver for general mixed-integer linear programming (MILP) problems. The use of different cut selection criteria and strategies to manage the size of the MP by eliciting a subset of cuts to be added in each iteration of the BD scheme using quantum computing is discussed. The HQC optimization algorithm is applied to the Unit Commitment (UC) problem. UC is a prototypical use case of optimization applied to electrical power systems, a critical sector that may benefit from advances in quantum computing. The validity and computational viability of the proposed approach are demonstrated using the D-Wave Advantage 4.1 quantum annealer.


title: Roominoes: Generating Novel 3D Floor Plans From Existing 3D Rooms

abstract: Realistic 3D indoor scene datasets have enabled significant recent progress in computer vision, scene understanding, autonomous navigation, and 3D reconstruction. But the scale, diversity, and customizability of existing datasets is limited, and it is time-consuming and expensive to scan and annotate more. Fortunately, combinatorics is on our side: there are enough individual rooms in existing 3D scene datasets, if there was but a way to recombine them into new layouts. In this paper, we propose the task of generating novel 3D floor plans from existing 3D rooms. We identify three sub-tasks of this problem: generation of 2D layout, retrieval of compatible 3D rooms, and deformation of 3D rooms to fit the layout. We then discuss different strategies for solving the problem, and design two representative pipelines: one uses available 2D floor plans to guide selection and deformation of 3D rooms; the other learns to retrieve a set of compatible 3D rooms and combine them into novel layouts. We design a set of metrics that evaluate the generated results with respect to each of the three subtasks and show that different methods trade off performance on these subtasks. Finally, we survey downstream tasks that benefit from generated 3D scenes and discuss strategies in selecting the methods most appropriate for the demands of these tasks.


title: Graph-structured tensor optimization for nonlinear density control and mean field games

abstract: In this work we develop a numerical method for solving a type of convex graph-structured tensor optimization problems. This type of problems, which can be seen as a generalization of multi-marginal optimal transport problems with graph-structured costs, appear in many applications. Examples are unbalanced optimal transport and multi-species potential mean field games, where the latter is a class of nonlinear density control problems. The method we develop is based on coordinate ascent in a Lagrangian dual, and under mild assumptions we prove that the algorithm converges globally. Moreover, under a set of stricter assumptions, the algorithm converges R-linearly. To perform the coordinate ascent steps one has to compute projections of the tensor, and doing so by brute force is in general not computationally feasible. Nevertheless, for certain graph structures it is possible to derive efficient methods for computing these projections, and here we specifically consider the graph structure that occurs in multi-species potential mean field games. We also illustrate the methodology on a numerical example from this problem class.


title: Mask-invariant Face Recognition through Template-level Knowledge Distillation

abstract: The emergence of the global COVID-19 pandemic poses new challenges for biometrics. Not only are contactless biometric identification options becoming more important, but face recognition has also recently been confronted with the frequent wearing of masks. These masks affect the performance of previous face recognition systems, as they hide important identity information. In this paper, we propose a mask-invariant face recognition solution (MaskInv) that utilizes template-level knowledge distillation within a training paradigm that aims at producing embeddings of masked faces that are similar to those of non-masked faces of the same identities. In addition to the distilled knowledge, the student network benefits from additional guidance by margin-based identity classification loss, ElasticFace, using masked and non-masked faces. In a step-wise ablation study on two real masked face databases and five mainstream databases with synthetic masks, we prove the rationalization of our MaskInv approach. Our proposed solution outperforms previous state-of-the-art (SOTA) academic solutions in the recent MFRC-21 challenge in both scenarios, masked vs masked and masked vs non-masked, and also outperforms the previous solution on the MFR2 dataset. Furthermore, we demonstrate that the proposed model can still perform well on unmasked faces with only a minor loss in verification performance. The code, the trained models, as well as the evaluation protocol on the synthetically masked data are publicly available: https://github.com/fdbtrs/Masked-Face-Recognition-KD.


title: Analysis and Prediction of NLP Models Via Task Embeddings

abstract: Task embeddings are low-dimensional representations that are trained to capture task properties. In this paper, we propose MetaEval, a collection of $101$ NLP tasks. We fit a single transformer to all MetaEval tasks jointly while conditioning it on learned embeddings. The resulting task embeddings enable a novel analysis of the space of tasks. We then show that task aspects can be mapped to task embeddings for new tasks without using any annotated examples. Predicted embeddings can modulate the encoder for zero-shot inference and outperform a zero-shot baseline on GLUE tasks. The provided multitask setup can function as a benchmark for future transfer learning research.


title: Minimax detection of localized signals in statistical inverse problems

abstract: We investigate minimax testing for detecting local signals or linear combinations of such signals when only indirect data is available. Naturally, in the presence of noise, signals that are too small cannot be reliably detected. In a Gaussian white noise model, we discuss upper and lower bounds for the minimal size of the signal such that testing with small error probabilities is possible. In certain situations we are able to characterize the asymptotic minimax detection boundary. Our results are applied to inverse problems such as numerical differentiation, deconvolution and the inversion of the Radon transform.


title: On Ramanujan-type Congruences for Multiplicative Functions

abstract: The study of Ramanujan-type congruences for functions specific to additive number theory has a long and rich history. Motivated by recent connections between divisor sums and overpartitions via congruences in arithmetic progressions, we investigate the existence and classification of Ramanujan-type congruences for functions in multiplicative number theory.


title: Quasiparticle poisoning in trivial and topological Josephson junctions

abstract: We study theoretically a short single-channel Josephson junction between superconductors in the trivial and topological phases. The junction is assumed to be biased by a small current and subjected to quasiparticle poisoning. We find that the presence of quasiparticles leads to a voltage signal from the Josephson junction that can be observed both in the trivial and in the topological phase. Quite remarkably, these voltage signatures are sufficiently different in the two phases such that they can serve as means to clearly distinguish between trivial Andreev and topological Majorana bound states in the system. Moreover, these voltage signatures, in the trivial and topological phase, would allow one to measure directly the quasiparticle poisoning rates and to test various approaches for protection against quasiparticle poisoning.


title: Eccentric self-forced inspirals into a rotating black hole

abstract: We develop the first model for extreme mass-ratio inspirals (EMRIs) into a rotating massive black hole driven by the gravitational self-force. Our model is based on an action angle formulation of the method of osculating geodesics for eccentric, equatorial (i.e., spin-aligned) motion in Kerr spacetime. The forcing terms are provided by an efficient spectral interpolation of the first-order gravitational self-force in the outgoing radiation gauge. We apply a near-identity (averaging) transformation to eliminate all dependence of the orbital phases from the equations of motion, while maintaining all secular effects of the first-order gravitational self-force at post-adiabatic order. This implies that the model can be evolved without having to resolve all $\mathcal{O}(10^5)$ orbit cycles of an EMRI, yielding an inspiral model that can be evaluated in less than a second for any mass-ratio. In the case of a non-rotating central black hole, we compare inspirals evolved using self-force data computed in the Lorenz and radiation gauges. We find that the two gauges generally produce differing inspirals with a deviation of comparable magnitude to the conservative self-force correction. This emphasizes the need for including the (currently unknown) dissipative second order self-force to obtain gauge independent, post-adiabatic waveforms.


title: BEBOP II: Sensitivity to sub-Saturn circumbinary planets using radial-velocities

abstract: BEBOP is a radial-velocity survey that monitors a sample of single-lined eclipsing binaries, in search of circumbinary planets by using high-resolution spectrographs. Here, we describe and test the methods we use to identify planetary signals within the BEBOP data, and establish how we quantify our sensitivity to circumbinary planets by producing detection limits. This process is made easier and more robust by using a diffusive nested sampler. In the process of testing our methods, we notice that contrary to popular wisdom, assuming circular orbits in calculating detection limits for a radial velocity survey provides over-optimistic detection limits by up to $40\%$ in semi-amplitude with implications for all radial-velocity surveys. We perform example analyses using three BEBOP targets from our Southern HARPS survey. We demonstrate for the first time a repeated ability to reach a residual root mean squared scatter of $3~\rm m.s^{-1}$ (after removing the binary signal), and find we are sensitive to circumbinary planets with masses down to that of Neptune and Saturn, for orbital periods up to $1000~\rm days$.


title: Interpretable Clustering via Multi-Polytope Machines

abstract: Clustering is a popular unsupervised learning tool often used to discover groups within a larger population such as customer segments, or patient subtypes. However, despite its use as a tool for subgroup discovery and description - few state-of-the-art algorithms provide any rationale or description behind the clusters found. We propose a novel approach for interpretable clustering that both clusters data points and constructs polytopes around the discovered clusters to explain them. Our framework allows for additional constraints on the polytopes - including ensuring that the hyperplanes constructing the polytope are axis-parallel or sparse with integer coefficients. We formulate the problem of constructing clusters via polytopes as a Mixed-Integer Non-Linear Program (MINLP). To solve our formulation we propose a two phase approach where we first initialize clusters and polytopes using alternating minimization, and then use coordinate descent to boost clustering performance. We benchmark our approach on a suite of synthetic and real world clustering problems, where our algorithm outperforms state of the art interpretable and non-interpretable clustering algorithms.


title: Efficient Analysis of Photoluminescence Images for the Classification of Single-Photon Emitters

abstract: Solid-state single-photon emitters (SPE) are a basis for emerging technologies such as quantum communication and quantum sensing. SPE based on fluorescent point defects are ubiquitous in semiconductors and insulators, and new systems with desirable properties for quantum information science may exist amongst the vast number of unexplored defects. However, the characterization of new SPE typically relies on time-consuming techniques for identifying point source emitters by eye in photoluminescence (PL) images. This manual strategy is a bottleneck for discovering new SPE, motivating a more efficient method for characterizing emitters in PL images. Here we present a quantitative method using image analysis and regression fitting to automatically identify Gaussian emitters in PL images and classify them according to their stability, shape, and intensity relative to the background. We demonstrate efficient emitter classification for SPEs in nanodiamond arrays and hexagonal boron nitride flakes. Adaptive criteria detect SPE in both samples despite variation in emitter intensity, stability, and background features. The detection criteria can be tuned for specific material systems and experimental setups to accommodate the diverse properties of SPE.


title: Branching high-order exceptional points in non-hermitian optical systems

abstract: Exceptional points are complex-valued spectral singularities that lead to a host of intriguing features such as loss-induced transparency - a counterintuitive process in which an increase in the system's overall loss can lead to enhanced transmission. In general, the associated enhancements scale with the order of the exceptional points. Consequently, it is of great interest to devise new strategies to implement realistic devices capable of exhibiting high-order exceptional points. Here, we show that high-order N-photon exceptional points can be generated by exciting non-hermitian waveguide arrangements with coherent light states. Using photon-number resolving detectors it then becomes possible to observe N-photon enhanced loss-induced transparency in the quantum realm. Further, we analytically show that the number-resolved dynamics occurring in the same nonconservative waveguide arrays will exhibit eigenspectral ramifications having several exceptional points associated to different sets of eigenmodes and dissipation rates.


title: Dynamic spin polarization in organic semiconductors with intermolecular exchange interaction

abstract: It is shown that in organic semiconductors where organic magnetoresistance (OMAR) is observed, the exchange interaction between electrons and holes localized at different molecules leads to dynamic spin polarization in the direction of the applied magnetic field. The polarization appears even at room temperature due to the non-equilibrium conditions. The strong spin polarization requires exchange energy to be comparable with Zeeman energy in the external field and be larger or comparable with the energy of hyperfine interaction of electron and nuclear spins. The exchange interaction also modifies the lineshape of OMAR.


title: Artificial Intellgence -- Application in Life Sciences and Beyond. The Upper Rhine Artificial Intelligence Symposium UR-AI 2021

abstract: The TriRhenaTech alliance presents the accepted papers of the 'Upper-Rhine Artificial Intelligence Symposium' held on October 27th 2021 in Kaiserslautern, Germany. Topics of the conference are applications of Artificial Intellgence in life sciences, intelligent systems, industry 4.0, mobility and others. The TriRhenaTech alliance is a network of universities in the Upper-Rhine Trinational Metropolitan Region comprising of the German universities of applied sciences in Furtwangen, Kaiserslautern, Karlsruhe, Offenburg and Trier, the Baden-Wuerttemberg Cooperative State University Loerrach, the French university network Alsace Tech (comprised of 14 'grandes \'ecoles' in the fields of engineering, architecture and management) and the University of Applied Sciences and Arts Northwestern Switzerland. The alliance's common goal is to reinforce the transfer of knowledge, research, and technology, as well as the cross-border mobility of students.


title: Galilean invariance without superluminal particles

abstract: Recently Dragan and Ekert [New. J. Phys 22, 033038, 2020] presented arguments that probabilistic dynamics inherent in the realm of quantum physics is related to the propagation of superluminal particles. Moreover they argue that existence of such particles is a natural consequence of the principle of relativity. We show that the proposed extension of Lorentz transformation can be interpreted in natural way without invoking superluminal phenomena.


title: On muon energy group structure based on deflection angle for application in muon scattering tomography: A Monte Carlo study through GEANT4 simulations

abstract: The average deflection angle of the tracked muons in the muon scattering tomography exponentially declines in function of the initial kinetic energy, the angular dependence of which provides an opportunity to set out a binary relation between the initial kinetic energy and the average deflection angle, thereby leading to a coarse energy prediction founded on the mean deflection angle in the case of experimental incapabilities or limitations. In this study, we address the problem of the muon energy classification for a tomographic system consisting of 0.4-cm plastic scintillators manufactured from polyvinyl toluene and we explore a four-group structure besides a ternary partitioning between 0.25 and 8 GeV. In the first instance, we determine the deflection angles by tracking the hit locations in the detector layers on the sub-divided uniform energy intervals through the GEANT4 simulations. In the latter step, we express two misclassification probabilities where the first approach assumes a symmetrical linear propagation bounded by one standard deviation in one dimension, whereas the second procedure employs a positively defined modified Gaussian distribution that governs the overlapping area in two dimensions. In the final stage, we compare qualitatively and quantitatively the adjacent energy groups by using the computed misclassification probabilities. In the absence of any further data manipulation, we explicitly show that the misclassification probabilities increase when the number of energy groups augments. Furthermore, we also conclude that it is feasible to benefit from the mean deflection angle to roughly estimate the muon energies up to four energy groups by taking the misclassification probabilities into consideration, while the classification viability significantly diminishes when the partition number exceeds four on the basis of standard deviation.


title: DPU: DAG Processing Unit for Irregular Graphs with Precision-Scalable Posit Arithmetic in 28nm

abstract: Computation in several real-world applications like probabilistic machine learning, sparse linear algebra, and robotic navigation, can be modeled as irregular directed acyclic graphs (DAGs). The irregular data dependencies in DAGs pose challenges to parallel execution on general-purpose CPUs and GPUs, resulting in severe under-utilization of the hardware. This paper proposes DPU, a specialized processor designed for the efficient execution of irregular DAGs. The DPU is equipped with parallel compute units that execute different subgraphs of a DAG independently. The compute units can synchronize within a cycle using a hardware-supported synchronization primitive, and communicate via an efficient interconnect to a global banked scratchpad. Furthermore, a precision-scalable posit arithmetic unit is developed to enable application-dependent precision. The DPU is taped-out in 28nm CMOS, achieving a speedup of 5.1$\times$ and 20.6$\times$ over state-of-the-art CPU and GPU implementations on DAGs of sparse linear algebra and probabilistic machine learning workloads. This performance is achieved while operating at a power budget of 0.23W, as opposed to 55W and 98W of the CPU and GPU, resulting in a peak efficiency of 538 GOPS/W with DPU, which is 1350$\times$ and 9000$\times$ higher than the CPU and GPU, respectively. Thus, with specialized architecture, DPU enables low-power execution of irregular DAG workloads.


title: The Geroch Group in One Dimension

abstract: We study the dimensional reduction of general relativity to a single null spacetime dimension. The dimensionally reduced theory is a theory of six scalar fields governed by three constraints. It has an infinite dimensional symmetry which is an enhanced version of the Geroch group. To get a local action of the symmetry on solution space, we need to introduce an infinite tower of new fields and new constraints. The symmetry appears to be a hyperbolic Kac-Moody algebra, with the caveat that some of the defining relations of the hyperbolic Kac-Moody algebra are only checked ``order by order'' on the infinite tower of new fields. This is a very mysterious Lie algebra with no known geometrical interpretation. It is not even clear how to enumerate a basis. We explore this problem using the action of the algebra on solution space and find an intriguing connection to the representation theory of the symmetric group. The symmetry described here might be related to the dynamics of gravity near spacelike singularities.


title: Match Your Words! A Study of Lexical Matching in Neural Information Retrieval

abstract: Neural Information Retrieval models hold the promise to replace lexical matching models, e.g. BM25, in modern search engines. While their capabilities have fully shone on in-domain datasets like MS MARCO, they have recently been challenged on out-of-domain zero-shot settings (BEIR benchmark), questioning their actual generalization capabilities compared to bag-of-words approaches. Particularly, we wonder if these shortcomings could (partly) be the consequence of the inability of neural IR models to perform lexical matching off-the-shelf. In this work, we propose a measure of discrepancy between the lexical matching performed by any (neural) model and an 'ideal' one. Based on this, we study the behavior of different state-of-the-art neural IR models, focusing on whether they are able to perform lexical matching when it's actually useful, i.e. for important terms. Overall, we show that neural IR models fail to properly generalize term importance on out-of-domain collections or terms almost unseen during training


title: Statistics of the maximum and the convex hull of a Brownian motion in confined geometries

abstract: We consider a Brownian particle with diffusion coefficient $D$ in a $d$-dimensional ball of radius $R$ with reflecting boundaries. We study the maximum $M_x(t)$ of the trajectory of the particle along the $x$-direction at time $t$. In the long time limit, the maximum converges to the radius of the ball $M_x(t) \to R$ for $t\to \infty$. We investigate how this limit is approached and obtain an exact analytical expression for the distribution of the fluctuations $\Delta(t) = [R-M_x(t)]/R$ in the limit of large $t$ in all dimensions. We find that the distribution of $\Delta(t)$ exhibits a rich variety of behaviors depending on the dimension $d$. These results are obtained by establishing a connection between this problem and the narrow escape time problem. We apply our results in $d=2$ to study the convex hull of the trajectory of the particle in a disk of radius $R$ with reflecting boundaries. We find that the mean perimeter $\langle L(t)\rangle$ of the convex hull exhibits a slow convergence towards the perimeter of the circle $2\pi R$ with a stretched exponential decay $2\pi R-\langle L(t)\rangle \propto \sqrt{R}(Dt)^{1/4} \,e^{-2\sqrt{2Dt}/R}$. Finally, we generalise our results to other confining geometries, such as the ellipse with reflecting boundaries. Our results are corroborated by thorough numerical simulations.


title: Leveraging Joint-Diagonalization in Transform-Learning NMF

abstract: Non-negative matrix factorization with transform learning (TL-NMF) is a recent idea that aims at learning data representations suited to NMF. In this work, we relate TL-NMF to the classical matrix joint-diagonalization (JD) problem. We show that, when the number of data realizations is sufficiently large, TL-NMF can be replaced by a two-step approach -- termed as JD+NMF -- that estimates the transform through JD, prior to NMF computation. In contrast, we found that when the number of data realizations is limited, not only is JD+NMF no longer equivalent to TL-NMF, but the inherent low-rank constraint of TL-NMF turns out to be an essential ingredient to learn meaningful transforms for NMF.


title: Deep Odometry Systems on Edge with EKF-LoRa Backend for Real-Time Positioning in Adverse Environment

abstract: Ubiquitous positioning for pedestrian in adverse environment has served a long standing challenge. Despite dramatic progress made by Deep Learning, multi-sensor deep odometry systems yet pose a high computational cost and suffer from cumulative drifting errors over time. Thanks to the increasing computational power of edge devices, we propose a novel ubiquitous positioning solution by integrating state-of-the-art deep odometry models on edge with an EKF (Extended Kalman Filter)-LoRa backend. We carefully compare and select three sensor modalities, i.e., an Inertial Measurement Unit (IMU), a millimetre-wave (mmWave) radar, and a thermal infrared camera, and realise their deep odometry inference engines which runs in real-time. A pipeline of deploying deep odometry considering accuracy, complexity, and edge platform is proposed. We design a LoRa link for positional data backhaul and projecting aggregated positions of deep odometry into the global frame. We find that a simple EKF based fusion module is sufficient for generic positioning calibration with over 34% accuracy gains against any standalone deep odometry system. Extensive tests in different environments validate the efficiency and efficacy of our proposed positioning system.


title: An Ensemble 1D-CNN-LSTM-GRU Model with Data Augmentation for Speech Emotion Recognition

abstract: In this paper, we propose an ensemble of deep neural networks along with data augmentation (DA) learned using effective speech-based features to recognize emotions from speech. Our ensemble model is built on three deep neural network-based models. These neural networks are built using the basic local feature acquiring blocks (LFAB) which are consecutive layers of dilated 1D Convolutional Neural networks followed by the max pooling and batch normalization layers. To acquire the long-term dependencies in speech signals further two variants are proposed by adding Gated Recurrent Unit (GRU) and Long Short Term Memory (LSTM) layers respectively. All three network models have consecutive fully connected layers before the final softmax layer for classification. The ensemble model uses a weighted average to provide the final classification. We have utilized five standard benchmark datasets: TESS, EMO-DB, RAVDESS, SAVEE, and CREMA-D for evaluation. We have performed DA by injecting Additive White Gaussian Noise, pitch shifting, and stretching the signal level to generalize the models, and thus increasing the accuracy of the models and reducing the overfitting as well. We handcrafted five categories of features: Mel-frequency cepstral coefficients, Log Mel-Scaled Spectrogram, Zero-Crossing Rate, Chromagram, and statistical Root Mean Square Energy value from each audio sample. These features are used as the input to the LFAB blocks that further extract the hidden local features which are then fed to either fully connected layers or to LSTM or GRU based on the model type to acquire the additional long-term contextual representations. LFAB followed by GRU or LSTM results in better performance compared to the baseline model. The ensemble model achieves the state-of-the-art weighted average accuracy in all the datasets.


title: A Deep Learning Based Automated Hand Hygiene Training System

abstract: Hand hygiene is crucial for preventing viruses and infections. Due to the pervasive outbreak of COVID-19, wearing a mask and hand hygiene appear to be the most effective ways for the public to curb the spread of these viruses. The World Health Organization (WHO) recommends a guideline for alcohol-based hand rub in eight steps to ensure that all surfaces of hands are entirely clean. As these steps involve complex gestures, human assessment of them lacks enough accuracy. However, Deep Neural Network (DNN) and machine vision have made it possible to accurately evaluate hand rubbing quality for the purposes of training and feedback. In this paper, an automated deep learning based hand rub assessment system with real-time feedback is presented. The system evaluates the compliance with the 8-step guideline using a DNN architecture trained on a dataset of videos collected from volunteers with various skin tones and hand characteristics following the hand rubbing guideline. Various DNN architectures were tested, and an Inception-ResNet model led to the best results with 97% test accuracy. In the proposed system, an NVIDIA Jetson AGX Xavier embedded board runs the software. The efficacy of the system is evaluated in a concrete situation of being used by various users, and challenging steps are identified. In this experiment, the average time taken by the hand rubbing steps among volunteers is 27.2 seconds, which conforms to the WHO guidelines.


title: Dark biportals at direct detection

abstract: We present a study of the constraining power of low-threshold, high-resolution direct-detection experiments for a biportal simplified dark matter model. In the scenario we consider here, dark matter and Standard Model particles interact through two dark vector mediators $-$ one light and one heavy with respect to the momentum transfer in the experiment. Interference effects at the level of scattering amplitudes can lead to novel marked shape features in the differential recoil spectra, which are best exploited by high-resolution, low-threshold experiments. We identify the region in parameters space for our model where such effects are dominant and show that composite-target experiments with large atomic mass differences are ideal to explore these scenarios. We develop a profile likelihood approach to analyze presently available and future data. Using published results by the CRESST-III experiment and projections of future sensitivities for the COSINUS experiment, we constrain the parameter space in our model, thereby showing the potential of such an analysis on a class of dark matter models which exhibit non-standard features in the recoil spectra.


title: Existence of Zero-damped Quasinormal Frequencies for Nearly Extremal Black Holes

abstract: It has been observed that many spacetimes which feature a near-extremal horizon exhibit the phenomenon of zero-damped modes. This is characterised by the existence of a sequence of quasinormal frequencies which all converge to some purely imaginary number $i\alpha$ in the extremal limit and cluster in a neighbourhood of the line $\Im s=\alpha$. In this paper, we establish that this property is present for the conformal Klein-Gordon equation on a Reissner-Nordstr\"om-de Sitter background. This follows from a similar result that we prove for a class of spherically symmetric black hole spacetimes with a cosmological horizon. We also show that the phenomenon of zero-damped modes is stable to perturbations that arise through adding a potential.


title: Memory truncated Kadanoff-Baym equations

abstract: The Keldysh formalism for nonequilibrium Green's functions is a powerful theoretical framework for the description of the electronic structure, spectroscopy, and dynamics of strongly correlated systems. However, the underlying Kadanoff-Baym equations (KBE) for the two-time Keldysh Green's functions involve a memory kernel which results in a high computational cost for long simulation times $t_\text{max}$, with a cubic scaling of the computation time with $t_\text{max}$. Truncation of the memory kernel can reduce the computational cost to linear scaling with $t_\text{max}$, but the required memory times will depend on the model and the diagrammatic approximation to the self-energy. We explain how a truncation of the memory kernel can be incorporated into the time-propagation algorithm to solve the KBE, and investigate the systematic truncation of the memory kernel for the Hubbard model in different parameter regimes, and for different diagrammatic approximations. The truncation is easier to control within dynamical mean-field solutions, where it is applied to a momentum-independent self-energy. Here, simulation times up to two orders of magnitude longer are accessible both in the weak and strong coupling regime, allowing for a study of long-time phenomena such as the crossover between pre-thermalization and thermalization dynamics.


title: On the Assumptions of Synthetic Control Methods

abstract: Synthetic control (SC) methods have been widely applied to estimate the causal effect of large-scale interventions, e.g., the state-wide effect of a change in policy. The idea of synthetic controls is to approximate one unit's counterfactual outcomes using a weighted combination of some other units' observed outcomes. The motivating question of this paper is: how does the SC strategy lead to valid causal inferences? We address this question by re-formulating the causal inference problem targeted by SC with a more fine-grained model, where we change the unit of the analysis from "large units" (e.g., states) to "small units" (e.g., individuals in states). Under this re-formulation, we derive sufficient conditions for the non-parametric causal identification of the causal effect. We highlight two implications of the reformulation: (1) it clarifies where "linearity" comes from, and how it falls naturally out of the more fine-grained and flexible model, and (2) it suggests new ways of using available data with SC methods for valid causal inference, in particular, new ways of selecting observations from which to estimate the counterfactual.


title: The number of limit cycles bifurcating from a randomly perturbed center

abstract: We consider the average number of limit cycles that bifurcate from a randomly perturbed linear center where the perturbation consists of random (bivariate) polynomials with independent coefficients. This problem reduces, by way of classical perturbation theory of the Poincar\'e first return map, to a problem on the real zeros of a random \emph{univariate} polynomial $\displaystyle f_n(x) = \sum_{m=0}^n c_m \xi_m x^m$ with independent coefficients $\xi_m$ having mean zero, variance 1 and $c_m \sim m^{-1/2}$. This polynomial belongs to the class of {\it generalized Kac polynomials} at the critical regime. We provide asymptotics for the average number of real zeros and answer the question on bifurcating limit cycles. Additionally, we provide the correct order of the mean number of real roots in the subcritical regime.


title: Neural Multi-Quantile Forecasting for Optimal Inventory Management

abstract: In this work we propose the use of quantile regression and dilated recurrent neural networks with temporal scaling (MQ-DRNN-s) and apply it to the inventory management task. This model showed a better performance of up to 3.2\% over a statistical benchmark (the quantile autoregressive model with exogenous variables, QAR-X), being better than the MQ-DRNN without temporal scaling by 6\%. The above on a set of 10,000 time series of sales of El Globo over a 53-week horizon using rolling windows of 7-day ahead each week.


title: The Boundary Yamabe Problem, II: General Constant Mean Curvature Case

abstract: This article uses the iterative schemes and perturbation methods to completely solve the Han-Li conjecture, i.e. the general boundary Yamabe problem with prescribed constant scalar curvature and constant mean curvature on compact manifolds $ (M, \partial M, g) $ with non-empty smooth boundary, $ \dim M \geqslant 3 $. It is equivalent to show the existence of a real, positive, smooth solution of $ -\frac{4(n -1)}{n - 2} \Delta_{g} u + R_{g} u = \lambda u^{\frac{n+2}{n - 2}} $ in $ M $, $ \frac{\partial u}{\partial \nu} + \frac{n-2}{2} h_{g} u = \frac{n-2}{2} \zeta u^{\frac{n}{n - 2}} $ on $ \partial M $ with some constants $ \lambda, \zeta \in \mathbb{R} $. This boundary Yamabe problem is solved in cases according to the sign of the first eigenvalue $ \eta_{1} $ of the conformal Laplacian with homogeneous Robin condition. The signs of scalar curvature $ R_{g} $ and mean curvature $ h_{g} $ play an important role in this existence result. In contrast to the classical method, the Weyl tensor and classification of boundary points play no role in the proof. In addition, the method is not dimensional specific. The key steps include a new version of monotone iteration scheme for nonlinear elliptic PDEs and nonlinear boundary conditions, an introduction of the perturbed conformal Laplacian, a delicate gluing skill to construct a smooth super-solution and existence of solution of local Yamabe-type equations.


title: Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support

abstract: Various tools and practices have been developed to support practitioners in identifying, assessing, and mitigating fairness-related harms caused by AI systems. However, prior research has highlighted gaps between the intended design of these tools and practices and their use within particular contexts, including gaps caused by the role that organizational factors play in shaping fairness work. In this paper, we investigate these gaps for one such practice: disaggregated evaluations of AI systems, intended to uncover performance disparities between demographic groups. By conducting semi-structured interviews and structured workshops with thirty-three AI practitioners from ten teams at three technology companies, we identify practitioners' processes, challenges, and needs for support when designing disaggregated evaluations. We find that practitioners face challenges when choosing performance metrics, identifying the most relevant direct stakeholders and demographic groups on which to focus, and collecting datasets with which to conduct disaggregated evaluations. More generally, we identify impacts on fairness work stemming from a lack of engagement with direct stakeholders or domain experts, business imperatives that prioritize customers over marginalized groups, and the drive to deploy AI systems at scale.


title: Optimal transport and control of active drops

abstract: Understanding the complex patterns in space-time exhibited by active systems has been the subject of much interest in recent times. Complementing this forward problem is the inverse problem of controlling active matter. Here we use optimal control theory to pose the problem of transporting a slender drop of an active fluid and determine the dynamical profile of the active stresses to move it with minimal viscous dissipation. By parametrizing the position and size of the drop using a low-order description based on lubrication theory, we uncover a natural ''gather-move-spread'' strategy that leads to an optimal bound on the maximum achievable displacement of the drop relative to its size. In the continuum setting, the competition between passive surface tension, and active controls generates richer behaviour with futile oscillations and complex drop morphologies that trade internal dissipation against the transport cost to select optimal strategies. Our work combines active hydrodynamics and optimal control in a tractable and interpretable framework, and begins to pave the way for the spatiotemporal manipulation of active matter.

categories: cond-mat.soft cs.SY eess.SY math.OC physics.flu-dyn


title: Concept Representation Learning with Contrastive Self-Supervised Learning

abstract: Concept-oriented deep learning (CODL) is a general approach to meet the future challenges for deep learning: (1) learning with little or no external supervision, (2) coping with test examples that come from a different distribution than the training examples, and (3) integrating deep learning with symbolic AI. In CODL, as in human learning, concept representations are learned based on concept exemplars. Contrastive self-supervised learning (CSSL) provides a promising approach to do so, since it: (1) uses data-driven associations, to get away from semantic labels, (2) supports incremental and continual learning, to get away from (large) fixed datasets, and (3) accommodates emergent objectives, to get away from fixed objectives (tasks). We discuss major aspects of concept representation learning using CSSL. These include dual-level concept representations, CSSL for feature representations, exemplar similarity measures and self-supervised relational reasoning, incremental and continual CSSL, and contrastive self-supervised concept (class) incremental learning. The discussion leverages recent findings from cognitive neural science and CSSL.


title: Multivariate Dynamic Modeling for Bayesian Forecasting of Business Revenue

abstract: Forecasting enterprise-wide revenue is critical to many companies and presents several challenges and opportunities for significant business impact. This case study is based on model developments to address these challenges for forecasting in a large-scale retail company. Focused on multivariate revenue forecasting across collections of supermarkets and product Categories, hierarchical dynamic models are natural: these are able to couple revenue streams in an integrated forecasting model, while allowing conditional decoupling to enable relevant and sensitive analysis together with scalable computation. Structured models exploit multi-scale modeling to cascade information on price and promotion activities as predictors relevant across Categories and groups of stores. With a context-relevant focus on forecasting revenue 12 weeks ahead, the study highlights product Categories that benefit from multi-scale information, defines insights into when, how and why multivariate models improve forecast accuracy, and shows how cross-Category dependencies can relate to promotion decisions in one Category impacting others. Bayesian modeling developments underlying the case study are accessible in custom code for interested readers.


title: Laplace priors and spatial inhomogeneity in Bayesian inverse problems

abstract: Spatially inhomogeneous functions, which may be smooth in some regions and rough in other regions, are modelled naturally in a Bayesian manner using so-called Besov priors which are given by random wavelet expansions with Laplace-distributed coefficients. This paper studies theoretical guarantees for such prior measures - specifically, we examine their frequentist posterior contraction rates in the setting of non-linear inverse problems with Gaussian white noise. Our results are first derived under a general local Lipschitz assumption on the forward map. We then verify the assumption for two non-linear inverse problems arising from elliptic partial differential equations, the Darcy flow model from geophysics as well as a model for the Schr\"odinger equation appearing in tomography. In the course of the proofs, we also obtain novel concentration inequalities for penalized least squares estimators with $\ell^1$ wavelet penalty, which have a natural interpretation as maximum a posteriori (MAP) estimators. The true parameter is assumed to belong to some spatially inhomogeneous Besov class $B^{\alpha}_{11}$, $\alpha>0$. In a setting with direct observations, we complement these upper bounds with a lower bound on the rate of contraction for arbitrary Gaussian priors. An immediate consequence of our results is that while Laplace priors can achieve minimax-optimal rates over $B^{\alpha}_{11}$-classes, Gaussian priors are limited to a (by a polynomial factor) slower contraction rate. This gives information-theoretical justification for the intuition that Laplace priors are more compatible with $\ell^1$ regularity structure in the underlying parameter.


title: Transverse-single-spin asymmetries of charged pions at midrapidity in transversely polarized $p{+}p$ collisions at $\sqrt{s}=200$ GeV

abstract: In 2015, the PHENIX collaboration has measured single-spin asymmetries for charged pions in transversely polarized proton-proton collisions at the center of mass energy of $\sqrt{s}=200$ GeV. The pions were detected at central rapidities of $|\eta|<0.35$. The single-spin asymmetries are consistent with zero for each charge individually, as well as consistent with the previously published neutral-pion asymmetries in the same rapidity range. However, they show a slight indication of charge-dependent differences which may suggest a flavor dependence in the underlying mechanisms that create these asymmetries.


title: Physical Benchmarking for AI-Generated Cosmic Web

abstract: The potential of deep learning based image-to-image translations has recently drawn a lot of attention; one intriguing possibility is that of generating cosmological predictions with a drastic reduction in computational cost. Such an effort requires optimization of neural networks with loss functions beyond low-order statistics like pixel-wise mean square error, and validation of results beyond simple visual comparisons and summary statistics. In order to study learning-based cosmological mappings, we choose a tractable analytical prescription - the Zel'dovich approximation - modeled using U-Net, a convolutional image translation framework. A comprehensive list of metrics is proposed, including higher-order correlation functions, conservation laws, topological indicators, dynamical robustness, and statistical independence of density fields. We find that the U-Net approach does well with some metrics but has difficulties with others. In addition to validating AI approaches using rigorous physical benchmarks, this study motivates advancements in domain-specific optimization schemes for scientific machine learning.


title: Self-attention Does Not Need $O(n^2)$ Memory

abstract: We present a very simple algorithm for attention that requires $O(1)$ memory with respect to sequence length and an extension to self-attention that requires $O(\log n)$ memory. This is in contrast with the frequently stated belief that self-attention requires $O(n^2)$ memory. While the time complexity is still $O(n^2)$, device memory rather than compute capability is often the limiting factor on modern accelerators. Thus, reducing the memory requirements of attention allows processing of longer sequences than might otherwise be feasible. We provide a practical implementation for accelerators that requires $O(\sqrt{n})$ memory, is numerically stable, and is within a few percent of the runtime of the standard implementation of attention. We also demonstrate how to differentiate the function while remaining memory-efficient. For sequence length 16384, the memory overhead of self-attention is reduced by 59X for inference and by 32X for differentiation.