title: Particle Diffusivity and Free-Energy Profiles in Inhomogeneous Hydrogel Systems from Time-Resolved Penetration Profiles

abstract: A combined experimental/theoretical method to simultaneously determine diffusivity and free-energy profiles of particles that penetrate into inhomogeneous hydrogel systems is presented. As the only input, arbitrarily normalized concentration profiles from fluorescence intensity data of labeled tracer particles for different penetration times are needed. The method is applied to dextran molecules of varying size which penetrate into hydrogels of polyethylene-glycol (PEG) chains with different lengths that are covalently cross-linked by hyperbranched polyglycerol (hPG) hubs. Extracted dextran bulk diffusivities agree well with fluorescence correlation spectroscopy data obtained separately. Scaling laws for dextran diffusivities and free energies inside the hydrogel are identified as a function of the dextran mass. An elastic free-volume model that includes dextran as well as PEG linker flexibility describes the repulsive dextran-hydrogel interaction free energy, which is of steric origin, quantitatively and furthermore suggests that the hydrogel mesh-size distribution is rather broad and particle penetration is dominated by large hydrogel pores. Particle penetration into hydrogels is for steric particle-hydrogel interactions thus suggested to be governed by an elastic size-filtering mechanism that involves the tail of the hydrogel pore-size distribution.


title: AMALGUM -- A Free, Balanced, Multilayer English Web Corpus

abstract: We present a freely available, genre-balanced English web corpus totaling 4M tokens and featuring a large number of high-quality automatic annotation layers, including dependency trees, non-named entity annotations, coreference resolution, and discourse trees in Rhetorical Structure Theory. By tapping open online data sources the corpus is meant to offer a more sizable alternative to smaller manually created annotated data sets, while avoiding pitfalls such as imbalanced or unknown composition, licensing problems, and low-quality natural language processing. We harness knowledge from multiple annotation layers in order to achieve a "better than NLP" benchmark and evaluate the accuracy of the resulting resource.


title: Hetero-functional Graph Resilience of the Future American Electric Grid

abstract: As climate change takes hold in the 21st century, it places an impetus to decarbonize the American electric power system with renewable energy resources. This paper presents a structural resilience analysis of the American electric power system that incrementally incorporates architectural changes including meshed distribution lines, distributed generation, and energy storage solutions. A hetero-functional graph analysis confirms our formal graph understandings from network science in terms of cumulative degree distributions and traditional attack vulnerability measures. Additionally, The paper shows that hetero-functional graphs more precisely describe the changes in functionality associated with the addition of distributed generation and energy storage. Finally, it demonstrates that the addition of all three types of mitigation measures enhance the grid's structural resilience; even in the presence of disruptive attacks. The paper concludes that there is no structural trade-off between grid sustainability and resilience.


title: REGroup: Rank-aggregating Ensemble of Generative Classifiers for Robust Predictions

abstract: Deep Neural Networks (DNNs) are often criticized for being susceptible to adversarial attacks. Most successful defense strategies adopt adversarial training or random input transformations that typically require retraining or fine-tuning the model to achieve reasonable performance. In this work, our investigations of intermediate representations of a pre-trained DNN lead to an interesting discovery pointing to intrinsic robustness to adversarial attacks. We find that we can learn a generative classifier by statistically characterizing the neural response of an intermediate layer to clean training samples. The predictions of multiple such intermediate-layer based classifiers, when aggregated, show unexpected robustness to adversarial attacks. Specifically, we devise an ensemble of these generative classifiers that rank-aggregates their predictions via a Borda count-based consensus. Our proposed approach uses a subset of the clean training data and a pre-trained model, and yet is agnostic to network architectures or the adversarial attack generation method. We show extensive experiments to establish that our defense strategy achieves state-of-the-art performance on the ImageNet validation set.


title: DisARM: An Antithetic Gradient Estimator for Binary Latent Variables

abstract: Training models with discrete latent variables is challenging due to the difficulty of estimating the gradients accurately. Much of the recent progress has been achieved by taking advantage of continuous relaxations of the system, which are not always available or even possible. The Augment-REINFORCE-Merge (ARM) estimator provides an alternative that, instead of relaxation, uses continuous augmentation. Applying antithetic sampling over the augmenting variables yields a relatively low-variance and unbiased estimator applicable to any model with binary latent variables. However, while antithetic sampling reduces variance, the augmentation process increases variance. We show that ARM can be improved by analytically integrating out the randomness introduced by the augmentation process, guaranteeing substantial variance reduction. Our estimator, DisARM, is simple to implement and has the same computational cost as ARM. We evaluate DisARM on several generative modeling benchmarks and show that it consistently outperforms ARM and a strong independent sample baseline in terms of both variance and log-likelihood. Furthermore, we propose a local version of DisARM designed for optimizing the multi-sample variational bound, and show that it outperforms VIMCO, the current state-of-the-art method.


title: A dataset for complex activity recognition withmicro and macro activities in a cooking scenario

abstract: Complex activity recognition can benefit from understanding the steps that compose them. Current datasets, however, are annotated with one label only, hindering research in this direction. In this paper, we describe a new dataset for sensor-based activity recognition featuring macro and micro activities in a cooking scenario. Three sensing systems measured simultaneously, namely a motion capture system, tracking 25 points on the body; two smartphone accelerometers, one on the hip and the other one on the forearm; and two smartwatches one on each wrist. The dataset is labeled for both the recipes (macro activities) and the steps (micro activities). We summarize the results of a baseline classification using traditional activity recognition pipelines. The dataset is designed to be easily used to test and develop activity recognition approaches.


title: Carleson measure estimates and $\epsilon$-approximation of bounded harmonic functions, without Ahlfors regularity assumptions

abstract: Let $\Omega$ be a domain in $\mathbb{R}^{d+1}$, $d \geq 1$. In the paper's references [HMM2] and [GMT] it was proved that if $\Omega$ satisfies a corkscrew condition and if $\partial \Omega$ is $d$-Ahlfors regular, i.e. Hausdorff measure $\mathcal{H}^d(B(x,r) \cap \partial \Omega) \sim r^d$ for all $x \in \partial \Omega$ and $0 < r < {\rm diam}(\partial \Omega)$, then $\partial \Omega$ is uniformly rectifiable if and only if (a) a square function Carleson measure estimate holds for every bounded harmonic function on $\Omega$ or (b) an $\varepsilon$-approximation property for all $0 < \varepsilon <1$ for every such function. Here we explore (a) and (b) when $\partial \Omega$ is not required to be Ahlfors regular. We first prove that (a) and (b) hold for any domain $\Omega$ for which there exists a domain $\widetilde \Omega \subset \Omega$ such that $\partial \Omega \subset \partial \widetilde \Omega$ and $\partial \widetilde \Omega$ is uniformly rectifiable. We next assume $\Omega$ satisfies a corkscrew condition and $\partial \Omega$ satisfies a capacity density condition. Under these assumptions we prove conversely that the existence of such $\widetilde \Omega$ implies (a) and (b) hold on $\Omega$ and give further characterizations of domains for which (a) or (b) holds. One is that harmonic measure satisfies a Carleson packing condition for diameters similar to the corona decompositionm proved equivalent to uniform rectifiability in [GMT]. The second characterization is reminiscent of the Carleson measure description of $H^{\infty}$ interpolating sequences in the unit disc.


title: Applying deep reinforcement learning to active flow control in turbulent conditions

abstract: Machine learning has recently become a promising technique in fluid mechanics, especially for active flow control (AFC) applications. A recent work [J. Fluid Mech. (2019), vol. 865, pp. 281-302] has demonstrated the feasibility and effectiveness of deep reinforcement learning (DRL) in performing AFC over a circular cylinder at $Re = 100$, i.e., in the laminar flow regime. As a follow-up study, we investigate the same AFC problem at an intermediate Reynolds number, i.e., $Re = 1000$, where the turbulence in the flow poses great challenges to the control. The results show that the DRL agent can still find effective control strategies, but requires much more episodes in the learning. A remarkable drag reduction of around $30\%$ is achieved, which is accompanied by elongation of the recirculation bubble and reduction of turbulent fluctuations in the cylinder wake. To our best knowledge, this study is the first successful application of DRL to AFC in weak turbulent conditions. It therefore sets a new milestone in progressing towards AFC in strong turbulent flows.


title: Spin magnetometry as a probe of stripe superconductivity in twisted bilayer graphene

abstract: The discovery of alternating superconducting and insulating ground-states in magic angle graphene has suggested an intriguing analogy with cuprate high-$T_c$ materials. Here we argue that the network states of small angle twisted bilayer graphene (TBG) afford a further perspective on the cuprates by emulating their stripe-ordered phases, as in La$_{1.875}$Ba$_{0.125}$CuO$_4$. We show that the spin and valley quantum numbers of stripes in TBG graphene fractionalize, developing characteristic signatures in the tunneling density of states and the magnetic noise spectrum of impurity spins. By examining the coupling between the charge rivers we determine the superconducting transition temperature. Our study suggests that magic angle graphene can be used for a controlled emulation of stripe superconductivity and quantum sensing experiments of emergent anyonic excitations.


title: Deep Learning Enabled Semantic Communication Systems

abstract: Recently, deep learned enabled end-to-end (E2E) communication systems have been developed to merge all physical layer blocks in the traditional communication systems, which make joint transceiver optimization possible. Powered by deep learning, natural language processing (NLP) has achieved great success in analyzing and understanding large amounts of language texts. Inspired by research results in both areas, we aim to providing a new view on communication systems from the semantic level. Particularly, we propose a deep learning based semantic communication system, named DeepSC, for text transmission. Based on the Transformer, the DeepSC aims at maximizing the system capacity and minimizing the semantic errors by recovering the meaning of sentences, rather than bit- or symbol-errors in traditional communications. Moreover, transfer learning is used to ensure the DeepSC applicable to different communication environments and to accelerate the model training process. To justify the performance of semantic communications accurately, we also initialize a new metric, named sentence similarity. Compared with the traditional communication system without considering semantic information exchange, the proposed DeepSC is more robust to channel variation and is able to achieve better performance, especially in the low signal-to-noise (SNR) regime, as demonstrated by the extensive simulation results.


title: Controlling the quantum speed limit time for unital maps via filtering operations

abstract: The minimum time a system needs to change from an initial state to a final orthogonal state is called quantum speed limit time. Quantum speed limit time can be used to quantify the speed of the quantum evolution. The speed of the quantum evolution will increase, if the quantum speed limit time decreases. In this work we will use relative purity based bound for quantum speed limit time. It is applicable for any arbitrary initial state. Here, we investigate the effects of filtering operation on quantum speed limit time. It will be observed that for some intervals of filtering operation parameter the quantum speed limit time is decreased by increasing filtering operation parameter and for some other intervals it is decreased by decreasing filtering operation parameter.


title: Flexible ferromagnetic nanowires with ultralow magnetostriction

abstract: Integration of magneto-electric and spintronic sensors presents a massive potential for advancing flexible and wearable technology. Magnetic nanowires are core components for building such devices, and therefore it important to realize flexible magnetic nanowires and uncover magneto-elastic properties, which can propel not only such flexible sensing applications, but can also make new pathways for exploration of flexible magneto-plasmonic devices, and discovering unseen observations at reduced dimensions. Here, we realize ferromagnetic nanowires on flexible substrates for the first time. Through extensive magneto-optical Kerr experiments, exploring the Villari effect in such nanowires, we reveal a two-order of magnitude reduced magnetostrictive constant in nanowires, compared to bulk values. In addition, the nanowires exhibit a remarkably resilient behavior sustaining bending radii ~ 5 mm, very high endurance, and enhanced elastic limit compared to thin films of similar thickness and composition. We confirm the observed performance by micro-magnetic simulations and attribute the observations to the size reduction and high nanostructure-interfacial effects. The flexible magnetic nanowires with ultralow magnetostriction open up new opportunities for stable surface mountable and wearable spintronic sensors, enable a credible way for engineering advanced nanospintronic devices and exploring new effects in hybrid heterostructures.


title: Fermionic Chern insulator from twisted light with linear polarization

abstract: The breaking of time-reversal symmetry is a crucial ingredient to topological bands. It can occur intrisically in materials with magnetic order, or be induced by external fields, such as magnetic fields in quantum Hall systems, or circularly polarized light fields in Floquet Chern insulators. Apart from polarization, photons can carry another degree of freedom, orbital angular momentum, through which time-reversal symmetry can be broken. In this Letter, we pose the question whether this property allows for inducing topological bands via a linearly polarized but twisted light beam. To this end, we study a graphene-like model of electrons on a honeycomb lattice interacting with a twisted light field. To identify topological behavior of the electrons, we calculate their local markers of Chern number, and monitor the presence of in-gap edge states. Our results are shown to be fully analogous to the behavior found in paradigmatic models for static and driven Chern insulators, and realizing the state is experimentally straightforward. With this, our work establishes a new mechanism for generating Fermionic topological phases of matter that can harness the central phase singularity of an optical vortex beam.


title: Free Energy Wells and Overlap Gap Property in Sparse PCA

abstract: We study a variant of the sparse PCA (principal component analysis) problem in the "hard" regime, where the inference task is possible yet no polynomial-time algorithm is known to exist. Prior work, based on the low-degree likelihood ratio, has conjectured a precise expression for the best possible (sub-exponential) runtime throughout the hard regime. Following instead a statistical physics inspired point of view, we show bounds on the depth of free energy wells for various Gibbs measures naturally associated to the problem. These free energy wells imply hitting time lower bounds that corroborate the low-degree conjecture: we show that a class of natural MCMC (Markov chain Monte Carlo) methods (with worst-case initialization) cannot solve sparse PCA with less than the conjectured runtime. These lower bounds apply to a wide range of values for two tuning parameters: temperature and sparsity misparametrization. Finally, we prove that the Overlap Gap Property (OGP), a structural property that implies failure of certain local search algorithms, holds in a significant part of the hard regime.

categories: math.PR cs.DS cs.LG math.OC math.ST stat.TH


title: Intrinsic Spin Photogalvanic Effect in Nonmagnetic Insulator

abstract: We show that with the help of spin-orbit coupling, nonlinear light-matter interactions can efficiently couple with spin and valley degrees of freedom. This revealed spin photogalvanic effect can generate the long-time pursued intrinsic pure spin current (PSC) in non-centrosymmetric nonmagnetic insulators. Different from the spin and valley Hall effect, such a photo-driven spin current is universal and can be generated without external bias field. Using first-principles simulation, we study monolayer transition metal dichalcogenides (TMDs) to demonstrate this effect and confirm an enhanced PSC under linearly polarized photoexcitation. The amplitude of the PSC is one order larger than that of the charge current observed in monolayer TMDs. This exotic nonlinear light-spin interaction indicates that light can be utilized as a rapid fashion to manipulate the spin-polarized current, which is crucial for future low-dissipation nanodevices.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.comp-ph physics.optics


title: Formation of Uniform Crystal and Reduction of Electrical Variation in HfZrO$_2$ Ferroelectric Memory by Thermal Engineering

abstract: In this paper we proclaim excellent variation control in Hf$_{0.5}$Zr$_{0.5}$O$_2$ based ferroelectric films obtained by germination of large ferroelectric domain via extended duration of thermal annealing. 10nm thick Hf$_{0.5}$Zr$_{0.5}$O$_2$ based ferroelectric capacitors with TiN as bottom and top electrodes are fabricated and characterized. The duration of rapid thermal annealing (RTA) is varied to observe its effect on crystal formation and device electrical properties at 700C. The device to device variation in terms of coercive voltage and peak capacitance are reduced from 0.4V to 0.01V and from 2*$10^{-5}$nF/cm$^2$ to 4*$10^{-6}$nF/cm$^2$, respectively, by increasing the RTA duration. High resolution transmission electron micrograph clearly shows large and uniform ferroelectric domains with RTA of 180 seconds. Extended duration of RTA likely allows uniform crystal to form, which mitigates the stochasticity of the distribution of ferroelectric and paraelectric domains, and deterministic switching has been infused. This improvement paves the way for implementing Hf$_{0.5}$Zr$_{0.5}$O$_2$ based deeply scaled devices for memory and steep slope device applications.


title: Online Dynamic B-Matching With Applications to Reconfigurable Datacenter Networks

abstract: This paper initiates the study of online algorithms for the maximum weight $b$-matching problem, a generalization of maximum weight matching where each node has at most $b \geq 1$ adjacent matching edges. The problem is motivated by emerging optical technologies which allow to enhance datacenter networks with reconfigurable matchings, providing direct connectivity between frequently communicating racks. These additional links may improve network performance, by leveraging spatial and temporal structure in the workload. We show that the underlying algorithmic problem features an intriguing connection to online paging (a.k.a. caching), but introduces a novel challenge. Our main contribution is an online algorithm which is $O(b)$-competitive; we also prove that this is asymptotically optimal. We complement our theoretical results with extensive trace-driven simulations, based on real-world datacenter workloads as well as synthetic traffic traces.


title: Quantitative Sensitivity Bounds for Nonlinear Programming and Time-varying Optimization

abstract: Inspired by classical sensitivity results for nonlinear optimization, we derive and discuss new quantitative bounds to characterize the solution map and dual variables of a parametrized nonlinear program. In particular, we derive explicit expressions for the local and global Lipschitz constants of the solution map of non-convex or convex optimization problems, respectively. Our results are geared towards the study of time-varying optimization problems which are commonplace in various applications of online optimization, including power systems, robotics, signal processing and more. In this context, our results can be used to bound the rate of change of the optimizer. To illustrate the use of our sensitivity bounds we generalize existing arguments to quantify the tracking performance of continuous-time, monotone running algorithms. Further, we introduce a new continuous-time running algorithm for time-varying constrained optimization which we model as a so-called perturbed sweeping process. For this discontinuous scheme, we establish an explicit bound on the asymptotic solution tracking for a class of convex problems.


title: Planetary statistics and forecasting for solar flares

abstract: Indications are presented for a significant connection between the relative motion of the planets and the appearance of energetic solar flares. Based on the records of the last four decades, the analysis highlights remarkable features and a lack of randomness in the data. The indications are supported further by the predictive power of a preliminary application to forecasting with machine learning methods.


title: Behavior of solutions to the 1D focusing stochastic nonlinear Schr\"odinger equation with spatially correlated noise

abstract: We study the focusing stochastic nonlinear Schr\"odinger equation in one spatial dimension with multiplicative noise, driven by a Wiener process white in time and colored in space, in the $L^2$-critical and supercritical cases. The mass ($L^2$-norm) is conserved due to the multiplicative noise defined via the Stratonovich integral, the energy (Hamiltonian) is not preserved. We first investigate how the energy is affected by various spatially correlated random perturbations. We then study the influence of the noise on the global dynamics measuring the probability of blow-up versus scattering behavior depending on various parameters of correlation kernels. Finally, we study the effect of the spatially correlated noise on the blow-up behavior, and conclude that such random perturbations do not influence the blow-up dynamics, except for shifting of the blow-up center location. This is similar to what we observed in [32] for a space-time white driving noise.


title: Conflict in Africa during COVID-19: social distancing, food vulnerability and welfare response

abstract: We study the effect of social distancing, food vulnerability, welfare and labour COVID-19 policy responses on riots, violence against civilians and food-related conflicts. Our analysis uses georeferenced data for 24 African countries with monthly local prices and real-time conflict data reported in the Armed Conflict Location and Event Data Project (ACLED) from January 2015 until early May 2020. Lockdowns and recent welfare policies have been implemented in light of COVID-19, but in some contexts also likely in response to ongoing conflicts. To mitigate the potential risk of endogeneity, we use instrumental variables. We exploit the exogeneity of global commodity prices, and three variables that increase the risk of COVID-19 and efficiency in response such as countries colonial heritage, male mortality rate attributed to air pollution and prevalence of diabetes in adults. We find that the probability of experiencing riots, violence against civilians, food-related conflicts and food looting has increased since lockdowns. Food vulnerability has been a contributing factor. A 10% increase in the local price index is associated with an increase of 0.7 percentage points in violence against civilians. Nonetheless, for every additional anti-poverty measure implemented in response to COVID-19 the probability of experiencing violence against civilians, riots and food-related conflicts declines by approximately 0.2 percentage points. These anti-poverty measures also reduce the number of fatalities associated with these conflicts. Overall, our findings reveal that food vulnerability has increased conflict risks, but also offer an optimistic view of the importance of the state in providing an extensive welfare safety net.


title: Odd, spoof perfect factorizations

abstract: We investigate the integer solutions of Diophantine equations related to perfect numbers. These solutions generalize the example, found by Descartes in 1638, of an odd, ``spoof'' perfect factorization $3^2\cdot 7^2\cdot 11^2\cdot 13^2\cdot 22021^1$. More recently, Voight found the spoof perfect factorization $3^4\cdot 7^2\cdot 11^2\cdot 19^2\cdot(-127)^1$. No other examples appear in the literature. We compute all nontrivial, odd, primitive spoof perfect factorizations with fewer than seven bases -- there are twenty-one in total. We show that the structure of odd, spoof perfect factorizations is extremely rich, and there are multiple infinite families of them. This implies that certain approaches to the odd perfect number problem that use only the multiplicative nature of the sum-of-divisors function are unworkable. On the other hand, we prove that there are only finitely many nontrivial, odd, primitive spoof perfect factorizations with a fixed number of bases.


title: Resource Pools and the CAP Theorem

abstract: Blockchain protocols differ in fundamental ways, including the mechanics of selecting users to produce blocks (e.g., proof-of-work vs. proof-of-stake) and the method to establish consensus (e.g., longest chain rules vs. BFT-inspired protocols). These fundamental differences have hindered "apples-to-apples" comparisons between different categories of blockchain protocols and, in turn, the development of theory to formally discuss their relative merits. This paper presents a parsimonious abstraction sufficient for capturing and comparing properties of many well-known permissionless blockchain protocols, simultaneously capturing essential properties of both proof-of-work and proof-of-stake protocols, and of both longest-chain-type and BFT-type protocols. Our framework blackboxes the precise mechanics of the user selection process, allowing us to isolate the properties of the selection process which are significant for protocol design. We illustrate our framework's utility with two results. First, we prove an analog of the CAP theorem from distributed computing for our framework in a partially synchronous setting. This theorem shows that a fundamental dichotomy holds between protocols (such as Bitcoin) that are adaptive, in the sense that they can function given unpredictable levels of participation, and protocols (such as Algorand) that have certain finality properties. Second, we formalize the idea that proof-of-work (PoW) protocols and non-PoW protocols can be distinguished by the forms of permission that users are given to carry out updates to the state.


title: Existence of solutions for the surface electromigration equation

abstract: We consider a model that describes electromigration in nanoconductors known as surface electromigration (SEM) equation. Our purpose here is to establish local well-posedness for the associated initial value problem in Sobolev spaces from two different points of view. In the first one, we study the pure Cauchy problem and establish local well-posedness in $H^s(\mathbb{R}^2)$, $s>1/2$. In the second one, we study the Cauchy problem on the background of a Korteweg-de Vries solitary traveling wave in a less regular space. To obtain our results we make use of the smoothing properties of solutions for the linear problem corresponding to the Zakharov-Kuznetsov equation for the latter problem. For the former problem we use bilinear estimates in Fourier restriction spaces established by Molinet and Pilod.


title: Galaxy cluster cores as seen with VLT/MUSE: new strong-lensing analyses of RX J2129.4+0009, MS 0451.6-0305 & MACSJ2129.4-0741

abstract: We present strong-lensing analyses of three galaxy clusters, RXJ2129.4+0009 (z=0.235), MS0451.6-0305 (z=0.55), and MACSJ2129.4-0741 (z=0.589), using the powerful combination of Hubble Space Telescope (HST) multi-band observations, and Multi-Unit Spectroscopic Explorer (MUSE) spectroscopy. In RXJ2129, we newly spectroscopically confirm 15 cluster members. Our resulting mass model uses 8 multiple image systems as we include a galaxy-galaxy lensing system North-East of the cluster, and is composed of 71 halos including one dark matter cluster-scale halo and 2 galaxy-scale halos optimized individually. For MS0451, we report the spectroscopic identification of 2 new systems of multiple images in the Northern region, and 112 cluster members. Our mass model uses 16 multiple image systems, and 146 halos, including 2 large-scale halos, and 7 galaxy-scale halos independently optimized. For MACSJ2129, we report the spectroscopic identification of one new multiple image system at z=4.41, and newly measure spectroscopic redshifts for 4 cluster members. Our mass model uses 14 multiple image systems, and is composed of 151 halos, including 2 large-scale halos and 4 galaxy-scale halos independently optimized. Our best models have rms of 0.29'', 0.6'', 0.74'' in the image plane for RXJ2129, MS0451, and MACSJ2129 respectively. This analysis presents a detailed comparison with the existing literature showing excellent agreements, and discuss specific studies of lensed galaxies, e.g. a group of submilimeter galaxies at z=2.9 in MS0451, and a bright z=2.1472 red singly imaged galaxy in MACSJ2129.


title: Deep Reinforcement Learning amidst Lifelong Non-Stationarity

abstract: As humans, our goals and our environment are persistently changing throughout our lifetime based on our experiences, actions, and internal and external drives. In contrast, typical reinforcement learning problem set-ups consider decision processes that are stationary across episodes. Can we develop reinforcement learning algorithms that can cope with the persistent change in the former, more realistic problem settings? While on-policy algorithms such as policy gradients in principle can be extended to non-stationary settings, the same cannot be said for more efficient off-policy algorithms that replay past experiences when learning. In this work, we formalize this problem setting, and draw upon ideas from the online learning and probabilistic inference literature to derive an off-policy RL algorithm that can reason about and tackle such lifelong non-stationarity. Our method leverages latent variable models to learn a representation of the environment from current and past experiences, and performs off-policy RL with this representation. We further introduce several simulation environments that exhibit lifelong non-stationarity, and empirically find that our approach substantially outperforms approaches that do not reason about environment shift.


title: Semi-Supervised Recognition under a Noisy and Fine-grained Dataset

abstract: Simi-Supervised Recognition Challenge-FGVC7 is a challenging fine-grained recognition competition. One of the difficulties of this competition is how to use unlabeled data. We adopted pseudo-tag data mining to increase the amount of training data. The other one is how to identify similar birds with a very small difference, especially those have a relatively tiny main-body in examples. We combined generic image recognition and fine-grained image recognition method to solve the problem. All generic image recognition models were training using PaddleClas . Using the combination of two different ways of deep recognition models, we finally won the third place in the competition.


title: The magnetic structure of the subsolar MPB current layer from MAVEN observations: Implications for the Hall electric force

abstract: We report on the local structure of the Martian subsolar Magnetic Pileup Boundary (MPB) from minimum variance analysis of the magnetic field measured by the Mars Atmosphere and Volatile EvolutioN (MAVEN) spacecraft for six orbits. In particular, we detect a well defined current layer within the MPB and provide a local estimate of its current density which results in a sunward Hall electric force. This force accounts for the deflection of the solar wind ions and the acceleration of electrons which carry the interplanetary magnetic field through the MPB into the Magnetic Pileup Region. We find that the thickness of the MPB current layer is of the order of both the upstream (magnetosheath) solar wind proton inertial length and convective gyroradius. This study provides a high resolution view of one of the components of the current system around Mars reported in recent works.


title: Latent Video Transformer

abstract: The video generation task can be formulated as a prediction of future video frames given some past frames. Recent generative models for videos face the problem of high computational requirements. Some models require up to 512 Tensor Processing Units for parallel training. In this work, we address this problem via modeling the dynamics in a latent space. After the transformation of frames into the latent space, our model predicts latent representation for the next frames in an autoregressive manner. We demonstrate the performance of our approach on BAIR Robot Pushing and Kinetics-600 datasets. The approach tends to reduce requirements to 8 Graphical Processing Units for training the models while maintaining comparable generation quality.


title: Set Distribution Networks: a Generative Model for Sets of Images

abstract: Images with shared characteristics naturally form sets. For example, in a face verification benchmark, images of the same identity form sets. For generative models, the standard way of dealing with sets is to represent each as a one hot vector, and learn a conditional generative model $p(\mathbf{x}|\mathbf{y})$. This representation assumes that the number of sets is limited and known, such that the distribution over sets reduces to a simple multinomial distribution. In contrast, we study a more generic problem where the number of sets is large and unknown. We introduce Set Distribution Networks (SDNs), a novel framework that learns to autoencode and freely generate sets. We achieve this by jointly learning a set encoder, set discriminator, set generator, and set prior. We show that SDNs are able to reconstruct image sets that preserve salient attributes of the inputs in our benchmark datasets, and are also able to generate novel objects/identities. We examine the sets generated by SDN with a pre-trained 3D reconstruction network and a face verification network, respectively, as a novel way to evaluate the quality of generated sets of images.


title: COVID-19 response needs to broaden financial inclusion to curb the rise in poverty

abstract: The ongoing COVID-19 pandemic risks wiping out years of progress made in reducing global poverty. In this paper, we explore to what extent financial inclusion could help mitigate the increase in poverty using cross-country data across 78 low- and lower-middle-income countries. Unlike other recent cross-country studies, we show that financial inclusion is a key driver of poverty reduction in these countries. This effect is not direct, but indirect, by mitigating the detrimental effect that inequality has on poverty. Our findings are consistent across all the different measures of poverty used. Our forecasts suggest that the world's population living on less than $1.90 per day could increase from 8% to 14% by 2021, pushing nearly 400 million people into poverty. However, urgent improvements in financial inclusion could substantially reduce the impact on poverty.


title: Does causal dynamics imply local interactions?

abstract: We consider quantum systems with causal dynamics in discrete spacetimes, also known as quantum cellular automata (QCA). Due to time-discreteness this type of dynamics is not characterized by a Hamiltonian but by a one-time-step unitary. This can be written as the exponential of a Hamiltonian but in a highly non-unique way. We ask if any of the Hamiltonians generating a QCA unitary is local in some sense, and we obtain two very different answers. On one hand, we present an example of QCA for which all generating Hamiltonians are fully non-local, in the sense that interactions do not decay with the distance. We expect this result to have relevant consequences for the classification of topological phases in Floquet systems, given that this relies on the effective Hamiltonian. On the other hand, we show that all one-dimensional quasi-free fermionic QCAs have quasi-local generating Hamiltonians, with interactions decaying exponentially in the massive case and algebraically in the critical case. We also prove that some integrable systems do not have local, quasi-local nor low-weight constants of motion; a result that challenges the standard definition of integrability.


title: Polynomials with Zeros on the Unit Circle: Regularity of Leja Sequences

abstract: Let $z_1, \dots, z_m$ be $m$ distinct complex numbers, normalized to $|z_k| = 1$, and consider the polynomial $$ p_{m}(z) = \prod_{k=1}^{m}{(z-z_k)}.$$ We define a sequence of polynomials in a greedy fashion, $$ p_{N+1}(z) = p_{N}(z) \left(z - z^*\right)\qquad \mbox{where}~z^* = \arg\max_{|z|=1} |p_{N}(z)|,$$ and prove that, independently of the initial polynomial $p_m$, the roots of $p_{N}$ equidistribute in angle at rate at most $(\log{N})^2/N$. This even persists when sometimes adding `adversarial' points by hand. We rephrase the main result in terms of a dynamical system involving the inverse fractional Laplacian $(-\Delta)^{-1/2}$ and conjecture that, when phrased in this language, the underlying regularity phenomenon might appear in a very general setting.


title: NH$_{3}$ (1,1) hyperfine intensity anomalies in the Orion A molecular cloud

abstract: In LTE, the two inner satellite lines (ISLs) and the two outer satellite lines (OSLs) of the NH$_{3}$ (1,1) transition are each predicted to have equal intensities. However, hyperfine intensity anomalies (HIAs) are observed to be omnipresent in star formation regions, which is still not fully understood. In addressing this issue, we find that the computation method of the HIA by the ratio of the peak intensities may have defects, especially when being used to process the spectra with low velocity dispersions. Therefore we define the integrated HIAs of the ISLs (HIA$_{\rm IS}$) and OSLs (HIA$_{\rm OS}$) by the ratio of their redshifted to blueshifted integrated intensities and develop a procedure to calculate them. Based on this procedure, we present a systematic study of the integrated HIAs in the northern part of the Orion A MC. We find that integrated HIA$_{\rm IS}$ and HIA$_{\rm OS}$ are commonly present in the Orion A MC and no clear distinction is found at different locations of the MC. The medians of the integrated HIA$_{\rm IS}$ and HIA$_{\rm OS}$ are 0.921$\pm$0.003 and 1.422$\pm$0.009, respectively, which is consistent with the HIA core model and inconsistent with the CE model. Selecting those 170 positions where both integrated HIAs deviate by more than 3-$\sigma$ from unity, most (166) are characterized by HIA$_{\rm IS}$<1 and HIA$_{\rm OS}$>1, which suggests that the HIA core model plays a more significant role than the CE model. The remaining four positions are consistent with the CE model. We compare the integrated HIAs with the para-NH$_{3}$ column density ($N$(para-NH$_{3}$)), kinetic temperature ($T_{\rm K}$), total velocity dispersion ($\sigma_{\rm v}$), non-thermal velocity dispersion ($\sigma_{\rm NT}$), and the total opacity of the NH$_{3}$ (1,1) line ($\tau_{0}$). Their correlations can not be fully explained by neither the HIA core nor the CE model.


title: A New Black Hole Solution In Dilaton Gravity Inspired By Power-Law Electrodynamics

abstract: In this work, a new class of slowly rotating black hole solutions in dilaton gravity has been obtained where dilaton field is coupled with nonlinear Maxwell invariant. The background space-time is a stationary axisymmetric geometry. Here, it has been shown that the dilaton potential can be written in the form of generalized three Liouville-type potentials. In the presence of this three Liouville-type dilaton potential, the asymptotic behavior of the obtained solutions are neither flat nor (A)dS. One bizarre property of the electric field is that the electric field goes to zero when $r\rightarrow 0$ and diverges at $r\rightarrow\infty$. We show the validity of the first law of thermodynamics in thermodynamic investigations. The local and global thermodynamical stability are investigated through the use of heat capacity and Gibbs free-energy. Also, the bounded, phase transition and the Hawking-Page phase transition points as well as the ranges of black hole stability have been shown in the corresponding diagrams. From these diagrams, we can say that the presence of the dilaton field makes the solutions to be locally stable near origin and vanishes the global stability of our solutions. In final thermodynamics analysis, we obtain the Smarr formula for our solution. We will show that the presence of dilaton field brings a new term in the Smarr formula. Also, we find that the dilaton field makes the black hole(AdS) mass to decrease for every fix values of S(entropy).


title: STEER: Simple Temporal Regularization For Neural ODEs

abstract: Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have shown that regularizing the dynamics of the ODE can partially alleviate this. In this paper we propose a new regularization technique: randomly sampling the end time of the ODE during training. The proposed regularization is simple to implement, has negligible overhead and is effective across a wide variety of tasks. Further, the technique is orthogonal to several other methods proposed to regularize the dynamics of ODEs and as such can be used in conjunction with them. We show through experiments on normalizing flows, time series models and image recognition that the proposed regularization can significantly decrease training time and even improve performance over baseline models.


title: Task-agnostic Out-of-Distribution Detection Using Kernel Density Estimation

abstract: In the recent years, researchers proposed a number of successful methods to perform out-of-distribution (OOD) detection in deep neural networks (DNNs). So far the scope of the highly accurate methods has been limited to image level classification tasks. However, attempts for generally applicable methods beyond classification did not attain similar performance. In this paper, we address this limitation by proposing a simple yet effective task-agnostic OOD detection method. We estimate the probability density functions (pdfs) of intermediate features of a pre-trained DNN by performing kernel density estimation (KDE) on the training dataset. As direct application of KDE to feature maps is hindered by their high dimensionality, we use a set of lower-dimensional marginalized KDE models instead of a single high-dimensional one. At test time, we evaluate the pdfs on a test sample and produce a confidence score that indicates the sample is OOD. The use of KDE eliminates the need for making simplifying assumptions about the underlying feature pdfs and makes the proposed method task-agnostic. We perform extensive experiments on classification tasks using benchmark datasets for OOD detection. Additionally, we perform experiments on medical image segmentation tasks using brain MRI datasets. The results demonstrate that the proposed method consistently achieves high OOD detection performance in both classification and segmentation tasks and improves state-of-the-art in almost all cases. Code is available at \url{https://github.com/eerdil/task_agnostic_ood}


title: Zero-Shot Learning with Common Sense Knowledge Graphs

abstract: Zero-shot learning relies on semantic class representations such as hand-engineered attributes or learned embeddings to predict classes without any labeled examples. We propose to learn class representations by embedding nodes from common sense knowledge graphs in a vector space. Common sense knowledge graphs are an untapped source of explicit high-level knowledge that requires little human effort to apply to a range of tasks. To capture the knowledge in the graph, we introduce ZSL-KG, a general-purpose framework with a novel transformer graph convolutional network (TrGCN) for generating class representations. Our proposed TrGCN architecture computes non-linear combinations of node neighbourhoods. Our results show that ZSL-KG improves over existing WordNet-based methods on five out of six zero-shot benchmark datasets in language and vision.


title: Uncertainty quantification for epidemiological forecasts of COVID-19 through combinations of model predictions

abstract: Scientific advice to the UK government throughout the COVID-19 pandemic has been informed by ensembles of epidemiological models provided by members of the Scientific Pandemic Influenza group on Modelling (SPI-M). Among other applications, the model ensembles have been used to forecast daily incidence, deaths and hospitalizations. The models differ in approach (e.g. deterministic or agent-based) and in assumptions made about the disease and population. These differences capture genuine uncertainty in the understanding of disease dynamics and in the choice of simplifying assumptions underpinning the model. Although analyses of multi-model ensembles can be logistically challenging when time-frames are short, accounting for structural uncertainty can improve accuracy and reduce the risk of over-confidence in predictions. In this study, we compare the performance of various ensemble methods to combine short-term (14 day) COVID-19 forecasts within the context of the pandemic response. We address practical issues around the availability of model predictions and make some initial proposals to address the short-comings of standard methods in this challenging situation.


title: List-Decodable Mean Estimation via Iterative Multi-Filtering

abstract: We study the problem of {\em list-decodable mean estimation} for bounded covariance distributions. Specifically, we are given a set $T$ of points in $\mathbb{R}^d$ with the promise that an unknown $\alpha$-fraction of points in $T$, where $0< \alpha < 1/2$, are drawn from an unknown mean and bounded covariance distribution $D$, and no assumptions are made on the remaining points. The goal is to output a small list of hypothesis vectors such that at least one of them is close to the mean of $D$. We give the first practically viable estimator for this problem. In more detail, our algorithm is sample and computationally efficient, and achieves information-theoretically near-optimal error. While the only prior algorithm for this setting inherently relied on the ellipsoid method, our algorithm is iterative and only uses spectral techniques. Our main technical innovation is the design of a soft outlier removal procedure for high-dimensional heavy-tailed datasets with a majority of outliers.


title: Market Graph Clustering Via QUBO and Digital Annealing

abstract: Our goal is to find representative nodes of a market graph that best replicate the returns of a broader market graph (index), a common task in the financial industry. We model our reference index as a market graph and express the index tracking problem in a quadratic K-medoids form. We take advantage of a purpose built hardware architecture, the Fujitsu Digital Annealer, to circumvent the NP-hard nature of the problem and solve our formulation efficiently. In this article, we combine three separate areas of the literature, market graph models, K-medoid clustering and quadratic binary optimization modeling, to formulate the index-tracking problem as a quadratic K-medoid graph-clustering problem. Our initial results show we accurately replicate the returns of a broad market index, using only a small subset of its constituent assets. Moreover, our quadratic formulation allows us to take advantage of recent hardware advances, to overcome the NP-hard nature of the problem.


title: A flexible spiraling-metasurface as a versatile haptic interface

abstract: Haptic feedback is the most significant sensory interface following visual cues. Developing thin, flexible surfaces that function as haptic interfaces is important for augmenting virtual reality, wearable devices, robotics and prostheses. For example, adding a haptic feedback interface to prosthesis could improve their acceptance among amputees. State of the art programmable interfaces targeting the skin feel-of-touch through mechano-receptors are limited by inadequate sensory feedback, cumbersome mechanisms or narrow frequency of operation. Here, we present a flexible metasurface as a generic haptic interface capable of producing complex tactile patterns on the human skin at wide range of frequencies. The metasurface is composed of multiple "pixels" that can locally amplify both input displacements and forces. Each of these pixels encodes various deformation patterns capable of producing different sensations on contact. The metasurface can transform a harmonic signal containing multiple frequencies into a complex preprogrammed tactile pattern. Our findings, corroborated by user studies conducted on human candidates, can open new avenues for wearable and robotic interfaces.


title: A numerical study on combustion mode characterization for locally stratified dual-fuel mixtures

abstract: Combustion modes in locally stratified dual-fuel (DF) mixtures are numerically investigated for methanol n-dodecane blends under engine-relevant pressures. In the studied constant-volume numerical setup, methanol acts as a background low-reactivity fuel (LRF) while n-dodecane serves as high-reactivity fuel (HRF), controlling local ignition delay time. The spatial distribution of n-dodecane is modeled as a sinusoidal function parametrized by stratification amplitude (Y) and wavelength (0.01 mm<$\lambda$<15 mm). In contrast, methanol is assumed to be fully premixed with air at equivalence ratio 0.8. First, one-dimensional setup is investigated by hundreds of chemical kinetics simulations in (Y,$\lambda$) parameter space. Further, the concepts by Sankaran et al. 2005 and Zeldovich 1980 on ignition front propagation speed are applied to develop a theoretical analysis of the time-dependent diffusion-reaction problem. The theoretical analysis predicts two combustion modes, 1) spontaneous ignition and 2) deflagrative propagation, and leads to an analytical expression for the border curve called $\beta$-curve herein. One-dimensional chemical kinetics simulations confirm the presence of two combustion modes in (Y,$\lambda$) parameter space while the $\beta$-curve explains consistently the position of phase border observed in the simulations. Finally, the role of convective mixing is incorporated to the theoretical expression for the $\beta$-curve. The effect of convection on combustion mode is assessed by carrying out two-dimensional fully-resolved simulations with different turbulence levels. Two-dimensional numerical simulation results give evidence on combustion mode switching, which is consistent with predictions of the modified $\beta$-curve for turbulent cases. The practical output of the paper is the $\beta$-curve which is proposed as a predictive tool to estimate combustion modes ...


title: SwissCovid: a critical analysis of risk assessment by Swiss authorities

abstract: Ahead of the rollout of the SwissCovid contact tracing app, an official public security test was performed. During this audit, Prof. Serge Vaudenay and Dr. Martin Vuagnoux described a large set of problems with the app, including a new variation of a known false-positive attack, leveraging a cryptographic weakness in the Google and Apple Exposure Notification framework to tamper with the emitted Bluetooth beacons. Separately, the first author described a re-identification attack leveraging rogue apps or SDKs. The response from the Swiss cybersecurity agency and the Swiss public health authority was to claim these various attacks were unlikely as they required physical proximity of the attacker with the target (although it was admitted the attacker could be further than two meters). The physical presence of the attacker in Switzerland was deemed significant as it would imply such attackers would fall under the Swiss Criminal Code. We show through one example that a much larger variety of adversaries must be considered in the scenarios originally described and that these attacks can be done by adversaries without any physical presence in Switzerland. This goes directly against official findings of Swiss public authorities evaluating the risks associated with SwissCovid. To move the discussion further along, we briefly discuss the growth of the attack surface and harms with COVID-19 and SwissCovid prevalence in the population. While the focus of this article is on Switzerland, we emphasize the core technical findings and cybersecurity concerns are of relevance to many contact tracing efforts.


title: IReEn: Reverse-Engineering of Black-Box Functions via Iterative Neural Program Synthesis

abstract: In this work, we investigate the problem of revealing the functionality of a black-box agent. Notably, we are interested in the interpretable and formal description of the behavior of such an agent. Ideally, this description would take the form of a program written in a high-level language. This task is also known as reverse engineering and plays a pivotal role in software engineering, computer security, but also most recently in interpretability. In contrast to prior work, we do not rely on privileged information on the black box, but rather investigate the problem under a weaker assumption of having only access to inputs and outputs of the program. We approach this problem by iteratively refining a candidate set using a generative neural program synthesis approach until we arrive at a functionally equivalent program. We assess the performance of our approach on the Karel dataset. Our results show that the proposed approach outperforms the state-of-the-art on this challenge by finding an approximately functional equivalent program in 78% of cases -- even exceeding prior work that had privileged information on the black-box.


title: Ocean: Object-aware Anchor-free Tracking

abstract: Anchor-based Siamese trackers have achieved remarkable advancements in accuracy, yet the further improvement is restricted by the lagged tracking robustness. We find the underlying reason is that the regression network in anchor-based methods is only trained on the positive anchor boxes (i.e., $IoU \geq0.6$). This mechanism makes it difficult to refine the anchors whose overlap with the target objects are small. In this paper, we propose a novel object-aware anchor-free network to address this issue. First, instead of refining the reference anchor boxes, we directly predict the position and scale of target objects in an anchor-free fashion. Since each pixel in groundtruth boxes is well trained, the tracker is capable of rectifying inexact predictions of target objects during inference. Second, we introduce a feature alignment module to learn an object-aware feature from predicted bounding boxes. The object-aware feature can further contribute to the classification of target objects and background. Moreover, we present a novel tracking framework based on the anchor-free model. The experiments show that our anchor-free tracker achieves state-of-the-art performance on five benchmarks, including VOT-2018, VOT-2019, OTB-100, GOT-10k and LaSOT. The source code is available at https://github.com/researchmm/TracKit.


title: Modular Invariant Quark and Lepton Models in Double Covering of $S_4$ Modular Group

abstract: We perform a comprehensive analysis of the homogeneous finite modular group $\Gamma'_4\equiv S'_4$ which is the double covering of $S_4$ group. The weight 1 modular forms of level 4 are constructed in terms of Dedekind eta function, and they transform as a triplet $\mathbf{\hat{3}'}$ of $S'_4$. The integral weight modular forms until weight 6 are built from the tensor products of weight 1 modular forms. We perform a systematical classification of $S'_4$ modular models for lepton masses and mixing with/without generalized CP, where the left-handed leptons are assigned to triplet of $S'_4$ and right-handed charged leptons transform as singlets under $S'_4$, and we consider both scenarios where the neutrino masses arise from Weinberg operator or type I seesaw mechanism. The phenomenological implications of the minimal models for lepton masses, mixing angles, CP violation phases and neutrinoless double decay are discussed. The $S'_4$ modular symmetry is extended to quark sector, we present several predictive models which use nine or ten free parameters including real and imaginary parts of $\tau$ to describe quark masses and Cabibbo-Kobayashi-Maskawa mixing matrix. We give a quark-lepton unified model which can explain the flavor structure of quarks and leptons simultaneously for a common value of $\tau$.


title: The relationship between individual variation in macroscale functional gradients and distinct aspects of ongoing thought

abstract: Contemporary accounts of ongoing thought recognise it as a heterogeneous and multidimensional construct, varying in both form and content. An emerging body of evidence demonstrates that distinct types of experience are associated with unique neurocognitive profiles, that can be described at the whole-brain level as interactions between multiple large-scale networks. The current study sought to explore the possibility that whole-brain functional connectivity patterns at rest may be meaningfully related to patterns of ongoing thought that occurred over this period. Participants underwent resting-state functional magnetic resonance imaging (rs-fMRI) followed by a questionnaire retrospectively assessing the content and form of their ongoing thoughts during the scan. A non-linear dimension reduction algorithm was applied to the rs-fMRI data to identify components explaining the greatest variance in whole-brain connectivity patterns, and ongoing thought patterns during the resting-state were measured retrospectively at the end of the scan. Multivariate analyses revealed that individuals for whom the connectivity of the sensorimotor system was maximally distinct from the visual system were most likely to report thoughts related to finding solutions to problems or goals and least likely to report thoughts related to the past. These results add to an emerging literature that suggests that unique patterns of experience are associated with distinct distributed neurocognitive profiles and highlight that unimodal systems may play an important role in this process.


title: Cyclic Differentiable Architecture Search

abstract: Differentiable ARchiTecture Search, i.e., DARTS, has drawn great attention in neural architecture search. It tries to find the optimal architecture in a shallow search network and then measures its performance in a deep evaluation network. The independent optimization of the search and evaluation networks, however, leaves room for potential improvement by allowing interaction between the two networks. To address the problematic optimization issue, we propose new joint optimization objectives and a novel Cyclic Differentiable ARchiTecture Search framework, dubbed CDARTS. Considering the structure difference, CDARTS builds a cyclic feedback mechanism between the search and evaluation networks with introspective distillation. First, the search network generates an initial architecture for evaluation, and the weights of the evaluation network are optimized. Second, the architecture weights in the search network are further optimized by the label supervision in classification, as well as the regularization from the evaluation network through feature distillation. Repeating the above cycle results in joint optimization of the search and evaluation networks and thus enables the evolution of the architecture to fit the final evaluation network. The experiments and analysis on CIFAR, ImageNet and NAS-Bench-201 demonstrate the effectiveness of the proposed approach over the state-of-the-art ones. Specifically, in the DARTS search space, we achieve 97.52% top-1 accuracy on CIFAR10 and 76.3% top-1 accuracy on ImageNet. In the chain-structured search space, we achieve 78.2% top-1 accuracy on ImageNet, which is 1.1% higher than EfficientNet-B0. Our code and models are publicly available at https://github.com/microsoft/Cream.


title: The Chabauty-Kim Method for Relative Completions

abstract: In this thesis we develop a Chabauty-Kim theory for the relative completion of motivic fundamental groups, including Selmer stacks and moduli spaces of admissible torsors for the relative completion of the de Rham fundamental group. On one hand, this work generalizes results of Kim (and therefore Chabauty) in the unipotent case by adding a reductive quotient of the fundamental group. From this perspective, the addition of a reductive part allows one to apply Chabauty-type methods to fundamental groups with trivial unipotent completion, such as $SL_2(\mathbb{Z})$. On the other hand, the unipotent part provides a natural extension of the recent work of Lawrence and Venkatesh. We show that their concern with the centralizer of Frobenius goes away as one moves up the unipotent tower and away from the reductive world of flag varieties and the Gauss-Manin connection. One is tempted to hope that the relative completion will provide a unified proof of Mordell's conjecture that takes advantage of the two methods. Toward this end, we apply our work to the Legendre family on the projective line minus three points, a particular example where the method of Lawrence and Venkatesh fails.


title: Tent: Fully Test-time Adaptation by Entropy Minimization

abstract: A model must adapt itself to generalize to new and different data during testing. In this setting of fully test-time adaptation the model has only the test data and its own parameters. We propose to adapt by test entropy minimization (tent): we optimize the model for confidence as measured by the entropy of its predictions. Our method estimates normalization statistics and optimizes channel-wise affine transformations to update online on each batch. Tent reduces generalization error for image classification on corrupted ImageNet and CIFAR-10/100 and reaches a new state-of-the-art error on ImageNet-C. Tent handles source-free domain adaptation on digit recognition from SVHN to MNIST/MNIST-M/USPS, on semantic segmentation from GTA to Cityscapes, and on the VisDA-C benchmark. These results are achieved in one epoch of test-time optimization without altering training.


title: Unexpected emission pattern adds to the enigma of fast radio bursts

abstract: Observations of millisecond-long radio bursts from beyond the Milky Way have revealed a repeat pattern with a roughly 16-day period -- a finding that adds to the enigma of the origin of these bursts.


title: Diverse Image Generation via Self-Conditioned GANs

abstract: We introduce a simple but effective unsupervised method for generating realistic and diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels automatically derived from clustering in the discriminator's feature space. Our clustering step automatically discovers diverse modes, and explicitly requires the generator to cover them. Experiments on standard mode collapse benchmarks show that our method outperforms several competing methods when addressing mode collapse. Our method also performs well on large-scale datasets such as ImageNet and Places365, improving both image diversity and standard quality metrics, compared to previous methods.


title: Controlling electrical conduction through noble metal thin films by surface plasmon resonance

abstract: The collective oscillations of surface charges (surface plasmons) induced by light-matter interactions were predicted in the 1950s to influence electrical conduction in 2D noble metals. Primarily two mechanisms were predicted and later by Frohlich which could affect the electron transport in metals; (1) Umklapp electron-electron scattering and (2) attractive interaction between free electrons in transition metals because of screening of the d-band electrons by the s-band electrons. [1] However, there is no experimental evidence to date on how such oscillations might influence the electrical conductivity of 2D metals. We have conducted in-situ measurements of the surface plasmons and electrical resistivity of thin film gold. We observe striking correlations between the electrical resistivity of noble metal thin films and surface plasmon resonance


title: Edge Channels of Broken-Symmetry Quantum Hall States in Graphene probed by Atomic Force Microscopy

abstract: The quantum Hall (QH) effect, a topologically non-trivial quantum phase, expanded and brought into focus the concept of topological order in physics. The topologically protected quantum Hall edge states are of crucial importance to the QH effect but have been measured with limited success. The QH edge states in graphene take on an even richer role as graphene is distinguished by its four-fold degenerate zero energy Landau level (zLL), where the symmetry is broken by electron interactions on top of lattice-scale potentials but has eluded spatial measurements. In this report, we map the quantum Hall broken-symmetry edge states comprising the graphene zLL at integer filling factors of $\nu=0,\pm 1$ across the quantum Hall edge boundary using atomic force microscopy (AFM). Measurements of the chemical potential resolve the energies of the four-fold degenerate zLL as a function of magnetic field and show the interplay of the moir\'e superlattice potential of the graphene/boron nitride system and spin/valley symmetry-breaking effects in large magnetic fields.


title: Spin-Weighted Spherical CNNs

abstract: Learning equivariant representations is a promising way to reduce sample and model complexity and improve the generalization performance of deep neural networks. The spherical CNNs are successful examples, producing SO(3)-equivariant representations of spherical inputs. There are two main types of spherical CNNs. The first type lifts the inputs to functions on the rotation group SO(3) and applies convolutions on the group, which are computationally expensive since SO(3) has one extra dimension. The second type applies convolutions directly on the sphere, which are limited to zonal (isotropic) filters, and thus have limited expressivity. In this paper, we present a new type of spherical CNN that allows anisotropic filters in an efficient way, without ever leaving the spherical domain. The key idea is to consider spin-weighted spherical functions, which were introduced in physics in the study of gravitational waves. These are complex-valued functions on the sphere whose phases change upon rotation. We define a convolution between spin-weighted functions and build a CNN based on it. The spin-weighted functions can also be interpreted as spherical vector fields, allowing applications to tasks where the inputs or outputs are vector fields. Experiments show that our method outperforms previous methods on tasks like classification of spherical images, classification of 3D shapes and semantic segmentation of spherical panoramas.


title: When Does Preconditioning Help or Hurt Generalization?

abstract: While second order optimizers such as natural gradient descent (NGD) often speed up optimization, their effect on generalization has been called into question. This work presents a more nuanced view on how the \textit{implicit bias} of first- and second-order methods affects the comparison of generalization properties. We provide an exact asymptotic bias-variance decomposition of the generalization error of overparameterized ridgeless regression under a general class of preconditioner $\boldsymbol{P}$, and consider the inverse population Fisher information matrix (used in NGD) as a particular example. We determine the optimal $\boldsymbol{P}$ for both the bias and variance, and find that the relative generalization performance of different optimizers depends on the label noise and the "shape" of the signal (true parameters): when the labels are noisy, the model is misspecified, or the signal is misaligned with the features, NGD can achieve lower risk; conversely, GD generalizes better than NGD under clean labels, a well-specified model, or aligned signal. Based on this analysis, we discuss several approaches to manage the bias-variance tradeoff, and the potential benefit of interpolating between GD and NGD. We then extend our analysis to regression in the reproducing kernel Hilbert space and demonstrate that preconditioned GD can decrease the population risk faster than GD. Lastly, we empirically compare the generalization error of first- and second-order optimizers in neural network experiments, and observe robust trends matching our theoretical analysis.


title: A unified framework for equivalences in social networks

abstract: A key concern in network analysis is the study of social positions and roles of actors in a network. The notion of "position" refers to an equivalence class of nodes that have similar ties to other nodes, whereas a "role" is an equivalence class of compound relations that connect the same pairs of nodes. An open question in network science is whether it is possible to simultaneously perform role and positional analysis. Motivated by the principle of functoriality in category theory we propose a new method that allows to tie role and positional analysis together. We illustrate our methods on two well-studied data sets in network science.


title: Forward Prediction for Physical Reasoning

abstract: Physical reasoning requires forward prediction: the ability to forecast what will happen next given some initial world state. We study the performance of state-of-the-art forward-prediction models in the complex physical-reasoning tasks of the PHYRE benchmark. We do so by incorporating models that operate on object or pixel-based representations of the world into simple physical-reasoning agents. We find that forward-prediction models can improve physical-reasoning performance, particularly on complex tasks that involve many objects. However, we also find that these improvements are contingent on the test tasks being small variations of train tasks, and that generalization to completely new task templates is challenging. Surprisingly, we observe that forward predictors with better pixel accuracy do not necessarily lead to better physical-reasoning performance.Nevertheless, our best models set a new state-of-the-art on the PHYRE benchmark.


title: Dark Matter and the XENON1T electron recoil excess

abstract: We show that the electron recoil excess around 2 keV claimed by the Xenon collaboration can be fitted by DM or DM-like particles having a fast component with velocity of order $\sim 0.1$. Those particles cannot be part of the cold DM halo of our Galaxy, so we speculate about their possible nature and origin, such as fast moving DM sub-haloes, semi-annihilations of DM and relativistic axions produced by a nearby axion star. Feasible new physics scenarios must accommodate exotic DM dynamics and unusual DM properties.


title: Quantized Floquet topology with temporal noise

abstract: Time-periodic (Floquet) drive is a powerful method to engineer quantum phases of matter, including fundamentally non-equilibrium states that are impossible in static Hamiltonian systems. One characteristic example is the anomalous Floquet insulator, which exhibits topologically quantized chiral edge states similar to a Chern insulator, yet is amenable to bulk localization. We study the response of this topological system to time-dependent noise, which breaks the topologically protecting Floquet symmetry. Surprisingly, we find that the quantized response, given by partially filling the fermionic system and measuring charge pumped per cycle, remains quantized up to finite noise amplitude. We trace this robust topology to an interplay between diffusion and Pauli blocking of edge state decay, which we expect should be robust against interactions. We determine the boundaries of the topological phase for a system with spatial disorder numerically through level statistics, and corroborate our results in the limit of vanishing disorder through an analytical Floquet superoperator approach. This approach suggests an interpretation of the state of the system as a non-Hermitian Floquet topological phase. We comment on quantization of other topological responses in the absence of Floquet symmetry and potential experimental realizations.


title: Herschel SPIRE discovery of far-infrared excess synchrotron emission from the west hot spot of the radio galaxy Pictor A

abstract: A far-infrared counterpart to the west hot spot of the radio galaxy Pictor A is discovered with the Spectral and Photometric Imaging REceiver (SPIRE) onboard Herschel. The color-corrected flux density of the source is measured as $70.0 \pm 9.9$ mJy at the wavelength of 350 $\mu$m. A close investigation into its radio-to-optical spectrum indicates that the mid-infrared excess over the radio synchrotron component, detected with WISE and Spitzer, significantly contributes to the far-infrared band. Thanks to the SPIRE data, it is revealed that the spectrum of the excess is described by a broken power-law model subjected to a high-energy cutoff. By applying the radiative cooling break under continuous energy injection ($\Delta \alpha = 0.5$), the broken power-law model supports an idea that the excess originates in 10-pc scale substructures within the hot spot. From the break frequency, $\nu_{\rm b} = 1.6_{-1.0}^{+3.0} \times 10^{12}$ Hz, the magnetic field was estimated as $B\simeq1$-$4$ mG. This is higher than the minimum-energy magnetic field of the substructures by a factor of $3$--$10$. Even if the origin of the excess is larger than $\sim 100$ pc, the magnetic field stronger than the minimum-energy field is confirmed. It is proposed that regions with a magnetic field locally boosted via plasma turbulence are observed as the substructures. The derived energy index below the break, $\alpha \sim 0.22$ (conservatively $<0.42$), is difficult to be attributed to the strong-shock acceleration ($\alpha = 0.5$). Stochastic acceleration and magnetic reconnection are considered as a plausible alternative mechanism.


title: Differentiable Augmentation for Data-Efficient GAN Training

abstract: The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable Augmentation (DiffAugment), a simple method that improves the data efficiency of GANs by imposing various types of differentiable augmentations on both real and fake samples. Previous attempts to directly augment the training data manipulate the distribution of real images, yielding little benefit; DiffAugment enables us to adopt the differentiable augmentation for the generated samples, effectively stabilizes training, and leads to better convergence. Experiments demonstrate consistent gains of our method over a variety of GAN architectures and loss functions for both unconditional and class-conditional generation. With DiffAugment, we achieve a state-of-the-art FID of 6.80 with an IS of 100.8 on ImageNet 128x128 and 2-4x reductions of FID given 1,000 images on FFHQ and LSUN. Furthermore, with only 20% training data, we can match the top performance on CIFAR-10 and CIFAR-100. Finally, our method can generate high-fidelity images using only 100 images without pre-training, while being on par with existing transfer learning algorithms. Code is available at https://github.com/mit-han-lab/data-efficient-gans.


title: Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains

abstract: We show that passing input points through a simple Fourier feature mapping enables a multilayer perceptron (MLP) to learn high-frequency functions in low-dimensional problem domains. These results shed light on recent advances in computer vision and graphics that achieve state-of-the-art results by using MLPs to represent complex 3D objects and scenes. Using tools from the neural tangent kernel (NTK) literature, we show that a standard MLP fails to learn high frequencies both in theory and in practice. To overcome this spectral bias, we use a Fourier feature mapping to transform the effective NTK into a stationary kernel with a tunable bandwidth. We suggest an approach for selecting problem-specific Fourier features that greatly improves the performance of MLPs for low-dimensional regression tasks relevant to the computer vision and graphics communities.


title: Swing surfaces and holographic entanglement beyond AdS/CFT

abstract: We propose a holographic entanglement entropy prescription for general states and regions in two models of holography beyond AdS/CFT known as flat$_3$/BMSFT and (W)AdS$_3$/WCFT. Flat$_3$/BMSFT is a candidate of holography for asymptotically flat three-dimensional spacetimes, while (W)AdS$_3$/WCFT is relevant in the study of black holes in the real world. In particular, the boundary theories are examples of quantum field theories that feature an infinite dimensional symmetry group but break Lorentz invariance. Our holographic entanglement entropy proposal is given by the area of a swing surface that consists of ropes, which are null geodesics emanating from the entangling surface at the boundary, and a bench, which is a spacelike geodesic connecting the ropes. The proposal is supported by an extension of the Lewkowycz-Maldacena argument, reproduces previous results based on the Rindler method, and satisfies the first law of entanglement entropy.


title: Modular Hamiltonians in flat holography and (W)AdS/WCFT

abstract: We study several aspects of holographic entanglement in two models known as flat$_3$/BMSFT and (W)AdS$_3$/WCFT. These are two examples of holography beyond AdS/CFT where the the boundary field theories are not Lorentz invariant but still feature an infinite set of local symmetries. In the first example, BMS-invariant field theories (BMSFTs) are conjectured to provide a holographic description of quantum gravity in asymptotically flat three-dimensional spacetimes; while in the second example, warped conformal field theories (WCFTs) are proposed to describe quantum gravity in warped AdS$_3$ or AdS$_3$ backgrounds with Dirichlet-Neumann boundary conditions. In particular, we derive the modular Hamiltonian for single intervals in both BMSFTs and WCFTs and find the holographic duals in the bulk using the covariant formulation of gravitational charges. We also extend the first law of entanglement entropy to these models of non-AdS holography and discuss the bound on "modular chaos" introduced recently in the context of the AdS/CFT correspondence.


title: Learning Invariant Representations for Reinforcement Learning without Reconstruction

abstract: We study how representation learning can accelerate reinforcement learning from rich observations, such as images, without relying either on domain knowledge or pixel-reconstruction. Our goal is to learn representations that both provide for effective downstream control and invariance to task-irrelevant details. Bisimulation metrics quantify behavioral similarity between states in continuous MDPs, which we propose using to learn robust latent representations which encode only the task-relevant information from observations. Our method trains encoders such that distances in latent space equal bisimulation distances in state space. We demonstrate the effectiveness of our method at disregarding task-irrelevant information using modified visual MuJoCo tasks, where the background is replaced with moving distractors and natural videos, while achieving SOTA performance. We also test a first-person highway driving task where our method learns invariance to clouds, weather, and time of day. Finally, we provide generalization results drawn from properties of bisimulation metrics, and links to causal inference.


title: Search for TiO and Optical Night-side Emission from the Exoplanet WASP-33b

abstract: With a temperature akin to an M-dwarf, WASP-33b is among the hottest Jupiters known, making it an ideal target for high-resolution optical spectroscopy. By analyzing both transmission and emission spectra, we aim to substantiate previous reports of atmospheric TiO and a thermal inversion within the planet's atmosphere. We observed two transits and six arcs of the phase curve with ESPaDOns on the Canada-France-Hawaii Telescope and HIRES on the Keck telescope, which provide high spectral resolution and ample wavelength coverage. We employ the Doppler cross-correlation technique to search for the molecular signatures of TiO and H$_2$O in these spectra, using models based on the TiO line list of Plez (2012). Though we cannot exclude line-list-dependent effects, our data do not corroborate previous indications of a thermal inversion. Instead we place a $3\sigma$ upper limit of $10^{-9}$ on the volume mixing ratio of TiO for the T-P profile we consider. While we are unable to constrain the volume mixing ratio of water, our strongest constraint on TiO comes from day-side emission spectra. This apparent absence of a stratosphere sits in stark contrast to previous observations of WASP-33b as well as theoretical predictions for the atmospheres of highly irradiated planets. The discrepancy could be due to variances between line lists, and we stress that detection limits are only as good as the line list employed, and are only valid for the specific T-P profile considered due to the strong degeneracy between lapse rate ($dT/d\log P$) and molecular abundance.


title: A comparison of quasar emission reconstruction techniques for $z\geq5.0$ Lyman-$\alpha$ and Lyman-$\beta$ transmission

abstract: Reconstruction techniques for intrinsic quasar continua are crucial for the precision study of Lyman-$\alpha$ (Ly-$\alpha$) and Lyman-$\beta$ (Ly-$\beta$) transmission at $z>5.0$, where the $\lambda<1215 A$ emission of quasars is nearly completely absorbed. While the number and quality of spectroscopic observations has become theoretically sufficient to quantify Ly-$\alpha$ transmission at $5.0<z<6.0$ to better than $1\%$, the biases and uncertainties arising from predicting the unabsorbed continuum are not known to the same level. In this paper, we systematically evaluate eight reconstruction techniques on a unified testing sample of $2.7<z<3.5$ quasars drawn from eBOSS. The methods include power-law extrapolation, stacking of neighbours, and six variants of Principal Component Analysis (PCA) using direct projection, fitting of components, or neural networks to perform weight mapping. We find that power-law reconstructions and the PCA with fewest components and smallest training sample display the largest biases in the Ly-$\alpha$ forest ($-9.58\%/+8.22\%$ respectively). Power-law extrapolations have larger scatters than previously assumed of $+13.1\%/-13.2\%$ over Ly-$\alpha$ and $+19.9\%/-20.1\%$ over Ly-$\beta$. We present two new PCAs which achieve the best current accuracies of $9\%$ for Ly-$\alpha$ and $17\%$ for Ly-$\beta$. We apply the eight techniques after accounting for wavelength-dependent biases and scatter to a sample $19$ quasars at $z>5.7$ with IR X-Shooter spectroscopy, obtaining well-characterised measurements for the mean flux transmission at $4.7<z<6.3$. Our results demonstrate the importance of testing and, when relevant, training, continuum reconstruction techniques in a systematic way.


title: (Non)-neutrality of science and algorithms: Machine Learning between fundamental physics and society

abstract: The impact of Machine Learning (ML) algorithms in the age of big data and platform capitalism has not spared scientific research in academia. In this work, we will analyse the use of ML in fundamental physics and its relationship to other cases that directly affect society. We will deal with different aspects of the issue, from a bibliometric analysis of the publications, to a detailed discussion of the literature, to an overview on the productive and working context inside and outside academia. The analysis will be conducted on the basis of three key elements: the non-neutrality of science, understood as its intrinsic relationship with history and society; the non-neutrality of the algorithms, in the sense of the presence of elements that depend on the choices of the programmer, which cannot be eliminated whatever the technological progress is; the problematic nature of a paradigm shift in favour of a data-driven science (and society). The deconstruction of the presumed universality of scientific thought from the inside becomes in this perspective a necessary first step also for any social and political discussion. This is the subject of this work in the case study of ML.


title: Invisible decays of neutral hadrons

abstract: Invisible decays of neutral hadrons are evaluated as ordinary-mirror particle oscillations using the newly developed mirror matter model. Assuming equivalence of the $CP$ violation and mirror symmetry breaking scales for neutral kaon oscillations, rather precise values of the mirror matter model parameters are predicted for such ordinary-mirror particle oscillations. Not only do these parameter values satisfy the cosmological constraints, but they can also be used to precisely determine the oscillation or invisible decay rates of neutral hadrons. In particular, invisible decay branching fractions for relatively long-lived hadrons such as $K^0_L$, $K^0_S$, $\Lambda^0$, and $\Xi^0$ due to such oscillations are calculated to be $9.9\times 10^{-6}$, $1.8\times 10^{-6}$, $4.4\times 10^{-7}$, and $3.6\times 10^{-8}$, respectively. These significant invisible decays are readily detectable at existing accelerator facilities.


title: An inverse designed achromatic flat lens operating in the ultraviolet

abstract: We demonstrate an inverse designed achromatic, flat, polarization-insensitive diffractive optic element, i.e., multilevel diffractive lens (MDL), operating across a broadband range of UV light (250 nm - 400 nm) via numerical simulations. The simulated average on-axis focusing efficiency of the MDL is optimized to be as high as ~86%. We also investigate the off-axis focusing characteristics at different incident angles of the incoming UV radiation such that the MDL has a full field of view of 30 degrees. The simulated average off-axis focusing efficiency is ~67%, which is the highest reported till date for any chromatic or achromatic UV metalens or diffractive lens to the best of our knowledge. The designed MDL is composed of silicon nitride. The work reported herein will be useful for the miniaturization and integration of lightweight and compact UV optical systems.


title: Genetic Programming visitation scheduling solution can deliver a less austere COVID-19 pandemic population lockdown

abstract: A computational methodology is introduced to minimize infection opportunities for people suffering some degree of lockdown in response to a pandemic, as is the 2020 COVID-19 pandemic. Persons use their mobile phone or computational device to request trips to places of their need or interest indicating a rough time of day: `morning', `afternoon', `night' or `any time' when they would like to undertake these outings as well as the desired place to visit. An artificial intelligence methodology which is a variant of Genetic Programming studies all requests and responds with specific time allocations for such visits that minimize the overall risks of infection, hospitalization and death of people. A number of alternatives for this computation are presented and results of numerical experiments involving over 230 people of various ages and background health levels in over 1700 visits that take place over three consecutive days. A novel partial infection model is introduced to discuss these proof of concept solutions which are compared to round robin uninformed time scheduling for visits to places. The computations indicate vast improvements with far fewer dead and hospitalized. These auger well for a more realistic study using accurate infection models with the view to test deployment in the real world. The input that drives the infection model is the degree of infection by taxonomic class, such as the information that may arise from population testing for COVID-19 or, alternatively, any contamination model. The taxonomy class assumed in the computations is the likely level of infection by age group.


title: Dynamical vortex phase diagram of 2D superconductivity in gated MoS2

abstract: Recent discoveries of two-dimensional (2D) superconductors have uncovered various new aspects of physical properties including vortex matter. In this paper, we report transport properties and a dynamical phase diagram at zero magnetic field in ion-gated MoS2. In addition to the universal jump in the current-voltage characteristic showing unambiguous evidence of the Berezinskii-Kosterlitz-Thouless (BKT) transition, we observed multiple peaks in the temperature- and current-derivative of the electrical resistance, based on which a dynamical phase diagram in the current-temperature plane was constructed. We found current-induced dynamical states of vortex-antivortex pairs, containing that with the phase slip line. Also, we present a global phase diagram of vortices in gated MoS2 which captures the nature of vortex matter of clean 2D superconductors.


title: A New Window into Black Holes

abstract: We develop a formalism to compute the gravitational multipole moments and ratios of moments of non-extremal and of supersymmetric black holes in four dimensions, as well as of horizonless microstate geometries of the latter. For supersymmetric and for Kerr black holes many of these multipole moments vanish, and their dimensionless ratios are ill-defined. We present two methods to compute these dimensionless ratios, which for certain supersymmetric black holes agree spectacularly. We also compute these dimensionless ratios for the Kerr solution. Our methods allow us to calculate an infinite number of hitherto unknown parameters of Kerr black holes, giving us a new window into their physics.


title: Asymmetric jet clustering in deep-inelastic scattering

abstract: We propose a new jet algorithm for deep-inelastic scattering (DIS) that accounts for the forward-backward asymmetry in the Breit frame. The Centauro algorithm is longitudinally invariant and can cluster jets with Born kinematics, which enables novel studies of transverse-momentum-dependent observables. Furthermore, we show that spherically-invariant algorithms in the Breit frame give access to low-energy jets from current fragmentation. We propose novel studies in unpolarized, polarized, and nuclear DIS at the future Electron-Ion Collider.


title: Studying galaxy cluster morphological metrics with Mock-X

abstract: Dynamically relaxed galaxy clusters have long played a role in galaxy cluster studies because it is thought their properties can be reconstructed more precisely and with less systematics. As relaxed clusters are desirable, there exist a plethora of criteria for classifying a galaxy cluster as relaxed. In this work, we examine $9$ commonly used observational and theoretical morphological metrics extracted from $54,000$ Mock-X synthetic X-ray images of galaxy clusters taken from the IllustrisTNG, BAHAMAS and MACSIS simulation suites. We find that the simulated criteria distributions are in reasonable agreement with the observed distributions. Many criteria distributions evolve as a function of redshift, cluster mass, numerical resolution and subgrid physics, limiting the effectiveness of a single relaxation threshold value. All criteria are positively correlated with each other, however, the strength of the correlation is sensitive to redshift, mass and numerical choices. Driven by the intrinsic scatter inherent to all morphological metrics and the arbitrary nature of relaxation threshold values, we find the consistency of relaxed subsets defined by the different metrics to be relatively poor. Therefore, the use of relaxed cluster subsets introduces significant selection effects that are non-trivial to resolve.


title: ALMA unveils wider environment of distant red protocluster core

abstract: We report observations with the Atacama Large Millimetre Array (ALMA) of six submillimetre galaxies (SMGs) within 3 arcmin of the Distant Red Core (DRC) at $z=4.0$, a site of intense cluster-scale star formation, first reported by Oteo et al. (2018). We find new members of DRC in three SMG fields; in two fields, the SMGs are shown to lie along the line of sight towards DRC; one SMG is spurious. Although at first sight this rate of association is consistent with earlier predictions, associations with the bright SMGs are rarer than expected, which suggests caution when interpreting continuum over-densities. We consider the implications of all 14 confirmed DRC components passing simultaneously through an active phase of star formation. In the simplest explanation, we see only the tip of the iceberg in terms of star formation and gas available for future star formation, consistent with our remarkable finding that the majority of newly confirmed DRC galaxies are not the brightest continuum emitters in their immediate vicinity. Thus while ALMA continuum follow-up of SMGs identifies the brightest continuum emitters in each field, it does not necessarily reveal all the gas-rich galaxies. To hunt effectively for protocluster members requires wide and deep spectral-line imaging to uncover any relatively continuum-faint galaxies that are rich in atomic or molecular gas. Searching with short-baseline arrays or single-dish facilities, the true scale of the underlying gas reservoirs may be revealed.


title: Islands for Reflected Entropy

abstract: Recent work has demonstrated the need to include contributions from entanglement islands when computing the entanglement entropy in QFT states coupled to regions of semiclassical gravity. We propose a new formula for the reflected entropy that includes additional contributions from such islands. We derive this formula from the gravitational path integral by finding additional saddles that include generalized replica wormholes. We also demonstrate that our covariant formula satisfies all the inequalities required of the reflected entropy. We use this formula in various examples that demonstrate its relevance in illustrating the structure of multipartite entanglement that are invisible to the entropies.


title: Many-body density and coherence of trapped cold bosons

abstract: Many-body densities and correlation functions are of paramount importance for understanding quantum many-body physics. Here, we present a method to compute them; our approach is general and based on the action of bosonic or fermionic annihilation field operators on the many-body wavefunction. We analyze $N = 6$ quasi-one-dimensional harmonically-trapped bosons with weak to strong contact interaction strength up to the Tonks-Girardeau limit with infinite repulsion using the MultiConfigurational Time-Dependent Hartree method for indistinguishable particles (MCTDH-X). We compare our MCTDH-X solutions to the analytical ones in the infinite repulsion regime as well as to the so-called correlated pair wavefunction approach and find a good agreement. Since numerical approximations are not bound to the cases where analytical solutions are known, we thus demonstrate a general method to investigate high-order reduced density matrices and correlation functions in systems for which analytical solutions are unknown. We trace the build-up of correlation features in the crossover from weak interactions to the Tonks-Girardeau limit and find that the higher-order correlation functions and densities resemble those in the Tonks-Girardeau limit for way smaller interactions than anticipated from just the one-body density.