title: Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence Learning

abstract: Previous cycle-consistency correspondence learning methods usually leverage image patches for training. In this paper, we present a fully convolutional method, which is simpler and more coherent to the inference process. While directly applying fully convolutional training results in model collapse, we study the underline reason behind this collapse phenomenon, indicating that the absolute positions of pixels provide a shortcut to easily accomplish cycle-consistence, which hinders the learning of meaningful visual representations. To break this absolute position shortcut, we propose to apply different crops for forward and backward frames, and adopt feature warping to establish correspondence between two crops of a same frame. The former technique enforces the corresponding pixels at forward and back tracks to have different absolute positions, and the latter effectively blocks the shortcuts going between forward and back tracks. In three label propagation benchmarks for pose tracking, face landmark tracking and video object segmentation, our method largely improves the results of vanilla fully convolutional cycle-consistency method, achieving very competitive performance compared with the self-supervised state-of-the-art approaches. Our trained model and code are available at \url{https://github.com/Steve-Tod/STFC3}.


title: Entropy production of selfish drivers: Implications for efficiency and predictability of movements in a city

abstract: Characterizing the efficiency of movements is important for a better management of the cities. More specifically, the connection between the efficiency and uncertainty (entropy) production of a transport process is not established yet. In this study, we consider the movements of selfish drivers from their homes (origins) to work places (destinations) to see how interactions and randomness in the movements affect a measure of efficiency and entropy production (uncertainty in the destination time intervals) in this process. We employ realistic models of population distributions and mobility laws to simulate the movement process, where interactions are modelled by dependence of the local travel times on the local flows. We observe that some level of information (the travel times) sharing enhances a measure of predictability in the process without any coordination. Moreover, the larger cities display smaller efficiencies, for the same model parameters and population density, which limits the size of an efficient city. We find that entropy production is a good order parameter to distinguish the low- and high-congestion phases. In the former phase, the entropy production grows monotonically with the probability of random moves, whereas it displays a minimum in the congested phase; that is randomness in the movements can reduce the uncertainty in the destination time intervals. The findings highlight the role of entropy production in the study of efficiency and predictability of similar processes in a complex system like the city.


title: AGN STORM 2: I. First results: A Change in the Weather of Mrk 817

abstract: We present the first results from the ongoing, intensive, multi-wavelength monitoring program of the luminous Seyfert 1 galaxy Mrk 817. While this AGN was, in part, selected for its historically unobscured nature, we discovered that the X-ray spectrum is highly absorbed, and there are new blueshifted, broad and narrow UV absorption lines, which suggest that a dust-free, ionized obscurer located at the inner broad line region partially covers the central source. Despite the obscuration, we measure UV and optical continuum reverberation lags consistent with a centrally illuminated Shakura-Sunyaev thin accretion disk, and measure reverberation lags associated with the optical broad line region, as expected. However, in the first 55 days of the campaign, when the obscuration was becoming most extreme, we observe a de-coupling of the UV continuum and the UV broad emission line variability. The correlation recovers in the next 42 days of the campaign, as Mrk 817 enters a less obscured state. The short CIV and Ly alpha lags suggest that the accretion disk extends beyond the UV broad line region.


title: Combining Set Propagation with Finite Element Methods for Time Integration in Transient Solid Mechanics Problems

abstract: The Finite Element Method (FEM) is the gold standard for spatial discretization in numerical simulations for a wide spectrum of real-world engineering problems. Prototypical areas of interest include linear heat transfer and linear structural dynamics problems modeled with partial differential equations (PDEs). While different algorithms for direct integration of the equations of motion exist, exploring all feasible behaviors for varying loads, initial states and fluxes in models with large numbers of degrees of freedom remains a challenging task. In this article we propose a novel approach, based in set propagation methods and motivated by recent advances in the field of Reachability Analysis. Assuming a set of initial states and inputs, the proposed method consists in the construction of a union of sets (flowpipe) that enclose the infinite number of solutions of the spatially discretized PDE. We present the numerical results obtained in five examples to illustrate the capabilities of our approach, and compare its performance against reference numerical integration methods. We conclude that, for problems with single known initial conditions, the proposed method is accurate. For problems with uncertain initial conditions included in sets, the proposed method can compute all the solutions of the system more efficiently than numerical integration methods.


title: Kernel Thinning

abstract: We introduce kernel thinning, a new procedure for compressing a distribution $\mathbb{P}$ more effectively than i.i.d. sampling or standard thinning. Given a suitable reproducing kernel $\mathbf{k}_{\star}$ and $O(n^2)$ time, kernel thinning compresses an $n$-point approximation to $\mathbb{P}$ into a $\sqrt{n}$-point approximation with comparable worst-case integration error across the associated reproducing kernel Hilbert space. The maximum discrepancy in integration error is $O_d(n^{-1/2}\sqrt{\log n})$ in probability for compactly supported $\mathbb{P}$ and $O_d(n^{-\frac{1}{2}} (\log n)^{(d+1)/2}\sqrt{\log\log n})$ for sub-exponential $\mathbb{P}$ on $\mathbb{R}^d$. In contrast, an equal-sized i.i.d. sample from $\mathbb{P}$ suffers $\Omega(n^{-1/4})$ integration error. Our sub-exponential guarantees resemble the classical quasi-Monte Carlo error rates for uniform $\mathbb{P}$ on $[0,1]^d$ but apply to general distributions on $\mathbb{R}^d$ and a wide range of common kernels. Moreover, the same construction delivers near-optimal $L^\infty$ coresets in $O(n^2)$ time. We use our results to derive explicit non-asymptotic maximum mean discrepancy bounds for Gaussian, Mat\'ern, and B-spline kernels and present two vignettes illustrating the practical benefits of kernel thinning over i.i.d. sampling and standard Markov chain Monte Carlo thinning, in dimensions $d=2$ through $100$.

categories: stat.ML cs.LG math.ST stat.CO stat.ME stat.TH


title: Caustics of Lagrangian homotopy spheres with stably trivial Gauss map

abstract: For each positive integer $n$, we give a geometric description of the stably trivial elements of the group $\pi_n U_n/O_n$. In particular, we show that all such elements admit representatives whose tangencies with respect to a fixed Lagrangian plane consist only of folds. By the h-principle for the simplification of caustics, this has the following consequence: if a Lagrangian distribution is stably trivial from the viewpoint of a Lagrangian homotopy sphere, then by an ambient Hamiltonian isotopy one may deform the Lagrangian homotopy sphere so that its tangencies with respect to the Lagrangian distribution are only of fold type. Thus the stable triviality of the Lagrangian distribution, which is a necessary condition for the simplification of caustics to be possible, is also sufficient. We give applications of this result to the arborealization program and to the study of nearby Lagrangian homotopy spheres.


title: Investigation of the monopole magneto-chemical potential in spin ices using capacitive torque magnetometry

abstract: The single-ion anisotropy and magnetic interactions in spin-ice systems give rise to unusual non-collinear spin textures, such as Pauling states and magnetic monopoles. The effective spin correlation strength ($J_{eff}$) determines the relative energies of the different spin-ice states. With this work, we display the capability of capacitive torque magnetometry in characterizing the magneto-chemical potential associated with monopole formation. We build a magnetic phase diagram of Ho$_2$Ti$_2$O$_7$, and show that the magneto-chemical potential depends on the spin-sublattice ($\alpha$ or $\beta$), i.e., the Pauling state, involved in the transition. Monte-Carlo simulations using the dipolar-spin-ice Hamiltonian support our findings of a sublattice-dependent magneto-chemical potential, but the model underestimates the $J_{eff}$ for the $\beta$-sublattice. Additional simulations, including next-nearest neighbor interactions ($J_2$), show that long-range exchange terms in the Hamiltonian are needed to describe the measurements. This demonstrates that torque magnetometry provides a sensitive test for $J_{eff}$ and the spin-spin interactions that contribute to it.


title: Effective transcendental Zilber-Pink for variations of Hodge structures

abstract: We prove function field versions of the Zilber-Pink conjectures for varieties supporting a variation of Hodge structures. A form of these results for Shimura varieties in the context of unlikely intersections is the following. Let $S$ be a connected pure Shimura variety with a fixed quasiprojective embedding. We show that there is an explicitly computable function $B$ of two natural number arguments so that for any field extension $K$ of the complex numbers and Hodge generic irreducible proper subvariety $X \subsetneq S_K$, the set of nonconstant points in the intersection of $X$ with the union of all special subvarieties of $X$ of dimension less than the codimension of $X$ in $S$ is contained in a proper subvariety of $X$ of degree bounded by $B(\operatorname{deg}(X),\dim(X))$. Our techniques are differential algebraic and rely on Ax-Schanuel functional transcendence theorems. We use these results to show that the differential equations associated with Shimura varieties give new examples of minimal, and sometimes, strongly minimal, types with trivial forking geometry but non-$\aleph_0$-categorical induced structure.


title: Experimental Investigation of Aortic Pressure Variations Following a Simulated Thoracic Impact

abstract: Blunt traumatic aortic rupture is a heart injury that can occur in falls, automobile accidents, and sporting injuries involving impact to the thorax. Despite its severity and high morbidity rate, the research still does not provide a consistent description of the mechanism of rupture. In this study, a crash testing dummy with an in vitro pumping heart, 3D printed ribcage, and ballistic gel damping layer was developed to reproduce a realistic response to thoracic impact. Testing was performed using a standardized pendulum used for calibration of crash test dummies, with the location of impact being the middle of the sternum. Different impact severities were tested by adjusting the kinetic energy at impact with the initial height of the pendulum. Measurements of the dummy include instantaneous aortic pressure waveforms prior, during and following the impact. The results of this experiment show that aortic pressure experiences significant changes in magnitude during simulated impact. This work could help contribute towards a better understanding of the mechanisms leading to blunt traumatic aortic rupture and the development of preventative measures.


title: Learning to Generate Novel Scene Compositions from Single Images and Videos

abstract: Training GANs in low-data regimes remains a challenge, as overfitting often leads to memorization or training divergence. In this work, we introduce One-Shot GAN that can learn to generate samples from a training set as little as one image or one video. We propose a two-branch discriminator, with content and layout branches designed to judge the internal content separately from the scene layout realism. This allows synthesis of visually plausible, novel compositions of a scene, with varying content and layout, while preserving the context of the original sample. Compared to previous single-image GAN models, One-Shot GAN achieves higher diversity and quality of synthesis. It is also not restricted to the single image setting, successfully learning in the introduced setting of a single video.


title: Pointwise-in-time a posteriori error control for time-fractional parabolic equations

abstract: For time-fractional parabolic equations with a Caputo time derivative of order $\alpha\in(0,1)$, we give pointwise-in-time a posteriori error bounds in the spatial $L_2$ and $L_\infty$ norms. Hence, an adaptive mesh construction algorithm is applied for the L1 method, which yields optimal convergence rates $2-\alpha$ in the presence of solution singularities.


title: Orienting, Framing, Bridging, Magic, and Counseling: How Data Scientists Navigate the Outer Loop of Client Collaborations in Industry and Academia

abstract: Data scientists often collaborate with clients to analyze data to meet a client's needs. What does the end-to-end workflow of a data scientist's collaboration with clients look like throughout the lifetime of a project? To investigate this question, we interviewed ten data scientists (5 female, 4 male, 1 non-binary) in diverse roles across industry and academia. We discovered that they work with clients in a six-stage outer-loop workflow, which involves 1) laying groundwork by building trust before a project begins, 2) orienting to the constraints of the client's environment, 3) collaboratively framing the problem, 4) bridging the gap between data science and domain expertise, 5) the inner loop of technical data analysis work, 6) counseling to help clients emotionally cope with analysis results. This novel outer-loop workflow contributes to CSCW by expanding the notion of what collaboration means in data science beyond the widely-known inner-loop technical workflow stages of acquiring, cleaning, analyzing, modeling, and visualizing data. We conclude by discussing the implications of our findings for data science education, parallels to design work, and unmet needs for tool development.


title: A Path Model to Infer Mathematics Performance: The Interrelated Impact of Motivation, Attitude, Learning Style and Teaching Strategies Variables

abstract: The present study aims at exploring predictors influencing mathematics performance. In particular, the research focuses on four subject components such as motivation, attitude towards mathematics, learning style, and teaching strategies. The study respondents have involved a sample of 240 students from Agusan del Sur State College of Agriculture and Technology (ASSCAT). Path analysis will be used to test the direct and indirect relations between the predictors and mathematics performance. Based on the result, the calculation of reproduced correlation through path decompositions and subsequent comparison to the empirical correlation indicated that the path model fits the observed data. Results also revealed that a large proportion of mathematics performance could be predicted from the attitude towards mathematics, learning style, and teaching strategies. Moreover, attitude towards mathematics, learning style, and teaching strategies influence mathematics performance directly and indirectly.


title: Fractal Quantum Phase Transitions: Critical Phenomena Beyond Renormalization

abstract: We identify a quantum critical point with fractal symmetry whose effective theory eludes the renormalization group framework. We consider the Newman-Moore model with three-body interaction subjected to an external transverse field, which exhibits a Kramers-Wannier type self-duality and a fractal $Z_2$ symmetry with Ising charge conserved on a fractal subset of sites, i.e., on Sierpinski gaskets. Using large-scale quantum Monte Carlo simulations, we identify a continuous quantum phase transition between a phase with spontaneous fractal symmetry breaking and a paramagnetic phase. This phase transition is characterized by the emergence of a fractal scaling dimension $d=\ln(3)/\ln(2)$ at the quantum critical point, where the power-law exponent of the correlation function is related to the fractal dimension of the Sierpinski triangle. We develop a field theory to elucidate such quantum criticality and denote the fractal scaling as a subsequence of UV-IR mixing, where the low energy modes at the critical point are manipulated by short-wavelength physics due to the fractal symmetry.


title: New Physics Through Drell Yan SMEFT Measurements at NLO

abstract: Drell Yan production is a sensitive probe of new physics and as such has been calculated to high order in both the electroweak and QCD sectors of the Standard Model, allowing for precision comparisons between theory and data. Here we extend these calculations to the Standard Model Effective field theory (SMEFT) and present the NLO QCD and electroweak contributions to the neutral Drell Yan process that are linear in the Wilson coefficients of the SMEFT theory.


title: Surrogate modelling the Baryonic Universe II: on forward modelling the colours of individual and populations of galaxies

abstract: Among the properties shaping the light of a galaxy, the star formation history (SFH) is one of the most challenging to model due to the variety of correlated physical processes regulating star formation. In this work, we leverage the stellar population synthesis model FSPS, together with SFHs predicted by the hydrodynamical simulation IllustrisTNG and the empirical model UNIVERSEMACHINE, to study the impact of star formation variability on galaxy colours. We start by introducing a model-independent metric to quantify the burstiness of a galaxy formation model, and we use this metric to demonstrate that UNIVERSEMACHINE predicts SFHs with more burstiness relative to IllustrisTNG. Using this metric and principal component analysis, we construct families of SFH models with adjustable variability, and we show that the precision of broad-band optical and near-infrared colours degrades as the level of unresolved short-term variability increases. We use the same technique to demonstrate that variability in metallicity and dust attenuation presents a practically negligible impact on colours relative to star formation variability. We additionally provide a model-independent fitting function capturing how the level of unresolved star formation variability translates into imprecision in predictions for galaxy colours; our fitting function can be used to determine the minimal SFH model that reproduces colours with some target precision. Finally, we show that modelling the colours of individual galaxies with percent-level precision demands resorting to complex SFH models, while producing precise colours for galaxy populations can be achieved using models with just a few degrees of freedom.


title: The cosmological dependence of halo and galaxy assembly bias

abstract: One of the main predictions of excursion set theory is that the clustering of dark matter haloes only depends on halo mass. However, it has been long established that the clustering of haloes also depends on other properties, including formation time, concentration, and spin; this effect is commonly known as halo assembly bias. We use a suite of gravity-only simulations to study the dependence of halo assembly bias on cosmology; these simulations cover cosmological parameters spanning 10$\sigma$ around state-of-the-art best-fitting values, including standard extensions of the $\Lambda$CDM paradigm such as neutrino mass and dynamical dark energy. We find that the strength of halo assembly bias presents variations smaller than 0.05 dex across all cosmologies studied for concentration and spin selected haloes, letting us conclude that the dependence of halo assembly bias upon cosmology is negligible. We then study the dependence of galaxy assembly bias (i.e. the manifestation of halo assembly bias in galaxy clustering) on cosmology using subhalo abundance matching. We find that galaxy assembly bias also presents very small dependence upon cosmology ($\sim$ 2$\%$-4$\%$ of the total clustering); on the other hand, we find that the dependence of this signal on the galaxy formation parameters of our galaxy model is much stronger. Taken together, these results let us conclude that the dependence of halo and galaxy assembly bias on cosmology is practically negligible.


title: Is the Chiral Magnetic Effect fast enough?

abstract: It depends: While we find within holography that the lifetime of the magnetic field for collider energies like the ones achieved at RHIC is long enough to build up the chiral magnetic current, the lifetime of the magnetic field at LHC seems to be too short. We study the real time evolution of the chiral magnetic effect out-of-equilibrium in strongly coupled holographic gauge theories. We consider the backreaction of the magnetic field onto the geometry and monitor pressure and chiral magnetic current. Our findings show that generically at small magnetic field the pressure builds up faster than the chiral magnetic current whereas at strong magnetic field the opposite is true. At large charge we also find that equilibration is delayed significantly due to long lived oscillations. We also match the parameters of our model to QCD parameters and draw lessons of possible relevance to the realization of the chiral magnetic effect in heavy ion collisions. In particular, we find an equilibration time of about $\sim0.35$ fm/c in presence of the chiral anomaly for plasma temperatures of order $T\sim300-400$ MeV.

categories: hep-ph cond-mat.str-el hep-th nucl-ex nucl-th


title: Observed versus Simulated Halo c-Mvir Relations

abstract: The concentration - virial mass relation is a well-defined trend that reflects the formation of structure in an expanding Universe. Numerical simulations reveal a marked correlation that depends on the collapse time of dark matter halos and their subsequent assembly history. However, observational constraints are mostly limited to the massive end via X-ray emission of the hot diffuse gas in clusters. An alternative approach, based on gravitational lensing over galaxy scales, revealed an intriguingly high concentration at Milky Way-sized halos. This letter focuses on the robustness of these results by adopting a bootstrapping approach that combines stellar and lensing mass profiles. We also apply the identical methodology to simulated halos from EAGLE to assess any systematic. We bypass several shortcomings of ensemble type lens reconstruction and conclude that the mismatch between observed and simulated concentration-to-virial-mass relations are robust, and need to be explained either invoking a lensing-related sample selection bias, or a careful investigation of the evolution of concentration with assembly history. For reference, at a halo mass of $10^{12} M_\odot$, the concentration of observed lenses is $c_{12}\sim 40\pm 5$, whereas simulations give $c_{12}\sim 15\pm1$.


title: Kekul\'e spiral order at all nonzero integer fillings in twisted bilayer graphene

abstract: We study magic angle graphene in the presence of both strain and particle-hole symmetry breaking due to non-local inter-layer tunneling. We perform a self-consistent Hartree-Fock study that incorporates these effects alongside realistic interaction and substrate potentials, and explore a comprehensive set of competing orders including those that break translational symmetry at arbitrary wavevectors. We find that at all non-zero integer fillings very small strains, comparable to those measured in scanning tunneling experiments, stabilize a fundamentally new type of time-reversal symmetric and spatially non-uniform order. This order, which we dub the 'incommensurate Kekul\'e spiral' (IKS) order, spontaneously breaks both the emergent valley-charge conservation and moir\'e translation symmetries, but preserves a modified translation symmetry $\hat{T}'$ -- which simultaneously shifts the spatial coordinates and rotates the $U(1)$ angle which characterizes the spontaneous inter-valley coherence. We discuss the phenomenological and microscopic properties of this order. We argue that our findings are consistent with all experimental observations reported so far, suggesting a unified explanation of the global phase diagram in terms of the IKS order.


title: A critical assessment of the applicability of the energy-limited approximation for estimating exoplanetary mass-loss rates

abstract: Context: The energy-limited (EL) atmospheric escape approach is used to estimate mass-loss rates for a broad range of planets that host hydrogen-dominated atmospheres as well as for performing atmospheric evolution calculations. Aims: We aim to study the applicability range of the EL approximation. Methods: We revise the EL formalism and its assumptions. We also compare its results with those of hydrodynamic simulations, employing a grid covering planets with masses, radii, and equilibrium temperatures ranging between 1 $M_{\oplus}$ and 39 $M_{\oplus}$, 1 $R_{\oplus}$ and 10 $R_{\oplus}$, and 300 and 2000 K, respectively. Results: Within the grid boundaries, we find that the EL approximation gives a correct order of magnitude estimate for mass-loss rates for about 76% of the planets, but there can be departures from hydrodynamic simulations by up to three orders of magnitude in individual cases. Furthermore, we find that planets for which the mass-loss rates are correctly estimated by the EL approximation to within one order of magnitude have intermediate gravitational potentials as well as low-to-intermediate equilibrium temperatures and irradiation fluxes of extreme ultraviolet and X-ray radiation. However, for planets with low or high gravitational potentials, or high equilibrium temperatures and irradiation fluxes, the approximation fails in most cases. Conclusions: The EL approximation should not be used for planetary evolution calculations that require computing mass-loss rates for planets that cover a broad parameter space. In this case, it is very likely that the EL approximation would at times return mass-loss rates of up to several orders of magnitude above or below those predicted by hydrodynamic simulations. For planetary atmospheric evolution calculations, interpolation routines or approximations based on grids of hydrodynamic models should be used instead.


title: A Differentiable Model of the Assembly of Individual and Populations of Dark Matter Halos

abstract: We present a new empirical model for the mass assembly of dark matter halos. We approximate the growth of individual halos as a simple power-law function of time, where the power-law index smoothly decreases as the halo transitions from the fast-accretion regime at early times, to the slow-accretion regime at late times. Using large samples of halo merger trees taken from high-resolution cosmological simulations, we demonstrate that our 3-parameter model, Diffmah, can approximate halo growth with a typical accuracy of 0.1 dex for t > 1 Gyr for all halos of present-day mass greater than 10^11Msun, including subhalos and host halos in gravity-only simulations, as well as in the TNG hydrodynamical simulation. We additionally present a new model for the assembly of halo populations, DiffmahPop, which not only reproduces average mass growth across time, but also faithfully captures the diversity with which halos assemble their mass. Our python implementation is based on the autodiff library JAX, and so our model self-consistently captures the mean and variance of halo mass accretion rate across cosmic time. We show that the connection between halo assembly and the large-scale density field, known as halo assembly bias, is accurately captured by Diffmah, and that residual errors in our approximations to halo assembly history exhibit a negligible residual correlation with the density field. Our publicly available source code can be used to generate Monte Carlo realizations of cosmologically representative halo histories; our differentiable implementation facilitates the incorporation of our model into existing analytical halo model frameworks.


title: Challenges for Inflaton Dark Matter

abstract: We examine an intriguing possibility that a single field is responsible for both inflation and dark matter, focussing on the minimal set-up where inflation is driven by a scalar coupling to curvature. We study in detail the reheating process in this framework, which amounts mainly to particle production in a quartic potential, and distinguish thermal and non-thermal dark matter options. In the non-thermal case, the reheating is impeded by backreaction and rescattering, making this possibility unrealistic. On the other hand, thermalized dark matter is viable, yet the unitarity bound forces the inflaton mass into a narrow window close to half the Higgs mass.


title: Magnon spin current induced by triplet Cooper pair supercurrents

abstract: At the interface between a ferromagnetic insulator and a superconductor there is a coupling between the spins of the two materials. We show that when a supercurrent carried by triplet Cooper pairs flows through the superconductor, the coupling induces a magnon spin current in the adjacent ferromagnetic insulator. The effect is dominated by Cooper pairs polarized in the same direction as the ferromagnetic insulator, so that charge and spin supercurrents produce similar results. Our findings demonstrate a way of converting Cooper pair supercurrents to magnon spin currents.


title: The neutrino gravitational memory from a core collapse supernova: phenomenology and physics potential

abstract: General Relativity predicts that the passage of matter or radiation from an asymmetrically-emitting source should cause a permanent change in the local space-time metric. This phenomenon, called the \emph{gravitational memory effect}, has never been observed, however supernova neutrinos have long been considered a promising avenue for its detection in the future. With the advent of deci-Hertz gravitational wave interferometers, observing the supernova neutrino memory will be possible, with important implications for multimessenger astronomy and for tests of gravity. In this work, we develop a phenomenological (analytical) toy model for the supernova neutrino memory effect, which is overall consistent with the results of numerical simulations. This description is then generalized to several case studies of interest. We find that, for a galactic supernova, the dimensionless strain, $h(t)$, is of order $\sim 10^{-22} - 10^{-21}$, and develops over a typical time scale that varies between $\sim 0.1 - 10$ s, depending on the time-evolution of the anisotropy of the neutrino emission. The characteristic strain, $h_c(f)$, has a maximum at a frequency $f_{max} \sim {\mathcal O}(10^{-1}) - {\mathcal O}(1)$ Hz. The detailed features of the time- and frequency-structure of the memory strain will inform us of the matter dynamics near the collapsed core, and allow to distinguish between different stellar collapse scenarios. Next generation gravitational wave detectors like DECIGO and BBO will be sensitive to the neutrino memory effect for supernovae at typical galactic distances and beyond; with Ultimate DECIGO exceeding a detectability distance of 10 Mpc.


title: Precise Diffusion Coefficients for White Dwarf Astrophysics

abstract: Observations of galactic white dwarfs with Gaia have allowed for unprecedented modeling of white dwarf cooling, resolving core crystallization and sedimentary heating from neutron rich nuclei. These cooling sequences are sensitive to the diffusion coefficients of nuclei in Coulomb plasmas which have order 10\% uncertainty and are often not valid across coupling regimes. Using large scale molecular dynamics simulations we calculate diffusion coefficients at high resolution in the regime relevant for white dwarf modeling. We present a physically motivated law for diffusion with a semi-empirical correction which is accurate at the percent level. Implemented along with linear mixing in stellar evolution codes, this law should reduce the error from diffusion coefficients by an order of magnitude.


title: Perturbation Spectra and Renormalization-Group Techniques in Double-Field Inflation and Quantum Gravity Cosmology

abstract: We study primordial cosmology with two scalar fields that participate in inflation at the same time, by coupling quantum gravity (i.e., the theory $R+R^{2}+C^{2}$ with the fakeon prescription/projection for $C^{2}$) to a scalar field with a quadratic potential. We show that there exists a perturbative regime that can be described by an asymptotically de Sitter, cosmic RG flow in two couplings. Since the two scalar degrees of freedom mix in nontrivial ways, the adiabatic and isocurvature perturbations are not RG invariant on superhorizon scales. It is possible to identify the correct perturbations by using RG invariance as a guiding principle. We work out the resulting power spectra of the tensor and scalar perturbations to the NNLL and NLL orders, respectively. An unexpected consequence of RG invariance is that the theory remains predictive. Indeed, the scalar mixing affects only the subleading corrections, so the predictions of quantum gravity with single-field inflation are confirmed to the leading order.


title: Edge density of bulk states due to relativity

abstract: The boundaries of quantum materials can host a variety of exotic effects such as topologically robust edge states or anyonic quasiparticles. Here, we show that fermionic systems such as graphene that admit a low energy Dirac description can exhibit counterintuitive relativistic effects at their boundaries. As an example, we consider carbon nanotubes and demonstrate that relativistic bulk spinor states can have non zero charge density on the boundaries, in contrast to the sinusoidal distribution of non-relativistic wave functions that are necessarily zero at the boundaries. This unusual property of relativistic spinors is complementary to the linear energy dispersion relation exhibited by Dirac materials and can influence their coupling to leads, transport properties or their response to external fields.


title: Searching for Flavor-Violating ALPs in Higgs Decays

abstract: Pseudo-scalar particles, often referred to as axion-like-particles (ALPs), arise in a variety of theoretical contexts. The phenomenology of such states is typically studied assuming flavor-conserving interactions, yet they can in principle have flavor-violating (FV) couplings to fermions. We consider this general possibility, focusing on models where the ALP has non-negligible coupling to the Standard Model Higgs boson $h$. For a lepton FV ALP $a$ of mass $m_a \gtrsim 2$ GeV, $a\to \tau \ell$, where $\ell\neq \tau$ is a charged lepton, could have $\mathcal{O}(1)$ branching fraction, leading to potentially detectable $h \to a a \to \tau \ell \tau \ell$ at the LHC and its future program. We examine this possibility, in light of existing bounds on FV processes, in a general effective theory. We obtain constraints on the effective couplings from both prompt and long-lifetime searches at the LHC; some projections for envisioned measurements are also provided. The implications of the recently announced first results of the muon $g-2$ measurement at Fermilab for the ALP interactions considered in our work are also briefly discussed.


title: Second Law of Entanglement Dynamics for the Non-Asymptotic Regime

abstract: The distillable entanglement of a bipartite quantum state does not exceed its entanglement cost. This well known inequality can be understood as a second law of entanglement dynamics in the asymptotic regime of entanglement manipulation, excluding the possibility of perpetual entanglement extraction machines that generate boundless entanglement from a finite reserve. In this paper, I establish a refined second law of entanglement dynamics that holds for the non-asymptotic regime of entanglement manipulation.


title: FRBs Lensed by Point Masses I. Lens Mass Estimation for Doubly Imaged FRBs

abstract: Fast radio bursts (FRBs) are bright radio transient events with durations on the order of milliseconds. The majority of FRB sources discovered so far have a single peak, with the exception of a few showing multiple-peaked profiles, the origin of which is unknown. In this work, we show that the strong lensing effect of a point mass or a point mass $+$ external shear on a single-peak FRB can produce double peaks (i.e. lensed images). In particular, the leading peak will always be more magnified and hence brighter than the trailing peak for a point-mass lens model, while the point-mass $+$ external shear lens model can produce a less magnified leading peak. We find that, for a point-mass lens model, the combination of lens mass $M$ and redshift $z_l$ in the form of $M(1+z_l)$ can be directly computed from two observables -- the delayed time $\Delta t$ and the flux ratio of the leading peak to the trailing peak $R$. For a point-mass $+$ external shear lens model, upper and lower limits in $M(1+z_l)$ can also be obtained from $\Delta t$ and $R$ for a given external shear strength. In particular, tighter lens mass constraints can be achieved when the observed $R$ is larger. Lastly, we show the process of constraining lens mass using the observed values of $\Delta t$ and $R$ of two double-peaked FRB sources, i.e. FRB 121002 and FRB 130729, as references, although the double-peaked profiles are not necessarily caused by strong lensing.


title: Thermal anyon interferometry in phonon-coupled Kitaev spin liquids

abstract: Recent theoretical studies inspired by experiments on the Kitaev magnet $\alpha$-RuCl$_3$ highlight the nontrivial impact of phonons on the thermal Hall conductivity of chiral topological phases. Here we introduce mixed mesoscopic-macroscopic devices that allow refined thermal-transport probes of non-Abelian spin liquids with Ising topological order. These devices feature a quantum-coherent mesoscopic region with negligible phonon conductance, flanked by macroscopic lobes that facilitate efficient thermalization between chiral Majorana edge modes and bulk phonons. We show that our devices enable $(i)$ accurate determination of the quantized thermal Hall conductivity, $(ii)$ identification of non-Abelian Ising anyons via the temperature dependence of the thermal conductance, and most interestingly $(iii)$ single-anyon detection through heat-based anyon interferometry. Analogous results apply broadly to phonon-coupled chiral topological orders.


title: Gauge invariant quantum circuits for $U(1)$ and Yang-Mills lattice gauge theories

abstract: Quantum computation represents an emerging framework to solve lattice gauge theories (LGT) with arbitrary gauge groups, a general and long-standing problem in computational physics. While quantum computers may encode LGT using only polynomially increasing resources, a major openissue concerns the violation of gauge-invariance during the dynamics and the search for groundstates. Here, we propose a new class of parametrized quantum circuits that can represent states belonging only to the physical sector of the total Hilbert space. This class of circuits is compact yet flexible enough to be used as a variational ansatz to study ground state properties, as well as representing states originating from a real-time dynamics. Concerning the first application, the structure of the wavefunction ansatz guarantees the preservation of physical constraints such as the Gauss law along the entire optimization process, enabling reliable variational calculations. As for the second application, this class of quantum circuits can be used in combination with timedependent variational quantum algorithms, thus drastically reducing the resource requirements to access dynamical properties.


title: The 3-D Kinematics of the Orion Nebula Cluster: NIRSPEC-AO Radial Velocities of the Core Population

abstract: The kinematics and dynamics of stellar and substellar populations within young, still-forming clusters provides valuable information for constraining theories of formation mechanisms. Using Keck II NIRSPEC+AO data, we have measured radial velocities for 56 low-mass sources within 4' of the core of the Orion Nebula Cluster (ONC). We also re-measure radial velocities for 172 sources observed with SDSS/APOGEE. These data are combined with proper motions measured using $HST$ ACS/WFPC2/WFC3IR and Keck II NIRC2, creating a sample of 135 sources with all three velocity components. The velocities measured are consistent with a normal distribution in all three components. We measure intrinsic velocity dispersions of ($\sigma_{v_\alpha}$, $\sigma_{v_\delta}$, $\sigma_{v_r}$) = ($1.64\pm0.12$, $2.03\pm0.13$, $2.56^{+0.16}_{-0.17}$) km s$^{-1}$. Our computed intrinsic velocity dispersion profiles are consistent with the dynamical equilibrium models from Da Rio et al. (2014) in the tangential direction, but not in the line of sight direction, possibly indicating that the core of the ONC is not yet virialized, and may require a non-spherical potential to explain the observed velocity dispersion profiles. We also observe a slight elongation along the north-south direction following the filament, which has been well studied in previous literature, and an elongation in the line of sight to tangential velocity direction. These 3-D kinematics will help in the development of realistic models of the formation and early evolution of massive clusters.


title: New twists in compact binary waveform modelling: a fast time domain model for precession

abstract: We present IMRPhenomTPHM, a phenomenological model for the gravitational wave signals emitted by the coalescence of quasi-circular precessing binary black holes systems. The model is based on the "twisting up" approximation, which maps non-precessing signals to precessing ones in terms of a time dependent rotation described by three Euler angles, and which has been utilized in several frequency domain waveform models that have become standard tools in gravitational wave data analysis. Our model is however constructed in the time domain, which allows several improvements over the frequency domain models: we do not use the stationary phase approximation, we employ a simple approximation for the precessing Euler angles for the ringdown signal, and we implement a new method for computing the Euler angles through the evolution of the spin dynamics of the system, which is more accurate and also computationally efficient.


title: Out of the Box: Embodied Navigation in the Real World

abstract: The research field of Embodied AI has witnessed substantial progress in visual navigation and exploration thanks to powerful simulating platforms and the availability of 3D data of indoor and photorealistic environments. These two factors have opened the doors to a new generation of intelligent agents capable of achieving nearly perfect PointGoal Navigation. However, such architectures are commonly trained with millions, if not billions, of frames and tested in simulation. Together with great enthusiasm, these results yield a question: how many researchers will effectively benefit from these advances? In this work, we detail how to transfer the knowledge acquired in simulation into the real world. To that end, we describe the architectural discrepancies that damage the Sim2Real adaptation ability of models trained on the Habitat simulator and propose a novel solution tailored towards the deployment in real-world scenarios. We then deploy our models on a LoCoBot, a Low-Cost Robot equipped with a single Intel RealSense camera. Different from previous work, our testing scene is unavailable to the agent in simulation. The environment is also inaccessible to the agent beforehand, so it cannot count on scene-specific semantic priors. In this way, we reproduce a setting in which a research group (potentially from other fields) needs to employ the agent visual navigation capabilities as-a-Service. Our experiments indicate that it is possible to achieve satisfying results when deploying the obtained model in the real world. Our code and models are available at https://github.com/aimagelab/LoCoNav.


title: The Federated Tumor Segmentation (FeTS) Challenge

abstract: This manuscript describes the first challenge on Federated Learning, namely the Federated Tumor Segmentation (FeTS) challenge 2021. International challenges have become the standard for validation of biomedical image analysis methods. However, the actual performance of participating (even the winning) algorithms on "real-world" clinical data often remains unclear, as the data included in challenges are usually acquired in very controlled settings at few institutions. The seemingly obvious solution of just collecting increasingly more data from more institutions in such challenges does not scale well due to privacy and ownership hurdles. Towards alleviating these concerns, we are proposing the FeTS challenge 2021 to cater towards both the development and the evaluation of models for the segmentation of intrinsically heterogeneous (in appearance, shape, and histology) brain tumors, namely gliomas. Specifically, the FeTS 2021 challenge uses clinically acquired, multi-institutional magnetic resonance imaging (MRI) scans from the BraTS 2020 challenge, as well as from various remote independent institutions included in the collaborative network of a real-world federation (https://www.fets.ai/). The goals of the FeTS challenge are directly represented by the two included tasks: 1) the identification of the optimal weight aggregation approach towards the training of a consensus model that has gained knowledge via federated learning from multiple geographically distinct institutions, while their data are always retained within each institution, and 2) the federated evaluation of the generalizability of brain tumor segmentation models "in the wild", i.e. on data from institutional distributions that were not part of the training datasets.


title: IE-GSTC Metasurface Field Solver using Surface Susceptibility Tensors with Normal Polarizabilities

abstract: An Integral Equation (IE) based electromagnetic field solver using metasurface susceptibility tensors is proposed and validated using variety of numerical examples in 2D. The proposed method solves for fields generated by the metasurface which are represented as spatial discontinuities satisfying the Generalized Sheet Transition Conditions (GSTCs), and described using tensorial surface susceptibility densities, $\bar{\bar{\chi}}$. For the first time, the complete tensorial representation of susceptibilities is incorporated in this integrated IE-GSTC framework, where the normal surface polarizabilities and their spatial derivatives along the metasurface are rigorously taken into account. The proposed field equation formulation further utilizes a local co-ordinate system which enables modeling metasurfaces with arbitrary orientations and geometries. The proposed 2D BEM-GSTC framework is successfully tested using variety of examples including infinite and finite sized metasurfaces, periodic metasurfaces and complex shaped structures, showing comparisons with both analytical results and a commercial full-wave solver. It is shown that the zero-thickness sheet model with complete tensorial susceptibilities can very accurately reproduce the macroscopic fields, accounting for their angular field scattering response and the edge diffraction effects in finite-sized surfaces.


title: A Chandra and HST View of WISE-Selected AGN Candidates in Dwarf Galaxies

abstract: Reliably identifying active galactic nuclei (AGNs) in dwarf galaxies is key to understanding black hole demographics at low masses and constraining models for black hole seed formation. Here we present Chandra X-ray Observatory observations of eleven dwarf galaxies that were chosen as AGN candidates using Wide-field Infrared Survey Explorer (WISE) mid-infrared (mid-IR) color-color selection. Hubble Space Telescope images are also presented for ten of the galaxies. Based on Sloan Digital Sky Survey spectroscopy, six galaxies in our sample have optical evidence for hosting AGNs and five are classified as star-forming. We detect X-ray point sources with luminosities above that expected from X-ray binaries in the nuclei of five of the six galaxies with optical evidence of AGNs. However, the X-ray emission from these AGNs is generally much lower than expected based on AGN scaling relations with infrared and optical tracers. We do not find compelling evidence for AGNs in the five optically-selected star-forming galaxies despite having red mid-IR colors. Only two are detected in X-rays and their properties are consistent with stellar-mass X-ray binaries. Based on this multiwavelength study, we conclude that two-color mid-IR AGN diagnostics at the resolution of WISE cannot be used to reliably select AGNs in optically-star-forming dwarf galaxies. Future observations in the infrared with the James Webb Space Telescope offer a promising path forward.


title: Frequency-dependent capacitors using paper

abstract: Measurements of capacitors made with paper sheets reveal a significant decrease in capacitance with increasing frequency from 10 to 100,000 Hz, offering a simple demonstration of complex dielectric phenomena using common equipment.


title: Time-magnified photon counting with a 550fs resolution

abstract: Time-resolved photon-counting plays an indispensable role in precision metrology in both classical and quantum regimes. In particular, time-correlated single-photon counting (TCSPC) has been the key enabling technology for applications such as low-light fluorescence lifetime spectroscopy and photon counting time-of-flight (ToF) 3D imaging. However, state-of-the-art TCSPC single-photon timing resolution (SPTR) is limited in the range of 10-100 ps by the available single-photon detector technology. In this paper, we experimentally demonstrate a time-magnified TCSPC (TM-TCSPC) that achieves an unprecedentedly short SPTR of 550 fs for the first time with an off-the-shelf single-photon detector. The TM-TCSPC can resolve ultrashort pulses with a 130-fs pulsewidth difference at a 22-fs accuracy. When applied to photon counting ToF 3D imaging, the TM-TCSPC greatly suppresses the range walk error that limits all photon counting ToF 3D imaging systems by 99.2 % (130 times) and thus provides unprecedentedly high depth measurement accuracy and precision of 26 {\mu}m and 3 {\mu}m, respectively.


title: Sketching with Kerdock's crayons: Fast sparsifying transforms for arbitrary linear maps

abstract: Given an arbitrary matrix $A\in\mathbb{R}^{n\times n}$, we consider the fundamental problem of computing $Ax$ for any $x\in\mathbb{R}^n$ such that $Ax$ is $s$-sparse. While fast algorithms exist for particular choices of $A$, such as the discrete Fourier transform, there is currently no $o(n^2)$ algorithm that treats the unstructured case. In this paper, we devise a randomized approach to tackle the unstructured case. Our method relies on a representation of $A$ in terms of certain real-valued mutually unbiased bases derived from Kerdock sets. In the preprocessing phase of our algorithm, we compute this representation of $A$ in $O(n^3\log n)$ operations. Next, given any unit vector $x\in\mathbb{R}^n$ such that $Ax$ is $s$-sparse, our randomized fast transform uses this representation of $A$ to compute the entrywise $\epsilon$-hard threshold of $Ax$ with high probability in only $O(sn + \epsilon^{-2}\|A\|_{2\to\infty}^2n\log n)$ operations. In addition to a performance guarantee, we provide numerical results that demonstrate the plausibility of real-world implementation of our algorithm.


title: Characterizing Spectral Channels of Visible Emission Line Coronagraph of Aditya-L1

abstract: Aditya-L1 is India's first solar mission with Visible Emission Line Coronagraph (VELC) consisting of three spectral channels taking high-resolution spectroscopic observations of the inner corona up to 1.5 Rsun at 5303 \AA, 7892 \AA, and 10747 \AA. In this work, we present the strategy for the slit width optimization for the VELC using synthetic line profiles by taking into account the instrument characteristics and coronal conditions for log(T) varying from 6 to 6.5. The synthetic profiles are convolved with simulated instrumental scattered light and noise to estimate the signal-to-noise ratio (SNR), which will be crucial to design the future observation plans. We find that the optimum slit width for VELC turns out to be 50 microns providing sufficient SNR for observations in different solar conditions. We also analyzed the effect of plasma temperature on the SNR at different heights in the VELC field of view for the optimized slit width. We also studied the expected effect of the presence of a CME on the spectral channel observations. This analysis will help to plan the science observations of VELC in different solar conditions.


title: A Graph Neural Network Approach for Product Relationship Prediction

abstract: Graph Neural Networks have revolutionized many machine learning tasks in recent years, ranging from drug discovery, recommendation systems, image classification, social network analysis to natural language understanding. This paper shows their efficacy in modeling relationships between products and making predictions for unseen product networks. By representing products as nodes and their relationships as edges of a graph, we show how an inductive graph neural network approach, named GraphSAGE, can efficiently learn continuous representations for nodes and edges. These representations also capture product feature information such as price, brand, or engineering attributes. They are combined with a classification model for predicting the existence of the relationship between products. Using a case study of the Chinese car market, we find that our method yields double the prediction performance compared to an Exponential Random Graph Model-based method for predicting the co-consideration relationship between cars. While a vanilla GraphSAGE requires a partial network to make predictions, we introduce an `adjacency prediction model' to circumvent this limitation. This enables us to predict product relationships when no neighborhood information is known. Finally, we demonstrate how a permutation-based interpretability analysis can provide insights on how design attributes impact the predictions of relationships between products. This work provides a systematic method to predict the relationships between products in many different markets.


title: Ultrafast MHz-rate burst-mode pump-probe laser for the FLASH FEL facility based on nonlinear compression of ps-level pulses from an Yb-amplifier chain

abstract: The Free-Electron Laser (FEL) FLASH offers the worldwide still unique capability to study ultrafast processes with high-flux, high-repetition rate XUV and soft X-ray pulses. The vast majority of experiments at FLASH are of pump-probe type. Many of them rely on optical ultrafast lasers. Here, a novel FEL facility laser is reported which combines high average power output from Yb:YAG amplifiers with spectral broadening in a Herriott-type multi-pass cell and subsequent pulse compression to sub-100 fs durations. Compared to other facility lasers employing optical parametric amplification, the new system comes with significantly improved noise figures, compactness, simplicity and power efficiency. Like FLASH, the optical laser operates with 10 Hz burst repetition rate. The bursts consist of 800 $\mu$s long trains of up to 800 ultrashort pulses being synchronized to the FEL with femtosecond precision. In the experimental chamber, pulses with up to 50 $\mu$J energy, 60 fs FWHM duration and 1 MHz rate at 1.03 $\mu$m wavelength are available and can be adjusted by computer-control. Moreover, nonlinear polarization rotation is implemented to improve laser pulse contrast. First cross-correlation measurements with the FEL at the plane-grating monochromator photon beamline are demonstrated, exhibiting the suitability of the laser for user experiments at FLASH.


title: Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learning

abstract: This work addresses the problem of optimizing communications between server and clients in federated learning (FL). Current sampling approaches in FL are either biased, or non optimal in terms of server-clients communications and training stability. To overcome this issue, we introduce \textit{clustered sampling} for clients selection. We prove that clustered sampling leads to better clients representatitivity and to reduced variance of the clients stochastic aggregation weights in FL. Compatibly with our theory, we provide two different clustering approaches enabling clients aggregation based on 1) sample size, and 2) models similarity. Through a series of experiments in non-iid and unbalanced scenarios, we demonstrate that model aggregation through clustered sampling consistently leads to better training convergence and variability when compared to standard sampling approaches. Our approach does not require any additional operation on the clients side, and can be seamlessly integrated in standard FL implementations. Finally, clustered sampling is compatible with existing methods and technologies for privacy enhancement, and for communication reduction through model compression.


title: Parton Distribution Functions for diquarks based on an AdS/QCD quark-diquark nucleon model

abstract: We present a phenomenological unpolarized Parton Distribution Functions for diquarks based on a soft-wall light front AdS/QCD quark-diquark nucleon model. From a probed model consistent with the Drewll-Yan-West relation and quark counting rule, we have performed a fit of some free parameters using known phenomenological quark PDF data. The model considers the entire set of possible diquarks within the nucleon valence, in the present work we focus on the spin-0 $ud_0$, spin-1 $ud_1$ and spin-1 $uu_1$ diquarks into the valence of protons. The diquark PDFs obtained are able to used in proton-proton collision simulations.


title: Playing Codenames with Language Graphs and Word Embeddings

abstract: Although board games and video games have been studied for decades in artificial intelligence research, challenging word games remain relatively unexplored. Word games are not as constrained as games like chess or poker. Instead, word game strategy is defined by the players' understanding of the way words relate to each other. The word game Codenames provides a unique opportunity to investigate common sense understanding of relationships between words, an important open challenge. We propose an algorithm that can generate Codenames clues from the language graph BabelNet or from any of several embedding methods - word2vec, GloVe, fastText or BERT. We introduce a new scoring function that measures the quality of clues, and we propose a weighting term called DETECT that incorporates dictionary-based word representations and document frequency to improve clue selection. We develop BabelNet-Word Selection Framework (BabelNet-WSF) to improve BabelNet clue quality and overcome the computational barriers that previously prevented leveraging language graphs for Codenames. Extensive experiments with human evaluators demonstrate that our proposed innovations yield state-of-the-art performance, with up to 102.8% improvement in precision@2 in some cases. Overall, this work advances the formal study of word games and approaches for common sense language understanding.


title: Coherent spin-wave transport in an antiferromagnet

abstract: Magnonics is a research field complementary to spintronics, in which the quanta of spin waves (magnons) replace electrons as information carriers, promising less energy dissipation. The development of ultrafast nanoscale magnonic logic circuits calls for new tools and materials to generate coherent spin waves with frequencies as high, and wavelengths as short, as possible. Antiferromagnets can host spin waves at THz frequencies and are therefore seen as a future platform for the fastest and the least dissipative transfer of information. However, the generation of short-wavelength coherent propagating magnons in antiferromagnets has so far remained elusive. Here we report the efficient emission and detection of a nanometer-scale wavepacket of coherent propagating magnons in antiferromagnetic DyFeO3 using ultrashort pulses of light. The subwavelength nanoscale confinement of the laser field due to large absorption creates a strongly non-uniform spin excitation profile, thereby enabling the propagation of a broadband continuum of coherent THz spin waves. The wavepacket features magnons with detected wavelengths down to 125 nm and supersonic velocities up to 13 km/s that propagate over macroscopic distances. The long-sought source of coherent short-wavelength spin carriers demonstrated here opens up new prospects for THz antiferromagnetic magnonics and coherence mediated logic devices at THz frequencies.


title: Black or White but never neutral: How readers perceive identity from yellow or skin-toned emoji

abstract: Research in sociology and linguistics shows that people use language not only to express their own identity but to understand the identity of others. Recent work established a connection between expression of identity and emoji usage on social media, through use of emoji skin tone modifiers. Motivated by that finding, this work asks if, as with language, readers are sensitive to such acts of self-expression and use them to understand the identity of authors. In behavioral experiments (n=488), where text and emoji content of social media posts were carefully controlled before being presented to participants, we find in the affirmative -- emoji are a salient signal of author identity. That signal is distinct from, and complementary to, the one encoded in language. Participant groups (based on self-identified ethnicity) showed no differences in how they perceive this signal, except in the case of the default yellow emoji. While both groups associate this with a White identity, the effect was stronger in White participants. Our finding that emoji can index social variables will have experimental applications for researchers but also implications for designers: supposedly ``neutral`` defaults may be more representative of some users than others.


title: Projection-based embedded discrete fracture model (pEDFM) for flow and heat transfer in real-field geological formations with corner-point grid geometries

abstract: In this work, the projection-based embedded discrete fracture model (pEDFM) for corner-point grid (CPG) geometry is developed for simulation of flow and heat transfer in fractured porous media. Unlike classical embedded discrete fracture approaches, this method allows for using any geologically-relevant model with a complex geometry and generic conductivity contrasts between the rock matrix and the fractures (or faults). The mass and energy conservation equations are coupled using the fully-implicit (FIM) scheme, allowing for stable simulation. Independent corner-point grids are imposed on the rock matrix and all fractures. The connectivities between the non-neighboring grid cells are described such that a consistent discrete representation of the embedded fractures occurs within the corner-point grid geometry. Various numerical tests including geologically-relevant and real-field models are conducted to demonstrate the performance of the developed method. It is shown that pEDFM can accurately capture the physical influence of both highly conductive fractures and flow barriers on the flow and heat transfer fields in complex reservoir geometries. This development casts a promising approach for flow simulations of real-field geo-models, increasing the discretization flexibility and enhancing the computational performance for capturing explicit fractures accurately.


title: Modern incarnations of the Aristotelian concepts of Continuum and Topos

abstract: The general aim of this paper is i) to argue for the feasibility and fruitfulness of the balance between the phenomenological method seeking intuitive evidence and the axiomatic-deductive method and ii) the importance of mutual understanding between philosophy and mathematics and of cultivating an historical self-awareness of their common source in Greek philosophy. To this end we show how Aristotle's theory of \emph{sunekh\^es, apeiron} and \emph{topos} as well as their related notions can be given a rigorous interpretation in terms of modern topology and geometry as well as category theory. This is facilated by the fact that in Aristotle himself we already find a good balance between intuition and formal logic. We also show how these powerful Aristotelian intuitions and concepts are found incarnated in diverse domains of modern mathematics.


title: Polyply: a python suite for facilitating simulations of (bio-)macromolecules and nanomaterials

abstract: Molecular dynamics simulations play an increasingly important role in the rational design of (nano)-materials and in the study of biomacromolecules. However, generating input files and realistic starting coordinates for these simulations is a major bottleneck, especially for high throughput protocols and for complex multi-component systems. To eliminate this bottleneck, we present the polyply software suite that leverages 1) a multi-scale graph matching algorithm designed to generate parameters quickly and for arbitrarily complex polymeric topologies, and 2) a generic multi-scale random walk protocol capable of setting up complex systems efficiently and independent of the target force-field or model resolution. We benchmark quality and performance of the approach by creating melt simulations of six different polymers using two force-fields with different resolution. We further demonstrate the power of our approach by setting up a multi lamellar microphase-separated block copolymer system for next generation batteries, and by generating a liquid-liquid phase separated polyethylene oxide-dextran system inside a lipid vesicle, featuring both branching and molecular weight distribution of the dextran component.


title: Unsupervised Acute Intracranial Hemorrhage Segmentation with Mixture Models

abstract: Intracranial hemorrhage occurs when blood vessels rupture or leak within the brain tissue or elsewhere inside the skull. It can be caused by physical trauma or by various medical conditions and in many cases leads to death. The treatment must be started as soon as possible, and therefore the hemorrhage should be diagnosed accurately and quickly. The diagnosis is usually performed by a radiologist who analyses a Computed Tomography (CT) scan containing a large number of cross-sectional images throughout the brain. Analysing each image manually can be very time-consuming, but automated techniques can help speed up the process. While much of the recent research has focused on solving this problem by using supervised machine learning algorithms, publicly-available training data remains scarce due to privacy concerns. This problem can be alleviated by unsupervised algorithms. In this paper, we propose a fully-unsupervised algorithm which is based on the mixture models. Our algorithm utilizes the fact that the properties of hemorrhage and healthy tissues follow different distributions, and therefore an appropriate formulation of these distributions allows us to separate them through an Expectation-Maximization process. In addition, our algorithm is able to adaptively determine the number of clusters such that all the hemorrhage regions can be found without including noisy voxels. We demonstrate the results of our algorithm on publicly-available datasets that contain all different hemorrhage types in various sizes and intensities, and our results are compared to earlier unsupervised and supervised algorithms. The results show that our algorithm can outperform the other algorithms with most hemorrhage types.


title: The refined quantum extremal surface prescription from the asymptotic equipartition property

abstract: Information-theoretic ideas have provided numerous insights in the progress of fundamental physics, especially in our pursuit of quantum gravity. In particular, the holographic entanglement entropy is a very useful tool in studying AdS/CFT, and its efficacy is manifested in the recent black hole page curve calculation. On the other hand, the one-shot information-theoretic entropies, such as the smooth min/max-entropies, are less discussed in AdS/CFT. They are however more fundamental entropy measures from the quantum information perspective and should also play pivotal roles in holography. We combine the technical methods from both quantum information and quantum gravity to put this idea on firm grounds. In particular, we study the quantum extremal surface (QES) prescription that was recently revised to highlight the significance of one-shot entropies in characterizing the QES phase transition. Motivated by the asymptotic equipartition property (AEP), we derive the refined quantum extremal surface prescription for fixed-area states via a novel AEP replica trick, demonstrating the synergy between quantum information and quantum gravity. We further prove that, when restricted to pure bulk marginal states, such corrections do not occur for the higher R\'enyi entropies of a boundary subregion in fixed-area states, meaning they always have sharp QES transitions. Our path integral derivation suggests that the refinement applies beyond AdS/CFT, and we confirm it in a black hole toy model by showing that the Page curve, for a black hole in a superposition of two radiation stages, receives a large correction that is consistent with the refined QES prescription.


title: A function approximation approach to the prediction of blood glucose levels

abstract: The problem of real time prediction of blood glucose (BG) levels based on the readings from a continuous glucose monitoring (CGM) device is a problem of great importance in diabetes care, and therefore, has attracted a lot of research in recent years, especially based on machine learning. An accurate prediction with a 30, 60, or 90 minute prediction horizon has the potential of saving millions of dollars in emergency care costs. In this paper, we treat the problem as one of function approximation, where the value of the BG level at time $t+h$ (where $h$ the prediction horizon) is considered to be an unknown function of $d$ readings prior to the time $t$. This unknown function may be supported in particular on some unknown submanifold of the $d$-dimensional Euclidean space. While manifold learning is classically done in a semi-supervised setting, where the entire data has to be known in advance, we use recent ideas to achieve an accurate function approximation in a supervised setting; i.e., construct a model for the target function. We use the state-of-the-art clinically relevant PRED-EGA grid to evaluate our results, and demonstrate that for a real life dataset, our method performs better than a standard deep network, especially in hypoglycemic and hyperglycemic regimes. One noteworthy aspect of this work is that the training data and test data may come from different distributions.


title: Latent Event-Predictive Encodings through Counterfactual Regularization

abstract: A critical challenge for any intelligent system is to infer structure from continuous data streams. Theories of event-predictive cognition suggest that the brain segments sensorimotor information into compact event encodings, which are used to anticipate and interpret environmental dynamics. Here, we introduce a SUrprise-GAted Recurrent neural network (SUGAR) using a novel form of counterfactual regularization. We test the model on a hierarchical sequence prediction task, where sequences are generated by alternating hidden graph structures. Our model learns to both compress the temporal dynamics of the task into latent event-predictive encodings and anticipate event transitions at the right moments, given noisy hidden signals about them. The addition of the counterfactual regularization term ensures fluid transitions from one latent code to the next, whereby the resulting latent codes exhibit compositional properties. The implemented mechanisms offer a host of useful applications in other domains, including hierarchical reasoning, planning, and decision making.


title: Lipschitz Stability and Hadamard Directional Differentiability for Elliptic and Parabolic Obstacle-Type Quasi-Variational Inequalities

abstract: This paper is concerned with the sensitivity analysis of a class of parameterized fixed-point problems that arise in the context of obstacle-type quasi-variational inequalities. We prove that, if the operators in the considered fixed-point equation satisfy a positive superhomogeneity condition, then the maximal and minimal element of the solution set of the problem depend locally Lipschitz continuously on the involved parameters. We further show that, if certain concavity conditions hold, then the maximal solution mapping is Hadamard directionally differentiable and its directional derivatives are precisely the minimal solutions of suitably defined linearized fixed-point equations. In contrast to prior results, our analysis requires neither a Dirichlet space structure, nor restrictive assumptions on the mapping behavior and regularity of the involved operators, nor sign conditions on the directions that are considered in the directional derivatives. Our approach further covers the elliptic and parabolic setting simultaneously and also yields Hadamard directional differentiability results in situations in which the solution set of the fixed-point equation is a continuum and a characterization of directional derivatives via linearized auxiliary problems is provably impossible. To illustrate that our results can be used to study interesting problems arising in practice, we apply them to establish the Hadamard directional differentiability of the solution operator of a nonlinear elliptic quasi-variational inequality, which emerges in impulse control and in which the obstacle mapping is obtained by taking essential infima over certain parts of the underlying domain, and of the solution mapping of a parabolic quasi-variational inequality, which involves boundary controls and in which the state-to-obstacle relationship is described by a partial differential equation.


title: Computer simulations of supercooled liquid hydrogen mixtures and the possible crystallization slowdown

abstract: Metastable liquid mixtures of parahydrogen and orthodeuterium are studied theoretically by means of computer simulations. No reduced propensity of the mixture to undergo crystallization is observed, compared to that of pure liquid parahydrogen. Demixing of the two species as a precursor of crystallization is not observed either.


title: On orbits of automorphism groups on horospherical varieties

abstract: In this paper we describe orbits of automorphism group on a horospherical variety in terms of degrees of homogeneous with respect to natural grading locally nilpotent derivations. In case of (may be non-normal) toric varieties a description of orbits of automorphism group in terms of corresponding weight monoid is obtained.


title: Minimal Differential Lateral Acceleration Configurations for Starshade Stationkeeping in Exoplanet Direct Imaging

abstract: Exoplanet imaging missions utilizing an external occulter (starshade) for starlight suppression require precise alignment between the telescope and starshade, necessitating maintenance of the starshade orbit during observations. Differential lateral acceleration between the two spacecraft serves as a proxy for fuel use and number of required interruptions to the observation. Comparison against results from high fidelity simulations of stationkeeping validates the use of this easy-to-compute proxy. Among starshade positions constrained to the surface of a sphere centered about the telescope, minima of differential lateral acceleration lie on a great circle and its corresponding poles. We present a closed expression for telescope to star vectors requiring minimal stationkeeping for observation from a telescope at an arbitrary position


title: Higher-dimensional invariants in $6D$ super Yang-Mills theory

abstract: We exploit the $6D, {\cal N}=(1,0)$ and ${\cal N}=(1,1)$ harmonic superspace approaches to construct the full set of the maximally supersymmetric on-shell invariants of the canonical dimension ${\bf d=12}$ in $6D, \,{\cal N}=(1,1)$ supersymmetric Yang-Mills (SYM) theory. Both single- and double-trace invariants are derived. Only four single-trace and two double-trace invariants prove to be independent. The invariants constructed can provide the possible counterterms of ${\cal N}=(1,1)$ SYM theory at four-loop order, where the first double-trace divergences are expected to appear. We explicitly exhibit the gauge sector of all invariants in terms of ${\cal N} = (1, 0)$ gauge superfields and find the absence of ${\cal N}=(1,1)$ supercompletion of the $F^6$ term in the abelian limit.


title: Beyond the CMOS sensors: the DoTPiX pixel concept and technology for the International Linear Collider A

abstract: CMOS sensors were successfully implemented in the STAR tracker [1]. LHC experiments have shown that efficient b tagging, reconstruction of displaced vertices and identification of disappearing tracks are necessary. An improved vertex detector is justified for the ILC. To achieve a point(spatial single layer) resolution below the one-{\mu}m range while improving other characteristics (radiation tolerance and eventually time resolution) we will need the use of 1-micron pitch pixels. Therefore, we propose a single MOS transistor that acts as an amplifying device and a detector with a buried charge-collecting gate. Device simulations both classical and quantum, have led to the proposed DoTPiX structure. With the evolution of silicon processes, well below 100 nm line feature, this pixel should be feasible. We will present this pixel detector and the present status of its development in both our institution (IRFU) and in other collaborating labs (CNRS/C2N).


title: Calculating Expected Value of Sample Information Adjusting for Imperfect Implementation

abstract: Background: The Expected Value of Sample Information (EVSI) calculates the value of collecting additional information through a study with a given design. Standard EVSI analyses assume that the treatment recommendations based on the new information will be implemented immediately and completely once the study has finished. However, treatment implementation is often slow and incomplete, giving a biased estimation of the study value. Previous methods have adjusted for this bias, but they typically make the unrealistic assumption that the study outcomes do not impact the implementation. One method does assume that the implementation is related to the strength of evidence in favour of the treatment but this method uses analytical results, which require alternative restrictive assumptions. Methods: We develop two implementation-adjusted EVSI calculation methods that relax these assumptions. The first method uses computationally demanding nested simulations, using the definition of the implementation-adjusted EVSI. The second method aims to facilitate the computation by adapting a recently developed efficient EVSI computation method to adjust for imperfect implementation. The implementation-adjusted EVSI is then calculated with the two methods across three examples. Results: The maximum difference between the two methods is at most 6% in all examples. The efficient computation method is between 6 and 60 times faster than the nested simulation method in this case study and could be used in practice. Conclusions: The methods developed in this paper calculate implementation-adjusted EVSI using realistic assumptions. The efficient estimation method is accurate and can estimate the implementation-adjusted EVSI in practice. By adapting standard EVSI estimation methods, we allow accurate adjustments for imperfect implementation with the same computational cost as a standard analysis.


title: What's wrong with this video? Comparing Explainers for Deepfake Detection

abstract: Deepfakes are computer manipulated videos where the face of an individual has been replaced with that of another. Software for creating such forgeries is easy to use and ever more popular, causing serious threats to personal reputation and public security. The quality of classifiers for detecting deepfakes has improved with the releasing of ever larger datasets, but the understanding of why a particular video has been labelled as fake has not kept pace. In this work we develop, extend and compare white-box, black-box and model-specific techniques for explaining the labelling of real and fake videos. In particular, we adapt SHAP, GradCAM and self-attention models to the task of explaining the predictions of state-of-the-art detectors based on EfficientNet, trained on the Deepfake Detection Challenge (DFDC) dataset. We compare the obtained explanations, proposing metrics to quantify their visual features and desirable characteristics, and also perform a user survey collecting users' opinions regarding the usefulness of the explainers.


title: Finite-time Koopman Identifier: A Unified Batch-online Learning Framework for Joint Learning of Koopman Structure and Parameters

abstract: In this paper, a unified batch-online learning approach is introduced to learn a linear representation of nonlinear system dynamics using the Koopman operator. The presented system modeling approach leverages a novel incremental Koopman-based update law that retrieves a mini-batch of samples stored in a memory to not only minimizes the instantaneous Koopman operator's identification errors but also the identification errors for the batch of retrieved samples. Discontinuous modifications of gradient flows are presented for the online update law to assure finite-time convergence under easy-to-verify conditions defined on the batch of data. Therefore, this unified online-batch framework allows performing joint sample- and time-domain analysis for converging the Koopman operator's parameters. More specifically, it is shown that if the collected mini-batch of samples guarantees a rank condition, then finite-time guarantee in the time domain can be certified and the settling time depends on the quality of collected samples being reused in the update law. Moreover, the efficiency of the proposed Koopman-based update law is further analyzed by showing that the identification regret in continuous time grows sub-linearly with time. Furthermore, to avoid learning corrupted dynamics due to the selection of an inappropriate set of Koopman observables, a higher-layer meta learner employs a discrete Bayesian optimization algorithm to obtain the best library of observable functions for the operator. Since finite-time convergence of the Koopman model for each set of observable is guaranteed under a rank condition on stored data, the fitness of each set of observables can be obtained based on the identification error on the stored samples in the proposed framework and even without implementing any controller based on the learned system.


title: Dynamic Actuation of DNA-Assembled Plasmonic Nanostructures in Microfluidic Cell-Sized Compartments

abstract: Molecular motor proteins form the basis of cellular dynamics. Recently, notable efforts have led to the creation of their DNA-based mimics, which can carry out complex nanoscale motion. However, such functional analogues have not yet been integrated or operated inside synthetic cells toward the goal of realizing artificial biological systems entirely from the bottom-up. In this Letter, we encapsulate and actuate DNA-assembled dynamic nanostructures inside cell-sized microfluidic compartments. These encapsulated DNA nanostructures not only exhibit structural reconfigurability owing to their pH-sensitive molecular switches upon external stimuli but also possess optical feedback enabled by the integrated plasmonic probes. In particular, we demonstrate the power of microfluidic compartmentalization for achieving on-chip plasmonic enantiomer separation and substrate filtration. Our work exemplifies that the two unique tools, droplet-based microfluidics and DNA technology, offering high precision on the microscale and nanoscale, respectively, can be brought together to greatly enrich the complexity and diversity of functional synthetic systems.


title: Classifying spaces for the family of virtually abelian subgroups of orientable $3$-manifold groups

abstract: For a group $G$, let $\mathcal{F}_{n}$ be the family of all the subgroups of $G$ containing a subgroup isomorphic to $\mathbb{Z}^{r}$ for some $r=0,1,2,\dots ,n$ of finite index. Joecken, Lafont and S\'anchez Salda\~na computed the $\mathcal{F}_1$-dimension of 3-manifold groups. The goal of this article is to compute the $\mathcal{F}_n$-geometric dimension of 3-manifold groups for all $n\geq 2$.


title: Phase transitions of the ferroelectric $(\mathrm{ND}_4)_2\mathrm{FeCl}_5\cdot\mathrm{D}_2\mathrm{O}$ under a magnetic field

abstract: Due to the strong coupling between magnetism and ferroelectricity, $(\mathrm{ND}_4)_2\mathrm{FeCl}_5\cdot\mathrm{D}_2\mathrm{O}$ exhibits several intriguing magnetic and electric phases. In this letter, we include high-order onsite spin anisotropic interactions in a spin model that successfully captures the ferroelectric phase transitions of $(\mathrm{ND}_4)_2\mathrm{FeCl}_5\cdot\mathrm{D}_2\mathrm{O}$ under a magnetic field and produces the large weights of high-order harmonic components in the cycloid structure that are observed from neutron diffraction experiments. Moreover, we predict a new ferroelectric phase sandwiched between the FE II and FE III phases in a magnetic field. Our results emphasize the importance of the high-order spin anisotropic interactions and provide a guideline to understand multiferroic materials with rich phase diagrams.


title: A new characterization of discrete decomposable models

abstract: Decomposable graphical models, also known as perfect DAG models, play a fundamental role in standard approaches to probabilistic inference via graph representations in modern machine learning and statistics. However, such models are limited by the assumption that the data-generating distribution does not entail strictly context-specific conditional independence relations. The family of staged tree models generalizes DAG models so as to accommodate context-specific knowledge. We provide a new characterization of perfect discrete DAG models in terms of their staged tree representations. This characterization identifies the family of balanced staged trees as the natural generalization of discrete decomposable models to the context-specific setting.


title: The imprint of X-ray photoevaporation of planet-forming discs on the orbital distribution of giant planets -- II. Theoretical predictions

abstract: Numerical models have shown that disc dispersal via internal photoevaporation driven by the host star can successfully reproduce the observed pile-up of warm Jupiters near 1-2 au. However, since a range of different mechanisms have been proposed to cause the same feature, clear observational diagnostics of disc dispersal leaving an imprint in the observed distribution of giant planets could help to constrain the dominant mechanisms. We aim to assess the impact of disc dispersal via X-ray driven-photoevaporation (XPE) onto giant planet separations in order to provide theoretical constraints on the location and size of any possible features related to this process within their observed orbital distribution. For this purpose, we perform a set of 1D population syntheses with varying initial conditions and correlate the gas giants' final parking locations with the X-ray luminosities of their host stars in order to quantify observables of this process within the $L_\mathrm{x}$-$a$-plane of these systems. We find that XPE indeed creates an underdensity of gas giants near the gravitational radius, with corresponding pile-ups inside and/or outside of this location. However, the size and location of these features are strongly dependent on the choice of initial conditions in our model, such as the assumed formation location of the planets. XPE can strongly affect the migration process of giant planets and leave potentially observable signatures within the observed orbital separations of giant planets. However, due to the simplistic approach employed in our model, which lacks a self-consistent treatment of planet formation within an evolving disc, a quantitative analysis of the final planet population orbits is not possible. Our results however strongly motivate future studies to include realistic disc dispersal mechanisms into global planet population synthesis models.


title: Structural Order of the Molecular Adlayer Impacts the Stability of Nanoparticle-on-Mirror Plasmonic Cavities

abstract: Immense field enhancement and nanoscale confinement of light are possible within nanoparticle-on-mirror (NPoM) plasmonic resonators, which enable novel optically-activated physical and chemical phenomena, and render these nanocavities greatly sensitive to minute structural changes, down to the atomic scale. Although a few of these structural parameters, primarily linked to the nanoparticle and the mirror morphology, have been identified, the impact of molecular assembly and organization of the spacer layer between them has often been left uncharacterized. Here, we experimentally investigate how the complex and reconfigurable nature of a thiol-based self-assembled monolayer (SAM) adsorbed on the mirror surface impacts the optical properties of the NPoMs. We fabricate NPoMs with distinct molecular organizations by controlling the incubation time of the mirror in the thiol solution. Afterwards, we investigate the structural changes that occur under laser irradiation by tracking the bonding dipole plasmon mode, while also monitoring Stokes and anti-Stokes Raman scattering from the molecules as a probe of their integrity. First, we find an effective decrease in the SAM height as the laser power increases, compatible with an irreversible change of molecule orientation caused by heating. Second, we observe that the nanocavities prepared with a densely packed and more ordered monolayer of molecules are more prone to changes in their resonance compared to samples with sparser and more disordered SAMs. Our measurements indicate that molecular orientation and packing on the mirror surface play a key role in determining the stability of NPoM structures and hence highlight the under-recognized significance of SAM characterization in the development of NPoM-based applications.


title: On the matroidal path ideals

abstract: We prove that the set of all paths of a fixed length in a complete multipartite graph is the bases of a matroid. Moreover, we discuss the Cohen-Macaulayness and depth of powers of $t$-path ideals of a complete multipartite graph.


title: The Power of the Weisfeiler-Leman Algorithm for Machine Learning with Graphs

abstract: In recent years, algorithms and neural architectures based on the Weisfeiler-Leman algorithm, a well-known heuristic for the graph isomorphism problem, emerged as a powerful tool for (supervised) machine learning with graphs and relational data. Here, we give a comprehensive overview of the algorithm's use in a machine learning setting. We discuss the theoretical background, show how to use it for supervised graph- and node classification, discuss recent extensions, and its connection to neural architectures. Moreover, we give an overview of current applications and future directions to stimulate research.


title: MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation

abstract: The advent of large pre-trained language models has given rise to rapid progress in the field of Natural Language Processing (NLP). While the performance of these models on standard benchmarks has scaled with size, compression techniques such as knowledge distillation have been key in making them practical. We present, MATE-KD, a novel text-based adversarial training algorithm which improves the performance of knowledge distillation. MATE-KD first trains a masked language model based generator to perturb text by maximizing the divergence between teacher and student logits. Then using knowledge distillation a student is trained on both the original and the perturbed training samples. We evaluate our algorithm, using BERT-based models, on the GLUE benchmark and demonstrate that MATE-KD outperforms competitive adversarial learning and data augmentation baselines. On the GLUE test set our 6 layer RoBERTa based model outperforms BERT-Large.


title: Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense

abstract: Pretrained language models have demonstrated outstanding performance in many NLP tasks recently. However, their social intelligence, which requires commonsense reasoning about the current situation and mental states of others, is still developing. Towards improving language models' social intelligence, we focus on the Social IQA dataset, a task requiring social and emotional commonsense reasoning. Building on top of the pretrained RoBERTa and GPT2 models, we propose several architecture variations and extensions, as well as leveraging external commonsense corpora, to optimize the model for Social IQA. Our proposed system achieves competitive results as those top-ranking models on the leaderboard. This work demonstrates the strengths of pretrained language models, and provides viable ways to improve their performance for a particular task.


title: The mass and galaxy distribution around SZ-selected clusters

abstract: We present measurements of the radial profiles of the mass and galaxy number density around Sunyaev-Zel'dovich-selected clusters using both weak lensing and galaxy counts. The clusters are selected from the Atacama Cosmology Telescope Data Release 5 and the galaxies from the Dark Energy Survey Year 3 dataset. With signal-to-noise of 62 (43) for galaxy (weak lensing) profiles over scales of about $0.2-20h^{-1}$ Mpc, these are the highest precision measurements for SZ-selected clusters to date. Because SZ selection closely approximates mass selection, these measurements enable several tests of theoretical models of the mass and light distribution around clusters. Our main findings are: 1. The splashback feature is detected at a consistent location in both the mass and galaxy profiles and its location is consistent with predictions of cold dark matter N-body simulations. 2. The full mass profile is also consistent with the simulations; hence it can constrain alternative dark matter models that modify the mass distribution of clusters. 3. The shapes of the galaxy and lensing profiles are remarkably similar for our sample over the entire range of scales, from well inside the cluster halo to the quasilinear regime. This can be used to constrain processes such as quenching and tidal disruption that alter the galaxy distribution inside the halo, and scale-dependent features in the transition regime outside the halo. We measure the dependence of the profile shapes on the galaxy sample, redshift and cluster mass. We extend the Diemer \& Kravtsov model for the cluster profiles to the linear regime using perturbation theory and show that it provides a good match to the measured profiles. We also compare the measured profiles to predictions of the standard halo model and simulations that include hydrodynamics. Applications of these results to cluster mass estimation and cosmology are discussed.


title: Better than BERT but Worse than Baseline

abstract: This paper compares BERT-SQuAD and Ab3P on the Abbreviation Definition Identification (ADI) task. ADI inputs a text and outputs short forms (abbreviations/acronyms) and long forms (expansions). BERT with reranking improves over BERT without reranking but fails to reach the Ab3P rule-based baseline. What is BERT missing? Reranking introduces two new features: charmatch and freq. The first feature identifies opportunities to take advantage of character constraints in acronyms and the second feature identifies opportunities to take advantage of frequency constraints across documents.


title: Dynamical Isometry: The Missing Ingredient for Neural Network Pruning

abstract: Several recent works [40, 24] observed an interesting phenomenon in neural network pruning: A larger finetuning learning rate can improve the final performance significantly. Unfortunately, the reason behind it remains elusive up to date. This paper is meant to explain it through the lens of dynamical isometry [42]. Specifically, we examine neural network pruning from an unusual perspective: pruning as initialization for finetuning, and ask whether the inherited weights serve as a good initialization for the finetuning? The insights from dynamical isometry suggest a negative answer. Despite its critical role, this issue has not been well-recognized by the community so far. In this paper, we will show the understanding of this problem is very important -- on top of explaining the aforementioned mystery about the larger finetuning rate, it also unveils the mystery about the value of pruning [5, 30]. Besides a clearer theoretical understanding of pruning, resolving the problem can also bring us considerable performance benefits in practice.