title: SYK meets non-Hermiticity II: measurement-induced phase transition

abstract: We construct Brownian Sachdev-Ye-Kitaev (SYK) chains subjected to continuous monitoring and explore possible entanglement phase transitions therein. We analytically derive the effective action in the large-$N$ limit and show that an entanglement transition is caused by the symmetry breaking in the enlarged replica space. In the noninteracting case with SYK$_2$ chains, the model features a continuous $O(2)$ symmetry between two replicas and a transition corresponding to spontaneous breaking of that symmetry upon varying the measurement rate. In the symmetry broken phase at low measurement rate, the emergent replica criticality associated with the Goldstone mode leads to a log-scaling entanglement entropy that can be attributed to the free energy of vortices. In the symmetric phase at higher measurement rate, the entanglement entropy obeys area-law scaling. In the interacting case, the continuous $O(2)$ symmetry is explicitly lowered to a discrete $C_4$ symmetry, giving rise to volume-law entanglement entropy in the symmetry-broken phase due to the enhanced linear free energy cost of domain walls compared to vortices. The interacting transition is described by $C_4$ symmetry breaking. We also verify the large-$N$ critical exponents by numerically solving the Schwinger-Dyson equation.

categories: cond-mat.str-el cond-mat.stat-mech hep-th quant-ph


title: TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval

abstract: In recent years, considerable progress on the task of text-video retrieval has been achieved by leveraging large-scale pretraining on visual and audio datasets to construct powerful video encoders. By contrast, despite the natural symmetry, the design of effective algorithms for exploiting large-scale language pretraining remains under-explored. In this work, we are the first to investigate the design of such algorithms and propose a novel generalized distillation method, TeachText, which leverages complementary cues from multiple text encoders to provide an enhanced supervisory signal to the retrieval model. Moreover, we extend our method to video side modalities and show that we can effectively reduce the number of used modalities at test time without compromising performance. Our approach advances the state of the art on several video retrieval benchmarks by a significant margin and adds no computational overhead at test time. Last but not least, we show an effective application of our method for eliminating noise from retrieval datasets. Code and data can be found at https://www.robots.ox.ac.uk/~vgg/research/teachtext/.


title: Glue-and-Cut at Five Loops

abstract: We compute epsilon-expansions around 4 dimensions of a complete set of master integrals for momentum space five-loop massless propagator integrals in dimensional regularization, up to and including the first order with contributions of transcendental weight nine. Our method is the glue-and-cut technique from Baikov and Chetyrkin, which proves extremely effective in that it determines all expansion coefficients to this order in terms of recursively one-loop integrals and only one further integral. We observe that our results are compatible with conjectures that predict $\pi$-dependent contributions.


title: Membership Inference Attacks on Knowledge Graphs

abstract: Membership inference attacks (MIAs) infer whether a specific data record is used for target model training. MIAs have provoked many discussions in the information security community since they give rise to severe data privacy issues, especially for private and sensitive datasets. Knowledge Graphs (KGs), which describe domain-specific subjects and relationships among them, are valuable and sensitive, such as medical KGs constructed from electronic health records. However, the privacy threat to knowledge graphs is critical but rarely explored. In this paper, we conduct the first empirical evaluation of privacy threats to knowledge graphs triggered by knowledge graph embedding methods (KGEs). We propose three types of membership inference attacks: transfer attacks (TAs), prediction loss-based attacks (PLAs), and prediction correctness-based attacks (PCAs), according to attack difficulty levels. In the experiments, we conduct three inference attacks against four standard KGE methods over three benchmark datasets. In addition, we also propose the attacks against medical KG and financial KG. The results demonstrate that the proposed attack methods can easily explore the privacy leakage of knowledge graphs.


title: Learning Evolved Combinatorial Symbols with a Neuro-symbolic Generative Model

abstract: Humans have the ability to rapidly understand rich combinatorial concepts from limited data. Here we investigate this ability in the context of auditory signals, which have been evolved in a cultural transmission experiment to study the emergence of combinatorial structure in language. We propose a neuro-symbolic generative model which combines the strengths of previous approaches to concept learning. Our model performs fast inference drawing on neural network methods, while still retaining the interpretability and generalization from limited data seen in structured generative approaches. This model outperforms a purely neural network-based approach on classification as evaluated against both ground truth and human experimental classification preferences, and produces superior reproductions of observed signals as well. Our results demonstrate the power of flexible combined neural-symbolic architectures for human-like generalization in raw perceptual domains and offers a step towards developing precise computational models of inductive biases in language evolution.


title: SDSS-IV MaNGA: 3D spin alignment of spiral and S0 galaxies

abstract: We investigate the 3D spin alignment of galaxies with respect to the large-scale filaments using the MaNGA survey. The cosmic web is reconstructed from the Sloan Digital Sky Survey using Disperse and the 3D spins of MaNGA galaxies are estimated using the thin disk approximation with integral field spectroscopy kinematics. Late-type spiral galaxies are found to have their spins parallel to the closest filament's axis. The alignment signal is found to be dominated by low-mass spirals. Spins of S0-type galaxies tend to be oriented preferentially in perpendicular direction with respect to the filament's axis. This orthogonal orientation is found to be dominated by S0s that show a notable misalignment between their kinematic components of stellar and ionised gas velocity fields and/or by low mass S0s with lower rotation support compared to their high mass counterparts. Qualitatively similar results are obtained when splitting galaxies based on the degree of ordered stellar rotation, such that galaxies with high spin magnitude have their spin aligned, and those with low spin magnitude in perpendicular direction to the filaments. In the context of conditional tidal torque theory, these findings suggest that galaxies' spins retain memory of their larger-scale environment. In agreement with measurements from hydrodynamical cosmological simulations, the measured signal at low redshift is weak, yet statistically significant. The dependence of the spin-filament orientation of galaxies on their stellar mass, morphology and kinematics highlights the importance of sample selection to detect the signal.


title: Improving Transparency in IDIQ Contracts: A Comparison of Common Procurement Issues Affecting Economies Across the Atlantic and Suggested Solutions

abstract: Expansions in the size and scope of public procurement across the Atlantic have increased calls for accountability of democratic governments. Indefinite Delivery, Indefinite Quantity contracts by their very nature are less transparent but serve as major tools of public procurement in both the European and American economies. This paper utilizes a cross-Atlantic perspective to discuss common challenges faced by governments and contracting entities while highlighting the need for balancing transparency with efficiency to avoid negative economic outcomes. It concludes by discussing and providing potential solutions to certain common challenges.


title: Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction

abstract: Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions. Our work addresses two key challenges in trajectory prediction, learning multimodal outputs, and better predictions by imposing constraints using driving knowledge. Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many. But the impact of those methods in learning diverse hypotheses is under-studied as such objectives highly depend on their initialization for diversity. As our first contribution, we propose a novel Divide-And-Conquer (DAC) approach that acts as a better initialization technique to WTA objective, resulting in diverse outputs without any spurious modes. Our second contribution is a novel trajectory prediction framework called ALAN that uses existing lane centerlines as anchors to provide trajectories constrained to the input lanes. Our framework provides multi-agent trajectory outputs in a forward pass by capturing interactions through hypercolumn descriptors and incorporating scene information in the form of rasterized images and per-agent lane anchors. Experiments on synthetic and real data show that the proposed DAC captures the data distribution better compare to other WTA family of objectives. Further, we show that our ALAN approach provides on par or better performance with SOTA methods evaluated on Nuscenes urban driving benchmark.


title: Fusing the Old with the New: Learning Relative Camera Pose with Geometry-Guided Uncertainty

abstract: Learning methods for relative camera pose estimation have been developed largely in isolation from classical geometric approaches. The question of how to integrate predictions from deep neural networks (DNNs) and solutions from geometric solvers, such as the 5-point algorithm, has as yet remained under-explored. In this paper, we present a novel framework that involves probabilistic fusion between the two families of predictions during network training, with a view to leveraging their complementary benefits in a learnable way. The fusion is achieved by learning the DNN uncertainty under explicit guidance by the geometric uncertainty, thereby learning to take into account the geometric solution in relation to the DNN prediction. Our network features a self-attention graph neural network, which drives the learning by enforcing strong interactions between different correspondences and potentially modeling complex relationships between points. We propose motion parmeterizations suitable for learning and show that our method achieves state-of-the-art performance on the challenging DeMoN and ScanNet datasets. While we focus on relative pose, we envision that our pipeline is broadly applicable for fusing classical geometry and deep learning.


title: Testing for Outliers with Conformal p-values

abstract: This paper studies the construction of p-values for nonparametric outlier detection, taking a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a reference data set or are outliers. We propose a solution based on conformal inference, a broadly applicable framework which yields p-values that are marginally valid but mutually dependent for different test points. We prove these p-values are positively dependent and enable exact false discovery rate control, although in a relatively weak marginal sense. We then introduce a new method to compute p-values that are both valid conditionally on the training data and independent of each other for different test points; this paves the way to stronger type-I error guarantees. Our results depart from classical conformal inference as we leverage concentration inequalities rather than combinatorial arguments to establish our finite-sample guarantees. Furthermore, our techniques also yield a uniform confidence bound for the false positive rate of any outlier detection algorithm, as a function of the threshold applied to its raw statistics. Finally, the relevance of our results is demonstrated by numerical experiments on real and simulated data.


title: Metabolically Stable Neurotensin Analogs Exert Potent and Long-Acting Analgesia Without Hypothermia

abstract: The endogenous tridecapeptide neurotensin (NT) has emerged as an important inhibitory modulator of pain transmission, exerting its analgesic action through the activation of the G protein-coupled receptors, NTS1 and NTS2. Whereas both NT receptors mediate the analgesic effects of NT, NTS1 activation also produces hypotension and hypothermia, which may represent obstacles for the development of new pain medications. In the present study, we implemented various chemical strategies to improve the metabolic stability of the biologically active fragment NT(8-13) and assessed their NTS1/NTS2 relative binding affinities. We then determined their ability to reduce the nociceptive behaviors in acute, tonic, and chronic pain models and to modulate blood pressure and body temperature. To this end, we synthesized a series of NT(8-13) analogs carrying a reduced amide bond at Lys8-Lys9 and harboring site-selective modifications with unnatural amino acids, such as silaproline (Sip) and trimethylsilylalanine (TMSAla). Incorporation of Sip and TMSAla respectively in positions 10 and 13 of NT(8-13) combined with the Lys8-Lys9 reduced amine bond (JMV5296) greatly prolonged the plasma half-life time over 20 hours. These modifications also led to a 25-fold peptide selectivity toward NTS2. More importantly, central delivery of JMV5296 was able to induce a strong antinociceptive effect in acute (tail-flick), tonic (formalin), and chronic inflammatory (CFA) pain models without inducing hypothermia. Altogether, these results demonstrate that the chemically-modified NT(8-13) analog JMV5296 exhibits a better therapeutic profile and may thus represent a promising avenue to guide the development of new stable NT agonists and improve pain management.


title: Controlled abstention neural networks for identifying skillful predictions for classification problems

abstract: The earth system is exceedingly complex and often chaotic in nature, making prediction incredibly challenging: we cannot expect to make perfect predictions all of the time. Instead, we look for specific states of the system that lead to more predictable behavior than others, often termed "forecasts of opportunity." When these opportunities are not present, scientists need prediction systems that are capable of saying "I don't know." We introduce a novel loss function, termed the "NotWrong loss", that allows neural networks to identify forecasts of opportunity for classification problems. The NotWrong loss introduces an abstention class that allows the network to identify the more confident samples and abstain (say "I don't know") on the less confident samples. The abstention loss is designed to abstain on a user-defined fraction of the samples via a PID controller. Unlike many machine learning methods used to reject samples post-training, the NotWrong loss is applied during training to preferentially learn from the more confident samples. We show that the NotWrong loss outperforms other existing loss functions for multiple climate use cases. The implementation of the proposed loss function is straightforward in most network architectures designed for classification as it only requires the addition of an abstention class to the output layer and modification of the loss function.


title: The Compact UV Size of Green Pea Galaxies As Local Analogs of High-redshift Ly$\alpha$-Emitters

abstract: We study the dependence of Ly$\alpha$ escape from galaxies on UV continuum size and luminosity using a sample of 40 Green Pea (GP) galaxies, which are the best local analogs of high-redshift Ly$\alpha$-emitters (LAEs). We use the Cosmic Origins Spectrograph near-ultraviolet images from the \textit{Hubble Space Telescope} to measure the UV size and luminosity with $0.047''$ spatial resolution. Like most galaxies the GPs show a log-normal size distribution. They also show a positive correlation between size and UV-continuum luminosity. The slope of the size-continuum luminosity relation for GPs is consistent with those of continuum-selected star-forming galaxies at low and high redshifts. A distinctive feature of GPs is a very compact typical radius of 0.33 kpc with a population spread (1$\sigma$) of 0.19 kpc. The peak of the size distribution and the intercept of the size-luminosity relation of GPs are noticeably smaller than those of continuum-selected star-forming galaxies at similar redshifts. There are statistically significant anti-correlations found between the circularized half-light radius ($r_{\rm cir,50}$), the Ly$\alpha$ equivalent width (EW(Ly$\alpha$)), and the Ly$\alpha$ escape faction ($f^{Ly\alpha}_{esc}$), suggesting that small UV-continuum radii are crucial for Ly$\alpha$ emission. GPs and high-redshift LAEs have similar sizes, once spatial resolution effects are properly considered. Our results show that a compact/small size is crucial for escape of Ly$\alpha$ photons, and that Ly$\alpha$-emitters show constant characteristic size independent of their redshift.


title: Fast Tensor Disentangling Algorithm

abstract: Many recent tensor network algorithms apply unitary operators to parts of a tensor network in order to reduce entanglement. However, many of the previously used iterative algorithms to minimize entanglement can be slow. We introduce an approximate, fast, and simple algorithm to optimize disentangling unitary tensors. Our algorithm is asymptotically faster than previous iterative algorithms and often results in a residual entanglement entropy that is within 10 to 40% of the minimum. For certain input tensors, our algorithm returns an optimal solution. When disentangling order-4 tensors with equal bond dimensions, our algorithm achieves an entanglement spectrum where nearly half of the singular values are zero. We further validate our algorithm by showing that it can efficiently disentangle random 1D states of qubits.


title: B-modes from Post-inflationary Gravitational Waves Sourced by Axionic Instabilities at Cosmic Reionization

abstract: We show that axion-like particles that only couple to invisible dark photons can generate visible B-mode signals around the reionization epoch. The axion field starts rolling shortly before reionization, resulting in a tachyonic instability for the dark photons. This generates an exponential growth of the dark photon quanta sourcing both scalar metric modes and gravitational waves that leave an imprint on the reionized baryons. The tensor modes modify the cosmic microwave background (CMB) polarization at reionization, generating visible B-mode signatures for the next generation of CMB experiments for parameter ranges that satisfy the current experimental constraints.


title: Discovery of a directly imaged planet to the young solar analog YSES 2

abstract: Abbreviated. By selecting stars with similar ages and masses, the Young Suns Exoplanet Survey (YSES) aims to detect and characterize planetary-mass companions to solar-type host stars in the Scorpius-Centaurus association. Our survey is carried out with VLT/SPHERE with short exposure sequences on the order of 5 min per star per filter. The subtraction of the stellar point spread function (PSF) is based on reference star differential imaging (RDI) using the other targets in the survey in combination with principal component analysis. We report the discovery of YSES 2b, a planetary-mass companion to the K1 star YSES 2 (TYC 8984-2245-1). The primary has a Gaia EDR3 distance of 110 pc, and we derive a revised mass of $1.1\,M_\odot$ and an age of approximately 14 Myr. We detect the companion in two observing epochs southwest of the star at a position angle of 205$^\circ$ and with a separation of $\sim1.05''$, which translates to a minimum physical separation of 115 au at the distance of the system. We derive a photometric planet mass of $6.3^{+1.6}_{-0.9}\,M_\mathrm{Jup}$ using AMES-COND and AMES-dusty evolutionary models; this mass corresponds to a mass ratio of $q=(0.5\pm0.1)$% with the primary. This is the lowest mass ratio of a direct imaging planet around a solar-type star to date. We discuss potential formation mechanisms and find that the current position of the planet is compatible with formation by disk gravitational instability, but its mass is lower than expected from numerical simulations. Formation via core accretion must have occurred closer to the star, yet we do not find evidence that supports the required outward migration, such as via scattering off another undiscovered companion in the system. YSES 2b is an ideal target for follow-up observations to further the understanding of the physical and chemical formation mechanisms of wide-orbit Jovian planets.


title: linemake: An Atomic and Molecular Line List Generator

abstract: In this research note, we present linemake, an open-source atomic and molecular line list generator. Rather than a replacement for a number of well-established atomic and molecular spectral databases, linemake aims to be a lightweight, easy-to-use tool to generate formatted and curated lists suitable for spectral synthesis work. We encourage users of linemake to understand the sources of their transition data and cite them as appropriate in published work. We provide the code, line database, and an extensive list of literature references in a GitHub repository (https://github.com/vmplacco/linemake), which will be updated regularly as new data become available.


title: Probing QCD dynamics and the standard model with $D_{(s)} \to P^+ P^0 \gamma$ decays

abstract: We compute 10 radiative three-body decays of charged charmed mesons $D^+ \to P^+ P^0 \gamma$ and $D_s \to P^+ P^0 \gamma$, $P=\pi, K$, in leading order QCDF, HH$\chi$PT and the soft photon approximation. We work out decay distributions and asymmetries in the standard model and with new physics in the electromagnetic dipole operators. The forward-backward asymmetry is suitable to probe the QCD frameworks, in particular the $s$-channel dependent weak annihilation contributions in QCDF against the markedly different resonance structure in HH$\chi$PT. These studies can be performed with Cabibbo-favored modes $D_s \to \pi^+ \pi^0 \gamma$, $D^+ \to \pi^+ \overline{K}^0 \gamma$ and $D_s \to K^+ \overline{K}^0 \gamma$ with ${\cal{O}}(10^{-4}-10^{-3})$-level branching ratio, which are standard model-like and induced by different hadronic dynamics. Understanding of the latter can therefore be improved in a data-driven way and sharpens the interpretation of standard model tests. Singly Cabibbo-suppressed modes such as $ D^+ \to \pi^+ \pi^0 \gamma$, $D_s \to \pi^+ K^0 \gamma$, $D_s \to K^+ \pi^0 \gamma$ with branching ratios within $\sim 10^{-5}-10^{-4}$ are sensitive to new physics that can be signalled in the forward-backward asymmetry and in the CP-asymmetry of the rate, ideally in the Dalitz region but also in single differential distributions. Results complement those with neutral $D^0 \to PP \gamma$ decays.


title: The Gravitino and the Swampland

abstract: We propose a new swampland conjecture stating that the limit of vanishing gravitino mass corresponds to the massless limit of an infinite tower of states and to the consequent breakdown of the effective field theory. We test our proposal in large classes of models coming from compactification of string theory to four dimensions, where we identify the Kaluza-Klein nature of the tower of states becoming light. We point out a general relation between the gravitino mass and abelian gauge coupling in models with extended supersymmetry, which can survive also in examples with minimal supersymmetry. This allows us to connect our conjecture to other well established swampland conjectures, such as the weak gravity conjecture or the absence of global symmetries in quantum gravity. We discuss phenomenological implications of our conjecture in (quasi-)de Sitter backgrounds and extract a lower bound for the gravitino mass in terms of the Hubble parameter.


title: A Custodial Symmetry for Muon g-2

abstract: We discuss the recent results on the muon anomalous magnetic moment in the context of new physics models with light scalars. We propose a model in which the one-loop contributions to g-2 of a scalar and a pseudoscalar naturally cancel in the massless limit due to the symmetry structure of the model. This model allows to interpolate between two possible interpretations. In the first interpretation, the results provide a strong evidence of the existence of new physics, dominated by the positive contribution of a CP-even scalar. In the second one, supported by the recent lattice result, the data provides a strong upper bound on new physics, specifically in the case of (negative) pseudoscalar contributions. We emphasize that tree-level signatures of the new degrees of freedom of the model are enhanced relative to conventional explanations of the discrepancy. As a result, this model can be tested in the near future with accelerator-based experiments and possibly also at the precision frontier.


title: Radio Line Properties of Axion Dark Matter Conversion in Neutron Stars

abstract: Axions are well-motivated candidates for dark matter. Recently, much interest has focused on the detection of photons produced by the resonant conversion of axion dark matter in neutron star magnetospheres. Various groups have begun to obtain radio data to search for the signal, however, more work is needed to obtain a robust theory prediction for the corresponding radio lines. In this work we derive detailed properties for the signal, obtaining both the line shape and time-dependence. The principal physical effects are from refraction in the plasma as well as from gravitation which together lead to substantial lensing which varies over the pulse period. The time-dependence from the co-rotation of the plasma with the pulsar distorts the frequencies leading to a Doppler broadened signal whose width varies in time. For our predictions, we trace curvilinear rays to the line of sight using the full set of equations from Hamiltonian optics for a dispersive medium in curved spacetime. Thus, for the first time, we describe the detailed shape of the line signal as well as its time dependence, which is more pronounced compared to earlier results. Our prediction of the features of the signal will be essential for this kind of dark matter search.


title: Better Latent Spaces for Better Autoencoders

abstract: Autoencoders as tools behind anomaly searches at the LHC have the structural problem that they only work in one direction, extracting jets with higher complexity but not the other way around. To address this, we derive classifiers from the latent space of (variational) autoencoders, specifically in Gaussian mixture and Dirichlet latent spaces. In particular, the Dirichlet setup solves the problem and improves both the performance and the interpretability of the networks.


title: Capturing the physics of MaNGA galaxies with self-supervised Machine Learning

abstract: As available data sets grow in size and complexity, advanced visualization tools enabling their exploration and analysis become more important. In modern astronomy, integral field spectroscopic galaxy surveys are a clear example of increasing dimensionality and complexity of datasets, which challenge the traditional methods used to extract the physical information they contain. We present the use of a novel self-supervised Machine Learning method to visualize the multi-dimensional information on stellar population and kinematics in the MaNGA survey in a two dimensional plane. Our framework is insensitive to non-physical properties such as the size of integral field unit (IFU) and is therefore able to order galaxies according to their resolved physical properties. Using the extracted representations, we study how galaxies distribute based on their resolved and global physical properties. We show that even when using exclusively information about the internal structure, galaxies naturally cluster into two well-known categories from a purely data driven perspective: rotating main-sequence disks and massive slow rotators, hence confirming distinct assembly channels. Low-mass rotation-dominated quenched galaxies appear only as a third cluster if information about the integrated physical properties is preserved, suggesting a mixture of assembly processes for these galaxies without any particular signature in their internal kinematics that distinguishes them from the two main groups. The framework for data exploration is publicly released with this publication, ready to be used with the MaNGA or other integral field data sets.


title: Explaining $(g-2)_{\mu}$ with Multi-TeV Sleptons

abstract: We present a supersymmetric extension of the Standard Model in which the new physics contributions to the anomalous magnetic moment of the muon can be more than an order of magnitude larger than in the minimal supersymmetric Standard Model. The extended electroweak symmetry breaking sector of the model can consistently accommodate Higgs bosons and Higgsinos with $O(1)$ couplings to muons. We find that sleptons with masses in the multi-TeV range can comfortably explain the recently confirmed discrepancy in the anomalous magnetic moment of the muon. We discuss additional phenomenological aspects of the model, including its effects on tau flavor changing decays.


title: Constraining the AGN duty cycle in the cool-core cluster MS 0735.6+7421 with LOFAR data

abstract: MS 0735.6+7421 is a galaxy cluster which hosts a central radio galaxy with a very steep spectrum, produced by one of the most powerful known jetted active galactic nuclei (AGN). The radio plasma, ejected at nearly light speed from the central AGN, have displaced the intra-cluster medium, leaving two pairs of cavities observable in the X-ray, associated to two different outbursts, and have distributed energy to the surrounding medium. In this work we have performed for the first time a detailed, high-resolution spectral study of the source at radio frequencies and investigated its duty cycle to be compared with previous X-ray estimates. We have used new observations at 144 MHz produced with the LOw Frequency ARray (LOFAR) together with archival data at higher frequencies. At LOFAR frequency, the source presents two large outer radio lobes, wider than at higher frequencies, and a smaller Intermediate lobe located south-west of the core. A new inspection of X-ray data, allowed us to identify an intermediate cavity, associated with that lobe, indicating the presence of a further phase of jet activity. The radio lobes have a steep spectrum even at LOFAR frequencies, reaching $\alpha_{144}^{610}=2.9$ in the outer lobes and $\alpha_{144}^{610}=2.1$ in the Intermediate lobe. Fitting the lobe spectra using a single injection model of particle ageing, we derived a total age of the source between 170 and 106 Myr, in agreement with the buoyancy and sound crossing time-scales derived from X-ray data. We then reconstructed the duty cycle of the source. There were three phases of jet activity, with the AGN being active for most of the time with only brief quiescent phases, ensuring the repeated heating of the central gas. Finally, energetic estimates revealed that a source of additional pressure support must be present to sustain the bubbles against the pressure of the external medium.


title: The evolution of the mass-metallicity relations from the VANDELS survey and the GAEA Semi-Analytic model

abstract: In this work, we study the evolution of the mass-metallicity relations (MZRs) as predicted by the GAlaxy Evolution and Assembly (GAEA) semi-analytic model. We contrast these predictions with recent results from the VANDELS survey, that allows us to expand the accessible redshift range for the stellar MZR up to $z\sim3.5$. We complement our study by considering the evolution of the gas-phase MZR in the same redshift range. We show that GAEA is able to reproduce the observed evolution of the $z<3.5$ gas-phase MZR and $z<0.7$ stellar MZR, while it overpredicts the stellar metallicity at $z\sim3.5$. Furthermore, GAEA also reproduces the so-called fundamental metallicity relation (FMR) between gas-phase metallicity, stellar mass and star formation rate (SFR). In particular, the gas-phase FMR in GAEA is already in place at $z\sim5$ and shows almost no evolution at lower redshift. GAEA predicts the existence of a stellar FMR, that is, however, characterized by a relevant redshift evolution, although its shape follows closely the gas-phase FMR. We also report additional unsolved tensions between model and data: the overall normalization of the predicted MZR agrees with observations only within $\sim$0.1 dex; the largest discrepancies are seen at $z\sim3.5$ where models tend to slightly overpredict observed metallicities; the slope of the predicted MZR at fixed SFR is too steep below a few ${\rm M}_\odot\ {\rm yr}^{-1}$. Finally, we provide model predictions for the evolution of the MZRs at higher redshifts, that would be useful in the context of future surveys, like those that will be performed with JWST.


title: Learning to Reason for Text Generation from Scientific Tables

abstract: In this paper, we introduce SciGen, a new challenge dataset for the task of reasoning-aware data-to-text generation consisting of tables from scientific articles and their corresponding descriptions. Describing scientific tables goes beyond the surface realization of the table content and requires reasoning over table values. The unique properties of SciGen are that (1) tables mostly contain numerical values, and (2) the corresponding descriptions require arithmetic reasoning. SciGen is therefore the first dataset that assesses the arithmetic reasoning capabilities of generation models on complex input structures, i.e., tables from scientific articles. We study the effectiveness of state-of-the-art data-to-text generation models on SciGen and evaluate the results using common metrics as well as human evaluation. Our results and analyses show that (a) while humans like to reason for describing scientific tables, the ability of state-of-the-art models is severely limited on this task, (b) while adding more training data improves the results, it is not the solution for reasoning-aware text generation, and (c) one of the main bottlenecks for this task is the lack of proper automatic evaluation metrics. The data, code, and annotations for human evaluation will be available at https://github.com/UKPLab/SciGen. SciGen opens new avenues for future research in reasoning-aware text generation and evaluation.


title: Statistics of Limit Root Bundles Relevant for Exact Matter Spectra of F-Theory MSSMs

abstract: In the largest, currently known, class of one Quadrillion globally consistent F-theory Standard Models with gauge coupling unification and no chiral exotics, the vector-like spectra are counted by cohomologies of root bundles. In this work, we apply a previously proposed method to identify toric base 3-folds, which are promising to establish F-theory Standard Models with exactly three quark-doublets and no vector-like exotics in this representation. The base spaces in question are obtained from triangulations of 708 polytopes. By studying root bundles on the quark doublet curve $C_{(\mathbf{3},\mathbf{2})_{1/6}}$ and employing well-known results about desingularizations of toric K3-surfaces, we derive a \emph{triangulation independent lower bound} $\check{N}_P^{(3)}$ for the number $N_P^{(3)}$ of root bundles on $C_{(\mathbf{3},\mathbf{2})_{1/6}}$ with exactly three sections. The ratio $\check{N}_P^{(3)} / N_P$, where $N_P$ is the total number of roots on $C_{(\mathbf{3},\mathbf{2})_{1/6}}$, is largest for base spaces associated with triangulations of the 8-th 3-dimensional polytope $\Delta^\circ_8$ in the Kreuzer-Skarke list. For each of these $\mathcal{O}( 10^{15} )$ 3-folds, we expect that many root bundles on $C_{(\mathbf{3},\mathbf{2})_{1/6}}$ are induced from F-theory gauge potentials and that at least every 3000th root on $C_{(\mathbf{3},\mathbf{2})_{1/6}}$ has exactly three global sections and thus no exotic vector-like quark-doublet modes.


title: Associativity of the Morley product of invariant measures in NIP theories

abstract: In light of a gap found by Krupi\'{n}ski, we give a new proof of associativity for the Morley (or "nonforking") product of invariant measures in NIP theories.


title: Shattering Versus Metastability in Spin Glasses

abstract: Our goal in this work is to better understand the relationship between replica symmetry breaking, shattering, and metastability. To this end, we study the static and dynamic behaviour of spherical pure $p$-spin glasses above the replica symmetry breaking temperature $T_{s}$. In this regime, we find that there are at least two distinct temperatures related to non-trivial behaviour. First we prove that there is a regime of temperatures in which the spherical $p$-spin model exhibits a shattering phase. Our results holds in a regime above but near $T_s$. We then find that metastable states exist up to an even higher temperature $T_{BBM}$ as predicted by Barrat--Burioni--M\'ezard which is expected to be higher than the phase boundary for the shattering phase $T_d <T_{BBM}$. We develop this work by first developing a Thouless--Anderson--Palmer decomposition which builds on the work of Subag. We then present a series of questions and conjectures regarding the sharp phase boundaries for shattering and slow mixing.


title: Semiparametric Sensitivity Analysis: Unmeasured Confounding In Observational Studies

abstract: Establishing cause-effect relationships from observational data often relies on untestable assumptions. It is crucial to know whether, and to what extent, the conclusions drawn from non-experimental studies are robust to potential unmeasured confounding. In this paper, we focus on the average causal effect (ACE) as our target of inference. We generalize the sensitivity analysis approach developed by Robins et al. (2000), Franks et al. (2020) and Zhou and Yao (2023. We use semiparametric theory to derive the non-parametric efficient influence function of the ACE, for fixed sensitivity parameters. We use this influence function to construct a one-step bias-corrected estimator of the ACE. Our estimator depends on semiparametric models for the distribution of the observed data; importantly, these models do not impose any restrictions on the values of sensitivity analysis parameters. We establish sufficient conditions ensuring that our estimator has root-n asymptotics. We use our methodology to evaluate the causal effect of smoking during pregnancy on birth weight. We also evaluate the performance of estimation procedure in a simulation study.


title: Text2App: A Framework for Creating Android Apps from Text Descriptions

abstract: We present Text2App -- a framework that allows users to create functional Android applications from natural language specifications. The conventional method of source code generation tries to generate source code directly, which is impractical for creating complex software. We overcome this limitation by transforming natural language into an abstract intermediate formal language representing an application with a substantially smaller number of tokens. The intermediate formal representation is then compiled into target source codes. This abstraction of programming details allows seq2seq networks to learn complex application structures with less overhead. In order to train sequence models, we introduce a data synthesis method grounded in a human survey. We demonstrate that Text2App generalizes well to unseen combination of app components and it is capable of handling noisy natural language instructions. We explore the possibility of creating applications from highly abstract instructions by coupling our system with GPT-3 -- a large pretrained language model. We perform an extensive human evaluation and identify the capabilities and limitations of our system. The source code, a ready-to-run demo notebook, and a demo video are publicly available at \url{https://github.com/text2app/Text2App}.


title: Stein's method of normal approximation: Some recollections and reflections

abstract: This paper is a short exposition of Stein's method of normal approximation from my personal perspective. It focuses mainly on the characterization of the normal distribution and the construction of Stein identities. Through examples, it provides glimpses into the many approaches to constructing Stein identities and the diverse applications of Stein's method to mathematical problems. It also includes anecdotes of historical interest, including how Stein discovered his method and how I found an unpublished proof of his of the Berry-Esseen theorem.


title: Capturing Row and Column Semantics in Transformer Based Question Answering over Tables

abstract: Transformer based architectures are recently used for the task of answering questions over tables. In order to improve the accuracy on this task, specialized pre-training techniques have been developed and applied on millions of open-domain web tables. In this paper, we propose two novel approaches demonstrating that one can achieve superior performance on table QA task without even using any of these specialized pre-training techniques. The first model, called RCI interaction, leverages a transformer based architecture that independently classifies rows and columns to identify relevant cells. While this model yields extremely high accuracy at finding cell values on recent benchmarks, a second model we propose, called RCI representation, provides a significant efficiency advantage for online QA systems over tables by materializing embeddings for existing tables. Experiments on recent benchmarks prove that the proposed methods can effectively locate cell values on tables (up to ~98% Hit@1 accuracy on WikiSQL lookup questions). Also, the interaction model outperforms the state-of-the-art transformer based approaches, pre-trained on very large table corpora (TAPAS and TaBERT), achieving ~3.4% and ~18.86% additional precision improvement on the standard WikiSQL benchmark.


title: Time-Domain Formulation of Electromagnetic Scattering Based on a Polarization Mode Expansion and the Principle of Least Action

abstract: A fresh approach to the full wave analysis of time evolution of the polarization induced in the electromagnetic scattering from dispersive non magnetic particles is presented. It is grounded on the combination of the Hopfield model for the polarization field, the expansion of the polarization field in terms of static longitudinal and transverse modes of the particle, the expansion of the radiation field in terms of transverse wave modes of free space, and the principle of least action. The polarization field is linearly coupled to the electromagnetic field. The losses of the matter are provided through a linear coupling of the polarization field to a bath of harmonic oscillators with a continuous range of natural frequencies. The set of linear ordinary differential integral equations of convolution type of the overall system is reduced by eliminating both the radiation degrees of freedoms and the bath degrees of freedom, and the reduced system of equations is studied. The role played by the radiation field in the coupling between the longitudinal and transverse mode amplitudes of the polarization is described. The principal characteristics of the temporal evolution of the mode amplitudes are found as the particle size varies, including the impulse response. Results are presented for the analytically solvable spherical particle. The proposed approach leads to a general method for the analysis of the temporal evolution of the polarization field induced in dispersive particles of any shape, as well as for the computation of transients and steady states.


title: Membership Inference Attack Susceptibility of Clinical Language Models

abstract: Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In this work, we investigate the risks of training-data leakage through white-box or black-box access to CLMs. We design and employ membership inference attacks to estimate the empirical privacy leaks for model architectures like BERT and GPT2. We show that membership inference attacks on CLMs lead to non-trivial privacy leakages of up to 7%. Our results show that smaller models have lower empirical privacy leakages than larger ones, and masked LMs have lower leakages than auto-regressive LMs. We further show that differentially private CLMs can have improved model utility on clinical domain while ensuring low empirical privacy leakage. Lastly, we also study the effects of group-level membership inference and disease rarity on CLM privacy leakages.


title: Searching for Extragalactic Exoplanetary Systems: the Curious Case of BD+20 2457

abstract: Planets and their host stars carry a long-term memory of their origin in their chemical compositions. Thus, identifying planets formed in different environments improves our understating of planetary formation. Although restricted to detecting exoplanets within the solar vicinity, we might be able to detect planetary systems that formed in small external galaxies and later merged with the Milky Way. In fact, Gaia data have unequivocally shown that the Galaxy underwent several significant minor mergers during its first billion years of formation. The stellar debris of one of these mergers, Gaia-Enceladus (GE), is thought to have built up most of the stellar halo in the solar neighborhood. In this Letter, we investigate the origin of known planet-host stars combining data from the NASA Exoplanet Archive with Gaia EDR3 and large-scale spectroscopic surveys. We adopt a kinematic criterion and identify 42 stars associated with the Milky Way's thick disk and one halo star. The only halo star identified, BD+20 2457, known to harbor two exoplanets, moves on a retrograde and highly eccentric orbit. Its chemical abundance pattern situates the star at the border between the thick disk, the old halo, and accreted populations. Given its orbital parameters and chemical properties, we suggest that BD+20 2457 is likely formed in the protodisk of the Galaxy, but we do not exclude the possibility of the star belonging to the debris of GE. Finally, we estimate a minimum age and mass limit for the star, which has implications for its planetary system and will be tested with future Transiting Exoplanet Survey Satellite observations.


title: Stability tests in time of OAM multiplexing schemes in highly disturbed environments

abstract: We report the results of tests of data transmission and signal stability in time of two different wide-band multiplexing (MUX) schemes, each in a point-to-point configuration, based on electromagnetic waves carrying Orbital Angular Momentum (OAM) in noisy real-world settings. Each radio link transmitted two high definition wide--band analog TV channels in the same frequency band with FM-carrier centered at $2.414$ GHz and $27$ MHz bandwidth, encoded with different OAM modes in the same polarization state, uninterruptedly for $5$ months during the world exhibition ``Globale--Digitale'' at ZKM in Karlsruhe and in other $2$ months time slots taken in the following $4$ years, $24$ hours per day. We show the practical feasibility of the use of stable OAM radio/TV links in the real world for a long time, paving the way for for secure and efficient communication schemes also under electromagnetic jamming conditions.


title: Neural Transfer Learning for Repairing Security Vulnerabilities in C Code

abstract: In this paper, we address the problem of automatic repair of software vulnerabilities with deep learning. The major problem with data-driven vulnerability repair is that the few existing datasets of known confirmed vulnerabilities consist of only a few thousand examples. However, training a deep learning model often requires hundreds of thousands of examples. In this work, we leverage the intuition that the bug fixing task and the vulnerability fixing task are related and that the knowledge learned from bug fixes can be transferred to fixing vulnerabilities. In the machine learning community, this technique is called transfer learning. In this paper, we propose an approach for repairing security vulnerabilities named VRepair which is based on transfer learning. VRepair is first trained on a large bug fix corpus and is then tuned on a vulnerability fix dataset, which is an order of magnitude smaller. In our experiments, we show that a model trained only on a bug fix corpus can already fix some vulnerabilities. Then, we demonstrate that transfer learning improves the ability to repair vulnerable C functions. We also show that the transfer learning model performs better than a model trained with a denoising task and fine-tuned on the vulnerability fixing task. To sum up, this paper shows that transfer learning works well for repairing security vulnerabilities in C compared to learning on a small dataset.


title: An implementation of an efficient direct Fourier transform of polygonal areas and volumes

abstract: Calculations of the Fourier transform of a constant quantity over an area or volume defined by polygons (connected vertices) are often useful in modeling wave scattering, or in fourier-space filtering of real-space vector-based volumes and area projections. If the system is discretized onto a regular array, Fast Fourier techniques can speed up the resulting calculations but if high spatial resolution is required the initial step of discretization can limit performance; at other times the discretized methods result in unacceptable artifacts in the resulting transform. An alternative approach is to calculate the full Fourier integral transform of a polygonal area as a sum over the vertices, which has previously been derived in the literature using the divergence theorem to reduce the problem from a 3-dimensional to line integrals over the perimeter of the polygon surface elements, and converted to a sum over the straight segments of that contour. We demonstrate a software implementation of this algorithm and show that it can provide accurate approximations of the Fourier transform of real shapes with faster convergence than a block-based (voxel) discretization.


title: Learning to Boost the Efficiency of Modern Code Review

abstract: Modern Code Review (MCR) is a standard in all kinds of organizations that develop software. MCR pays for itself through perceived and proven benefits in quality assurance and knowledge transfer. However, the time invest in MCR is generally substantial. The goal of this thesis is to boost the efficiency of MCR by developing AI techniques that can partially replace or assist human reviewers. The envisioned techniques distinguish from existing MCR-related AI models in that we interpret these challenges as graph-learning problems. This should allow us to use state-of-science algorithms from that domain to learn coding and reviewing standards directly from existing projects. The required training data will be mined from online repositories and the experiments will be designed to use standard, quantitative evaluation metrics. This research proposal defines the motivation, research-questions, and solution components for the thesis, and gives an overview of the relevant related work.


title: Toward a concordance teleparallel Cosmology II: Linear perturbation

abstract: Late time cosmic acceleration may be achieved by modifying gravity on large scales. This should also have consequences on the evolution of perturbations. We thus extend our study of exponential infrared $f(T)$ teleparallel gravity to examine the viability of the theory at the linear perturbation level, evaluating the full CMB and matter power spectra. As the theory does not introduce extra free parameters, it fits within the minimal six parameter space of standard $\Lambda$CDM. Using Planck 2018 CMB (TT+TE+EE+lensing) alone, best fits predict those parameters to be almost identical to $\Lambda$CDM, with slightly smaller $\chi^2_{min}$. The resulting $H_0=72.24\pm 0.64$ km/s/Mpc, which "practically" alleviates the tension with local measurements, due to late time phantom behaviour. Inclusion of BAO data however reduces $H_0$, reflecting furthermore systematic deviations from data that are also present in supernova distances and the growth rate of structure (increasing the apparent tension in the latter case). As the theory, unlike other viable $f(T)$ models, does not reduce to $\Lambda$CDM through extra free parameters, those conclusions are generic; applying to any modified gravity or dynamical dark energy with phantom behaviour. With best fit parameters, the present scenario produces a CMB spectrum almost identical to $\Lambda$CDM, with slight deviation at low-multipole $\ell < 30$, where cosmic variance is large. The matter power spectrum is also quite close to $\Lambda$CDM; with percent level scale free modifications affecting modes significantly smaller than the horizon, arising primarily from modified background evolution. More significant deviations appear on larger scales, and may in principle distinguish modified gravity scenarios of the type studied here from dynamical dark energy.


title: Data Shapley Valuation for Efficient Batch Active Learning

abstract: Annotating the right set of data amongst all available data points is a key challenge in many machine learning applications. Batch active learning is a popular approach to address this, in which batches of unlabeled data points are selected for annotation, while an underlying learning algorithm gets subsequently updated. Increasingly larger batches are particularly appealing in settings where data can be annotated in parallel, and model training is computationally expensive. A key challenge here is scale - typical active learning methods rely on diversity techniques, which select a diverse set of data points to annotate, from an unlabeled pool. In this work, we introduce Active Data Shapley (ADS) -- a filtering layer for batch active learning that significantly increases the efficiency of active learning by pre-selecting, using a linear time computation, the highest-value points from an unlabeled dataset. Using the notion of the Shapley value of data, our method estimates the value of unlabeled data points with regards to the prediction task at hand. We show that ADS is particularly effective when the pool of unlabeled data exhibits real-world caveats: noise, heterogeneity, and domain shift. We run experiments demonstrating that when ADS is used to pre-select the highest-ranking portion of an unlabeled dataset, the efficiency of state-of-the-art batch active learning methods increases by an average factor of 6x, while preserving performance effectiveness.


title: Does language help generalization in vision models?

abstract: Vision models trained on multimodal datasets can benefit from the wide availability of large image-caption datasets. A recent model (CLIP) was found to generalize well in zero-shot and transfer learning settings. This could imply that linguistic or "semantic grounding" confers additional generalization abilities to the visual feature space. Here, we systematically evaluate various multimodal architectures and vision-only models in terms of unsupervised clustering, few-shot learning, transfer learning and adversarial robustness. In each setting, multimodal training produced no additional generalization capability compared to standard supervised visual training. We conclude that work is still required for semantic grounding to help improve vision models.


title: High Performance Convolution Using Sparsity and Patterns for Inference in Deep Convolutional Neural Networks

abstract: Deploying deep Convolutional Neural Networks (CNNs) is impacted by their memory footprint and speed requirements, which mainly come from convolution. Widely-used convolution algorithms, im2col and MEC, produce a lowered matrix from an activation map by redundantly storing the map's elements included at horizontal and/or vertical kernel overlappings without considering the sparsity of the map. Using the sparsity of the map, this paper proposes two new convolution algorithms dubbed Compressed Pattern Overlap (CPO) and Compressed Pattern Sets (CPS) that simultaneously decrease the memory footprint and increase the inference speed while preserving the accuracy. CPO recognizes non-zero elements (NZEs) at horizontal and vertical overlappings in the activation maps. CPS further improves the memory savings of CPO by compressing the index positions of neighboring NZEs. In both algorithms, channels/regions of the activation maps with all zeros are skipped. Then, CPO/CPS performs convolution via Sparse Matrix-Vector Multiplication (SpMv) done on their sparse representations. Experimental results conducted on CPUs show that average per-layer time savings reach up to 63% and Compression Ratio (CR) up to 26x with respect to im2col. In some layers, our average per layer CPO/CPS time savings are better by 28% and CR is better by 9.2x than the parallel implementation of MEC. For a given CNN's inference, we offline select for each convolution layer the best convolutional algorithm in terms of time between either CPO or CPS and im2col. Our algorithms were selected up to 56% of the non-pointwise convolutional layers. Our offline selections yield CNN inference time savings up to 9% and CR up to 10x.


title: Surface Form Competition: Why the Highest Probability Answer Isn't Always Right

abstract: Large language models have shown promising results in zero-shot settings (Brown et al.,2020; Radford et al., 2019). For example, they can perform multiple choice tasks simply by conditioning on a question and selecting the answer with the highest probability. However, ranking by string probability can be problematic due to surface form competition-wherein different surface forms compete for probability mass, even if they represent the same underlying concept, e.g. "computer" and "PC." Since probability mass is finite, this lowers the probability of the correct answer, due to competition from other strings that are valid answers (but not one of the multiple choice options). We introduce Domain Conditional Pointwise Mutual Information, an alternative scoring function that directly compensates for surface form competition by simply reweighing each option according to a term that is proportional to its a priori likelihood within the context of the specific zero-shot task. It achieves consistent gains in zero-shot performance over both calibrated (Zhao et al., 2021) and uncalibrated scoring functions on all GPT-2 and GPT-3 models over a variety of multiple choice datasets.


title: LiNiO$_2$ as a high-entropy charge- and bond-disproportionated glass

abstract: Understanding microscopic properties of LiNiO$_2$, a Li-ion battery cathode material with extraordinarily high reversible capacity, has remained a challenge for decades. Based on extensive electronic structure calculations, which reveal a large number of nearly degenerate phases involving local Jahn-Teller effect as well as bond and oxygen-based charge disproportionation, we propose that LiNiO$_2$ exists in a high-entropy charge-glass like state at and below ambient temperatures. Recognizing the glassy nature of LiNiO$_2$ does not only explain its key experimental features, but also opens a new path in designing entropy-stabilized battery cathodes with superb capacities.


title: A light echo from the warm outflow in the ULIRG F01004-2237 following a major flare in its optical continuum emission

abstract: Emission-line variability studies have the potential to provide key information about the structures of the near-nuclear outflow regions of AGN. Here we present a VLT/Xshooter spectrum of the nucleus of the ULIRG F01004-2237 that was taken in August 2018, about 8 yr after a major flare in its integrated optical emission. Compared with our WHT/ISIS spectrum from September 2015, the broad, red wings of the emission lines most closely associated with the flaring event, including HeII(4686), NIII(4100,4640) and HeI(5876), have substantially declined in flux. In contrast, the broad, blue wings that dominate the [OIII], [NeIII], [NeV] and [OI] forbidden lines have increased in flux by a factor 1.4 - 4.4 (depending on the line). Moreover, the [FeVII](6087) line is detected in the new spectrum for the first time. We interpret these results in terms of a light echo from the outflowing warm gas: the direct emission from the flaring event is continuing to fade, but due to light travel time effects we are only now observing the impact of the flare on the emission from the extended outflow region. Unless the outflow is confined to a small range of angles close to our line of sight, these observations imply that the outflow must be relatively compact (r<50 pc). In terms of the nature of the flare event, we speculate that the properties of the F01004-2237 flare may be the result of a tidal disruption event (TDE) occurring in an object with pre-existing AGN activity.


title: Li$_x$CoO$_2$ phase stability studied by machine learning-enabled scale bridging between electronic structure, statistical mechanics and phase field theories

abstract: Li$_xTM$O$_2$ (TM={Ni, Co, Mn}) are promising cathodes for Li-ion batteries, whose electrochemical cycling performance is strongly governed by crystal structure and phase stability as a function of Li content at the atomistic scale. Here, we use Li$_x$CoO$_2$ (LCO) as a model system to benchmark a scale-bridging framework that combines density functional theory (DFT) calculations at the atomistic scale with phase field modeling at the continuum scale to understand the impact of phase stability on microstructure evolution. This scale bridging is accomplished by incorporating traditional statistical mechanics methods with integrable deep neural networks, which allows formation energies for specific atomic configurations to be coarse-grained and incorporated in a neural network description of the free energy of the material. The resulting realistic free energy functions enable atomistically informed phase-field simulations. These computational results allow us to make connections to experimental work on LCO cathode degradation as a function of temperature, morphology and particle size.


title: Multitask Learning for VVC Quality Enhancement and Super-Resolution

abstract: The latest video coding standard, called versatile video coding (VVC), includes several novel and refined coding tools at different levels of the coding chain. These tools bring significant coding gains with respect to the previous standard, high efficiency video coding (HEVC). However, the encoder may still introduce visible coding artifacts, mainly caused by coding decisions applied to adjust the bitrate to the available bandwidth. Hence, pre and post-processing techniques are generally added to the coding pipeline to improve the quality of the decoded video. These methods have recently shown outstanding results compared to traditional approaches, thanks to the recent advances in deep learning. Generally, multiple neural networks are trained independently to perform different tasks, thus omitting to benefit from the redundancy that exists between the models. In this paper, we investigate a learning-based solution as a post-processing step to enhance the decoded VVC video quality. Our method relies on multitask learning to perform both quality enhancement and super-resolution using a single shared network optimized for multiple degradation levels. The proposed solution enables a good performance in both mitigating coding artifacts and super-resolution with fewer network parameters compared to traditional specialized architectures.


title: On the Importance of Effectively Adapting Pretrained Language Models for Active Learning

abstract: Recent Active Learning (AL) approaches in Natural Language Processing (NLP) proposed using off-the-shelf pretrained language models (LMs). In this paper, we argue that these LMs are not adapted effectively to the downstream task during AL and we explore ways to address this issue. We suggest to first adapt the pretrained LM to the target task by continuing training with all the available unlabeled data and then use it for AL. We also propose a simple yet effective fine-tuning method to ensure that the adapted LM is properly trained in both low and high resource scenarios during AL. Our experiments demonstrate that our approach provides substantial data efficiency improvements compared to the standard fine-tuning approach, suggesting that a poor training strategy can be catastrophic for AL.


title: Evolution of large-amplitude Alfv\'en waves and generation of switchbacks in the expanding solar wind

abstract: Motivated by recent Parker Solar Probe (PSP) observations of "switchbacks" (abrupt, large-amplitude reversals in the radial magnetic field, which exhibit Alfv\'enic correlations) we examine the dynamics of large-amplitude Alfv\'en waves in the expanding solar wind. We develop an analytic model which makes several predictions: switchbacks should preferentially occur in regions where the solar wind plasma has undergone a greater expansion, the switchback fraction at radii comparable to PSP should be an increasing function of radius, and switchbacks should have their gradients preferentially perpendicular to the mean magnetic field direction. The expansion of the plasma generates small compressive components as part of the wave's nonlinear evolution: these are maximized when the normalized fluctuation amplitude is comparable to $\sin\theta$, where $\theta$ is the angle between the propagation direction and the mean magnetic field. These compressive components steepen the primary Alfv\'enic waveform, keeping the solution in a state of nearly constant magnetic field strength as its normalized amplitude $\delta B/B$ grows due to expansion. The small fluctuations in the magnetic-field-strength are minimized at a particular $\theta$-dependent value of $\beta$, usually of order unity, and the density and magnetic-field-strength fluctuations can be correlated or anticorrelated depending on $\beta$ and $\theta$. Example solutions of our dynamical equation are presented; some do indeed form magnetic-field reversals. Our predictions appear to match some previously unexplained phenomena in observations and numerical simulations, providing evidence that the observed switchbacks result from the nonlinear evolution of the initially small-amplitude Alfv\'en waves already known to be present at the coronal base.


title: libEnsemble: A Library to Coordinate the Concurrent Evaluation of Dynamic Ensembles of Calculations

abstract: Almost all applications stop scaling at some point; those that don't are seldom performant when considering time to solution on anything but aspirational/unicorn resources. Recognizing these tradeoffs as well as greater user functionality in a near-term exascale computing era, we present libEnsemble, a library aimed at particular scalability- and capability-stretching uses. libEnsemble enables running concurrent instances of an application in dynamically allocated ensembles through an extensible Python library. We highlight the structure, execution, and capabilities of the library on leading pre-exascale environments as well as advanced capabilities for exascale environments and beyond.


title: Random and Adversarial Bit Error Robustness: Energy-Efficient and Secure DNN Accelerators

abstract: Deep neural network (DNN) accelerators received considerable attention in recent years due to the potential to save energy compared to mainstream hardware. Low-voltage operation of DNN accelerators allows to further reduce energy consumption, however, causes bit-level failures in the memory storing the quantized weights. Furthermore, DNN accelerators are vulnerable to adversarial attacks on voltage controllers or individual bits. In this paper, we show that a combination of robust fixed-point quantization, weight clipping, as well as random bit error training (RandBET) or adversarial bit error training (AdvBET) improves robustness against random or adversarial bit errors in quantized DNN weights significantly. This leads not only to high energy savings for low-voltage operation as well as low-precision quantization, but also improves security of DNN accelerators. In contrast to related work, our approach generalizes across operating voltages and accelerators and does not require hardware changes. Moreover, we present a novel adversarial bit error attack and are able to obtain robustness against both targeted and untargeted bit-level attacks. Without losing more than 0.8%/2% in test accuracy, we can reduce energy consumption on CIFAR10 by 20%/30% for 8/4-bit quantization. Allowing up to 320 adversarial bit errors, we reduce test error from above 90% (chance level) to 26.22%.


title: On the Robustness to Misspecification of $\alpha$-Posteriors and Their Variational Approximations

abstract: $\alpha$-posteriors and their variational approximations distort standard posterior inference by downweighting the likelihood and introducing variational approximation errors. We show that such distortions, if tuned appropriately, reduce the Kullback-Leibler (KL) divergence from the true, but perhaps infeasible, posterior distribution when there is potential parametric model misspecification. To make this point, we derive a Bernstein-von Mises theorem showing convergence in total variation distance of $\alpha$-posteriors and their variational approximations to limiting Gaussian distributions. We use these distributions to evaluate the KL divergence between true and reported posteriors. We show this divergence is minimized by choosing $\alpha$ strictly smaller than one, assuming there is a vanishingly small probability of model misspecification. The optimized value becomes smaller as the the misspecification becomes more severe. The optimized KL divergence increases logarithmically in the degree of misspecification and not linearly as with the usual posterior.


title: Permeation Instabilities in Active, Polar Gels

abstract: We present a theory of active, permeating, polar gels, based on a two-fluid model. An active relative force between the gel components creates a steady-state current. We analyze its stability, while considering two polar coupling terms to the relative current: a permeation-deformation term, which describes network deformation by the solvent flow, and a permeation-alignment term, which describes the alignment of the polarization field by the network deformation and flow. Novel instability mechanisms emerge at finite wave vectors, suggesting the formation of periodic domains and mesophases. Our results can be used to determine the physical conditions required for various types of multicellular migration across tissues.


title: The Phase Diagram of Carbon Dioxide from Correlation Functions and a Many-body Potential

abstract: The phase stability and equilibria of carbon dioxide is investigated from 125 -- 325K and 1 -- 10,000 atm using extensive molecular dynamics (MD) simulations and the Two-Phase Thermodynamics (2PT) method. We devise a direct approach for calculating phase diagrams in general, by considering the separate chemical potentials of the isolated phase at specific points on the P-T diagram. The unique ability of 2PT to accurately and efficiently approximate the entropy and Gibbs energy of liquids thus allows for assignment of phase boundaries from relatively short ($\mathrm{\sim}$ 100ps) MD simulations. We validate our approach by calculating the critical properties of the flexible Elementary Physical Model 2 (FEPM2), showing good agreement with previous results. We show, however, that the incorrect description of the short-range Pauli force and the lack of molecular charge polarization leads to deviations from experiments at high pressures. We thus develop a many-body, fluctuating charge model for CO${}_{2}$, termed CO${}_{2}$-Fq, from high level quantum mechanics (QM) calculations, that accurately captures the condensed phase vibrational properties of the solid (including the Fermi resonance at 1378 cm${}^{-1}$) as well as the diffusional properties of the liquid, leading to overall excellent agreement with experiments over the entire phase diagram. This work provides an efficient computational approach for determining phase diagrams of arbitrary systems and underscore the critical role of QM charge reorganization physics in molecular phase stability.

categories: cond-mat.mtrl-sci cond-mat.mes-hall cond-mat.soft cond-mat.stat-mech


title: Polynomial Hermite-Pad\'e $m$-system for meromorphic functions on a compact Riemann surface

abstract: For an arbitrary tuple of $m+1$ germs of analytic functions at a fixed point, we introduce the so-called polynomial Hermite-Pad\'e $m$-system (of order $n$, $n\in\mathbb N$), which consists of $m$ tuples of polynomials; these tuples, which are indexed by a natural number $k\in[1,\dots,m]$, are called the $k$th polynomials of the Hermite-Pad\'e $m$-system. We study the weak asymptotics of the polynomials of the Hermite-Pad\'e $m$-system constructed at the point $\infty$ from the tuple of germs $[1, f_{1,\infty},\dotsc$, $f_{m,\infty}]$ of the functions $1, f_1,\dots,f_m$ that are meromorphic on some $(m+1)$-sheeted branched covering $\pi\colon \mathfrak R\to\widehat{\mathbb C}$ of the Riemann sphere $\widehat{\mathbb C}$ of a compact Riemann surface $\mathfrak R$. In particular, under some additional condition on $\pi$, we find the limit distribution of the zeros and the asymptotics of the ratios of the $k$th polynomials for all $k\in[1,\dots, m]$. It turns out that in the case, where $f_j = f^j$ for some meromorphic function $f$ on $\mathfrak R$, the ratios of some $k$th polynomials of such Hermite-Pad\'e $m$-system converge to the sum of the values of the function $f$ on the first $k$ sheets of the Nuttall partition of the Riemann surface $\mathfrak R$ into sheets.


title: CTU Depth Decision Algorithms for HEVC: A Survey

abstract: High-Efficiency Video Coding (HEVC) surpasses its predecessors in encoding efficiency by introducing new coding tools at the cost of an increased encoding time-complexity. The Coding Tree Unit (CTU) is the main building block used in HEVC. In the HEVC standard, frames are divided into CTUs with the predetermined size of up to 64x64 pixels. Each CTU is then divided recursively into a number of equally sized square areas, known as Coding Units (CUs). Although this diversity of frame partitioning increases encoding efficiency, it also causes an increase in the time complexity due to the increased number of ways to find the optimal partitioning. To address this complexity, numerous algorithms have been proposed to eliminate unnecessary searches during partitioning CTUs by exploiting the correlation in the video. In this paper, existing CTU depth decision algorithms for HEVC are surveyed. These algorithms are categorized into two groups, namely statistics and machine learning approaches. Statistics approaches are further subdivided into neighboring and inherent approaches. Neighboring approaches exploit the similarity between adjacent CTUs to limit the depth range of the current CTU, while inherent approaches use only the available information within the current CTU. Machine learning approaches try to extract and exploit similarities implicitly. Traditional methods like support vector machines or random forests use manually selected features, while recently proposed deep learning methods extract features during training. Finally, this paper discusses extending these methods to more recent video coding formats such as Versatile Video Coding (VVC) and AOMedia Video 1(AV1).


title: Controller Synthesis for Multi-Agent Systems with Intermittent Communication and Metric Temporal Logic Specifications

abstract: This paper investigates the controller synthesis problem for a multi-agent system (MAS) with intermittent communication. We adopt a relay-explorer scheme, where a mobile relay agent with absolute position sensors switches among a set of explorers with relative position sensors to provide intermittent state information. We model the MAS as a switched system where the explorers' dynamics can be either fully-actuated or underactuated. The objective of the explorers is to reach approximate consensus to a predetermined goal region. To guarantee the stability of the switched system and the approximate consensus of the explorers, we derive maximum dwell-time conditions to constrain the length of time each explorer goes without state feedback (from the relay agent). Furthermore, the relay agent needs to satisfy practical constraints such as charging its battery and staying in specific regions of interest. Both the maximum dwell-time conditions and these practical constraints can be expressed by metric temporal logic (MTL) specifications. We iteratively compute the optimal control inputs for the relay agent to satisfy the MTL specifications, while guaranteeing stability and approximate consensus of the explorers. We implement the proposed method on a case study with the CoppeliaSim robot simulator.


title: Experimental review of distance sensors for indoor mapping

abstract: In this paper, some of the distance sensor, including Kinect, Hokuyo UTM-30LX, and RPLidar were observed experimentally. Strengths and weaknesses of each sensor were reviewed so that it can be used as a reference for selecting a suitable sensor for any particular application. A software application has been developed in C programming language as a platform for gathering information for all tested sensors. According to the experiment results, it showed that Hokuyo UTM-30LX results in random normally distributed error on measuring distance with average error 21.94 mm and variance 32.11. On the other hand, error measurement resulted by Kinect and RPLidar strongly depended on measured distance of the object from the sensors, while measurement error resulted by Kinect had a negative correlation with the measured distance and the error resulted by RPLidar sensor had a positive correlation with the measured distance. The performance of these three sensors for detecting a transparent object shows that the Kinect sensors can detect the transparent object on its effective range measurement, Hokuyo UTM-30LX can detect the transparent object in the distance more than equal to 200 mm, and the RPLidar sensor cannot detect the transparent object at all tested distance. Lastly, the experiment shows that the Hokuyo UTM-30LX has the fastest processing time significantly, and the RPLidar has the slowest processing time significantly, while the processing time of Kinect sensor was in between. These processing times were not significantly affected by various tested distance measurement.


title: Automatic Guided Vehicles System and Its Coordination Control for Containers Terminal Logistics Application

abstract: Automatic Guided Vehicle (AGV) has been widely applied in automatic logistics system because it provides flexibility and efficiency. This paper addresses review and design of multi AGVs system (MAGS) and its coordination control to be implemented at containers terminal logistics systems. It focuses on design of electric AGV and supervisory control to coordinate multi AGVs. Firstly, related previous works by other researchers are reviewed including containers terminal system, application of AGV in logistics systems and multi mobile robots control systems. Secondly, application of AGV system in containers terminal is proposed including AGV design specification, AGV control method, multi AGV system supervisory control method, and containers terminal port model. Conclusions have been obtained as follows: an electric AGV may be developed using electric motors with total power between 700-900KW and speed of 228 rpm; a MAGVS is proposed based on free ranging navigation system using GPS, digital compass and rotary encoder sensors; path planning, coordination and traffic management control is conducted by the supervisory controller based on priority based coordinative (PBC) control algorithm; a model of MAGVS for containers terminal logistics system can be developed using the navigation system and PBC control algorithm.


title: A New Approach to Axial Vector Gauge Theories

abstract: In an earlier paper it has been shown that the ultra violet divergence structure of anomalous U(1) axial vector gauge model in the stochastic quantization scheme is different from that in the conventional quantum field theory. Also it has been shown that the model is expected to be renormalizable. Based on the operator formalism of the stochastic quantization, a new approach to anomalous U(1) axial vector gauge model is proposed. The operator formalism provides a convenient framework for analysis of ultra violet divergences, but the computations in a realistic model become complicated. In this paper a new approach to do computations in the model is formulated directly in four dimensions. The suggestions put forward here will lead to simplification in the study of applications of the axial vector gauge theory, as well as those of other similar models


title: A survey on Dependable Digital Systems using FPGAs: Current Methods and Challenges

abstract: Fault tolerance is increasingly being use to design Dependable Digital Systems (DDS), which refers to the capability of a system to keep performing its intended functions in existence of faults. DDS are typically used in Safety-critical system (SCS) such as medical (I&C) devices, Nuclear power Plants (I&C) devices and Aerospace (I&C) systems, the failure in these systems can cause harm to environment, death, injury to people. Different fault tolerance techniques were developed to overcome these issues and that has led to increase the reliability and dependability of applications on Field Programmable Gate Arrays (FPGAs). In this paper, multiple related works are present dealing with different types of faults and fault tolerance methods in FPGA based systems. Furthermore, a comparison between the evaluation metrics of previous works of Fault Tolerant (FT) techniques like hardware redundancy overhead, time delay, reliability, and performance are also present.


title: Utilization of the simulated flue gas on the cultivation of Chlorella protothecoides

abstract: In recent years, fossil-based fuels have been used to supply the energy needs of the world. Fossil-based fuels induce accumulation of the atmospheric CO2 which causes global warming. One of CO2 source is flue gas emission from the power plant. The microalgae have been considered excellent biological materials for reduction CO2 with ability to photosynthesis. In this study, air, 10% CO2, 15% CO2 and simulated flue gas (containing 15% CO2) feed were used to observe effect CO2 concentration and flue gas on cell growth and lipid content of Chlorella protothecoides. The highest dry cell weight (1,5 g/L) and lipid content (45%) values were obtained with 15% CO2 feed while the highest growth rate (1,10), biomass productivity (0,125 g/L/day), and lipid weight (0,63 g/g) were observed in 10% CO2 feed. Cultures fed with flue gas did not inhibited C. protothecoides growth and showed similar results with those fed with 15% CO2 gas in terms of growth rate, dry cell weight, biomass productivity and lipid content. These results showed that C. protothecoides has great potential for reducing CO2 emission from flue gas.


title: Demystifying BERT: Implications for Accelerator Design

abstract: Transfer learning in natural language processing (NLP), as realized using models like BERT (Bi-directional Encoder Representation from Transformer), has significantly improved language representation with models that can tackle challenging language problems. Consequently, these applications are driving the requirements of future systems. Thus, we focus on BERT, one of the most popular NLP transfer learning algorithms, to identify how its algorithmic behavior can guide future accelerator design. To this end, we carefully profile BERT training and identify key algorithmic behaviors which are worthy of attention in accelerator design. We observe that while computations which manifest as matrix multiplication dominate BERT's overall runtime, as in many convolutional neural networks, memory-intensive computations also feature prominently. We characterize these computations, which have received little attention so far. Further, we also identify heterogeneity in compute-intensive BERT computations and discuss software and possible hardware mechanisms to further optimize these computations. Finally, we discuss implications of these behaviors as networks get larger and use distributed training environments, and how techniques such as micro-batching and mixed-precision training scale. Overall, our analysis identifies holistic solutions to optimize systems for BERT-like models.


title: Self-Supervised Graph Neural Networks for Improved Electroencephalographic Seizure Analysis

abstract: Automated seizure detection and classification from electroencephalography (EEG) can greatly improve seizure diagnosis and treatment. However, several modeling challenges remain unaddressed in prior automated seizure detection and classification studies: (1) representing non-Euclidean data structure in EEGs, (2) accurately classifying rare seizure types, and (3) lacking a quantitative interpretability approach to measure model ability to localize seizures. In this study, we address these challenges by (1) representing the spatiotemporal dependencies in EEGs using a graph neural network (GNN) and proposing two EEG graph structures that capture the electrode geometry or dynamic brain connectivity, (2) proposing a self-supervised pre-training method that predicts preprocessed signals for the next time period to further improve model performance, particularly on rare seizure types, and (3) proposing a quantitative model interpretability approach to assess a model's ability to localize seizures within EEGs. When evaluating our approach on seizure detection and classification on a large public dataset, we find that our GNN with self-supervised pre-training achieves 0.875 Area Under the Receiver Operating Characteristic Curve on seizure detection and 0.749 weighted F1-score on seizure classification, outperforming previous methods for both seizure detection and classification. Moreover, our self-supervised pre-training strategy significantly improves classification of rare seizure types. Furthermore, quantitative interpretability analysis shows that our GNN with self-supervised pre-training precisely localizes 25.4% focal seizures, a 21.9 point improvement over existing CNNs. Finally, by superimposing the identified seizure locations on both raw EEG signals and EEG graphs, our approach could provide clinicians with an intuitive visualization of localized seizure regions.


title: Identification of mental fatigue in language comprehension tasks based on EEG and deep learning

abstract: Mental fatigue increases the risk of operator error in language comprehension tasks. In order to prevent operator performance degradation, we used EEG signals to assess the mental fatigue of operators in human-computer systems. This study presents an experimental design for fatigue detection in language comprehension tasks. We obtained EEG signals from a 14-channel wireless EEG detector in 15 healthy participants. Each participant was given a cognitive test of a language comprehension task, in the form of multiple choice questions, in which pronoun references were selected between nominal and surrogate sentences. In this paper, the 2400 EEG fragments collected are divided into three data sets according to different utilization rates, namely 1200s data set with 50% utilization rate, 1500s data set with 62.5% utilization rate, and 1800s data set with 75% utilization rate. In the aspect of feature extraction, different EEG features were extracted, including time domain features, frequency domain features and entropy features, and the effects of different features and feature combinations on classification accuracy were explored. In terms of classification, we introduced the Convolutional Neural Network (CNN) method as the preferred method, It was compared with Least Squares Support Vector Machines(LSSVM),Support Vector Machines(SVM),Logistic Regression (LR), Random Forest(RF), Naive Bayes (NB), K-Nearest Neighbor (KNN) and Decision Tree(DT).According to the results, the classification accuracy of convolutional neural network (CNN) is higher than that of other classification methods. The classification results show that the classification accuracy of 1200S dataset is higher than the other two datasets. The combination of Frequency and entropy feature and CNN has the highest classification accuracy, which is 85.34%.


title: Unsupervised Hyperspectral Stimulated Raman Microscopy Image Enhancement: Denoising and Segmentation via One-Shot Deep Learning

abstract: Hyperspectral stimulated Raman scattering (SRS) microscopy is a label-free technique for biomedical and mineralogical imaging which can suffer from low signal to noise ratios. Here we demonstrate the use of an unsupervised deep learning neural network for rapid and automatic denoising of SRS images: UHRED (Unsupervised Hyperspectral Resolution Enhancement and Denoising). UHRED is capable of one-shot learning; only one hyperspectral image is needed, with no requirements for training on previously labelled datasets or images. Furthermore, by applying a k-means clustering algorithm to the processed data, we demonstrate automatic, unsupervised image segmentation, yielding, without prior knowledge of the sample, intuitive chemical species maps, as shown here for a lithium ore sample.


title: A short note on the accuracy of the discontinuous Galerkin method with reentrant faces

abstract: We study the convergence of the discontinuous Galerkin (DG) method applied to the advection-reaction equation on meshes with reentrant faces. On such meshes, the upwind numerical flux is not smooth, and so the numerical integration of the resulting face terms can only be expected to be first-order accurate. Despite this inexact integration, we prove that the DG method converges with order $\mathcal{O}(h^{p+1/2})$, which is the same rate as in the case of exact integration. Consequently, specialized quadrature rules that accurately integrate the non-smooth numerical fluxes are not required for high-order accuracy. These results are numerically corroborated on examples of linear advection and discrete ordinates transport equations.


title: An Analysis of a BERT Deep Learning Strategy on a Technology Assisted Review Task

abstract: Document screening is a central task within Evidenced Based Medicine, which is a clinical discipline that supplements scientific proof to back medical decisions. Given the recent advances in DL (Deep Learning) methods applied to Information Retrieval tasks, I propose a DL document classification approach with BERT or PubMedBERT embeddings and a DL similarity search path using SBERT embeddings to reduce physicians' tasks of screening and classifying immense amounts of documents to answer clinical queries. I test and evaluate the retrieval effectiveness of my DL strategy on the 2017 and 2018 CLEF eHealth collections. I find that the proposed DL strategy works, I compare it to the recently successful BM25 plus RM3 model, and conclude that the suggested method accomplishes advanced retrieval performance in the initial ranking of the articles with the aforementioned datasets, for the CLEF eHealth Technologically Assisted Reviews in Empirical Medicine Task.


title: PT-symmetry enabled spin circular photogalvanic effect in antiferromagnetic insulators

abstract: The short timescale spin dynamics in antiferromagnets is an attractive feature from the standpoint of ultrafast spintronics. Yet generating highly polarized spin currents at room temperature remains a fundamental challenge for antiferromagnets. We propose a spin circular photogalvanic effect (spin-CPGE), in which circularly polarized light can produce a spin current without net charge current at room temperature, through an "injection-current-like" mechanism in parity-time(PT)-symmetric antiferromagnetic (AFM) insulators. We demonstrate this effect by first-principles simulations of bilayer CrI3 and room-temperature AFM hematite. Our calculations show that the spin-CPGE is significant, and the magnitude of spin photo-current is comparable with the widely observed charge photocurrent in ferroelectric materials. Interestingly, this spin photocurrent is not sensitive to spin-orbit interactions, which were regarded as fundamental mechanisms for generating spin current. Given the fast response of light-matter interactions, large energy scale, and insensitivity to spin-orbit interactions, our work gives hope to realizing a fast-dynamic and temperature-robust pure spin current in a wide range of PT-symmetric AFM materials, including weak-relativistic magnetic insulators and topological axion insulators.


title: Paris Agreement requires substantial, broad, and sustained engagements beyond COVID-19 public stimulus packages

abstract: It has been claimed that COVID-19 public stimulus packages could be sufficient to meet the short-term energy investment needs to leverage a shift toward a pathway consistent with the 1.5 degrees C target of the Paris Agreement. Here we provide complementary perspectives to reiterate that substantial, broad, and sustained engagements beyond stimulus packages will be needed for achieving the Paris Agreement long-term targets. Low-carbon investments will need to scale up and persist over the next several decades following short-term stimulus packages. The required total energy investments in the real world can be larger than the currently available estimates from Integrated Assessment Models (IAMs). Existing databases from IAMs are not sufficient for analyzing the effect of public spending on emission reduction. To inform what role COVID-19 stimulus packages and public investments may play for reaching the Paris Agreement targets, explicit modelling of such policies is required.


title: Commutator formulas for gradient Ricci shrinker and their application to linear stability

abstract: In this paper we have found some commutator formulas between $div_{f},\Delta_{f,L},div_{f}^\dagger,\Delta_{f}$ on closed orientable $GRS^+$ metrics (Gradient Ricci Shrinker), then with them we have generalized a Theorem of Cao and Zhu about necessary condition for linear stability of a $GRS^+$.


title: A Causal Mediation Model for Longitudinal Mediators and Survival Outcomes with an Application to Animal Behavior

abstract: In animal behavior studies, a common goal is to investigate the causal pathways between an exposure and outcome, and a mediator that lies in between. Causal mediation analysis provides a principled approach for such studies. Although many applications involve longitudinal data, the existing causal mediation models are not directly applicable to settings where the mediators are measured on irregular time grids. In this paper, we propose a causal mediation model that accommodates longitudinal mediators on arbitrary time grids and survival outcomes simultaneously. We take a functional data analysis perspective and view longitudinal mediators as realizations of underlying smooth stochastic processes. We define causal estimands of direct and indirect effects accordingly and provide corresponding identification assumptions. We employ a functional principal component analysis approach to estimate the mediator process, and propose a Cox hazard model for the survival outcome that flexibly adjusts the mediator process. We then derive a g-computation formula to express the causal estimands using the model coefficients. The proposed method is applied to a longitudinal data set from the Amboseli Baboon Research Project to investigate the causal relationships between early adversity, adult physiological stress responses, and survival among wild female baboons. We find that adversity experienced in early life has a significant direct effect on females' life expectancy and survival probability, but find little evidence that these effects were mediated by markers of the stress response in adulthood. We further developed a sensitivity analysis method to assess the impact of potential violation to the key assumption of sequential ignorability.


title: Slowdown and Heating of Interstellar Neutral Helium by Elastic Collisions Beyond the Heliopause

abstract: Direct sampling of interstellar neutral (ISN) atoms close to the Sun enables studies of the very local interstellar medium (VLISM) around the heliosphere. The primary population of ISN helium atoms has, until now, been assumed to reflect the pristine VLISM conditions at the heliopause. Consequently, the atoms observed at 1 au by the Interstellar Boundary Explorer (IBEX) were used to determine the VLISM temperature and velocity relative to the Sun, without accounting for elastic collisions with other species outside the heliopause. Here, we evaluate the effect of these collisions on the primary ISN helium population. We follow trajectories of helium atoms and track their collisions with slowed plasma and interstellar hydrogen atoms ahead of the heliopause. Atoms typically collide a few times in the outer heliosheath, and only ~1.5% of the atoms are not scattered at all. We use calculated differential cross sections to randomly choose scattering angles in these collisions. We estimate that the resulting primary ISN helium atoms at the heliopause are slowed down by ~0.45 km/s and heated by ~1100 K compared to the pristine VLISM. The resulting velocity distribution is asymmetric and shows an extended tail in the antisunward direction. Accounting for this change in the parameters derived from IBEX observations gives the Sun's relative speed of 25.85 km/s and temperature of 6400 K in the pristine VLISM. Finally, this paper serves as a source of the differential cross sections for elastic collisions with helium atoms.