title: A Lyman-alpha transit left undetected: the environment and atmospheric behavior of K2-25b

abstract: K2-25b is a Neptune-sized exoplanet (3.45 Earth radii) that orbits its M4.5 host with a period of 3.48 days. Due to its membership in the Hyades Cluster, the system has a known age (727 +/- 75 Myr). K2-25b's youth and its similarities with Gl 436b suggested that K2-25b could be undergoing strong atmospheric escape. We observed two transits of K2-25b at Lyman-alpha using HST/STIS in order to search for escaping neutral hydrogen. We were unable to detect an exospheric signature, but placed an upper limit of (R_p/R_s) < 0.56 at 95% confidence by fitting the light curve of the Lyman-alpha red-wing, or < 1.20 in the blue-wing. We reconstructed the intrinsic Lyman-alpha profile of K2-25 to determine its Lyman-alpha flux, and analyzed XMM-Newton observations to determined its X-ray flux. Based on the total X-ray and extreme ultraviolet irradiation of the planet (8763 +/- 1049 erg/s/cm^2), we estimated the maximum energy-limited mass loss rate of K2-25b to be 10.6 x 10^10 g/s (0.56 Earth masses per 1 Gyr), five times larger than the similarly estimated mass loss rate of Gl 436b (2.2 x 10^10 g/s). The photoionization time is about 3 hours, significantly shorter than Gl 436b's 14 hours. A non-detection of a Lyman-alpha transit could suggest K2-25b is not significantly losing its atmosphere, or factors of the system are resulting in the mass loss being unobservable (e.g., atmosphere composition or the system's large high energy flux). Further observations could provide more stringent constraints.


title: A result on the size of iterated sumsets in $\mathbb{Z}^d$

abstract: In this paper we give a different approach to determining the cardinality of $h$-fold sumsets $hA$ when $A\subset \mathbb{Z}^d$ has $d+2$ elements. This enables us to provide more general result with a shorter and simpler proof. We also obtain an upper bound for the value of $|hA|$ when $A\subset \mathbb{Z}^d$ is a set of $d+3$ elements with simplicial hull.


title: Dynamic Modeling of Hand-Object Interactions via Tactile Sensing

abstract: Tactile sensing is critical for humans to perform everyday tasks. While significant progress has been made in analyzing object grasping from vision, it remains unclear how we can utilize tactile sensing to reason about and model the dynamics of hand-object interactions. In this work, we employ a high-resolution tactile glove to perform four different interactive activities on a diversified set of objects. We build our model on a cross-modal learning framework and generate the labels using a visual processing pipeline to supervise the tactile model, which can then be used on its own during the test time. The tactile model aims to predict the 3d locations of both the hand and the object purely from the touch data by combining a predictive model and a contrastive learning module. This framework can reason about the interaction patterns from the tactile data, hallucinate the changes in the environment, estimate the uncertainty of the prediction, and generalize to unseen objects. We also provide detailed ablation studies regarding different system designs as well as visualizations of the predicted trajectories. This work takes a step on dynamics modeling in hand-object interactions from dense tactile sensing, which opens the door for future applications in activity learning, human-computer interactions, and imitation learning for robotics.


title: Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contexts

abstract: Preserving maximal information is one of principles of designing self-supervised learning methodologies. To reach this goal, contrastive learning adopts an implicit way which is contrasting image pairs. However, we believe it is not fully optimal to simply use the contrastive estimation for preservation. Moreover, it is necessary and complemental to introduce an explicit solution to preserve more information. From this perspective, we introduce Preservational Learning to reconstruct diverse image contexts in order to preserve more information in learned representations. Together with the contrastive loss, we present Preservational Contrastive Representation Learning (PCRL) for learning self-supervised medical representations. PCRL provides very competitive results under the pretraining-finetuning protocol, outperforming both self-supervised and supervised counterparts in 5 classification/segmentation tasks substantially.


title: ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding

abstract: Contrastive learning has been attracting much attention for learning unsupervised sentence embeddings. The current state-of-the-art unsupervised method is the unsupervised SimCSE (unsup-SimCSE). Unsup-SimCSE takes dropout as a minimal data augmentation method, and passes the same input sentence to a pre-trained Transformer encoder (with dropout turned on) twice to obtain the two corresponding embeddings to build a positive pair. As the length information of a sentence will generally be encoded into the sentence embeddings due to the usage of position embedding in Transformer, each positive pair in unsup-SimCSE actually contains the same length information. And thus unsup-SimCSE trained with these positive pairs is probably biased, which would tend to consider that sentences of the same or similar length are more similar in semantics. Through statistical observations, we find that unsup-SimCSE does have such a problem. To alleviate it, we apply a simple repetition operation to modify the input sentence, and then pass the input sentence and its modified counterpart to the pre-trained Transformer encoder, respectively, to get the positive pair. Additionally, we draw inspiration from the community of computer vision and introduce a momentum contrast, enlarging the number of negative pairs without additional calculations. The proposed two modifications are applied on positive and negative pairs separately, and build a new sentence embedding method, termed Enhanced Unsup-SimCSE (ESimCSE). We evaluate the proposed ESimCSE on several benchmark datasets w.r.t the semantic text similarity (STS) task. Experimental results show that ESimCSE outperforms the state-of-the-art unsup-SimCSE by an average Spearman correlation of 2.02% on BERT-base.


title: Copy-Move Image Forgery Detection Based on Evolving Circular Domains Coverage

abstract: The aim of this paper is to improve the accuracy of copy-move forgery detection (CMFD) in image forensics by proposing a novel scheme and the main contribution is evolving circular domains coverage (ECDC) algorithm. The proposed scheme integrates both block-based and keypoint-based forgery detection methods. Firstly, the speed-up robust feature (SURF) in log-polar space and the scale invariant feature transform (SIFT) are extracted from an entire image. Secondly, generalized 2 nearest neighbor (g2NN) is employed to get massive matched pairs. Then, random sample consensus (RANSAC) algorithm is employed to filter out mismatched pairs, thus allowing rough localization of counterfeit areas. To present these forgery areas more accurately, we propose the efficient and accurate ECDC algorithm to present them. This algorithm can find satisfactory threshold areas by extracting block features from jointly evolving circular domains, which are centered on matched pairs. Finally, morphological operation is applied to refine the detected forgery areas. Experimental results indicate that the proposed CMFD scheme can achieve better detection performance under various attacks compared with other state-of-the-art CMFD schemes.


title: Bayesian optimization for the spanwise oscillation of a gliding flat-plate

abstract: The kinematics of a gliding flat-plate with spanwise oscillation has been optimized to enhance the power efficiency by using Bayesian optimization method, in which the portfolio allocation framework consists of a Gaussian process probabilistic surrogate and a hybrid acquisition strategy. We tune three types of acquisition function in the optimization framework and assign three different balance parameters to each acquisition function. The design variables are set as the dimensionless oscillating amplitude and reduced frequency of the spanwise oscillation. The object function is to maximize the power factor to support a unit weight. The optimization results in a maximal power factor of 1.65 when the dimensionless oscillating amplitude and reduced frequency vary from 0 to 1. The features of the probabilistic response surface are also examined. There exists an optimal reduced frequency for the power efficiency at the oscillating amplitudes above 0.40. In addition, the higher power efficiency may be obtained by increasing the amplitude beyond 1.00.


title: Nonuniform mixing

abstract: Fluid mixing usually involves the interplay between advection and diffusion, which together cause any initial distribution of passive scalar to homogenize and ultimately reach a uniform state. However, this scenario only holds when the velocity field is nondivergent and has no normal component to the boundary. If either condition is unmet, such as for active particles in a bounded region, floating particles, or for filters, then the ultimate state after a long time is not uniform, and may be time dependent. We show that in those cases of nonuniform mixing it is preferable to characterize the degree of mixing in terms of an f-divergence, which is a generalization of relative entropy, or to use the $L^1$ norm. Unlike concentration variance ($L^2$ norm), the f-divergence and $L^1$ norm always decay monotonically, even for nonuniform mixing, which facilitates measuring the rate of mixing. We show by an example that flows that mix well for the nonuniform case can be drastically different from efficient uniformly mixing flows.


title: Reachable sets for two-level open quantum systems driven by coherent and incoherent controls

abstract: In this work, we study controllability in the set of all density matrices for a two-level open quantum system driven by coherent and incoherent controls. In [A. Pechen, Phys. Rev. A 84, 042106 (2011)] an approximate controllability, i.e., controllability with some precision, was shown for generic $N$-level open quantum systems driven by coherent and incoherent controls. However, the explicit formulation of this property, including the behavior of this precision as a function of transition frequencies and decoherence rates of the system, was not known. The present work provides a rigorous analytical study of reachable sets for two-level open quantum systems. First, it is shown that for $N=2$ the presence of incoherent control does not affect the reachable set (while incoherent control may affect the time necessary to reach particular state). Second, the reachable set in the Bloch ball is described and it is shown that already just for one coherent control any point in the Bloch ball can be achieved with precision $\delta\sim \gamma/\omega$, where $\gamma$ is the decoherence rate and $\omega$ is the transition frequency. Typical values are $\delta\lesssim10^{-3}$ that implies high accuracy of achieving any density matrix. Moreover, we show that most points in the Bloch ball can be exactly reached, except of two lacunae of size $\sim\delta$. For two coherent controls, the system is shown to be completely controllable in the set of all density matrices. Third, the reachable set as a function of the final time is found and shown to exhibit a non-trivial structure.


title: Contrasting Human- and Machine-Generated Word-Level Adversarial Examples for Text Classification

abstract: Research shows that natural language processing models are generally considered to be vulnerable to adversarial attacks; but recent work has drawn attention to the issue of validating these adversarial inputs against certain criteria (e.g., the preservation of semantics and grammaticality). Enforcing constraints to uphold such criteria may render attacks unsuccessful, raising the question of whether valid attacks are actually feasible. In this work, we investigate this through the lens of human language ability. We report on crowdsourcing studies in which we task humans with iteratively modifying words in an input text, while receiving immediate model feedback, with the aim of causing a sentiment classification model to misclassify the example. Our findings suggest that humans are capable of generating a substantial amount of adversarial examples using semantics-preserving word substitutions. We analyze how human-generated adversarial examples compare to the recently proposed TextFooler, Genetic, BAE and SememePSO attack algorithms on the dimensions naturalness, preservation of sentiment, grammaticality and substitution rate. Our findings suggest that human-generated adversarial examples are not more able than the best algorithms to generate natural-reading, sentiment-preserving examples, though they do so by being much more computationally efficient.


title: ErfAct and Pserf: Non-monotonic Smooth Trainable Activation Functions

abstract: An activation function is a crucial component of a neural network that introduces non-linearity in the network. The state-of-the-art performance of a neural network depends also on the perfect choice of an activation function. We propose two novel non-monotonic smooth trainable activation functions, called ErfAct and Pserf. Experiments suggest that the proposed functions improve the network performance significantly compared to the widely used activations like ReLU, Swish, and Mish. Replacing ReLU by ErfAct and Pserf, we have 5.68% and 5.42% improvement for top-1 accuracy on Shufflenet V2 (2.0x) network in CIFAR100 dataset, 2.11% and 1.96% improvement for top-1 accuracy on Shufflenet V2 (2.0x) network in CIFAR10 dataset, 1.0%, and 1.0% improvement on mean average precision (mAP) on SSD300 model in Pascal VOC dataset.


title: Extra-large type Artin groups are hierarchically hyperbolic

abstract: We show that Artin groups of extra-large type, and more generally Artin groups of large and hyperbolic type, are hierarchically hyperbolic. This implies in particular that these groups have finite asymptotic dimension and uniform exponential growth. We prove these results by using a combinatorial approach to hierarchical hyperbolicity, via the action of these groups on a new complex that is quasi-isometric both to the coned-off Deligne complex introduced by Martin-Przytycki and to a generalisation due to Morris-Wright of the graph of irreducible parabolic subgroups of finite type introduced by Cumplido-Gebhardt-Gonz\'alez-Meneses-Wiest.


title: The ubiquitous mechanism accelerating cosmic rays at all the energies

abstract: The mechanism accelerating cosmic rays in the Milky Way Galaxy and galaxy clusters is identified and described. The acceleration of cosmic rays is a purely electrostatic process which operates up to the maximum energies of $10^{23}$ eV in galaxy clusters. Galactic cosmic rays are accelerated in a pervasive electrostatic field active in the whole Galaxy except in restricted regions shielded by interstellar and stellar plasmas as, for instance, the region occupied by the solar system. It is proved that the energy spectrum of the cosmic radiation in the Milky Way Galaxy, in the region where the solar system resides, has a constant spectral index comprised between 2.64-2.68 and the maximum energies of Galactic protons are $3.0 \times 10^{19}$ eV. The agreement of these results with the experimental data is discussed in detail and underlined. The various physical processes that maintain the stability of the electrostatic structure in the Milky Way Galaxy are the same that generate the Galactic magnetic field. Accordingly, the intensity, orientation and direction of the Galactic magnetic field are evaluated. The results of the calculation are compared with the observational data, optical and mostly radio astronomy data. The accord of the intensity, orientation and direction of the observed magnetic field with calculation is excellent.


title: Central nilpotency of skew braces

abstract: Skew braces are algebraic structures related to the solutions of the set-theoretic quantum Yang-Baxter equation. We develop the central nilpotency theory for such algebraic structures in the sense of Freese-McKenzie \cite{comm} and we compare the universal algebraic notion of central nilpotency with the notion of right and left $*$-nilpotency developed in \cite{NilpotentType}.


title: 1-Bit MIMO for Terahertz Channels

abstract: This paper tackles the problem of single-user multiple-input multiple-output communication with 1-bit digital-to-analog and analog-to-digital converters. With the information-theoretic capacity as benchmark, the complementary strategies of beamforming and equiprobable signaling are contrasted in the regimes of operational interest, and the ensuing spectral efficiencies are characterized. Various canonical channel types are considered, with emphasis on line-of-sight settings under both spherical and planar wavefronts, respectively representative of short and long transmission ranges at mmWave and terahertz frequencies. In all cases, a judicious combination of beamforming and equiprobable signaling is shown to operate within a modest gap from capacity.


title: A new classification of algebraic identities for linear operators on associative algebras

abstract: We introduce a new approach to the classification of operator identities, based on basic concepts from the theory of algebraic operads together with computational commutative algebra applied to determinantal ideals of matrices over polynomial rings. We consider operator identities of degree 2 (the number of variables in each term) and multiplicity 1 or 2 (the number of operators in each term), but our methods apply more generally. Given an operator identity with indeterminate coefficients, we use partial compositions to construct a matrix of consequences, and then use computer algebra to determine the values of the indeterminates for which this matrix has submaximal rank. For multiplicity 1 we obtain six identities, including the derivation identity. For multiplicity 2 we obtain eighteen identities and two parametrized families, including the left and right averaging identities, the Rota-Baxter identity, the Nijenhuis identity, and some new identities which deserve further study.


title: Fair Conformal Predictors for Applications in Medical Imaging

abstract: Deep learning has the potential to automate many clinically useful tasks in medical imaging. However translation of deep learning into clinical practice has been hindered by issues such as lack of the transparency and interpretability in these "black box" algorithms compared to traditional statistical methods. Specifically, many clinical deep learning models lack rigorous and robust techniques for conveying certainty (or lack thereof) in their predictions -- ultimately limiting their appeal for extensive use in medical decision-making. Furthermore, numerous demonstrations of algorithmic bias have increased hesitancy towards deployment of deep learning for clinical applications. To this end, we explore how conformal predictions can complement existing deep learning approaches by providing an intuitive way of expressing uncertainty while facilitating greater transparency to clinical users. In this paper, we conduct field interviews with radiologists to assess possible use-cases for conformal predictors. Using insights gathered from these interviews, we devise two clinical use-cases and empirically evaluate several methods of conformal predictions on a dermatology photography dataset for skin lesion classification. We show how to modify conformal predictions to be more adaptive to subgroup differences in patient skin tones through equalized coverage. Finally, we compare conformal prediction against measures of epistemic uncertainty.


title: On the overflowing of cosmic rays from galaxies and the expansion of cosmic matter

abstract: Particles of the cosmic radiation, electrons and nuclei, transport a dominant positive electric charge. A tiny fraction of these particles of extremely high energies in favorable conditions overflow from galaxies. The overflowing of positively charged cosmic nuclei into the intergalactic space uncovers an equal amount of negative charge in the parent galaxy. Negative charge is mainly stored by quiescent electrons. After adequate particle propagation neither the negative electric charge located in the galaxies nor the positive electric charge of the overflowed cosmic nuclei can be neutralized due to the enormous distances. In several ways it is proved that the total electric charge retained by clusters of galaxies after an appropriate time interval generate a repulsive force between clusters which overwhelms gravity. After a few billions years of electrostatic repulsion, peripheral clusters attain relativistic velocities and their mutual distances increase accordingly. Several facts suggest that the expansion of the universe, as determined by optical observations since a century, has been caused by the electrostatic repulsion of the positively charged cosmic nuclei overflowed from galaxy clusters.


title: Singular analysis of the stress concentration in the narrow regions between the inclusions and the matrix boundary

abstract: We consider the Lam\'{e} system arising from high-contrast composite materials whose inclusions (fibers) are nearly touching the matrix boundary. The stress, which is the gradient of the solution, always concentrates highly in the narrow regions between the inclusions and the external boundary. This paper aims to provide a complete characterization in terms of the singularities of the stress concentration by accurately capturing all the blow-up factor matrices and making clear the dependence on the Lam\'{e} constants and the curvature parameters of geometry. Moreover, the precise asymptotic expansions of the stress concentration are also presented in the presence of a strictly convex inclusion close to touching the external boundary for the convenience of application.


title: Entangling-gate error from coherently displaced motional modes of trapped ions

abstract: Entangling gates in trapped-ion quantum computing have primarily targeted stationary ions with initial motional distributions that are thermal and close to the ground state. However, future systems will likely incur significant non-thermal excitation due to, e.g., ion transport, longer operational times, and increased spatial extent of the trap array. In this paper, we analyze the impact of such coherent motional excitation on entangling-gate error by performing simulations of Molmer-Sorenson (MS) gates on a pair of trapped-ion qubits with both thermal and coherent excitation present in a shared motional mode at the start of the gate. We discover that a small amount of coherent displacement dramatically erodes gate performance in the presence of experimental noise, and we demonstrate that applying only limited control over the phase of the displacement can suppress this error. We then use experimental data from transported ions to analyze the impact of coherent displacement on MS-gate error under realistic conditions.


title: Spectroscopic observations of PHz G237.01+42.50: A galaxy protocluster at z=2.16 in the Cosmos field

abstract: The Planck satellite has identified more than 2000 protocluster candidates with extreme star formation rates (SFRs). Here, we present the spectroscopic identification of a Planck-selected protocluster located in the Cosmos field, PHz G237.01+42.50 (G237). G237 contains a galaxy overdensity of 31 spectroscopically identified galaxies at z~2.16 (significant at 5.4 sigma) in a 10'x11' region. The overdensity contains two substructures or protoclusters at <z>~2.16 and 2.195 with estimated halo masses at z=0 of ~(5-6)x10^14 Msun. The overdensity total SFR, ~4000 Msun/yr, is higher than predicted by simulations but much smaller than the SFR derived from the Planck data. The analysis of the Herschel data, in combination with the available ancillary data, shows that such a difference is due to an effect of source alignment along the line of sight that produces a 5 sigma overdensity of red Herschel sources in the field. We analyze the members' UV spectra and UV-far-infrared spectral energy distributions to derive their SFR, stellar mass, and metallicity. Galaxy members include blue star-forming galaxies and AGN with SFRs and stellar masses consistent with the main sequence. AGN, identified through optical spectroscopy or X-ray data, represent a significant fraction (20+/-10%) of all members of the protocluster at z=2.16, and they are powerful enough to produce radiative feedback. The core of this protocluster, besides being denser, includes members that are, on average, more massive and star-forming and contains a larger fraction of AGN and Herschel-detected galaxies than the full sample, suggesting an environmental effect on galaxy growth. A comparison between G237 and other protoclusters in the literature at similar redshifts reveals some common traits and differences that reflect both observational biases and a diversity in intrinsic properties that is not yet fully understood.


title: Accuracy of power spectra in dissipationless cosmological simulations

abstract: We exploit a suite of large \emph{N}-body simulations (up to N=$4096^3$) performed with \Abacus, of scale-free models with a range of spectral indices $n$, to better understand and quantify convergence of the matter power spectrum. Using self-similarity to identify converged regions, we show that the maximal wavenumber resolved at a given level of accuracy increases monotonically as a function of time. At the 1\% level it starts at early times from a fraction of $k_\Lambda$, the Nyquist wavenumber of the initial grid, and reaches at most, if the force softening is sufficiently small, $\sim 2-3 k_\Lambda$ at the very latest times we evolve to. At the $5\%$ level, accuracy extends up to wavenumbers of order $5k_\Lambda$ at late times. Expressed as a suitable function of the scale-factor, accuracy shows a very simple $n$-dependence, allowing a extrapolation to place conservative bounds on the accuracy of \emph{N}-body simulations of non-scale free models like LCDM. We note that deviations due to discretization in the converged range are not well modelled by shot noise, and subtracting it in fact degrades accuracy. Quantitatively our findings are broadly in line with the conservative assumptions about resolution adopted by recent studies using large cosmological simulations (e.g. Euclid Flagship) aiming to constrain the mildly non-linear regime. On the other hand, we remark that conclusions about small scale clustering (e.g. concerning the validity of stable clustering) obtained using PS data at wavenumbers larger than a few $k_\Lambda$ may need revision in light of our convergence analysis.


title: Neural-IMLS: Self-supervised Implicit Moving Least-Squares Network for Surface Reconstruction

abstract: Surface reconstruction is very challenging when the input point clouds, particularly real scans, are noisy and lack normals. Observing that the Multilayer Perceptron (MLP) and the implicit moving least-square function (IMLS) provide a dual representation of the underlying surface, we introduce Neural-IMLS, a novel approach that directly learns the noise-resistant signed distance function (SDF) from unoriented raw point clouds in a self-supervised fashion. We use the IMLS to regularize the distance values reported by the MLP while using the MLP to regularize the normals of the data points for running the IMLS. We also prove that at the convergence, our neural network, benefiting from the mutual learning mechanism between the MLP and the IMLS, produces a faithful SDF whose zero-level set approximates the underlying surface. We conducted extensive experiments on various benchmarks, including synthetic scans and real scans. The experimental results show that {\em Neural-IMLS} can reconstruct faithful shapes on various benchmarks with noise and missing parts. The source code can be found at~\url{https://github.com/bearprin/Neural-IMLS}.


title: Gradual (In)Compatibility of Fairness Criteria

abstract: Impossibility results show that important fairness measures (independence, separation, sufficiency) cannot be satisfied at the same time under reasonable assumptions. This paper explores whether we can satisfy and/or improve these fairness measures simultaneously to a certain degree. We introduce information-theoretic formulations of the fairness measures and define degrees of fairness based on these formulations. The information-theoretic formulations suggest unexplored theoretical relations between the three fairness measures. In the experimental part, we use the information-theoretic expressions as regularizers to obtain fairness-regularized predictors for three standard datasets. Our experiments show that a) fairness regularization directly increases fairness measures, in line with existing work, and b) some fairness regularizations indirectly increase other fairness measures, as suggested by our theoretical findings. This establishes that it is possible to increase the degree to which some fairness measures are satisfied at the same time -- some fairness measures are gradually compatible.


title: Cross-lingual Transfer for Text Classification with Dictionary-based Heterogeneous Graph

abstract: In cross-lingual text classification, it is required that task-specific training data in high-resource source languages are available, where the task is identical to that of a low-resource target language. However, collecting such training data can be infeasible because of the labeling cost, task characteristics, and privacy concerns. This paper proposes an alternative solution that uses only task-independent word embeddings of high-resource languages and bilingual dictionaries. First, we construct a dictionary-based heterogeneous graph (DHG) from bilingual dictionaries. This opens the possibility to use graph neural networks for cross-lingual transfer. The remaining challenge is the heterogeneity of DHG because multiple languages are considered. To address this challenge, we propose dictionary-based heterogeneous graph neural network (DHGNet) that effectively handles the heterogeneity of DHG by two-step aggregations, which are word-level and language-level aggregations. Experimental results demonstrate that our method outperforms pretrained models even though it does not access to large corpora. Furthermore, it can perform well even though dictionaries contain many incorrect translations. Its robustness allows the usage of a wider range of dictionaries such as an automatically constructed dictionary and crowdsourced dictionary, which are convenient for real-world applications.


title: Reconciling anomalously fast heating rate in ion tracks with low electron-phonon coupling

abstract: Formation of swift heavy ion tracks requires extremely fast energy transfer between excited electrons and a lattice. However, electron-phonon energy exchange is too slow, as known from laser-irradiation experiments and calculations. We resolve this contradiction noticing that electron-phonon coupling is not the sole mechanism of energy exchange between electrons and ions: heating of electrons also alters potential energy surface of atoms, accelerating them and increasing their kinetic energy.


title: Cycle-skipping mitigation using misfit measurements based on differentiable dynamic time warping

abstract: The dynamic time warping (DTW) distance has been used as a misfit function for wave-equation inversion to mitigate the local minima issue. However, the original DTW distance is not smooth; therefore it can yield a strong discontinuity in the adjoint source. Such a weakness does not help nonlinear inverse problems converge to a plausible minimum by any means. We therefore introduce for the first time in geophysics the smooth DTW distance, which has demonstrated its performance in time series classification, clustering, and prediction as the loss function. The fundamental idea of such a distance is to replace the $\min$ operator with its smooth relaxation. Then it becomes possible to define the analytic derivative of DTW distance. The new misfit function is entitled to the differentiable DTW distance. Moreover, considering that the warping path is an indicator of the traveltime difference between the observed and synthetic trace, a penalization term is constructed based on the warping path such that the misfit accumulation by the penalized differentiable DTW distance is weighted in favor of the traveltime difference. Numerical examples demonstrate the advantage of the penalized differentiable DTW misfit function over the conventional non-differentiable one.


title: Magnetofluidic based controlled droplet breakup: effect of non-uniform force field

abstract: We report the breakup dynamics of a magnetically active droplet (ferrofluid droplet) in a T-shaped LOC device under the modulation of a non-uniform magnetic field. We adhere to high-speed imaging modalities for the experimental quantification of the droplet splitting phenomena in the presence of a non-uniform force field gradient, while the underlying phenomena is supported by the numerical results in a qualitative manner as well. On reaching the T-junction divergence, the droplet engulfs the intersection fully and eventually deforms into the dumbbell-shaped form making its bulges to move towards the branches of the junction. We observe that the asymmetric distribution of the magnetic force lines, acting over the T-junction divergence, induces an accelerating motion to the left moving bulge (since the magnet is placed adjacent to the left branch). We show that the non-uniform force field gradient allows the formation of a hump-like structure inside the left moving bulge which triggers the onset of augmented convection in its flow field. We reveal that this augmented internal convection developed in the left moving volume/bulge, on getting coupled with the various involved time scales of the flow field, lead to the asymmetric splitting of the droplet into two sister droplets. Our analysis establishes that at the critical strength of the applied forcing, as realized by the critical magnetic Bond number, the flow time scale becomes minimum at the left branch of the channel, leading to the formation of larger sized sister droplet therein. Inferences of the present analysis, which focuses on the simple, wireless, robust and low-cost droplet splitting mechanism, will provide a potential solution for rapid droplet breakup, typically finds significant importance in point-of-care diagnostics.


title: All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality

abstract: Similarity measures are a vital tool for understanding how language models represent and process language. Standard representational similarity measures such as cosine similarity and Euclidean distance have been successfully used in static word embedding models to understand how words cluster in semantic space. Recently, these measures have been applied to embeddings from contextualized models such as BERT and GPT-2. In this work, we call into question the informativity of such measures for contextualized language models. We find that a small number of rogue dimensions, often just 1-3, dominate these measures. Moreover, we find a striking mismatch between the dimensions that dominate similarity measures and those which are important to the behavior of the model. We show that simple postprocessing techniques such as standardization are able to correct for rogue dimensions and reveal underlying representational quality. We argue that accounting for rogue dimensions is essential for any similarity-based analysis of contextual language models.


title: An Accelerated Proximal Gradient-based Model Predictive Control Algorithm

abstract: In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given positive integer. The proposed algorithm improves the convergence rate of existing algorithms that achieve $O(1/p^{2})$. The key idea is that iterative parameters are selected from a group of specific high order polynomial equations. The performance of the proposed algorithm is assessed on the randomly generated model predictive control (MPC) optimization problems. The experimental results show that our algorithm can outperform the state-of-the-art optimization software MOSEK and ECOS for the small size MPC problems.


title: Hubble tension or a transition of the Cepheid SnIa calibrator parameters?

abstract: We re-analyze the Cepheid data used to infer the value of $H_0$ by calibrating SnIa. We do not enforce a universal value of the empirical Cepheid calibration parameters $R_W$ (Cepheid Wesenheit color-luminosity parameter) and $M_H^{W}$ (Cepheid Wesenheit H-band absolute magnitude). Instead, we allow for variation of either of these parameters for each individual galaxy. We also consider the case where these parameters have two universal values: one for low galactic distances $D<D_c$ and one for high galactic distances $D>D_c$ where $D_c$ is a critical transition distance. We find hints for a $3\sigma$ level mismatch between the low and high galactic distance parameter values. We then use AIC and BIC criteria to compare and rank the following types of models: Base models: Universal values for $R_W$ and $M_H^{W}$ (no parameter variation), I Individual fitted galactic $R_W$ with a universal fitted $M_H^{W}$, II Universal fixed $R_W$ with individual fitted galactic $M_H^{W}$, III Universal fitted $R_W$ with individual fitted galactic $M_H^{W}$, IV Two universal fitted $R_W$ (near and far) with one universal fitted $M_H^{W}$, V Universal fitted $R_W$ with two universal fitted $M_H^{W}$ (near and far), VI Two universal fitted $R_W$ with two universal fitted $M_H^{W}$ (near and far). We find that the AIC and BIC criteria consistently favor model IV instead of the commonly used Base model where no variation is allowed for the Cepheid empirical parameters. The best fit value of the SnIa absolute magnitude $M_B$ and of $H_0$ implied by the favored model IV is consistent with the inverse distance ladder calibration based on the CMB sound horizon $H_0=67.4\pm 0.5\,km\,s^{-1}\,Mpc^{-1}$. Thus in the context of the favored model IV the Hubble crisis is not present. This model may imply the presence of a fundamental physics transition taking place at a time more recent than $100\,Myrs$ ago.


title: Logarithmic corrections to the entropy of non-extremal black holes in $\mathcal{N}=1$ Einstein-Maxwell supergravity

abstract: We reviewed the field redefinition approach of Seeley-DeWitt expansion for the determination of Seeley-DeWitt coefficients from arXiv:1505.01156. We apply this approach to compute the first three Seeley-DeWitt coefficients for \say{non-minimal} $\mathcal{N}=1$ Einstein-Maxwell supergravity in four dimensions. Finally, we use the third coefficient for the computation of the logarithmic corrections to the Bekenstein-Hawking entropy of non-extremal black holes following arXiv:1205.0971. We determine the logarithmic corrections for non-extremal Kerr-Newman, Kerr, Reissner-Nordstr\"{o}m and Schwarzschild black holes in \say{non-minimal} $\mathcal{N}=1$, $d=4$ Einstein-Maxwell supergravity.


title: Learning with Different Amounts of Annotation: From Zero to Many Labels

abstract: Training NLP systems typically assumes access to annotated data that has a single human label per example. Given imperfect labeling from annotators and inherent ambiguity of language, we hypothesize that single label is not sufficient to learn the spectrum of language interpretation. We explore new annotation distribution schemes, assigning multiple labels per example for a small subset of training examples. Introducing such multi label examples at the cost of annotating fewer examples brings clear gains on natural language inference task and entity typing task, even when we simply first train with a single label data and then fine tune with multi label examples. Extending a MixUp data augmentation framework, we propose a learning algorithm that can learn from training examples with different amount of annotation (with zero, one, or multiple labels). This algorithm efficiently combines signals from uneven training data and brings additional gains in low annotation budget and cross domain settings. Together, our method achieves consistent gains in two tasks, suggesting distributing labels unevenly among training examples can be beneficial for many NLP tasks.


title: Reconstructing and grounding narrated instructional videos in 3D

abstract: Narrated instructional videos often show and describe manipulations of similar objects, e.g., repairing a particular model of a car or laptop. In this work we aim to reconstruct such objects and to localize associated narrations in 3D. Contrary to the standard scenario of instance-level 3D reconstruction, where identical objects or scenes are present in all views, objects in different instructional videos may have large appearance variations given varying conditions and versions of the same product. Narrations may also have large variation in natural language expressions. We address these challenges by three contributions. First, we propose an approach for correspondence estimation combining learnt local features and dense flow. Second, we design a two-step divide and conquer reconstruction approach where the initial 3D reconstructions of individual videos are combined into a 3D alignment graph. Finally, we propose an unsupervised approach to ground natural language in obtained 3D reconstructions. We demonstrate the effectiveness of our approach for the domain of car maintenance. Given raw instructional videos and no manual supervision, our method successfully reconstructs engines of different car models and associates textual descriptions with corresponding objects in 3D.


title: Degrees of randomized computability: decomposition into atoms

abstract: In this paper we study structural properties of LV-degrees of the algebra of collections of sequences that are non-negligible in the sense that they can be computed by a probabilistic algorithm with positive probability. We construct atoms and infinitely divisible elements of this algebra generated by sequences, which cannot be Martin-L\"of random and, moreover, these sequences cannot be Turing equivalent to random sequences. The constructions are based on the corresponding templates which can be used for defining the special LV-degrees. In particular, we present the template for defining atoms of the algebra of LV-degrees and obtain the decomposition of the maximal LV-degree into a countable sequence of atoms and their non-zero complement -- infinitely divisible LV-degree. We apply the templates to establish new facts about specific LV-degrees, such as the LV-degree of the collection of sequences of hyperimmune degree. We construct atoms defined by collections of hyperimmune sequences, moreover, a representation of LV-degree of the collection of all hyperimmune sequences will be obtained in the form of a union of an infinite sequence of atoms and an infinitely divisible element.


title: Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring

abstract: This article describes an efficient end-to-end speech translation (E2E-ST) framework based on non-autoregressive (NAR) models. End-to-end speech translation models have several advantages over traditional cascade systems such as inference latency reduction. However, conventional AR decoding methods are not fast enough because each token is generated incrementally. NAR models, however, can accelerate the decoding speed by generating multiple tokens in parallel on the basis of the token-wise conditional independence assumption. We propose a unified NAR E2E-ST framework called Orthros, which has an NAR decoder and an auxiliary shallow AR decoder on top of the shared encoder. The auxiliary shallow AR decoder selects the best hypothesis by rescoring multiple candidates generated from the NAR decoder in parallel (parallel AR rescoring). We adopt conditional masked language model (CMLM) and a connectionist temporal classification (CTC)-based model as NAR decoders for Orthros, referred to as Orthros-CMLM and Orthros-CTC, respectively. We also propose two training methods to enhance the CMLM decoder. Experimental evaluations on three benchmark datasets with six language directions demonstrated that Orthros achieved large improvements in translation quality with a very small overhead compared with the baseline NAR model. Moreover, the Conformer encoder architecture enabled large quality improvements, especially for CTC-based models. Orthros-CTC with the Conformer encoder increased decoding speed by 3.63x on CPU with translation quality comparable to that of an AR model.


title: A source fragmentation approach to interacting quantum field theory

abstract: A corollary to the Reeh-Schlieder theorem is proved: that the time-ordered Vacuum Expectation Values and the S-matrix of a regularized Lagrangian quantum theory can be approximated by a local operator that uses nonlinear functionals of a locally supported source function. For the Wightman axioms, this suggests a modification that takes the algebra of measurement operators not to be generated by an operator-valued distribution. The use of operator-valued nonlinear functionals of a source function introduces many abstract fragments of the source to give a well-defined top-down construction of interacting quantum fields, in contrast to a bottom-up blocking and scaling construction or to analyzing response to changing renormalization scales. The construction can also be thought of as solving a localized inverse problem for the interacting dynamics or as a generating function for multi-point bound state fields.


title: AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Models

abstract: Despite their success in a variety of NLP tasks, pre-trained language models, due to their heavy reliance on compositionality, fail in effectively capturing the meanings of multiword expressions (MWEs), especially idioms. Therefore, datasets and methods to improve the representation of MWEs are urgently needed. Existing datasets are limited to providing the degree of idiomaticity of expressions along with the literal and, where applicable, (a single) non-literal interpretation of MWEs. This work presents a novel dataset of naturally occurring sentences containing MWEs manually classified into a fine-grained set of meanings, spanning both English and Portuguese. We use this dataset in two tasks designed to test i) a language model's ability to detect idiom usage, and ii) the effectiveness of a language model in generating representations of sentences containing idioms. Our experiments demonstrate that, on the task of detecting idiomatic usage, these models perform reasonably well in the one-shot and few-shot scenarios, but that there is significant scope for improvement in the zero-shot scenario. On the task of representing idiomaticity, we find that pre-training is not always effective, while fine-tuning could provide a sample efficient method of learning representations of sentences containing MWEs.


title: The cylinder amplitude in the Hard Dimer model on 2D Causal Dynamical Triangulations

abstract: We consider the model of hard dimers coupled to two-dimensional Causal Dynamical Triangulations (CDT) with all dimer types present and solve it exactly subject to a single restriction. Depending on the dimer weights there are, in addition to the usual gravity phase of CDT, two tri-critical and two dense dimer phases. We establish the properties of these phases, computing their cylinder and disk amplitudes, and their scaling limits.


title: Algorithms and Certificates for Boolean CSP Refutation: "Smoothed is no harder than Random"

abstract: We present an algorithm for strongly refuting smoothed instances of all Boolean CSPs. The smoothed model is a hybrid between worst and average-case input models, where the input is an arbitrary instance of the CSP with only the negation patterns of the literals re-randomized with some small probability. For an $n$-variable smoothed instance of a $k$-arity CSP, our algorithm runs in $n^{O(\ell)}$ time, and succeeds with high probability in bounding the optimum fraction of satisfiable constraints away from $1$, provided that the number of constraints is at least $\tilde{O}(n) (\frac{n}{\ell})^{\frac{k}{2} - 1}$. This matches, up to polylogarithmic factors in $n$, the trade-off between running time and the number of constraints of the state-of-the-art algorithms for refuting fully random instances of CSPs [RRS17]. We also make a surprising new connection between our algorithm and even covers in hypergraphs, which we use to positively resolve Feige's 2008 conjecture, an extremal combinatorics conjecture on the existence of even covers in sufficiently dense hypergraphs that generalizes the well-known Moore bound for the girth of graphs. As a corollary, we show that polynomial-size refutation witnesses exist for arbitrary smoothed CSP instances with number of constraints a polynomial factor below the "spectral threshold" of $n^{k/2}$, extending the celebrated result for random 3-SAT of Feige, Kim and Ofek [FKO06].


title: Non-Lorentzian Supersymmetric Models and M-Theory Branes

abstract: The theme of this thesis is the study of field theories generically without Lorentz symmetry, but possessing an inhomogeneous scaling symmetry. A number of aspects of such models are explored, including the addition of supersymmetry, and their application in the construction of more conventional conformal field theories. In Part I, we describe a scaling technique by which non-Lorentzian theories with an inhomogeneous scaling symmetry are obtained from Lorentzian supersymmetric models, while retaining all supersymmetry of the parent theory. The dynamics of the resulting theories are generically constrained to the moduli space of some BPS soliton. We explore this scaling technique and the resulting reduction to superconformal quantum mechanics for some examples, including several relevant to the branes of M-theory. In Part II, we build from the ground up the theory of models in five dimensions with an exotic $SU(1,3)$ spacetime symmetry, including an inhomogeneous scaling. We derive and solve the corresponding Ward-Takahashi identities for correlators, and demonstrate how such models naturally describe any six-dimensional conformal field theory on a conformal compactification of Minkowski space. We derive necessary conditions for a generic $SU(1,3)$ theory to admit such a six-dimensional interpretation, and also explore a degenerate limit of the construction that recovers the standard DLCQ picture. Finally, we study in detail an explicit $SU(1,3)$ model, conjectured to provide a Lagrangian description of the non-Abelian $(2,0)$ theory. The theory is shown to realise six-dimensional physics through the inclusion of singular points carrying non-zero instanton charge, which are encoded by instanton operators in the path integral. We explore the constrained dynamics of the theory, which are shown to describe the propagation of Yang-Mills instanton-particles between such points.


title: Low-Dispersive Permittivity Measurement Based on Transmitted Power Only

abstract: This paper presents a complex permittivity measurement method for low-dispersive materials as a function of frequency. The introduced method relies only on transmitted power signals which are collected using a spectrum analyzer/power meter, removing the need for phase measurements and a vector network analyzer. This method provides a very good accuracy along with easy and inexpensive permittivity measurements.


title: A complementary covariant approach to gravito-electromagnetism

abstract: From a previous paper where we proposed a description of general relativity within the gravito-electromagnetic limit, we propose an alternative modified gravitational theory. As in the former version, we analyze the vector and tensor equations of motion, the gravitational continuity equation, the conservation of the energy, the energy-momentum tensor, the field tensor, and the constraints concerning these fields. The Lagrangian formulation is also exhibited as an unified and simple formulation that will be useful for future investigation.


title: A preliminary study of liver fat quantification using reported longitudinal ultrasound speed of sound and attenuation parameters

abstract: The quantification of liver fat as a diagnostic assessment of steatosis remains an important priority for noninvasive imaging systems. We derive a framework in which the unknown fat volume percentage can be estimated from a pair of ultrasound measurements. The precise estimation of ultrasound speed of sound and attenuation within the liver are shown to be sufficient for estimating fat volume assuming a classical model of the properties of a composite elastic material. In this model, steatosis is represented as a random dispersion of spherical fat vacuoles with acoustic properties similar to those of edible oils. Using values of speed of sound and attenuation from the literature where normal and steatotic livers were studied near 3.5 MHz, we demonstrate agreement of the new estimation method with independent measures of fat. This framework holds the potential for translation to clinical scanners where the two ultrasound measurements can be made and utilized for improved quantitative assessment of steatosis.


title: Robustness of Enhanced Shortcuts to Adiabaticity in Lattice Transport

abstract: Shortcuts to adiabaticity (STA) are a collection of quantum control techniques that achieve high fidelity outside of the adiabatic regime. Recently an extension to shortcuts to adiabaticity was proposed by the authors [Phys. Rev. Research 2, 023360 (2020)]. This new method, enhanced shortcuts to adiabaticity (eSTA), provides an extension to the original STA control functions and allows effective control of systems not amenable to STA methods. It is conjectured that eSTA schemes also enjoy an improved stability over their STA counterparts. We provide numerical evidence of this claim by applying eSTA to fast atomic transport using an optical lattice, and evaluating appropriate stability measures. We show that the eSTA schemes not only produce higher fidelities, but also remain more stable against errors than the original STA schemes.


title: A simplified GW/BSE approach for charged and neutral excitation energies of large molecules and nanomaterials

abstract: Inspired by Grimme's simplified Tamm-Dancoff density functional theory approach [S. Grimme, J. Chem. Phys. \textbf{138}, 244104 (2013)], we describe a simplified approach to excited state calculations within the GW approximation to the self-energy and the Bethe-Salpeter equation (BSE), which we call sGW/sBSE. The primary simplification to the electron repulsion integrals yields the same structure as with tensor hypercontraction, such that our method has a storage requirement that grows quadratically with system size and computational timing that grows cubically with system size. The performance of sGW is tested on the ionization potential of the molecules in the GW100 test set, for which it differs from \textit{ab intio} GW calculations by only 0.2 eV. The performance of sBSE (based on sGW input) is tested on the excitation energies of molecules in the Thiel set, for which it differs from \textit{ab intio} GW/BSE calculations by about 0.5 eV. As examples of the systems that can be routinely studied with sGW/sBSE, we calculate the band gap and excitation energy of hydrogen-passivated silicon nanocrystals with up to 2650 electrons in 4678 spatial orbitals and the absorption spectra of two large organic dye molecules with hundreds of atoms.


title: TxT: Crossmodal End-to-End Learning with Transformers

abstract: Reasoning over multiple modalities, e.g. in Visual Question Answering (VQA), requires an alignment of semantic concepts across domains. Despite the widespread success of end-to-end learning, today's multimodal pipelines by and large leverage pre-extracted, fixed features from object detectors, typically Faster R-CNN, as representations of the visual world. The obvious downside is that the visual representation is not specifically tuned to the multimodal task at hand. At the same time, while transformer-based object detectors have gained popularity, they have not been employed in today's multimodal pipelines. We address both shortcomings with TxT, a transformer-based crossmodal pipeline that enables fine-tuning both language and visual components on the downstream task in a fully end-to-end manner. We overcome existing limitations of transformer-based detectors for multimodal reasoning regarding the integration of global context and their scalability. Our transformer-based multimodal model achieves considerable gains from end-to-end learning for multimodal question answering.


title: Data-Driven Modeling of Coarse Mesh Turbulence for Reactor Transient Analysis Using Convolutional Recurrent Neural Networks

abstract: Advanced nuclear reactors often exhibit complex thermal-fluid phenomena during transients. To accurately capture such phenomena, a coarse-mesh three-dimensional (3-D) modeling capability is desired for modern nuclear-system code. In the coarse-mesh 3-D modeling of advanced-reactor transients that involve flow and heat transfer, accurately predicting the turbulent viscosity is a challenging task that requires an accurate and computationally efficient model to capture the unresolved fine-scale turbulence. In this paper, we propose a data-driven coarse-mesh turbulence model based on local flow features for the transient analysis of thermal mixing and stratification in a sodium-cooled fast reactor. The model has a coarse-mesh setup to ensure computational efficiency, while it is trained by fine-mesh computational fluid dynamics (CFD) data to ensure accuracy. A novel neural network architecture, combining a densely connected convolutional network and a long-short-term-memory network, is developed that can efficiently learn from the spatial-temporal CFD transient simulation results. The neural network model was trained and optimized on a loss-of-flow transient and demonstrated high accuracy in predicting the turbulent viscosity field during the whole transient. The trained model's generalization capability was also investigated on two other transients with different inlet conditions. The study demonstrates the potential of applying the proposed data-driven approach to support the coarse-mesh multi-dimensional modeling of advanced reactors.


title: Mini Cheetah, the Falling Cat: A Case Study in Machine Learning and Trajectory Optimization for Robot Acrobatics

abstract: Seemingly in defiance of basic physics, cats consistently land on their feet after falling. In this paper, we design a controller that lands the Mini Cheetah quadruped robot on its feet as well. Specifically, we explore how trajectory optimization and machine learning can work together to enable highly dynamic bioinspired behaviors. We find that a reflex approach, in which a neural network learns entire state trajectories, outperforms a policy approach, in which a neural network learns a mapping from states to control inputs. We validate our proposed controller in both simulation and hardware experiments, and are able to land the robot on its feet from falls with initial pitch angles between -90 and 90 degrees.


title: Talk-to-Edit: Fine-Grained Facial Editing via Dialog

abstract: Facial editing is an important task in vision and graphics with numerous applications. However, existing works are incapable to deliver a continuous and fine-grained editing mode (e.g., editing a slightly smiling face to a big laughing one) with natural interactions with users. In this work, we propose Talk-to-Edit, an interactive facial editing framework that performs fine-grained attribute manipulation through dialog between the user and the system. Our key insight is to model a continual "semantic field" in the GAN latent space. 1) Unlike previous works that regard the editing as traversing straight lines in the latent space, here the fine-grained editing is formulated as finding a curving trajectory that respects fine-grained attribute landscape on the semantic field. 2) The curvature at each step is location-specific and determined by the input image as well as the users' language requests. 3) To engage the users in a meaningful dialog, our system generates language feedback by considering both the user request and the current state of the semantic field. We also contribute CelebA-Dialog, a visual-language facial editing dataset to facilitate large-scale study. Specifically, each image has manually annotated fine-grained attribute annotations as well as template-based textual descriptions in natural language. Extensive quantitative and qualitative experiments demonstrate the superiority of our framework in terms of 1) the smoothness of fine-grained editing, 2) the identity/attribute preservation, and 3) the visual photorealism and dialog fluency. Notably, user study validates that our overall system is consistently favored by around 80% of the participants. Our project page is https://www.mmlab-ntu.com/project/talkedit/.


title: Higgs decay into a lepton pair and a photon: a roadmap to $\mathbf{H\to Z\gamma}$ discovery and probes of new physics

abstract: The decay $H\to \ell^+\ell^- \gamma$, $\ell=e,\mu$, receives contributions from $H\to Z[\to \ell^+\ell^-] \gamma$ and a non-resonant contribution, both of which are loop-induced. We describe how one can separate these sub-processes in a gauge-independent way, define the decay rate $\Gamma(H\to Z\gamma)$, and extract the latter from differential $H\to \ell^+\ell^- \gamma$ branching ratios. For $\ell=\mu$ also the tree decay rate, which is driven by the muon Yukawa coupling, is important. We propose kinematic cuts optimized to separate the three contributions, paving the way to the milestones (i) discovery of $H\to Z \gamma$, (ii) discovery of $H\to \mu^+\mu^- \left. \gamma\right|_{\rm tree}$, and (iii) quantification of new physics in both the effective $H$-$Z$-$\gamma$ and non-resonant $H$-$\ell^+$-$\ell^-$-$\gamma$ couplings.


title: Exponentiation of the leading eikonal with spin

abstract: We initiate a study into the eikonal exponentiation of the amplitude in impact-parameter space when spinning particles are involved in the scattering. Considering the gravitational scattering of two spin-1/2 particles, we demonstrate that the leading eikonal exhibits exponentiation up to $\mathcal{O}(G^{2})$ in the limit where the spacetime dimension $D\rightarrow4$. We find this to hold for general spin orientations. The exponentiation of the leading eikonal including spin is understood through the unitarity properties at leading order in $\hbar$ of momentum-space amplitudes, allowing the extension of our results to arbitrary-spin scattering.


title: Improved Online Algorithm for Fractional Knapsack in the Random Order Model

abstract: The fractional knapsack problem is one of the classical problems in combinatorial optimization, which is well understood in the offline setting. However, the corresponding online setting has been handled only briefly in the theoretical computer science literature so far, although it appears in several applications. Even the previously best known guarantee for the competitive ratio was worse than the best known for the integral problem in the popular random order model. We show that there is an algorithm for the online fractional knapsack problem that admits a competitive ratio of 4.39. Our result significantly improves over the previously best known competitive ratio of 9.37 and surpasses the current best 6.65-competitive algorithm for the integral case. Moreover, our algorithm is deterministic in contrast to the randomized algorithms achieving the results mentioned above.


title: A deep learned nanowire segmentation model using synthetic data augmentation

abstract: Automatized object identification and feature analysis of experimental image data are indispensable for data-driven material science; deep-learning-based segmentation algorithms have been shown to be a promising technique to achieve this goal. However, acquiring high-resolution experimental images and assigning labels in order to train such algorithms is challenging and costly in terms of both time and labor. In the present work, we apply synthetic images, which resemble the experimental image data in terms of geometrical and visual features, to train state-of-art deep learning-based Mask R-CNN algorithms to segment vanadium pentoxide (V2O5) nanowires, a canonical cathode material, within optical intensity-based images from spectromicroscopy. The performance evaluation demonstrates that even though the deep learning model is trained on pure synthetically generated structures, it can segment real optical intensity-based spectromicroscopy images of complex V2O5 nanowire structures in overlapped particle networks, thus providing reliable statistical information. The model can further be used to segment nanowires in scanning electron microscopy (SEM) images, which are fundamentally different from the training dataset known to the model. The proposed methodology of using a purely synthetic dataset to train the deep learning model can be extended to any optical intensity-based images of variable particle morphology, extent of agglomeration, material class, and beyond.


title: Neutrino Interaction Physics in Neutrino Telescopes

abstract: Neutrino telescopes can observe neutrino interactions starting at GeV energies by sampling a small fraction of the Cherenkov radiation produced by charged secondary particles. These experiments instrument volumes massive enough to collect substantial samples of neutrinos up to the TeV scale as well as small samples at the PeV scale. This unique ability of neutrino telescopes has been exploited to study the properties of neutrino interactions across energies that cannot be accessed with man-made beams. Here we present the methods and results obtained by IceCube, the most mature neutrino telescope in operation, and offer a glimpse of what the future holds in this field.


title: Incorporating Computational Challenges into a Multidisciplinary Course on Stochastic Processes

abstract: Quantitative methods and mathematical modeling are playing an increasingly important role across disciplines. As a result, interdisciplinary mathematics courses are increasing in popularity. However, teaching such courses at an advanced level can be challenging. Students often arrive with different mathematical backgrounds, different interests, and divergent reasons for wanting to learn the material. Here we describe a course on stochastic processes in biology, delivered between September and December 2020 to a mixed audience of mathematicians and biologists. In addition to traditional lectures and homeworks, we incorporated a series of weekly computational challenges into the course. These challenges served to familiarize students with the main modeling concepts, and provide them with an introduction on how to implement them in a research-like setting. In order to account for the different academic backgrounds of the students, they worked on the challenges in small groups, and presented their results and code in a dedicated discussion class each week. We discuss our experience designing and implementing an element of problem-based learning in an applied mathematics course through computational challenges. We also discuss feedback from students, and describe the content of the challenges presented in the course. We provide all materials, along with example code for a number of challenges.


title: Detecting and Mitigating Test-time Failure Risks via Model-agnostic Uncertainty Learning

abstract: Reliably predicting potential failure risks of machine learning (ML) systems when deployed with production data is a crucial aspect of trustworthy AI. This paper introduces Risk Advisor, a novel post-hoc meta-learner for estimating failure risks and predictive uncertainties of any already-trained black-box classification model. In addition to providing a risk score, the Risk Advisor decomposes the uncertainty estimates into aleatoric and epistemic uncertainty components, thus giving informative insights into the sources of uncertainty inducing the failures. Consequently, Risk Advisor can distinguish between failures caused by data variability, data shifts and model limitations and advise on mitigation actions (e.g., collecting more data to counter data shift). Extensive experiments on various families of black-box classification models and on real-world and synthetic datasets covering common ML failure scenarios show that the Risk Advisor reliably predicts deployment-time failure risks in all the scenarios, and outperforms strong baselines.


title: Extreme Bandits using Robust Statistics

abstract: We consider a multi-armed bandit problem motivated by situations where only the extreme values, as opposed to expected values in the classical bandit setting, are of interest. We propose distribution free algorithms using robust statistics and characterize the statistical properties. We show that the provided algorithms achieve vanishing extremal regret under weaker conditions than existing algorithms. Performance of the algorithms is demonstrated for the finite-sample setting using numerical experiments. The results show superior performance of the proposed algorithms compared to the well known algorithms.


title: RNAglib: A Python Package for RNA 2.5D Graphs

abstract: RNA 3D architectures are stabilized by sophisticated networks of (non-canonical) base pair interactions, which can be conveniently encoded as multi-relational graphs and efficiently exploited by graph theoretical approaches and recent progresses in machine learning techniques. RNAglib is a library that eases the use of this representation, by providing clean data, methods to load it in machine learning pipelines and graph-based deep learning models suited for this representation. RNAglib also offers other utilities to model RNA with 2.5D graphs, such as drawing tools, comparison functions or baseline performances on RNA applications. The method and data is distributed as a fully documented pip package. Availability: https://rnaglib.cs.mcgill.ca


title: Continuity of the temperature in a multi-phase transition problem

abstract: Locally bounded, local weak solutions to a doubly nonlinear parabolic equation, which models the multi-phase transition of a material, is shown to be locally continuous. Moreover, an explicit modulus of continuity is given. The effect of the $p$-Laplacian type diffusion is also considered.


title: Uniform structural phase transition in V$_2$O$_3$ without short-range distortions of the local structure

abstract: The local structure of V$_{2}$O$_{3}$, an archetypal strongly correlated electron system that displays a metal-insulator transition around 160 K, has been investigated via pair distribution function (PDF) analysis of neutron and x-ray total scattering data. The rhombohedral-to-monoclinic structural phase transition manifests as an abrupt change on all length scales in the observed PDF. No monoclinic distortions of the local structure are found above the transition, although coexisting regions of phase-separated rhombohedral and monoclinic symmetry are observed between 150 K and 160 K. This lack of structural fluctuations above the transition contrasts with the known presence of magnetic fluctuations in the high-temperature state, suggesting that the lattice degree of freedom plays a secondary role behind the spin degree of freedom in the transition mechanism.


title: Molecular Dynamics Simulations of Water Anchored in Multi-Layered Nanoporous MoS$_2$ Membranes: Implications for Desalination

abstract: One of the most promising applications in nanoscience is the design of new materials to improve water permeability and selectivity of nanoporous membranes. Understanding the molecular architecture behind these fascinating structures and how it impacts the water flow is an intricate but necessary task. We studied here, the water flux through multi-layered nanoporous molybdenum disulfide (MLNMoS$_2$) membranes with different nanopore sizes and length. Molecular dynamics simulations show that the permeability do not increase with the inverse of the membrane thickness, violating the classical hydrodynamic behavior. The data also reveals that the water dynamics is slower than that observed in frictionless carbon nanotubes and multi-layer graphene membranes, which we explain in terms of an anchor mechanism observed in between layers. We show that the membrane permeability is critically dependent on the nanopore architecture, bringing important insights into the manufacture of new desalination membranes.


title: Keisler's Theorem and Cardinal Invariants

abstract: We consider several variants of Keisler's isomorphism theorem. We separate these variants by showing implications between them and cardinal invariants hypotheses. We characterize saturation hypotheses that are stronger than Keisler's theorem with respect to models of size $\aleph_1$ and $\aleph_0$ by $\mathrm{CH}$ and $\operatorname{cov}(\mathsf{meager}) = \mathfrak{c} \land 2^{<\mathfrak{c}} = \mathfrak{c}$ respectively. We prove that Keisler's theorem for models of size $\aleph_1$ and $\aleph_0$ implies $\mathfrak{b} = \aleph_1$ and $\operatorname{cov}(\mathsf{null}) \le \mathfrak{d}$ respectively. As a consequence, Keisler's theorem for models of size $\aleph_0$ fails in the random model. We also show that for Keisler's theorem for models of size $\aleph_1$ to hold it is not necessary that $\operatorname{cov}(\mathsf{meager})$ equals $\mathfrak{c}$.


title: Driving chiral phase transition with ring diagram

abstract: We study the dressing of four-quark interaction by the ring diagram, and its feeding back to the quark gap equation, in an effective chiral quark model. Implementing such an in-medium coupling naturally reduces the chiral transition temperature in a class of chiral models, and is capable of generating the inverse magnetic catalysis at finite temperatures. We also demonstrate the important role of confining forces, via the Polyakov loop, in a positive feedback mechanism which reinforces the inverse magnetic catalysis.


title: '1e0a': A Computational Approach to Rhythm Training

abstract: We present a computational assessment system that promotes the learning of basic rhythmic patterns. The system is capable of generating multiple rhythmic patterns with increasing complexity within various cycle lengths. For a generated rhythm pattern the performance assessment of the learner is carried out through the statistical deviations calculated from the onset detection and temporal assessment of a learner's performance. This is compared with the generated pattern, and their performance accuracy forms the feedback to the learner. The system proceeds to generate a new pattern of increased complexity when performance assessment results are within certain error bounds. The system thus mimics a learner-teacher relationship as the learner progresses in their feedback-based learning. The choice of progression within a cycle for each pattern is determined by a predefined complexity metric. This metric is based on a coded element model for the perceptual processing of sequential stimuli. The model earlier proposed for a sequence of tones and non-tones, is now used for onsets and silences. This system is developed into a web-based application and provides accessibility for learning purposes. Analysis of the performance assessments shows that the complexity metric is indicative of the perceptual processing of rhythm patterns and can be used for rhythm learning.


title: Exponential bases for partitions of intervals

abstract: For a partition of $[0,1]$ into intervals $I_1,\ldots,I_n$ we prove the existence of a partition of $\mathbb{Z}$ into $\Lambda_1,\ldots, \Lambda_n$ such that the complex exponential functions with frequencies in $ \Lambda_k$ form a Riesz basis for $L^2(I_k)$, and furthermore, that for any $J\subseteq\{1,\,2,\,\dots,\,n\}$, the exponential functions with frequencies in $ \bigcup_{j\in J}\Lambda_j$ form a Riesz basis for $L^2(I)$ for any interval $I$ with length $|I|=\sum_{j\in J}|I_j|$. The construction extends to infinite partitions of $[0,1]$, but with size limitations on the subsets $J\subseteq \mathbb{Z}$; it combines the ergodic properties of subsequences of $\mathbb{Z}$ known as Beatty-Fraenkel sequences with a theorem of Avdonin on exponential Riesz bases.


title: FGOT: Graph Distances based on Filters and Optimal Transport

abstract: Graph comparison deals with identifying similarities and dissimilarities between graphs. A major obstacle is the unknown alignment of graphs, as well as the lack of accurate and inexpensive comparison metrics. In this work we introduce the filter graph distance. It is an optimal transport based distance which drives graph comparison through the probability distribution of filtered graph signals. This creates a highly flexible distance, capable of prioritising different spectral information in observed graphs, offering a wide range of choices for a comparison metric. We tackle the problem of graph alignment by computing graph permutations that minimise our new filter distances, which implicitly solves the graph comparison problem. We then propose a new approximate cost function that circumvents many computational difficulties inherent to graph comparison and permits the exploitation of fast algorithms such as mirror gradient descent, without grossly sacrificing the performance. We finally propose a novel algorithm derived from a stochastic version of mirror gradient descent, which accommodates the non-convexity of the alignment problem, offering a good trade-off between performance accuracy and speed. The experiments on graph alignment and classification show that the flexibility gained through filter graph distances can have a significant impact on performance, while the difference in speed offered by the approximation cost makes the framework applicable in practical settings.


title: HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints

abstract: Back-translation (BT) of target monolingual corpora is a widely used data augmentation strategy for neural machine translation (NMT), especially for low-resource language pairs. To improve effectiveness of the available BT data, we introduce HintedBT -- a family of techniques which provides hints (through tags) to the encoder and decoder. First, we propose a novel method of using both high and low quality BT data by providing hints (as source tags on the encoder) to the model about the quality of each source-target pair. We don't filter out low quality data but instead show that these hints enable the model to learn effectively from noisy data. Second, we address the problem of predicting whether a source token needs to be translated or transliterated to the target language, which is common in cross-script translation tasks (i.e., where source and target do not share the written script). For such cases, we propose training the model with additional hints (as target tags on the decoder) that provide information about the operation required on the source (translation or both translation and transliteration). We conduct experiments and detailed analyses on standard WMT benchmarks for three cross-script low/medium-resource language pairs: {Hindi,Gujarati,Tamil}-to-English. Our methods compare favorably with five strong and well established baselines. We show that using these hints, both separately and together, significantly improves translation quality and leads to state-of-the-art performance in all three language pairs in corresponding bilingual settings.


title: Locally free twisted sheaves of infinite rank

abstract: We study twisted vector bundles of infinite rank on gerbes, giving a new spin on Grothendieck's famous problem on the equality of the Brauer group and cohomological Brauer group. We show that the relaxed version of the question has an affirmative answer in many, but not all, cases, including for any algebraic space with the resolution property and any algebraic space obtained by pinching two closed subschemes of a projective scheme. We also discuss some possible theories of infinite rank Azumaya algebras, consider a new class of "very positive" infinite rank vector bundles on projective varieties, and show that an infinite rank vector bundle on a curve in a surface can be lifted to the surface away from finitely many points.


title: Common and Sidorenko equations in Abelian groups

abstract: A linear configuration is said to be common in a finite Abelian group $G$ if for every 2-coloring of $G$ the number of monochromatic instances of the configuration is at least as large as for a randomly chosen coloring. Saad and Wolf conjectured that if a configuration is defined as the solution set of a single homogeneous equation over $G$, then it is common in $\mathbb{F}_p^n$ if and only if the equation's coefficients can be partitioned into pairs that sum to zero mod $p$. This was proven by Fox, Pham and Zhao for sufficiently large $n$. We generalize their result to all sufficiently large Abelian groups $G$ for which the equation's coefficients are coprime to $\vert G\vert$


title: Entanglement and superposition are equivalent concepts in any physical theory

abstract: We prove that any two general probabilistic theories (GPTs) are entangleable, in the sense that their composite exhibits either entangled states or entangled measurements, if and only if they are both non-classical, meaning that neither of the state spaces is a simplex. This establishes the universal equivalence of the (local) superposition principle and the existence of global entanglement, valid in a fully theory-independent way. As an application of our techniques, we show that all non-classical GPTs exhibit a strong form of incompatibility of states and measurements, and use this to construct a version of the BB84 protocol that works in any non-classical GPT.


title: Modeling Massive Spatial Datasets Using a Conjugate Bayesian Linear Regression Framework

abstract: Geographic Information Systems (GIS) and related technologies have generated substantial interest among statisticians with regard to scalable methodologies for analyzing large spatial datasets. A variety of scalable spatial process models have been proposed that can be easily embedded within a hierarchical modeling framework to carry out Bayesian inference. While the focus of statistical research has mostly been directed toward innovative and more complex model development, relatively limited attention has been accorded to approaches for easily implementable scalable hierarchical models for the practicing scientist or spatial analyst. This article discusses how point-referenced spatial process models can be cast as a conjugate Bayesian linear regression that can rapidly deliver inference on spatial processes. The approach allows exact sampling directly (avoids iterative algorithms such as Markov chain Monte Carlo) from the joint posterior distribution of regression parameters, the latent process and the predictive random variables, and can be easily implemented on statistical programming environments such as R.


title: Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers

abstract: Pretrained vision-and-language BERTs aim to learn representations that combine information from both modalities. We propose a diagnostic method based on cross-modal input ablation to assess the extent to which these models actually integrate cross-modal information. This method involves ablating inputs from one modality, either entirely or selectively based on cross-modal grounding alignments, and evaluating the model prediction performance on the other modality. Model performance is measured by modality-specific tasks that mirror the model pretraining objectives (e.g. masked language modelling for text). Models that have learned to construct cross-modal representations using both modalities are expected to perform worse when inputs are missing from a modality. We find that recently proposed models have much greater relative difficulty predicting text when visual information is ablated, compared to predicting visual object categories when text is ablated, indicating that these models are not symmetrically cross-modal.


title: Conditionally rigorous mitigation of multiqubit measurement errors

abstract: Several techniques have been recently introduced to mitigate errors in near-term quantum computers without the overhead required by quantum error correcting codes. While most of the focus has been on gate errors, measurement errors are significantly larger than gate errors on some platforms. A widely used {\it transition matrix error mitigation} (TMEM) technique uses measured transition probabilities between initial and final classical states to correct subsequently measured data. However from a rigorous perspective, the noisy measurement should be calibrated with perfectly prepared initial states and the presence of any state-preparation error corrupts the resulting mitigation. Here we develop a measurement error mitigation technique, conditionally rigorous TMEM, that is not sensitive to state-preparation errors and thus avoids this limitation. We demonstrate the importance of the technique for high-precision measurement and for quantum foundations experiments by measuring Mermin polynomials on IBM Q superconducting qubits. An extension of the technique allows one to correct for both state-preparation and measurement (SPAM) errors in expectation values as well; we illustrate this by giving a protocol for fully SPAM-corrected quantum process tomography.


title: Investigating strong gravitational lensing effects by suppermassive black holes with Horndeski gravity

abstract: We study gravitational lensing in strong-field limit by a static spherically symmetric black hole in quartic scalar field Horndeski gravity having additional hair parameter $q$, evading the no-hair theorem. We find an increase in the deflection angle $\alpha_D$, photon sphere radius $x_{ps}$, and angular position $\theta_{\infty}$ that increases more quickly while angular separation $s$ more slowly, but the ratio of the flux of the first image to all other images $r_{mag}$ decreases rapidly with increasing magnitude of the hair $q$. We also discuss the astrophysical consequences in the supermassive black holes at the centre of several galaxies and note that the black holes in Horndeski gravity can be quantitatively distinguished from the Schwarzschild black hole. Notably, we find that the deviation $\Delta\theta_{\infty}$ of black holes in Horndeski gravity from their general relativity (GR) counterpart, for supermassive black holes Sgr A* and M87, for $q=-1$ respectively, can reach as much as $25.192~\mu$as and $18.92~\mu$as while $\Delta s$ is about $1.121~\mu$as for Sgr A* and $0.8424~\mu$as for M87*. The ratio of the flux of the first image to all other images suggest that the Schwarzschild images are brighter than those of the black holes in Horndeski gravity, wherein the deviation $|\Delta r_{mag}|$ is as much as 3.082. The results suggest that observational tests of hairy black holes in Horndeski gravity are indeed feasible.


title: The Atacama Cosmology Telescope: Constraints on Pre-Recombination Early Dark Energy

abstract: The early dark energy (EDE) scenario aims to increase the value of the Hubble constant ($H_0$) inferred from cosmic microwave background (CMB) data over that found in $\Lambda$CDM, via the introduction of a new form of energy density in the early universe. The EDE component briefly accelerates cosmic expansion just prior to recombination, which reduces the physical size of the sound horizon imprinted in the CMB. Previous work has found that non-zero EDE is not preferred by Planck CMB power spectrum data alone, which yield a 95% confidence level (CL) upper limit $f_{\rm EDE} < 0.087$ on the maximal fractional contribution of the EDE field to the cosmic energy budget. In this paper, we fit the EDE model to CMB data from the Atacama Cosmology Telescope (ACT) Data Release 4. We find that a combination of ACT, large-scale Planck TT (similar to WMAP), Planck CMB lensing, and BAO data prefers the existence of EDE at $>99.7$% CL: $f_{\rm EDE} = 0.091^{+0.020}_{-0.036}$, with $H_0 = 70.9^{+1.0}_{-2.0}$ km/s/Mpc (both 68% CL). From a model-selection standpoint, we find that EDE is favored over $\Lambda$CDM by these data at roughly $3\sigma$ significance. In contrast, a joint analysis of the full Planck and ACT data yields no evidence for EDE, as previously found for Planck alone. We show that the preference for EDE in ACT alone is driven by its TE and EE power spectrum data. The tight constraint on EDE from Planck alone is driven by its high-$\ell$ TT power spectrum data. Understanding whether these differing constraints are physical in nature, due to systematics, or simply a rare statistical fluctuation is of high priority. The best-fit EDE models to ACT and Planck exhibit coherent differences across a wide range of multipoles in TE and EE, indicating that a powerful test of this scenario is anticipated with near-future data from ACT and other ground-based experiments.


title: Analysis of Language Change in Collaborative Instruction Following

abstract: We analyze language change over time in a collaborative, goal-oriented instructional task, where utility-maximizing participants form conventions and increase their expertise. Prior work studied such scenarios mostly in the context of reference games, and consistently found that language complexity is reduced along multiple dimensions, such as utterance length, as conventions are formed. In contrast, we find that, given the ability to increase instruction utility, instructors increase language complexity along these previously studied dimensions to better collaborate with increasingly skilled instruction followers.


title: Tube-Certified Trajectory Tracking for Nonlinear Systems With Robust Control Contraction Metrics

abstract: This paper presents an approach towards guaranteed trajectory tracking for nonlinear control-affine systems subject to external disturbances based on robust control contraction metrics (CCM) that aims to minimize the $\mathcal L_\infty$ gain from the disturbances to nominal-actual trajectory deviations. The guarantee is in the form of invariant tubes, computed offline and valid for any nominal trajectories, in which the actual states and inputs of the system are guaranteed to stay despite disturbances. Under mild assumptions, we prove that the proposed robust CCM (RCCM) approach yields tighter tubes than an existing approach based on CCM and input-to-state stability analysis. We show how the RCCM-based tracking controller together with tubes can be incorporated into a feedback motion planning framework to plan safe trajectories for robotic systems. Simulation results illustrate the effectiveness of the proposed method and empirically demonstrate reduced conservatism compared to the CCM-based approach.


title: ConvMLP: Hierarchical Convolutional MLPs for Vision

abstract: MLP-based architectures, which consist of a sequence of consecutive multi-layer perceptron blocks, have recently been found to reach comparable results to convolutional and transformer-based methods. However, most adopt spatial MLPs which take fixed dimension inputs, therefore making it difficult to apply them to downstream tasks, such as object detection and semantic segmentation. Moreover, single-stage designs further limit performance in other computer vision tasks and fully connected layers bear heavy computation. To tackle these problems, we propose ConvMLP: a hierarchical Convolutional MLP for visual recognition, which is a light-weight, stage-wise, co-design of convolution layers, and MLPs. In particular, ConvMLP-S achieves 76.8% top-1 accuracy on ImageNet-1k with 9M parameters and 2.4G MACs (15% and 19% of MLP-Mixer-B/16, respectively). Experiments on object detection and semantic segmentation further show that visual representation learned by ConvMLP can be seamlessly transferred and achieve competitive results with fewer parameters. Our code and pre-trained models are publicly available at https://github.com/SHI-Labs/Convolutional-MLPs.


title: Analytical and computational study of cascade reaction processes in catalytic fibrous membranes

abstract: Multistep catalytic reactions use two different catalysts for the $A\to B$ and the subsequent $B\to C$ reaction, respectively. Often the employed catalysts are chemically incompatible, such as acid-base systems, which prohibits simple mixing in one solution. In this work, we study the efficiency of reactors where the incompatible catalytic sites are immobilized on fibrous membranes. We compare a lattice Boltzmann based solver for the advection-diffusion-reaction equation, a random walk particle tracking method and a simple theoretical model to investigate the reaction efficiency as a function of two dimensionless control parameters: the P\'eclet and the Damk\"ohler number. We find that, while the efficiency decreases with higher flow speed (due to the reduced reaction time), the total production nevertheless increases due to the higher mass flux in most cases. Our results further show that, even at high flow speeds, spatial proximity of the two catalysts increases reaction efficiency, which supports recent experimental efforts to locate both catalysts on a single fiber in a side-by-side geometry.


title: NEAT: Neural Attention Fields for End-to-End Autonomous Driving

abstract: Efficient reasoning about the semantic, spatial, and temporal structure of a scene is a crucial prerequisite for autonomous driving. We present NEural ATtention fields (NEAT), a novel representation that enables such reasoning for end-to-end imitation learning models. NEAT is a continuous function which maps locations in Bird's Eye View (BEV) scene coordinates to waypoints and semantics, using intermediate attention maps to iteratively compress high-dimensional 2D image features into a compact representation. This allows our model to selectively attend to relevant regions in the input while ignoring information irrelevant to the driving task, effectively associating the images with the BEV representation. In a new evaluation setting involving adverse environmental conditions and challenging scenarios, NEAT outperforms several strong baselines and achieves driving scores on par with the privileged CARLA expert used to generate its training data. Furthermore, visualizing the attention maps for models with NEAT intermediate representations provides improved interpretability.


title: Fundamental limits of quantum error mitigation

abstract: The inevitable accumulation of errors in near-future quantum devices represents a key obstacle in delivering practical quantum advantages, motivating the development of various quantum error-mitigation methods. Here, we derive fundamental bounds concerning how error-mitigation algorithms can reduce the computation error as a function of their sampling overhead. Our bounds place universal performance limits on a general error-mitigation protocol class. We use them to show (1) that the sampling overhead that ensures a certain computational accuracy for mitigating local depolarizing noise in layered circuits scales exponentially with the circuit depth for general error-mitigation protocols and (2) the optimality of probabilistic error cancellation among a wide class of strategies in mitigating the local dephasing noise on an arbitrary number of qubits. Our results provide a means to identify when a given quantum error-mitigation strategy is optimal and when there is potential room for improvement.


title: Joint constraints on cosmology and the impact of baryon feedback: combining KiDS-1000 lensing with the thermal Sunyaev-Zeldovich effect from Planck and ACT

abstract: We conduct a pseudo-$C_\ell$ analysis of the tomographic cross-correlation between 1000 deg$^2$ of weak lensing data from the Kilo-Degree Survey (KiDS-1000) and the thermal Sunyaev-Zeldovich (tSZ) effect measured by Planck and the Atacama Cosmology Telescope (ACT). Using HMx, a halo-model-based approach that consistently models the gas, star, and dark matter components, we are able to derive constraints on both cosmology and baryon feedback for the first time from these data, marginalising over redshift uncertainties, intrinsic alignment of galaxies, and contamination by the cosmic infrared background (CIB). We find our results to be insensitive to the CIB, while intrinsic alignment provides a small but significant contribution to the lensing--tSZ cross-correlation. The cosmological constraints are consistent with those of other low-redshift probes and prefer strong baryon feedback. The inferred amplitude of the lensing--tSZ cross-correlation signal, which scales as $\sigma_8(\Omega_\mathrm{m}/0.3)^{0.2}$, is low by $\sim 2\,\sigma$ compared to the primary cosmic microwave background constraints by Planck. The lensing--tSZ measurements are then combined with pseudo-$C_\ell$ measurements of KiDS-1000 cosmic shear into a novel joint analysis, accounting for the full cross-covariance between the probes, providing tight cosmological constraints by breaking parameter degeneracies inherent to both probes. The joint analysis gives an improvement of 40% on the constraint of $S_8=\sigma_8\sqrt{\Omega_\mathrm{m}/0.3}$ over cosmic shear alone, while providing constraints on baryon feedback consistent with hydrodynamical simulations, demonstrating the potential of such joint analyses with baryonic tracers such as the tSZ effect. We discuss remaining modelling challenges that need to be addressed if these baryonic probes are to be included in future precision-cosmology analyses.