title: Graph-theoretical approach to robust 3D normal extraction of LiDAR data

abstract: Low dimensional primitive feature extraction from LiDAR point clouds (such as planes) forms the basis of majority of LiDAR data processing tasks. A major challenge in LiDAR data analysis arises from the irregular nature of LiDAR data that forces practitioners to either regularize the data using some form of gridding or utilize a triangular mesh such as triangulated irregular network (TIN). While there have been a handful applications using LiDAR data as a connected graph, a principled treatment of utilizing graph-theoretical approach for LiDAR data modelling is still lacking. In this paper, we try to bridge this gap by utilizing graphical approach for normal estimation from LiDAR point clouds. We formulate the normal estimation problem in an optimization framework, where we find the corresponding normal vector for each LiDAR point by utilizing its nearest neighbors and simultaneously enforcing a graph smoothness assumption based on point samples. This is a non-linear constrained convex optimization problem which can then be solved using projected conjugate gradient descent to yield an unique solution. As an enhancement to our optimization problem, we also provide different weighted solutions based on the dot product of the normals and Euclidean distance between the points. In order to assess the performance of our proposed normal extraction method and weighting strategies, we first provide a detailed analysis on repeated randomly generated datasets with four different noise levels and four different tuning parameters. Finally, we benchmark our proposed method against existing state-of-the-art approaches on a large scale synthetic plane extraction dataset. The code for the proposed approach along with the simulations and benchmarking is available at https://github.com/arpan-kusari/graph-plane-extraction-simulation.


title: Undecidability of Network Coding, Conditional Information Inequalities, and Conditional Independence Implication

abstract: We resolve three long-standing open problems, namely the (algorithmic) decidability of network coding, the decidability of conditional information inequalities, and the decidability of conditional independence implication among random variables, by showing that these problems are undecidable. The proof utilizes a construction inspired by Herrmann's arguments on embedded multivalued database dependencies, a network studied by Dougherty, Freiling and Zeger, together with a novel construction to represent group automorphisms on top of the network.


title: Discovery of a Single-Band Mott Insulator in a van der Waals Flat-Band Compound

abstract: The Mott insulator provides an excellent foundation for exploring a wide range of strongly correlated physical phenomena, such as high-temperature superconductivity, quantum spin liquid, and colossal magnetoresistance. A Mott insulator with the simplest degree of freedom is an ideal and highly desirable system for studying the fundamental physics of Mottness. In this study, we have unambiguously identified such an anticipated Mott insulator in a van der Waals layered compound Nb3Cl8. In the high-temperature phase, where interlayer coupling is negligible, density functional theory calculations for the monolayer of Nb3Cl8 suggest a half-filled flat band at the Fermi level, whereas angle-resolved photoemission spectroscopy experiments observe a large gap. This observation is perfectly reproduced by dynamical mean-field theory calculations considering strong electron correlations, indicating a correlation-driven Mott insulator state. Since this half-filled band derived from a single 2a1 orbital is isolated from all other bands, the monolayer of Nb3Cl8 is an ideal realization of the celebrated single-band Hubbard model. Upon decreasing the temperature, the bulk system undergoes a phase transition, where structural changes significantly enhance the interlayer coupling. This results in a bonding-antibonding splitting in the Hubbard bands, while the Mott gap remains dominant. Our discovery provides a simple and seminal model system for investigating Mott physics and other emerging correlated states.


title: Context Limitations Make Neural Language Models More Human-Like

abstract: Language models (LMs) have been used in cognitive modeling as well as engineering studies -- they compute information-theoretic complexity metrics that simulate humans' cognitive load during reading. This study highlights a limitation of modern neural LMs as the model of choice for this purpose: there is a discrepancy between their context access capacities and that of humans. Our results showed that constraining the LMs' context access improved their simulation of human reading behavior. We also showed that LM-human gaps in context access were associated with specific syntactic constructions; incorporating syntactic biases into LMs' context access might enhance their cognitive plausibility.


title: A New Formulation for the Concerted Alchemical Calculation of van der Waals and Coulomb Components of Solvation Free Energies

abstract: Alchemical free energy calculations via molecular dynamics have been widely used to obtain thermodynamic properties related to protein-ligand binding and solute-solvent interactions. Although soft-core modeling is the most common approach, the linear basis function (LBF) methodology [Naden, L. N.; et al. J. Chem. Theory Comput. 2014, 10 (3), 1128; 2015, 11 (6), 2536] has emerged as a suitable alternative. It overcomes the end-point singularity of the scaling method while maintaining essential advantages such as ease of implementation and high flexibility for postprocessing analysis. In the present work, we propose a simple LBF variant and formulate an efficient protocol for evaluating van der Waals and Coulomb components of an alchemical transformation in tandem, in contrast to the prevalent sequential evaluation mode. To validate our proposal, which results from a careful optimization study, we performed solvation free energy calculations and obtained octanol-water partition coefficients of small organic molecules. Comparisons with results obtained via the sequential mode using either another LBF approach or the soft-core model attest to the effectiveness and correctness of our method. In addition, we show that a reaction field model with an infinite dielectric constant can provide very accurate hydration free energies when used instead of a lattice-sum method to model solute-solvent electrostatics.


title: SQuALITY: Building a Long-Document Summarization Dataset the Hard Way

abstract: Summarization datasets are often assembled either by scraping naturally occurring public-domain summaries -- which are nearly always in difficult-to-work-with technical domains -- or by using approximate heuristics to extract them from everyday text -- which frequently yields unfaithful summaries. In this work, we turn to a slower but more straightforward approach to developing summarization benchmark data: We hire highly-qualified contractors to read stories and write original summaries from scratch. To amortize reading time, we collect five summaries per document, with the first giving an overview and the subsequent four addressing specific questions. We use this protocol to collect SQuALITY, a dataset of question-focused summaries built on the same public-domain short stories as the multiple-choice dataset QuALITY (Pang et al., 2021). Experiments with state-of-the-art summarization systems show that our dataset is challenging and that existing automatic evaluation metrics are weak indicators of quality.


title: Low-Rank Univariate Sum of Squares Has No Spurious Local Minima

abstract: We study the problem of decomposing a polynomial $p$ into a sum of $r$ squares by minimizing a quadratically penalized objective $f_p(\mathbf{u}) = \left\lVert \sum_{i=1}^r u_i^2 - p\right\lVert^2$. This objective is nonconvex and is equivalent to the rank-$r$ Burer-Monteiro factorization of a semidefinite program (SDP) encoding the sum of squares decomposition. We show that for all univariate polynomials $p$, if $r \ge 2$ then $f_p(\mathbf{u})$ has no spurious second-order critical points, showing that all local optima are also global optima. This is in contrast to previous work showing that for general SDPs, in addition to genericity conditions, $r$ has to be roughly the square root of the number of constraints (the degree of $p$) for there to be no spurious second-order critical points. Our proof uses tools from computational algebraic geometry and can be interpreted as constructing a certificate using the first- and second-order necessary conditions. We also show that by choosing a norm based on sampling equally-spaced points on the circle, the gradient $\nabla f_p$ can be computed in nearly linear time using fast Fourier transforms. Experimentally we demonstrate that this method has very fast convergence using first-order optimization algorithms such as L-BFGS, with near-linear scaling to million-degree polynomials.


title: A Question-Answer Driven Approach to Reveal Affirmative Interpretations from Verbal Negations

abstract: This paper explores a question-answer driven approach to reveal affirmative interpretations from verbal negations (i.e., when a negation cue grammatically modifies a verb). We create a new corpus consisting of 4,472 verbal negations and discover that 67.1% of them convey that an event actually occurred. Annotators generate and answer 7,277 questions for the 3,001 negations that convey an affirmative interpretation. We first cast the problem of revealing affirmative interpretations from negations as a natural language inference (NLI) classification task. Experimental results show that state-of-the-art transformers trained with existing NLI corpora are insufficient to reveal affirmative interpretations. We also observe, however, that fine-tuning brings small improvements. In addition to NLI classification, we also explore the more realistic task of generating affirmative interpretations directly from negations with the T5 transformer. We conclude that the generation task remains a challenge as T5 substantially underperforms humans.


title: Multiple points on the boundaries of Brownian loop-soup clusters

abstract: For a Brownian loop soup with intensity $c\in(0,1]$ in the unit disk, we show that almost surely, the set of simple (resp. double) points on any portion of boundary of any of its clusters has Hausdorff dimension $2-\xi_c(2)$ (resp. $2-\xi_c(4)$), where $\xi_c(k)$ is the generalized disconnection exponent computed in arxiv:1901.05436. As a consequence, when the dimension is positive, such points are a.s. dense on every boundary of every cluster. There are a.s. no triple points on the cluster boundaries. As an intermediate result, we establish a separation lemma for Brownian loop soups, which is a powerful tool for obtaining sharp estimates on non-intersection and non-disconnection probabilities in the setting of loop soups. In particular, it allows us to define a family of generalized intersection exponents $\xi_c(k, \lambda)$, and show that $\xi_c(k)$ is the limit as $\lambda\searrow 0$ of $\xi_c(k, \lambda)$.


title: Advanced Transient Diagnostic with Ensemble Digital Twin Modeling

abstract: The use of machine learning (ML) model as digital-twins for reduced-order-modeling (ROM) in lieu of system codes has grown traction over the past few years. However, due to the complex and non-linear nature of nuclear reactor transients as well as the large range of tasks required, it is infeasible for a single ML model to generalize across all tasks. In this paper, we incorporate issue specific digital-twin ML models with ensembles to enhance the prediction outcome. The ensemble also utilizes an indirect probabilistic tracking method of surrogate state variables to produce accurate predictions of unobservable safety goals. The unique method named Ensemble Diagnostic Digital-twin Modeling (EDDM) can select not only the most appropriate predictions from the incorporated diagnostic digital-twin models but can also reduce generalization error associated with training as opposed to single models.


title: Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learning

abstract: In this paper, we develop new efficient projection-free algorithms for Online Convex Optimization (OCO). Online Gradient Descent (OGD) is an example of a classical OCO algorithm that guarantees the optimal $O(\sqrt{T})$ regret bound. However, OGD and other projection-based OCO algorithms need to perform a Euclidean projection onto the feasible set $\mathcal{C}\subset \mathbb{R}^d$ whenever their iterates step outside $\mathcal{C}$. For various sets of interests, this projection step can be computationally costly, especially when the ambient dimension is large. This has motivated the development of projection-free OCO algorithms that swap Euclidean projections for often much cheaper operations such as Linear Optimization (LO). However, state-of-the-art LO-based algorithms only achieve a suboptimal $O(T^{3/4})$ regret for general OCO. In this paper, we leverage recent results in parameter-free Online Learning, and develop an OCO algorithm that makes two calls to an LO Oracle per round and achieves the near-optimal $\widetilde{O}(\sqrt{T})$ regret whenever the feasible set is strongly convex. We also present an algorithm for general convex sets that makes $\widetilde O(d)$ expected number of calls to an LO Oracle per round and guarantees a $\widetilde O(T^{2/3})$ regret, improving on the previous best $O(T^{3/4})$. We achieve the latter by approximating any convex set $\mathcal{C}$ by a strongly convex one, where LO can be performed using $\widetilde {O}(d)$ expected number of calls to an LO Oracle for $\mathcal{C}$.


title: Dark-fluid constraints of shear-free universes

abstract: Integrability conditions arising from general irrotational fluid-flow considerations of a universe dominated by cosmic dark fluids will be investigated under special assumptions on the nature of the spacetime shear. Special emphasis will be placed on linearized perturbations of quasi-Newtonian and anti-Newtonian spacetimes, whereby the conditions for the existence and consistent evolution of such spacetimes in the presence of the Chaplygin gas fluid model will be derived and discussed.


title: Diversity Over Size: On the Effect of Sample and Topic Sizes for Argument Mining Datasets

abstract: The task of Argument Mining, that is extracting argumentative sentences for a specific topic from large document sources, is an inherently difficult task for machine learning models and humans alike, as large Argument Mining datasets are rare and recognition of argumentative sentences requires expert knowledge. The task becomes even more difficult if it also involves stance detection of retrieved arguments. Given the cost and complexity of creating suitably large Argument Mining datasets, we ask whether it is necessary for acceptable performance to have datasets growing in size. Our findings show that, when using carefully composed training samples and a model pretrained on related tasks, we can reach 95% of the maximum performance while reducing the training sample size by at least 85%. This gain is consistent across three Argument Mining tasks on three different datasets. We also publish a new dataset for future benchmarking.


title: Rethinking Streaming Machine Learning Evaluation

abstract: While most work on evaluating machine learning (ML) models focuses on computing accuracy on batches of data, tracking accuracy alone in a streaming setting (i.e., unbounded, timestamp-ordered datasets) fails to appropriately identify when models are performing unexpectedly. In this position paper, we discuss how the nature of streaming ML problems introduces new real-world challenges (e.g., delayed arrival of labels) and recommend additional metrics to assess streaming ML performance.


title: Exposing Outlier Exposure: What Can Be Learned From Few, One, and Zero Outlier Images

abstract: Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that unsupervised image AD can be drastically improved through the utilization of huge corpora of random images to represent anomalousness; a technique which is known as Outlier Exposure. In this paper we show that specialized AD learning methods seem unnecessary for state-of-the-art performance, and furthermore one can achieve strong performance with just a small collection of Outlier Exposure data, contradicting common assumptions in the field of AD. We find that standard classifiers and semi-supervised one-class methods trained to discern between normal samples and relatively few random natural images are able to outperform the current state of the art on an established AD benchmark with ImageNet. Further experiments reveal that even one well-chosen outlier sample is sufficient to achieve decent performance on this benchmark (79.3% AUC). We investigate this phenomenon and find that one-class methods are more robust to the choice of training outliers, indicating that there are scenarios where these are still more useful than standard classifiers. Additionally, we include experiments that delineate the scenarios where our results hold. Lastly, no training samples are necessary when one uses the representations learned by CLIP, a recent foundation model, which achieves state-of-the-art AD results on CIFAR-10 and ImageNet in a zero-shot setting.


title: Study of $I=0$ bottomonium bound states and resonances in $S$, $P$, $D$ and $F$ waves with lattice QCD static-static-light-light potentials

abstract: In this paper we study $I = 0$ bottomonium in $S$, $P$, $D$ and $F$ waves considering five coupled channels, one confined quarkonium and four open $B^{(*)} \bar B^{(*)}$ and $B_s^{(*)} \bar B_s^{(*)}$ meson-meson channels. To this end we use and extend a recently developed novel approach utilizing lattice QCD string breaking potentials for the study of quarkonium bound states and resonances. This approach is based on the Born Oppenheimer approximation and the unitary emergent wave method and allows to compute the poles of the $\mbox{T}$ matrix. We compare our results to existing experimental results for $I = 0$ bottomonium and discuss masses, decay widths and the assignment of angular momentum quantum numbers. Moreover, we determine the quarkonium and meson-meson composition of these states to clarify, which of them are ordinary quarkonium, and which of them should rather be interpreted as tetraquarks.


title: An analogical model for the stationary black holes by the flow field of space-time fluid around a 3-dimensional point sink

abstract: Recent researches suggest an analogy between the theory of general relativity (GR) and fluid dynamics. As a result of this analogy, the Navier-Stokes equations and Einstein field equations are the same, and it is possible to study the properties of space-time by using fluid mechanics. In this paper, we present a new model to describe gravitational phenomena by an inviscid and compressible fluid called space-time fluid (STF). The analogy method is used to obtain the gravity field of both static and rotating masses from the flow field of STF around static and rotating point sinks. In addition, event horizons and the ergosphere of stationary black holes are defined based on our STF model. Then, we compare hydrodynamic forces exerted on a test particle with gravitational forces in the gravitoelectromagnetic approximation of the GR. As a natural consequence, it is shown that inertial and gravitational masses are equivalent in this analogy. Finally, using the aspect of fluid dynamics, Mach's principle, weak equivalence principle, and information discontinuity on the event horizon are discussed.


title: Loop-corrected subleading soft theorem and the celestial stress-tensor

abstract: We demonstrate that the one-loop exact subleading soft graviton theorem automatically follows from conservation of the BMS charges, provided that the hard and soft fluxes separately represent the extended BMS algebra at null infinity. This confirms that superrotations are genuine symmetries of the gravitational $\mathcal{S}$-matrix beyond the semiclassical regime. In contrast with a previous proposal, the celestial stress-tensor accounting for the one-loop corrections follows from the gravitational phase space analysis and does not require the addition of divergent counterterms. In addition, we show that the symplectic form on the radiative phase space factorises into hard and soft sectors, and that the resulting canonical generators precisely coincide with the correct BMS fluxes.


title: SYK does not Transit Gloria Mundi just yet

abstract: This note discusses examples of 0+1-dimensional Liouvillean dynamics instigated by the various deformations of the Sachdev-Ye-Kitaev (SYK) model. In reference to such deformations the main focus is on the regions of parameter space where the competing SYK couplings are of comparable strength and can not be treated as each others perturbations in the vicinity of the conformal fixed points corresponding to the pure SYK_q models with different values of $q$. Crossovers between such fixed points ('SYK transits') can be efficiently studied in the equivalent framework of single-particle quantum mechanics.


title: Optically induced resonant tunneling of electrons in nanostructures

abstract: We developed the theory of elastic electron tunneling through a potential barrier driven by a strong high-frequency electromagnetic field. It is demonstrated that the driven barrier can be considered as a stationary two-barrier potential which contains the quasi-stationary electron states confined between these two barriers. When the energy of an incident electron coincides with the energy of the quasi-stationary state, the driven barrier becomes fully transparent for the electron (the resonant tunneling). The developed theory is applied to describe electron transport through a quantum point contact irradiated by an electromagnetic wave.


title: Novel Light Field Imaging Device with Enhanced Light Collection for Cold Atom Clouds

abstract: We present a light field imaging system that captures multiple views of an object with a single shot. The system is designed to maximize the total light collection by accepting a larger solid angle of light than a conventional lens with equivalent depth of field. This is achieved by populating a plane of virtual objects using mirrors and fully utilizing the available field of view and depth of field. Simulation results demonstrate that this design is capable of single-shot tomography of objects of size $\mathcal{O}$(1 mm$^3$), reconstructing the 3-dimensional (3D) distribution and features not accessible from any single view angle in isolation. In particular, for atom clouds used in atom interferometry experiments, the system can reconstruct 3D fringe patterns with size $\mathcal{O}$(100 $\mu$m). We also demonstrate this system with a 3D-printed prototype. The prototype is used to take images of $\mathcal{O}$(1 mm$^{3}$) sized objects, and 3D reconstruction algorithms running on a single-shot image successfully reconstruct $\mathcal{O}$(100 $\mu$m) internal features. The prototype also shows that the system can be built with 3D printing technology and hence can be deployed quickly and cost-effectively in experiments with needs for enhanced light collection or 3D reconstruction. Imaging of cold atom clouds in atom interferometry is a key application of this new type of imaging device where enhanced light collection, high depth of field, and 3D tomographic reconstruction can provide new handles to characterize the atom clouds.

categories: physics.ins-det cs.CV physics.atom-ph physics.optics quant-ph


title: Fabrication-Robust Silicon Photonic Devices in Standard Sub-Micron Silicon-on-Insulator Processes

abstract: Perturbations to the effective refractive index from nanometer-scale fabrication variations in waveguide geometry plague high index-contrast photonic platforms including the ubiquitous sub-micron silicon-on-insulator (SOI) process. Such variations are particularly troublesome for phase-sensitive devices such as interferometers and resonators, which exhibit drastic changes in performance as a result of these fabrication-induced phase errors. In this Letter, we propose and experimentally demonstrate a design methodology for dramatically reducing device sensitivity to silicon width variations. We apply this methodology to a highly phase-sensitive device, the ring-assisted Mach Zehnder interferometer (RAMZI), and show comparable performance and footprint to state-of-the-art devices while substantially reducing stochastic phase errors from etch variations. This decrease in sensitivity is directly realized as energy savings by significantly lowering the required corrective thermal tuning power, providing a promising path towards ultra-energy-efficient large-scale silicon photonic circuits.


title: Towards Tracing Factual Knowledge in Language Models Back to the Training Data

abstract: Language models (LMs) have been shown to memorize a great deal of factual knowledge contained in their training data. But when an LM generates an assertion, it is often difficult to determine where it learned this information and whether it is true. In this paper, we propose the problem of fact tracing: identifying which training examples taught an LM to generate a particular factual assertion. Prior work on training data attribution (TDA) may offer effective tools for identifying such examples, known as "proponents". We present the first quantitative benchmark to evaluate this. We compare two popular families of TDA methods -- gradient-based and embedding-based -- and find that much headroom remains. For example, both methods have lower proponent-retrieval precision than an information retrieval baseline (BM25) that does not have access to the LM at all. We identify key challenges that may be necessary for further improvement such as overcoming the problem of gradient saturation, and also show how several nuanced implementation details of existing neural TDA methods can significantly improve overall fact tracing performance.


title: Learning differential equations from data

abstract: Differential equations are used to model problems that originate in disciplines such as physics, biology, chemistry, and engineering. In recent times, due to the abundance of data, there is an active search for data-driven methods to learn Differential equation models from data. However, many numerical methods often fall short. Advancements in neural networks and deep learning, have motivated a shift towards data-driven deep learning methods of learning differential equations from data. In this work, we propose a forward-Euler based neural network model and test its performance by learning ODEs such as the FitzHugh-Nagumo equations from data using different number of hidden layers and different neural network width.


title: Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyond

abstract: Natural language processing technology has rapidly improved automated grammatical error correction tasks, and the community begins to explore document-level revision as one of the next challenges. To go beyond sentence-level automated grammatical error correction to NLP-based document-level revision assistant, there are two major obstacles: (1) there are few public corpora with document-level revisions being annotated by professional editors, and (2) it is not feasible to elicit all possible references and evaluate the quality of revision with such references because there are infinite possibilities of revision. This paper tackles these challenges. First, we introduce a new document-revision corpus, TETRA, where professional editors revised academic papers sampled from the ACL anthology which contain few trivial grammatical errors that enable us to focus more on document- and paragraph-level edits such as coherence and consistency. Second, we explore reference-less and interpretable methods for meta-evaluation that can detect quality improvements by document revision. We show the uniqueness of TETRA compared with existing document revision corpora and demonstrate that a fine-tuned pre-trained language model can discriminate the quality of documents after revision even when the difference is subtle. This promising result will encourage the community to further explore automated document revision models and metrics in future.


title: Conditional Supervised Contrastive Learning for Fair Text Classification

abstract: Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance disparities in downstream tasks, such as increased silencing of underrepresented groups in toxicity comment classification. In light of this challenge, in this work, we study learning fair representations that satisfy a notion of fairness known as equalized odds for text classification via contrastive learning. Specifically, we first theoretically analyze the connections between learning representations with a fairness constraint and conditional supervised contrastive objectives, and then propose to use conditional supervised contrastive objectives to learn fair representations for text classification. We conduct experiments on two text datasets to demonstrate the effectiveness of our approaches in balancing the trade-offs between task performance and bias mitigation among existing baselines for text classification. Furthermore, we also show that the proposed methods are stable in different hyperparameter settings.


title: Robust and Agnostic Learning of Conditional Distributional Treatment Effects

abstract: The conditional average treatment effect (CATE) is the best measure of individual causal effects given baseline covariates. However, the CATE only captures the (conditional) average, and can overlook risks and tail events, which are important to treatment choice. In aggregate analyses, this is usually addressed by measuring the distributional treatment effect (DTE), such as differences in quantiles or tail expectations between treatment groups. Hypothetically, one can similarly fit conditional quantile regressions in each treatment group and take their difference, but this would not be robust to misspecification or provide agnostic best-in-class predictions. We provide a new robust and model-agnostic methodology for learning the conditional DTE (CDTE) for a class of problems that includes conditional quantile treatment effects, conditional super-quantile treatment effects, and conditional treatment effects on coherent risk measures given by $f$-divergences. Our method is based on constructing a special pseudo-outcome and regressing it on covariates using any regression learner. Our method is model-agnostic in that it can provide the best projection of CDTE onto the regression model class. Our method is robust in that even if we learn these nuisances nonparametrically at very slow rates, we can still learn CDTEs at rates that depend on the class complexity and even conduct inferences on linear projections of CDTEs. We investigate the behavior of our proposal in simulations, as well as in a case study of 401(k) eligibility effects on wealth.


title: Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding

abstract: We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understanding. Imagen builds on the power of large transformer language models in understanding text and hinges on the strength of diffusion models in high-fidelity image generation. Our key discovery is that generic large language models (e.g. T5), pretrained on text-only corpora, are surprisingly effective at encoding text for image synthesis: increasing the size of the language model in Imagen boosts both sample fidelity and image-text alignment much more than increasing the size of the image diffusion model. Imagen achieves a new state-of-the-art FID score of 7.27 on the COCO dataset, without ever training on COCO, and human raters find Imagen samples to be on par with the COCO data itself in image-text alignment. To assess text-to-image models in greater depth, we introduce DrawBench, a comprehensive and challenging benchmark for text-to-image models. With DrawBench, we compare Imagen with recent methods including VQ-GAN+CLIP, Latent Diffusion Models, and DALL-E 2, and find that human raters prefer Imagen over other models in side-by-side comparisons, both in terms of sample quality and image-text alignment. See https://imagen.research.google/ for an overview of the results.


title: Entanglements

abstract: Robertson and Seymour constructed for every graph $G$ a tree-decomposition that efficiently distinguishes all the tangles in $G$. While all previous constructions of these decompositions are either iterative in nature or not canonical, we give an explicit one-step construction that is canonical. The key ingredient is an axiomatisation of 'local properties' of tangles. Generalisations to locally finite graphs and matroids are also discussed.


title: Hodge-to-singular correspondence for reduced curves

abstract: We study the summands of the decomposition theorem for the Hitchin system for $\mathrm{GL}_n$, in arbitrary degree, over the locus of reduced spectral curves. A key ingredient is a new correspondence between these summands and the topology of hypertoric quiver varieties. In contrast to the case of meromorphic Higgs fields, the intersection cohomology groups of moduli spaces of regular Higgs bundles depend on the degree. We describe this dependence.


title: Local Byte Fusion for Neural Machine Translation

abstract: Subword tokenization schemes are the dominant technique used in current NLP models. However, such schemes can be rigid and tokenizers built on one corpus do not adapt well to other parallel corpora. It has also been observed that in multilingual corpora, subword tokenization schemes over-segment low-resource languages leading to a drop in translation performance. A simple alternative to subword tokenizers is byte-based methods i.e. tokenization into byte sequences using encoding schemes such as UTF-8. Byte tokens often represent inputs at a sub-character granularity i.e. one character can be represented by a sequence of multiple byte tokens. This results in byte sequences that are significantly longer than character sequences. Enforcing aggregation of local information in the lower layers can guide the model to build higher-level semantic information. We propose a Local Byte Fusion (LOBEF) method for byte-based machine translation -- utilizing byte $n$-gram and word boundaries -- to aggregate local semantic information. Extensive experiments on multilingual translation, zero-shot cross-lingual transfer, and domain adaptation reveal a consistent improvement over traditional byte-based models and even over subword techniques. Further analysis also indicates that our byte-based models are parameter-efficient and can be trained faster than subword models.


title: HyperTree Proof Search for Neural Theorem Proving

abstract: We propose an online training procedure for a transformer-based automated theorem prover. Our approach leverages a new search algorithm, HyperTree Proof Search (HTPS), inspired by the recent success of AlphaZero. Our model learns from previous proof searches through online training, allowing it to generalize to domains far from the training distribution. We report detailed ablations of our pipeline's main components by studying performance on three environments of increasing complexity. In particular, we show that with HTPS alone, a model trained on annotated proofs manages to prove 65.4% of a held-out set of Metamath theorems, significantly outperforming the previous state of the art of 56.5% by GPT-f. Online training on these unproved theorems increases accuracy to 82.6%. With a similar computational budget, we improve the state of the art on the Lean-based miniF2F-curriculum dataset from 31% to 42% proving accuracy.


title: Design, construction and commissioning of a high-flow radon removal system for XENONnT

abstract: A high-flow radon removal system based on cryogenic distillation was developed and constructed to reduce radon-induced backgrounds in liquid xenon detectors for rare event searches such as XENONnT. A continuous purification of the XENONnT liquid xenon inventory of 8.4 tonnes at process flows up to 71 kg/h (200 slpm) is required to achieve a radon reduction by a factor two for radon sources inside the detector. To reach such high flows, the distillation column's design features liquid xenon inlet and outlets along with novel custom-made bath-type heat exchangers with high liquefaction capabilities. The distillation process was designed using a modification of the McCabe-Thiele approach without a bottom product extraction. The thermodynamic concept is based on a Clausius-Rankine cooling cycle with phase-changing medium, in this case the xenon itself. To drastically reduce the external cooling power requirements, an energy efficient heat pump concept was developed applying a custom-made four cylinder magnetically-coupled piston pump as compressor. The distillation system was operated at thermodynamically stable conditions at a process flow of (91$\pm$2) kg/h ((258$\pm$6) slpm), 30 % over design. With this flow, a $^{222}$Rn activity concentration <1 $\mu$Bq/kg is expected inside the XENONnT detector given the measured radon source distribution.


title: New description of neutrino flavour evolution in solar matter

abstract: Assuming that the interacting neutrino and the solar matter can be treated as an open quantum system we formulate a formalism of neutrino state evolution in terms of the Bloch vector, obtained by solving a quasilinear extension of the von Neumann equation. We broaden the classical Wolfenstein formalism by means of exploiting the strictly linear von Neumann equation and reinterpreting the results in terms of the quantities appropriate for the quasilinear approach. We obtain similar predictions for the averaged neutrino survival probability measured on Earth in both approaches, differing by details inside the Sun where the quasilinear evolution predicts a suppression of oscillations. We discuss the issues of energy transfer between the neutrino and the Sun and the speed of the state evolution in both approaches.


title: Hopf-Galois extensions and twisted Hopf algebroids

abstract: We show that the Ehresmann-Schauenburg bialgebroid of a quantum principal bundle $P$ or Hopf Galois extension with structure quantum group $H$ is in fact a left Hopf algebroid $L(P,H)$. We show further that if $H$ is coquasitriangular then $L(P,H)$ has an antipode map $S$ obeying certain minimal axioms. Trivial quantum principal bundles or cleft Hopf Galois extensions with base $B$ are known to be cocycle cross products $B\#_\sigma H$ for a cocycle-action pair ($\vartriangleright$,$\sigma$) and we look at these of a certain `associative type' where $ \vartriangleright$ is an actual action. In this case also, we show that the associated left Hopf algebroid has an antipode obeying our minimal axioms. We show that if $L$ is any left Hopf algebroid then so is its cotwist $L^\varsigma$ as an extension of the previous bialgebroid Drinfeld cotwist theory. We show that in the case of associative type, $L(B\#_\sigma H,H)=L(B\# H)^{\tilde\sigma}$ for a Hopf algebroid cotwist $\varsigma=\tilde\sigma$. Thus, switching on $\sigma$ of associative type appears at the Hopf algebroid level as a Drinfeld cotwist. We view the affine quantum group $\hat{U_q(sl_2)}$ and the quantum Weyl group of $u_q(sl_2)$ as examples of associative type.


title: Flexible Diffusion Modeling of Long Videos

abstract: We present a framework for video modeling based on denoising diffusion probabilistic models that produces long-duration video completions in a variety of realistic environments. We introduce a generative model that can at test-time sample any arbitrary subset of video frames conditioned on any other subset and present an architecture adapted for this purpose. Doing so allows us to efficiently compare and optimize a variety of schedules for the order in which frames in a long video are sampled and use selective sparse and long-range conditioning on previously sampled frames. We demonstrate improved video modeling over prior work on a number of datasets and sample temporally coherent videos over 25 minutes in length. We additionally release a new video modeling dataset and semantically meaningful metrics based on videos generated in the CARLA autonomous driving simulator.


title: Robust multiscale estimation of time-average variance for time series segmentation

abstract: There exist several methods developed for the canonical change point problem of detecting multiple mean shifts, which search for changes over sections of the data at multiple scales. In such methods, estimation of the noise level is often required in order to distinguish genuine changes from random fluctuations due to the noise. When serial dependence is present, using a single estimator of the noise level may not be appropriate. Instead, it is proposed to adopt a scale-dependent time-average variance constant that depends on the length of the data section in consideration, to gauge the level of the noise therein. Accordingly, an estimator that is robust to the presence of multiple mean shifts is developed. The consistency of the proposed estimator is shown under general assumptions permitting heavy-tailedness, and its use with two widely adopted data segmentation algorithms, the moving sum and the wild binary segmentation procedures, is discussed. The performance of the proposed estimator is illustrated through extensive simulation studies and on applications to the house price index and air quality data sets.


title: Global Dynamics Above The Ground State Energy For The Energy-Critical Klein-Gordon Equation

abstract: Consider the focusing energy-critical Klein-Gordon equation in dimension d=3,4,5. We describe the global dynamics of real-valued solutions of which the energy is slightly larger than that of the ground states'. We classify the flows of the solutions that are ejected from a small neighborhood of the ground states or that are away from them.


title: Injecting Domain Adaptation with Learning-to-hash for Effective and Efficient Zero-shot Dense Retrieval

abstract: Dense retrieval overcome the lexical gap and has shown great success in ad-hoc information retrieval (IR). Despite their success, dense retrievers are expensive to serve across practical use cases. For use cases requiring to search from millions of documents, the dense index becomes bulky and requires high memory usage for storing the index. More recently, learning-to-hash (LTH) techniques, for e.g., BPR and JPQ, produce binary document vectors, thereby reducing the memory requirement to efficiently store the dense index. LTH techniques are supervised and finetune the retriever using a ranking loss. They outperform their counterparts, i.e., traditional out-of-the-box vector compression techniques such as PCA or PQ. A missing piece from prior work is that existing techniques have been evaluated only in-domain, i.e., on a single dataset such as MS MARCO. In our work, we evaluate LTH and vector compression techniques for improving the downstream zero-shot retrieval accuracy of the TAS-B dense retriever while maintaining efficiency at inference. Our results demonstrate that, unlike prior work, LTH strategies when applied naively can underperform the zero-shot TAS-B dense retriever on average by up to 14% nDCG@10 on the BEIR benchmark. To solve this limitation, in our work, we propose an easy yet effective solution of injecting domain adaptation with existing supervised LTH techniques. We experiment with two well-known unsupervised domain adaptation techniques: GenQ and GPL. Our domain adaptation injection technique can improve the downstream zero-shot retrieval effectiveness for both BPR and JPQ variants of the TAS-B model by on average 11.5% and 8.2% nDCG@10 while both maintaining 32$\times$ memory efficiency and 14$\times$ and 2$\times$ speedup respectively in CPU retrieval latency on BEIR. All our code, models, and data are publicly available at https://github.com/thakur-nandan/income.


title: Ordering the confusion: A study of the impact of lens models on gravitational-wave lensing detection capabilities

abstract: When traveling from their source to the observer, gravitational waves can get deflected by massive objects along their travel path. When the lens is massive enough and the source aligns closely with the line-of-sight to the lens, the wave undergoes strong lensing, leading to several images with the same frequency evolution. These images are separated in time, magnified, and can undergo an overall phase shift. Searches for strongly-lensed gravitational waves are already ongoing. In essence, such searches look for events originating from the same sky location and having the same detector frame parameters. However, the agreement between these quantities can also happen by chance, leading to an important confusion background. To reduce the overlap between background and foreground, one can include lensing models, enforcing the lensing parameters to also be consistent with our expectations. In principle, such models should decrease the confusion background. However, when doing realistic searches, one does not know which model is the correct one. The use of an incorrect model could lead to the non-detection of genuinely lensed events. In this work, we investigate under realistic conditions how one can identify lensed events in the unlensed background. We focus on the impact of the addition of a model for the lens density profile and investigate the effect of potential errors in the modelling. We show that it is extremely difficult to identify lensing confidently without the addition of a lens model. We also show that slight variations in the profile of the lens model are tolerable but a model with incorrect assumptions about the underlying lens population causes significant errors compared to assuming no lens model at all. We also suggest some strategies to improve the confidence in the detection of strong lensing for gravitational waves.


title: A Turing-based bimodal population code can specify Cephalopod chromatic skin displays

abstract: The skin of a cephalopod forms a dazzling array of patterns made by chromatophores, elastic sacs of pigment that can be expanded by muscles to reveal their color. Tens of thousands of these chromatophores can work together to generate a stable display of stripes, spots, mottled grainy camouflage, or dynamic oscillations and traveling waves of activation. How does a neuromuscular system organize the coactivation of thousands of degrees of freedom through simple central commands? We provide a minimally-complex physiologically-plausible mathematical model, using Turing's morphogenetic equations, that can generate the array of twelve static and four dynamic types of skin displays seen in several cephalopod species. These equations specify how muscle cells on the skin need to locally interact for the global chromatic patterns to be formed. We also demonstrate a link between Turing neural computations and the asynchronous type of computing that has been extensively demonstrated in brain systems: population coding, using bimodal codes, with the relative heights of the modes specifying the kind of global pattern generated. Since Cephalopod skins are a "visible neural net", we believe that the computational principles uncovered through their study may have wider implications for the functioning of other neural systems.


title: VQA-GNN: Reasoning with Multimodal Knowledge via Graph Neural Networks for Visual Question Answering

abstract: Visual question answering (VQA) requires systems to perform concept-level reasoning by unifying unstructured (e.g., the context in question and answer; "QA context") and structured (e.g., knowledge graph for the QA context and scene; "concept graph") multimodal knowledge. Existing works typically combine a scene graph and a concept graph of the scene by connecting corresponding visual nodes and concept nodes, then incorporate the QA context representation to perform question answering. However, these methods only perform a unidirectional fusion from unstructured knowledge to structured knowledge, limiting their potential to capture joint reasoning over the heterogeneous modalities of knowledge. To perform more expressive reasoning, we propose VQA-GNN, a new VQA model that performs bidirectional fusion between unstructured and structured multimodal knowledge to obtain unified knowledge representations. Specifically, we inter-connect the scene graph and the concept graph through a super node that represents the QA context, and introduce a new multimodal GNN technique to perform inter-modal message passing for reasoning that mitigates representational gaps between modalities. On two challenging VQA tasks (VCR and GQA), our method outperforms strong baseline VQA methods by 3.2% on VCR (Q-AR) and 4.6% on GQA, suggesting its strength in performing concept-level reasoning. Ablation studies further demonstrate the efficacy of the bidirectional fusion and multimodal GNN method in unifying unstructured and structured multimodal knowledge.


title: On the Paradox of Learning to Reason from Data

abstract: Logical reasoning is needed in a wide range of NLP tasks. Can a BERT model be trained end-to-end to solve logical reasoning problems presented in natural language? We attempt to answer this question in a confined problem space where there exists a set of parameters that perfectly simulates logical reasoning. We make observations that seem to contradict each other: BERT attains near-perfect accuracy on in-distribution test examples while failing to generalize to other data distributions over the exact same problem space. Our study provides an explanation for this paradox: instead of learning to emulate the correct reasoning function, BERT has in fact learned statistical features that inherently exist in logical reasoning problems. We also show that it is infeasible to jointly remove statistical features from data, illustrating the difficulty of learning to reason in general. Our result naturally extends to other neural models and unveils the fundamental difference between learning to reason and learning to achieve high performance on NLP benchmarks using statistical features.


title: Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models

abstract: We propose a method for arbitrary textual style transfer (TST)--the task of transforming a text into any given style--utilizing general-purpose pre-trained language models. Our method, Prompt-and-Rerank, is based on a mathematical formulation of the TST task, decomposing it into three constituent components: textual similarity, target style strength, and fluency. Specifically, our method first uses zero-shot or few-shot prompting to obtain a set of candidate generations in the target style, and then re-ranks these candidates according to a combination of the three components above. Empirically, our method enables small pre-trained language models to perform on par with state-of-the-art large-scale models while consuming two orders of magnitude less compute and memory. Finally, we conduct a systematic investigation of the effect of model size and prompt design (e.g., prompt paraphrasing and delimiter-pair choice) on style transfer quality across seven diverse textual style transfer datasets.


title: Optical depth to reionization from perturbative 21cm clustering

abstract: The optical depth $\tau$ is the least well determined parameter in the standard model of cosmology, and one whose precise value is important for both understanding reionization and for inferring fundamental physics from cosmological measurements. We forecast how well future epoch of reionization experiments could constraint $\tau$ using a symmetries-based bias expansion that highlights the special role played by anisotropies in the power spectrum on large scales. Given a parametric model for the ionization evolution inspired by the physical behavior of more detailed reionization simulations, we find that future 21cm experiments could place tight constraints on the timing and duration of reionization and hence constraints on $\tau$ that are competitive with proposed, space-based CMB missions provided they can measure $k\approx 0.1\,h\,\text{Mpc}^{-1}$ with a clean foreground wedge across redshifts spanning the most active periods of reionization, corresponding to ionization fractions $0.2 \lesssim x \lesssim 0.8$. Significantly improving upon existing CMB-based measurements with next-generation 21cm surveys would require substantially longer observations ($\sim5$ years) than standard $\mathcal{O}(1000 \,\,\text{hour})$ integration times. Precise measurements of smaller scales will not improve constraints on $\tau$ until a better understanding of the astrophysics of reionization is achieved. In the presence of noise and foregrounds even future 21cm experiments will struggle to constrain $\tau$ if the ionization evolution deviates significantly from simple parametric forms.


title: What Makes Data-to-Text Generation Hard for Pretrained Language Models?

abstract: Expressing natural language descriptions of structured facts or relations -- data-to-text generation (D2T) -- increases the accessibility of structured knowledge repositories. Previous work shows that pre-trained language models(PLMs) perform remarkably well on this task after fine-tuning on a significant amount of task-specific training data. On the other hand, while auto-regressive PLMs can generalize from a few task examples, their efficacy at D2T is largely unexplored. Furthermore, we have an incomplete understanding of the limits of PLMs on D2T. In this work, we conduct an empirical study of both fine-tuned and auto-regressive PLMs on the DART multi-domain D2T dataset. We consider their performance as a function of the amount of task-specific data and how these data are incorporated into the models: zero and few-shot learning, and fine-tuning of model weights. In addition, we probe the limits of PLMs by measuring performance on subsets of the evaluation data: novel predicates and abstractive test examples. To improve the performance on these subsets, we investigate two techniques: providing predicate descriptions in the context and re-ranking generated candidates by information reflected in the source. Finally, we conduct a human evaluation of model errors and show that D2T generation tasks would benefit from datasets with more careful manual curation.


title: Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering

abstract: Federated learning is generally used in tasks where labels are readily available (e.g., next word prediction). Relaxing this constraint requires design of unsupervised learning techniques that can support desirable properties for federated training: robustness to statistical/systems heterogeneity, scalability with number of participants, and communication efficiency. Prior work on this topic has focused on directly extending centralized self-supervised learning techniques, which are not designed to have the properties listed above. To address this situation, we propose Orchestra, a novel unsupervised federated learning technique that exploits the federation's hierarchy to orchestrate a distributed clustering task and enforce a globally consistent partitioning of clients' data into discriminable clusters. We show the algorithmic pipeline in Orchestra guarantees good generalization performance under a linear probe, allowing it to outperform alternative techniques in a broad range of conditions, including variation in heterogeneity, number of clients, participation ratio, and local epochs.


title: Computationally Efficient Horizon-Free Reinforcement Learning for Linear Mixture MDPs

abstract: Recent studies have shown that episodic reinforcement learning (RL) is not more difficult than contextual bandits, even with a long planning horizon and unknown state transitions. However, these results are limited to either tabular Markov decision processes (MDPs) or computationally inefficient algorithms for linear mixture MDPs. In this paper, we propose the first computationally efficient horizon-free algorithm for linear mixture MDPs, which achieves the optimal $\tilde O(d\sqrt{K} +d^2)$ regret up to logarithmic factors. Our algorithm adapts a weighted least square estimator for the unknown transitional dynamic, where the weight is both \emph{variance-aware} and \emph{uncertainty-aware}. When applying our weighted least square estimator to heterogeneous linear bandits, we can obtain an $\tilde O(d\sqrt{\sum_{k=1}^K \sigma_k^2} +d)$ regret in the first $K$ rounds, where $d$ is the dimension of the context and $\sigma_k^2$ is the variance of the reward in the $k$-th round. This also improves upon the best-known algorithms in this setting when $\sigma_k^2$'s are known.


title: Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods

abstract: Self-Supervised Learning (SSL) surmises that inputs and pairwise positive relationships are enough to learn meaningful representations. Although SSL has recently reached a milestone: outperforming supervised methods in many modalities\dots the theoretical foundations are limited, method-specific, and fail to provide principled design guidelines to practitioners. In this paper, we propose a unifying framework under the helm of spectral manifold learning to address those limitations. Through the course of this study, we will rigorously demonstrate that VICReg, SimCLR, BarlowTwins et al. correspond to eponymous spectral methods such as Laplacian Eigenmaps, Multidimensional Scaling et al. This unification will then allow us to obtain (i) the closed-form optimal representation for each method, (ii) the closed-form optimal network parameters in the linear regime for each method, (iii) the impact of the pairwise relations used during training on each of those quantities and on downstream task performances, and most importantly, (iv) the first theoretical bridge between contrastive and non-contrastive methods towards global and local spectral embedding methods respectively, hinting at the benefits and limitations of each. For example, (i) if the pairwise relation is aligned with the downstream task, any SSL method can be employed successfully and will recover the supervised method, but in the low data regime, VICReg's invariance hyper-parameter should be high; (ii) if the pairwise relation is misaligned with the downstream task, VICReg with small invariance hyper-parameter should be preferred over SimCLR or BarlowTwins.


title: Information Propagation by Composited Labels in Natural Language Processing

abstract: In natural language processing (NLP), labeling on regions of text, such as words, sentences and paragraphs, is a basic task. In this paper, label is defined as map between mention of entity in a region on text and context of entity in a broader region on text containing the mention. This definition naturally introduces linkage of entities induced from inclusion relation of regions, and connected entities form a graph representing information flow defined by map. It also enables calculation of information loss through map using entropy, and entropy lost is regarded as distance between two entities over a path on graph.


title: Conditional probability framework for entanglement and its decoupling from tensor product structure

abstract: Our aim is to make a step towards clarification of foundations for the notion of entanglement (both physical and mathematical) by representing it in the conditional probability framework. In Schr\"odinger's words, this is entanglement of knowledge which can be extracted via conditional measurements. In particular, quantum probabilities are interpreted as conditional ones (as, e.g., by Ballentine). We restrict considerations to perfect conditional correlations (PCC) induced by measurements ("EPR entanglement"). Such entanglement is coupled to the pairs of observables with the projection type state update as the back action of measurement. In this way, we determine a special class of entangled states. One of our aims is to decouple the notion of entanglement from the compound systems. The rigid association of entanglement with the state of a few body systems stimulated its linking with quantum nonlocality ("spooky action at a distance"). However, already by Schr\"odinger entanglement was presented as knotting of knowledge (about statistics) for one observable A with knowledge about another observable B.


title: Exploring Concept Contribution Spatially: Hidden Layer Interpretation with Spatial Activation Concept Vector

abstract: To interpret deep learning models, one mainstream is to explore the learned concepts by networks. Testing with Concept Activation Vector (TCAV) presents a powerful tool to quantify the contribution of query concepts (represented by user-defined guidance images) to a target class. For example, we can quantitatively evaluate whether and to what extent concept striped contributes to model prediction zebra with TCAV. Therefore, TCAV whitens the reasoning process of deep networks. And it has been applied to solve practical problems such as diagnosis. However, for some images where the target object only occupies a small fraction of the region, TCAV evaluation may be interfered with by redundant background features because TCAV calculates concept contribution to a target class based on a whole hidden layer. To tackle this problem, based on TCAV, we propose Spatial Activation Concept Vector (SACV) which identifies the relevant spatial locations to the query concept while evaluating their contributions to the model prediction of the target class. Experiment shows that SACV generates a more fine-grained explanation map for a hidden layer and quantifies concepts' contributions spatially. Moreover, it avoids interference from background features. The code is available on https://github.com/AntonotnaWang/Spatial-Activation-Concept-Vector.


title: Classification of four-qubit entangled states via Machine Learning

abstract: We apply the support vector machine (SVM) algorithm to derive a set of entanglement witnesses (EW) to identify entanglement patterns in families of four-qubit states. The effectiveness of SVM for practical EW implementations stems from the coarse-grained description of families of equivalent entangled quantum states. The equivalence criteria in our work is based on the stochastic local operations and classical communication (SLOCC) classification and the description of the four-qubit entangled Werner states. We numerically verify that the SVM approach provides an effective tool to address the entanglement witness problem when the coarse-grained description of a given family state is available. We also discuss and demonstrate the efficiency of nonlinear kernel SVM methods as applied to four-qubit entangled state classification.


title: Data-Driven Learning of Safety-Critical Control with Stochastic Control Barrier Functions

abstract: Control barrier functions are widely used to synthesize safety-critical controls. The existence of Gaussian-type noise may lead to unsafe actions and result in severe consequences. While studies are widely done in safety-critical control for stochastic systems, in many real-world applications, we do not have the knowledge of the stochastic component of the dynamics. In this paper, we study safety-critical control of stochastic systems with an unknown diffusion part and propose a data-driven method to handle these scenarios. More specifically, we propose a data-driven stochastic control barrier function (DDSCBF) framework and use supervised learning to learn the unknown stochastic dynamics via the DDSCBF scheme. Under some reasonable assumptions, we provide guarantees that the DDSCBF scheme can approximate the It\^{o} derivative of the stochastic control barrier function (SCBF) under partially unknown dynamics using the universal approximation theorem. We also show that we can achieve the same safety guarantee using the DDSCBF scheme as with SCBF in previous work without requiring the knowledge of stochastic dynamics. We use two non-linear stochastic systems to validate our theory in simulations.


title: A Non-Habituating Configurable Audio Visual Animal Deterrent System to Mitigate Roadkill

abstract: Growth economies continue to be more reliant on roadways than ever before. Over 30,000 miles of road are added yearly to the already enormous road system that exists in the United States. As roads segment habitats, animals have no option but to walk across them for food, water and companionship. In this process they end up becoming roadkill. Wherever wildlife habitat and roadways overlap, death and destruction seem impossible to control. These animal deaths have a direct impact on the biodiversity and dynamics of an ecosystem and roadkill poses a threat to many species that are fighting extinction. Vehicles colliding with animals results in human fatalities, life changing injuries and extensive property damage. Current methods of handling roadkill are primarily passive and do not utilize the animal's natural instincts. This paper presents an alternative approach by actively involving the animal, warning them of an oncoming vehicle and triggering their survival instincts. Making the animal an integral part of the solution, augmenting their sensory perception with science and technology and utilizing their heightened reflexes and survival instincts provides a better chance at mitigating the problem of roadkill. The results show that this solution is able to provide animals a warning of an oncoming vehicle, consistently, reliably and in a wide range of testing conditions.


title: Cardiomegaly Detection using Deep Convolutional Neural Network with U-Net

abstract: Cardiomegaly is indeed a medical disease in which the heart is enlarged. Cardiomegaly is better to handle if caught early, so early detection is critical. The chest X-ray, being one of the most often used radiography examinations, has been used to detect and visualize abnormalities of human organs for decades. X-ray is also a significant medical diagnosis tool for cardiomegaly. Even for domain experts, distinguishing the many types of diseases from the X-ray is a difficult and time-consuming task. Deep learning models are also most effective when used on huge data sets, yet due to privacy concerns, large datasets are rarely available inside the medical industry. A Deep learning-based customized retrained U-Net model for detecting Cardiomegaly disease is presented in this research. In the training phase, chest X-ray images from the "ChestX-ray8" open source real dataset are used. To reduce computing time, this model performs data preprocessing, picture improvement, image compression, and classification before moving on to the training step. The work used a chest x-ray image dataset to simulate and produced a diagnostic accuracy of 94%, a sensitivity of 96.2 percent, and a specificity of 92.5 percent, which beats prior pre-trained model findings for identifying Cardiomegaly disease.


title: Three-dimensional direct numerical simulation of free-surface magnetohydrodynamic wave turbulence

abstract: We report on three-dimensional direct numerical simulation of wave turbulence on the free surface of a magnetic fluid subjected to an external horizontal magnetic field. A transition from capillarywave turbulence to anisotropic magneto-capillary wave turbulence is observed for an increasing field. At high enough field, wave turbulence becomes highly anisotropic, cascading mainly perpendicularly to the field direction, in good agreement with the prediction of a phenomenological model, and with anisotropic Alfv{\'e}n wave turbulence. Although surface waves on a magnetic fluid are different from Alfv{\'e}n waves in plasma, a strong analogy is found with similar wave spectrum scalings and similar magnetic-field dependent dispersionless wave velocities.

categories: physics.plasm-ph astro-ph.SR nlin.CD physics.class-ph physics.flu-dyn


title: Monomiality and a New Family of Hermite Polynomials

abstract: In this article we go deeply into the formulation and meaning of the monomiality principle and employ it to study the properties of a set of polynomials, which, asymptotically, reduce to the ordinary two variable Kampe de Feriet family. We derive the relevant differential equations and discuss the associated orthogonality properties, along with the relevant generalized forms.


title: LIA: Privacy-Preserving Data Quality Evaluation in Federated Learning Using a Lazy Influence Approximation

abstract: In Federated Learning, it is crucial to handle low-quality, corrupted, or malicious data. However, traditional data valuation methods are not suitable due to privacy concerns. To address this, we propose a simple yet effective approach that utilizes a new influence approximation called "lazy influence" to filter and score data while preserving privacy. To do this, each participant uses their own data to estimate the influence of another participant's batch and sends a differentially private obfuscated score to the central coordinator. Our method has been shown to successfully filter out biased and corrupted data in various simulated and real-world settings, achieving a recall rate of over $>90\%$ (sometimes up to $100\%$) while maintaining strong differential privacy guarantees with $\varepsilon \leq 1$.


title: FedSA: Accelerating Intrusion Detection in Collaborative Environments with Federated Simulated Annealing

abstract: Fast identification of new network attack patterns is crucial for improving network security. Nevertheless, identifying an ongoing attack in a heterogeneous network is a non-trivial task. Federated learning emerges as a solution to collaborative training for an Intrusion Detection System (IDS). The federated learning-based IDS trains a global model using local machine learning models provided by federated participants without sharing local data. However, optimization challenges are intrinsic to federated learning. This paper proposes the Federated Simulated Annealing (FedSA) metaheuristic to select the hyperparameters and a subset of participants for each aggregation round in federated learning. FedSA optimizes hyperparameters linked to the global model convergence. The proposal reduces aggregation rounds and speeds up convergence. Thus, FedSA accelerates learning extraction from local models, requiring fewer IDS updates. The proposal assessment shows that the FedSA global model converges in less than ten communication rounds. The proposal requires up to 50% fewer aggregation rounds to achieve approximately 97% accuracy in attack detection than the conventional aggregation approach.


title: Counting-Based Effective Dimension and Discrete Regularizations

abstract: Fractal-like structures of varying complexity are common in nature, and measure-based dimensions (Minkowski, Hausdorff) supply their basic geometric characterization. However, at the level of fundamental dynamics, which is quantum, structure does not enter via geometry of fixed sets but is encoded in probability distributions on associated spaces. The question then arises whether a robust notion of fractal measure-based dimension exists for structures represented in this way. Starting from effective number theory, we construct all counting-based schemes to select effective supports on collections of objects with probabilities and associate the effective counting dimension (ECD) with each. We then show that ECD is scheme-independent and, thus, a well-defined measure-based dimension with meaning analogous to the Minkowski dimension of fixed sets. In physics language, ECD characterizes probabilistic descriptions arising in a theory or model via discrete ``regularization''. For example, our analysis makes recent surprising results on effective spatial dimensions in quantum chromodynamics and Anderson models well founded. We discuss how to assess the reliability of regularization removals in practice and perform such analysis in the context of 3d Anderson criticality.

categories: hep-lat cond-mat.dis-nn hep-th math-ph math.MP quant-ph


title: From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopy

abstract: With applications ranging from metabolomics to histopathology, quantitative phase microscopy (QPM) is a powerful label-free imaging modality. Despite significant advances in fast multiplexed imaging sensors and deep-learning-based inverse solvers, the throughput of QPM is currently limited by the speed of electronic hardware. Complementarily, to improve throughput further, here we propose to acquire images in a compressed form such that more information can be transferred beyond the existing electronic hardware bottleneck. To this end, we present a learnable optical compression-decompression framework that learns content-specific features. The proposed differentiable quantitative phase microscopy ($\partial \mu$) first uses learnable optical feature extractors as image compressors. The intensity representation produced by these networks is then captured by the imaging sensor. Finally, a reconstruction network running on electronic hardware decompresses the QPM images. In numerical experiments, the proposed system achieves compression of $\times$ 64 while maintaining the SSIM of $\sim 0.90$ and PSNR of $\sim 30$ dB on cells. The results demonstrated by our experiments open up a new pathway for achieving end-to-end optimized (i.e., optics and electronic) compact QPM systems that may provide unprecedented throughput improvements.

categories: eess.IV cs.CV physics.comp-ph physics.optics


title: Superradiant Production of Heavy Dark Matter from Primordial Black Holes

abstract: Rotating black holes (BHs) can efficiently transfer energy to the surrounding environment via superradiance. In particular, when the Compton length of a particle is comparable to the gravitational radius of a BH, the particle's occupation number can be exponentially amplified. In this work, we investigate the effect of the primordial-black-hole (PBH) superradiant instabilities on the generation of heavy bosonic dark matter (DM) with mass above $\sim$ 1 TeV. Additionally, we analyze its interplay with other purely gravitational and therefore unavoidable DM production mechanisms such as Hawking emission and the ultraviolet freeze-in. We find that superradiance can significantly increase the DM density produced by PBHs with respect to the case that only considers Hawking emission, and hence lower initial PBH densities are required.


title: Fractionalization and topology in amorphous electronic solids

abstract: Band-topology is traditionally analyzed in terms of gauge-invariant observables associated with crystalline Bloch wavefunctions. Recent work has demonstrated that many of the free fermion topological characteristics survive even in an amorphous setting. In this work, we extend these studies to incorporate the effect of strong repulsive interactions on the fate of topology and other correlation induced phenomena. Using a parton-based approach, we obtain the interacting phase diagram for an electronic two-orbital model with tunable topology in a two dimensional amorphous network. In addition to the (non-)topological phases that are adiabatically connected to the free fermion limit, we find a number of strongly interacting amorphous analogs of crystalline Mott insulating phases with non-trivial chiral neutral edge modes, and a fractionalized Anderson insulating phase. The amorphous networks thus provide a new playground for studying a plethora of exotic states of matter, and their glassy dynamics, due to the combined effects of non-trivial topology, disorder, and strong interactions.


title: Bayesian Reasoning in Eternal Inflation: A Solution to the Measure Problem

abstract: Probabilities in eternal inflation are traditionally defined as limiting frequency distributions, but a unique and unambiguous probability measure remains elusive. In this paper, we present a different approach, based on Bayesian reasoning. Our starting point is the master equation governing vacuum dynamics, which describes a random walk on the network of vacua. Our probabilities require two pieces of prior information, both pertaining to initial conditions: a prior density $\rho(t)$ for the time of nucleation, and a prior probability $p_\alpha$ for the ancestral vacuum. For ancestral vacua, we advocate the uniform prior as a conservative choice, though our conclusions are fairly insensitive to this choice. For the time of nucleation, we argue that a uniform prior is consistent with the time-translational invariance of the master equation and represents the minimally-informative choice. The resulting predictive probabilities coincide with Bousso's "holographic" prior probabilities and are closely related to Garriga and Vilenkin's "comoving" probabilities. Despite making the least informative priors, these probabilities are surprisingly predictive. They favor vacua whose surrounding landscape topography is that of a deep funnel, akin to the folding funnels of naturally-occurring proteins. They predict that we exist during the approach to near-equilibrium, much earlier than the mixing time for the landscape. We also consider a volume-weighted $\rho(t)$, which amounts to weighing vacua by physical volume. The predictive probabilities in this case coincide with the GSVW measure. The Bayesian framework allows us to compare the plausibility of the uniform-time and volume-weighted hypotheses to explain our data by computing the Bayesian evidence for each. We argue, under general and plausible assumptions, that posterior odds overwhelmingly favor the uniform-time hypothesis.


title: Euclid: Cosmological forecasts from the void size function

abstract: The Euclid mission $-$ with its spectroscopic galaxy survey covering a sky area over $15\,000 \ \mathrm{deg}^2$ in the redshift range $0.9<z<1.8\ -$ will provide a sample of tens of thousands of cosmic voids. This paper explores for the first time the constraining power of the void size function on the properties of dark energy (DE) from a survey mock catalogue, the official Euclid Flagship simulation. We identify voids in the Flagship light-cone, which closely matches the features of the upcoming Euclid spectroscopic data set. We model the void size function considering a state-of-the art methodology: we rely on the volume conserving (Vdn) model, a modification of the popular Sheth & van de Weygaert model for void number counts, extended by means of a linear function of the large-scale galaxy bias. We find an excellent agreement between model predictions and measured mock void number counts. We compute updated forecasts for the Euclid mission on DE from the void size function and provide reliable void number estimates to serve as a basis for further forecasts of cosmological applications using voids. We analyse two different cosmological models for DE: the first described by a constant DE equation of state parameter, $w$, and the second by a dynamic equation of state with coefficients $w_0$ and $w_a$. We forecast $1\sigma$ errors on $w$ lower than $10\%$, and we estimate an expected figure of merit (FoM) for the dynamical DE scenario $\mathrm{FoM}_{w_0,w_a} = 17$ when considering only the neutrino mass as additional free parameter of the model. The analysis is based on conservative assumptions to ensure full robustness, and is a pathfinder for future enhancements of the technique. Our results showcase the impressive constraining power of the void size function from the Euclid spectroscopic sample, both as a stand-alone probe, and to be combined with other Euclid cosmological probes.


title: z~2-9 Galaxies Magnified by the Hubble Frontier Field Clusters II: Luminosity Functions and Constraints on a Faint-End Turnover

abstract: We present new determinations of the rest-UV luminosity functions (LFs) at z=2-9 to extremely low luminosities (>-14 mag) from a sample of >2500 lensed galaxies found behind the HFF clusters. For the first time, we present faint-end slope results from lensed samples that are fully consistent with blank-field results over the redshift range z=2-9, while reaching to much lower luminosities than possible from the blank-field studies. Combining the deep lensed sample with the large blank-field samples allows us to set the tight constraints on the faint-end slope alpha of the z=2-9 UV LFs and its evolution. We find a smooth flattening in alpha from -2.28+/-0.10 (z=9) to -1.53+/-0.03 (z=2) with cosmic time (d(alpha)/dz=-0.11+/-0.01), fully consistent with dark matter halo buildup. We utilize these new results to present new measurements of the evolution in the UV luminosity density rho(UV) brightward of -13 mag from z~9 to z~2. Accounting for the SFR densities to faint luminosities implied by our LF results, we find that unobscured star formation dominates the SFR density at z>~4, with obscured star formation dominant thereafter. Having shown we can quantify the faint-end slope alpha of the LF accurately with our lensed HFF samples, we also quantify the apparent curvature in the shape of the UV LF through a curvature parameter delta. The constraints on the curvature delta strongly rule out the presence of a turn-over brightward of -13.1 mag at z~3, -14.3 mag at z~6, and -15.5 mag at all other redshifts between z~9 to z~2.


title: Dark Solar Wind

abstract: We study the solar emission of light dark sector particles that self-interact strongly enough to self-thermalize. The resulting outflow behaves like a fluid which accelerates under its own thermal pressure to highly relativistic bulk velocities in the solar system. Compared to the ordinary non-interacting scenario, the local outflow has at least $\sim 10^3$ higher number density and correspondingly at least $\sim 10^3$ lower average energy per particle. We show how this generic phenomenon arises in a dark sector comprised of millicharged particles strongly self-interacting via a dark photon. The millicharged plasma wind emerging in this model has novel yet predictive signatures that encourages new experimental directions. This phenomenon demonstrates how a small step away from the simplest models can lead to radically different outcomes and thus motivates a broader search for dark sector particles.


title: Sunyaev-Zel'dovich effect and X-ray scaling relations of galaxies, groups and clusters in the IllustrisTNG simulations

abstract: Observable thermodynamical properties of the intracluster medium (ICM) reflect the complex interplay between AGN feedback and the gravitational collapse of haloes. Using the large volume TNG300 simulation of the IllustrisTNG project we provide predictions for X-ray and Sunyaev-Zel'dovich (SZ) scaling relations for a sample of over 30,000 haloes that cover a wide mass range from galaxies to massive galaxy clusters ($M_{\rm 500crit}$ $\in [10^{12}$ M$_{\odot} - 2\times 10^{15}$ M$_{\odot}$]). We produce mock X-ray observations of simulated haloes using methods that are consistent with observational techniques. Thus, we investigate the scaling relations between the soft-band X-ray luminosity, spectroscopic temperature, gas mass fraction, $Y_{\rm X}$ and $Y_{\rm SZ}$ as a function of halo mass, and we find broad agreement between IllustrisTNG and the observed relations. Our results highlight the scatter and bias introduced by estimated masses, and thus the importance of converting simulated ICM properties to the observable space when comparing simulations to current X-ray observations. The wide range of halo masses in our sample provides new insights into the shape of the X-ray and SZ scaling relations across three orders of magnitude in mass. Our findings show strong evidence for a break in $z=0$ scaling relations. We introduce a smoothly broken power law model which robustly captures the location of this break, the width of the transition region around the break, as well as the slope dependence on halo mass. Our results inform the next generation of subgrid black hole feedback models and provide predictions for ongoing and future observational surveys.


title: Classification of Abelian domain walls

abstract: We discuss domain walls from spontaneous breaking of Abelian discrete symmetries $Z_N$. A series of different domain wall structures are predicted, depending on the symmetry and charge assignments of scalars leading to the spontaneous symmetry breaking (SSB). A widely-existing type of domain walls are those separating degenerate vacua which are adjacent in the field space. We denote these walls as adjacency walls. In the case that $Z_N$ terms are small compared with the $U(1)$ terms, the SSB of $U(1)$ generates strings first and then adjacency walls bounded by strings are generated after the SSB of $Z_N$. For symmetries larger than $Z_3$, non-adjacent vacua exist, we regard walls separating them as non-adjacency walls. These walls are unstable if $U(1)$ is a good approximation. If the discrete symmetry is broken via multiple steps, we arrive at a complex structure that one kind of walls wrapped by another type. On the other hand, if the symmetry is broken in different directions independently, walls generated from the different breaking chains are blind to each other.


title: Type IIB at eight derivatives: insights from Superstrings, Superfields and Superparticles

abstract: We study the non-linear structure of Type IIB eight-derivative couplings involving the metric and the complexified three-form $G_3$. We show that, at the level of five-point string amplitudes, the kinematics in the maximally R-symmetry-violating sector is fully matched by standard superspace integrals and by superparticle amplitudes in M-theory on a two-torus. The latter approach is used to determine the complete effective action in this sector and to verify its invariance under SL$(2,\mathbb{Z})$ duality. We further comment on the general structure of the higher-point kinematics. Compactifications to lower dimensions provide both tests for our results and the arena for their applications. We verify that K3 reductions are fully consistent with the constraints of six-dimensional supersymmetry, and derive the four-dimensional flux scalar potential and axion kinetic terms at order $(\alpha^{\prime})^{3}$ in Calabi-Yau threefold reductions.


title: Implications of the Zero 1-3 Flavour Mixing Hypothesis: Predictions for $\theta_{23}^\mathrm{PMNS}$ and $\delta^\mathrm{PMNS}$

abstract: We revisit mixing sum rule relations in the lepton and quark sectors under the assumption that the 1-3 elements of the flavour mixing matrices ($V^u_L,V^d_L,V^e_L,V^\nu_L$) are zero in the flavour basis. We consider the exact relations resulting from the validity of this "zero 1-3 flavour mixing hypothesis" and analyse their implications based on the current experimental data, including effects from RG running. In particular, we analyse how the existing precise measurement of $\theta_{13}^\mathrm{PMNS}$ allows to derive predictions for $\theta_{23}^\mathrm{PMNS}$ in models with constrained $\theta_{12}^\mathrm{e}$. As examples, we calculate the predictions for $\theta_{23}^\mathrm{PMNS}$ which arise in classes of Pati-Salam models and SU(5) GUTs that relate $\theta_{12}^\mathrm{e}$ to $\theta_{12}^\mathrm{d}$. We also derive a novel "lepton phase sum rule", valid under the additional assumption of small charged lepton mixing contributions. We furthermore point out that, in the context of GUT flavour models, the quark and lepton CP violating phases $\delta^\mathrm{CKM}$ and $\delta^\mathrm{PMNS}$ can both be predicted from a single imaginary element in the mass matrices.


title: Improved indirect limits on charm and bottom quark EDMs

abstract: We derive indirect limits on the charm and bottom quark electric dipole moments (EDMs) from paramagnetic AMO and neutron EDM experiments. The charm and bottom quark EDMs generate $CP$-odd photon-gluon operators and light quark EDMs at the $c$- and $b$-quark mass thresholds. These $CP$-odd operators induce the $CP$-odd semi-leptonic operator $C_S$ and the neutron EDM below the QCD scale that are probed by the paramagnetic and neutron EDM experiments, respectively. The bound from $C_S$ is $\vert d_c \vert < 1.3\times 10^{-20}\,e\,\mathrm{cm}$ for the charm quark and $\vert d_b \vert < 7.6\times 10^{-19}\,e\,\mathrm{cm}$ for the bottom quark, with its uncertainty estimated as 10%. The neutron EDM provides a stronger bound, $\vert d_c \vert < 6\times 10^{-22}\,e\,\mathrm{cm}$ and $\vert d_b \vert < 2\times 10^{-20}\,e\,\mathrm{cm}$, though with a larger hadronic uncertainty.


title: Two-loop power spectrum with full time- and scale-dependence and EFT corrections: impact of massive neutrinos and going beyond EdS

abstract: We compute the density and velocity power spectra at next-to-next-to-leading order taking into account the effect of time- and scale-dependent growth of massive neutrino perturbations as well as the departure from Einstein--de-Sitter (EdS) dynamics at late times non-linearly. We determine the impact of these effects by comparing to the commonly adopted approximate treatment where they are not included. For the bare cold dark matter (CDM)+baryon spectrum, we find percent deviations for $k\gtrsim 0.17h~\mathrm{Mpc}^{-1}$, mainly due to the departure from EdS. For the velocity and cross power spectrum the main difference arises due to time- and scale-dependence in presence of massive neutrinos yielding percent deviation above $k\simeq 0.08, 0.13, 0.16h~\mathrm{Mpc}^{-1}$ for $\sum m_{\nu} = 0.4, 0.2, 0.1~\mathrm{eV}$, respectively. We use an effective field theory (EFT) framework at two-loop valid for wavenumbers $k \gg k_{\mathrm{FS}}$, where $k_{\mathrm{FS}}$ is the neutrino free-streaming scale. Comparing to Quijote N-body simulations, we find that for the CDM+baryon density power spectrum the effect of neutrino perturbations and exact time-dependent dynamics at late times can be accounted for by a shift in the one-loop EFT counterterm, $\Delta\bar{\gamma}_1 \simeq - 0.2~\mathrm{Mpc}^2/h^2$. We find percent agreement between the perturbative and N-body results up to $k\lesssim 0.12h~\mathrm{Mpc}^{-1}$ and $k\lesssim 0.16h~\mathrm{Mpc}^{-1}$ at one- and two-loop order, respectively, for all considered neutrino masses $\sum m_{\nu} \leq 0.4~\mathrm{eV}$.


title: MgII in the JWST Era: a Probe of Lyman Continuum Escape?

abstract: Limited constraints on the evolution of the Lyman Continuum (LyC) escape fraction represent one of the primary uncertainties in the theoretical determination of the reionization history. Due to the intervening intergalactic medium (IGM), the possibility of observing LyC photons directly in the epoch of reionization is highly unlikely. For this reason, multiple indirect probes of LyC escape have been identified, some of which are used to identify low-redshift LyC leakers (e.g. O32), while others are primarily useful at $z>6$ (e.g. [OIII]/[CII] far infrared emission). The flux ratio of the resonant MgII doublet emission at 2796$\dot{\rm A}$ and 2803$\dot{\rm A}$ as well as the MgII optical depth have recently been proposed as ideal diagnostics of LyC leakage that can be employed at $z>6$ with JWST. Using state-of-the-art cosmological radiation hydrodynamics simulations post-processed with CLOUDY and resonant-line radiative transfer, we test whether MgII is indeed a useful probe of LyC leakage. Our simulations indicate that the majority of bright, star-forming galaxies with high LyC escape fractions are expected to be MgII emitters rather than absorbers at $z=6$. However, we find that the MgII doublet flux ratio is a more sensitive indicator of dust rather than neutral hydrogen, limiting its use as a LyC leakage indicator to only galaxies in the optically thin regime. Given its resonant nature, we show that MgII will be an exciting probe of the complex kinematics in high-redshift galaxies in upcoming JWST observations.


title: Identifying magnetic antiskyrmions while they form with convolutional neural networks

abstract: Chiral magnets have attracted a large amount of research interest in recent years because they support a variety of topological defects, such as skyrmions and bimerons, and allow for their observation and manipulation through several techniques. They also have a wide range of applications in the field of spintronics, particularly in developing new technologies for memory storage devices. However, the vast amount of data generated in these experimental and theoretical studies requires adequate tools, among which machine learning is crucial. We use a Convolutional Neural Network (CNN) to identify the relevant features in the thermodynamical phases of chiral magnets, including (anti-)skyrmions, bimerons, and helical and ferromagnetic states. We use a flexible multi-label classification framework that can correctly classify states in which different features and phases are mixed. We then train the CNN to predict the features of the final state from snapshots of intermediate states of a lattice Monte Carlo simulation. The trained model allows identifying the different phases reliably and early in the formation process. Thus, the CNN can significantly speed up the large-scale simulations for 3D materials that have been the bottleneck for quantitative studies so far. Moreover, this approach can be applied to the identification of mixed states and emerging features in real-world images of chiral magnets.

categories: cond-mat.str-el cond-mat.mtrl-sci cs.LG hep-ph


title: Implications of a Temperature Dependent IMF I: Photometric Template Fitting

abstract: A universal stellar initial mass function (IMF) should not be expected from theoretical models of star formation, but little conclusive observational evidence for a variable IMF has been uncovered. In this paper, a parameterization of the IMF is introduced into photometric template fitting of the COSMOS2015 catalog. The resulting best-fit templates suggest systematic variations in the IMF, with most galaxies exhibiting top-heavier stellar populations than in the Milky Way. At fixed redshift, only a small range of IMFs are found, with the typical IMF becoming progressively top-heavier with increasing redshift. Additionally, subpopulations of ULIRGs, quiescent- and star-forming galaxies are compared with predictions of stellar population feedback and show clear qualitative similarities to the evolution of dust temperatures.


title: Unifying Sunyaev-Zel'dovich and X-ray predictions from clusters to galaxy groups: the impact of X-ray mass estimates on the $Y-M$ scaling relation

abstract: One of the main limitations in precision cluster cosmology arises from systematic errors and uncertainties in estimating cluster masses. Using the Mock-X pipeline, we produce synthetic X-ray images and derive cluster and galaxy group X-ray properties for a sample of over 30,000 simulated galaxy groups and clusters with $M_{\rm 500crit}$ between $10^{12}$ and $2\times 10^{15}$ M$_{\odot}$ in IllustrisTNG. We explore the similarities and differences between IllustrisTNG predictions of the Sunyaev-Zel'dovich and X-ray scaling relations with mass. We find a median hydrostatic mass bias $b = 0.125 \pm 0.003$ for $M_{\rm 500crit}$ $>10^{13}$ M$_{\odot}$. The bias increases to $b = 0.17 \pm 0.004$ when masses are derived from synthetic X-ray observations. We model how different underlying assumptions about the dependence of $Y_{\rm X}$ on halo mass can generate biases in the observed $Y_{\rm SZ} - M_{Y_{\rm X}}$ scaling relation. In particular, the simplifying assumption that $Y_{\rm X} - M_{\rm tot}$ is self-similar at all mass scales largely hides the break in $Y_{\rm SZ} - M_{\rm tot}$ and overestimates $Y_{\rm SZ}$ at galaxy and groups scales. We show that calibrating the $Y_{\rm X}-$mass proxy using a new model for a smoothly broken power law reproduces the true underlying $Y_{\rm SZ} - M_{\rm tot}$ scaling relation with high accuracy. Moreover, $M_{Y_{\rm X}}$ estimates calibrated with this method lead to $Y_{\rm SZ} - M_{Y_{\rm X}}$ predictions that are not biased by the presence of lower mass clusters or galaxy groups in the sample. Finally, we show that our smoothly broken power law model provides a robust way to derive the $Y_{\rm X}-$mass proxy, significantly reducing the level of mass bias for clusters, groups, and galaxies.


title: Interpretation of the observed neutrino emission from three Tidal Disruption Events

abstract: Three Tidal Disruption Event (TDE) candidates (AT2019dsg, AT2019fdr, AT2019aalc) have been associated with high energy astrophysical neutrinos in multi-messenger follow-ups. In all cases, the neutrino observation occurred O(100) days after the maximum of the optical-ultraviolet (OUV) luminosity. We discuss unified fully time-dependent interpretations of the neutrino signals where the neutrino delays are not a statistical effect, but rather the consequence of a physical scale of the post-disruption system. Noting that X-rays flares and infrared (IR) dust echoes have been observed in all cases, we consider three models in which quasi-isotropic neutrino emission is due to the interactions of accelerated protons of moderate, medium, and ultra-high energies with X-rays, OUV, and IR photons, respectively. We find that the neutrino time delays can be well described in the X-ray model assuming magnetic confinement of protons in a calorimetric approach if the unobscured X-ray luminosity is roughly constant over time, and in the IR model, where the delay is directly correlated with the time evolution of the echo luminosity (for which a model is developed here). The OUV model exhibits the highest neutrino production efficiency. In all three models, the highest neutrino fluence is predicted for AT2019aalc, due to its high estimated supermassive black hole mass and low redshift. All models result in diffuse neutrino fluxes that are consistent with observations.