title: Accurate holographic light potentials using pixel crosstalk modelling

abstract: Arbitrary light potentials have proven to be a valuable and versatile tool in many quantum information and quantum simulation experiments with ultracold atoms. Using a phase-modulating spatial light modulator (SLM), we generate arbitrary light potentials holographically with measured efficiencies between $15\% - 40\% $ and an accuracy of below $2\% $ root-mean-squared error. Key to the high accuracy is the modelling of pixel crosstalk of the SLM on a sub-pixel scale which is relevant especially for large light potentials. We employ conjugate gradient minimisation to calculate the SLM phase pattern for a given target light potential after measuring the intensity and wavefront at the SLM. Further, we use camera feedback to reduce experimental errors, we remove optical vortices and investigate the difference between the angular spectrum method and the Fourier transform to simulate the propagation of light. Using a combination of all these techniques, we achieved more accurate and efficient light potentials compared to previous studies, and generated a series of potentials relevant for cold atom experiments.


title: Combining machine-learned and empirical force fields with the parareal algorithm: application to the diffusion of atomistic defects

abstract: We numerically investigate an adaptive version of the parareal algorithm in the context of molecular dynamics. This adaptive variant has been originally introduced in [F. Legoll, T. Lelievre and U. Sharma, SISC 2022]. We focus here on test cases of physical interest where the dynamics of the system is modelled by the Langevin equation and is simulated using the molecular dynamics software LAMMPS. In this work, the parareal algorithm uses a family of machine-learning spectral neighbor analysis potentials (SNAP) as fine, reference, potentials and embedded-atom method potentials (EAM) as coarse potentials. We consider a self-interstitial atom in a tungsten lattice and compute the average residence time of the system in metastable states. Our numerical results demonstrate significant computational gains using the adaptive parareal algorithm in comparison to a sequential integration of the Langevin dynamics. We also identify a large regime of numerical parameters for which statistical accuracy is reached without being a consequence of trajectorial accuracy.


title: Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions

abstract: Prompting-based large language models (LLMs) are surprisingly powerful at generating natural language reasoning steps or Chains-of-Thoughts (CoT) for multi-step question answering (QA). They struggle, however, when the necessary knowledge is either unavailable to the LLM or not up-to-date within its parameters. While using the question to retrieve relevant text from an external knowledge source helps LLMs, we observe that this one-step retrieve-and-read approach is insufficient for multi-step QA. Here, \textit{what to retrieve} depends on \textit{what has already been derived}, which in turn may depend on \textit{what was previously retrieved}. To address this, we propose IRCoT, a new approach for multi-step QA that interleaves retrieval with steps (sentences) in a CoT, guiding the retrieval with CoT and in turn using retrieved results to improve CoT. Using IRCoT with GPT3 substantially improves retrieval (up to 21 points) as well as downstream QA (up to 15 points) on four datasets: HotpotQA, 2WikiMultihopQA, MuSiQue, and IIRC. We observe similar substantial gains in out-of-distribution (OOD) settings as well as with much smaller models such as Flan-T5-large without additional training. IRCoT reduces model hallucination, resulting in factually more accurate CoT reasoning. Code, data, and prompts are available at \url{https://github.com/stonybrooknlp/ircot}


title: Temperature analysis of X-ray Thomson scattering data

abstract: The accurate interpretation of experiments with matter at extreme densities and pressures is a notoriously difficult challenge. In a recent work [T.~Dornheim et al., Nature Comm. (in print), arXiv:2206.12805], we have introduced a formally exact methodology that allows extracting the temperature of arbitrarily complex materials without any model assumptions or simulations. Here, we provide a more detailed introduction to this approach and analyze the impact of experimental noise on the extracted temperatures. In particular, we extensively apply our method both to synthetic scattering data and to previous experimental measurements over a broad range of temperatures and wave numbers. We expect that our approach will be of high interest to a gamut of applications, including inertial confinement fusion, laboratory astrophysics, and the compilation of highly accurate equation-of-state databases.


title: When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories

abstract: Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world knowledge. This paper aims to understand LMs' strengths and limitations in memorizing factual knowledge, by conducting large-scale knowledge probing experiments of 10 models and 4 augmentation methods on PopQA, our new open-domain QA dataset with 14k questions. We find that LMs struggle with less popular factual knowledge, and that scaling fails to appreciably improve memorization of factual knowledge in the long tail. We then show that retrieval-augmented LMs largely outperform orders of magnitude larger LMs, while unassisted LMs remain competitive in questions about high-popularity entities. Based on those findings, we devise a simple, yet effective, method for powerful and efficient retrieval-augmented LMs, which retrieves non-parametric memories only when necessary. Experimental results show that this significantly improves models' performance while reducing the inference costs.


title: PHANGS-JWST First Results: Measuring PAH Properties across the multiphase ISM

abstract: Ratios of polycyclic aromatic hydrocarbon (PAH) vibrational bands are a promising tool for measuring the properties of the PAH population and their effect on star formation. The photometric bands of the MIRI and NIRCam instruments on JWST provide the opportunity to measure PAH emission features across entire galaxy disks at unprecedented resolution and sensitivity. Here we present the first results of this analysis in a sample of three nearby galaxies: NGC 628, NGC 1365, and NGC 7496. Based on the variations observed in the 3.3, 7.7, and 11.3 $\mu$m features, we infer changes to the average PAH size and ionization state across the different galaxy environments. High values of F335M$_{\rm PAH}$/F1130W and low values of F1130W/F770W are measured in H II regions in all three galaxies. This suggests that these regions are populated by hotter PAHs, and/or that the PAH ionization fraction is larger. We see additional evidence of heating and/or changes in PAH size in regions with higher molecular gas content as well as increased ionization in regions with higher H$\alpha$ intensity.


title: ECoHeN: A Hypothesis Testing Framework for Extracting Communities from Heterogeneous Networks

abstract: Community discovery is the general process of attaining assortative communities from a network: collections of nodes that are densely connected within yet sparsely connected to the rest of the network. While community discovery has been well studied, few such techniques exist for heterogeneous networks, which contain different types of nodes and possibly different connectivity patterns between the node types. In this paper, we introduce a framework called ECoHeN, which \textbf{e}xtracts \textbf{co}mmunities from a \textbf{he}terogeneous \textbf{n}etwork in a statistically meaningful way. Using a heterogeneous configuration model as a reference distribution, ECoHeN identifies communities that are significantly more densely connected than expected given the node types and connectivity of its membership. Specifically, the ECoHeN algorithm extracts communities one at a time through a dynamic set of iterative updating rules, is guaranteed to converge, and imposes no constraints on the type composition of extracted communities. To our knowledge this is the first discovery method that distinguishes and identifies both homogeneous and heterogeneous, possibly overlapping, community structure in a network. We demonstrate the performance of ECoHeN through simulation and in application to a political blogs network to identify collections of blogs which reference one another more than expected considering the ideology of its' members.


title: Constraining mass, radius and tidal deformability of compact stars with axial wI modes: new universal relations including slow stable hybrid stars

abstract: We revisit asteroseismology with quadrupolar wI modes and present universal relationships for its fundamental and first overtone. In contrast to relationships proposed in the literature, our universal relationships are capable of including slow stable hybrid stars that appear when considering slow sharp hadron-quark phase transitions. We show that, if the frequency and damping time of the fundamental mode of a given pulsating object are measured, its mass, radius, and dimensionless tidal deformability can be inferred. Moreover, we show that the errors of such estimates are smaller than a few percent for the mass and radius. For the dimensionless tidal deformability, the errors are -- for compact objects with $M\gtrsim 1.4\,M_\odot$ -- in general smaller than ~100%. Comparison with previous universal relationships shows that the ones proposed in this work produce better estimates of the mass and radius of totally stable compact objects.


title: CausalDialogue: Modeling Utterance-level Causality in Conversations

abstract: Despite their widespread adoption, neural conversation models have yet to exhibit natural chat capabilities with humans. In this research, we examine user utterances as causes and generated responses as effects, recognizing that changes in a cause should produce a different effect. To further explore this concept, we have compiled and expanded upon a new dataset called CausalDialogue through crowd-sourcing. This dataset includes multiple cause-effect pairs within a directed acyclic graph (DAG) structure. Our analysis reveals that traditional loss functions struggle to effectively incorporate the DAG structure, leading us to propose a causality-enhanced method called Exponential Maximum Average Treatment Effect (ExMATE) to enhance the impact of causality at the utterance level in training neural conversation models. To evaluate the needs of considering causality in dialogue generation, we built a comprehensive benchmark on CausalDialogue dataset using different models, inference, and training methods. Through experiments, we find that a causality-inspired loss like ExMATE can improve the diversity and agility of conventional loss function and there is still room for improvement to reach human-level quality on this new dataset.


title: Constraints on Lepton Universality Violation from Rare $B$ Decays

abstract: The LHCb collaboration has very recently released a new study of $B^+ \to K^{+} \ell^+ \ell^-$ and $B \to K^{*0} \ell^+ \ell^-$ ($\ell = e,\mu$) decays, testing lepton universality with unprecedented accuracy using the whole Run 1 and 2 dataset. In addition, the CMS collaboration has recently reported an improved analysis of the branching ratios $B_{(d,s)}\to\mu^+\mu^-$. While these measurements offer, per se, a powerful probe of New Physics, global analyses of $b \to s \ell^+ \ell^-$ transitions also rely on the assumptions about nonperturbative contributions to the decay matrix elements. In this work, we perform a global Bayesian analysis of New Physics in (semi)leptonic rare $B$ decays, paying attention to the role of charming penguins which are difficult to evaluate from first principles. We find data to be consistent with the Standard Model once rescattering from intermediate hadronic states is included. Consequently, we derive stringent bounds on lepton universality violation in $|\Delta B | = | \Delta S| = 1$ (semi)leptonic processes.


title: The HI Content of Red Geyser Galaxies

abstract: Red geysers are a specific type of quiescent galaxy, denoted by twin jets emerging from their galactic centers. These bisymmetric jets possibly inject energy and heat into the surrounding material, effectively suppressing star formation by stabilizing cool gas. In order to confirm the presence and evolutionary consequences of these jets, this paper discusses the scaling, stacking, and conversion of 21-cm HI flux data sourced from the HI-MaNGA survey into HI gas-to-stellar mass (G/S) spectra. Our samples were dominated by non-detections, or galaxies with weak HI signals, and consequently by HI upper limits. The stacking technique discussed successfully resolved emission features in both the red geyser G/S spectrum and the control sample G/S spectrum. From these stacked spectra, we find that on average, red geyser galaxies have G/S of 0.086 $\pm$ 0.011(random)+0.029(systematic), while non-red geyser galaxies of similar stellar mass have a G/S ratio of 0.039 $\pm$ 0.018(random)+0.013(systematic). Therefore, we find no statistically significant evidence that the HI content of red geysers is different from the general quiescent population.


title: Stability of binomials over finite fields

abstract: A polynomial $f(x)$ over a field $K$ is said to be stable if all its iterates are irreducible over $K$. L. Danielson and B. Fein have shown that over a large class of fields $K$, if $f(x)$ is an irreducible monic binomial, then it is stable over $K$. In this paper it is proved that this result no longer holds over finite fields. Necessary and sufficient conditions are given in order that a given binomial is stable over $\mathbb{F}_q$. These conditions are used to construct a table listing the stable binomials over $\mathbb{F}_q$ of the form $f(x)=x^d-a$, $a\in\mathbb{F}_q\setminus\{0,1\}$, for $q \leq 27$ and $d \leq 10$. The paper ends with a brief link with Mersenne primes.


title: On polynomial interpolation in the monomial basis

abstract: In this paper, we show that the monomial basis is generally as good as a well-conditioned polynomial basis for interpolation, provided that the condition number of the Vandermonde matrix is smaller than the reciprocal of machine epsilon.


title: Privacy-Preserving Domain Adaptation of Semantic Parsers

abstract: Task-oriented dialogue systems often assist users with personal or confidential matters. For this reason, the developers of such a system are generally prohibited from observing actual usage. So how can they know where the system is failing and needs more training data or new functionality? In this work, we study ways in which realistic user utterances can be generated synthetically, to help increase the linguistic and functional coverage of the system, without compromising the privacy of actual users. To this end, we propose a two-stage Differentially Private (DP) generation method which first generates latent semantic parses, and then generates utterances based on the parses. Our proposed approach improves MAUVE by 2.5$\times$ and parse tree function type overlap by 1.3$\times$ relative to current approaches for private synthetic data generation, improving both on fluency and semantic coverage. We further validate our approach on a realistic domain adaptation task of adding new functionality from private user data to a semantic parser, and show overall gains of 8.5% points in accuracy with the new feature.


title: Single virus fingerprinting by widefield interferometric defocus-enhanced mid-infrared photothermal microscopy

abstract: Clinical identification and fundamental study of viruses rely on the detection of viral proteins or viral nucleic acids. Yet, amplification-based and antigen-based methods are not able to provide precise compositional information of individual virions due to small particle size and low-abundance chemical contents (e.g., ~ 5000 proteins in a vesicular stomatitis virus). Here, we report a widefield interferometric defocus-enhanced mid-infrared photothermal (WIDE-MIP) microscope for high-throughput fingerprinting of single viruses. With the identification of feature absorption peaks, WIDE-MIP reveals the contents of viral proteins and nucleic acids in single DNA vaccinia viruses and RNA vesicular stomatitis viruses. Different nucleic acids signatures of thymine and uracil residue vibrations are obtained to differentiate DNA and RNA viruses. WIDE-MIP imaging further reveals an enriched \b{eta} sheet components in DNA varicella-zoster virus proteins. Together, these advances open a new avenue for compositional analysis of viral vectors and elucidating protein function in an assembled virion.


title: Transformers Go for the LOLs: Generating (Humourous) Titles from Scientific Abstracts End-to-End

abstract: We consider the end-to-end abstract-to-title generation problem, exploring seven recent transformer based models (including ChatGPT) fine-tuned on more than 30k abstract-title pairs from NLP and machine learning (ML) venues. As an extension, we also consider the harder problem of generating humorous paper titles. For the latter, we compile the first large-scale humor annotated dataset for scientific papers in the NLP/ML domains, comprising almost ~2.6k titles. We evaluate all models using human and automatic metrics. Our human evaluation suggests that our best end-to-end system performs similarly to human authors (but arguably slightly worse). Generating funny titles is more difficult, however, and our automatic systems clearly underperform relative to humans and often learn dataset artefacts of humor. Finally, ChatGPT, without any fine-tuning, performs on the level of our best fine-tuned system.


title: Concatenated Forward Error Correction with KP4 and Single Parity Check Codes

abstract: Concatenated forward error correction is studied using an outer KP4 Reed-Solomon code with hard-decision decoding and inner single parity check (SPC) codes with Chase/Wagner soft-decision decoding. Analytical expressions are derived for the end-to-end frame and bit error rates for transmission over additive white Gaussian noise channels with binary phase-shift keying (BPSK) and quaternary amplitude shift keying (4-ASK), as well as with symbol interleavers and quantized channel outputs. The BPSK error rates are compared to those of two other inner codes: a two-dimensional product code with SPC component codes and an extended Hamming code. Simulation results for unit-memory inter-symbol interference channels and 4-ASK are also presented. The results show that the coding schemes achieve similar error rates, but SPC codes have the lowest complexity and permit flexible rate adaptation.


title: Supercurrent renormalization of $\mathcal{N}=1$ supersymmetric Yang-Mills theory on the lattice

abstract: Supersymmetry on the lattice is explicitly broken by the gluino mass and lattice artifacts. However, it can be restored in the continuum limit by fine tuning the parameters based on the renormalized Ward identities. On the renormalization step not only the mass but also the renormalization of the supercurrent needs to be addressed. Here we present a lattice investigation to obtain the renormalization factors of the supercurrent for $\mathcal{N}$=1 Super-Yang Mills theory in a gauge invariant renormalization scheme. We also provide the conversion factors which are necessary in order to translate our results to the more standard $\overline{\text{MS}}$ scheme.


title: SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks

abstract: Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not nearly as many SLU task benchmarks, and many of the existing ones use data that is not freely available to all researchers. Recent work has begun to introduce such benchmark datasets for several tasks. In this work, we introduce several new annotated SLU benchmark tasks based on freely available speech data, which complement existing benchmarks and address gaps in the SLU evaluation landscape. We contribute four tasks: question answering and summarization involve inference over longer speech sequences; named entity localization addresses the speech-specific task of locating the targeted content in the signal; dialog act classification identifies the function of a given speech utterance. We follow the blueprint of the Spoken Language Understanding Evaluation (SLUE) benchmark suite. In order to facilitate the development of SLU models that leverage the success of pre-trained speech representations, we will be publishing for each task (i) annotations for a relatively small fine-tuning set, (ii) annotated development and test sets, and (iii) baseline models for easy reproducibility and comparisons. In this work, we present the details of data collection and annotation and the performance of the baseline models. We also perform sensitivity analysis of pipeline models' performance (speech recognizer + text model) to the speech recognition accuracy, using more than 20 state-of-the-art speech recognition models.


title: Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval

abstract: Multi-document summarization (MDS) assumes a set of topic-related documents are provided as input. In practice, this document set is not always available; it would need to be retrieved given an information need, i.e. a question or topic statement, a setting we dub "open-domain" MDS. We study this more challenging setting by formalizing the task and bootstrapping it using existing datasets, retrievers and summarizers. Via extensive automatic and human evaluation, we determine: (1) state-of-the-art summarizers suffer large reductions in performance when applied to open-domain MDS, (2) additional training in the open-domain setting can reduce this sensitivity to imperfect retrieval, and (3) summarizers are insensitive to the retrieval of duplicate documents and the order of retrieved documents, but highly sensitive to other errors, like the retrieval of irrelevant documents. Based on our results, we provide practical guidelines to enable future work on open-domain MDS, e.g. how to choose the number of retrieved documents to summarize. Our results suggest that new retrieval and summarization methods and annotated resources for training and evaluation are necessary for further progress in the open-domain setting.


title: Search for Gamma-ray Spectral Lines from Dark Matter Annihilation up to 100 TeV towards the Galactic Center with MAGIC

abstract: Line-like features in TeV $\gamma$-rays constitute a ''smoking gun'' for TeV-scale particle dark matter and new physics. Probing the Galactic Center region with ground-based Cherenkov telescopes enables the search for TeV spectral features in immediate association with a dense dark matter reservoir at a sensitivity out of reach for satellite $\gamma$-ray detectors, and direct detection and collider experiments. We report on 223 hours of observations of the Galactic Center region with the MAGIC stereoscopic telescope system reaching $\gamma$-ray energies up to 100 TeV. We improved the sensitivity to spectral lines at high energies using large-zenith-angle observations and a novel background modeling method within a maximum-likelihood analysis in the energy domain. No line-like spectral feature is found in our analysis. Therefore, we constrain the cross section for dark matter annihilation into two photons to $\langle \sigma v \rangle \lesssim 5 \times 10^{-28}\,\mathrm{cm^3\,s^{-1}}$ at 1 TeV and $\langle \sigma v \rangle \lesssim 1 \times 10^{-25}\,\mathrm{cm^3\,s^{-1}}$ at 100 TeV, achieving the best limits to date for a dark matter mass above 20 TeV and a cuspy dark matter profile at the Galactic Center. Finally, we use the derived limits for both cuspy and cored dark matter profiles to constrain supersymmetric wino models.


title: HYRR: Hybrid Infused Reranking for Passage Retrieval

abstract: We present Hybrid Infused Reranking for Passages Retrieval (HYRR), a framework for training rerankers based on a hybrid of BM25 and neural retrieval models. Retrievers based on hybrid models have been shown to outperform both BM25 and neural models alone. Our approach exploits this improved performance when training a reranker, leading to a robust reranking model. The reranker, a cross-attention neural model, is shown to be robust to different first-stage retrieval systems, achieving better performance than rerankers simply trained upon the first-stage retrievers in the multi-stage systems. We present evaluations on a supervised passage retrieval task using MS MARCO and zero-shot retrieval tasks using BEIR. The empirical results show strong performance on both evaluations.


title: Evaluating Psychological Safety of Large Language Models

abstract: In this work, we designed unbiased prompts to systematically evaluate the psychological safety of large language models (LLMs). First, we tested five different LLMs by using two personality tests: Short Dark Triad (SD-3) and Big Five Inventory (BFI). All models scored higher than the human average on SD-3, suggesting a relatively darker personality pattern. Despite being instruction fine-tuned with safety metrics to reduce toxicity, InstructGPT, GPT-3.5, and GPT-4 still showed dark personality patterns; these models scored higher than self-supervised GPT-3 on the Machiavellianism and narcissism traits on SD-3. Then, we evaluated the LLMs in the GPT series by using well-being tests to study the impact of fine-tuning with more training data. We observed a continuous increase in the well-being scores of GPT models. Following these observations, we showed that fine-tuning Llama-2-chat-7B with responses from BFI using direct preference optimization could effectively reduce the psychological toxicity of the model. Based on the findings, we recommended the application of systematic and comprehensive psychological metrics to further evaluate and improve the safety of LLMs.


title: KdV-type equations in projective Gevrey classes

abstract: We prove well-posedness of the Cauchy problem for a class of third order quasilinear evolution equations with variable coefficients in projective Gevrey spaces. The class considered is connected with several equations in Mathematical Physics as the KdV and KdVB equation and some of their many generalizations.


title: JWST UNCOVER: Extremely red and compact object at$z_{\mathrm{phot}}\simeq7.6$ triply imaged by Abell 2744

abstract: Recent JWST/NIRCam imaging taken for the ultra-deep UNCOVER program reveals a very red dropout object at $z_{\mathrm{phot}}\simeq7.6$, triply imaged by the galaxy cluster Abell 2744 ($z_{\mathrm{d}}=0.308$). All three images are very compact, i.e. unresolved, with a de-lensed size upper-limit of $r_{e}\lesssim35$ pc. The images have apparent magnitudes of $m_{\mathrm{F444W}}\sim25-26$ AB, and the magnification-corrected absolute UV magnitude of the source is $M_{\mathrm{UV},1450}=-16.81\pm0.09$. From the sum of observed fluxes and from a spectral energy distribution (SED) analysis, we obtain estimates of the bolometric luminosities of the source of $L_{\mathrm{bol}}\gtrsim10^{43} \frac{\mathrm{erg}}{\mathrm{s}}$ and $L_{\mathrm{bol}}\sim10^{44}-10^{46} \frac{\mathrm{erg}}{\mathrm{s}}$, respectively. Based on its compact, point-like appearance, its position in color-color space and the SED analysis, we tentatively conclude that this object is a UV-faint dust-obscured quasar-like object, i.e. an active galactic nucleus (AGN) at high redshift. We also discuss other alternative origins for the object's emission features, including a massive star cluster, Population III, supermassive, or dark stars, or a direct-collapse black hole. Although populations of red galaxies at similar photometric redshifts have been detected with JWST, this object is unique in that its high-redshift nature is corroborated geometrically by lensing, that it is unresolved despite being magnified -- and thus intrinsically even more compact -- and that it occupies notably distinct regions in both size-luminosity and color-color space. Planned UNCOVER JWST/NIRSpec observations, scheduled in Cycle 1, will enable a more detailed analysis of this object.


title: Stochastic Cyclic Inventory Routing with Supply Uncertainty: A Case in Green-Hydrogen Logistics

abstract: Hydrogen can be produced from water, using electricity. The hydrogen can subsequently be kept in inventory in large quantities, unlike the electricity itself. This enables solar and wind energy generation to occur asynchronously from its usage. For this reason, hydrogen is expected to be a key ingredient for reaching a climate-neutral economy. However, the logistics for hydrogen are complex. Inventory policies must be determined for multiple locations in the network, and transportation of hydrogen from the production location to customers must be scheduled. At the same time, production patterns of hydrogen are intermittent, which affects the possibilities to realize the planned transportation and inventory levels. To provide policies for efficient transportation and storage of hydrogen, this paper proposes a parameterized cost function approximation approach to the stochastic cyclic inventory routing problem. Firstly, our approach includes a parameterized mixed integer programming (MIP) model which yields fixed and repetitive schedules for vehicle transportation of hydrogen. Secondly, buying and selling decisions in case of underproduction or overproduction are optimized further via a Markov decision process (MDP) model, taking into account the uncertainties in production and demand quantities. To jointly optimize the parameterized MIP and the MDP model, our approach includes an algorithm that searches the parameter space by iteratively solving the MIP and MDP models. We conduct computational experiments to validate our model in various problem settings and show that it provides near-optimal solutions. Moreover, we test our approach on an expert-reviewed case study at two hydrogen production locations in the Netherlands. We offer insights for the stakeholders in the region and analyze the impact of various problem elements in these case studies.


title: The Risks of Ranking: Revisiting Graphical Perception to Model Individual Differences in Visualization Performance

abstract: Graphical perception studies typically measure visualization encoding effectiveness using the error of an "average observer", leading to canonical rankings of encodings for numerical attributes: e.g., position > area > angle > volume. Yet different people may vary in their ability to read different visualization types, leading to variance in this ranking across individuals not captured by population-level metrics using "average observer" models. One way we can bridge this gap is by recasting classic visual perception tasks as tools for assessing individual performance, in addition to overall visualization performance. In this paper we replicate and extend Cleveland and McGill's graphical comparison experiment using Bayesian multilevel regression, using these models to explore individual differences in visualization skill from multiple perspectives. The results from experiments and modeling indicate that some people show patterns of accuracy that credibly deviate from the canonical rankings of visualization effectiveness. We discuss implications of these findings, such as a need for new ways to communicate visualization effectiveness to designers, how patterns in individuals' responses may show systematic biases and strategies in visualization judgment, and how recasting classic visual perception tasks as tools for assessing individual performance may offer new ways to quantify aspects of visualization literacy. Experiment data, source code, and analysis scripts are available at the following repository: https://osf.io/8ub7t/?view\_only=9be4798797404a4397be3c6fc2a68cc0.


title: DISCO: Distilling Counterfactuals with Large Language Models

abstract: Models trained with counterfactually augmented data learn representations of the causal structure of tasks, enabling robust generalization. However, high-quality counterfactual data is scarce for most tasks and not easily generated at scale. When crowdsourced, such data is typically limited in scale and diversity; when generated using supervised methods, it is computationally expensive to extend to new counterfactual dimensions. In this work, we introduce DISCO (DIStilled COunterfactual Data), a new method for automatically generating high quality counterfactual data at scale. DISCO engineers prompts to generate phrasal perturbations with a large general language model. Then, a task-specific teacher model filters these generations to distill high-quality counterfactual data. While task-agnostic, we apply our pipeline to the task of natural language inference (NLI) and find that on challenging evaluations such as the NLI stress test, comparatively smaller student models trained with DISCO generated counterfactuals are more robust (6% absolute) and generalize better across distributions (2%) compared to models trained without data augmentation. Furthermore, DISCO augmented models are 10% more consistent between counterfactual pairs on three evaluation sets, demonstrating that DISCO augmentation enables models to more reliably learn causal representations. Our repository is available at: https://github.com/eric11eca/disco


title: A Survey of Deep Learning for Mathematical Reasoning

abstract: Mathematical reasoning is a fundamental aspect of human intelligence and is applicable in various fields, including science, engineering, finance, and everyday life. The development of artificial intelligence (AI) systems capable of solving math problems and proving theorems has garnered significant interest in the fields of machine learning and natural language processing. For example, mathematics serves as a testbed for aspects of reasoning that are challenging for powerful deep learning models, driving new algorithmic and modeling advances. On the other hand, recent advances in large-scale neural language models have opened up new benchmarks and opportunities to use deep learning for mathematical reasoning. In this survey paper, we review the key tasks, datasets, and methods at the intersection of mathematical reasoning and deep learning over the past decade. We also evaluate existing benchmarks and methods, and discuss future research directions in this domain.


title: Measure More, Question More: Experimental Studies on Transformer-based Language Models and Complement Coercion

abstract: Transformer-based language models have shown strong performance on an array of natural language understanding tasks. However, the question of how these models react to implicit meaning has been largely unexplored. We investigate this using the complement coercion phenomenon, which involves sentences like "The student finished the book about sailing" where the action "reading" is implicit. We compare LMs' surprisal estimates at various critical sentence regions in sentences with and without implicit meaning. Effects associated with recovering implicit meaning were found at a critical region other than where sentences minimally differ. We then use follow-up experiments to factor out potential confounds, revealing different perspectives that offer a richer and more accurate picture.


title: Does CLIP Bind Concepts? Probing Compositionality in Large Image Models

abstract: Large-scale neural network models combining text and images have made incredible progress in recent years. However, it remains an open question to what extent such models encode compositional representations of the concepts over which they operate, such as correctly identifying ''red cube'' by reasoning over the constituents ''red'' and ''cube''. In this work, we focus on the ability of a large pretrained vision and language model (CLIP) to encode compositional concepts and to bind variables in a structure-sensitive way (e.g., differentiating ''cube behind sphere'' from ''sphere behind cube''). In order to inspect the performance of CLIP, we compare several architectures from research on compositional distributional semantics models (CDSMs), a line of research that attempts to implement traditional compositional linguistic structures within embedding spaces. We find that CLIP can compose concepts in a single-object setting, but in situations where concept binding is needed, performance drops dramatically. At the same time, CDSMs also perform poorly, with best performance at chance level.


title: HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes

abstract: Bayesian optimization (BO), while proved highly effective for many black-box function optimization tasks, requires practitioners to carefully select priors that well model their functions of interest. Rather than specifying by hand, researchers have investigated transfer learning based methods to automatically learn the priors, e.g. multi-task BO (Swersky et al., 2013), few-shot BO (Wistuba and Grabocka, 2021) and HyperBO (Wang et al., 2022). However, those prior learning methods typically assume that the input domains are the same for all tasks, weakening their ability to use observations on functions with different domains or generalize the learned priors to BO on different search spaces. In this work, we present HyperBO+: a pre-training approach for hierarchical Gaussian processes that enables the same prior to work universally for Bayesian optimization on functions with different domains. We propose a two-step pre-training method and analyze its appealing asymptotic properties and benefits to BO both theoretically and empirically. On real-world hyperparameter tuning tasks that involve multiple search spaces, we demonstrate that HyperBO+ is able to generalize to unseen search spaces and achieves lower regrets than competitive baselines.


title: Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?

abstract: Large language models can perform new tasks in a zero-shot fashion, given natural language prompts that specify the desired behavior. Such prompts are typically hand engineered, but can also be learned with gradient-based methods from labeled data. However, it is underexplored what factors make the prompts effective, especially when the prompts are natural language. In this paper, we investigate common attributes shared by effective prompts. We first propose a human readable prompt tuning method (F LUENT P ROMPT) based on Langevin dynamics that incorporates a fluency constraint to find a diverse distribution of effective and fluent prompts. Our analysis reveals that effective prompts are topically related to the task domain and calibrate the prior probability of label words. Based on these findings, we also propose a method for generating prompts using only unlabeled data, outperforming strong baselines by an average of 7.0% accuracy across three tasks.


title: Challenges in Using mHealth Data From Smartphones and Wearable Devices to Predict Depression Symptom Severity: Retrospective Analysis

abstract: A number of challenges exist for the analysis of mHealth data: maintaining participant engagement over extended time periods and therefore understanding what constitutes an acceptable threshold of missing data; distinguishing between the cross-sectional and longitudinal relationships for different features to determine their utility in tracking within-individual longitudinal variation or screening individuals at high risk; and understanding the heterogeneity with which depression manifests itself in behavioral patterns quantified by the passive features. From 479 participants with MDD, we extracted 21 features capturing mobility, sleep, and smartphone use. We investigated the impact of the number of days of available data on feature quality using the intraclass correlation coefficient and Bland-Altman analysis. We then examined the nature of the correlation between the 8-item Patient Health Questionnaire (PHQ-8) depression scale (measured every 14 days) and the features using the individual-mean correlation, repeated measures correlation, and linear mixed effects model. Furthermore, we stratified the participants based on their behavioral difference, quantified by the features, between periods of high (depression) and low (no depression) PHQ-8 scores using the Gaussian mixture model. We demonstrated that at least 8 (range 2-12) days were needed for reliable calculation of most of the features in the 14-day time window. We observed that features such as sleep onset time correlated better with PHQ-8 scores cross-sectionally than longitudinally, whereas features such as wakefulness after sleep onset correlated well with PHQ-8 longitudinally but worse cross-sectionally. Finally, we found that participants could be separated into 3 distinct clusters according to their behavioral difference between periods of depression and periods of no depression.


title: UNO-QA: An Unsupervised Anomaly-Aware Framework with Test-Time Clustering for OCTA Image Quality Assessment

abstract: Medical image quality assessment (MIQA) is a vital prerequisite in various medical image analysis applications. Most existing MIQA algorithms are fully supervised that request a large amount of annotated data. However, annotating medical images is time-consuming and labor-intensive. In this paper, we propose an unsupervised anomaly-aware framework with test-time clustering for optical coherence tomography angiography (OCTA) image quality assessment in a setting wherein only a set of high-quality samples are accessible in the training phase. Specifically, a feature-embedding-based low-quality representation module is proposed to quantify the quality of OCTA images and then to discriminate between outstanding quality and non-outstanding quality. Within the non-outstanding quality class, to further distinguish gradable images from ungradable ones, we perform dimension reduction and clustering of multi-scale image features extracted by the trained OCTA quality representation network. Extensive experiments are conducted on one publicly accessible dataset sOCTA-3*3-10k, with superiority of our proposed framework being successfully established.


title: On generalized Ramsey numbers in the non-integral regime

abstract: A $(p,q)$-coloring of a graph $G$ is an edge-coloring of $G$ such that every $p$-clique receives at least $q$ colors. In 1975, Erd\H{o}s and Shelah introduced the generalized Ramsey number $f(n,p,q)$ which is the minimum number of colors needed in a $(p,q)$-coloring of $K_n$. In 1997, Erd\H{o}s and Gy\'arf\'as showed that $f(n,p,q)$ is at most a constant times $n^{\frac{p-2}{\binom{p}{2} - q + 1}}$. Very recently the first author, Dudek, and English improved this bound by a factor of $\log n^{\frac{-1}{\binom{p}{2} - q + 1}} $ for all $q \le \frac{p^2 - 26p + 55}{4}$, and they ask if this improvement could hold for a wider range of $q$. We answer this in the affirmative for the entire non-integral regime, that is, for all integers $p, q$ with $p-2$ not divisible by $\binom{p}{2} - q + 1$. Furthermore, we provide a simultaneous three-way generalization as follows: where $p$-clique is replaced by any fixed graph $F$ (with $|V(F)|-2$ not divisible by $|E(F)| - q + 1$); to list coloring; and to $k$-uniform hypergraphs. Our results are a new application of the Forbidden Submatching Method of the second and fourth authors.


title: Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts

abstract: Text detoxification has the potential to mitigate the harms of toxicity by rephrasing text to remove offensive meaning, but subtle toxicity remains challenging to tackle. We introduce MaRCo, a detoxification algorithm that combines controllable generation and text rewriting methods using a Product of Experts with autoencoder language models (LMs). MaRCo uses likelihoods under a non-toxic LM (expert) and a toxic LM (anti-expert) to find candidate words to mask and potentially replace. We evaluate our method on several subtle toxicity and microaggressions datasets, and show that it not only outperforms baselines on automatic metrics, but MaRCo's rewrites are preferred 2.1 $\times$ more in human evaluation. Its applicability to instances of subtle toxicity is especially promising, demonstrating a path forward for addressing increasingly elusive online hate.


title: Pretraining Without Attention

abstract: Transformers have been essential to pretraining success in NLP. While other architectures have been used, downstream accuracy is either significantly worse, or requires attention layers to match standard benchmarks such as GLUE. This work explores pretraining without attention by using recent advances in sequence routing based on state-space models (SSMs). Our proposed model, Bidirectional Gated SSM (BiGS), combines SSM layers with a multiplicative gating architecture that has been effective in simplified sequence modeling architectures. The model learns static layers that do not consider pair-wise interactions. Even so, BiGS is able to match BERT pretraining accuracy on GLUE and can be extended to long-form pretraining of 4096 tokens without approximation. Analysis shows that while the models have similar average accuracy, the approach has different inductive biases than BERT in terms of interactions and syntactic representations. All models from this work are available at https://github.com/jxiw/BiGS.


title: DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships

abstract: In this paper, we propose DimonGen, which aims to generate diverse sentences describing concept relationships in various everyday scenarios. To support this, we first create a benchmark dataset for this task by adapting the existing CommonGen dataset. We then propose a two-stage model called MoREE to generate the target sentences. MoREE consists of a mixture of retrievers model that retrieves diverse context sentences related to the given concepts, and a mixture of generators model that generates diverse sentences based on the retrieved contexts. We conduct experiments on the DimonGen task and show that MoREE outperforms strong baselines in terms of both the quality and diversity of the generated sentences. Our results demonstrate that MoREE is able to generate diverse sentences that reflect different relationships between concepts, leading to a comprehensive understanding of concept relationships.


title: On the Higgs spectra of the 3-3-1 model with the sextet of scalars engendering the type II seesaw mechanism

abstract: In the 3-3-1 model with right-handed neutrinos, three triplets of scalars engender the correct sequence of symmetry breaking, $SU(3)_C \times SU(3)_L \times U(1)_X \rightarrow SU(3)_C \times SU(2)_L \times U(1)_Y \rightarrow SU(3)_C \times U(1)_{EM}$, generating mass for all fermions, except neutrinos. Tiny neutrino masses may be achieved by adding one sextet of scalars to the original scalar content. As consequence, it emerges a very complex scalar sector, involving terms that violate lepton number explicitly, too. The main obstacle to the development of the phenomenology of such scenario is the knowledge of its spectrum of scalars since, now, there are 15 massive scalar particles on it. The proposal of this work is to do an exhaustive analysis of such scalar sector with lepton number being explicitly violated at low, electroweak and high energy scales by means of trilinear terms in the potential. The first case can be addressed analytically and, as a nice result, we have observed that the scalar content of such case is split into two categories: One belonging to the 331 energy scale and the other belonging to the EWSB energy scale, with the last recovering the well known THDM+triplet. For the other cases, the scalar sector can be addressed only numerically. Hence, we proposed a very general approach for the numerical study of the potential, avoiding simplifications that can make us reach conclusions without foundation. We show that, in the case of lepton number being explicitly violated at electroweak scale, it is possible to recover the same physics of the THDM+triplet, as the previous case. Among all the possibilities, we call the attention to one special case which generates the 3HDM+triplet scenario. For the last case, when lepton number is violated at high energy scale, the sextet become very massive and decouples from the original scalar content of the 3-3-1 model.


title: Semantically-informed Hierarchical Event Modeling

abstract: Prior work has shown that coupling sequential latent variable models with semantic ontological knowledge can improve the representational capabilities of event modeling approaches. In this work, we present a novel, doubly hierarchical, semi-supervised event modeling framework that provides structural hierarchy while also accounting for ontological hierarchy. Our approach consists of multiple layers of structured latent variables, where each successive layer compresses and abstracts the previous layers. We guide this compression through the injection of structured ontological knowledge that is defined at the type level of events: importantly, our model allows for partial injection of semantic knowledge and it does not depend on observing instances at any particular level of the semantic ontology. Across two different datasets and four different evaluation metrics, we demonstrate that our approach is able to out-perform the previous state-of-the-art approaches by up to 8.5%, demonstrating the benefits of structured and semantic hierarchical knowledge for event modeling.


title: T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks

abstract: In the absence of readily available labeled data for a given sequence labeling task and language, annotation projection has been proposed as one of the possible strategies to automatically generate annotated data. Annotation projection has often been formulated as the task of transporting, on parallel corpora, the labels pertaining to a given span in the source language into its corresponding span in the target language. In this paper we present T-Projection, a novel approach for annotation projection that leverages large pretrained text-to-text language models and state-of-the-art machine translation technology. T-Projection decomposes the label projection task into two subtasks: (i) A candidate generation step, in which a set of projection candidates using a multilingual T5 model is generated and, (ii) a candidate selection step, in which the generated candidates are ranked based on translation probabilities. We conducted experiments on intrinsic and extrinsic tasks in 5 Indo-European and 8 low-resource African languages. We demostrate that T-projection outperforms previous annotation projection methods by a wide margin. We believe that T-Projection can help to automatically alleviate the lack of high-quality training data for sequence labeling tasks. Code and data are publicly available.


title: Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment

abstract: Despite recent progress towards scaling up multimodal vision-language models, these models are still known to struggle on compositional generalization benchmarks such as Winoground. We find that a critical component lacking from current vision-language models is relation-level alignment: the ability to match directional semantic relations in text (e.g., "mug in grass") with spatial relationships in the image (e.g., the position of the mug relative to the grass). To tackle this problem, we show that relation alignment can be enforced by encouraging the directed language attention from 'mug' to 'grass' (capturing the semantic relation 'in') to match the directed visual attention from the mug to the grass. Tokens and their corresponding objects are softly identified using the cross-modal attention. We prove that this notion of soft relation alignment is equivalent to enforcing congruence between vision and language attention matrices under a 'change of basis' provided by the cross-modal attention matrix. Intuitively, our approach projects visual attention into the language attention space to calculate its divergence from the actual language attention, and vice versa. We apply our Cross-modal Attention Congruence Regularization (CACR) loss to UNITER and improve on the state-of-the-art approach to Winoground.


title: InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds

abstract: In this paper, we take a significant step towards real-world applicability of monocular neural avatar reconstruction by contributing InstantAvatar, a system that can reconstruct human avatars from a monocular video within seconds, and these avatars can be animated and rendered at an interactive rate. To achieve this efficiency we propose a carefully designed and engineered system, that leverages emerging acceleration structures for neural fields, in combination with an efficient empty space-skipping strategy for dynamic scenes. We also contribute an efficient implementation that we will make available for research purposes. Compared to existing methods, InstantAvatar converges 130x faster and can be trained in minutes instead of hours. It achieves comparable or even better reconstruction quality and novel pose synthesis results. When given the same time budget, our method significantly outperforms SoTA methods. InstantAvatar can yield acceptable visual quality in as little as 10 seconds training time.


title: Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translation

abstract: Multilingual neural machine translation (MNMT) aims to build a unified model for many language directions. Existing monolithic models for MNMT encounter two challenges: parameter interference among languages and inefficient inference for large models. In this paper, we revisit the classic multi-way structures and develop a detachable model by assigning each language (or group of languages) to an individual branch that supports plug-and-play training and inference. To address the needs of learning representations for all languages in a unified space, we propose a novel efficient training recipe, upon which we build an effective detachable model, Lego-MT. For a fair comparison, we collect data from OPUS and build a translation benchmark covering 433 languages and 1.3B parallel data. Experiments show that Lego-MT with 1.2B parameters brings an average gain of 3.2 spBLEU. It even outperforms M2M-100 with 12B parameters. The proposed training recipe brings a 28.2$\times$ speedup over the conventional multi-way training method.\footnote{ \url{https://github.com/CONE-MT/Lego-MT}.}


title: Measurement of the charge asymmetry in top-quark pair production in association with a photon with the ATLAS experiment

abstract: A measurement of the charge asymmetry in top-quark pair ($t\bar{t}$) production in association with a photon is presented. The measurement is performed in the single-lepton $t\bar{t}$ decay channel using proton-proton collision data collected with the ATLAS detector at the Large Hadron Collider at CERN at a centre-of-mass-energy of 13 TeV during the years 2015-2018, corresponding to an integrated luminosity of 139 fb$^{-1}$. The charge asymmetry is obtained from the distribution of the difference of the absolute rapidities of the top quark and antiquark using a profile likelihood unfolding approach. It is measured to be $A_\text{C}=-0.003 \pm 0.029$ in agreement with the Standard Model expectation.


title: RangeAugment: Efficient Online Augmentation with Range Learning

abstract: State-of-the-art automatic augmentation methods (e.g., AutoAugment and RandAugment) for visual recognition tasks diversify training data using a large set of augmentation operations. The range of magnitudes of many augmentation operations (e.g., brightness and contrast) is continuous. Therefore, to make search computationally tractable, these methods use fixed and manually-defined magnitude ranges for each operation, which may lead to sub-optimal policies. To answer the open question on the importance of magnitude ranges for each augmentation operation, we introduce RangeAugment that allows us to efficiently learn the range of magnitudes for individual as well as composite augmentation operations. RangeAugment uses an auxiliary loss based on image similarity as a measure to control the range of magnitudes of augmentation operations. As a result, RangeAugment has a single scalar parameter for search, image similarity, which we simply optimize via linear search. RangeAugment integrates seamlessly with any model and learns model- and task-specific augmentation policies. With extensive experiments on the ImageNet dataset across different networks, we show that RangeAugment achieves competitive performance to state-of-the-art automatic augmentation methods with 4-5 times fewer augmentation operations. Experimental results on semantic segmentation, object detection, foundation models, and knowledge distillation further shows RangeAugment's effectiveness.


title: A Length-Extrapolatable Transformer

abstract: Position modeling plays a critical role in Transformers. In this paper, we focus on length extrapolation, i.e., training on short texts while evaluating longer sequences. We define attention resolution as an indicator of extrapolation. Then we propose two designs to improve the above metric of Transformers. Specifically, we introduce a relative position embedding to explicitly maximize attention resolution. Moreover, we use blockwise causal attention during inference for better resolution. We evaluate different Transformer variants with language modeling. Experimental results show that our model achieves strong performance in both interpolation and extrapolation settings. The code will be available at https://aka.ms/LeX-Transformer.


title: PairReranker: Pairwise Reranking for Natural Language Generation

abstract: Pre-trained language models have been successful in natural language generation (NLG) tasks. While various decoding methods have been employed, they often produce suboptimal results. We first present an empirical analysis of three NLG tasks: summarization, machine translation, and constrained text generation. We found that selecting the best output from the results of multiple decoding methods can significantly improve performance. To further improve reranking for NLG tasks, we proposed a novel method, \textsc{PairReranker}, which uses a single encoder and a pairwise loss function to jointly encode a source input and a pair of candidates and compare them. Experiments on three NLG tasks demonstrated the effectiveness and flexibility of \textsc{PairReranker}, showing strong results, compared with previous baselines. In addition, our \textsc{PairReranker} can generalize to significantly improve GPT-3 (text-davinci-003) results (e.g., 24.55\% on CommonGen and 11.35\% on WMT18 zh-en), even though our rerankers are not trained with any GPT-3 candidates.


title: Unleashing the Power of Visual Prompting At the Pixel Level

abstract: This paper presents a simple and effective visual prompting method for adapting pre-trained models to downstream recognition tasks. Our method includes two key designs. First, rather than directly adding together the prompt and the image, we treat the prompt as an extra and independent learnable component. We show that the strategy of reconciling the prompt and the image matters, and find that warping the prompt around a properly shrinked image empirically works the best. Second, we re-introduce two "old tricks" commonly used in building transferable adversarial examples, i.e., input diversity and gradient normalization, into visual prompting. These techniques improve optimization and enable the prompt to generalize better. We provide extensive experimental results to demonstrate the effectiveness of our method. Using a CLIP model, our prompting method sets a new record of 82.8% average accuracy across 12 popular classification datasets, substantially surpassing the prior art by +5.6%. It is worth noting that this prompting performance already outperforms linear probing by +2.1% and can even match fully fine-tuning in certain datasets. In addition, our prompting method shows competitive performance across different data scales and against distribution shifts. The code is publicly available at https://github.com/UCSC-VLAA/EVP.


title: DialGuide: Aligning Dialogue Model Behavior with Developer Guidelines

abstract: Dialogue models are able to generate coherent and fluent responses, but they can still be challenging to control and may produce non-engaging, unsafe results. This unpredictability diminishes user trust and can hinder the use of the models in the real world. To address this, we introduce DialGuide, a novel framework for controlling dialogue model behavior using natural language rules, or guidelines. These guidelines provide information about the context they are applicable to and what should be included in the response, allowing the models to generate responses that are more closely aligned with the developer's expectations and intent. We evaluate DialGuide on three tasks in open-domain dialogue response generation: guideline selection, response generation, and response entailment verification. Our dataset contains 10,737 positive and 15,467 negative dialogue context-response-guideline triplets across two domains - chit-chat and safety. We provide baseline models for the tasks and benchmark their performance. We also demonstrate that DialGuide is effective in the dialogue safety domain, producing safe and engaging responses that follow developer guidelines.


title: On-the-fly Denoising for Data Augmentation in Natural Language Understanding

abstract: Data Augmentation (DA) is frequently used to provide additional training data without extra human annotation automatically. However, data augmentation may introduce noisy data that impairs training. To guarantee the quality of augmented data, existing methods either assume no noise exists in the augmented data and adopt consistency training or use simple heuristics such as training loss and diversity constraints to filter out "noisy" data. However, those filtered examples may still contain useful information, and dropping them completely causes a loss of supervision signals. In this paper, based on the assumption that the original dataset is cleaner than the augmented data, we propose an on-the-fly denoising technique for data augmentation that learns from soft augmented labels provided by an organic teacher model trained on the cleaner original data. To further prevent overfitting on noisy labels, a simple self-regularization module is applied to force the model prediction to be consistent across two distinct dropouts. Our method can be applied to general augmentation techniques and consistently improve the performance on both text classification and question-answering tasks.


title: Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers

abstract: Large pretrained language models have shown surprising in-context learning (ICL) ability. With a few demonstration input-label pairs, they can predict the label for an unseen input without parameter updates. Despite the great success in performance, its working mechanism still remains an open question. In this paper, we explain language models as meta-optimizers and understand in-context learning as implicit finetuning. Theoretically, we figure out that Transformer attention has a dual form of gradient descent. On top of it, we understand ICL as follows: GPT first produces meta-gradients according to the demonstration examples, and then these meta-gradients are applied to the original GPT to build an ICL model. We comprehensively compare the behaviors of in-context learning and explicit finetuning on real tasks to provide empirical evidence that supports our understanding. Experimental results show that in-context learning behaves similarly to explicit finetuning from multiple perspectives. Inspired by the dual form between Transformer attention and gradient descent, we design a momentum-based attention by analogy with gradient descent with momentum. The improved performance over vanilla attention further supports our understanding from another perspective, and more importantly, shows the potential to utilize our understanding for future model design. The code is available at \url{https://aka.ms/icl}.


title: Self-Instruct: Aligning Language Models with Self-Generated Instructions

abstract: Large "instruction-tuned" language models (i.e., finetuned to respond to instructions) have demonstrated a remarkable ability to generalize zero-shot to new tasks. Nevertheless, they depend heavily on human-written instruction data that is often limited in quantity, diversity, and creativity, therefore hindering the generality of the tuned model. We introduce Self-Instruct, a framework for improving the instruction-following capabilities of pretrained language models by bootstrapping off their own generations. Our pipeline generates instructions, input, and output samples from a language model, then filters invalid or similar ones before using them to finetune the original model. Applying our method to the vanilla GPT3, we demonstrate a 33% absolute improvement over the original model on Super-NaturalInstructions, on par with the performance of InstructGPT-001, which was trained with private user data and human annotations. For further evaluation, we curate a set of expert-written instructions for novel tasks, and show through human evaluation that tuning GPT3 with Self-Instruct outperforms using existing public instruction datasets by a large margin, leaving only a 5% absolute gap behind InstructGPT-001. Self-Instruct provides an almost annotation-free method for aligning pre-trained language models with instructions, and we release our large synthetic dataset to facilitate future studies on instruction tuning. Our code and data are available at https://github.com/yizhongw/self-instruct.


title: Parsel: Algorithmic Reasoning with Language Models by Composing Decompositions

abstract: Despite recent success in large language model (LLM) reasoning, LLMs struggle with hierarchical multi-step reasoning tasks like generating complex programs. For these tasks, humans often start with a high-level algorithmic design and implement each part gradually. We introduce Parsel, a framework enabling automatic implementation and validation of complex algorithms with code LLMs. With Parsel, we automatically decompose algorithmic tasks into hierarchical natural language function descriptions and then search over combinations of possible function implementations using tests. We show that Parsel can be used across domains requiring hierarchical reasoning, including program synthesis and robotic planning. We find that, using Parsel, LLMs solve more competition-level problems in the APPS dataset, resulting in pass rates over 75\% higher than prior results from directly sampling AlphaCode and Codex, while often using a smaller sample budget. Moreover, with automatically generated tests, we find that Parsel can improve the state-of-the-art pass@1 performance on HumanEval from 67\% to 85\%. We also find that LLM-generated robotic plans using Parsel are more than twice as likely to be considered accurate than directly generated plans. Lastly, we explore how Parsel addresses LLM limitations and discuss how Parsel may be useful for human programmers. We release our code at https://github.com/ezelikman/parsel


title: Character-Aware Models Improve Visual Text Rendering

abstract: Current image generation models struggle to reliably produce well-formed visual text. In this paper, we investigate a key contributing factor: popular text-to-image models lack character-level input features, making it much harder to predict a word's visual makeup as a series of glyphs. To quantify this effect, we conduct a series of experiments comparing character-aware vs. character-blind text encoders. In the text-only domain, we find that character-aware models provide large gains on a novel spelling task (WikiSpell). Applying our learnings to the visual domain, we train a suite of image generation models, and show that character-aware variants outperform their character-blind counterparts across a range of novel text rendering tasks (our DrawText benchmark). Our models set a much higher state-of-the-art on visual spelling, with 30+ point accuracy gains over competitors on rare words, despite training on far fewer examples.


title: BLIND: Bias Removal With No Demographics

abstract: Models trained on real-world data tend to imitate and amplify social biases. Common methods to mitigate biases require prior information on the types of biases that should be mitigated (e.g., gender or racial bias) and the social groups associated with each data sample. In this work, we introduce BLIND, a method for bias removal with no prior knowledge of the demographics in the dataset. While training a model on a downstream task, BLIND detects biased samples using an auxiliary model that predicts the main model's success, and down-weights those samples during the training process. Experiments with racial and gender biases in sentiment classification and occupation classification tasks demonstrate that BLIND mitigates social biases without relying on a costly demographic annotation process. Our method is competitive with other methods that require demographic information and sometimes even surpasses them.


title: Re-evaluating the Need for Multimodal Signals in Unsupervised Grammar Induction

abstract: Are multimodal inputs necessary for grammar induction? Recent work has shown that multimodal training inputs can improve grammar induction. However, these improvements are based on comparisons to weak text-only baselines that were trained on relatively little textual data. To determine whether multimodal inputs are needed in regimes with large amounts of textual training data, we design a stronger text-only baseline, which we refer to as LC-PCFG. LC-PCFG is a C-PFCG that incorporates em-beddings from text-only large language models (LLMs). We use a fixed grammar family to directly compare LC-PCFG to various multi-modal grammar induction methods. We compare performance on four benchmark datasets. LC-PCFG provides an up to 17% relative improvement in Corpus-F1 compared to state-of-the-art multimodal grammar induction methods. LC-PCFG is also more computationally efficient, providing an up to 85% reduction in parameter count and 8.8x reduction in training time compared to multimodal approaches. These results suggest that multimodal inputs may not be necessary for grammar induction, and emphasize the importance of strong vision-free baselines for evaluating the benefit of multimodal approaches.


title: Analysis of Explainable Artificial Intelligence Methods on Medical Image Classification

abstract: The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial intelligence in many critical tasks has exploded. In the medical domain, medical image classification systems are being adopted due to their high accuracy and near parity with human physicians in many tasks. However, these artificial intelligence systems are extremely complex and are considered black boxes by scientists, due to the difficulty in interpreting what exactly led to the predictions made by these models. When these systems are being used to assist high-stakes decision-making, it is extremely important to be able to understand, verify and justify the conclusions reached by the model. The research techniques being used to gain insight into the black-box models are in the field of explainable artificial intelligence (XAI). In this paper, we evaluated three different XAI methods across two convolutional neural network models trained to classify lung cancer from histopathological images. We visualized the outputs and analyzed the performance of these methods, in order to better understand how to apply explainable artificial intelligence in the medical domain.


title: Visual Analytics for Early Detection of Retinal Diseases

abstract: Advances in optical coherence tomography (OCT) have enabled noninvasive imaging of substructures of the human retina with high spatial resolution. OCT examinations are now a standard procedure in clinics and an integral part of ophthalmic research. The interpretation of the OCT helps ophthalmologists understand the impact of various retinal and systemic diseases on the structure of the retina in a way not previously possible. In the early stages of retinal diseases, however, the identification and analysis of small and localized substructural changes in the retina remains a challenge. We present an overview of novel visual analytics approaches for the interactive exploration of early retinal changes in single and multiple patients, the comparison of the changes with normative data, and automated quantification and measurement of diagnosis-relevant information. We developed these approaches in close collaboration with ophthalmology researchers and industry experts from a leading OCT device manufacturer. As a result, they not only significantly reduced the time and effort required for OCT data analysis, especially in the context of cross-sectional studies, but have also led to several new discoveries published in biomedical journals.


title: Anticancer Peptides Classification using Kernel Sparse Representation Classifier

abstract: Cancer is one of the most challenging diseases because of its complexity, variability, and diversity of causes. It has been one of the major research topics over the past decades, yet it is still poorly understood. To this end, multifaceted therapeutic frameworks are indispensable. \emph{Anticancer peptides} (ACPs) are the most promising treatment option, but their large-scale identification and synthesis require reliable prediction methods, which is still a problem. In this paper, we present an intuitive classification strategy that differs from the traditional \emph{black box} method and is based on the well-known statistical theory of \emph{sparse-representation classification} (SRC). Specifically, we create over-complete dictionary matrices by embedding the \emph{composition of the K-spaced amino acid pairs} (CKSAAP). Unlike the traditional SRC frameworks, we use an efficient \emph{matching pursuit} solver instead of the computationally expensive \emph{basis pursuit} solver in this strategy. Furthermore, the \emph{kernel principal component analysis} (KPCA) is employed to cope with non-linearity and dimension reduction of the feature space whereas the \emph{synthetic minority oversampling technique} (SMOTE) is used to balance the dictionary. The proposed method is evaluated on two benchmark datasets for well-known statistical parameters and is found to outperform the existing methods. The results show the highest sensitivity with the most balanced accuracy, which might be beneficial in understanding structural and chemical aspects and developing new ACPs. The Google-Colab implementation of the proposed method is available at the author's GitHub page (\href{https://github.com/ehtisham-Fazal/ACP-Kernel-SRC}{https://github.com/ehtisham-fazal/ACP-Kernel-SRC}).


title: Baryon Number Transport, Strangeness Conservation and $\Omega$-hadron Correlations

abstract: Although strange quarks are produced in $s\bar{s}$ pairs, the ratio of $\Omega^{-}$ to ${\bar{\Omega}}^{+}$ is greater than one in heavy-ion collisions at lower RHIC energies. Thus the produced $\Omega$ hyperons must carry net baryon quantum numbers from the colliding nuclei. We present results of $K$-$\Omega$ correlations from AMPT model simulations of Au+Au collisions at $\sqrt{s_{NN}}$ = 14.6 GeV, to probe dynamics for baryon number transport to mid-rapidities at this beam energy. We use both the default and string-melting versions to illustrate how hadronization schemes of quark coalescence and string fragmentations could leave imprints on such correlations. Implications on the measurements of these correlations with the STAR experiment at RHIC will also be discussed.


title: The phase-space architecture in extrasolar systems with two planets in orbits of high mutual inclination

abstract: We revisit the secular 3D planetary three-body problem aiming to provide a unified formalism for studying the structure of the phase space for progressively higher values of the mutual inclination $i_{mut}$ between the two planets' orbits. We propose a `book-keeping' technique yielding (after Jacobi reduction) a clear decomposition of the secular Hamiltonian as $H_{sec}=H_{planar} +H_{space}$, where $H_{space}$ contains all terms depending on $i_{mut}$. We numerically compare several models obtained via expansion in the orbital eccentricities or via multipole expansion. We find the mimimum required truncation orders to accurately represent the dynamics. We explore the transition, as $i_{mut}$ increases, from a `planar-like' to a `Lidov-Kozai' regime. Using a typical (non-hierarchical) example, we show how the structure of the phase portraits of the integrable secular dynamics of the planar case is reproduced to a large extent also in the 3D case. We estimate semi-analytically the level of $i_{mut}$ up to which the dynamics remains nearly-integrable. In this regime, we propose a normal form method by which the basic periodic orbits of the nearly-integrable regime (apsidal corotation resonances) can be computed semi-analytically. On the other hand, as the energy increases the system gradually moves to the `Lidov-Kozai' regime. The latter is dominated by two different families of inclined periodic orbits ($C_1$ and $C_2$), of which $C_2$ becomes unstable via the usual Lidov-Kozai mechanism. We discuss the connection between the above families of periodic orbits. Finally, we study numerically the form of the phase portraits for different mass and semi-major axis ratios of the two planets, aiming to establish how generic are the phenomena reported above as the systems parameters are chosen close to one or more hierarchical limits.


title: Video Segmentation Learning Using Cascade Residual Convolutional Neural Network

abstract: Video segmentation consists of a frame-by-frame selection process of meaningful areas related to foreground moving objects. Some applications include traffic monitoring, human tracking, action recognition, efficient video surveillance, and anomaly detection. In these applications, it is not rare to face challenges such as abrupt changes in weather conditions, illumination issues, shadows, subtle dynamic background motions, and also camouflage effects. In this work, we address such shortcomings by proposing a novel deep learning video segmentation approach that incorporates residual information into the foreground detection learning process. The main goal is to provide a method capable of generating an accurate foreground detection given a grayscale video. Experiments conducted on the Change Detection 2014 and on the private dataset PetrobrasROUTES from Petrobras support the effectiveness of the proposed approach concerning some state-of-the-art video segmentation techniques, with overall F-measures of $\mathbf{0.9535}$ and $\mathbf{0.9636}$ in the Change Detection 2014 and PetrobrasROUTES datasets, respectively. Such a result places the proposed technique amongst the top 3 state-of-the-art video segmentation methods, besides comprising approximately seven times less parameters than its top one counterpart.


title: The $SL(2,\mathbb{Z})$ dualization algorithm at work

abstract: Recently an algorithm to dualize a theory into its mirror dual has been proposed, both for $3d$ $\mathcal{N}=4$ linear quivers and for their $4d$ $\mathcal{N}=1$ uplift. This mimics the manipulations done at the level of the Type IIB brane setup that engineers the $3d$ theories, where mirror symmetry is realized as $S$-duality, but it is enirely field-theoretic and based on the application of genuine infra-red dualities that implement the local action of $S$-duality on the quiver. In this paper, we generalize the algorithm to the full duality group, which is $SL(2,\mathbb{Z})$ in $3d$ and $PSL(2,\mathbb{Z})$ in $4d$. This also produces dualities for $3d$ $\mathcal{N}=3$ theories with Chern--Simons couplings, some of which have enhanced $\mathcal{N}=4$ supersymmetry, and their new $4d$ $\mathcal{N}=1$ counterpart. In addition, we propose three ways to study the RG flows triggered by possible VEVs appearing at the last step of the algorithm, one of which uses a new duality that implements the Hanany--Witten move in field theory.


title: Reflections on Bubble Walls

abstract: We discuss the dynamics of expanding bubble walls in the presence of massive dark photons whose mass changes as they cross the wall. For sufficiently thin walls, we show that there exists a transient kinematic regime characterized by a constant reflection probability of longitudinal -- but not transverse -- modes. This effect can have important implications for the dynamics of expanding vacuum bubbles in the early Universe. Most notably, it leads to a new source of pressure on the expanding interface, featuring a non-monotonic dependence on the $\gamma$-factor of the bubble walls and reaching a peak at intermediate $\gamma$-factors that we dub Maximum Dynamic Pressure. When this pressure is large enough to halt the acceleration of the bubble walls, the difference in vacuum energy densities goes into making a fraction of the dark photons relativistic, turning them into dark radiation. If the dark radiation remains relativistic until late times, an observable contribution to $\Delta N_\text{eff}$ is possible for phase transitions with strength $\alpha \sim 10^{-2} - 10^{-1}$.


title: Moduli Space Reconstruction and Weak Gravity

abstract: We present a method to construct the extended K\"ahler cone of any Calabi-Yau threefold by using Gopakumar-Vafa invariants to identify all geometric phases that are related by flops or Weyl reflections. In this way we obtain the K\"ahler moduli spaces of all favorable Calabi-Yau threefold hypersurfaces with $h^{1,1} \le 4$, including toric and non-toric phases. In this setting we perform an explicit test of the Weak Gravity Conjecture by using the Gopakumar-Vafa invariants to count BPS states. All of our examples satisfy the tower/sublattice WGC, and in fact they even satisfy the stronger lattice WGC.


title: PHANGS-JWST First Results: Mid-infrared emission traces both gas column density and heating at 100 pc scales

abstract: We compare mid-infrared (mid-IR), extinction-corrected H$\alpha$, and CO (2-1) emission at 70--160 pc resolution in the first four PHANGS-JWST targets. We report correlation strengths, intensity ratios, and power law fits relating emission in JWST's F770W, F1000W, F1130W, and F2100W bands to CO and H$\alpha$. At these scales, CO and H$\alpha$ each correlate strongly with mid-IR emission, and these correlations are each stronger than the one relating CO to H$\alpha$ emission. This reflects that mid-IR emission simultaneously acts as a dust column density tracer, leading to the good match with the molecular gas-tracing CO, and as a heating tracer, leading to the good match with the H$\alpha$. By combining mid-IR, CO, and H$\alpha$ at scales where the overall correlation between cold gas and star formation begins to break down, we are able to separate these two effects. We model the mid-IR above $I_\nu = 0.5$~MJy sr$^{-1}$ at F770W, a cut designed to select regions where the molecular gas dominates the interstellar medium (ISM) mass. This bright emission can be described to first order by a model that combines a CO-tracing component and an H$\alpha$-tracing component. The best-fitting models imply that $\sim 50\%$ of the mid-IR flux arises from molecular gas heated by the diffuse interstellar radiation field, with the remaining $\sim 50\%$ associated with bright, dusty star forming regions. We discuss differences between the F770W, F1000W, F1130W bands and the continuum dominated F2100W band and suggest next steps for using the mid-IR as an ISM tracer.


title: The entropic $g$-theorem in general spacetime dimension

abstract: We establish the irreversibility of renormalization group flows on a pointlike defect inserted in a $d$-dimensional Lorentzian conformal field theory. We identify the impurity entropy $g$ with the quantum relative entropy in two equivalent ways. One involves a null deformation of the Cauchy surface, and the other is given in terms of a local quench protocol. Positivity and monotonicity of the relative entropy imply that $g$ decreases monotonically along renormalization group flows, and provides a clear information-theoretic meaning for this irreversibility.


title: Constraints on strong phase transitions in neutron stars

abstract: We study current bounds on strong first-order phase transitions (PTs) along the equation of state (EOS) of dense strongly interacting matter in neutron stars, under the simplifying assumption that on either side of the PT the EOS can be approximated by a simple polytropic form. We construct a large ensemble of possible EOSs of this form, anchor them to chiral effective field theory calculations at nuclear density and perturbative QCD at high densities, and subject them to astrophysical constraints from high-mass pulsars and gravitational-wave observations. Within this setup, we find that a PT permits neutron-star solutions with larger radii, but only if the transition begins below twice nuclear saturation density. We also identify a large parameter space of allowed PTs currently unexplored by numerical-relativity studies. Additionally, we locate a small region of parameter space allowing twin-star solutions, though we find them to only marginally pass the current astrophysical constraints. Finally, we find that sizeable cores of high-density matter beyond the PT may be located in the centers of some stable neutron stars, primarily those with larger masses.


title: Thermalization, Fragmentation and Tidal Disruption: The Complex Galactic Dynamics of Dark Matter Superfluidity

abstract: The idea of self-interacting bosonic dark matter capable of exhibiting superfluidity is revisited. We show that the most interesting parameter space of the theory corresponds to fully thermalized dark matter halos. As a result the entire halo undergoes Bose-Einstein condensation due to high degeneracy. Since it is observationally preferable for the dark matter density profile to be similar to cold dark matter in the outskirts of the halo, we argue that the Jeans wavelength must be at least few times shorter than the virial radius. This entails that, upon condensation, a dark matter halo fragments into superfluid clumps. However, we demonstrate that these would-be solitons experience strong tidal disruption and behave as virialized weakly interacting streams. An exception is the central soliton, which can be as large as few tens of kiloparsecs in size without contradicting observational bounds. As a result, in dwarf galaxies, the observed rotation curves can be completely contained within the superfluid soliton. In this case, the dark matter distribution is expected to be strongly sensitive to the baryonic density profile. We argue that the diversity of rotation curves observed for dwarf galaxies is a natural consequence of the superfluid dark matter scenario.

categories: astro-ph.CO astro-ph.GA gr-qc hep-ph hep-th


title: Multipoint Lightcone Bootstrap from Differential Equations

abstract: One of the most striking successes of the lightcone bootstrap has been the perturbative computation of the anomalous dimensions and OPE coefficients of double-twist operators with large spin. It is expected that similar results for multiple-twist families can be obtained by extending the lightcone bootstrap to multipoint correlators. However, very little was known about multipoint lightcone blocks until now, in particular for OPE channels of comb topology. Here, we develop a systematic theory of lightcone blocks for arbitrary OPE channels based on the analysis of Casimir and vertex differential equations. Most of the novel technology is developed in the context of five- and six-point functions. Equipped with new expressions for lightcone blocks, we analyze crossing symmetry equations and compute OPE coefficients involving two double-twist operators that were not known before. In particular, for the first time, we are able to resolve a discrete dependence on tensor structures at large spin. The computation of anomalous dimensions for triple-twist families from six-point crossing equations will be addressed in a sequel to this work.


title: Resonant Anomaly Detection with Multiple Reference Datasets

abstract: An important class of techniques for resonant anomaly detection in high energy physics builds models that can distinguish between reference and target datasets, where only the latter has appreciable signal. Such techniques, including Classification Without Labels (CWoLa) and Simulation Assisted Likelihood-free Anomaly Detection (SALAD) rely on a single reference dataset. They cannot take advantage of commonly-available multiple datasets and thus cannot fully exploit available information. In this work, we propose generalizations of CWoLa and SALAD for settings where multiple reference datasets are available, building on weak supervision techniques. We demonstrate improved performance in a number of settings with realistic and synthetic data. As an added benefit, our generalizations enable us to provide finite-sample guarantees, improving on existing asymptotic analyses.


title: Non canonical polarizations of Gravitational Waves

abstract: We hereby propose an alternative and additional angle on the nature of gravitational waves (GWs), postulating the theoretical and experimental possibility that GWs carry a deformation of the time component of spacetime, other than the spatial one. By explicitly working outside of the transverse-traceless gauge, we propose how events with welldefined time duration, when hit by a GW, would consequently be expected to show a difference in their characteristic time, as measured from the rest frame of an outside observer,whose clock is to remain unaffected by the GW. This constitutes a theoretically viable way in the sense of detecting the passing of the wave itself and may prove relevant as a standalone method for GWs detection other than laser interferometers, or as well be implemented as a complementary but independent system of signal triggering, improving the statistical significance of existing methods. A simple but physically realistic scenario in which the appropriate conditions for the generation and detection of GWs with time dilation are met is presented, along with the conceptual design of an experimental detector.


title: Multiple shock fronts in RBS 797: the Chandra window on shock heating in galaxy clusters

abstract: Using $\sim$427 ks of Chandra observations, we present a study of shock heating and ICM cooling in the galaxy cluster RBS 797. We discover three nested pairs of weak shocks at roughly 50 kpc, 80 kpc and 130 kpc from the center. The total energy associated with the shocks is $\sim6\times10^{61}$ erg, with the central AGN driving a pair of weak shocks every 20-30 Myr with a power $P_{sh}\approx10^{46}$ erg s$^{-1}$. Based on its morphology and age ($\sim$30 Myr), the inner cocoon shock is associated with the four equidistant X-ray cavities previously discovered. From the thermodynamic analysis of the inner 30 kpc, we find evidence for ICM condensation into colder gas between and behind the X-ray cavities. The total AGN mechanical power (cavities and shocks) of $3.4\times10^{46}$ erg s$^{-1}$ can balance the ICM radiative losses, estimated as $L_{cool} = 2.3\times10^{45}$ erg s$^{-1}$. By building plots of $P_{cav}$ vs. $L_{cool}$, $P_{shock}$ vs. $L_{cool}$ and $P_{tot}$ vs. $L_{cool}$ for RBS 797 and 14 other galaxy clusters, groups and elliptical galaxies where both cavities and shocks are detected, we verify that the most powerful outbursts are found in the strongest cooling systems. Ultimately, we observe that the mechanical power of the AGN exceeds the gas radiative losses by a factor that is different for FR I and FR II radio galaxies, being less than a few tens for FR Is (as RBS 797) and more than roughly a hundred for FR IIs.


title: Sharp complexity phase transitions generated by entanglement

abstract: Entanglement is one of the physical properties of quantum systems responsible for the computational hardness of simulating quantum systems. But while the runtime of specific algorithms, notably tensor network algorithms, explicitly depends on the amount of entanglement in the system, it is unknown whether this connection runs deeper and entanglement can also cause inherent, algorithm-independent complexity. In this work, we quantitatively connect the entanglement present in certain quantum systems to the computational complexity of simulating those systems. Moreover, we completely characterize the entanglement and complexity as a function of a system parameter. Specifically, we consider the task of simulating single-qubit measurements of $k$--regular graph states on $n$ qubits. We show that, as the regularity parameter is increased from $1$ to $n-1$, there is a sharp transition from an easy regime with low entanglement to a hard regime with high entanglement at $k=3$, and a transition back to easy and low entanglement at $k=n-3$. As a key technical result, we prove a duality for the simulation complexity of regular graph states between low and high regularity.


title: A universal approach to Krylov State and Operator complexities

abstract: We present a general framework in which both Krylov state and operator complexities can be put on the same footing. In our formalism, the Krylov complexity is defined in terms of the density matrix of the associated state which, for the operator complexity, lives on a doubled Hilbert space obtained through the channel-state map. This unified definition of complexity in terms of the density matrices enables us to extend the notion of Krylov complexity, to subregion or mixed state complexities and also naturally to the Krylov mutual complexity. We show that this framework also encompasses nicely the holographic notions of complexity.


title: Volume-law to area-law entanglement transition in a non-unitary periodic Gaussian circuit

abstract: We consider Gaussian quantum circuits that alternate unitary gates and post-selected weak measurements, with spatial translation symmetry and time periodicity. We show analytically that such models can host different kinds of measurement-induced phase transitions detected by entanglement entropy, by mapping the time evolution and weak measurements to M\"obius transformations. We demonstrate the existence of a log-law to area-law transition, as well as a volume-law to area-law transition. For the latter, we compute the critical exponent $\nu$ for the Hartley, von Neumann and R\'enyi entropies exactly.


title: Spatially-resolved chemodynamics of the starburst dwarf galaxy CGCG 007-025: Evidence for recent accretion of metal-poor gas

abstract: Nearby metal-poor starburst dwarf galaxies present a unique opportunity to probe the physics of high-density star formation with a detail and sensitivity unmatched by any observation of the high-z Universe. Here we present the first results from a chemodynamical study of the nearby, gas-rich starburst dwarf CGCG 007-025. We use VLT/MUSE integral field spectroscopy to characterise the properties of the star-forming (SF) gas, from its metal content to its kinematics. The star formation rate (SFR) surface density presents a clumpy distribution, with the brightest knot hosting a 5 Myr young, Wolf-Rayet (WR) population (revealed by the presence of the characteristic 5808\AA~WR bump). The ionised gas kinematics are dominated by disordered motions. A superposition of a narrow ($\sigma \approx$ 50 km s$^{-1}$), intermediate (150 km s$^{-1}$) and broad (1000 km s$^{-1}$) kinematic components are needed to model the emission line profiles in the brightest SF region, suggesting the presence of energetic outflows from massive stars. The gas-phase metallicity of the galaxy spans 0.6 dex and displays a strong anti-correlation with SFR surface density, dropping to 12+log(O/H) = 7.7 in the central SF knot. The spatially-resolved BPTs indicates the gas is being ionised purely by SF processes. Finally, the anti-correlation between the SFR and the gas metallicity points out to accretion of metal-poor gas as the origin of the recent off-centre starburst, in which the infalling material ignites the SF episode.


title: A combinatorial proof of a tantalizing symmetry on Catalan objects

abstract: We investigate a tantalizing symmetry on Catalan objects. In terms of Dyck paths, this symmetry is interpreted in the following way: if $w_{n,k,m}$ is the number of Dyck paths of semilength $n$ with $k$ occurrences of $UD$ and $m$ occurrences of $UUD$, then $w_{2k+1,k,m}=w_{2k+1,k,k+1-m}$. We give two proofs of this symmetry: an algebraic proof using generating functions, and a combinatorial proof which makes heavy use of the cycle lemma and an alternate interpretation of the numbers $w_{n,k,m}$ using plane trees. In particular, our combinatorial proof expresses the numbers $w_{2k+1,k,m}$ in terms of Narayana numbers, and we generalize this to a relationship between the numbers $w_{n,k,m}$ and a family of generalized Narayana numbers due to Callan. Some further generalizations and applications of our combinatorial proofs are explored. Finally, we investigate properties of the polynomials $W_{n,k}(t)= \sum_{m=0}^k w_{n,k,m} t^m$, including real-rootedness, $\gamma$-positivity, and a symmetric decomposition.