title: The Link between Gulf Stream Precipitation and European Blocking in General Circulation Models and the Role of Horizontal Resolution

abstract: Past studies show that coupled model biases in European blocking and North Atlantic eddy-driven jet variability decrease as one increases the horizontal resolution in the atmospheric and oceanic model components. This has commonly been argued to be related to an alleviation of sea surface temperature (SST) biases due to increased oceanic resolution in particular, with a physical pathway via changes to surface baroclinicity. On the other hand, many studies have now highlighted the key role of diabatic processes in the Gulf Stream region on blocking formation and maintenance. Here, following recent work by Schemm, we leverage a large multi-model ensemble to show that Gulf Stream precipitation variability in coupled models is tightly linked to the simulated frequency of European blocking and northern jet excursions. Furthermore, the reduced biases in blocking and jet variability are consistent with greater precipitation variability as a result of increased atmospheric horizontal resolution. By contrast, typical North Atlantic SST biases are found to share only a weak or negligible relationship with blocking and jet biases. Finally, while previous studies have used a comparison between coupled models and models run with prescribed SSTs to argue for the role of ocean resolution, we emphasise here that models run with prescribed SSTs experience greatly reduced precipitation variability due to their excessive thermal damping, making it unclear if such a comparison is meaningful. Instead, we speculate that most of the reduction in coupled model biases may actually be due to increased atmospheric resolution.


title: Enhancing Consumer User Experience, Education and Brand Awareness through Musical Advergames

abstract: The effectiveness of traditional communication techniques has declined in recent years, and marketing specialists are looking at more creative ways to engage consumers. A lot of attention has recently been paid to advergames, which are seen as an attractive new marketing tool to increase consumer engagement and education of brand awareness. The term advergame refers to games that combine brand advertising with gaming to promote business products. In this paper, we study the impact of music on consumer uptake of advergames (n=197). Our results show that music in advergames is an important feature because of its capability to attract audience, enhance their user experience and increase brand awareness.


title: Automatically Generating Narrative-Style Radiology Reports from Volumetric CT Images; a Proof of Concept

abstract: The world faces a shortage of radiologists, leading to longer treatment times and increased stress, negatively impacting patient safety and workforce morale. Integrating artificial intelligence to interpret radiographic images and generate descriptive reports offers a promising solution. However, limited research exists on generating natural language descriptions for volumetric medical images. This study introduces a deep learning-based proof of concept model to accurately identify abnormalities in volumetric CT data and generate narrative-style reports. Various encoder-decoder models were assessed for their efficacy in clinically relevant and surrogate tasks. Clinically relevant tasks involved identifying and describing pulmonary nodules and pleural effusions, while surrogate tasks involved recognizing and describing artificial abnormalities such as mirroring, rotation, and lung lobe occlusion. The results show high accuracy in detecting combinations of artificial abnormalities, with the best model achieving a classification accuracy of 0.97 on an independent dataset with a homogeneously distributed 11-class problem. Furthermore, the best model consistently generated coherent radiology reports in natural language, with a next-word prediction accuracy of 0.84. Additionally, 65% of these reports were factually accurate regarding the identified artificial abnormalities. Unfortunately, these models did not replicate this success for clinically relevant tasks. Overall, this study provides a working proof of concept model for a challenge yet to be fully addressed by the scientific community. Given the success on surrogate tasks, the leap to clinically relevant tasks seems feasible. Acquiring a significantly larger high-quality dataset appears to be the most promising path forward, alongside more computational resources for end-to-end model training.


title: Generalization bounds for mixing processes via delayed online-to-PAC conversions

abstract: We study the generalization error of statistical learning algorithms in a non-i.i.d. setting, where the training data is sampled from a stationary mixing process. We develop an analytic framework for this scenario based on a reduction to online learning with delayed feedback. In particular, we show that the existence of an online learning algorithm with bounded regret (against a fixed statistical learning algorithm in a specially constructed game of online learning with delayed feedback) implies low generalization error of said statistical learning method even if the data sequence is sampled from a mixing time series. The rates demonstrate a trade-off between the amount of delay in the online learning game and the degree of dependence between consecutive data points, with near-optimal rates recovered in a number of well-studied settings when the delay is tuned appropriately as a function of the mixing time of the process.


title: Tilted CO-terminated probes in scanning tunneling microscopy

abstract: Scanning tunneling microscopy with a CO-functionalized tip is combined with simulations to explore the impact of the CO tilt angle on topographies of a single Cu atom and CO molecule adsorbed on Cu(111). Images of the Cu atom acquired with varying tip tilt angles and sample voltages are reproduced by the calculations. The agreement between measured and simulated data allows to unveil the tip-orbital composition of the tunneling current, which highlights the role of the different $p$-orbitals of the CO-tip. Topographies of adsorbed CO and their dependence on voltage and probe-surface distance are captured for the nontilted junction geometry and in the limit of weak molecular interactions.


title: Reinforcement-Learning based routing for packet-optical networks with hybrid telemetry

abstract: This article provides a methodology and open-source implementation of Reinforcement Learning algorithms for finding optimal routes in a packet-optical network scenario. The algorithm uses measurements provided by the physical layer (pre-FEC bit error rate and propagation delay) and the link layer (link load) to configure a set of latency-based rewards and penalties based on such measurements. Then, the algorithm executes Q-learning based on this set of rewards for finding the optimal routing strategies. It is further shown that the algorithm dynamically adapts to changing network conditions by re-calculating optimal policies upon either link load changes or link degradation as measured by pre-FEC BER.


title: European Satellite Benchmark for Control Education and Industrial Training

abstract: To overcome the innovation gap of the Guidance, Navigation and Control (GNC) design process between research and industrial practice a benchmark of industrial relevance has been developed and is presented. This initiative is driven as well by the necessity to train future GNC engineers and the GNC space community on a set of identified complex problems. It allows to demonstrate the relevance of state-of-the-art modeling, control and analysis algorithms for future industrial adoption. The modeling philosophy for robust control synthesis, analysis including the control architecture that enables the simulation of the mission, i.e. the acquisition of a high pointing space mission, are provided.


title: Stochastic Chemical Reaction Networks with Discontinuous Limits and AIMD processes

abstract: In this paper we study a class of stochastic chemical reaction networks (CRNs) for which chemical species are created by a sequence of chain reactions. We prove that under some convenient conditions on the initial state, some of these networks exhibit a discrete-induced transitions (DIT) property: isolated, random, events have a direct impact on the macroscopic state of the process. If this phenomenon has already been noticed in several CRNs, in auto-catalytic networks in the literature of physics in particular, there are up to now few rigorous studies in this domain. A scaling analysis of several cases of such CRNs with several classes of initial states is achieved. The DIT property is investigated for the case of a CRN with four nodes. We show that on the normal timescale and for a subset of (large) initial states and for convenient Skorohod topologies, the scaled process converges in distribution to a Markov process with jumps, an Additive Increase/Multiplicative Decrease (AIMD) process. This asymptotically discontinuous limiting behavior is a consequence of a DIT property due to random, local, blowups of jumps occurring during small time intervals. With an explicit representation of invariant measures of AIMD processes and time-change arguments, we show that, with a speed-up of the timescale, the scaled process is converging in distribution to a continuous deterministic function. The DIT analyzed in this paper is connected to a simple chain reaction between three chemical species and is therefore likely to be a quite generic phenomenon for a large class of CRNs.


title: Attack and Defense of Deep Learning Models in the Field of Web Attack Detection

abstract: The challenge of WAD (web attack detection) is growing as hackers continuously refine their methods to evade traditional detection. Deep learning models excel in handling complex unknown attacks due to their strong generalization and adaptability. However, they are vulnerable to backdoor attacks, where contextually irrelevant fragments are inserted into requests, compromising model stability. While backdoor attacks are well studied in image recognition, they are largely unexplored in WAD. This paper introduces backdoor attacks in WAD, proposing five methods and corresponding defenses. Testing on textCNN, biLSTM, and tinybert models shows an attack success rate over 87%, reducible through fine-tuning. Future research should focus on backdoor defenses in WAD. All the code and data of this paper can be obtained at https://anonymous.4open.science/r/attackDefenceinDL-7E05


title: Low-Redundant Optimization for Large Language Model Alignment

abstract: Large language models (LLMs) are still struggling in aligning with human preference in complex tasks and scenarios. They are prone to overfit into the unexpected patterns or superficial styles in the training data. We conduct an empirical study that only selects the top-10\% most updated parameters in LLMs for alignment training, and see improvements in the convergence process and final performance. It indicates the existence of redundant neurons in LLMs for alignment training. To reduce its influence, we propose a low-redundant alignment method named \textbf{ALLO}, focusing on optimizing the most related neurons with the most useful supervised signals. Concretely, we first identify the neurons that are related to the human preference data by a gradient-based strategy, then identify the alignment-related key tokens by reward models for computing loss. Besides, we also decompose the alignment process into the forgetting and learning stages, where we first forget the tokens with unaligned knowledge and then learn aligned knowledge, by updating different ratios of neurons, respectively. Experimental results on 10 datasets have shown the effectiveness of ALLO. Our code and data are available at \url{https://github.com/RUCAIBox/ALLO}.


title: Explanations for the two-component spectral energy distributions of gravitationally lensed stars at high redshifts

abstract: Observations of gravitationally lensed, high-mass stars at redshifts $\gtrsim1$ occasionally reveal spectral energy distributions that contain two components with different effective temperatures. Given that two separate stars are involved, it suggests that both stars have simultaneously reached very high magnification, as expected for two stars in a binary system close to the caustic curve of the foreground galaxy-cluster lens. The inferred effective temperatures and luminosities of these stars are, however, difficult to reconcile with known binaries, or even with isolated stars of the same age. Here, we explore three alternative explanations for these cases: circumstellar dust around the cooler of the two stars; age differences of a few Myr among stars in the same star cluster, and a scenario in which the stars originate in two separate star clusters of different age along the lensing caustic. While all of these scenarios are deemed plausible in principle, dust solutions would require more circumstellar extinction than seen in local observations of the relevant super/hypergiant stars. Hence, we argue that age differences between the two stars are the most likely scenario, given the current data.


title: Bridging Local Details and Global Context in Text-Attributed Graphs

abstract: Representation learning on text-attributed graphs (TAGs) is vital for real-world applications, as they combine semantic textual and contextual structural information. Research in this field generally consist of two main perspectives: local-level encoding and global-level aggregating, respectively refer to textual node information unification (e.g., using Language Models) and structure-augmented modeling (e.g., using Graph Neural Networks). Most existing works focus on combining different information levels but overlook the interconnections, i.e., the contextual textual information among nodes, which provides semantic insights to bridge local and global levels. In this paper, we propose GraphBridge, a multi-granularity integration framework that bridges local and global perspectives by leveraging contextual textual information, enhancing fine-grained understanding of TAGs. Besides, to tackle scalability and efficiency challenges, we introduce a graphaware token reduction module. Extensive experiments across various models and datasets show that our method achieves state-of-theart performance, while our graph-aware token reduction module significantly enhances efficiency and solves scalability issues.


title: Small Hurewicz and Menger sets which have large continuous images

abstract: We provide new techniques to construct sets of reals without perfect subsets and with the Hurewicz or Menger covering properties. In particular, we show that if the Continuum Hypothesis holds, then there are such sets which can be mapped continuously onto the Cantor space. These results allow to separate the properties of Menger and $\mathsf{S}_1(\Gamma,\mathrm{O})$ in the realm of sets of reals without perfect subsets and solve a problem of Nowik and Tsaban concerning perfectly meager subsets in the transitive sense. We present also some other applications of the mentioned above methods.


title: Modified difference ascent sequences and Fishburn structures

abstract: Ascent sequences and their modified version play a central role in the bijective framework relating several combinatorial structures counted by the Fishburn numbers. Ascent sequences are nonnegative integer sequences defined by imposing a bound on the growth of their entries in terms of the number of ascents contained in the corresponding prefix, while modified ascent sequences are the image of ascent sequences under the so-called hat map. By relaxing the notion of ascent, Dukes and Sagan have recently introduced difference ascent sequences. Here we define modified difference ascent sequences and study their combinatorial properties. Inversion sequences are a superset of the difference ascent sequences and we extend the hat map to this domain. Our extension depends on a parameter which we specialize to obtain a new set of permutations counted by the Fishburn numbers and characterized by a subdiagonality property.


title: Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting

abstract: End-to-end multilingual speech recognition models handle multiple languages through a single model, often incorporating language identification to automatically detect the language of incoming speech. Since the common scenario is where the language is already known, these models can perform as language-specific by using language information as prompts, which is particularly beneficial for attention-based encoder-decoder architectures. However, the Connectionist Temporal Classification (CTC) approach, which enhances recognition via joint decoding and multi-task training, does not normally incorporate language prompts due to its conditionally independent output tokens. To overcome this, we introduce an encoder prompting technique within the self-conditioned CTC framework, enabling language-specific adaptation of the CTC model in a zero-shot manner. Our method has shown to significantly reduce errors by 28% on average and by 41% on low-resource languages.


title: The Galactic population of canonical pulsars II

abstract: Pulsars are highly magnetized rotating neutron stars, emitting in a broad electromagnetic energy range. Reproducing the observed population of pulsars refines our understanding of their formation, evolution as well as radiation processes and geometry. In this paper, we improve our previous pulsar population synthesis by studying the impact of the Galactic gravitational potential and of the death line putting emphasis on the gamma-ray pulsar population. In order to elucidate the necessity of a death line, refined initial distributions for spin periods and radial positions at birth were implemented, elevating the sophistication of our previous simulations to the most recent state-of-the-art. Our pulsar population synthesis takes into account the secular evolution of a force-free magnetosphere and the magnetic field decay. The radio and gamma-ray emissions are modeled respectively by the polar cap geometry and the striped wind model. When simulating a cohort of ten million pulsars akin to previous endeavors, the integration of a death line proves essential for a better agreement with observational trends. Yet, discrepancies emerges when modeling a reduced ensemble of only one million pulsars, endowed with a higher birth rate. This divergence yields a remarkably refined $P-\dot{P}$ diagram, conspicuously with or without any delineating death line. Intriguingly, this observation suggests an overestimation of the ages of detected pulsars in existent data sets, thereby challenging the necessity of death lines in pulsar population synthesis. Validation through Kolmogorov-Smirnov testing underlines the statistical congruence between the spin period and spin period derivative distributions of both observations and simulations. Moreover simulations with a higher gamma-ray instrumental sensitivity show that the GeV excess in the Galactic centre could be of pulsar origin.


title: Understanding the intrinsic framework of the Hall-Petch relationship of metals from the view of the electronic-structure level

abstract: The relationship between grain size and yield strength of metals follows the Hall-Petch relationship {\sigma} = {\sigma}0 + kd^-0.5; however, the specific physical factors that affect the coefficients {\sigma}0 and k of this relationship remain unclear. Here we propose the intrinsic descriptors to determine the Hall-Petch relation across different metals and alloys. Inspired by the tight-binding theory, we find that {\sigma}0 strongly depends on the group and period number, the valence-electron number and electronegativity, while k is determined by the cohesive energy. Our framework establishes a predictive structure-property relationship for the size-dependent yield strength of various metals, and unravels that both the coefficients of the Hall-Petch relationship physically originate from the d-band properties. This novel correlation provides a new perspective for understanding the mechanical strength of metals, which is useful for the design of high-performance materials.


title: EUvsDisinfo: a Dataset for Multilingual Detection of Pro-Kremlin Disinformation in News Articles

abstract: This work introduces EUvsDisinfo, a multilingual dataset of trustworthy and disinformation articles related to pro-Kremlin themes. It is sourced directly from the debunk articles written by experts leading the EUvsDisinfo project. Our dataset is the largest to-date resource in terms of the overall number of articles and distinct languages. It also provides the largest topical and temporal coverage. Using this dataset, we investigate the dissemination of pro-Kremlin disinformation across different languages, uncovering language-specific patterns targeting specific disinformation topics. We further analyse the evolution of topic distribution over an eight-year period, noting a significant surge in disinformation content before the full-scale invasion of Ukraine in 2022. Lastly, we demonstrate the dataset's applicability in training models to effectively distinguish between disinformation and trustworthy content in multilingual settings.


title: When Are Bias-Free ReLU Networks Like Linear Networks?

abstract: We investigate the expressivity and learning dynamics of bias-free ReLU networks. We firstly show that two-layer bias-free ReLU networks have limited expressivity: the only odd function two-layer bias-free ReLU networks can express is a linear one. We then show that, under symmetry conditions on the data, these networks have the same learning dynamics as linear networks. This allows us to give closed-form time-course solutions to certain two-layer bias-free ReLU networks, which has not been done for nonlinear networks outside the lazy learning regime. While deep bias-free ReLU networks are more expressive than their two-layer counterparts, they still share a number of similarities with deep linear networks. These similarities enable us to leverage insights from linear networks, leading to a novel understanding of bias-free ReLU networks. Overall, our results show that some properties established for bias-free ReLU networks arise due to equivalence to linear networks, and suggest that including bias or considering asymmetric data are avenues to engage with nonlinear behaviors.


title: Learning Diffusion at Lightspeed

abstract: Diffusion regulates a phenomenal number of natural processes and the dynamics of many successful generative models. Existing models to learn the diffusion terms from observational data rely on complex bilevel optimization problems and properly model only the drift of the system. We propose a new simple model, JKOnet*, which bypasses altogether the complexity of existing architectures while presenting significantly enhanced representational capacity: JKOnet* recovers the potential, interaction, and internal energy components of the underlying diffusion process. JKOnet* minimizes a simple quadratic loss, runs at lightspeed, and drastically outperforms other baselines in practice. Additionally, JKOnet* provides a closed-form optimal solution for linearly parametrized functionals. Our methodology is based on the interpretation of diffusion processes as energy-minimizing trajectories in the probability space via the so-called JKO scheme, which we study via its first-order optimality conditions, in light of few-weeks-old advancements in optimization in the probability space.


title: Enriched concepts of regular logic

abstract: Building on our previous work on enriched universal algebra, we define a notion of enriched language consisting of function and relation symbols whose arities are objects of the base of enrichment. In this context, we construct atomic formulas and define the regular fragment of enriched logic by taking conjunctions and existential quantifications of those. We then characterize enriched categories of models of regular theories as enriched injectivity classes in the enriched category of structures. These notions rely on the choice of a factorization system on the base of enrichment which will be used to interpret relation symbols and existential quantifications.


title: From Insights to Actions: The Impact of Interpretability and Analysis Research on NLP

abstract: Interpretability and analysis (IA) research is a growing subfield within NLP with the goal of developing a deeper understanding of the behavior or inner workings of NLP systems and methods. Despite growing interest in the subfield, a commonly voiced criticism is that it lacks actionable insights and therefore has little impact on NLP. In this paper, we seek to quantify the impact of IA research on the broader field of NLP. We approach this with a mixed-methods analysis of: (1) a citation graph of 185K+ papers built from all papers published at ACL and EMNLP conferences from 2018 to 2023, and (2) a survey of 138 members of the NLP community. Our quantitative results show that IA work is well-cited outside of IA, and central in the NLP citation graph. Through qualitative analysis of survey responses and manual annotation of 556 papers, we find that NLP researchers build on findings from IA work and perceive it is important for progress in NLP, multiple subfields, and rely on its findings and terminology for their own work. Many novel methods are proposed based on IA findings and highly influenced by them, but highly influential non-IA work cites IA findings without being driven by them. We end by summarizing what is missing in IA work today and provide a call to action, to pave the way for a more impactful future of IA research.


title: Formation of the Supersonic Stellar Wind: Parker's Theory Revisited

abstract: We examine the classical theory of stellar wind formation. The theory requires that to form a supersonic stellar wind, a subsonic flow speed must start at a specific initial speed from the coronal base, called eigenspeed, go along a continuous eigenfunction, and reach the sonic point, which is where the flow speed equals the sonic speed, while the critical condition, which is where the effective driving force is zero, is satisfied. Any mismatch between the sonic point and critical condition distances results in either subsonic winds when the initial speed is below the eigenspeed, or no stellar wind when the initial speed is above the eigenspeed. However, because the critical condition is determined by the stellar wind temperature profile, which depends on ionization process at the top of the chromosphere and the heating process around the coronal base but not by the processes at the sonic point, the requirement of sonic point satisfying the critical condition is generally not met and hence the momentum equation in the conventional theory encounters difficulty when the initial speed is above the eigenspeed. To resolve the difficulty, we propose a discontinuity between the sonic point and the critical condition to reach supersonic stellar wind solutions. As a result, supersonic stellar winds can be produced when the initial speed in the coronal base is greater than the eigenspeed. The critical solution or eigen function provided by the conventional stellar wind model describes the condition that separates the supersonic stellar winds from subsonic ones.


title: What Makes Two Language Models Think Alike?

abstract: Do architectural differences significantly affect the way models represent and process language? We propose a new approach, based on metric-learning encoding models (MLEMs), as a first step to answer this question. The approach provides a feature-based comparison of how any two layers of any two models represent linguistic information. We apply the method to BERT, GPT-2 and Mamba. Unlike previous methods, MLEMs offer a transparent comparison, by identifying the specific linguistic features responsible for similarities and differences. More generally, the method uses formal, symbolic descriptions of a domain, and use these to compare neural representations. As such, the approach can straightforwardly be extended to other domains, such as speech and vision, and to other neural systems, including human brains.


title: Growing Trees on Sounds: Assessing Strategies for End-to-End Dependency Parsing of Speech

abstract: Direct dependency parsing of the speech signal -- as opposed to parsing speech transcriptions -- has recently been proposed as a task (Pupier et al. 2022), as a way of incorporating prosodic information in the parsing system and bypassing the limitations of a pipeline approach that would consist of using first an Automatic Speech Recognition (ASR) system and then a syntactic parser. In this article, we report on a set of experiments aiming at assessing the performance of two parsing paradigms (graph-based parsing and sequence labeling based parsing) on speech parsing. We perform this evaluation on a large treebank of spoken French, featuring realistic spontaneous conversations. Our findings show that (i) the graph based approach obtain better results across the board (ii) parsing directly from speech outperforms a pipeline approach, despite having 30% fewer parameters.


title: Challenging margin-based speaker embedding extractors by using the variational information bottleneck

abstract: Speaker embedding extractors are typically trained using a classification loss over the training speakers. During the last few years, the standard softmax/cross-entropy loss has been replaced by the margin-based losses, yielding significant improvements in speaker recognition accuracy. Motivated by the fact that the margin merely reduces the logit of the target speaker during training, we consider a probabilistic framework that has a similar effect. The variational information bottleneck provides a principled mechanism for making deterministic nodes stochastic, resulting in an implicit reduction of the posterior of the target speaker. We experiment with a wide range of speaker recognition benchmarks and scoring methods and report competitive results to those obtained with the state-of-the-art Additive Angular Margin loss.


title: Learned Image Compression for HE-stained Histopathological Images via Stain Deconvolution

abstract: Processing histopathological Whole Slide Images (WSI) leads to massive storage requirements for clinics worldwide. Even after lossy image compression during image acquisition, additional lossy compression is frequently possible without substantially affecting the performance of deep learning-based (DL) downstream tasks. In this paper, we show that the commonly used JPEG algorithm is not best suited for further compression and we propose Stain Quantized Latent Compression (SQLC ), a novel DL based histopathology data compression approach. SQLC compresses staining and RGB channels before passing it through a compression autoencoder (CAE ) in order to obtain quantized latent representations for maximizing the compression. We show that our approach yields superior performance in a classification downstream task, compared to traditional approaches like JPEG, while image quality metrics like the Multi-Scale Structural Similarity Index (MS-SSIM) is largely preserved. Our method is online available.


title: Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges

abstract: Offering a promising solution to the scalability challenges associated with human evaluation, the LLM-as-a-judge paradigm is rapidly gaining traction as an approach to evaluating large language models (LLMs). However, there are still many open questions about the strengths and weaknesses of this paradigm, and what potential biases it may hold. In this paper, we present a comprehensive study of the performance of various LLMs acting as judges. We leverage TriviaQA as a benchmark for assessing objective knowledge reasoning of LLMs and evaluate them alongside human annotations which we found to have a high inter-annotator agreement. Our study includes 9 judge models and 9 exam taker models -- both base and instruction-tuned. We assess the judge model's alignment across different model sizes, families, and judge prompts. Among other results, our research rediscovers the importance of using Cohen's kappa as a metric of alignment as opposed to simple percent agreement, showing that judges with high percent agreement can still assign vastly different scores. We find that both Llama-3 70B and GPT-4 Turbo have an excellent alignment with humans, but in terms of ranking exam taker models, they are outperformed by both JudgeLM-7B and the lexical judge Contains, which have up to 34 points lower human alignment. Through error analysis and various other studies, including the effects of instruction length and leniency bias, we hope to provide valuable lessons for using LLMs as judges in the future.


title: Reproducibility of predictive networks for mouse visual cortex

abstract: Deep predictive models of neuronal activity have recently enabled several new discoveries about the selectivity and invariance of neurons in the visual cortex. These models learn a shared set of nonlinear basis functions, which are linearly combined via a learned weight vector to represent a neuron's function. Such weight vectors, which can be thought as embeddings of neuronal function, have been proposed to define functional cell types via unsupervised clustering. However, as deep models are usually highly overparameterized, the learning problem is unlikely to have a unique solution, which raises the question if such embeddings can be used in a meaningful way for downstream analysis. In this paper, we investigate how stable neuronal embeddings are with respect to changes in model architecture and initialization. We find that $L_1$ regularization to be an important ingredient for structured embeddings and develop an adaptive regularization that adjusts the strength of regularization per neuron. This regularization improves both predictive performance and how consistently neuronal embeddings cluster across model fits compared to uniform regularization. To overcome overparametrization, we propose an iterative feature pruning strategy which reduces the dimensionality of performance-optimized models by half without loss of performance and improves the consistency of neuronal embeddings with respect to clustering neurons. This result suggests that to achieve an objective taxonomy of cell types or a compact representation of the functional landscape, we need novel architectures or learning techniques that improve identifiability. We will make our code available at publication time.


title: Irreducible representations of $\mathrm{SL}(2,\R)$ on Hilbert spaces are admissible

abstract: We show that irreducible strongly continuous representations of $\mathrm{SL}(2,\mathbb{R})$ on Hilbert spaces are admissible, modulo the recently proposed solution of the invariant subspace problem on Hilbert spaces.


title: Impact of E-plane Misalignment on THz Diagonal Horn Antennas

abstract: A key challenge in developing terahertz front-ends is achieving high coupling efficiency between the waveguide feed horn and the optical beam. In this paper, we have quantified the alignment requirements for the widely used E-plane split diagonal horn antenna through theoretical analysis, electromagnetic simulation, and experimental validation within the 325-500 GHz frequency range. The results from our analytical models, simulations, and measurements are consistent and shows good agreement. They reveal that even minor geometric asymmetries can cause significant increases in fractional power radiated to the cross-polar component due to amplitude and phase imbalances in the TE10 and TE01 modes. Furthermore, a misalignment of approximately 8% of the wavelength was observed to result in a 3-dB degradation in the optical coupling to a Gaussian beam (Gaussicity) in middle of the waveguide band. These findings highlight the critical importance of precise alignment and feed horn machining for the successful implementation of terahertz front-end systems.


title: Large Language Models based Multi-Agent Framework for Objective Oriented Control Design in Power Electronics

abstract: Power electronics, a critical component in modern power systems, face several challenges in control design, including model uncertainties, and lengthy and costly design cycles. This paper is aiming to propose a Large Language Models (LLMs) based multi-agent framework for objective-oriented control design in power electronics. The framework leverages the reasoning capabilities of LLMs and a multi-agent workflow to develop an efficient and autonomous controller design process. The LLM agent is able to understand and respond to high-level instructions in natural language, adapting its behavior based on the task's specific requirements and constraints from a practical implementation point of view. This novel and efficient approach promises a more flexible and adaptable controller design process in power electronics that will largely facilitate the practitioners.


title: SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation

abstract: Out-of-distribution (OOD) detection is crucial for the safe deployment of neural networks. Existing CLIP-based approaches perform OOD detection by devising novel scoring functions or sophisticated fine-tuning methods. In this work, we propose SeTAR, a novel, training-free OOD detection method that leverages selective low-rank approximation of weight matrices in vision-language and vision-only models. SeTAR enhances OOD detection via post-hoc modification of the model's weight matrices using a simple greedy search algorithm. Based on SeTAR, we further propose SeTAR+FT, a fine-tuning extension optimizing model performance for OOD detection tasks. Extensive evaluations on ImageNet1K and Pascal-VOC benchmarks show SeTAR's superior performance, reducing the false positive rate by up to 18.95% and 36.80% compared to zero-shot and fine-tuning baselines. Ablation studies further validate our approach's effectiveness, robustness, and generalizability across different model backbones. Our work offers a scalable, efficient solution for OOD detection, setting a new state-of-the-art in this area.


title: Photoproduction of J/$\psi$ and dileptons in Pb-Pb collisions with nuclear overlap

abstract: Photon-photon reactions and the production of J/$\psi$ meson through photonuclear reactions have been extensively studied in ultra-peripheral heavy-ion collisions, in which the impact parameter is larger than twice the nuclear radius. In recent years, coherently photoproduced J/$\psi$ and dilepton production via photon-photon interactions have also been observed in nucleus-nucleus (A-A) collisions with nuclear overlap. The former can help to constrain the nuclear gluon distributions at low Bjorken-$x$ and high energy, while the latter could be used to further map the electromagnetic fields produced in heavy-ion collisions. In addition, these measurements can shed light on the theory behind photon-induced reactions in A-A collisions with nuclear overlap, including possible interactions of the measured probes with the formed and fast expanding quark-gluon plasma. Since the produced quarkonium is expected to keep the polarization of the incoming photon due to $s$-channel helicity conservation, the photoproduction origin of the J/$\psi$ yield excess at very low transverse momentum, $p_{\rm T}$, can be confirmed by the measurement of the J/$\psi$ polarization. The ALICE detector can perform quarkonium production measurements at both mid ($|y|<0.9$) and forward ($2.5<y<4$) rapidities down to $p_{\rm T} = 0$. In the following, the new ALICE measurements of the J/$\psi$ $y$-differential cross section and the first polarization results of coherently photoproduced J/$\psi$ via the dimuon decay channel at forward rapidity in Pb-Pb collisions at $\sqrt{s_{NN}}=$ 5.02 TeV are reported. Additionally, the measurement of an excess with respect to expectations from hadronic production in the dielectron yield, at low mass and $p_{\rm T}$, at midrapidity in Pb-Pb collisions at $\sqrt{s_{NN}}=$ 5.02~TeV, is presented. The results are compared with available theoretical models.


title: Nonreciprocal Bundle Emissions of Quantum Entangled Pairs

abstract: Realizing precise control over multiquanta emission is crucial for quantum information processing, especially when integrated with advanced techniques of manipulating quantum states. Here, by spinning the resonator to induce the Sagnac effect, we can obtain nonreciprocal photon-phonon and photon-magnon super-Rabi oscillations under conditions of optically driving resonance transitions. Opening dissipative channels for such super-Rabi oscillations enables the realization of directional bundle emissions of entangled photon-phonon pairs and photon-magnon pairs by transferring pure multiquanta state to bundled multiquanta outside of the system. This nonreciprocal emission is a flexible switch that can be controlled with precision, and simultaneous emissions of different entangled pairs (such as photon-phonon or photon-magnon pairs) can even emerge but in opposite directions by driving the resonator from different directions. This ability to flexibly manipulate the system allows us to achieve directional entangled multiquanta emitters, and has also potential applications for building hybrid quantum networks and on-chip quantum communications.


title: Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Image Synthesis: T1 MRI to Tau-PET

abstract: Alzheimer's Disease (AD) is the most common form of dementia, characterised by cognitive decline and biomarkers such as tau-proteins. Tau-positron emission tomography (tau-PET), which employs a radiotracer to selectively bind, detect, and visualise tau protein aggregates within the brain, is valuable for early AD diagnosis but is less accessible due to high costs, limited availability, and its invasive nature. Image synthesis with neural networks enables the generation of tau-PET images from more accessible T1-weighted magnetic resonance imaging (MRI) images. To ensure high-quality image synthesis, we propose a cyclic 2.5D perceptual loss combined with mean squared error and structural similarity index measure (SSIM) losses. The cyclic 2.5D perceptual loss sequentially calculates the axial 2D average perceptual loss for a specified number of epochs, followed by the coronal and sagittal planes for the same number of epochs. This sequence is cyclically performed, with intervals reducing as the cycles repeat. We conduct supervised synthesis of tau-PET images from T1w MRI images using 516 paired T1w MRI and tau-PET 3D images from the ADNI database. For the collected data, we perform preprocessing, including intensity standardisation for tau-PET images from each manufacturer. The proposed loss, applied to generative 3D U-Net and its variants, outperformed those with 2.5D and 3D perceptual losses in SSIM and peak signal-to-noise ratio (PSNR). In addition, including the cyclic 2.5D perceptual loss to the original losses of GAN-based image synthesis models such as CycleGAN and Pix2Pix improves SSIM and PSNR by at least 2% and 3%. Furthermore, by-manufacturer PET standardisation helps the models in synthesising high-quality images than min-max PET normalisation.


title: Solutions to a chemotaxis system with spatially heterogeneous diffusion sensitivity

abstract: We consider a parabolic-elliptic Keller-Segel system with spatially dependent diffusion sensitivity \begin{eqnarray*} \left\{ \begin{array}{l} u_t = \nabla \cdot (|x|^\beta \nabla u) - \nabla \cdot (u\nabla v), \\[1mm] 0 = \Delta v - \mu + u, \qquad \mu:=\frac{1}{|\Omega|} \int\limits_\Omega u, \end{array} \right. \qquad \qquad (\star) \end{eqnarray*} under homogeneous Neumann boundary conditions in the ball $\Omega=B_R(0)\subset \mathbb R^n$. For $\beta>0$ and radially symmetric H\"older continuous initial data, we prove that there exists a pointwise classical solution to $(\star)$ in $(\Omega\setminus \{0\})\times (0,T)$ for some $T>0$. For radially decreasing initial data satisfying certain compatibility criteria, this solution is bounded and unique in $(\Omega\setminus \{0\})\times (0,T^*)$ for some $T^*>0$. Moreover, for $n \geq 2$ and sufficiently accumulated initial data, there exists no solution $(u,v)$ to $(\star)$ in the sense specified above which is globally bounded in time.


title: News Without Borders: Domain Adaptation of Multilingual Sentence Embeddings for Cross-lingual News Recommendation

abstract: Rapidly growing numbers of multilingual news consumers pose an increasing challenge to news recommender systems in terms of providing customized recommendations. First, existing neural news recommenders, even when powered by multilingual language models (LMs), suffer substantial performance losses in zero-shot cross-lingual transfer (ZS-XLT). Second, the current paradigm of fine-tuning the backbone LM of a neural recommender on task-specific data is computationally expensive and infeasible in few-shot recommendation and cold-start setups, where data is scarce or completely unavailable. In this work, we propose a news-adapted sentence encoder (NaSE), domain-specialized from a pretrained massively multilingual sentence encoder (SE). To this end, we construct and leverage PolyNews and PolyNewsParallel, two multilingual news-specific corpora. With the news-adapted multilingual SE in place, we test the effectiveness of (i.e., question the need for) supervised fine-tuning for news recommendation, and propose a simple and strong baseline based on (i) frozen NaSE embeddings and (ii) late click-behavior fusion. We show that NaSE achieves state-of-the-art performance in ZS-XLT in true cold-start and few-shot news recommendation.


title: ScenEval: A Benchmark for Scenario-Based Evaluation of Code Generation

abstract: In the scenario-based evaluation of machine learning models, a key problem is how to construct test datasets that represent various scenarios. The methodology proposed in this paper is to construct a benchmark and attach metadata to each test case. Then a test system can be constructed with test morphisms that filter the test cases based on metadata to form a dataset. The paper demonstrates this methodology with large language models for code generation. A benchmark called ScenEval is constructed from problems in textbooks, an online tutorial website and Stack Overflow. Filtering by scenario is demonstrated and the test sets are used to evaluate ChatGPT for Java code generation. Our experiments found that the performance of ChatGPT decreases with the complexity of the coding task. It is weakest for advanced topics like multi-threading, data structure algorithms and recursive methods. The Java code generated by ChatGPT tends to be much shorter than reference solution in terms of number of lines, while it is more likely to be more complex in both cyclomatic and cognitive complexity metrics, if the generated code is correct. However, the generated code is more likely to be less complex than the reference solution if the code is incorrect.


title: UEFA Champions League entry is incentive incompatible again from the 2024/25 season

abstract: A tournament is called incentive incompatible if it allows for a situation where a team could be strictly better off by losing. This paper uncovers that the entry rules of the UEFA Champions League, the most prestigious club football competition in Europe, suffer from this shortcoming again from the 2024/25 season. Consequently, a match with misaligned incentives has been barely avoided in the 2023/24 German Bundesliga. Two straightforward solutions are recommended. Fairness can be easily guaranteed by reversing the order of two paragraphs in the UEFA Champions League regulation.


title: Percolating Cosmic String Networks from Kination

abstract: We describe a new mechanism, whose ingredients are realised in string compactifications, for the formation of cosmic (super)string networks. Oscillating string loops grow when their tension $\mu$ decreases with time. If $2H + \dot{\mu}/\mu < 0$, where $H$ is the Hubble parameter, loops grow faster than the scale factor and an initial population of isolated small loops (for example, produced by nucleation) can grow, percolate and form a network. This condition is satisfied for fundamental strings in the background of a kinating volume modulus rolling towards the asymptotic large volume region of moduli space. Such long kination epochs are motivated in string cosmology by both the electroweak hierarchy problem and the need to solve the overshoot problem. The tension of such a network today is set by the final vacuum; for phenomenologically appealing Large Volume Scenario (LVS) vacua, this would lead to a fundamental string network with $G \mu \sim 10^{-10}$.


title: Efficient and Long-Tailed Generalization for Pre-trained Vision-Language Model

abstract: Pre-trained vision-language models like CLIP have shown powerful zero-shot inference ability via image-text matching and prove to be strong few-shot learners in various downstream tasks. However, in real-world scenarios, adapting CLIP to downstream tasks may encounter the following challenges: 1) data may exhibit long-tailed data distributions and might not have abundant samples for all the classes; 2) There might be emerging tasks with new classes that contain no samples at all. To overcome them, we propose a novel framework to achieve efficient and long-tailed generalization, which can be termed as Candle. During the training process, we propose compensating logit-adjusted loss to encourage large margins of prototypes and alleviate imbalance both within the base classes and between the base and new classes. For efficient adaptation, we treat the CLIP model as a black box and leverage the extracted features to obtain visual and textual prototypes for prediction. To make full use of multi-modal information, we also propose cross-modal attention to enrich the features from both modalities. For effective generalization, we introduce virtual prototypes for new classes to make up for their lack of training images. Candle achieves state-of-the-art performance over extensive experiments on 11 diverse datasets while substantially reducing the training time, demonstrating the superiority of our approach. The source code is available at https://github.com/shijxcs/Candle.


title: Ask-before-Plan: Proactive Language Agents for Real-World Planning

abstract: The evolution of large language models (LLMs) has enhanced the planning capabilities of language agents in diverse real-world scenarios. Despite these advancements, the potential of LLM-powered agents to comprehend ambiguous user instructions for reasoning and decision-making is still under exploration. In this work, we introduce a new task, Proactive Agent Planning, which requires language agents to predict clarification needs based on user-agent conversation and agent-environment interaction, invoke external tools to collect valid information, and generate a plan to fulfill the user's demands. To study this practical problem, we establish a new benchmark dataset, Ask-before-Plan. To tackle the deficiency of LLMs in proactive planning, we propose a novel multi-agent framework, Clarification-Execution-Planning (\texttt{CEP}), which consists of three agents specialized in clarification, execution, and planning. We introduce the trajectory tuning scheme for the clarification agent and static execution agent, as well as the memory recollection mechanism for the dynamic execution agent. Extensive evaluations and comprehensive analyses conducted on the Ask-before-Plan dataset validate the effectiveness of our proposed framework.


title: Research and Implementation of Data Enhancement Techniques for Graph Neural Networks

abstract: Data, algorithms, and arithmetic power are the three foundational conditions for deep learning to be effective in the application domain. Data is the focus for developing deep learning algorithms. In practical engineering applications, some data are affected by the conditions under which more data cannot be obtained or the cost of obtaining data is too high, resulting in smaller data sets (generally several hundred to several thousand) and data sizes that are far smaller than the size of large data sets (tens of thousands). The above two methods are based on the original dataset to generate, in the case of insufficient data volume of the original data may not reflect all the real environment, such as the real environment of the light, silhouette and other information, if the amount of data is not enough, it is difficult to use a simple transformation or neural network generative model to generate the required data. The research in this paper firstly analyses the key points of the data enhancement technology of graph neural network, and at the same time introduces the composition foundation of graph neural network in depth, on the basis of which the data enhancement technology of graph neural network is optimized and analysed.


title: DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence?

abstract: Detecting evidence within the context is a key step in the process of reasoning task. Evaluating and enhancing the capabilities of LLMs in evidence detection will strengthen context-based reasoning performance. This paper proposes a benchmark called DetectBench for verifying the ability to detect and piece together implicit evidence within a long context. DetectBench contains 3,928 multiple-choice questions, with an average of 994 tokens per question. Each question contains an average of 4.55 pieces of implicit evidence, and solving the problem typically requires 7.62 logical jumps to find the correct answer. To enhance the performance of LLMs in evidence detection, this paper proposes Detective Reasoning Prompt and Finetune. Experiments demonstrate that the existing LLMs' abilities to detect evidence in long contexts are far inferior to humans. However, the Detective Reasoning Prompt effectively enhances the capability of powerful LLMs in evidence detection, while the Finetuning method shows significant effects in enhancing the performance of weaker LLMs. Moreover, when the abilities of LLMs in evidence detection are improved, their final reasoning performance is also enhanced accordingly.


title: Low mach Number Limit of the Viscous and Heat Conductive Flow with general pressure law on torus

abstract: We prove the low Mach number limit from compressible Navier-Stokes-Fourier system with the general pressure law around a constant state on the torus $\mathbb{T}^N_a$. We view this limit as a special case of the weakly nonlinear-dissipative approximation of the general hyperbolic-parabolic system with entropy. In particular, we consider the ill-prepared initial data, for which the group of fast acoustic waves is needed to be filtered. This extends the previous works, in particular Danchin [ Amer. J. Math. 124 (2002), 1153-1219] in two ways: 1. We treat the fully general non-isentropic flow, i.e. the pressure depends on the density $\rho$ and temperature $\theta$ by basic thermodynamic law. We illustrate the role played by the entropy structure of the system in the coupling of the acoustic waves and incompressible flow, and the construction of the filtering group. 2. We refine the small divisor estimate, which helps us to give the first explicit convergence rate of the filtered acoustic waves whose propogation is governed by non-local averaged system. In previous works, only convergence rate of incompressible limit was obtained.


title: Waveshape of THz radiation produced by two-color laser-induced air plasmas

abstract: The spatial and spectral distributions of terahertz (THz) pulses emitted by two-color air plasmas are theoretically investigated for focused laser pulses and in the filamentation regime. We derive a so-called ''augmented'' conical emission model, which, similarly to the one originally proposed by You et al.\ [Phys.\ Rev.\ Lett.\ {\bf 109}, 183902 (2012)], involves phase matching between laser harmonics along the plasma channel, the plasma density and length, and the emitted frequency as key parameters. Our augmented model, however, treats envelope effects and accounts for transverse variations of both plasma- and Kerr-driven potential THz emitters. We highlight the importance of the characteristic spatio-spectral distributions of these two conversion mechanisms in the expression of the angular radiated power. The results of our model are successfully compared with data provided by a comprehensive, fully space and time-resolved unidirectional solver. Importantly, these numerical simulations clear up the effective plasma length along which THz emission develops, compared with the dephasing length along which the laser fundamental and second harmonic become out-of-phase. The impact of common optical aberrations, such as sphericity, astigmatism, and coma, on the THz generation is also investigated. Aberrations are shown to generally decrease the laser-to-THz conversion efficiency and potentially induce spatial asymmetries and narrowing in the THz spectra.


title: Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models

abstract: Assessing the effectiveness of large language models (LLMs) in addressing diverse tasks is essential for comprehending their strengths and weaknesses. Conventional evaluation techniques typically apply a single prompting strategy uniformly across datasets, not considering the varying degrees of task complexity. We introduce the Hierarchical Prompting Taxonomy (HPT), a taxonomy that employs a Hierarchical Prompt Framework (HPF) composed of five unique prompting strategies, arranged from the simplest to the most complex, to assess LLMs more precisely and to offer a clearer perspective. This taxonomy assigns a score, called the Hierarchical Prompting Score (HP-Score), to datasets as well as LLMs based on the rules of the taxonomy, providing a nuanced understanding of their ability to solve diverse tasks and offering a universal measure of task complexity. Additionally, we introduce the Adaptive Hierarchical Prompt framework, which automates the selection of appropriate prompting strategies for each task. This study compares manual and adaptive hierarchical prompt frameworks using four instruction-tuned LLMs, namely Llama 3 8B, Phi 3 3.8B, Mistral 7B, and Gemma 7B, across four datasets: BoolQ, CommonSenseQA (CSQA), IWSLT-2017 en-fr (IWSLT), and SamSum. Experiments demonstrate the effectiveness of HPT, providing a reliable way to compare different tasks and LLM capabilities. This paper leads to the development of a universal evaluation metric that can be used to evaluate both the complexity of the datasets and the capabilities of LLMs. The implementation of both manual HPF and adaptive HPF is publicly available.


title: Evaluating Transparency of Machine Generated Fact Checking Explanations

abstract: An important factor when it comes to generating fact-checking explanations is the selection of evidence: intuitively, high-quality explanations can only be generated given the right evidence. In this work, we investigate the impact of human-curated vs. machine-selected evidence for explanation generation using large language models. To assess the quality of explanations, we focus on transparency (whether an explanation cites sources properly) and utility (whether an explanation is helpful in clarifying a claim). Surprisingly, we found that large language models generate similar or higher quality explanations using machine-selected evidence, suggesting carefully curated evidence (by humans) may not be necessary. That said, even with the best model, the generated explanations are not always faithful to the sources, suggesting further room for improvement in explanation generation for fact-checking.


title: An Empirical Study on the Fairness of Foundation Models for Multi-Organ Image Segmentation

abstract: The segmentation foundation model, e.g., Segment Anything Model (SAM), has attracted increasing interest in the medical image community. Early pioneering studies primarily concentrated on assessing and improving SAM's performance from the perspectives of overall accuracy and efficiency, yet little attention was given to the fairness considerations. This oversight raises questions about the potential for performance biases that could mirror those found in task-specific deep learning models like nnU-Net. In this paper, we explored the fairness dilemma concerning large segmentation foundation models. We prospectively curate a benchmark dataset of 3D MRI and CT scans of the organs including liver, kidney, spleen, lung and aorta from a total of 1056 healthy subjects with expert segmentations. Crucially, we document demographic details such as gender, age, and body mass index (BMI) for each subject to facilitate a nuanced fairness analysis. We test state-of-the-art foundation models for medical image segmentation, including the original SAM, medical SAM and SAT models, to evaluate segmentation efficacy across different demographic groups and identify disparities. Our comprehensive analysis, which accounts for various confounding factors, reveals significant fairness concerns within these foundational models. Moreover, our findings highlight not only disparities in overall segmentation metrics, such as the Dice Similarity Coefficient but also significant variations in the spatial distribution of segmentation errors, offering empirical evidence of the nuanced challenges in ensuring fairness in medical image segmentation.


title: Evolution of cooperation with the diversity of cooperation tendencies

abstract: The complete cooperation and the complete defection are two typical strategies considered in evolutionary games in many previous works. However, in real life, strategies of individuals are full of variety rather than only two complete ones. In this work, the diversity of strategies is introduced into the weak prisoners' dilemma game, which is measured by the diversity of the cooperation tendency. A higher diversity means more cooperation tendencies are provided. The complete cooperation strategy is the full cooperation tendency and the complete defection strategy is without any cooperation tendency. Agents with other cooperation tendencies behave as partial cooperators and as partial defectors simultaneously. The numerical simulation shows that increasing the diversity of the cooperation tendency promotes the cooperation level, not only the number of cooperators but also the average tendency over the whole population, until the diversity reaches its saturated value. Furthermore, our work points out maintaining cooperation is based on the cooperation efficiency approximating to the reward of cooperators and that the cooperation efficiency oscillates and quickly decreases to zero when cooperator clusters cannot resist the invasion of defectors. When the effect of the noise for the Femi update mechanism is considered, a higher diversity of strategies not only improves the cooperation level of the whole population but also supports the survival of more rational agents.


title: Mitigating Information Asymmetry in Two-Stage Contracts with Non-Myopic Agents

abstract: We consider a Stackelberg game in which a principal (she) establishes a two-stage contract with a non-myopic agent (he) whose type is unknown. The contract takes the form of an incentive function mapping the agent's first-stage action to his second-stage incentive. While the first-stage action reveals the agent's type under truthful play, a non-myopic agent could benefit from portraying a false type in the first stage to obtain a larger incentive in the second stage. The challenge is thus for the principal to design the incentive function so as to induce truthful play. We show that this is only possible with a constant, non-reactive incentive functions when the type space is continuous, whereas it can be achieved with reactive functions for discrete types. Additionally, we show that introducing an adjustment mechanism that penalizes inconsistent behavior across both stages allows the principal to design more flexible incentive functions.


title: Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Models

abstract: Vision transformers (ViTs) have emerged as a significant area of focus, particularly for their capacity to be jointly trained with large language models and to serve as robust vision foundation models. Yet, the development of trustworthy explanation methods for ViTs has lagged, particularly in the context of post-hoc interpretations of ViT predictions. Existing sub-image selection approaches, such as feature-attribution and conceptual models, fall short in this regard. This paper proposes five desiderata for explaining ViTs -- faithfulness, stability, sparsity, multi-level structure, and parsimony -- and demonstrates the inadequacy of current methods in meeting these criteria comprehensively. We introduce a variational Bayesian explanation framework, dubbed ProbAbilistic Concept Explainers (PACE), which models the distributions of patch embeddings to provide trustworthy post-hoc conceptual explanations. Our qualitative analysis reveals the distributions of patch-level concepts, elucidating the effectiveness of ViTs by modeling the joint distribution of patch embeddings and ViT's predictions. Moreover, these patch-level explanations bridge the gap between image-level and dataset-level explanations, thus completing the multi-level structure of PACE. Through extensive experiments on both synthetic and real-world datasets, we demonstrate that PACE surpasses state-of-the-art methods in terms of the defined desiderata.


title: Weakly Supervised Learning of Cortical Surface Reconstruction from Segmentations

abstract: Existing learning-based cortical surface reconstruction approaches heavily rely on the supervision of pseudo ground truth (pGT) cortical surfaces for training. Such pGT surfaces are generated by traditional neuroimage processing pipelines, which are time consuming and difficult to generalize well to low-resolution brain MRI, e.g., from fetuses and neonates. In this work, we present CoSeg, a learning-based cortical surface reconstruction framework weakly supervised by brain segmentations without the need for pGT surfaces. CoSeg introduces temporal attention networks to learn time-varying velocity fields from brain MRI for diffeomorphic surface deformations, which fit an initial surface to target cortical surfaces within only 0.11 seconds for each brain hemisphere. A weakly supervised loss is designed to reconstruct pial surfaces by inflating the white surface along the normal direction towards the boundary of the cortical gray matter segmentation. This alleviates partial volume effects and encourages the pial surface to deform into deep and challenging cortical sulci. We evaluate CoSeg on 1,113 adult brain MRI at 1mm and 2mm resolution. CoSeg achieves superior geometric and morphological accuracy compared to existing learning-based approaches. We also verify that CoSeg can extract high-quality cortical surfaces from fetal brain MRI on which traditional pipelines fail to produce acceptable results.


title: Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics

abstract: Ultrasonography has revolutionized non-invasive diagnostic methodologies, significantly enhancing patient outcomes across various medical domains. Despite its advancements, integrating ultrasound technology with robotic systems for automated scans presents challenges, including limited command understanding and dynamic execution capabilities. To address these challenges, this paper introduces a novel Ultrasound Embodied Intelligence system that synergistically combines ultrasound robots with large language models (LLMs) and domain-specific knowledge augmentation, enhancing ultrasound robots' intelligence and operational efficiency. Our approach employs a dual strategy: firstly, integrating LLMs with ultrasound robots to interpret doctors' verbal instructions into precise motion planning through a comprehensive understanding of ultrasound domain knowledge, including APIs and operational manuals; secondly, incorporating a dynamic execution mechanism, allowing for real-time adjustments to scanning plans based on patient movements or procedural errors. We demonstrate the effectiveness of our system through extensive experiments, including ablation studies and comparisons across various models, showcasing significant improvements in executing medical procedures from verbal commands. Our findings suggest that the proposed system improves the efficiency and quality of ultrasound scans and paves the way for further advancements in autonomous medical scanning technologies, with the potential to transform non-invasive diagnostics and streamline medical workflows.


title: The Onsager principle and physics preserving numerical schemes

abstract: We present a natural framework for constructing energy-stable time discretization schemes. By leveraging the Onsager principle, we demonstrate its efficacy in formulating partial differential equation models for diverse gradient flow systems. Furthermore, this principle provides a robust basis for developing numerical schemes that uphold crucial physical properties. Within this framework, several widely used schemes emerge naturally, showing its versatility and applicability.


title: Single-photon and two-photon blockade in a three-wave mixing system with a two-level atom

abstract: This paper discusses conventional photon blockade (CPB) and two-photon blockade (2PB) in a three-wave mixing system embedded with a two-level atom in the high-frequency cavity. Analytical conditions for achieving CPB and 2PB are obtained by analyzing the eigenvalues of the system Hamiltonian. Numerical solutions, derived by solving the master equation in a truncated Fock space, are consistent with the analytical conditions. Detailed analysis of system parameters reveals the influence of the embedded atom on achieving different types of photon blockade. Unlike previous schemes, this system can achieve single-photon blockade simultaneously in three photon modes. Additionally, by adjusting the coupling coefficient between the atom and high-frequency mode photons, the system can switch between single-photon blockade and two-photon blockade in the high-frequency mode.


title: A comparative study on the self-similarity hypothesis of regular and slow earthquake growth

abstract: Fault ruptures of regular earthquakes typically grow in a self-similar manner, where the radiated energy is proportional to the seismic moment. Their proportionality factor, termed as scaled energy, has been conventionally described as the ratio of stress drop to stiffness. By analyzing the self-similar circular crack model by Sato and Hirasawa (1973), Matsu'ura (2024) found a correction prefactor for this theoretical representation of the scaled energy, the cubed ratio of the rupture speed to the S-wave speed. The stress drop times the cubed rupture speed is the scaling prefactor of the self-similar seismic moment, and thus, Matsu'ura's solution tells that the seismic moment rate is determined by the scaled energy in the self-similar rupture growth. We rearrange the properties of the self-similar solution from this perspective, apply this Sato-Hirasawa-Matsu'ura relation to a series of seismic events thought to be self-similar, and estimate their source parameters and scaled energies. According to our estimation using the above self-similarity model, seismologically detected low-frequency and very-low-frequency earthquakes have a common scaled energy, while geodetically detectable slow slip events indicate multiple modes with different scaled energies. Meanwhile, for very-low-frequency earthquakes and tectonic tremors, the seismic moments were significantly smaller than expected for self-similar ruptures despite their moments being proportional to cubed duration values. It keeps alive a hitherto less contemplated possibility: the proportionality of the moment to cubed duration may not be a manifestation of the self-similarity for slow earthquake rupture growth.


title: Benchmarks and Metrics for Evaluations of Code Generation: A Critical Review

abstract: With the rapid development of Large Language Models (LLMs), a large number of machine learning models have been developed to assist programming tasks including the generation of program code from natural language input. However, how to evaluate such LLMs for this task is still an open problem despite of the great amount of research efforts that have been made and reported to evaluate and compare them. This paper provides a critical review of the existing work on the testing and evaluation of these tools with a focus on two key aspects: the benchmarks and the metrics used in the evaluations. Based on the review, further research directions are discussed.


title: Exponential Error Reduction for Glueball Calculations Using a Two-Level Algorithm in Pure Gauge Theory

abstract: This study explores the application of a two-level algorithm to enhance the signal-to-noise ratio of glueball calculations in four-dimensional $\mathrm{SU(3)}$ pure gauge theory. Our findings demonstrate that the statistical errors exhibit an exponential reduction, enabling reliable extraction of effective masses at distances where current standard methods would demand exponentially more samples. However, at shorter distances, standard methods prove more efficient due to a saturation of the variance reduction using the multi-level method. We discuss the physical distance at which the multi-level sampling is expected to outperform the standard algorithm, supported by numerical evidence across different lattice spacings and glueball channels. Additionally, we construct a variational basis comprising 35 Wilson loops up to length 12 and 5 smearing sizes each, presenting results for the first state in the spectrum for the scalar, pseudoscalar, and tensor channels.


title: Inferring kinetics and entropy production from observable transitions in partially accessible, periodically driven Markov networks

abstract: For a network of discrete states with a periodically driven Markovian dynamics, we develop an inference scheme for an external observer who has access to some transitions. Based on waiting-time distributions between these transitions, the periodic probabilities of states connected by these observed transitions and their time-dependent transition rates can be inferred. Moreover, the smallest number of hidden transitions between accessible ones and some of their transition rates can be extracted. We prove and conjecture lower bounds on the total entropy production for such periodic stationary states. Even though our techniques are based on generalizations of known methods for steady states, we obtain original results for those as well.


title: Federated Learning with a Single Shared Image

abstract: Federated Learning (FL) enables multiple machines to collaboratively train a machine learning model without sharing of private training data. Yet, especially for heterogeneous models, a key bottleneck remains the transfer of knowledge gained from each client model with the server. One popular method, FedDF, uses distillation to tackle this task with the use of a common, shared dataset on which predictions are exchanged. However, in many contexts such a dataset might be difficult to acquire due to privacy and the clients might not allow for storage of a large shared dataset. To this end, in this paper, we introduce a new method that improves this knowledge distillation method to only rely on a single shared image between clients and server. In particular, we propose a novel adaptive dataset pruning algorithm that selects the most informative crops generated from only a single image. With this, we show that federated learning with distillation under a limited shared dataset budget works better by using a single image compared to multiple individual ones. Finally, we extend our approach to allow for training heterogeneous client architectures by incorporating a non-uniform distillation schedule and client-model mirroring on the server side.


title: A variational Bayes approach to debiased inference for low-dimensional parameters in high-dimensional linear regression

abstract: We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field approximation to the nuisance coordinates and carefully modelling the conditional distribution of the target given the nuisance. This requires only a preprocessing step and preserves the computational advantages of mean-field variational Bayes, while ensuring accurate and reliable inference for the target parameter, including for uncertainty quantification. We investigate the numerical performance of our algorithm, showing that it performs competitively with existing methods. We further establish accompanying theoretical guarantees for estimation and uncertainty quantification in the form of a Bernstein--von Mises theorem.


title: Investigating the Role of Explainability and AI Literacy in User Compliance

abstract: AI is becoming increasingly common across different domains. However, as sophisticated AI-based systems are often black-boxed, rendering the decision-making logic opaque, users find it challenging to comply with their recommendations. Although researchers are investigating Explainable AI (XAI) to increase the transparency of the underlying machine learning models, it is unclear what types of explanations are effective and what other factors increase compliance. To better understand the interplay of these factors, we conducted an experiment with 562 participants who were presented with the recommendations of an AI and two different types of XAI. We find that users' compliance increases with the introduction of XAI but is also affected by AI literacy. We also find that the relationships between AI literacy XAI and users' compliance are mediated by the users' mental model of AI. Our study has several implications for successfully designing AI-based systems utilizing XAI.


title: SCORE: A 1D Reparameterization Technique to Break Bayesian Optimization's Curse of Dimensionality

abstract: Bayesian optimization (BO) has emerged as a powerful tool for navigating complex search spaces, showcasing practical applications in the fields of science and engineering.However, since it typically relies on a surrogate model to approximate the objective function, BO grapples with heightened computational costs that tend to escalate as the number of parameters and experiments grows. Several methods such as parallelization, surrogate model approximations, and memory pruning have been proposed to cut down computing time, but they all fall short of resolving the core issue behind BO's curse of dimensionality. In this paper, a 1D reparametrization trick is proposed to break this curse and sustain linear time complexity for BO in high-dimensional landscapes. This fast and scalable approach named SCORE can successfully find the global minimum of needle-in-a-haystack optimization functions and fit real-world data without the high-performance computing resources typically required by state-of-the-art techniques.


title: Online Anchor-based Training for Image Classification Tasks

abstract: In this paper, we aim to improve the performance of a deep learning model towards image classification tasks, proposing a novel anchor-based training methodology, named \textit{Online Anchor-based Training} (OAT). The OAT method, guided by the insights provided in the anchor-based object detection methodologies, instead of learning directly the class labels, proposes to train a model to learn percentage changes of the class labels with respect to defined anchors. We define as anchors the batch centers at the output of the model. Then, during the test phase, the predictions are converted back to the original class label space, and the performance is evaluated. The effectiveness of the OAT method is validated on four datasets.


title: Do More Details Always Introduce More Hallucinations in LVLM-based Image Captioning?

abstract: Large Vision-Language Models (LVLMs) excel in integrating visual and linguistic contexts to produce detailed content, facilitating applications such as image captioning. However, using LVLMs to generate descriptions often faces the challenge of object hallucination (OH), where the output text misrepresents actual objects in the input image. While previous studies attribute the occurrence of OH to the inclusion of more details, our study finds technical flaws in existing metrics, leading to unreliable evaluations of models and conclusions about OH. This has sparked a debate on the question: Do more details always introduce more hallucinations in LVLM-based image captioning? In this paper, we address this debate by proposing a novel decoding strategy, Differentiated Beam Decoding (DBD), along with a reliable new set of evaluation metrics: CLIP-Precision, CLIP-Recall, and CLIP-F1. DBD decodes the wealth of information hidden in visual input into distinct language representations called unit facts in parallel. This decoding is achieved via a well-designed differential score that guides the parallel search and candidate screening. The selected unit facts are then aggregated to generate the final caption. Our proposed metrics evaluate the comprehensiveness and accuracy of image captions by comparing the embedding groups of ground-truth image regions and generated text partitions. Extensive experiments on the Visual Genome dataset validate the effectiveness of our approach, demonstrating that it produces detailed descriptions while maintaining low hallucination levels.


title: On minimal homogeneous submanifolds of the hyperbolic space up to codimension two

abstract: We show that a minimal homogeneous submanifold $M^n$, $n\geq 5$, of a hyperbolic space up to codimension two is totally geodesic.


title: CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysis

abstract: The rise of unifying frameworks that enable seamless interoperability of Large Language Models (LLMs) has made LLM-LLM collaboration for open-ended tasks a possibility. Despite this, there have not been efforts to explore such collaborative writing. We take the next step beyond human-LLM collaboration to explore this multi-LLM scenario by generating the first exclusively LLM-generated collaborative stories dataset called CollabStory. We focus on single-author ($N=1$) to multi-author (up to $N=5$) scenarios, where multiple LLMs co-author stories. We generate over 32k stories using open-source instruction-tuned LLMs. Further, we take inspiration from the PAN tasks that have set the standard for human-human multi-author writing tasks and analysis. We extend their authorship-related tasks for multi-LLM settings and present baselines for LLM-LLM collaboration. We find that current baselines are not able to handle this emerging scenario. Thus, CollabStory is a resource that could help propel an understanding as well as the development of techniques to discern the use of multiple LLMs. This is crucial to study in the context of writing tasks since LLM-LLM collaboration could potentially overwhelm ongoing challenges related to plagiarism detection, credit assignment, maintaining academic integrity in educational settings, and addressing copyright infringement concerns. We make our dataset and code available at \texttt{\url{https://github.com/saranya-venkatraman/multi_llm_story_writing}}.


title: The Modified Combo i3+3 Design for Novel-Novel Combination Dose-Finding Trials in Oncology

abstract: We consider a modified Ci3+3 (MCi3+3) design for dual-agent dose-finding trials in which both agents are tested on multiple doses. This usually happens when the agents are novel therapies. The MCi3+3 design offers a two-stage or three-stage version, depending on the practical need. The first stage begins with single-agent dose escalation, the second stage launches a model-free combination dose finding for both agents, and optionally, the third stage follows with a model-based design. MCi3+3 aims to maintain a relatively simple framework to facilitate practical application, while also address challenges that are unique to novel-novel combination dose finding. Through simulations, we demonstrate that the MCi3+3 design adeptly manages various toxicity scenarios. It exhibits operational characteristics on par with other combination designs, while offering an enhanced safety profile. The design is motivated and tested for a real-life clinical trial.


title: A Systematization of the Wagner Framework: Graph Theory Conjectures and Reinforcement Learning

abstract: In 2021, Adam Zsolt Wagner proposed an approach to disprove conjectures in graph theory using Reinforcement Learning (RL). Wagner's idea can be framed as follows: consider a conjecture, such as a certain quantity f(G) < 0 for every graph G; one can then play a single-player graph-building game, where at each turn the player decides whether to add an edge or not. The game ends when all edges have been considered, resulting in a certain graph G_T, and f(G_T) is the final score of the game; RL is then used to maximize this score. This brilliant idea is as simple as innovative, and it lends itself to systematic generalization. Several different single-player graph-building games can be employed, along with various RL algorithms. Moreover, RL maximizes the cumulative reward, allowing for step-by-step rewards instead of a single final score, provided the final cumulative reward represents the quantity of interest f(G_T). In this paper, we discuss these and various other choices that can be significant in Wagner's framework. As a contribution to this systematization, we present four distinct single-player graph-building games. Each game employs both a step-by-step reward system and a single final score. We also propose a principled approach to select the most suitable neural network architecture for any given conjecture, and introduce a new dataset of graphs labeled with their Laplacian spectra. Furthermore, we provide a counterexample for a conjecture regarding the sum of the matching number and the spectral radius, which is simpler than the example provided in Wagner's original paper. The games have been implemented as environments in the Gymnasium framework, and along with the dataset, are available as open-source supplementary materials.


title: Disturbing Image Detection Using LMM-Elicited Emotion Embeddings

abstract: In this paper we deal with the task of Disturbing Image Detection (DID), exploiting knowledge encoded in Large Multimodal Models (LMMs). Specifically, we propose to exploit LMM knowledge in a two-fold manner: first by extracting generic semantic descriptions, and second by extracting elicited emotions. Subsequently, we use the CLIP's text encoder in order to obtain the text embeddings of both the generic semantic descriptions and LMM-elicited emotions. Finally, we use the aforementioned text embeddings along with the corresponding CLIP's image embeddings for performing the DID task. The proposed method significantly improves the baseline classification accuracy, achieving state-of-the-art performance on the augmented Disturbing Image Detection dataset.


title: How to Drive -- An Ability-based Description of Autonomous, Remote and Human Driving

abstract: The development of autonomous and remote-operated driving systems requires extensive stakeholder analyses, requirement engineering, and formalized system descriptions. This is necessary to guarantee the success of the final product after the expensive and time-consuming development phase. To integrate a formalized description of the required abilites of the system, ability graphs have been proposed in the literature. Up to this date, however, this ability graph has only been used to model less complicated driver assistance systems in the literature. This work aims to introduce the value of an ability graph-based description of complex driving systems. This is achieved by successfully demonstrating and discussing a method for constructing a holistic ability graph capable of describing the entirety of abilities required for any driving system.


title: Stealth edits for provably fixing or attacking large language models

abstract: We reveal new methods and the theoretical foundations of techniques for editing large language models. We also show how the new theory can be used to assess the editability of models and to expose their susceptibility to previously unknown malicious attacks. Our theoretical approach shows that a single metric (a specific measure of the intrinsic dimensionality of the model's features) is fundamental to predicting the success of popular editing approaches, and reveals new bridges between disparate families of editing methods. We collectively refer to these approaches as stealth editing methods, because they aim to directly and inexpensively update a model's weights to correct the model's responses to known hallucinating prompts without otherwise affecting the model's behaviour, without requiring retraining. By carefully applying the insight gleaned from our theoretical investigation, we are able to introduce a new network block -- named a jet-pack block -- which is optimised for highly selective model editing, uses only standard network operations, and can be inserted into existing networks. The intrinsic dimensionality metric also determines the vulnerability of a language model to a stealth attack: a small change to a model's weights which changes its response to a single attacker-chosen prompt. Stealth attacks do not require access to or knowledge of the model's training data, therefore representing a potent yet previously unrecognised threat to redistributed foundation models. They are computationally simple enough to be implemented in malware in many cases. Extensive experimental results illustrate and support the method and its theoretical underpinnings. Demos and source code for editing language models are available at https://github.com/qinghua-zhou/stealth-edits.


title: GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Models

abstract: Recent advances in discriminative and generative pretraining have yielded geometry estimation models with strong generalization capabilities. While discriminative monocular geometry estimation methods rely on large-scale fine-tuning data to achieve zero-shot generalization, several generative-based paradigms show the potential of achieving impressive generalization performance on unseen scenes by leveraging pre-trained diffusion models and fine-tuning on even a small scale of synthetic training data. Frustratingly, these models are trained with different recipes on different datasets, making it hard to find out the critical factors that determine the evaluation performance. Besides, current geometry evaluation benchmarks have two main drawbacks that may prevent the development of the field, i.e., limited scene diversity and unfavorable label quality. To resolve the above issues, (1) we build fair and strong baselines in a unified codebase for evaluating and analyzing the geometry estimation models; (2) we evaluate monocular geometry estimators on more challenging benchmarks for geometry estimation task with diverse scenes and high-quality annotations. Our results reveal that pre-trained using large data, discriminative models such as DINOv2, can outperform generative counterparts with a small amount of high-quality synthetic data under the same training configuration, which suggests that fine-tuning data quality is a more important factor than the data scale and model architecture. Our observation also raises a question: if simply fine-tuning a general vision model such as DINOv2 using a small amount of synthetic depth data produces SOTA results, do we really need complex generative models for depth estimation? We believe this work can propel advancements in geometry estimation tasks as well as a wide range of downstream applications.


title: Sparsifying dimensionality reduction of PDE solution data with Bregman learning

abstract: Classical model reduction techniques project the governing equations onto a linear subspace of the original state space. More recent data-driven techniques use neural networks to enable nonlinear projections. Whilst those often enable stronger compression, they may have redundant parameters and lead to suboptimal latent dimensionality. To overcome these, we propose a multistep algorithm that induces sparsity in the encoder-decoder networks for effective reduction in the number of parameters and additional compression of the latent space. This algorithm starts with sparsely initialized a network and training it using linearized Bregman iterations. These iterations have been very successful in computer vision and compressed sensing tasks, but have not yet been used for reduced-order modelling. After the training, we further compress the latent space dimensionality by using a form of proper orthogonal decomposition. Last, we use a bias propagation technique to change the induced sparsity into an effective reduction of parameters. We apply this algorithm to three representative PDE models: 1D diffusion, 1D advection, and 2D reaction-diffusion. Compared to conventional training methods like Adam, the proposed method achieves similar accuracy with 30% less parameters and a significantly smaller latent space.


title: Estimating Knowledge in Large Language Models Without Generating a Single Token

abstract: To evaluate knowledge in large language models (LLMs), current methods query the model and then evaluate its generated responses. In this work, we ask whether evaluation can be done $\textit{before}$ the model has generated any text. Concretely, is it possible to estimate how knowledgeable a model is about a certain entity, only from its internal computation? We study this question with two tasks: given a subject entity, the goal is to predict (a) the ability of the model to answer common questions about the entity, and (b) the factuality of responses generated by the model about the entity. Experiments with a variety of LLMs show that KEEN, a simple probe trained over internal subject representations, succeeds at both tasks - strongly correlating with both the QA accuracy of the model per-subject and FActScore, a recent factuality metric in open-ended generation. Moreover, KEEN naturally aligns with the model's hedging behavior and faithfully reflects changes in the model's knowledge after fine-tuning. Lastly, we show a more interpretable yet equally performant variant of KEEN, which highlights a small set of tokens that correlates with the model's lack of knowledge. Being simple and lightweight, KEEN can be leveraged to identify gaps and clusters of entity knowledge in LLMs, and guide decisions such as augmenting queries with retrieval.


title: Transcribe, Align and Segment: Creating speech datasets for low-resource languages

abstract: In this work, we showcase a cost-effective method for generating training data for speech processing tasks. First, we transcribe unlabeled speech using a state-of-the-art Automatic Speech Recognition (ASR) model. Next, we align generated transcripts with the audio and apply segmentation on short utterances. Our focus is on ASR for low-resource languages, such as Ukrainian, using podcasts as a source of unlabeled speech. We release a new dataset UK-PODS that features modern conversational Ukrainian language. It contains over 50 hours of text audio-pairs as well as uk-pods-conformer, a 121 M parameters ASR model that is trained on MCV-10 and UK-PODS and achieves 3x reduction of Word Error Rate (WER) on podcasts comparing to publically available uk-nvidia-citrinet while maintaining comparable WER on MCV-10 test split. Both dataset UK-PODS https://huggingface.co/datasets/taras-sereda/uk-pods and ASR uk-pods-conformer https://huggingface.co/taras-sereda/uk-pods-conformer are available on the hugging-face hub.


title: Dark Energy Survey Year 3 Results: Cosmology from galaxy clustering and galaxy-galaxy lensing in harmonic space

abstract: We present the joint tomographic analysis of galaxy-galaxy lensing and galaxy clustering in harmonic space, using galaxy catalogues from the first three years of observations by the Dark Energy Survey (DES Y3). We utilise the redMaGiC and MagLim catalogues as lens galaxies and the METACALIBRATION catalogue as source galaxies. The measurements of angular power spectra are performed using the pseudo-$C_\ell$ method, and our theoretical modelling follows the fiducial analyses performed by DES Y3 in configuration space, accounting for galaxy bias, intrinsic alignments, magnification bias, shear magnification bias and photometric redshift uncertainties. We explore different approaches for scale cuts based on non-linear galaxy bias and baryonic effects contamination. Our fiducial covariance matrix is computed analytically, accounting for mask geometry in the Gaussian term, and including non-Gaussian contributions and super-sample covariance terms. To validate our harmonic space pipelines and covariance matrix, we used a suite of 1800 log-normal simulations. We also perform a series of stress tests to gauge the robustness of our harmonic space analysis. In the $\Lambda$CDM model, the clustering amplitude $S_8 =\sigma_8(\Omega_m/0.3)^{0.5}$ is constrained to $S_8 = 0.704\pm 0.029$ and $S_8 = 0.753\pm 0.024$ ($68\%$ C.L.) for the redMaGiC and MagLim catalogues, respectively. For the $w$CDM, the dark energy equation of state is constrained to $w = -1.28 \pm 0.29$ and $w = -1.26^{+0.34}_{-0.27}$, for redMaGiC and MagLim catalogues, respectively. These results are compatible with the corresponding DES Y3 results in configuration space and pave the way for harmonic space analyses using the DES Y6 data.