title: Exploring Jamming and Hijacking Attacks for Micro Aerial Drones

abstract: Recent advancements in drone technology have shown that commercial off-the-shelf Micro Aerial Drones are more effective than large-sized drones for performing flight missions in narrow environments, such as swarming, indoor navigation, and inspection of hazardous locations. Due to their deployments in many civilian and military applications, safe and reliable communication of these drones throughout the mission is critical. The Crazyflie ecosystem is one of the most popular Micro Aerial Drones and has the potential to be deployed worldwide. In this paper, we empirically investigate two interference attacks against the Crazy Real Time Protocol (CRTP) implemented within the Crazyflie drones. In particular, we explore the feasibility of experimenting two attack vectors that can disrupt an ongoing flight mission: the jamming attack, and the hijacking attack. Our experimental results demonstrate the effectiveness of such attacks in both autonomous and non-autonomous flight modes on a Crazyflie 2.1 drone. Finally, we suggest potential shielding strategies that guarantee a safe and secure flight mission. To the best of our knowledge, this is the first work investigating jamming and hijacking attacks against Micro Aerial Drones, both in autonomous and non-autonomous modes.


title: Cosmological forecasts from the combination of Stage-IV photometric galaxy surveys and the magnification from forthcoming GW observatories

abstract: In this work we have investigated the synergy between Stage-IV galaxy surveys and future GW observatories for constraining the underlying cosmological model of the Universe, focussing on photometric galaxy clustering, cosmic shear and GW magnification as cosmological probes. We have implemented a Fisher matrix approach for the evaluation of the full $6\times2$pt statistics composed by the angular power spectra of the single probes together with their combination. For our analysis, we have in particular considered dynamical dark energy and massive neutrino scenarios. We have found that the improvement to galaxy survey performance is below 1\%, in the case $\ell^{\rm GW}_{\rm max}=100$ and a luminosity distance error of $\sigma_{d_L}/d_L=10\%$. However, when extending the analysis to $\ell^{\rm GW}_{\rm max}=1000$, we find that the GW magnification improves the galaxy survey performance on all the cosmological parameters, reducing their errors by $3\%$-$5\%$, when $\sigma_{d_L}/d_L=10\%$, and by $10\%$-$18\%$ when $\sigma_{d_L}/d_L=1\%$, especially for $M_\nu$, $w_0$ and $w_a$. However, here our analysis is unavoidably optimistic: a much more detailed and realistic approach will be needed, especially by including systematic effects. But we can conclude that, in the case of future gravitational wave observatories the inclusion of the gravitational wave magnification can improve Stage-IV galaxy surveys performance on constraining the underlying cosmological model of the Universe.


title: ProxNF: Neural Field Proximal Training for High-Resolution 4D Dynamic Image Reconstruction

abstract: Accurate spatiotemporal image reconstruction methods are needed for a wide range of biomedical research areas but face challenges due to data incompleteness and computational burden. Data incompleteness arises from the undersampling often required to increase frame rates and reduce acquisition times, while computational burden emerges due to the memory footprint of high-resolution images with three spatial dimensions and extended time horizons. Neural fields, an emerging class of neural networks that act as continuous representations of spatiotemporal objects, have previously been introduced to solve these dynamic imaging problems by reframing image reconstruction to a problem of estimating network parameters. Neural fields can address the twin challenges of data incompleteness and computational burden by exploiting underlying redundancies in these spatiotemporal objects. This work proposes ProxNF, a novel neural field training approach for spatiotemporal image reconstruction leveraging proximal splitting methods to separate computations involving the imaging operator from updates of the network parameter. Specifically, ProxNF evaluates the (subsampled) gradient of the data-fidelity term in the image domain and uses a fully supervised learning approach to update the neural field parameters. By reducing the memory footprint and the computational cost of evaluating the imaging operator, the proposed ProxNF approach allows for reconstructing large, high-resolution spatiotemporal images. This method is demonstrated in two numerical studies involving virtual dynamic contrast-enhanced photoacoustic computed tomography imaging of an anatomically realistic dynamic numerical mouse phantom and a two-compartment model of tumor perfusion.


title: Designing Informative Metrics for Few-Shot Example Selection

abstract: Pretrained language models (PLMs) have shown remarkable few-shot learning capabilities when provided with properly formatted examples. However, selecting the "best" examples remains an open challenge. We propose a complexity-based prompt selection approach for sequence tagging tasks. This approach avoids the training of a dedicated model for selection of examples, and instead uses certain metrics to align the syntactico-semantic complexity of test sentences and examples. We use both sentence- and word-level metrics to match the complexity of examples to the (test) sentence being considered. Our results demonstrate that our approach extracts greater performance from PLMs: it achieves state-of-the-art performance on few-shot NER, achieving a 5% absolute improvement in F1 score on the CoNLL2003 dataset for GPT-4. We also see large gains of upto 28.85 points (F1/Acc.) in smaller models like GPT-j-6B.


title: An analysis of the NCAA college football playoff team selections using an Elo ratings model

abstract: In December 2023 the Florida State Seminoles became the first Power 5 school to have an undefeated season and miss selection for the College Football Playoff. In order to assess this decision, we employed an Elo ratings model to rank the teams and found that the selection committee's decision was justified and that Florida State were not one of the four best teams in college football in that season (ranking only 11th!). We extended this analysis to all other years of the CFP and found that the top four teams by Elo ratings differ greatly from the four teams selected in almost every year of the CFP's existence. Furthermore, we found that there have been more egregious non-selections including when Alabama was ranked first by Elo ratings in 2022 and were not selected. The analysis suggests that the current criteria are too subjective and a ratings model should be implemented to provide transparency for the sport, its teams, and its fans.


title: X-Shot: A Unified System to Handle Frequent, Few-shot and Zero-shot Learning Simultaneously in Classification

abstract: In recent years, few-shot and zero-shot learning, which learn to predict labels with limited annotated instances, have garnered significant attention. Traditional approaches often treat frequent-shot (freq-shot; labels with abundant instances), few-shot, and zero-shot learning as distinct challenges, optimizing systems for just one of these scenarios. Yet, in real-world settings, label occurrences vary greatly. Some of them might appear thousands of times, while others might only appear sporadically or not at all. For practical deployment, it is crucial that a system can adapt to any label occurrence. We introduce a novel classification challenge: X-shot, reflecting a real-world context where freq-shot, few-shot, and zero-shot labels co-occur without predefined limits. Here, X can span from 0 to positive infinity. The crux of X-shot centers on open-domain generalization and devising a system versatile enough to manage various label scenarios. To solve X-shot, we propose BinBin (Binary INference Based on INstruction following) that leverages the Indirect Supervision from a large collection of NLP tasks via instruction following, bolstered by Weak Supervision provided by large language models. BinBin surpasses previous state-of-the-art techniques on three benchmark datasets across multiple domains. To our knowledge, this is the first work addressing X-shot learning, where X remains variable.


title: Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

abstract: This paper introduces the novel task of multimodal puzzle solving, framed within the context of visual question-answering. We present a new dataset, AlgoPuzzleVQA designed to challenge and evaluate the capabilities of multimodal language models in solving algorithmic puzzles that necessitate both visual understanding, language understanding, and complex algorithmic reasoning. We create the puzzles to encompass a diverse array of mathematical and algorithmic topics such as boolean logic, combinatorics, graph theory, optimization, search, etc., aiming to evaluate the gap between visual data interpretation and algorithmic problem-solving skills. The dataset is generated automatically from code authored by humans. All our puzzles have exact solutions that can be found from the algorithm without tedious human calculations. It ensures that our dataset can be scaled up arbitrarily in terms of reasoning complexity and dataset size. Our investigation reveals that large language models (LLMs) such as GPT4V and Gemini exhibit limited performance in puzzle-solving tasks. We find that their performance is near random in a multi-choice question-answering setup for a significant number of puzzles. The findings emphasize the challenges of integrating visual, language, and algorithmic knowledge for solving complex reasoning problems.


title: Blockchain and Carbon Markets: Standards Overview

abstract: The increasing significance of sustainability considerations within both public spheres (such as policies and regulations) and private sectors (including voluntary commitments by major multinational corporations) underscores the imperative to harness cutting-edge technological advancements. This is essential to ensure that the momentum of this trend translates into tangible outcomes, thwarting phenomena like greenwashing and upholding high standards of integrity, all while expediting progress through automation. This paper focuses specifically on carbon markets, which, after enduring years of confusion and controversy, may finally be on the brink of converging toward internationally recognized minimum standards. Beginning with an introduction to fundamental concepts pertaining to carbon markets and Distributed Ledger Technologies (DLTs), the paper proceeds to dissect the challenges and opportunities within this burgeoning field. Its primary contribution lies in offering a comprehensive overview of recent developments across various initiatives (such as ICVCM, IETA/WorldBank/CAD Trust, IEEE/ISO) and providing a layered analysis of the entire ecosystem. This framework aids in understanding and prioritising future endeavours. Ultimately, the paper furnishes a set of recommendations aimed at bolstering scalability and fostering widespread adoption of best practices within international markets.


title: KIWI: A Dataset of Knowledge-Intensive Writing Instructions for Answering Research Questions

abstract: Large language models (LLMs) adapted to follow user instructions are now widely deployed as conversational agents. In this work, we examine one increasingly common instruction-following task: providing writing assistance to compose a long-form answer. To evaluate the capabilities of current LLMs on this task, we construct KIWI, a dataset of knowledge-intensive writing instructions in the scientific domain. Given a research question, an initial model-generated answer and a set of relevant papers, an expert annotator iteratively issues instructions for the model to revise and improve its answer. We collect 1,260 interaction turns from 234 interaction sessions with three state-of-the-art LLMs. Each turn includes a user instruction, a model response, and a human evaluation of the model response. Through a detailed analysis of the collected responses, we find that all models struggle to incorporate new information into an existing answer, and to perform precise and unambiguous edits. Further, we find that models struggle to judge whether their outputs successfully followed user instructions, with accuracy at least 10 points short of human agreement. Our findings indicate that KIWI will be a valuable resource to measure progress and improve LLMs' instruction-following capabilities for knowledge intensive writing tasks.


title: On the Origins of Linear Representations in Large Language Models

abstract: Recent works have argued that high-level semantic concepts are encoded "linearly" in the representation space of large language models. In this work, we study the origins of such linear representations. To that end, we introduce a simple latent variable model to abstract and formalize the concept dynamics of the next token prediction. We use this formalism to show that the next token prediction objective (softmax with cross-entropy) and the implicit bias of gradient descent together promote the linear representation of concepts. Experiments show that linear representations emerge when learning from data matching the latent variable model, confirming that this simple structure already suffices to yield linear representations. We additionally confirm some predictions of the theory using the LLaMA-2 large language model, giving evidence that the simplified model yields generalizable insights.


title: Confidence on the Focal: Conformal Prediction with Selection-Conditional Coverage

abstract: Conformal prediction builds marginally valid prediction intervals that cover the unknown outcome of a randomly drawn new test point with a prescribed probability. However, a common scenario in practice is that, after seeing the data, practitioners decide which test unit(s) to focus on in a data-driven manner and seek for uncertainty quantification of the focal unit(s). In such cases, marginally valid conformal prediction intervals may not provide valid coverage for the focal unit(s) due to selection bias. This paper presents a general framework for constructing a prediction set with finite-sample exact coverage conditional on the unit being selected by a given procedure. The general form of our method works for arbitrary selection rules that are invariant to the permutation of the calibration units, and generalizes Mondrian Conformal Prediction to multiple test units and non-equivariant classifiers. We then work out the computationally efficient implementation of our framework for a number of realistic selection rules, including top-K selection, optimization-based selection, selection based on conformal p-values, and selection based on properties of preliminary conformal prediction sets. The performance of our methods is demonstrated via applications in drug discovery and health risk prediction.


title: Digitality as a "longue dur\`ee" historical phenomenon

abstract: The digital age introduced the Digital Ecological Niche (DEN), revolutionizing human interactions. The advent of Digital History (DHy) has marked a methodological shift in historical studies, tracing its roots to Babbage and Lovelace's 19th-century work on "coding" as a foundational communication process, fostering a new interaction paradigm between humans and machines, termed "person2persons2machines." This evolution, through digitization and informatization, builds upon ancient coding practices but was significantly advanced by Babbage and Lovelace's contributions to mathematical linguistic systems, laying the groundwork for Computer Science. This field, central to 20th-century mainframe interaction through programming languages and formalization, situates Digital History within a broader historical context. Here, coding and mathematical methodologies empower historians with advanced technologies for historical data preservation and analysis. Nonetheless, the extent to which computation and Turing machines can fully understand and interpret history remains a subject of debate.


title: Learning to Decode Collaboratively with Multiple Language Models

abstract: We propose a method to teach multiple large language models (LLM) to collaborate by interleaving their generations at the token level. We model the decision of which LLM generates the next token as a latent variable. By optimizing the marginal likelihood of a training set under our latent variable model, the base LLM automatically learns when to generate itself and when to call on one of the ``assistant'' language models to generate, all without direct supervision. Token-level collaboration during decoding allows for a fusion of each model's expertise in a manner tailored to the specific task at hand. Our collaborative decoding is especially useful in cross-domain settings where a generalist base LLM learns to invoke domain expert models. On instruction-following, domain-specific QA, and reasoning tasks, we show that the performance of the joint system exceeds that of the individual models. Through qualitative analysis of the learned latent decisions, we show models trained with our method exhibit several interesting collaboration patterns, e.g., template-filling. Our code is available at https://github.com/clinicalml/co-llm.


title: Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data

abstract: Vertical Federated Learning (VFL) is an emergent distributed machine learning paradigm wherein owners of disjoint features of a common set of entities collaborate to learn a global model without sharing data. In VFL, a host client owns data labels for each entity and learns a final representation based on intermediate local representations from all guest clients. Therefore, the host is a single point of failure and label feedback can be used by malicious guest clients to infer private features. Requiring all participants to remain active and trustworthy throughout the entire training process is generally impractical and altogether infeasible outside of controlled environments. We propose Decoupled VFL (DVFL), a blockwise learning approach to VFL. By training each model on its own objective, DVFL allows for decentralized aggregation and isolation between feature learning and label supervision. With these properties, DVFL is fault tolerant and secure. We implement DVFL to train split neural networks and show that model performance is comparable to VFL on a variety of classification datasets.


title: A dormant, overmassive black hole in the early Universe

abstract: Recent observations have found a large number of supermassive black holes already in place in the first few hundred million years after Big Bang. The channels of formation and growth of these early, massive black holes are not clear, with scenarios ranging from heavy seeds to light seeds experiencing bursts of high accretion rate. Here we present the detection, from the JADES survey, of broad Halpha emission in a galaxy at z=6.68, which traces a black hole with mass of ~ 4 * 10^8 Msun and accreting at a rate of only 0.02 times the Eddington limit. The host galaxy has low star formation rate (~ 1 Msun/yr, a factor of 3 below the star forming main sequence). The black hole to stellar mass ratio is ~ 0.4, i.e. about 1,000 times above the local relation, while the system is closer to the local relations in terms of dynamical mass and velocity dispersion of the host galaxy. This object is most likely the tip of the iceberg of a much larger population of dormant black holes around the epoch of reionisation. Its properties are consistent with scenarios in which short bursts of super-Eddington accretion have resulted in black hole overgrowth and massive gas expulsion from the accretion disk; in between bursts, black holes spend most of their life in a dormant state.


title: The algebra $\mathcal{D}(W)$ via strong Darboux transformations

abstract: The Matrix Bochner Problem aims to classify weight matrices $W$ such that its algebra $\mathcal D(W)$, of all differential operators that have a sequence of these matrix orthogonal polynomials as eigenfunctions, contains a second-order differential operator. In [5] it is proven that, under certain assumptions, the solutions to the Matrix Bochner Problem can be obtained through a noncommutative bispectral Darboux transformation of some classical scalar weights. The main aim of this paper is to introduce the concept of strong Darboux transformation among weight matrices and explore the relationship between the algebras $\mathcal{D}(W)$ and $\mathcal{D}(\widetilde{W})$ when $\widetilde{W}$ is a strong Darboux transformation of $W$. Starting from a direct sum of classical scalar weights $\widetilde W$, and leveraging our complete knowledge of the algebra of $\mathcal D(\widetilde W)$, we can easily determine the algebra $\mathcal D(W)$ of a weight $W$ that is a strong Darboux transformation of $\widetilde W$.


title: Impoverished Language Technology: The Lack of (Social) Class in NLP

abstract: Since Labov's (1964) foundational work on the social stratification of language, linguistics has dedicated concerted efforts towards understanding the relationships between socio-demographic factors and language production and perception. Despite the large body of evidence identifying significant relationships between socio-demographic factors and language production, relatively few of these factors have been investigated in the context of NLP technology. While age and gender are well covered, Labov's initial target, socio-economic class, is largely absent. We survey the existing Natural Language Processing (NLP) literature and find that only 20 papers even mention socio-economic status. However, the majority of those papers do not engage with class beyond collecting information of annotator-demographics. Given this research lacuna, we provide a definition of class that can be operationalised by NLP researchers, and argue for including socio-economic class in future language technologies.


title: Augmenting reality to diminish distractions for cognitive enhancement

abstract: Smartphones are integral to modern life, yet research highlights the cognitive drawbacks associated even with their mere presence. Physically removing them from sight is a solution, but it is sometimes impractical and may increase anxiety due to fear of missing out. In response, we introduce a simple but effective use of augmented reality (AR) head-mounted displays, focusing not on augmenting reality with virtual objects, but on diminishing reality by selectively removing or occluding distracting objects, from the user's field of view. We compared cognitive task performance across four conditions: the smartphone being physically nearby, physically remote, visually removed and visually occluded via AR. Our findings reveal that using AR to visually cancel out smartphones significantly mitigates cognitive distractions caused by their presence. Specifically, the AR interventions had effects similar to physically removing the phone. These results suggest potential for novel AR applications designed to diminish reality, thereby enhancing cognitive performance.


title: A Survey on Adversarial Contention Resolution

abstract: Contention resolution addresses the challenge of coordinating access by multiple processes to a shared resource such as memory, disk storage, or a communication channel. Originally spurred by challenges in database systems and bus networks, contention resolution has endured as an important abstraction for resource sharing, despite decades of technological change. Here, we survey the literature on resolving worst-case contention, where the number of processes and the time at which each process may start seeking access to the resource is dictated by an adversary. We highlight the evolution of contention resolution, where new concerns -- such as security, quality of service, and energy efficiency -- are motivated by modern systems. These efforts have yielded insights into the limits of randomized and deterministic approaches, as well as the impact of different model assumptions such as global clock synchronization, knowledge of the number of processors, feedback from access attempts, and attacks on the availability of the shared resource.


title: Convergence rate of the Smoluchowski-Kramers approximation for diffusions with jumps

abstract: In the paper, the Kolmogorov distance is used to study the Smoluchowski-Kramers approximation for diffusions with jumps. The convergence rate is derived by Malliavin calculus.


title: On the stack of 0-dimensional coherent sheaves: structural aspects

abstract: Let $X$ be a quasiprojective scheme. In this expository note we collect a series of useful structural results on the stack $\mathscr{C}oh^n(X)$ parametrising $0$-dimensional coherent sheaves of length $n$ over $X$. For instance, we discuss its functoriality (in particular its behaviour along \'etale maps), the support morphism to $\mathrm{Sym}^n(X)$, and its relationship with the Quot scheme of points $\mathrm{Quot}_X(\mathcal E,n)$ for fixed $\mathcal E\in \mathrm{Coh}(X)$.


title: Redefining cystoscopy with ai: bladder cancer diagnosis using an efficient hybrid cnn-transformer model

abstract: Bladder cancer ranks within the top 10 most diagnosed cancers worldwide and is among the most expensive cancers to treat due to the high recurrence rates which require lifetime follow-ups. The primary tool for diagnosis is cystoscopy, which heavily relies on doctors' expertise and interpretation. Therefore, annually, numerous cases are either undiagnosed or misdiagnosed and treated as urinary infections. To address this, we suggest a deep learning approach for bladder cancer detection and segmentation which combines CNNs with a lightweight positional-encoding-free transformer and dual attention gates that fuse self and spatial attention for feature enhancement. The architecture suggested in this paper is efficient making it suitable for medical scenarios that require real time inference. Experiments have proven that this model addresses the critical need for a balance between computational efficiency and diagnostic accuracy in cystoscopic imaging as despite its small size it rivals large models in performance.


title: Almost Surely Asymptotically Constant Graph Neural Networks

abstract: We present a new angle on the expressive power of graph neural networks (GNNs) by studying how the predictions of a GNN probabilistic classifier evolve as we apply it on larger graphs drawn from some random graph model. We show that the output converges to a constant function, which upper-bounds what these classifiers can uniformly express. This strong convergence phenomenon applies to a very wide class of GNNs, including state of the art models, with aggregates including mean and the attention-based mechanism of graph transformers. Our results apply to a broad class of random graph models, including sparse and dense variants of the Erd\H{o}s-R\'enyi model, the stochastic block model, and the Barab\'asi-Albert model. We empirically validate these findings, observing that the convergence phenomenon appears not only on random graphs but also on some real-world graphs.


abstract: The efficacy of machine learning has traditionally relied on the availability of increasingly larger datasets. However, large datasets pose storage challenges and contain non-influential samples, which could be ignored during training without impacting the final accuracy of the model. In response to these limitations, the concept of distilling the information on a dataset into a condensed set of (synthetic) samples, namely a distilled dataset, emerged. One crucial aspect is the selected architecture (usually ConvNet) for linking the original and synthetic datasets. However, the final accuracy is lower if the employed model architecture differs from the model used during distillation. Another challenge is the generation of high-resolution images, e.g., 128x128 and higher. In this paper, we propose Latent Dataset Distillation with Diffusion Models (LD3M) that combine diffusion in latent space with dataset distillation to tackle both challenges. LD3M incorporates a novel diffusion process tailored for dataset distillation, which improves the gradient norms for learning synthetic images. By adjusting the number of diffusion steps, LD3M also offers a straightforward way of controlling the trade-off between speed and accuracy. We evaluate our approach in several ImageNet subsets and for high-resolution images (128x128 and 256x256). As a result, LD3M consistently outperforms state-of-the-art distillation techniques by up to 4.8 p.p. and 4.2 p.p. for 1 and 10 images per class, respectively.


title: Self and Mixed Supervision to Improve Training Labels for Multi-Class Medical Image Segmentation

abstract: Accurate training labels are a key component for multi-class medical image segmentation. Their annotation is costly and time-consuming because it requires domain expertise. This work aims to develop a dual-branch network and automatically improve training labels for multi-class image segmentation. Transfer learning is used to train the network and improve inaccurate weak labels sequentially. The dual-branch network is first trained by weak labels alone to initialize model parameters. After the network is stabilized, the shared encoder is frozen, and strong and weak decoders are fine-tuned by strong and weak labels together. The accuracy of weak labels is iteratively improved in the fine-tuning process. The proposed method was applied to a three-class segmentation of muscle, subcutaneous and visceral adipose tissue on abdominal CT scans. Validation results on 11 patients showed that the accuracy of training labels was statistically significantly improved, with the Dice similarity coefficient of muscle, subcutaneous and visceral adipose tissue increased from 74.2% to 91.5%, 91.2% to 95.6%, and 77.6% to 88.5%, respectively (p<0.05). In comparison with our earlier method, the label accuracy was also significantly improved (p<0.05). These experimental results suggested that the combination of the dual-branch network and transfer learning is an efficient means to improve training labels for multi-class segmentation.


title: SaulLM-7B: A pioneering Large Language Model for Law

abstract: In this paper, we introduce SaulLM-7B, a large language model (LLM) tailored for the legal domain. With 7 billion parameters, SaulLM-7B is the first LLM designed explicitly for legal text comprehension and generation. Leveraging the Mistral 7B architecture as its foundation, SaulLM-7B is trained on an English legal corpus of over 30 billion tokens. SaulLM-7B exhibits state-of-the-art proficiency in understanding and processing legal documents. Additionally, we present a novel instructional fine-tuning method that leverages legal datasets to further enhance SaulLM-7B's performance in legal tasks. SaulLM-7B is released under the MIT License.


title: Towards a Schauder theory for fractional viscous Hamilton--Jacobi equations

abstract: We survey some results on Lipschitz and Schauder regularity estimates for viscous Hamilton--Jacobi equations with subcritical L\'evy diffusions. The Schauder estimates, along with existence of smooth solutions, are obtained with the help of a Duhamel formula and $L^1$ bounds on the spatial derivatives of the heat kernel. Our results cover very general nonlocal and mixed local-nonlocal diffusions, including strongly anisotropic, nonsymmetric, mixed order, and spectrally one-sided models.


title: Generalization of Cycle Decompositions of Even Dimensional Hypercubes on $d$-Dimensional Toruses

abstract: We consider cycle decompositions of even, $2an$-dimensional hypercubes $Q_{2an},$ where $a \geq 3$ is odd and $n \geq 1.$ Prior work done by Axenovich, Offner, and Tompkins focused on obtaining the existence of cycle decompositions for even-dimensional hypercubes using long cycles of a given form, leaving out cycles of shorter lengths and, in fact, cycles of even longer lengths than those obtained there, such as $C_{7 \cdot 2^{11}}$ in the case of $Q_{14}.$ In this paper, we provide two novel methods for explicitly constructing cycle decompositions of virtually all possible cycle lengths, using cycles of a given form, on Cartesian products of cycles up to those known by the work of Axenovich, Offner, and Tompkins. In particular, we show that we can explicitly obtain cycle decompositions of even dimensional hypercubes $Q_{2an}$ for all lengths mentioned above while on the same Cartesian product of cycles. With this, the current understanding of cycle decompositions of even dimensional hypercubes is furthered constructively and is featured with some interesting consequences for when $a$ is a positive, even integer. Additionally, progress is made towards obtaining cycle decompositions using the longest admissible cycle lengths with the incorporation of a more explicit starting point from which such decompositions of $Q_{2an}$ can be studied further.


title: A Virtual Element method for non-Newtonian fluid flows

abstract: In this paper, we design and analyze a Virtual Element discretization for the steady motion of non-Newtonian, incompressible fluids. A specific stabilization, tailored to mimic the monotonicity and boundedness properties of the continuous operator, is introduced and theoretically investigated. The proposed method has several appealing features, including the exact enforcement of the divergence free condition and the possibility of making use of fully general polygonal meshes. A complete well-posedness and convergence analysis of the proposed method is presented under mild assumptions on the non-linear laws, encompassing common examples such as the Carreau--Yasuda model. Numerical experiments validating the theoretical bounds as well as demonstrating the practical capabilities of the proposed formulation are presented.


title: Homeomorphism groups of telescoping 2-manifolds are strongly distorted

abstract: Building on the work of Mann and Rafi, we introduce an expanded definition of a telescoping 2-manifold and proceed to study the homeomorphism group of a telescoping 2-manifold. Our main result shows that it is strongly distorted. We then give a simple description of its commutator subgroup, which is index one, two, or four depending on the topology of the manifold. Moreover, we show its commutator subgroup is uniformly perfect with commutator width at most two, and we give a family of uniform normal generators for its commutator subgroup. As a consequence of the latter result, we show that for an (orientable) telescoping 2-manifold, every (orientation-preserving) homeomorphism can be expressed as a product of at most 17 conjugate involutions. Finally, we provide analogous statements for mapping class groups.


title: FaaF: Facts as a Function for the evaluation of generated text

abstract: The demand for accurate and efficient verification of information in texts generated by large language models (LMs) is at an all-time high, but remains unresolved. Recent efforts have focused on extracting and verifying atomic facts from these texts via prompting LM evaluators. However, we demonstrate that this method of prompting is unreliable when faced with incomplete or inaccurate reference information. We introduce Facts as a Function (FaaF), a new approach to the fact verification task that leverages the function-calling capabilities of LMs. FaaF significantly enhances the ability of LMs to identify unsupported facts in texts, while also improving efficiency and significantly lowering costs compared to prompt-based methods. Additionally, we propose a framework for evaluating factual recall in Retrieval Augmented Generation (RAG) systems, which we employ to compare prompt-based and FaaF methods using various LMs under challenging conditions.


title: Non-reflective traveling waves in finite thin beams: A parametric study

abstract: In the present study, the authors introduce a geometrically improved model inspired by the mammalian basilar membrane's properties and special vibratory behavior while conducting a parametric investigation. The goal of this model is to mimic the broadband non-reflective traveling wave response to excitation frequencies, as observed in the basilar membrane. Simple structural elements, such as beams, springs, and dashpots are utilized for this purpose. Therefore, the beam's equation of motion is developed using Hamilton's principle, and the Galerkin method is implemented as the discretization scheme. Then, the model is verified by comparing its outcome to results presented in the literature. Finally, a parametric study is conducted to reveal the effect of different parameters, i.e., the absorber's location and coefficients' values, excitation frequency, geometric tapering, and material grading on the non-reflective traveling wave response of the beam. The results reveal that traveling waves and their quality are strongly dependent on these parameters. In addition, this study suggests that adopting a single spring-damper system within the span of the beam as the wave reflection absorber may not address the entire bandwidth.


title: Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation

abstract: This paper introduces Hierarchical Diffusion Policy (HDP), a hierarchical agent for multi-task robotic manipulation. HDP factorises a manipulation policy into a hierarchical structure: a high-level task-planning agent which predicts a distant next-best end-effector pose (NBP), and a low-level goal-conditioned diffusion policy which generates optimal motion trajectories. The factorised policy representation allows HDP to tackle both long-horizon task planning while generating fine-grained low-level actions. To generate context-aware motion trajectories while satisfying robot kinematics constraints, we present a novel kinematics-aware goal-conditioned control agent, Robot Kinematics Diffuser (RK-Diffuser). Specifically, RK-Diffuser learns to generate both the end-effector pose and joint position trajectories, and distill the accurate but kinematics-unaware end-effector pose diffuser to the kinematics-aware but less accurate joint position diffuser via differentiable kinematics. Empirically, we show that HDP achieves a significantly higher success rate than the state-of-the-art methods in both simulation and real-world.


title: Joint multi-task learning improves weakly-supervised biomarker prediction in computational pathology

abstract: Deep Learning (DL) can predict biomarkers directly from digitized cancer histology in a weakly-supervised setting. Recently, the prediction of continuous biomarkers through regression-based DL has seen an increasing interest. Nonetheless, clinical decision making often requires a categorical outcome. Consequently, we developed a weakly-supervised joint multi-task Transformer architecture which has been trained and evaluated on four public patient cohorts for the prediction of two key predictive biomarkers, microsatellite instability (MSI) and homologous recombination deficiency (HRD), trained with auxiliary regression tasks related to the tumor microenvironment. Moreover, we perform a comprehensive benchmark of 16 approaches of task balancing for weakly-supervised joint multi-task learning in computational pathology. Using our novel approach, we improve over the state-of-the-art area under the receiver operating characteristic by +7.7% and +4.1%, as well as yielding better clustering of latent embeddings by +8% and +5% for the prediction of MSI and HRD in external cohorts, respectively.


title: Polynomial extension of stronger central set theorem near zero

abstract: Furstenberg introduced the notion of Central sets in 1981. Later in 1990 V. Bergelson and N. Hindman proved a different but an equivalent version of the central set theorem. In 2008 D. De, N. Hindman and D. Strauss proved a stronger version of central sets theorem. Hindman and Leader first introduced the concept of near zero. Recently S. Goswami, L. Baglini and S. Patra did a polynomial extension of Stronger Central sets theorem in 2023. In this article, we proved the Polynomial stronger Central Sets Theorem near zero.


title: From One to Many: Expanding the Scope of Toxicity Mitigation in Language Models

abstract: To date, toxicity mitigation in language models has almost entirely been focused on single-language settings. As language models embrace multilingual capabilities, it's crucial our safety measures keep pace. Recognizing this research gap, our approach expands the scope of conventional toxicity mitigation to address the complexities presented by multiple languages. In the absence of sufficient annotated datasets across languages, we employ translated data to evaluate and enhance our mitigation techniques. We also compare finetuning mitigation approaches against retrieval-augmented techniques under both static and continual toxicity mitigation scenarios. This allows us to examine the effects of translation quality and the cross-lingual transfer on toxicity mitigation. We also explore how model size and data quantity affect the success of these mitigation efforts. Covering nine languages, our study represents a broad array of linguistic families and levels of resource availability, ranging from high to mid-resource languages. Through comprehensive experiments, we provide insights into the complexities of multilingual toxicity mitigation, offering valuable insights and paving the way for future research in this increasingly important field. Code and data are available at https://github.com/for-ai/goodtriever.


title: IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generators

abstract: Code understanding and generation have fast become some of the most popular applications of language models (LMs). Nonetheless, research on multilingual aspects of Code-LMs (i.e., LMs for code generation) such as cross-lingual transfer between different programming languages, language-specific data augmentation, and post-hoc LM adaptation, alongside exploitation of data sources other than the original textual content, has been much sparser than for their natural language counterparts. In particular, most mainstream Code-LMs have been pre-trained on source code files alone. In this work, we investigate the prospect of leveraging readily available compiler intermediate representations (IR) - shared across programming languages - to improve the multilingual capabilities of Code-LMs and facilitate cross-lingual transfer. To this end, we first compile SLTrans, a parallel dataset consisting of nearly 4M self-contained source code files coupled with respective intermediate representations. Next, starting from various base Code-LMs (ranging in size from 1.1B to 7.3B parameters), we carry out continued causal language modelling training on SLTrans, forcing the Code-LMs to (1) learn the IR language and (2) align the IR constructs with respective constructs of various programming languages. Our resulting models, dubbed IRCoder, display sizeable and consistent gains across a wide variety of code generation tasks and metrics, including prompt robustness, multilingual code completion, code understanding, and instruction following.


title: The Lanczos Tau Framework for Time-Delay Systems: Pad\'e Approximation and Collocation Revisited

abstract: We reformulate the Lanczos tau method for the discretization of time-delay systems in terms of a pencil of operators, allowing for new insights into this approach. As a first main result, we show that, for the choice of a shifted Legendre basis, this method is equivalent to Pad\'e approximation in the frequency domain. We illustrate that Lanczos tau methods straightforwardly give rise to sparse, self nesting discretizations. Equivalence is also demonstrated with pseudospectral collocation, where the non-zero collocation points are chosen as the zeroes of orthogonal polynomials. The importance of such a choice manifests itself in the approximation of the $H^2$-norm, where, under mild conditions, super-geometric convergence is observed and, for a special case, super convergence is proved; both significantly faster than the algebraic convergence reported in previous work.


title: DART: Implicit Doppler Tomography for Radar Novel View Synthesis

abstract: Simulation is an invaluable tool for radio-frequency system designers that enables rapid prototyping of various algorithms for imaging, target detection, classification, and tracking. However, simulating realistic radar scans is a challenging task that requires an accurate model of the scene, radio frequency material properties, and a corresponding radar synthesis function. Rather than specifying these models explicitly, we propose DART - Doppler Aided Radar Tomography, a Neural Radiance Field-inspired method which uses radar-specific physics to create a reflectance and transmittance-based rendering pipeline for range-Doppler images. We then evaluate DART by constructing a custom data collection platform and collecting a novel radar dataset together with accurate position and instantaneous velocity measurements from lidar-based localization. In comparison to state-of-the-art baselines, DART synthesizes superior radar range-Doppler images from novel views across all datasets and additionally can be used to generate high quality tomographic images.


title: Fuzzing BusyBox: Leveraging LLM and Crash Reuse for Embedded Bug Unearthing

abstract: BusyBox, an open-source software bundling over 300 essential Linux commands into a single executable, is ubiquitous in Linux-based embedded devices. Vulnerabilities in BusyBox can have far-reaching consequences, affecting a wide array of devices. This research, driven by the extensive use of BusyBox, delved into its analysis. The study revealed the prevalence of older BusyBox versions in real-world embedded products, prompting us to conduct fuzz testing on BusyBox. Fuzzing, a pivotal software testing method, aims to induce crashes that are subsequently scrutinized to uncover vulnerabilities. Within this study, we introduce two techniques to fortify software testing. The first technique enhances fuzzing by leveraging Large Language Models (LLM) to generate target-specific initial seeds. Our study showed a substantial increase in crashes when using LLM-generated initial seeds, highlighting the potential of LLM to efficiently tackle the typically labor-intensive task of generating target-specific initial seeds. The second technique involves repurposing previously acquired crash data from similar fuzzed targets before initiating fuzzing on a new target. This approach streamlines the time-consuming fuzz testing process by providing crash data directly to the new target before commencing fuzzing. We successfully identified crashes in the latest BusyBox target without conducting traditional fuzzing, emphasizing the effectiveness of LLM and crash reuse techniques in enhancing software testing and improving vulnerability detection in embedded systems. Additionally, manual triaging was performed to identify the nature of crashes in the latest BusyBox.


title: Electrical Load Forecasting Model Using Hybrid LSTM Neural Networks with Online Correction

abstract: Accurate electrical load forecasting is of great importance for the efficient operation and control of modern power systems. In this work, a hybrid long short-term memory (LSTM)-based model with online correction is developed for day-ahead electrical load forecasting. Firstly, four types of features are extracted from the original electrical load dataset, including the historical time series, time index features, historical statistical features, and similarity features. Then, a hybrid LSTM-based electrical load forecasting model is designed, where an LSTM neural network block and a fully-connected neural network block are integrated that can model both temporal features (historical time series) and non-temporal features (the rest features). A gradient regularization-based offline training algorithm and an output layer parameter fine-tuning-based online model correction method are developed to enhance the model's capabilities to defend against disturbance and adapt to the latest load data distribution, thus improving the forecasting accuracy. At last, extensive experiments are carried out to validate the effectiveness of the proposed electrical load forecasting strategy with superior accuracy compared with commonly used forecasting models.


title: Magnetoconvection in a Long Vertical Enclosure With Walls of Finite Electrical Conductivity

abstract: Magnetoconvection in a tall vertical box with vertical hot and cold walls, and an imposed steady uniform magnetic field perpendicular to the temperature gradient, is analyzed numerically. The geometry and the values of the non-dimensional parameters - the Prandtl number of 0.025, the Rayleigh number of $7.5 \times 10^5$, and the Hartmann number between 0 and 798 - match those of an earlier experiment. A parametric study of the effect of wall electric conductivity, across a wide range of conductance ratio values, on flow properties is performed. Two configurations of electric boundary conditions are explored. In one configuration, all walls have finite electric conductivity, while in the other, only the walls with constant temperature are electrically conducting. The flows are analyzed using their integral properties and distributions of velocity, temperature, and electric currents. It is found that, in general, the convection flow is suppressed by the magnetic field. However, this effect is strongly modified by the wall's electric conductivity and is markedly different for the two wall configurations. The associated changes in flow structure, rate of heat transfer, and flow's kinetic energy are revealed. It is also shown that the assumption of quasi-two-dimensionality may not be valid under some conditions, even at high Hartmann numbers.


title: Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models

abstract: Sequential recommendation aims to estimate the dynamic user preferences and sequential dependencies among historical user behaviors. Although Transformer-based models have proven to be effective for sequential recommendation, they suffer from the inference inefficiency problem stemming from the quadratic computational complexity of attention operators, especially for long-range behavior sequences. Inspired by the recent success of state space models (SSMs), we propose Mamba4Rec, which is the first work to explore the potential of selective SSMs for efficient sequential recommendation. Built upon the basic Mamba block which is a selective SSM with an efficient hardware-aware parallel algorithm, we incorporate a series of sequential modeling techniques to further promote the model performance and meanwhile maintain the inference efficiency. Experiments on two public datasets demonstrate that Mamba4Rec is able to well address the effectiveness-efficiency dilemma, and defeat both RNN- and attention-based baselines in terms of both effectiveness and efficiency.


title: A notion of $s$-fractional mass for $1$-currents in higher codimension

abstract: In this paper we propose a notion of $s$-fractional mass for $1$-currents in $\R^d$. Such a notion generalizes the notion of $s$-fractional perimeters for sets in the plane to higher codimension one-dimensional singularities. Remarkably, the limit as $s\to 1$ of the $s$-fractional mass gives back the classical notion of length for regular enough curves in $\R^d$. We prove a lower semi-continuity and compactness result for sequences of $1$-currents with uniformly bounded fractional mass and support. Moreover, we prove the density of weighted polygonal, closed and compact oriented curves in the class of divergence-free 1-currents with compact support and finite fractional mass. Finally, we discuss some possible applications of our notion of fractional mass to build up purely geometrical approaches to the variational modeling of dislocation lines in crystals and to vortex filaments in superconductivity.


title: An elementary approach to quantum length of SLE

abstract: We present an elementary proof establishing the equality of the right and left-sided $\sqrt{\kappa}$-quantum lengths for an SLE$_\kappa$ curve, where $\kappa\in (0,4]$. We achieve this by demonstrating that the$\sqrt{\kappa}$-quantum length is equal to the $(\sqrt{\kappa}/2)$-Gaussian multiplicative chaos with reference measure given by half the conformal Minkowski content of the curve, multiplied by $2/(4-\kappa)$ for $\kappa\in (0,4)$ and by $1$ for $\kappa=4$. Our proof relies on a novel "one-sided" approximation of the conformal Minkowski content, which is compatible with the conformal change of coordinates formula.


title: Challenges of Processing Data Clumps within Plugin Architectures of Integrated Development Environment

abstract: In this study, we explore advanced strategies for enhancing software quality by detecting and refactoring data clumps, special types of code smells. Our approach transcends the capabilities of integrated development environments, utilizing a novel method that separates the detection of data clumps from the source access. This method facilitates data clump processing. We introduce a command-line interface plugin to support this novel method of processing data clumps. This research highlights the efficacy of modularized algorithms and advocates their integration into continuous workflows, promising enhanced code quality and efficient project management across various programming and integrated development environments.


title: Topological spaces satisfying a closed graph theorem

abstract: We discuss topological versions of the closed graph theorem, where continuity is inferred from near continuity in tandem with suitable conditions on source or target spaces. We seek internal characterizations of spaces satisfying a closed graph theorem, and we compare closed graph and open mapping spaces.


title: Black-Box $k$-to-$1$-PCA Reductions: Theory and Applications

abstract: The $k$-principal component analysis ($k$-PCA) problem is a fundamental algorithmic primitive that is widely-used in data analysis and dimensionality reduction applications. In statistical settings, the goal of $k$-PCA is to identify a top eigenspace of the covariance matrix of a distribution, which we only have black-box access to via samples. Motivated by these settings, we analyze black-box deflation methods as a framework for designing $k$-PCA algorithms, where we model access to the unknown target matrix via a black-box $1$-PCA oracle which returns an approximate top eigenvector, under two popular notions of approximation. Despite being arguably the most natural reduction-based approach to $k$-PCA algorithm design, such black-box methods, which recursively call a $1$-PCA oracle $k$ times, were previously poorly-understood. Our main contribution is significantly sharper bounds on the approximation parameter degradation of deflation methods for $k$-PCA. For a quadratic form notion of approximation we term ePCA (energy PCA), we show deflation methods suffer no parameter loss. For an alternative well-studied approximation notion we term cPCA (correlation PCA), we tightly characterize the parameter regimes where deflation methods are feasible. Moreover, we show that in all feasible regimes, $k$-cPCA deflation algorithms suffer no asymptotic parameter loss for any constant $k$. We apply our framework to obtain state-of-the-art $k$-PCA algorithms robust to dataset contamination, improving prior work in sample complexity by a $\mathsf{poly}(k)$ factor.


title: On HTLC-Based Protocols for Multi-Party Cross-Chain Swaps

abstract: In his 2018 paper, Herlihy introduced an atomic protocol for multi-party asset swaps across different blockchains. His model represents an asset swap by a directed graph whose nodes are the participating parties and edges represent asset transfers, and rational behavior of the participants is captured by a preference relation between a protocol's outcomes. Asset transfers between parties are achieved using smart contracts. These smart contracts are quite involved and they require storage and processing of a large number of paths in the swap digraph, limiting practical significance of his protocol. His paper also describes a different protocol that uses only standard hash time-lock contracts (HTLC's), but this simpler protocol applies only to some special types of digraphs. He left open the question whether there is a simple and efficient protocol for cross-chain asset swaps in arbitrary digraphs. Motivated by this open problem, we conducted a comprehensive study of \emph{HTLC-based protocols}, in which all asset transfers are implemented with HTLCs. Our main contribution is a full characterization of swap digraphs that have such protocols.


title: The gonality of chess graphs

abstract: Chess graphs encode the moves that a particular chess piece can make on an $m\times n$ chessboard. We study through these graphs through the lens of chip-firing games and graph gonality. We provide upper and lower bounds for the gonality of king's, bishop's, and knight's graphs, as well as for the toroidal versions of these graphs. We also prove that among all chess graphs, there exists an upper bound on gonality solely in terms of $\min\{m,n\}$, except for queen's, toroidal queen's, rook's, and toroidal bishop's graphs.


title: EPOCHS IV: SED Modelling Assumptions and their impact on the Stellar Mass Function at 6.5 < z < 13.5 using PEARLS and public JWST observations

abstract: We utilize deep JWST NIRCam observations for the first direct constraints on the Galaxy Stellar Mass Function (GSMF) at z>10. Our EPOCHS v1 sample includes 1120 galaxy candidates at 6.5<z<13.5 taken from a consistent reduction and analysis of publicly available deep JWST NIRCam data covering the PEARLS, CEERS, GLASS, JADES GOOD-S, NGDEEP, and SMACS0723 surveys, totalling 187 arcmin2. We investigate the impact of SED fitting methods, assumed star formation histories (SFH), dust laws, and priors on galaxy masses and the resultant GSMF. Whilst our fiducial GSMF agrees with the literature at z<13.5, we find that the assumed SFH model has a large impact on the GSMF and stellar mass density (SMD), finding a 0.75 dex increase in the SMD at z=10.5 between a flexible non-parametric and standard parametric SFH. Overall, we find a flatter SMD evolution at z > 9 than some studies predict, suggesting a rapid buildup of stellar mass in the early Universe. We find no incompatibility between our results and those of standard cosmological models, as suggested previously, although the most massive galaxies may require a high star formation efficiency. We find that the 'Little Red Dot' galaxies dominate the z=7 GSMF at high-masses, necessitating a better understanding of the relative contributions of AGN and stellar emission. We show that assuming a theoretically motivated top-heavy IMF reduces stellar mass by 0.5 dex without affecting fit quality, but our results remain consistent with existing cosmological models with a standard IMF.


title: A Measure for Transparent Comparison of Linguistic Diversity in Multilingual NLP Data Sets

abstract: Typologically diverse benchmarks are increasingly created to track the progress achieved in multilingual NLP. Linguistic diversity of these data sets is typically measured as the number of languages or language families included in the sample, but such measures do not consider structural properties of the included languages. In this paper, we propose assessing linguistic diversity of a data set against a reference language sample as a means of maximising linguistic diversity in the long run. We represent languages as sets of features and apply a version of the Jaccard index suitable for comparing sets of measures. In addition to the features extracted from typological data bases, we propose an automatic text-based measure, which can be used as a means of overcoming the well-known problem of data sparsity in manually collected features. Our diversity score is interpretable in terms of linguistic features and can identify the types of languages that are not represented in a data set. Using our method, we analyse a range of popular multilingual data sets (UD, Bible100, mBERT, XTREME, XGLUE, XNLI, XCOPA, TyDiQA, XQuAD). In addition to ranking these data sets, we find, for example, that (poly)synthetic languages are missing in almost all of them.


title: A Unified Model for Active Battery Equalization Systems

abstract: Lithium-ion battery packs demand effective active equalization systems to enhance their usable capacity and lifetime. Despite numerous topologies and control schemes proposed in the literature, conducting quantitative analyses, comprehensive comparisons, and systematic optimization of their performance remains challenging due to the absence of a unified mathematical model at the pack level. To address this gap, we introduce a novel, hypergraph-based approach to establish the first unified model for various active battery equalization systems. This model reveals the intrinsic relationship between battery cells and equalizers by representing them as the vertices and hyperedges of hypergraphs, respectively. With the developed model, we identify the necessary condition for all equalization systems to achieve balance through controllability analysis, offering valuable insights for selecting the number of equalizers. Moreover, we prove that the battery equalization time is inversely correlated with the second smallest eigenvalue of the hypergraph's Laplacian matrix of each equalization system. This significantly simplifies the selection and optimized design of equalization systems, obviating the need for extensive experiments or simulations to derive the equalization time. Illustrative results demonstrate the efficiency of the proposed model and validate our findings.


title: Electron correlations in the kagome flat band metal $\rm CsCr_3Sb_5$

abstract: Kagome metals offer a unique platform for investigating robust electron-correlation effects because of their lattice geometry, flat bands and multi-orbital nature. In the cases with active flat bands, recent theoretical studies have pointed to a rich phase diagram that contains not only electronic orders but also quantum criticality. $\rm CsCr_3Sb_5$ has emerged as a strong candidate for exploring such new physics. Here, using effective tight-binding models obtained from ab initio calculations, we study the effects of electronic correlations and symmetries on the electronic structure of $\rm CsCr_3 Sb_5$. The effective tight-binding model and Fermi surface comprise multiple Cr-$d$ orbitals and Sb-$p$ orbitals. The introduction of Hubbard-Kanamori interactions leads to orbital-selective band renormalization dominated by the $d_{xz}$ band, concurrently producing emergent flat bands very close to the Fermi level. Our analysis sets the stage for further investigations into the electronic properties of $\rm CsCr_3Sb_5$, including electronic orders, quantum criticality and unconventional superconductivity, which promise to shed much new light into the electronic materials with frustrated lattices and bring about new connections with the correlation physics of a variety of strongly correlated systems.


title: Digamma function and general Fischer series in the theory of Kempner sums

abstract: The harmonic sum of the integers which are missing $p$ given digits in a base $b$ is expressed as $b\log(b)/p$ plus corrections indexed by the excluded digits and expressed as integrals involving the digamma function and a suitable measure. A number of consequences are derived, such as explicit bounds, monotony, series representations and asymptotic expansions involving the zeta values at integers, and suitable moments of the measure. In the classic Kempner case of $b=10$ and $9$ as the only excluded digit, the series representation turns out to be exactly identical with a result obtained by Fischer already in 1993. Extending this work is indeed the goal of the present contribution.


title: Multipolar opinion evolution in biased networks

abstract: Motivated by empirical research on bias and opinion formation, we formulate a multidimensional nonlinear opinion-dynamical model where agents have individual biases, which are fixed, as well as opinions, which evolve. The dimensions represent competing options, of which each agent has a relative opinion, and are coupled through normalization of the opinion vector. This can capture, for example, an individual's relative trust in different media. In special cases including where biases are uniform across agents our model achieves consensus, but in general, behaviors are richer and capture multipolar opinion distributions. We examine general fixed points of the system, as well as special cases such as zero biases toward certain options or partitioned decision sets. Lastly, we demonstrate that our model exhibits polarization when biases are spatially correlated across the network, while, as empirical research suggests, a mixed community can mediate biases.


title: Effect of Uncorrelated On-site Scalar Potential and Mass Disorder on Transport of Two-Dimensional Dirac Fermions

abstract: We investigate the transport properties of massive Dirac fermions subjected to uncorrelated scalar potential disorder, and mass disorder. Using a finite difference method, the conductance is calculated for a wide variety of combinations of these two disorder strengths. By calculating the scaling of conductivity with system size we find that, depending on the combination, the system can have an insulating, scale invariant, and metallic behavior. We identify the critical values of these disorder strengths where the phase transitions occur. We study both the zero and nonzero average mass cases to examine the effect of scalar potential disorder on band gap. Our results suggest a suppression of the band gap by the scalar potential disorder.


title: Risk-Sensitive Mean Field Games with Common Noise: A Theoretical Study with Applications to Interbank Markets

abstract: In this paper, we address linear-quadratic-Gaussian (LQG) risk-sensitive mean field games (MFGs) with common noise. In this framework agents are exposed to a common noise and aim to minimize an exponential cost functional that reflects their risk sensitivity. We leverage the convex analysis method to derive the optimal strategies of agents in the limit as the number of agents goes to infinity. These strategies yield a Nash equilibrium for the limiting model. The model is then applied to interbank markets, focusing on optimizing lending and borrowing activities to assess systemic and individual bank risks when reserves drop below a critical threshold. We employ Fokker-Planck equations and the first hitting time method to formulate the overall probability of a bank or market default. We observe that the risk-averse behavior of agents reduces the probability of individual defaults and systemic risk, enhancing the resilience of the financial system. Adopting a similar approach based on stochastic Fokker-Planck equations, we further expand our analysis to investigate the conditional probabilities of individual default under specific trajectories of the common market shock.

categories: math.OC cs.SY eess.SY math.PR q-fin.MF q-fin.RM


title: Recent Developments within The Cosmic Ray Extremely Distributed Observatory (CREDO)

abstract: This contribution presents the recent research developments within the Cosmic Ray Extremely Distributed Observatory (CREDO) in the search for resolution of various scientific puzzles, ranging from fundamental physical questions to applications like the determination of earthquake precursors. The state-of-the art theoretical, numerical and computational aspects of these phenomena are addressed, as well as recent experimental developments for detection.


title: On wen knots

abstract: We introduce the notion of wen knots, and prove that the set of wen knots is a proper subset of the set of extended welded knots. Furthermore we prove that the complementary subset consists of welded knots up to horizontal mirror reflections. This allow us to characterise completely extended welded knots by the parity of their number of wens, that we can always reduce to 0 or 1.


title: The Geochemical Potential for Metabolic Processes on the Sub-Neptune Exoplanet K2-18b

abstract: Quantifying disequilibria is important to understand whether an environment could be habitable. It has been proposed that the exoplanet K2-18b has a hydrogen-rich atmosphere and a water ocean, making it a "hycean world". The James Webb Space Telescope recently made measurements of methane, CO$_2$, and possibly dimethyl sulfide (DMS) in the atmosphere of this planet. The initial interpretation of these data is that they may support the occurrence of hycean conditions. Here, I attempt to take a next step in exploring the prospects for habitability. I use constraints on the abundances of atmospheric gases to calculate how much chemical disequilibrium there could be, assuming K2-18b is a hycean world. I find that the presence of oxidized carbon species coexisting with abundant H$_2$ (1-1000 bar) at cool to warm (25-120{\deg}C) conditions creates a strong thermodynamic drive for methanogenesis. More than ~75 kJ (mol C)$^{-1}$ of free energy can be released from CO$_2$ hydrogenation. Partially oxidized carbon compounds such as DMS (if present) also have potential to provide metabolic energy, albeit in smaller quantities. Because of the thermodynamic instability of CO$_2$ under hycean conditions, other reductive reactions of CO$_2$ are likely to be favored, including the synthesis of amino acids. Glycine and alanine synthesis can be energy-releasing or at least much less costly on K2-18b than in Earth's ocean, even when NH$_3$ is scarce but not totally absent. These first bioenergetic calculations for a proposed ocean-bearing exoplanet lay new groundwork for assessing exoplanetary habitability.


title: Multi-parameter quantum estimation of single- and two-mode pure Gaussian states

abstract: We discuss the ultimate precision bounds on the multiparameter estimation of single- and two-mode pure Gaussian states. By leveraging on previous approaches that focused on the estimation of a complex displacement only, we derive the Holevo Cram\'er-Rao bound (HCRB) for both displacement and squeezing parameter characterizing single and two-mode squeezed states. In the single-mode scenario, we obtain an analytical bound and find that it degrades monotonically as the squeezing increases. Furthermore, we prove that heterodyne detection is nearly optimal in the large squeezing limit, but in general the optimal measurement must include non-Gaussian resources. On the other hand, in the two-mode setting, the HCRB improves as the squeezing parameter grows and we show that it can be attained using double-homodyne detection.


title: Enhancing Instructional Quality: Leveraging Computer-Assisted Textual Analysis to Generate In-Depth Insights from Educational Artifacts

abstract: This paper explores the transformative potential of computer-assisted textual analysis in enhancing instructional quality through in-depth insights from educational artifacts. We integrate Richard Elmore's Instructional Core Framework to examine how artificial intelligence (AI) and machine learning (ML) methods, particularly natural language processing (NLP), can analyze educational content, teacher discourse, and student responses to foster instructional improvement. Through a comprehensive review and case studies within the Instructional Core Framework, we identify key areas where AI/ML integration offers significant advantages, including teacher coaching, student support, and content development. We unveil patterns that indicate AI/ML not only streamlines administrative tasks but also introduces novel pathways for personalized learning, providing actionable feedback for educators and contributing to a richer understanding of instructional dynamics. This paper emphasizes the importance of aligning AI/ML technologies with pedagogical goals to realize their full potential in educational settings, advocating for a balanced approach that considers ethical considerations, data quality, and the integration of human expertise.


title: Zero forcing irredundant sets

abstract: Irredundance has been studied in the context of dominating sets, via the concept of private neighbor. Here irredundance of zero forcing sets is introduced via the concept of a private fort and the upper and lower zero forcing irrdedundance numbers $\mbox{ZIR}(G)$ and $\mbox{zir}(G)$ are defined. Bounds on $\mbox{ZIR}(G)$ and $\mbox{zir}(G)$ are established and graphs having extreme values of $\mbox{ZIR}(G)$ and $\mbox{zir}(G)$ are characterized. The effect of the join and corona operations is studied. As the concept of a zero forcing irrdedundant set is new, there are many questions for future research.


title: Collision Cascade-Driven Evolution of Vacancy Defects in Ni-Based Concentrated Solid-Solution Alloys

abstract: Concentrated solid--solution alloys (CSAs) in single--phase form have recently garnered considerable attention owing to their potential for exceptional irradiation resistance. This computational study delves into the intricate interplay of alloying elements on the generation, recombination, and evolution of irradiation-induced defects. Molecular dynamics simulations were conducted for collision cascades at room temperature, spanning a range of primary knock-on atom energies from 1 to 10 keV. The investigation encompasses a series of model crystals, progressing from pure Ni to binary CSAs such as NiFe$_{20}$, NiFe, NiCr$_{20}$, and culminating in the more intricate NiFeCr$_{20}$ CSA. We observe that materials rich in chromium actively facilitate dislocation emissions and induce the nucleation of stacking fault tetrahedra in the proximity of nanovoids, owing to Shockley partial interactions. This result is validated by molecular static simulations, which calculate the surface, vacancy, and defect formation energies. Among various shapes considered, the spherical void proves to be the most stable, followed by the truncated octahedron and octahedron shapes. On the other hand, the tetrahedron cubic shape is identified as the most unstable, and stacking fault tetrahedra exhibit the highest formation energy. Notably, among the materials studied, NiCr$_{20}$ and NiFeCr$_{20}$ CSAs stood out as the sole alloys capable of manifesting this mechanism, mainly observed at high impact energies.


title: Did Translation Models Get More Robust Without Anyone Even Noticing?

abstract: Neural machine translation (MT) models achieve strong results across a variety of settings, but it is widely believed that they are highly sensitive to "noisy" inputs, such as spelling errors, abbreviations, and other formatting issues. In this paper, we revisit this insight in light of recent multilingual MT models and large language models (LLMs) applied to machine translation. Somewhat surprisingly, we show through controlled experiments that these models are far more robust to many kinds of noise than previous models, even when they perform similarly on clean data. This is notable because, even though LLMs have more parameters and more complex training processes than past models, none of the open ones we consider use any techniques specifically designed to encourage robustness. Next, we show that similar trends hold for social media translation experiments -- LLMs are more robust to social media text. We include an analysis of the circumstances in which source correction techniques can be used to mitigate the effects of noise. Altogether, we show that robustness to many types of noise has increased.


title: Relaxation of maximally entangled quantum states of two nonequivalent nuclear spins in a liquid

abstract: We investigate both experimentally and theoretically the relaxation of pseudo-pure maximally entangled states (Bell states) of two nuclear spins 1H-13C belonging to a molecule in a liquid. The Bell states are obtained by a method based on a detuned Hartmann-Hahn cross-polarization condition. Their entangled character is verified by quantum-state tomography. Our relaxation measurements reveal different relaxation rates for different Bell states. We interpret this difference as originating from cross-correlations between different relaxation mechanisms, thereby demonstrating that the measurements of the differential relaxation of Bell states are potentially useful for advanced NMR characterization of liquids.


title: Consciousness qua Mortal Computation

abstract: Computational functionalism posits that consciousness is a computation. Here we show, perhaps surprisingly, that it cannot be a Turing computation. Rather, computational functionalism implies that consciousness is a novel type of computation that has recently been proposed by Geoffrey Hinton, called mortal computation.


title: Order in disordered packings with and without permutation symmetry

abstract: A disordered solid, such as an athermal jammed packing of soft spheres, exists in a rugged potential-energy landscape in which there are a myriad of stable configurations that defy easy enumeration and characterization. Nevertheless, in three-dimensional monodisperse particle packings, we demonstrate an astonishing regularity in the distribution of basin volumes. The probability of landing randomly in a basin is proportional to its volume. Ordering the basins according to their probability, $P(n)$, from the largest at $n=1$ to smaller at larger $n$, we find approximately: $P(n) \propto n^{-1}$. This order, persisting up to the largest systems for which we can collect sufficient data, has implications for the dynamics of a system as it evolves under perturbations. In monodisperse packings there is ``permutation symmetry'' since identical particles can always be interchanged without affecting the system or its properties. Introducing any distribution of radii breaks this symmetry and leads to a proliferation of distinct configurations. We present an algorithm that partially restores permutation symmetry to such polydisperse packings.


title: Remarks on Diffeological Frobenius Reciprocity

abstract: A recent paper [R22] established "Frobenius reciprocity" as a bijection $t$ between certain symplectically reduced spaces (which need not be manifolds), and conjectured: 1{\deg}) $t$ is a diffeomorphism when these spaces are endowed with their natural subquotient diffeologies, 2{\deg}) $t$ respects the reduced diffeological $2$-forms they may (or might not) carry. In this paper, we prove both this conjecture and a similar one on prequantum reduction, and also give new sufficient conditions for the reduced forms to exist. We stop short of proving that they always exist.


title: Pattern preserving quasi-isometries in lamplighter groups and other related groups

abstract: In this paper we explore the interplay between aspects of the geometry and algebra of three families of groups of the form B semidirect the integers Z, namely Lamplighter groups, solvable Baumslag-Solitar groups and lattices in SOL. In particular we examine what kind of maps are induced on B by quasi-isometries that coarsely permute cosets of the Z subgroup. By the results of Schwartz(1996) and Taback(2000) in the lattice in SOL and solvable Baumslag-Solitar cases respectively such quasi-isometries induce affine maps of B. We show that this is no longer true in the lamplighter case but the induced maps do share some features with affine maps.


title: Extreme Precipitation Nowcasting using Transformer-based Generative Models

abstract: This paper presents an innovative approach to extreme precipitation nowcasting by employing Transformer-based generative models, namely NowcastingGPT with Extreme Value Loss (EVL) regularization. Leveraging a comprehensive dataset from the Royal Netherlands Meteorological Institute (KNMI), our study focuses on predicting short-term precipitation with high accuracy. We introduce a novel method for computing EVL without assuming fixed extreme representations, addressing the limitations of current models in capturing extreme weather events. We present both qualitative and quantitative analyses, demonstrating the superior performance of the proposed NowcastingGPT-EVL in generating accurate precipitation forecasts, especially when dealing with extreme precipitation events. The code is available at \url{https://github.com/Cmeo97/NowcastingGPT}.


title: Holographic thermal entropy from geodesic bit threads

abstract: The holographic bit threads are an insightful tool to investigate the holographic entanglement entropy and other quantities related to the bipartite entanglement in AdS/CFT. We mainly explore the geodesic bit threads in various static backgrounds, for the bipartitions characterized by either a sphere or an infinite strip. In pure AdS and for the sphere, the geodesic bit threads provide a gravitational dual of the map implementing the geometric action of the modular conjugation in the dual CFT. In Schwarzschild AdS black brane and for the sphere, our numerical analysis shows that the flux of the geodesic bit threads through the horizon gives the holographic thermal entropy of the sphere. This feature is not observed when the subsystem is an infinite strip, whenever we can construct the corresponding bit threads. The bit threads are also determined by the global structure of the gravitational background; indeed, for instance, we show that the geodesic bit threads of an arc in the BTZ black hole cannot be constructed.


title: Physical viability of traversable Finslerian wormholes with traceless fluid under conformal symmetry

abstract: The current study explores the novel potential of traversable wormhole solutions within the framework of Finsler geometry, incorporating conformal symmetry alongside traceless fluid dynamics. Using the Conformal Killing vector approach, we have discussed the wormholes based on traceless fluid within the intriguing framework of Finsler geometry. The field equations and the associated conformal factor are obtained specifically under the condition of conformal motion in Finsler geometry. Furthermore, we have successfully derived and examined the shape function, considering a range of values for the Finslerian parameter $\lambda$. Our investigation extends to fundamental physical characteristics such as proper radial distance, active mass function, and total gravitational energy, aiming to understand their influence on the traversability of the wormhole. The observation of energy condition violations provides evidence for the exotic matter's presence near the throat, reinforcing the assertion of the Finslerian wormhole's traversability.


title: Transition of type in the von Neumann algebras associated to the Connes-Marcolli $GSp_4$-system

abstract: We study different types of von Neumann algebras arising from the Connes-Marcolli $GSp_4$-system and show that a phase transition occurs at the level of these algebras. More precisely, we show that the type of these algebras transitions from type $I_\infty$ to type $III_1$, with this transition occurring precisely at the inverse temperature $\beta = 4$.


title: Polynomial Calculus sizes over the Boolean and Fourier bases are incomparable

abstract: For every $n >0$, we show the existence of a CNF tautology over $O(n^2)$ variables of width $O(\log n)$ such that it has a Polynomial Calculus Resolution refutation over $\{0,1\}$ variables of size $O(n^3polylog(n))$ but any Polynomial Calculus refutation over $\{+1,-1\}$ variables requires size $2^{\Omega(n)}$. This shows that Polynomial Calculus sizes over the $\{0,1\}$ and $\{+1,-1\}$ bases are incomparable (since Tseitin tautologies show a separation in the other direction) and answers an open problem posed by Sokolov [Sok20] and Razborov.


title: A Categorical Treatment of Open Linear Systems

abstract: An open stochastic system \`a la Willems is a system affected two qualitatively different kinds of uncertainty -- one is probabilistic fluctuation, and the other one is nondeterminism caused by lack of information. We give a formalization of open stochastic systems in the language of category theory. A new construction, which we term copartiality, is needed to model the propagating lack of information (which corresponds to varying sigma-algebras). As a concrete example, we discuss extended Gaussian distributions, which combine Gaussian probability with nondeterminism and correspond precisely to Willems' notion of Gaussian linear systems. We describe them both as measure-theoretic and abstract categorical entities, which enables us to rigorously describe a variety of phenomena like noisy physical laws and uninformative priors in Bayesian statistics. The category of extended Gaussian maps can be seen as a mutual generalization of Gaussian probability and linear relations, which connects the literature on categorical probability with ideas from control theory like signal-flow diagrams.


title: Demographic Dynamics and Artificial Intelligence: Challenges and Opportunities in Europe and Africa for 2050

abstract: This paper explores the complex relationship between demographics and artificial intelligence (AI) advances in Europe and Africa, projecting into the year 2050. The advancement of AI technologies has occurred at diverse rates, with Africa lagging behind Europe. Moreover, the imminent economic consequences of demographic shifts require a more careful examination of immigration patterns, with Africa emerging as a viable labor pool for European countries. However, within these dynamics, questions are raised about the differences in AI proficiency between African immigrants and Europeans by 2050. This paper examines demographic trends and AI developments to unravel insights into the multifaceted challenges and opportunities that lie ahead in the realms of technology, the economy, and society as we look ahead to 2050.


title: Non-resonant conditions for the Klein-Gordon equation on the circle

abstract: We consider the infinite dimensional vector of frequencies $\omega(m)=( \sqrt{j^2+m})_{j\in \mathbb{Z}}$, $m\in [1,2]$ arising form a linear Klein-Gordon equation on the one dimensional torus and prove that there exists a positive measure set of masses $m'$s for which $\omega(m)$ satisfies a diophantine condition similar to the one introduced by Bourgain in (JFA, 2005), in the context of Schr\"odinger equation with convolution potential. The main difficulties we have to deal with are the asymptotically linear nature of the (infinitely many) $\omega_{j}'$s and the degeneracy coming from having only one parameter at disposal for their modulation. As an application we provide estimates on the inverse of the adjoint action of the associated quadratic Hamiltonian on homogenenous polynomials of any degree in Gevrey category.


title: Settling the Competition Complexity of Additive Buyers over Independent Items

abstract: The competition complexity of an auction setting is the number of additional bidders needed such that the simple mechanism of selling items separately (with additional bidders) achieves greater revenue than the optimal but complex (randomized, prior-dependent, Bayesian-truthful) optimal mechanism without the additional bidders. Our main result settles the competition complexity of $n$ bidders with additive values over $m < n$ independent items at $\Theta(\sqrt{nm})$. The $O(\sqrt{nm})$ upper bound is due to [BW19], and our main result improves the prior lower bound of $\Omega(\ln n)$ to $\Omega(\sqrt{nm})$. Our main result follows from an explicit construction of a Bayesian IC auction for $n$ bidders with additive values over $m<n$ independent items drawn from the Equal Revenue curve truncated at $\sqrt{nm}$ ($\mathcal{ER}_{\le \sqrt{nm}}$), which achieves revenue that exceeds $\text{SRev}_{n+\sqrt{nm}}(\mathcal{ER}_{\le \sqrt{nm}}^m)$. Along the way, we show that the competition complexity of $n$ bidders with additive values over $m$ independent items is exactly equal to the minimum $c$ such that $\text{SRev}_{n+c}(\mathcal{ER}_{\le p}^m) \geq \text{Rev}_n(\mathcal{ER}_{\le p}^m)$ for all $p$ (that is, some truncated Equal Revenue witnesses the worst-case competition complexity). Interestingly, we also show that the untruncated Equal Revenue curve does not witness the worst-case competition complexity when $n > m$: $\text{SRev}_n(\mathcal{ER}^m) = nm+O_m(\ln (n)) \leq \text{SRev}_{n+O_m(\ln (n))}(\mathcal{ER}^m)$, and therefore our result can only follow by considering all possible truncations.


title: GUIDE: Guidance-based Incremental Learning with Diffusion Models

abstract: We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from a generative model. Such an approach contradicts buffer-based approaches where sampling strategy plays an important role. We propose to bridge this gap by incorporating classifier guidance into the diffusion process to produce rehearsal examples specifically targeting information forgotten by a continuously trained model. This approach enables the generation of samples from preceding task distributions, which are more likely to be misclassified in the context of recently encountered classes. Our experimental results show that GUIDE significantly reduces catastrophic forgetting, outperforming conventional random sampling approaches and surpassing recent state-of-the-art methods in continual learning with generative replay.


title: Subgroups arising from connected components in the Morse boundary

abstract: We study connected components of the Morse boundary and their stabilisers. We introduce the notion of point-convergence and show that if the set of non-singleton connected components of the Morse boundary of a finitely generated group $G$ is point-convergent, then every non-singleton connected component is the (relative) Morse boundary of its stabiliser. The above property only depends on the topology of the Morse boundary and hence is invariant under quasi-isometry. This shows that the topology of the Morse boundary not only carries algebraic information but can be used to detect certain subgroups which in some sense are invariant under quasi-isometry.


title: The large and moderate deviations approach in geometric functional analysis

abstract: The work of Gantert, Kim, and Ramanan [Large deviations for random projections of $\ell^p$ balls, Ann. Probab. 45 (6B), 2017] has initiated and inspired a new direction of research in the asymptotic theory of geometric functional analysis. The moderate deviations perspective, describing the asymptotic behavior between the scale of a central limit theorem and a large deviations principle, was later added by Kabluchko, Prochno, and Th\"ale in [High-dimensional limit theorems for random vectors in $\ell_p^n$ balls. II, Commun. Contemp. Math. 23(3), 2021]. These two approaches nicely complement the classical study of central limit phenomena or non-asymptotic concentration bounds for high-dimensional random geometric quantities. Beyond studying large and moderate deviations principles for random geometric quantities that appear in geometric functional analysis, other ideas emerged from the theory of large deviations and the closely related field of statistical mechanics, and have provided new insight and become the origin for new developments. Within less than a decade, a variety of results have appeared and formed this direction of research. Recently, a connection to the famous Kannan-Lov\'asz-Simonovits conjecture and the study of moderate and large deviations for isotropic log-concave random vectors was discovered. In this manuscript, we introduce the basic principles, survey the work that has been done, and aim to manifest this direction of research, at the same time making it more accessible to a wider community of researchers.


title: Scalar curvature deformations with non-compact boundaries

abstract: We develop a general deformation principle for families of Riemannian metrics on smooth manifolds with possibly non-compact boundary, preserving lower scalar curvature bounds. The principle is used in order to strengthen boundary conditions, from mean convex to totally geodesic or doubling. The deformation principle preserves further geometric properties such as completeness and a given quasi-isometry type. As an application, we prove non-existence results for Riemannian metrics with (uniformly) positive scalar curvature and mean convex boundary.


title: The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models

abstract: Prior work has found that pretrained language models (LMs) fine-tuned with different random seeds can achieve similar in-domain performance but generalize differently on tests of syntactic generalization. In this work, we show that, even within a single model, we can find multiple subnetworks that perform similarly in-domain, but generalize vastly differently. To better understand these phenomena, we investigate if they can be understood in terms of "competing subnetworks": the model initially represents a variety of distinct algorithms, corresponding to different subnetworks, and generalization occurs when it ultimately converges to one. This explanation has been used to account for generalization in simple algorithmic tasks ("grokking"). Instead of finding competing subnetworks, we find that all subnetworks -- whether they generalize or not -- share a set of attention heads, which we refer to as the heuristic core. Further analysis suggests that these attention heads emerge early in training and compute shallow, non-generalizing features. The model learns to generalize by incorporating additional attention heads, which depend on the outputs of the "heuristic" heads to compute higher-level features. Overall, our results offer a more detailed picture of the mechanisms for syntactic generalization in pretrained LMs.


title: Separate and Detailed Treatment of Absolute Signal and Noise Enables NMR Under Adverse Circumstances

abstract: When deploying a spectrometer in an adverse environment, such as during a typical ODNP experiment or experiments that require low-volume low-field measurements, a clear and modern protocol for characterizing and quantifying the absolute signal and noise levels proves essential. This paper provides such a protocol. It also highlights the clarity and insight that comes from (1) discussing NMR signal intensities in (conserved) units of square root instantaneous power that are derived from a theory and notation developed initially for ESR spectroscopy; as well as (2) characterizing the spectral distribution of the noise. Crucially, the strategy introduced here applies not only to ODNP measurements, but to all low-field NMR. Low-field NMR offers immense flexibility: it enables integration with other instrumentation and deploys in practical applications not accessible to higher-field instrumentation. More generally, the protocol introduced here should apply to a wide range of instruments, and should prove especially useful in cases subject to design constraints that requires integration with multiple other modules that are not dedicated to NMR but that control other forms of spectroscopy or other crucial aspects of the measurement. However, in the specific case of ODNP, this protocol demonstrates that the absolute signal and noise level can be estimated from the clarified theory presented here, and uses that theory to identify the inefficient distribution of fields in the hairpin loop probe as the main remaining bottleneck for the improvement of low-field low-volume ODNP SNR.


title: MR.RGM: An R Package for Fitting Bayesian Multivariate Bidirectional Mendelian Randomization Networks

abstract: Motivation: Mendelian randomization (MR) infers causal relationships between exposures and outcomes using genetic variants as instrumental variables. Typically, MR considers only a pair of exposure and outcome at a time, limiting its capability of capturing the entire causal network. We overcome this limitation by developing 'MR.RGM' (Mendelian randomization via reciprocal graphical model), a fast R-package that implements the Bayesian reciprocal graphical model and enables practitioners to construct holistic causal networks with possibly cyclic/reciprocal causation and proper uncertainty quantifications, offering a comprehensive understanding of complex biological systems and their interconnections. Results: We developed 'MR.RGM', an open-source R package that applies bidirectional MR using a network-based strategy, enabling the exploration of causal relationships among multiple variables in complex biological systems. 'MR.RGM' holds the promise of unveiling intricate interactions and advancing our understanding of genetic networks, disease risks, and phenotypic complexities.


title: SPEAR:Exact Gradient Inversion of Batches in Federated Learning

abstract: Federated learning is a framework for collaborative machine learning where clients only share gradient updates and not their private data with a server. However, it was recently shown that gradient inversion attacks can reconstruct this data from the shared gradients. In the important honest-but-curious setting, existing attacks enable exact reconstruction only for a batch size of $b=1$, with larger batches permitting only approximate reconstruction. In this work, we propose SPEAR, the first algorithm reconstructing whole batches with $b >1$ exactly. SPEAR combines insights into the explicit low-rank structure of gradients with a sampling-based algorithm. Crucially, we leverage ReLU-induced gradient sparsity to precisely filter out large numbers of incorrect samples, making a final reconstruction step tractable. We provide an efficient GPU implementation for fully connected networks and show that it recovers high-dimensional ImageNet inputs in batches of up to $b \lesssim 25$ exactly while scaling to large networks. Finally, we show theoretically that much larger batches can be reconstructed with high probability given exponential time.