title: Data Fusion for Heterogeneous Treatment Effect Estimation with Multi-Task Gaussian Processes

abstract: Bridging the gap between internal and external validity is crucial for heterogeneous treatment effect estimation. Randomised controlled trials (RCTs), favoured for their internal validity due to randomisation, often encounter challenges in generalising findings due to strict eligibility criteria. Observational studies on the other hand, provide external validity advantages through larger and more representative samples but suffer from compromised internal validity due to unmeasured confounding. Motivated by these complementary characteristics, we propose a novel Bayesian nonparametric approach leveraging multi-task Gaussian processes to integrate data from both RCTs and observational studies. In particular, we introduce a parameter which controls the degree of borrowing between the datasets and prevents the observational dataset from dominating the estimation. The value of the parameter can be either user-set or chosen through a data-adaptive procedure. Our approach outperforms other methods in point predictions across the covariate support of the observational study, and furthermore provides a calibrated measure of uncertainty for the estimated treatment effects, which is crucial when extrapolating. We demonstrate the robust performance of our approach in diverse scenarios through multiple simulation studies and a real-world education randomised trial.


title: Optimized reinitialization based level-set method within industrial context

abstract: This paper presents a solver using the Level-Set method for incompressible two phase flows with surface tension. A one fluid approach is adopted where both phases share the same velocity and pressure field. The Level Set method has been coupled with the Ghost Fluid Method. An efficient and pragmatic solution is proposed to avoid interface displacement during the reinitialization of the level-Set fields. A solver called LSFoam has been implemented in the OpenFOAM framework with consistent Rhie & Chow interpolation. This solver has been tested on several test cases covering different scales and flow configurations: rising bubble test case, Rayleigh-Taylor instability simulations, Ogee spillway flow, 3D dambreak simulation with a square cylinder obstacle and KVLCC2 steady resistance calculations. Overall results are in excellent agreement with reference data and the present approach is very promising for moderate free surface deformations.


title: Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilities

abstract: In an era of rapidly advancing data-driven applications, there is a growing demand for data in both research and practice. Synthetic data have emerged as an alternative when no real data is available (e.g., due to privacy regulations). Synthesizing tabular data presents unique and complex challenges, especially handling (i) missing values, (ii) dataset imbalance, (iii) diverse column types, and (iv) complex data distributions, as well as preserving (i) column correlations, (ii) temporal dependencies, and (iii) integrity constraints (e.g., functional dependencies) present in the original dataset. While substantial progress has been made recently in the context of generational models, there is no one-size-fits-all solution for tabular data today, and choosing the right tool for a given task is therefore no trivial task. In this paper, we survey the state of the art in Tabular Data Synthesis (TDS), examine the needs of users by defining a set of functional and non-functional requirements, and compile the challenges associated with meeting those needs. In addition, we evaluate the reported performance of 36 popular research TDS tools about these requirements and develop a decision guide to help users find suitable TDS tools for their applications. The resulting decision guide also identifies significant research gaps.


title: Reiterated Periodic Homogenization of Parabolic Monotone Operators with Nonstandard Growth

abstract: In this paper, we are interested in reiterated periodic homogenization for a family of parabolic problems with nonstandard growth monotone operators leading to Orlicz spaces. The aim of this work is the determination of the global homogenized problem on the one hand and the macroscopic homogenized problem on the other hand, via the reiterated two-scale convergence method adapted to this type of spaces.


title: GGS-groups acting on trees of growing degrees

abstract: We consider analogues of Grigorchuk-Gupta-Sidki (GGS-)groups acting on trees of growing degree; the so-called growing GGS-groups. These groups are not just infinite and do not possess the congruence subgroup property, but many of them are branch and have the $p$-congruence subgroup property, for a prime $p$. Among them, we find groups with maximal subgroups only of finite index, and with infinitely many such maximal subgroups. These give the first examples of finitely generated branch groups with infinitely many finite-index maximal subgroups. Additionally, we prove that congruence quotients of growing GGS-groups associated to a defining vector of zero sum give rise to Beauville groups.


title: Large Language Models are Zero-Shot Next Location Predictors

abstract: Predicting the locations an individual will visit in the future is crucial for solving many societal issues like disease diffusion and reduction of pollution among many others. The models designed to tackle next-location prediction, however, require a significant amount of individual-level information to be trained effectively. Such data may be scarce or even unavailable in some geographic regions or peculiar scenarios (e.g., cold-start in recommendation systems). Moreover, the design of a next-location predictor able to generalize or geographically transfer knowledge is still an open research challenge. Recent advances in natural language processing have led to a rapid diffusion of Large Language Models (LLMs) which have shown good generalization and reasoning capabilities. These insights, coupled with the recent findings that LLMs are rich in geographical knowledge, allowed us to believe that these models can act as zero-shot next-location predictors. This paper evaluates the capabilities of many popular LLMs in this role, specifically Llama, GPT-3.5 and Mistral 7B. After designing a proper prompt, we tested the models on three real-world mobility datasets. The results show that LLMs can obtain accuracies up to 32.4%, a significant relative improvement of over 600% when compared to sophisticated DL models specifically designed for human mobility. Moreover, we show that other LLMs are unable to perform the task properly. To prevent positively biased results, we also propose a framework inspired by other studies to test data contamination. Finally, we explored the possibility of using LLMs as text-based explainers for next-location prediction showing that can effectively provide an explanation for their decision. Notably, 7B models provide more generic, but still reliable, explanations compared to larger counterparts. Code: github.com/ssai-trento/LLM-zero-shot-NL


title: Non-commutative Iwasawa theory of abelian varieties over global function fields

abstract: Let $A$ be an abelian variety defined over a global function field $F$. We investigate the structure of the $p$-primary Selmer group $\mathrm{Sel}(A/F_\infty)$ for any prime number $p$ distinct from the characteristic of $F$, over $p$-adic Lie extensions $F_\infty$ of $F$ which contain the cyclotomic $\mathbb{Z}_p$-extension $F^{\mathrm{cyc}}$. In particular, we prove that the Pontryagin dual of the Selmer group $\mathrm{Sel}(A/F^\mathrm{cyc})$ is a torsion $\mathbb{Z}_p[[\mathrm{Gal}(F^\mathrm{cyc}/F)]]$-module with trivial $\mu$-invariant, and we establish the $\mathfrak{M}_H(G)$-conjecture of Coates-Fukaya-Kato-Sujatha-Venjakob for $A/F_\infty$. In view of the validity of the $\mathfrak{M}_H(G)$-conjecture, it therefore makes sense to speak of the characteristic element (in the sense of Coates et al.) attached to the Pontryagin dual of $\mathrm{Sel}(A/F_\infty)$. We relate the order of vanishing of the characteristic elements, evaluated at Artin representations, to the corank of the Selmer group of the corresponding twist of $A$ over the base field $F$. Combining this with the deep results of Tate, Milne and Kato-Trihan, we show that the order of vanishing of the characteristic elements is equal to the order of vanishing of the $L$-function of $A/F$ at $s=1$ under appropriate assumptions. Finally, we relate the generalised Euler characteristic of $\mathrm{Sel}(A/F_\infty)$ to the Euler characteristic of $\mathrm{Sel}(A/F^{\mathrm{cyc}})$. This is a natural analogue of Zerbes' result in the number field context and generalises previous results of Sechi and Valentino in the function field context.


title: Profinite groups with soluble centralisers

abstract: We show that a profinite group, in which the centralisers of non-trivial elements are metabelian, is either virtually pro-$p$ or virtually soluble of derived length at most 4. We furthermore show that a prosoluble group, in which the centralisers of non-trivial elements are soluble of bounded derived length, is either soluble or virtually pro-$p$.


title: ZTF SN Ia DR2: Environmental dependencies of stretch and luminosity of a volume limited sample of 1,000 Type Ia Supernovae

abstract: To get distances, Type Ia Supernovae magnitudes are corrected for their correlation with lightcurve width and colour. Here we investigate how this standardisation is affected by the SN environment, with the aim to reduce scatter and improve standardisation. We first study the SN Ia stretch distribution, as well as its dependence on environment, as characterised by local and global (g-z) colour and stellar mass. We then look at the standardisation parameter $\alpha$, which accounts for the correlation between residuals and stretch, along with its environment dependence and linearity. We finally compute magnitude offsets between SNe in different astrophysical environments after colour and stretch standardisation, aka steps. This analysis is made possible due to the unprecedented statistics of the ZTF SN Ia DR2 volume-limited sample. The stretch distribution exhibits a bimodal behaviour, as previously found in literature. However, we find the distribution means to decrease with host stellar mass at a 9.0$\sigma$ significance. We demonstrate, at the 14.3$\sigma$ level, that the stretch-magnitude relation is non-linear, challenging the usual linear stretch-residuals relation. Fitting for a broken-$\alpha$ model, we indeed find two different slopes between stretch regimes ($x_1<-0.49\pm0.06$): $\alpha_{low}=0.28\pm0.01$ and $\alpha_{high}=0.09\pm0.01$, a $\Delta_{\alpha}=-0.19\pm0.01$ difference. As the relative proportion of SNe Ia in the high-/low-stretch modes evolves with redshift and environment, this implies that a linear $\alpha$ also evolves with redshift and environment. Concerning the environmental magnitude offset $\gamma$, we find it to be greater than 0.14 mag regardless of the considered environmental tracer used (local or global colour and stellar mass), all measured at the $\geq 6\sigma$ level, increased to $\sim0.18\pm0.01$ mag when accounting for the stretch-non linearity.


title: Black hole solutions surrounded by anisotropic fluid in $f(\mathbb{T},\CMcal{T})$ gravity

abstract: In this work, we investigate some extensions of the Kiselev black hole solutions in the context of $f(\mathbb{T},\CMcal{T})$ gravity. By mapping the components of the Kiselev energy-momentum tensor into the anisotropic energy-momentum tensor and assuming a particular form of $f(\mathbb{T},\CMcal{T})$, we obtain exact solutions for the field equation in this theory that carries dependence on the coupling constant and on the parameter of the equation of state of the fluid. We show that in this scenario of modified gravity some new structure is added to the geometry of spacetime as compared to the Kiselev black hole. We analyse the energy conditions, mass, horizons and the Hawking temperature considering particular values for the parameter of the equation of state.


title: Superlatives in Context: Explicit and Implicit Domain Restrictions for Superlative Frames

abstract: Superlatives are used to single out elements with a maximal/minimal property. Semantically, superlatives perform a set comparison: something (or some things) has the min/max property out of a set. As such, superlatives provide an ideal phenomenon for studying implicit phenomena and discourse restrictions. While this comparison set is often not explicitly defined, its (implicit) restrictions can be inferred from the discourse context the expression appears in. In this work we provide an extensive computational study on the semantics of superlatives. We propose a unified account of superlative semantics which allows us to derive a broad-coverage annotation schema. Using this unified schema we annotated a multi-domain dataset of superlatives and their semantic interpretations. We specifically focus on interpreting implicit or ambiguous superlative expressions, by analyzing how the discourse context restricts the set of interpretations. In a set of experiments we then analyze how well models perform at variations of predicting superlative semantics, with and without context. We show that the fine-grained semantics of superlatives in context can be challenging for contemporary models, including GPT-4.


title: A new multivariate primitive from CCZ equivalence

abstract: Multivariate Cryptography is one of the main candidates for Post-quantum Cryptography. Multivariate schemes are usually constructed by applying two secret affine invertible transformations $\mathcal S,\mathcal T$ to a set of multivariate polynomials $\mathcal{F}$ (often quadratic). The secret polynomials $\mathcal{F}$ posses a trapdoor that allows the legitimate user to find a solution of the corresponding system, while the public polynomials $\mathcal G=\mathcal S\circ\mathcal F\circ\mathcal T$ look like random polynomials. The polynomials $\mathcal G$ and $\mathcal F$ are said to be affine equivalent. In this article, we present a more general way of constructing a multivariate scheme by considering the CCZ equivalence, which has been introduced and studied in the context of vectorial Boolean functions.


title: Design, Calibration, and Control of Compliant Force-sensing Gripping Pads for Humanoid Robots

abstract: This paper introduces a pair of low-cost, light-weight and compliant force-sensing gripping pads used for manipulating box-like objects with smaller-sized humanoid robots. These pads measure normal gripping forces and center of pressure (CoP). A calibration method is developed to improve the CoP measurement accuracy. A hybrid force-alignment-position control framework is proposed to regulate the gripping forces and to ensure the surface alignment between the grippers and the object. Limit surface theory is incorporated as a contact friction modeling approach to determine the magnitude of gripping forces for slippage avoidance. The integrated hardware and software system is demonstrated with a NAO humanoid robot. Experiments show the effectiveness of the overall approach.


title: PUAL: A Classifier on Trifurcate Positive-Unlabeled Data

abstract: Positive-unlabeled (PU) learning aims to train a classifier using the data containing only labeled-positive instances and unlabeled instances. However, existing PU learning methods are generally hard to achieve satisfactory performance on trifurcate data, where the positive instances distribute on both sides of the negative instances. To address this issue, firstly we propose a PU classifier with asymmetric loss (PUAL), by introducing a structure of asymmetric loss on positive instances into the objective function of the global and local learning classifier. Then we develop a kernel-based algorithm to enable PUAL to obtain non-linear decision boundary. We show that, through experiments on both simulated and real-world datasets, PUAL can achieve satisfactory classification on trifurcate data.


title: Amortizing intractable inference in diffusion models for vision, language, and control

abstract: Diffusion models have emerged as effective distribution estimators in vision, language, and reinforcement learning, but their use as priors in downstream tasks poses an intractable posterior inference problem. This paper studies amortized sampling of the posterior over data, $\mathbf{x}\sim p^{\rm post}(\mathbf{x})\propto p(\mathbf{x})r(\mathbf{x})$, in a model that consists of a diffusion generative model prior $p(\mathbf{x})$ and a black-box constraint or likelihood function $r(\mathbf{x})$. We state and prove the asymptotic correctness of a data-free learning objective, relative trajectory balance, for training a diffusion model that samples from this posterior, a problem that existing methods solve only approximately or in restricted cases. Relative trajectory balance arises from the generative flow network perspective on diffusion models, which allows the use of deep reinforcement learning techniques to improve mode coverage. Experiments illustrate the broad potential of unbiased inference of arbitrary posteriors under diffusion priors: in vision (classifier guidance), language (infilling under a discrete diffusion LLM), and multimodal data (text-to-image generation). Beyond generative modeling, we apply relative trajectory balance to the problem of continuous control with a score-based behavior prior, achieving state-of-the-art results on benchmarks in offline reinforcement learning.


title: Congestion-Aware Path Re-routing Strategy for Dense Urban Airspace

abstract: Existing UAS Traffic Management (UTM) frameworks designate preplanned flight paths to uncrewed aircraft systems (UAS), enabling the UAS to deliver payloads. However, with increasing delivery demand between the source-destination pairs in the urban airspace, UAS will likely experience considerable congestion on the nominal paths. We propose a rule-based congestion mitigation strategy that improves UAS safety and airspace utilization in congested traffic streams. The strategy relies on nominal path information from the UTM and positional information of other UAS in the vicinity. Following the strategy, UAS opts for alternative local paths in the unoccupied airspace surrounding the nominal path and avoids congested regions. The strategy results in UAS traffic exploring and spreading to alternative adjacent routes on encountering congestion. The paper presents queuing models to estimate the expected traffic spread for varying stochastic delivery demand at the source, thus helping to reserve the airspace around the nominal path beforehand to accommodate any foreseen congestion. Simulations are presented to validate the queuing results in the presence of static obstacles and intersecting UAS streams.


title: LCQ: Low-Rank Codebook based Quantization for Large Language Models

abstract: Large language models~(LLMs) have recently demonstrated promising performance in many tasks. However, the high storage and computational cost of LLMs has become a challenge for deploying LLMs. Weight quantization has been widely used for model compression, which can reduce both storage and computational cost. Most existing weight quantization methods for LLMs use a rank-one codebook for quantization, which results in substantial accuracy loss when the compression ratio is high. In this paper, we propose a novel weight quantization method, called low-rank codebook based quantization~(LCQ), for LLMs. LCQ adopts a low-rank codebook, the rank of which can be larger than one, for quantization. Experiments show that LCQ can achieve better accuracy than existing methods with a negligibly extra storage cost.


title: SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales

abstract: Large language models (LLMs) often generate inaccurate or fabricated information and generally fail to indicate their confidence, which limits their broader applications. Previous work elicits confidence from LLMs by direct or self-consistency prompting, or constructing specific datasets for supervised finetuning. The prompting-based approaches have inferior performance, and the training-based approaches are limited to binary or inaccurate group-level confidence estimates. In this work, we present the advanced SaySelf, a training framework that teaches LLMs to express more accurate fine-grained confidence estimates. In addition, beyond the confidence scores, SaySelf initiates the process of directing LLMs to produce self-reflective rationales that clearly identify gaps in their parametric knowledge and explain their uncertainty. This is achieved by using an LLM to automatically summarize the uncertainties in specific knowledge via natural language. The summarization is based on the analysis of the inconsistency in multiple sampled reasoning chains, and the resulting data is utilized for supervised fine-tuning. Moreover, we utilize reinforcement learning with a meticulously crafted reward function to calibrate the confidence estimates, motivating LLMs to deliver accurate, high-confidence predictions and to penalize overconfidence in erroneous outputs. Experimental results in both in-distribution and out-of-distribution datasets demonstrate the effectiveness of SaySelf in reducing the confidence calibration error and maintaining the task performance. We show that the generated self-reflective rationales are reasonable and can further contribute to the calibration. The code is made public at https://github.com/xu1868/SaySelf.


title: ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learning

abstract: In Federated Learning (FL), a set of clients collaboratively train a machine learning model (called global model) without sharing their local training data. The local training data of clients is typically non-i.i.d. and heterogeneous, resulting in varying contributions from individual clients to the final performance of the global model. In response, many contribution evaluation methods were proposed, where the server could evaluate the contribution made by each client and incentivize the high-contributing clients to sustain their long-term participation in FL. Existing studies mainly focus on developing new metrics or algorithms to better measure the contribution of each client. However, the security of contribution evaluation methods of FL operating in adversarial environments is largely unexplored. In this paper, we propose the first model poisoning attack on contribution evaluation methods in FL, termed ACE. Specifically, we show that any malicious client utilizing ACE could manipulate the parameters of its local model such that it is evaluated to have a high contribution by the server, even when its local training data is indeed of low quality. We perform both theoretical analysis and empirical evaluations of ACE. Theoretically, we show our design of ACE can effectively boost the malicious client's perceived contribution when the server employs the widely-used cosine distance metric to measure contribution. Empirically, our results show ACE effectively and efficiently deceive five state-of-the-art contribution evaluation methods. In addition, ACE preserves the accuracy of the final global models on testing inputs. We also explore six countermeasures to defend ACE. Our results show they are inadequate to thwart ACE, highlighting the urgent need for new defenses to safeguard the contribution evaluation methods in FL.


title: Matrix Rationalization via Partial Orders

abstract: A preference matrix $M$ has an entry for each pair of candidates in an election whose value $p_{ij}$ represents the proportion of voters that prefer candidate $i$ over candidate $j$. The matrix is rationalizable if it is consistent with a set of voters whose preferences are total orders. A celebrated open problem asks for a concise characterization of rationalizable preference matrices. In this paper, we generalize this matrix rationalizability question and study when a preference matrix is consistent with a set of voters whose preferences are partial orders of width $\alpha$. The width (the maximum cardinality of an antichain) of the partial order is a natural measure of the rationality of a voter; indeed, a partial order of width $1$ is a total order. Our primary focus concerns the rationality number, the minimum width required to rationalize a preference matrix. We present two main results. The first concerns the class of half-integral preference matrices, where we show the key parameter required in evaluating the rationality number is the chromatic number of the undirected unanimity graph associated with the preference matrix $M$. The second concerns the class of integral preference matrices, where we show the key parameter now is the dichromatic number of the directed voting graph associated with $M$.


title: A mathematical justification for nonlinear constitutive relations between stress and linearized strain

abstract: We present an asymptotic framework that rigorously generates nonlinear constitutive relations between stress and linearized strain for elastic bodies. Each of these relations arises as the leading order relationship satisfied by a one-parameter family of nonlinear constitutive relations between stress and nonlinear strain. The asymptotic parameter limits the overall range of strains that satisfy the corresponding constitutive relation in the one-parameter family while the stresses can remain large (relative to a fixed stress scale). This differs from classical linearized elasticity where a fixed constitutive relation is assumed, and the magnitude of the displacement gradient serves as the asymptotic parameter. Also unlike classical approaches, the constitutive relations in our framework are expressed as implicit relationships between stress and strain rather than requiring stress explicitly expressed as a function of strain, adding conceptual simplicity and versatility. We demonstrate that our framework rigorously justifies nonlinear constitutive relations between stress and linearized strain including those with density-dependent Young's moduli or derived from strain energies beyond quadratic forms.


title: Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training

abstract: Large Language Models (LLMs) exhibit substantial capabilities yet encounter challenges, including hallucination, outdated knowledge, and untraceable reasoning processes. Retrieval-augmented generation (RAG) has emerged as a promising solution, integrating knowledge from external databases to mitigate these challenges. However, inappropriate retrieved passages can potentially hinder the LLMs' capacity to generate comprehensive and high-quality responses. Prior RAG studies on the robustness of retrieval noises often confine themselves to a limited set of noise types, deviating from real-world retrieval environments and limiting practical applicability. In this study, we initially investigate retrieval noises and categorize them into three distinct types, reflecting real-world environments. We analyze the impact of these various retrieval noises on the robustness of LLMs. Subsequently, we propose a novel RAG approach known as Retrieval-augmented Adaptive Adversarial Training (RAAT). RAAT leverages adaptive adversarial training to dynamically adjust the model's training process in response to retrieval noises. Concurrently, it employs multi-task learning to ensure the model's capacity to internally recognize noisy contexts. Extensive experiments demonstrate that the LLaMA-2 7B model trained using RAAT exhibits significant improvements in F1 and EM scores under diverse noise conditions. For reproducibility, we release our code and data at: https://github.com/calubkk/RAAT.


title: Tsang's resolution enhancement method for imaging with focused illumination

abstract: A widely tested approach to overcoming the diffraction limit in microscopy without disturbing the sample relies on substituting widefield sample illumination with a structured light beam. This gives rise to confocal, image-scanning and structured-illumination microscopy methods. On the other hand, as shown recently by Tsang and others, subdiffractional resolution at the detection end of the microscope can be achieved by replacing the intensity measurement in the image plane with spatial mode demultiplexing. In this work we study the combined action of Tsang's method with image scanning. We experimentally demonstrate superior lateral resolution and enhanced image quality compared to either method alone. This result paves the way for integrating spatial demultiplexing into existing microscopes, contributing to further pushing the boundaries of optical resolution.


title: Neural Gaussian Scale-Space Fields

abstract: Gaussian scale spaces are a cornerstone of signal representation and processing, with applications in filtering, multiscale analysis, anti-aliasing, and many more. However, obtaining such a scale space is costly and cumbersome, in particular for continuous representations such as neural fields. We present an efficient and lightweight method to learn the fully continuous, anisotropic Gaussian scale space of an arbitrary signal. Based on Fourier feature modulation and Lipschitz bounding, our approach is trained self-supervised, i.e., training does not require any manual filtering. Our neural Gaussian scale-space fields faithfully capture multiscale representations across a broad range of modalities, and support a diverse set of applications. These include images, geometry, light-stage data, texture anti-aliasing, and multiscale optimization.


title: Generative Adversarial Networks in Ultrasound Imaging: Extending Field of View Beyond Conventional Limits

abstract: Transthoracic Echocardiography (TTE) is a fundamental, non-invasive diagnostic tool in cardiovascular medicine, enabling detailed visualization of cardiac structures crucial for diagnosing various heart conditions. Despite its widespread use, TTE ultrasound imaging faces inherent limitations, notably the trade-off between field of view (FoV) and resolution. This paper introduces a novel application of conditional Generative Adversarial Networks (cGANs), specifically designed to extend the FoV in TTE ultrasound imaging while maintaining high resolution. Our proposed cGAN architecture, termed echoGAN, demonstrates the capability to generate realistic anatomical structures through outpainting, effectively broadening the viewable area in medical imaging. This advancement has the potential to enhance both automatic and manual ultrasound navigation, offering a more comprehensive view that could significantly reduce the learning curve associated with ultrasound imaging and aid in more accurate diagnoses. The results confirm that echoGAN reliably reproduce detailed cardiac features, thereby promising a significant step forward in the field of non-invasive cardiac naviagation and diagnostics.


title: Scaling Data Plane Verification with Intent-based Slicing

abstract: Data plane verification has grown into a powerful tool to ensure network correctness. However, existing monolithic data plane models have high memory requirements with large networks, and the existing method of scaling out is too limited in expressiveness to capture practical network features. In this paper, we describe Scylla, a general data plane verifier that provides fine-grained scale-out without the need for a monolithic network model. Scylla creates models for what we call intent-based slices, each of which is constructed at a fine (rule-level) granularity with just enough to verify a given set of intents. The sliced models are retained in memory across a cluster and are incrementally updated in a distributed compute cluster in response to network updates. Our experiments show that Scylla makes the scaling problem more granular -- tied to the size of the intent-based slices rather than that of the overall network. This enables Scylla to verify large, complex networks in minimum units of work that are significantly smaller (in both memory and time) than past techniques, enabling fast scale-out verification with minimal resource requirement.


title: Goal-Oriented Sensor Reporting Scheduling for Non-linear Dynamic System Monitoring

abstract: Goal-oriented communication (GoC) is a form of semantic communication where the effectiveness of information transmission is measured by its impact on achieving the desired goal. In the context of the Internet of Things (IoT), GoC can make IoT sensors to selectively transmit data pertinent to the intended goals of the receiver. Therefore, GoC holds significant value for IoT networks as it facilitates timely decision-making at the receiver, reduces network congestion, and enhances spectral efficiency. In this paper, we consider a scenario where an edge node polls sensors monitoring the state of a non-linear dynamic system (NLDS) to respond to the queries of several clients. Our work delves into the foregoing GoC problem, which we term goal-oriented scheduling (GoS). Our proposed GoS utilizes deep reinforcement learning (DRL) with meticulously devised action space, state space, and reward function. The devised action space and reward function play a pivotal role in reducing the number of sensor transmissions. Meanwhile, the devised state space empowers our DRL scheduler to poll the sensor whose observation is expected to minimize the mean square error (MSE) of the query responses. Our numerical analysis demonstrates that the proposed GoS can either effectively minimize the query response MSE further or obtain a resembling MSE compared to benchmark scheduling methods, depending on the type of query. Furthermore, the proposed GoS proves to be energy-efficient for the sensors and of lower complexity compared to benchmark scheduling methods.


title: Bayesian Design Principles for Offline-to-Online Reinforcement Learning

abstract: Offline reinforcement learning (RL) is crucial for real-world applications where exploration can be costly or unsafe. However, offline learned policies are often suboptimal, and further online fine-tuning is required. In this paper, we tackle the fundamental dilemma of offline-to-online fine-tuning: if the agent remains pessimistic, it may fail to learn a better policy, while if it becomes optimistic directly, performance may suffer from a sudden drop. We show that Bayesian design principles are crucial in solving such a dilemma. Instead of adopting optimistic or pessimistic policies, the agent should act in a way that matches its belief in optimal policies. Such a probability-matching agent can avoid a sudden performance drop while still being guaranteed to find the optimal policy. Based on our theoretical findings, we introduce a novel algorithm that outperforms existing methods on various benchmarks, demonstrating the efficacy of our approach. Overall, the proposed approach provides a new perspective on offline-to-online RL that has the potential to enable more effective learning from offline data.


title: DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Models

abstract: The visual projector, which bridges the vision and language modalities and facilitates cross-modal alignment, serves as a crucial component in MLLMs. However, measuring the effectiveness of projectors in vision-language alignment remains under-explored, which currently can only be inferred from the performance of MLLMs on downstream tasks. Motivated by the problem, this study examines the projector module by interpreting the vision-language semantic flow within MLLMs. Specifically, we trace back the semantic relevance flow from generated language tokens to raw visual encoder patches and the intermediate outputs produced by projectors. Our findings reveal that compressive projectors (e.g., QFormer), abstract visual patches into a limited set of semantic concepts, such as objects or attributes, resulting in a 'double abstraction' phenomenon. This involves a first visual semantic abstraction by the projector referring to pre-defined query tokens, and a second extraction by the LLM based on text instructions. The double abstraction is inefficient in training and will result in cumulative vision semantics deficiency. To mitigate this issue, we propose the key insight of 'Decouple Compression from Abstraction (DeCo), that is compressing the visual token number at the patch level by projectors and allowing the LLM to handle visual semantic abstraction entirely. Consequently, we adopt a simple compressor, i.e., 2D Adaptive Pooling, to downsample visual patches in a parameter-free manner. Empirical evaluation demonstrates that DeCo surpasses traditional compressive projectors regarding both performance and efficiency. It achieves performance gains of 0.9%, 7.1%, and 2.9% across the MLLM Benchmarks, Visual Localization, and Open-ended VQA tasks with fewer trainable parameters and faster convergence speed.


title: Uncertainty Quantification for Bird's Eye View Semantic Segmentation: Methods and Benchmarks

abstract: The fusion of raw features from multiple sensors on an autonomous vehicle to create a Bird's Eye View (BEV) representation is crucial for planning and control systems. There is growing interest in using deep learning models for BEV semantic segmentation. Anticipating segmentation errors and improving the explainability of DNNs is essential for autonomous driving, yet it is under-studied. This paper introduces a benchmark for predictive uncertainty quantification in BEV segmentation. The benchmark assesses various approaches across three popular datasets using two representative backbones and focuses on the effectiveness of predicted uncertainty in identifying misclassified and out-of-distribution (OOD) pixels, as well as calibration. Empirical findings highlight the challenges in uncertainty quantification. Our results find that evidential deep learning based approaches show the most promise by efficiently quantifying aleatoric and epistemic uncertainty. We propose the Uncertainty-Focal-Cross-Entropy (UFCE) loss, designed for highly imbalanced data, which consistently improves the segmentation quality and calibration. Additionally, we introduce a vacuity-scaled regularization term that enhances the model's focus on high uncertainty pixels, improving epistemic uncertainty quantification.


title: Early Stopping Criteria for Training Generative Adversarial Networks in Biomedical Imaging

abstract: Generative Adversarial Networks (GANs) have high computational costs to train their complex architectures. Throughout the training process, GANs' output is analyzed qualitatively based on the loss and synthetic images' diversity and quality. Based on this qualitative analysis, training is manually halted once the desired synthetic images are generated. By utilizing an early stopping criterion, the computational cost and dependence on manual oversight can be reduced yet impacted by training problems such as mode collapse, non-convergence, and instability. This is particularly prevalent in biomedical imagery, where training problems degrade the diversity and quality of synthetic images, and the high computational cost associated with training makes complex architectures increasingly inaccessible. This work proposes a novel early stopping criteria to quantitatively detect training problems, halt training, and reduce the computational costs associated with synthesizing biomedical images. Firstly, the range of generator and discriminator loss values is investigated to assess whether mode collapse, non-convergence, and instability occur sequentially, concurrently, or interchangeably throughout the training of GANs. Secondly, utilizing these occurrences in conjunction with the Mean Structural Similarity Index (MS-SSIM) and Fr\'echet Inception Distance (FID) scores of synthetic images forms the basis of the proposed early stopping criteria. This work helps identify the occurrence of training problems in GANs using low-resource computational cost and reduces training time to generate diversified and high-quality synthetic images.


title: Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging

abstract: Driven by the ever-growing volume and decentralized nature of data, coupled with the need to harness this data and generate knowledge from it, has led to the extensive use of distributed deep learning (DDL) techniques for training. These techniques rely on local training that is performed at the distributed nodes based on locally collected data, followed by a periodic synchronization process that combines these models to create a global model. However, frequent synchronization of DL models, encompassing millions to many billions of parameters, creates a communication bottleneck, severely hindering scalability. Worse yet, DDL algorithms typically waste valuable bandwidth, and make themselves less practical in bandwidth-constrained federated settings, by relying on overly simplistic, periodic, and rigid synchronization schedules. These drawbacks also have a direct impact on the time required for the training process, necessitating excessive time for data communication. To address these shortcomings, we propose Federated Dynamic Averaging (FDA), a communication-efficient DDL strategy that dynamically triggers synchronization based on the value of the model variance. In essence, the costly synchronization step is triggered only if the local models, which are initialized from a common global model after each synchronization, have significantly diverged. This decision is facilitated by the communication of a small local state from each distributed node/worker. Through extensive experiments across a wide range of learning tasks we demonstrate that FDA reduces communication cost by orders of magnitude, compared to both traditional and cutting-edge communication-efficient algorithms. Additionally, we show that FDA maintains robust performance across diverse data heterogeneity settings.


title: Unravelling the asphericities in the explosion and multi-faceted circumstellar matter of SN 2023ixf

abstract: We present a detailed investigation of photometric, spectroscopic, and polarimetric observations of the Type II SN 2023ixf. The early detection of highly-ionized flash features, rapid ascent in ultraviolet flux coupled with the blueward shift in near-ultraviolet colors and temperature provides compelling evidence for a delayed shock breakout from a confined dense circumstellar matter (CSM) enveloping the progenitor star. The temporal evolution of polarization in the SN 2023ixf phase revealed three distinct peaks in polarization evolution at 1.4 d, 6.4 d, and 79.2 d, indicating an asymmetric dense CSM, an aspherical shock front and clumpiness in the low-density extended CSM, and an aspherical inner ejecta/He-core. SN 2023ixf displayed two dominant axes, one along the CSM-outer ejecta and the other along the inner ejecta/He-core, showcasing the independent origin of asymmetry in the early and late evolution. The argument for an aspherical shock front is further strengthened by the presence of a high-velocity broad absorption feature in the blue wing of the Balmer features in addition to the P-Cygni absorption post 16 d. Hydrodynamical light curve modeling indicated a progenitor mass of 10 solar mass with a radius of 470 solar radius, explosion energy of 2e51 erg, and 0.06 solar mass of 56Ni. The modeling also indicated a two-zone CSM: a confined dense CSM extending up to 5e14 cm, with a mass-loss rate of 1e-2 solar mass per year, and an extended CSM spanning from 5e14 cm to 1e16 cm with a mass-loss rate of 1e-4 solar mass per year. The early nebular phase observations display an axisymmetric line profile of [OI] and red-ward attenuation of the emission of Halpha post 125 days, marking the onset of dust formation.


title: Locking Machine Learning Models into Hardware

abstract: Modern Machine Learning models are expensive IP and business competitiveness often depends on keeping this IP confidential. This in turn restricts how these models are deployed -- for example it is unclear how to deploy a model on-device without inevitably leaking the underlying model. At the same time, confidential computing technologies such as Multi-Party Computation or Homomorphic encryption remain impractical for wide adoption. In this paper we take a different approach and investigate feasibility of ML-specific mechanisms that deter unauthorized model use by restricting the model to only be usable on specific hardware, making adoption on unauthorized hardware inconvenient. That way, even if IP is compromised, it cannot be trivially used without specialised hardware or major model adjustment. In a sense, we seek to enable cheap locking of machine learning models into specific hardware. We demonstrate that locking mechanisms are feasible by either targeting efficiency of model representations, such making models incompatible with quantisation, or tie the model's operation on specific characteristics of hardware, such as number of cycles for arithmetic operations. We demonstrate that locking comes with negligible work and latency overheads, while significantly restricting usability of the resultant model on unauthorized hardware.


title: Hard Cases Detection in Motion Prediction by Vision-Language Foundation Models

abstract: Addressing hard cases in autonomous driving, such as anomalous road users, extreme weather conditions, and complex traffic interactions, presents significant challenges. To ensure safety, it is crucial to detect and manage these scenarios effectively for autonomous driving systems. However, the rarity and high-risk nature of these cases demand extensive, diverse datasets for training robust models. Vision-Language Foundation Models (VLMs) have shown remarkable zero-shot capabilities as being trained on extensive datasets. This work explores the potential of VLMs in detecting hard cases in autonomous driving. We demonstrate the capability of VLMs such as GPT-4v in detecting hard cases in traffic participant motion prediction on both agent and scenario levels. We introduce a feasible pipeline where VLMs, fed with sequential image frames with designed prompts, effectively identify challenging agents or scenarios, which are verified by existing prediction models. Moreover, by taking advantage of this detection of hard cases by VLMs, we further improve the training efficiency of the existing motion prediction pipeline by performing data selection for the training samples suggested by GPT. We show the effectiveness and feasibility of our pipeline incorporating VLMs with state-of-the-art methods on NuScenes datasets. The code is accessible at https://github.com/KTH-RPL/Detect_VLM.


title: A Novel Two-stage Deming Regression Framework with Applications to Association Analysis between Clinical Risks

abstract: In healthcare, clinical risks are crucial for treatment decisions, yet the analysis of their associations is often overlooked. This gap is particularly significant when balancing risks that are weighed against each other, as in the case of atrial fibrillation (AF) patients facing stroke and bleeding risks with anticoagulant medication. While traditional regression models are ill-suited for this task due to standard errors in risk estimation, a novel two-stage Deming regression framework is proposed to address this issue, offering a more accurate tool for analyzing associations between variables observed with errors of known or estimated variances. The first stage is to obtain the variable values with variances of errors either by estimation or observation, followed by the second stage that fits a Deming regression model potentially subject to a transformation. The second stage accounts for the uncertainties associated with both independent and response variables, including known or estimated variances and additional unknown variances from the model. The complexity arising from different scenarios of uncertainty is handled by existing and advanced variations of Deming regression models. An important practical application is to support personalized treatment recommendations based on clinical risk associations that were identified by the proposed framework. The model's effectiveness is demonstrated by applying it to a real-world dataset of AF-diagnosed patients to explore the relationship between stroke and bleeding risks, providing crucial guidance for making informed decisions regarding anticoagulant medication. Furthermore, the model's versatility in addressing data containing multiple sources of uncertainty such as privacy-protected data suggests promising avenues for future research in regression analysis.


title: Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise

abstract: We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is i.i.d. Gaussian, the more realistic case of structured noise still proves to be challenging. To capture the structure while maintaining mathematical tractability, a line of work has focused on rotationally invariant noise. However, existing studies either provide sub-optimal algorithms or they are limited to a special class of noise ensembles. In this paper, we establish the first characterization of the information-theoretic limits for a noise matrix drawn from a general trace ensemble. These limits are then achieved by an efficient algorithm inspired by the theory of adaptive Thouless-Anderson-Palmer (TAP) equations. Our approach leverages tools from statistical physics (replica method) and random matrix theory (generalized spherical integrals), and it unveils the equivalence between the rotationally invariant model and a surrogate Gaussian model.

categories: cs.IT cond-mat.dis-nn cs.LG math.IT math.ST stat.TH


title: CWRCzech: 100M Query-Document Czech Click Dataset and Its Application to Web Relevance Ranking

abstract: We present CWRCzech, Click Web Ranking dataset for Czech, a 100M query-document Czech click dataset for relevance ranking with user behavior data collected from search engine logs of Seznam.cz. To the best of our knowledge, CWRCzech is the largest click dataset with raw text published so far. It provides document positions in the search results as well as information about user behavior: 27.6M clicked documents and 10.8M dwell times. In addition, we also publish a manually annotated Czech test for the relevance task, containing nearly 50k query-document pairs, each annotated by at least 2 annotators. Finally, we analyze how the user behavior data improve relevance ranking and show that models trained on data automatically harnessed at sufficient scale can surpass the performance of models trained on human annotated data. CWRCzech is published under an academic non-commercial license and is available to the research community at https://github.com/seznam/CWRCzech.


title: Revisiting quantum field theory in Rindler spacetime with superselection rules

abstract: Quantum field theory (QFT) in Rindler spacetime is a gateway to understanding unitarity and information loss paradoxes in curved spacetime. Rindler coordinates map Minkowski spacetime onto regions with horizons, effectively dividing accelerated observers into causally disconnected sectors. Employing standard quantum field theory techniques and Bogoliubov transformations between Minkowski and Rindler coordinates yields entanglement between states across these causally separated regions of spacetime. This results in a breakdown of unitarity, implying that information regarding the entangled partner may be irretrievably lost beyond the Rindler horizon. As a consequence, one has a situation of pure states evolving into mixed states. In this paper, we introduce a novel framework for comprehending this phenomenon using a recently proposed formulation of direct-sum quantum field theory (DQFT), which is grounded in superselection rules formulated by the parity and time reversal ($\mathcal{P}\mathcal{T}$) symmetry of Minkowski spacetime. In the context of DQFT applied to Rindler spacetime, we demonstrate that each Rindler observer can, in principle, access pure states within the horizon, thereby restoring unitarity. However, our analysis also reveals the emergence of a thermal spectrum of Unruh radiation. This prompts a reevaluation of entanglement in Rindler spacetime, where we propose a novel perspective on how Rindler observers may reconstruct complementary information beyond the horizon. Furthermore, we revisit the implications of the Reeh-Schlieder theorem within the framework of DQFT. Lastly, we underscore how our findings contribute to ongoing efforts aimed at elucidating the role of unitarity in quantum field theory within the context of de Sitter and black hole spacetimes.


title: KeldyshQFT: A C++ codebase for real-frequency multiloop functional renormalization group and parquet computations of the single-impurity Anderson model

abstract: We provide a detailed exposition of our computational framework designed for the accurate calculation of real-frequency dynamical correlation functions of the single-impurity Anderson model (AM) in the regime of weak to intermediate coupling. Using quantum field theory within the Keldysh formalism to directly access the self-energy and dynamical susceptibilities in real frequencies, as detailed in our recent publication (https://doi.org/10.1103/PhysRevB.109.115128), the primary computational challenge is the full three-dimensional real-frequency dependence of the four-point vertex. Our codebase provides a fully MPI+OpenMP parallelized implementation of the functional renormalization group (fRG) and the self-consistent parquet equations within the parquet approximation. It leverages vectorization to handle the additional complexity imposed by the Keldysh formalism, using optimized data structures and highly performant integration routines. Going beyond the results shown in the previous publication, the code includes functionality to perform fRG calculations in the multiloop framework, at arbitrary loop order, including self-consistent self-energy iterations. Moreover, implementations of various regulators, such as hybridization, interaction, frequency, and temperature are supplied.


title: Axial HoloTile: Extended Depth-of-Focus of Dynamic Holographic Light Projections

abstract: This publication extends the HoloTile framework to three dimensions, introducing the ability to generate arbitrary dynamic patterns composed of extended depth-of-field non-diffractive beamlets with theoretically 100% diffraction efficiency. In particular, we demonstrate experimentally the generation of speckle-reduced reconstruction patterns, consisting of spatially multiplexed extended Bessel-like beamlets, implemented on a phase-only spatial light modulator (SLM). Due to the inherent separation of the tiled subhologram and the point spread function shaping hologram in HoloTile, we show that the reconstruction amplitude can be expressed as a simple convolution of the contributions from the two holograms. This results in a discretely sampled reconstruction, with each spatial frequency component exhibiting long DoF with characteristic Bessel beam properties. This separation facilitates spatial and temporal multiplexing of both contributions, and allows for real-time dynamic patterning with extended DoF. Additionally, a geometric analysis is included, allowing for the direct calculation of the propagation characteristics of the beamlets.


title: Full-Cycle Simulations of the Fermilab Booster

abstract: The Proton Improvement Plan phase II (PIP-II) project currently under construction at FNAL will replace the existing 400 MeV normal conducting linac with a new 800 MeV superconducting linac. The beam power in the downstream rapid-cycling Booster synchrotron will be doubled by raising the machine cycle frequency from 15 to 20 Hz and by increasing the injected beam intensity by a factor 1.5. This has to be accomplished without raising uncontrolled losses beyond the administrative limit of 500 W. In addition, slip-stacking efficiency in the Recycler, the next machine in the accelerator chain, sets an upper limit on the longitudinal emittance of the beam delivered by the Booster. As part of an effort to better understand potential losses and emittance blow-up in the Booster, we have been conducting full cycle 6D simulations using the code PyORBIT. The simulations include space charge, wall impedance effects and transition crossing. In this paper, we discuss our experience with the code and present representative results for possible operational scenarios.


title: Towards a Fluid computer

abstract: In 1991, Moore [20] raised a question about whether hydrodynamics is capable of performing computations. Similarly, in 2016, Tao [25] asked whether a mechanical system, including a fluid flow, can simulate a universal Turing machine. In this expository article, we review the construction in [8] of a "Fluid computer" in dimension 3 that combines techniques in symbolic dynamics with the connection between steady Euler flows and contact geometry unveiled by Etnyre and Ghrist. In addition, we argue that the metric that renders the vector field Beltrami cannot be critical in the Chern-Hamilton sense [9]. We also sketch the completely different construction for the Euclidean metric in $\mathbb R^3$ as given in [7]. These results reveal the existence of undecidable fluid particle paths. We conclude the article with a list of open problems.


title: Quantum Information Processing with Molecular Nanomagnets: an introduction

abstract: Many problems intractable on classical devices could be solved by algorithms explicitly based on quantum mechanical laws, i.e. exploiting quantum information processing. As a result, increasing efforts from different fields are nowadays directed to the actual realization of quantum devices. Here we provide an introduction to Quantum Information Processing, focusing on a promising setup for its implementation, represented by molecular spin clusters known as Molecular Nanomagnets. We introduce the basic tools to understand and design quantum algorithms, always referring to their actual realization on a molecular spin architecture. We then examine the most important sources of noise in this class of systems and then one of their most peculiar features, i.e. the possibility to exploit many (more than two) available states to encode information and to self-correct it from errors via proper design of quantum error correction codes. Finally, we present some examples of quantum algorithms proposed and implemented on a molecular spin qudit hardware.


title: Progress in patterned wax stamp for prototyping of paper-based microfluidic analytical devices via injection molding

abstract: In this study, we successfully developed two-dimensional paper-based analytical devices using a hybrid technique of injection molding and embossing. This innovative approach involves passive or active delivery of molten wax onto a glass substrate through a sealed chip, facilitating wax stamp creation.


title: The Renormalization Group for Large-Scale Structure: Primordial non-Gaussianities

abstract: The renormalization group for large-scale structure (RG-LSS) describes the evolution of galaxy bias and stochastic parameters as a function of the cutoff $\Lambda$. In this work, we introduce interaction vertices that describe primordial non-Gaussianity into the Wilson-Polchinski framework, thereby extending the free theory to the interacting case. The presence of these interactions forces us to include new operators and bias coefficients to the bias expansion to ensure closure under renormalization. We recover the previously-derived ``scale-dependent bias'' contributions, as well as a new (subdominant) stochastic contribution. We derive the renormalization group equations governing the RG-LSS for a large class of interactions which account for vertices at linear order in $f_{\rm NL}$ that parametrize interacting scalar and massive spinning fields during inflation. Solving the RG equations, we show the evolution of the non-Gaussian contributions to galaxy clustering as a function of scale.


title: Explaining Predictions by Characteristic Rules

abstract: Characteristic rules have been advocated for their ability to improve interpretability over discriminative rules within the area of rule learning. However, the former type of rule has not yet been used by techniques for explaining predictions. A novel explanation technique, called CEGA (Characteristic Explanatory General Association rules), is proposed, which employs association rule mining to aggregate multiple explanations generated by any standard local explanation technique into a set of characteristic rules. An empirical investigation is presented, in which CEGA is compared to two state-of-the-art methods, Anchors and GLocalX, for producing local and aggregated explanations in the form of discriminative rules. The results suggest that the proposed approach provides a better trade-off between fidelity and complexity compared to the two state-of-the-art approaches; CEGA and Anchors significantly outperform GLocalX with respect to fidelity, while CEGA and GLocalX significantly outperform Anchors with respect to the number of generated rules. The effect of changing the format of the explanations of CEGA to discriminative rules and using LIME and SHAP as local explanation techniques instead of Anchors are also investigated. The results show that the characteristic explanatory rules still compete favorably with rules in the standard discriminative format. The results also indicate that using CEGA in combination with either SHAP or Anchors consistently leads to a higher fidelity compared to using LIME as the local explanation technique.


title: MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses

abstract: We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses, designed to track fine-grained dietary actions like hand-to-mouth movements for food intake, chewing, and drinking. MunchSonic emits inaudible ultrasonic waves from a commodity eyeglass frame. The reflected signals contain rich information about the position and movements of various body parts, including the mouth, jaw, arms, and hands, all of which are involved in eating activities. These signals are then processed by a custom deep-learning pipeline to classify six actions: food intake, chewing, drinking, talking, face-hand touching, and other activities (null). In an unconstrained user study with 12 participants, MunchSonic achieves a 93.5% macro F1-score in a user-independent evaluation with a 2-second time resolution, demonstrating its effectiveness. Additionally, MunchSonic accurately tracks eating episodes and the frequency of food intake within those episodes.


title: Influx ratio preserving coupling conditions for the networked Lighthill-Whitham-Richards model

abstract: A new coupling rule for the Lighthill-Whitham-Richards model at merging junctions is introduced that imposes the preservation of the ratio between inflow from a given road to the total inflow into the junction. This rule is considered both in the context of the original traffic flow model and a relaxation setting giving rise to two different Riemann solvers that are discussed for merging 2-to-1 junctions. Numerical experiments are shown suggesting that the relaxation based Riemann solver is capable of suitable predictions of both, free-flow and congestion scenarios without relying on flow maximization.


title: Magnetotransport Properties of Ferromagnetic/Antiferromagnetic Superlattices: Probing the role of induced magnetization in antiferromagnetic layer

abstract: We investigate the magnetic and transport properties of the $La_{1-x}Sr_{x}MnO_{3}$ (LSMO)/$Pr_{1-x}Ca_{x}MnO_{3}$ (PCMO) like ferromagnetic/antiferromagnetic superlattices in three dimensions using a two orbitals double exchange model incorporating the Jahn-Teller lattice distortions, superexchange interactions and long-range Coulomb interactions. In our simulations we primarily focus on periodic arrangement of $w_L$ planes of ferromagnetic LSMO and $w_P$ planes of antiferromagnetic PCMO manganites, and set $w_L$+$w_P$ = 10. The induced ferromagnetic correlations in the parent PCMO layer decreases monotonically with increasing the PCMO layer width $w_P$ at high temperatures for both half-doping ($n =0.5$) and off-half-doping ($n = 0.55$) scenarios. As we decrease the temperature further the induced ferromagnetic moments in PCMO layer disappears or decreases considerably at half-doping due to the onset of charge ordering in antiferromagnetic PCMO layers. Overall, the magnetization in PCMO layer decreases at low temperatures and the metal-insulator transition temperature of the LSMO/PCMO superlattices increases with increase of the PCMO layer width $w_P$, similar to the experiments. On the other hand, at off-half-doping, the induced ferromagnetic moment survives even at low temperatures due to weakened charge ordering in PCMO layer and interestingly, varies nonmonotonically with PCMO layer width, in agreement with experiments. The nonmonotonic trend of the conductivity of the superlattice with increase of the PCMO layer width $w_P$ shows an one-to-one correspondence between conductivity of the superlattice and the induced ferromagnetic moments in the PCMO layer. We highlight the key role of induced ferromagnetic moment in PCMO layer in analyzing the magnetotransport properties of the LSMO/PCMO superlattices.


title: Card Tricks and Information

abstract: Fitch Cheney's 5-card trick was introduced in 1950. In 2013, Mulcahy invented a 4-card trick in which the cards are allowed to be displayed face down. We suggest our own invention: a 3-card trick in which the cards can be face down and also allowed to be placed both vertically and horizontally. We discuss the theory behind all the tricks and estimate the maximum deck size given the number of chosen cards. We also discuss the cases of hiding several cards and the deck that has duplicates.


title: Continuation of Bianchi Spacetimes Through The Big Bang

abstract: In this paper we present a framework in which the relational description of General Relativity can be used to smoothly continue cosmological dynamical systems through the Big Bang without invoking quantum gravity effects. Cosmological spacetimes contain as a key dynamical variable a notion of scale through the volume factor $\nu$. However no cosmological observer is ever able to separate their measuring apparatus from the system they are measuring, in that sense every measurement is a relative one and measurable dynamical variables are in fact dimensionless ratios. This is manifest in the identification of a scaling symmetry or ``Dynamical Similarity" in the Einstein-Hilbert action associated with the volume factor. By quotienting out this scaling symmetry, we form a relational system defined on a contact manifold whose dynamical variables are decoupled from scale. When the phase space is reduced to shape space, we show that there exist unique solutions to the equations of motion that pass smoothly through the initial cosmological singularity in flat FLRW, Bianchi I and Quiescent Bianchi IX cosmologies.


title: FunLess: Functions-as-a-Service for Private Edge Cloud Systems

abstract: We present FunLess, a Function-as-a-Service (FaaS) platform tailored for the private edge cloud system. FunLess responds to recent trends that advocate for extending the coverage of serverless computing to private edge cloud systems and enhancing latency, security, and privacy while improving resource usage. Unlike existing solutions that rely on containers for function invocation, FunLess leverages WebAssembly (Wasm) as its runtime environment. Wasm's lightweight, sandboxed runtime is crucial to have functions run on constrained devices at the edge. Moreover, the advantages of using Wasm in FunLess include a consistent development and deployment environment for users and function portability (write once, run everywhere) We validate FunLess under different deployment scenarios, characterised by the presence/absence of constrained-resource devices (Raspberry Pi 3B+) and the (in)accessibility of container orchestration technologies - Kubernetes. We compare FunLess with three production-ready, widely adopted open-source FaaS platforms - OpenFaaS, Fission, and Knative. Our benchmarks confirm that FunLess is a proper solution for FaaS private edge cloud systems since it achieves performance comparable to the considered FaaS alternatives while it is the only fully-deployable alternative on constrained-resource devices, thanks to its small memory footprint.


title: Likelihood Equilibria in the Ising Game

abstract: A description of static equilibria in the noisy binary choice (Ising) game on complete and random graphs resulting from maximisation of the likelihood of system configurations is presented. An equivalence of such likelihood equilibria to the competitive Bayes-Nash quantal response expectation equilibria in the special case of consistent agents expectations is established. It is shown that the same likelihood equilibria are obtained by considering the system's partition function.


title: Nash states versus eigenstates for many-body quantum systems

abstract: Eigenstates of observables such as the Hamiltonian play a central role in quantum mechanics. Inspired by the pure Nash equilibria that arise in classical game theory, we propose ''Nash states'' of multiple observables as a generalization of eigenstates of single observables. This generalization is mathematically natural for many-body quantum systems, which possess an intrinsic tensor product structure. Every set of observables gives rise to algebraic varieties of Nash state vectors that we call ''Nash varieties''. We present analytical and numerical results on the existence of Nash states and on the geometry of Nash varieties. We relate these ideas to earlier, pioneering work on the Nash equilibria of few-body quantum games and discuss connections to the variational minimization of local Hamiltonians.


title: G-Transformer for Conditional Average Potential Outcome Estimation over Time

abstract: Estimating potential outcomes for treatments over time based on observational data is important for personalized decision-making in medicine. Yet, existing neural methods for this task suffer from either (a) bias or (b) large variance. In order to address both limitations, we introduce the G-transformer (GT). Our GT is a novel, neural end-to-end model designed for unbiased, low-variance estimation of conditional average potential outcomes (CAPOs) over time. Specifically, our GT is the first neural model to perform regression-based iterative G-computation for CAPOs in the time-varying setting. We evaluate the effectiveness of our GT across various experiments. In sum, this work represents a significant step towards personalized decision-making from electronic health records.


title: StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyond

abstract: Text-rich images have significant and extensive value, deeply integrated into various aspects of human life. Notably, both visual cues and linguistic symbols in text-rich images play crucial roles in information transmission but are accompanied by diverse challenges. Therefore, the efficient and effective understanding of text-rich images is a crucial litmus test for the capability of Vision-Language Models. We have crafted an efficient vision-language model, StrucTexTv3, tailored to tackle various intelligent tasks for text-rich images. The significant design of StrucTexTv3 is presented in the following aspects: Firstly, we adopt a combination of an effective multi-scale reduced visual transformer and a multi-granularity token sampler (MG-Sampler) as a visual token generator, successfully solving the challenges of high-resolution input and complex representation learning for text-rich images. Secondly, we enhance the perception and comprehension abilities of StrucTexTv3 through instruction learning, seamlessly integrating various text-oriented tasks into a unified framework. Thirdly, we have curated a comprehensive collection of high-quality text-rich images, abbreviated as TIM-30M, encompassing diverse scenarios like incidental scenes, office documents, web pages, and screenshots, thereby improving the robustness of our model. Our method achieved SOTA results in text-rich image perception tasks, and significantly improved performance in comprehension tasks. Among multimodal models with LLM decoder of approximately 1.8B parameters, it stands out as a leader, which also makes the deployment of edge devices feasible. In summary, the StrucTexTv3 model, featuring efficient structural design, outstanding performance, and broad adaptability, offers robust support for diverse intelligent application tasks involving text-rich images, thus exhibiting immense potential for widespread application.


title: The classification of dp-minimal integral domains

abstract: We classify dp-minimal integral domains, building off the existing classification of dp-minimal fields and dp-minimal valuation rings. We show that if R is a dp-minimal integral domain, then R is a field or a valuation ring or arises from the following construction: there is a dp-minimal valuation overring O extending R, a proper ideal I in O, and a finite subring S in O/I such that R is the preimage of S in O.


title: The rising costs of training frontier AI models

abstract: The costs of training frontier AI models have grown dramatically in recent years, but there is limited public data on the magnitude and growth of these expenses. This paper develops a detailed cost model to address this gap, estimating training costs using three approaches that account for hardware, energy, cloud rental, and staff expenses. The analysis reveals that the amortized cost to train the most compute-intensive models has grown precipitously at a rate of 2.4x per year since 2016 (95% CI: 2.0x to 3.1x). For key frontier models, such as GPT-4 and Gemini, the most significant expenses are AI accelerator chips and staff costs, each costing tens of millions of dollars. Other notable costs include server components (15-22%), cluster-level interconnect (9-13%), and energy consumption (2-6%). If the trend of growing development costs continues, the largest training runs will cost more than a billion dollars by 2027, meaning that only the most well-funded organizations will be able to finance frontier AI models.


title: MpoxSLDNet: A Novel CNN Model for Detecting Monkeypox Lesions and Performance Comparison with Pre-trained Models

abstract: Monkeypox virus (MPXV) is a zoonotic virus that poses a significant threat to public health, particularly in remote parts of Central and West Africa. Early detection of monkeypox lesions is crucial for effective treatment. However, due to its similarity with other skin diseases, monkeypox lesion detection is a challenging task. To detect monkeypox, many researchers used various deep-learning models such as MobileNetv2, VGG16, ResNet50, InceptionV3, DenseNet121, EfficientNetB3, MobileNetV2, and Xception. However, these models often require high storage space due to their large size. This study aims to improve the existing challenges by introducing a CNN model named MpoxSLDNet (Monkeypox Skin Lesion Detector Network) to facilitate early detection and categorization of Monkeypox lesions and Non-Monkeypox lesions in digital images. Our model represents a significant advancement in the field of monkeypox lesion detection by offering superior performance metrics, including precision, recall, F1-score, accuracy, and AUC, compared to traditional pre-trained models such as VGG16, ResNet50, and DenseNet121. The key novelty of our approach lies in MpoxSLDNet's ability to achieve high detection accuracy while requiring significantly less storage space than existing models. By addressing the challenge of high storage requirements, MpoxSLDNet presents a practical solution for early detection and categorization of monkeypox lesions in resource-constrained healthcare settings. In this study, we have used "Monkeypox Skin Lesion Dataset" comprising 1428 skin images of monkeypox lesions and 1764 skin images of Non-Monkeypox lesions. Dataset's limitations could potentially impact the model's ability to generalize to unseen cases. However, the MpoxSLDNet model achieved a validation accuracy of 94.56%, compared to 86.25%, 84.38%, and 67.19% for VGG16, DenseNet121, and ResNet50, respectively.


title: Generating Triangulations and Fibrations with Reinforcement Learning

abstract: We apply reinforcement learning (RL) to generate fine regular star triangulations of reflexive polytopes, that give rise to smooth Calabi-Yau (CY) hypersurfaces. We demonstrate that, by simple modifications to the data encoding and reward function, one can search for CYs that satisfy a set of desirable string compactification conditions. For instance, we show that our RL algorithm can generate triangulations together with holomorphic vector bundles that satisfy anomaly cancellation and poly-stability conditions in heterotic compactification. Furthermore, we show that our algorithm can be used to search for reflexive subpolytopes together with compatible triangulations that define fibration structures of the CYs.


title: Improved Techniques for Optimization-Based Jailbreaking on Large Language Models

abstract: Large language models (LLMs) are being rapidly developed, and a key component of their widespread deployment is their safety-related alignment. Many red-teaming efforts aim to jailbreak LLMs, where among these efforts, the Greedy Coordinate Gradient (GCG) attack's success has led to a growing interest in the study of optimization-based jailbreaking techniques. Although GCG is a significant milestone, its attacking efficiency remains unsatisfactory. In this paper, we present several improved (empirical) techniques for optimization-based jailbreaks like GCG. We first observe that the single target template of "Sure" largely limits the attacking performance of GCG; given this, we propose to apply diverse target templates containing harmful self-suggestion and/or guidance to mislead LLMs. Besides, from the optimization aspects, we propose an automatic multi-coordinate updating strategy in GCG (i.e., adaptively deciding how many tokens to replace in each step) to accelerate convergence, as well as tricks like easy-to-hard initialisation. Then, we combine these improved technologies to develop an efficient jailbreak method, dubbed I-GCG. In our experiments, we evaluate on a series of benchmarks (such as NeurIPS 2023 Red Teaming Track). The results demonstrate that our improved techniques can help GCG outperform state-of-the-art jailbreaking attacks and achieve nearly 100% attack success rate. The code is released at https://github.com/jiaxiaojunQAQ/I-GCG.


title: Quantum quench dynamics as a shortcut to adiabaticity

abstract: The ability to efficiently prepare ground states of quantum Hamiltonians via adiabatic protocols is typically limited by the smallest energy gap encountered during the quantum evolution. This presents a key obstacle for quantum simulation and realizations of adiabatic quantum algorithms in large systems, particularly when the adiabatic gap vanishes exponentially with system size. Using QuEra's Aquila programmable quantum simulator based on Rydberg atom arrays, we experimentally demonstrate a method to circumvent such limitations. Specifically, we develop and test a "sweep-quench-sweep" quantum algorithm in which the incorporation of a quench step serves as a remedy to the diverging adiabatic timescale. These quenches introduce a macroscopic reconfiguration between states separated by an extensively large Hamming distance, akin to quantum many-body scars. Our experiments show that this approach significantly outperforms the adiabatic algorithm, illustrating that such quantum quench algorithms can provide a shortcut to adiabaticity for large-scale many-body quantum systems.


title: Bayesian Estimation of Hierarchical Linear Models from Incomplete Data: Cluster-Level Interaction Effects and Small Sample Sizes

abstract: We consider Bayesian estimation of a hierarchical linear model (HLM) from small sample sizes where 37 patient-physician encounters are repeatedly measured at four time points. The continuous response $Y$ and continuous covariates $C$ are partially observed and assumed missing at random. With $C$ having linear effects, the HLM may be efficiently estimated by available methods. When $C$ includes cluster-level covariates having interactive or other nonlinear effects given small sample sizes, however, maximum likelihood estimation is suboptimal, and existing Gibbs samplers are based on a Bayesian joint distribution compatible with the HLM, but impute missing values of $C$ by a Metropolis algorithm via a proposal density having a constant variance while the target conditional distribution has a nonconstant variance. Therefore, the samplers are not guaranteed to be compatible with the joint distribution and, thus, not guaranteed to always produce unbiased estimation of the HLM. We introduce a compatible Gibbs sampler that imputes parameters and missing values directly from the exact conditional distributions. We analyze repeated measurements from patient-physician encounters by our sampler, and compare our estimators with those of existing methods by simulation.


title: Beyond Conventional Parametric Modeling: Data-Driven Framework for Estimation and Prediction of Time Activity Curves in Dynamic PET Imaging

abstract: Dynamic Positron Emission Tomography (dPET) imaging and Time-Activity Curve (TAC) analyses are essential for understanding and quantifying the biodistribution of radiopharmaceuticals over time and space. Traditional compartmental modeling, while foundational, commonly struggles to fully capture the complexities of biological systems, including non-linear dynamics and variability. This study introduces an innovative data-driven neural network-based framework, inspired by Reaction Diffusion systems, designed to address these limitations. Our approach, which adaptively fits TACs from dPET, enables the direct calibration of diffusion coefficients and reaction terms from observed data, offering significant improvements in predictive accuracy and robustness over traditional methods, especially in complex biological scenarios. By more accurately modeling the spatio-temporal dynamics of radiopharmaceuticals, our method advances modeling of pharmacokinetic and pharmacodynamic processes, enabling new possibilities in quantitative nuclear medicine.


title: You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet

abstract: Linear attention mechanisms have gained prominence in causal language models due to their linear computational complexity and enhanced speed. However, the inherent decay mechanism in linear attention presents challenges when applied to multi-dimensional sequence modeling tasks, such as image processing and multi-modal learning. In these scenarios, the utilization of sequential scanning to establish a global receptive field necessitates multiple scans for multi-dimensional data, thereby leading to inefficiencies. This paper identifies the inefficiency caused by a multiplicative linear recurrence and proposes an efficient alternative additive linear recurrence to avoid the issue, as it can handle multi-dimensional data within a single scan. We further develop an efficient multi-dimensional sequential modeling framework called LightNet based on the new recurrence. Moreover, we present two new multi-dimensional linear relative positional encoding methods, MD-TPE and MD-LRPE to enhance the model's ability to discern positional information in multi-dimensional scenarios. Our empirical evaluations across various tasks, including image classification, image generation, bidirectional language modeling, and autoregressive language modeling, demonstrate the efficacy of LightNet, showcasing its potential as a versatile and efficient solution for multi-dimensional sequential modeling.


title: Compact Optimality Verification for Optimization Proxies

abstract: Recent years have witnessed increasing interest in optimization proxies, i.e., machine learning models that approximate the input-output mapping of parametric optimization problems and return near-optimal feasible solutions. Following recent work by (Nellikkath & Chatzivasileiadis, 2021), this paper reconsiders the optimality verification problem for optimization proxies, i.e., the determination of the worst-case optimality gap over the instance distribution. The paper proposes a compact formulation for optimality verification and a gradient-based primal heuristic that brings substantial computational benefits to the original formulation. The compact formulation is also more general and applies to non-convex optimization problems. The benefits of the compact formulation are demonstrated on large-scale DC Optimal Power Flow and knapsack problems.


title: Programming evolution of geometry in shape-morphing sheets via spatiotemporal activation

abstract: Shape-programmed sheets morph from one surface into another upon activation by stimuli such as illumination, and have attracted much interest for their potential engineering applications, especially in soft robotics. Complex shape changes can be achieved by patterning a simple local active deformation (e.g. isotropic swelling), to generate differential growth. Usually the material itself is designed $\unicode{x2014}$ for example by patterning a molecular director $\unicode{x2014}$ such that a particular shape change occurs upon exposure to a spatially uniform stimulus. A limitation of this paradigm is that typically only one target geometry can be attained as the stimulus is adjusted. Here we show that this limitation can be overcome by patterning the stimulus itself, thereby exercising spatiotemporal control over local deformation magnitudes. Thus a single physical sample can be induced to traverse a continuous family of target geometries, opening the door to precise shape adjustments, new functionalities, and designable non-reciprocal loops in shape space. We illustrate these possibilities with examples including active parabolic reflectors, chiral flow guides, and bending channels. Finding the necessary patterns of activation involves solving families of metric inverse problems; we solve these by reduction to ODEs in an axisymmetric setting, then present a novel numerical scheme to solve them in generality.


title: On reduction and parameter recovering of Petri's cycloids

abstract: Cycloids are particular Petri nets for modelling processes of actions and events, belonging to the fundaments of Petri's general systems theory. Defined by four parameters they provide an algebraic formalism to describe strongly synchronized sequential processes. To further investigate their structure, reduction systems of cycloids are defined in the style of rewriting systems and properties of reduced cycloids are proved. In particular the recovering of cycloid parameters from their Petri net structure is derived.


title: A note on oriented percolation with inhomogeneities and strict inequalities

abstract: This note was motivated by natural questions related to oriented percolation on a layered environment that introduces long range dependence. As a convenient tool, we are led to deal with questions on the strict decrease of the percolation parameter in the oriented setup when an extra dimension is added.


title: Fusion-PSRO: Nash Policy Fusion for Policy Space Response Oracles

abstract: A popular approach for solving zero-sum games is to maintain populations of policies to approximate the Nash Equilibrium (NE). Previous studies have shown that Policy Space Response Oracle (PSRO) algorithm is an effective multi-agent reinforcement learning framework for solving such games. However, repeatedly training new policies from scratch to approximate Best Response (BR) to opponents' mixed policies at each iteration is both inefficient and costly. While some PSRO variants initialize a new policy by inheriting from past BR policies, this approach limits the exploration of new policies, especially against challenging opponents. To address this issue, we propose Fusion-PSRO, which employs policy fusion to initialize policies for better approximation to BR. By selecting high-quality base policies from meta-NE, policy fusion fuses the base policies into a new policy through model averaging. This approach allows the initialized policies to incorporate multiple expert policies, making it easier to handle difficult opponents compared to inheriting from past BR policies or initializing from scratch. Moreover, our method only modifies the policy initialization phase, allowing its application to nearly all PSRO variants without additional training overhead. Our experiments on non-transitive matrix games, Leduc Poker, and the more complex Liars Dice demonstrate that Fusion-PSRO enhances the performance of nearly all PSRO variants, achieving lower exploitability.


title: LACIE: Listener-Aware Finetuning for Confidence Calibration in Large Language Models

abstract: When answering questions, LLMs can convey not only an answer, but a level of confidence about the answer being correct. This includes explicit confidence markers (e.g. giving a numeric score) as well as implicit markers, like an authoritative tone or elaborating with additional knowledge. For LLMs to be trustworthy knowledge sources, the confidence they convey should match their actual expertise; however, most current models tend towards overconfidence. To calibrate both implicit and explicit confidence markers, we introduce a pragmatic, listener-aware finetuning method (LACIE) that models the listener, considering not only whether an answer is right, but whether it will be accepted by a listener. We cast calibration as preference optimization, creating data via a two-agent game, where a speaker model's outputs are judged by a simulated listener. We then finetune three LLMs (Mistral-7B, Llama3-8B, Llama3-70B) with LACIE, and show that the resulting models are better calibrated w.r.t. a simulated listener. Crucially, these trends transfer to human listeners, helping them correctly predict model correctness: we conduct a human evaluation where annotators accept or reject an LLM's answers, finding that training with LACIE results in 47% fewer incorrect answers being accepted while maintaining the same level of acceptance for correct answers. Furthermore, LACIE generalizes to another dataset, resulting in a large increase in truthfulness on TruthfulQA when trained on TriviaQA. Our analysis indicates that LACIE leads to a better confidence separation between correct and incorrect examples. Qualitatively, we find that a LACIE-trained model hedges more and implicitly signals certainty when it is correct by using an authoritative tone or including details. Finally, LACIE finetuning leads to an emergent increase in model abstention (e.g. saying "I don't know") for answers that are likely wrong.


title: Table-top nanodiamond interferometer enabling quantum gravity tests

abstract: Unifying quantum theory and general relativity is the holy grail of contemporary physics. Nonetheless, the lack of experimental evidence driving this process led to a plethora of mathematical models with a substantial impossibility of discriminating among them or even establishing if gravity really needs to be quantized or if, vice versa, quantum mechanics must be "gravitized" at some scale. Recently, it has been proposed that the observation of the generation of entanglement by gravitational interaction, could represent a breakthrough demonstrating the quantum nature of gravity. A few experimental proposals have been advanced in this sense, but the extreme technological requirements (e.g., the need for free-falling gravitationally-interacting masses in a quantum superposition state) make their implementation still far ahead. Here we present a feasibility study for a table-top nanodiamond-based interferometer eventually enabling easier and less resource-demanding quantum gravity tests. With respect to the aforementioned proposals, by relying on quantum superpositions of steady massive (mesoscopic) objects our interferometer may allow exploiting just small-range electromagnetic fields (much easier to implement and control) and, at the same time, the re-utilization of the massive quantum probes exploited, inevitably lost in free-falling interferometric schemes.


title: Standards for Belief Representations in LLMs

abstract: As large language models (LLMs) continue to demonstrate remarkable abilities across various domains, computer scientists are developing methods to understand their cognitive processes, particularly concerning how (and if) LLMs internally represent their beliefs about the world. However, this field currently lacks a unified theoretical foundation to underpin the study of belief in LLMs. This article begins filling this gap by proposing adequacy conditions for a representation in an LLM to count as belief-like. We argue that, while the project of belief measurement in LLMs shares striking features with belief measurement as carried out in decision theory and formal epistemology, it also differs in ways that should change how we measure belief. Thus, drawing from insights in philosophy and contemporary practices of machine learning, we establish four criteria that balance theoretical considerations with practical constraints. Our proposed criteria include accuracy, coherence, uniformity, and use, which together help lay the groundwork for a comprehensive understanding of belief representation in LLMs. We draw on empirical work showing the limitations of using various criteria in isolation to identify belief representations.


title: To be or not to be, but where?

abstract: The identification of physical subsystems in quantum mechanics as compared to classical mechanics poses significant conceptual challenges, especially in the context of quantum gravity. Traditional approaches associate quantum systems with classical ones localized in spacetime, using either Hilbert space factors for finite-dimensional systems or local operator algebras in algebraic quantum field theory. These methods ensure statistical independence for state preparations and measurements. However, canonical linearized quantum gravity disrupts this framework by preventing the formation of gauge-invariant local algebras, thereby undermining the statistical independence required in measurements. This presents a major obstacle for modeling early universe cosmology, gravity-induced-entanglement experiments, and poses a significant roadblock toward a comprehensive theory of quantum gravity. A pivotal shift is proposed: the identification of classical and quantum systems should be dynamically evolving rather than static, opening the possibility of a single-world unitary quantum mechanics. This perspective aligns with the broader aim of understanding how classical spatiotemporal existence emerges from quantum mechanics and connects the measurement problem with quantum gravity.


title: Scale hierarchies near the conifold

abstract: We study the axio-dilaton and complex structure stabilization for a generic one-parameter Calabi-Yau (CY) compactification. We focus on near the conifold regions and consider a strongly warped metric. We analyze numerically the case of the mirror of the quintic CY. The axio-dilaton $\tau$ and complex structure $z$ moduli are stabilized simultaneously comparing with previous results, showing that generically $z$ is heavier than $\tau$, and the axio-dilaton can not be fixed first. This is also the case when we add the warping correction to the potential; and in general this inclusion does not destabilize the moduli. We point out why in this setup non-supersymmetric vacua are much more dense than supersymmetric vacua. We study the dependence of the vacua stabilization by addition of an $\overline{D3}$-brane, for a fixed volume. The vacuum state masses have divergent eigenvalues near the conifold singularity that gets softened by the warping correction. Generically the considered contributions allow to find stable vacua in this setup. The scale hierarchy between 6D and 4D; arising from the warping, as stated by Giddings Kachru and Polchinski (GKP), is preserved; while the masses in the vacua acquire physically reasonable values.


title: 3D simulations of convective shell Neon-burning in a massive star

abstract: The treatment of convection remains a major weakness in the modelling of stellar evolution with one-dimensional (1D) codes. The ever increasing computing power makes now possible to simulate in 3D part of a star for a fraction of its life, allowing us to study the full complexity of convective zones with hydrodynamics codes. Here, we performed state-of-the-art hydrodynamics simulations of turbulence in a neon-burning convective zone, during the late stage of the life of a massive star. We produced a set of simulations varying the resolution of the computing domain (from 1283 to 10243 cells) and the efficiency of the nuclear reactions (by boosting the energy generation rate from nominal to a factor of 1000). We analysed our results by the mean of Fourier transform of the velocity field, and mean-field decomposition of the various transport equations. Our results are in line with previous studies, showing that the behaviour of the bulk of the convective zone is already well captured at a relatively low resolution (2563), while the details of the convective boundaries require higher resolutions. The different boosting factors used show how various quantities (velocity, buoyancy, abundances, abundance variances) depend on the energy generation rate. We found that for low boosting factors, convective zones are well mixed, validating the approach usually used in 1D stellar evolution codes. However, when nuclear burning and turbulent transport occur on the same timescale, a more sophisticated treatment would be needed. This is typically the case when shell mergers occur.