title: Rethinking Clustered Federated Learning in NOMA Enhanced Wireless Networks

abstract: This study explores the benefits of integrating the novel clustered federated learning (CFL) approach with non-orthogonal multiple access (NOMA) under non-independent and identically distributed (non-IID) datasets, where multiple devices participate in the aggregation with time limitations and a finite number of sub-channels. A detailed theoretical analysis of the generalization gap that measures the degree of non-IID in the data distribution is presented. Following that, solutions to address the challenges posed by non-IID conditions are proposed with the analysis of the properties. Specifically, users' data distributions are parameterized as concentration parameters and grouped using spectral clustering, with Dirichlet distribution serving as the prior. The investigation into the generalization gap and convergence rate guides the design of sub-channel assignments through the matching-based algorithm, and the power allocation is achieved by Karush-Kuhn-Tucker (KKT) conditions with the derived closed-form solution. The extensive simulation results show that the proposed cluster-based FL framework can outperform FL baselines in terms of both test accuracy and convergence rate. Moreover, jointly optimizing sub-channel and power allocation in NOMA-enhanced networks can lead to a significant improvement.


title: The Amplitude Equation for the Space-Fractional Swift-Hohenberg Equation

abstract: Non-local reaction-diffusion partial differential equations (PDEs) involving the fractional Laplacian have arisen in a wide variety of applications. One common tool to analyse the dynamics of classical local PDEs near instability is to derive local amplitude/modulation approximations, which provide local normal forms classifying a wide variety of pattern-formation phenomena. In this work, we study amplitude equations for the space-fractional Swift-Hohenberg equation. The Swift-Hohenberg equation is a basic model problem motivated by pattern formation in fluid dynamics and has served as one of the main PDEs to develop general techniques to derive amplitude equations. We prove that there exists near the first bifurcation point an approximation by a (real) Ginzburg-Landau equation. Interestingly, this Ginzburg-Landau equation is a local PDE, which provides a rigorous justification of the physical conjecture that suitably localized unstable modes can out-compete superdiffusion and re-localize a PDE near instability. Our main technical contributions are to provide a suitable function space setting for the approximation problem, and to then bound the residual between the original PDE and its amplitude equation.


title: Novel approach of exploring ASEP-like models through the Yang Baxter Equation

abstract: We explore the algebraic structure of a particular ansatz of Yang Baxter Equation which is inspired from the Bethe Ansatz treatment of the ASEP spin-model. Various classes of Hamiltonian density arriving from two types of R-Matrices are found which also appear as solutions of constant YBE. We identify the idempotent and nilpotent categories of such constant R-Matrices and perform a rank-1 numerical search for the lowest dimension. A summary of finalised results reveals general non-hermitian spin-1/2 chain models.


title: Soliton Frequency Combs in Elastomer Membrane-Cavity Optomechanics

abstract: Solitons, arising from nonlinear wave-matter interactions, stand out for their intrinsic stability during wave propagation and exceptional spectral characteristics. Their applications span diverse physical systems, including telecommunications, atomic clocks, and precise measurements. In recent years, significant strides have been made in developing cavity-optomechanics based approaches to generate optical frequency combs (FCs). In this study, we present an innovative approach, never explored before, that leverages elastomer membrane (EM)-cavity optomechanics to achieve the generation of soliton FCs, a highly sought-after phenomenon in the realm of nonlinear wave-matter interactions. Our method represents a significant breakthrough due to its streamlined simplicity, relying on a single continuous-wave (CW) laser pump and an externally applied acoustic wave exciting an EM-cavity, which gives rise to phonons, quantized vibrational energy states intrinsic to the elastomer's crystalline lattice structure. The mechanical resonator and electromagnetic cavity resonance are parametrically coupled within the microwave frequency range, collectively orchestrate the process of soliton FCs formation with remarkable efficiency. Numerical simulations and experimental observations demonstrate the emergence of multiple stable localized opto-mechanical wave packets, characterized by a narrow pulses time-domain response. Crucially, by setting the acoustic wave frequency to match the natural frequency of the EM resonator, the solitons' teeth are precisely spaced, and the EM's motion is significantly amplified, giving rise to a Kerr medium. The successful realization of optomechanical stable solitons represents a monumental advancement with transformative potential across various fields, including quantum computing and spectroscopy.


title: PalmProbNet: A Probabilistic Approach to Understanding Palm Distributions in Ecuadorian Tropical Forest via Transfer Learning

abstract: Palms play an outsized role in tropical forests and are important resources for humans and wildlife. A central question in tropical ecosystems is understanding palm distribution and abundance. However, accurately identifying and localizing palms in geospatial imagery presents significant challenges due to dense vegetation, overlapping canopies, and variable lighting conditions in mixed-forest landscapes. Addressing this, we introduce PalmProbNet, a probabilistic approach utilizing transfer learning to analyze high-resolution UAV-derived orthomosaic imagery, enabling the detection of palm trees within the dense canopy of the Ecuadorian Rainforest. This approach represents a substantial advancement in automated palm detection, effectively pinpointing palm presence and locality in mixed tropical rainforests. Our process begins by generating an orthomosaic image from UAV images, from which we extract and label palm and non-palm image patches in two distinct sizes. These patches are then used to train models with an identical architecture, consisting of an unaltered pre-trained ResNet-18 and a Multilayer Perceptron (MLP) with specifically trained parameters. Subsequently, PalmProbNet employs a sliding window technique on the landscape orthomosaic, using both small and large window sizes to generate a probability heatmap. This heatmap effectively visualizes the distribution of palms, showcasing the scalability and adaptability of our approach in various forest densities. Despite the challenging terrain, our method demonstrated remarkable performance, achieving an accuracy of 97.32% and a Cohen's kappa of 94.59% in testing.


title: Statistical modeling of equilibrium phase transition in confined fluids

abstract: The phase transition of confined fluids in mesoporous materials deviates from that of bulk fluids due to the interactions with the surrounding heterogeneous structure. For example, adsorbed fluids in metal-organic-frameworks (MOFs) have atypical phase characteristics such as capillary condensation and higher-order phase transitions due to a strong heterogeneous field. Considering a many-body problem in the presence of a nonuniform external field, we model the host-guest and guest-guest interactions in MOFs. To solve the three-dimensional Ising model, we use the mean-field theory to approximate the guest-guest interactions and Mayer's f-functions to describe the host-guest interactions in a unit cell. Later, using Hill's theory of nanothermodynamics, we define differential thermodynamic functions to understand the distribution of intensive properties and integral thermodynamic functions to explain the phase transition in confined fluids. The investigation reveals a distinct behavior where fluids confined in larger pores undergo a discontinuous (first-order) phase transition, whereas those confined in smaller pores experience a continuous (higher-order) phase transition. Furthermore, the results indicate that the free-energy barrier for phase transitions is lower in confined fluids than in bulk fluids giving rise to a lower condensation pressure relative to the bulk saturation pressure. Finally, the integral thermodynamic functions are succinctly presented in the form of a phase diagram, marking an initial step toward a more practical approach for understanding the phase behavior of confined fluids.

categories: cond-mat.soft cond-mat.mes-hall cond-mat.stat-mech physics.atm-clus


title: Design2Code: How Far Are We From Automating Front-End Engineering?

abstract: Generative AI has made rapid advancements in recent years, achieving unprecedented capabilities in multimodal understanding and code generation. This can enable a new paradigm of front-end development, in which multimodal LLMs might directly convert visual designs into code implementations. In this work, we formalize this as a Design2Code task and conduct comprehensive benchmarking. Specifically, we manually curate a benchmark of 484 diverse real-world webpages as test cases and develop a set of automatic evaluation metrics to assess how well current multimodal LLMs can generate the code implementations that directly render into the given reference webpages, given the screenshots as input. We also complement automatic metrics with comprehensive human evaluations. We develop a suite of multimodal prompting methods and show their effectiveness on GPT-4V and Gemini Pro Vision. We further finetune an open-source Design2Code-18B model that successfully matches the performance of Gemini Pro Vision. Both human evaluation and automatic metrics show that GPT-4V performs the best on this task compared to other models. Moreover, annotators think GPT-4V generated webpages can replace the original reference webpages in 49% of cases in terms of visual appearance and content; and perhaps surprisingly, in 64% of cases GPT-4V generated webpages are considered better than the original reference webpages. Our fine-grained break-down metrics indicate that open-source models mostly lag in recalling visual elements from the input webpages and in generating correct layout designs, while aspects like text content and coloring can be drastically improved with proper finetuning.


title: A remark on $\mathscr{C}^\infty$ definable equivalence

abstract: We establish that if a submanifold $M$ of $\mathbb{R}^n$ is definable in some o-minimal structure then any definable submanifold $N\subset \mathbb{R}^n$ which is $\mathscr{C}^\infty$ diffeomorphic to $M$, with a diffeomorphism $h:N\to M$ that is sufficiently close to the identity, must be $\mathscr{C}^\infty$ definably diffeomorphic to $M$. The definable diffeomorphism between $N$ and $M$ is then provided by a tubular neighborhood of $M$.


title: Leveraging Federated Learning and Edge Computing for Recommendation Systems within Cloud Computing Networks

abstract: To enable large-scale and efficient deployment of artificial intelligence (AI), the combination of AI and edge computing has spawned Edge Intelligence, which leverages the computing and communication capabilities of end devices and edge servers to process data closer to where it is generated. A key technology for edge intelligence is the privacy-protecting machine learning paradigm known as Federated Learning (FL), which enables data owners to train models without having to transfer raw data to third-party servers. However, FL networks are expected to involve thousands of heterogeneous distributed devices. As a result, communication efficiency remains a key bottleneck. To reduce node failures and device exits, a Hierarchical Federated Learning (HFL) framework is proposed, where a designated cluster leader supports the data owner through intermediate model aggregation. Therefore, based on the improvement of edge server resource utilization, this paper can effectively make up for the limitation of cache capacity. In order to mitigate the impact of soft clicks on the quality of user experience (QoE), the authors model the user QoE as a comprehensive system cost. To solve the formulaic problem, the authors propose a decentralized caching algorithm with federated deep reinforcement learning (DRL) and federated learning (FL), where multiple agents learn and make decisions independently


title: Hybrid data assimilation techniques using the adjoint method in a coupled Lorenz system

abstract: A hybrid 4D-variational data assimilation method for numerical climate models is introduced using the Lorenz '63 model. This new approach has the potential to optimise a high complexity Earth system model (ESM) by utilising the adjoint equations of an intermediate complexity ESM. The method is conceptually demonstrated by consecutively synchronising two Lorenz '63 systems to observations before optimisation. The first represents a 'high complexity' model and the second an 'intermediate complexity' model which has adjoint equations. This method will save computational power for a full ESM and has negligible error and uncertainty change compared to the optimisation of a single model with adjoint equations. A similar setup can be applied to sparse observations. An alternative assimilation setup, with two identical models, is used to filter noisy data. This reduces optimised parametric model uncertainty by approximately one third. Such a precision gain could prove valuable for seasonal, annual, and decadal predictions.


title: PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Dataset

abstract: Recently, there has been growing interest within the community regarding whether large language models are capable of planning or executing plans. However, most prior studies use LLMs to generate high-level plans for simplified scenarios lacking linguistic complexity and domain diversity, limiting analysis of their planning abilities. These setups constrain evaluation methods (e.g., predefined action space), architectural choices (e.g., only generative models), and overlook the linguistic nuances essential for realistic analysis. To tackle this, we present PARADISE, an abductive reasoning task using Q\&A format on practical procedural text sourced from wikiHow. It involves warning and tip inference tasks directly associated with goals, excluding intermediary steps, with the aim of testing the ability of the models to infer implicit knowledge of the plan solely from the given goal. Our experiments, utilizing fine-tuned language models and zero-shot prompting, reveal the effectiveness of task-specific small models over large language models in most scenarios. Despite advancements, all models fall short of human performance. Notably, our analysis uncovers intriguing insights, such as variations in model behavior with dropped keywords, struggles of BERT-family and GPT-4 with physical and abstract goals, and the proposed tasks offering valuable prior knowledge for other unseen procedural tasks. The PARADISE dataset and associated resources are publicly available for further research exploration with https://github.com/GGLAB-KU/paradise.


title: Learning Explicitly Conditioned Sparsifying Transforms

abstract: Sparsifying transforms became in the last decades widely known tools for finding structured sparse representations of signals in certain transform domains. Despite the popularity of classical transforms such as DCT and Wavelet, learning optimal transforms that guarantee good representations of data into the sparse domain has been recently analyzed in a series of papers. Typically, the conditioning number and representation ability are complementary key features of learning square transforms that may not be explicitly controlled in a given optimization model. Unlike the existing approaches from the literature, in our paper, we consider a new sparsifying transform model that enforces explicit control over the data representation quality and the condition number of the learned transforms. We confirm through numerical experiments that our model presents better numerical behavior than the state-of-the-art.


title: Dynamical decoding of the competition between charge density waves in a kagome superconductor

abstract: The kagome superconductor CsV$_3$Sb$_5$ hosts a variety of charge density wave (CDW) phases, which play a fundamental role in the formation of other exotic electronic instabilities. However, identifying the precise structure of these CDW phases and their intricate relationships remain the subject of intense debate, due to the lack of static probes that can distinguish the CDW phases with identical spatial periodicity. Here, we unveil the competition between two coexisting $2\times2\times2$ CDWs in CsV$_3$Sb$_5$ harnessing time-resolved X-ray diffraction. By analyzing the light-induced changes in the intensity of CDW superlattice peaks, we demonstrate the presence of both phases, each displaying a significantly different amount of melting upon excitation. The anomalous light-induced sharpening of peak width further shows that the phase that is more resistant to photo-excitation exhibits an increase in domain size at the expense of the other, thereby showcasing a hallmark of phase competition. Our results not only shed light on the interplay between the multiple CDW phases in CsV$_3$Sb$_5$, but also establish a non-equilibrium framework for comprehending complex phase relationships that are challenging to disentangle using static techniques.


title: SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection

abstract: Misinformation is a prevalent societal issue due to its potential high risks. Out-of-context (OOC) misinformation, where authentic images are repurposed with false text, is one of the easiest and most effective ways to mislead audiences. Current methods focus on assessing image-text consistency but lack convincing explanations for their judgments, which is essential for debunking misinformation. While Multimodal Large Language Models (MLLMs) have rich knowledge and innate capability for visual reasoning and explanation generation, they still lack sophistication in understanding and discovering the subtle crossmodal differences. In this paper, we introduce SNIFFER, a novel multimodal large language model specifically engineered for OOC misinformation detection and explanation. SNIFFER employs two-stage instruction tuning on InstructBLIP. The first stage refines the model's concept alignment of generic objects with news-domain entities and the second stage leverages language-only GPT-4 generated OOC-specific instruction data to fine-tune the model's discriminatory powers. Enhanced by external tools and retrieval, SNIFFER not only detects inconsistencies between text and image but also utilizes external knowledge for contextual verification. Our experiments show that SNIFFER surpasses the original MLLM by over 40% and outperforms state-of-the-art methods in detection accuracy. SNIFFER also provides accurate and persuasive explanations as validated by quantitative and human evaluations.


title: JWST PRIMER: A new multi-field determination of the evolving galaxy UV luminosity function at redshifts $\mathbf{z \simeq 9-15}$

abstract: We present a new determination of the evolving galaxy UV luminosity function (LF) over the redshift range $8.5<z<15.5$ using a combination of several major Cycle-1 JWST imaging programmes - PRIMER, JADES and NGDEEP. This multi-field approach yields a total of $\simeq370$ sq. arcmin of JWST/NIRCam imaging, reaching (5-$\sigma$) depths of $\simeq30$ AB mag in the deepest regions. We select a sample of 2548 galaxies with a significant probability of lying at high redshift ($p(z>8.5)>0.05$) to undertake a statistical calculation of the UV LF. Our new measurements span $\simeq4$ magnitudes in UV luminosity at $z=9-12.5$, placing new constraints on both the shape and evolution of the LF at early times. Our measurements yield a new estimate of the early evolution of cosmic star-formation rate density ($\rho_{\rm{SFR}}$) confirming the gradual decline deduced from early JWST studies, at least out to $z \simeq 12$. Finally we show that the observed early evolution of the galaxy UV LF (and $\rho_{\rm{SFR}}$) can be reproduced in a ${\rm \Lambda}$CDM Universe, with no change in dust properties or star-formation efficiency required out to $z \simeq 12$. Instead, a progressive trend towards younger stellar population ages can reproduce the observations, and the typical ages required at $z \simeq$ 8, 9, 10, and 11 all converge on $\simeq 380-330$ Myr after the Big Bang, indicative of a rapid emergence of early galaxies at $z \simeq 12 - 13$. This is consistent with the first indications of a steeper drop-off in $\rho_{\rm{SFR}}$ we find beyond $z \simeq 13$, possibly reflecting the rapid evolution of the halo mass function at earlier times.


title: Reaching Consensus in Cooperative Multi-Agent Reinforcement Learning with Goal Imagination

abstract: Reaching consensus is key to multi-agent coordination. To accomplish a cooperative task, agents need to coherently select optimal joint actions to maximize the team reward. However, current cooperative multi-agent reinforcement learning (MARL) methods usually do not explicitly take consensus into consideration, which may cause miscoordination problem. In this paper, we propose a model-based consensus mechanism to explicitly coordinate multiple agents. The proposed Multi-agent Goal Imagination (MAGI) framework guides agents to reach consensus with an Imagined common goal. The common goal is an achievable state with high value, which is obtained by sampling from the distribution of future states. We directly model this distribution with a self-supervised generative model, thus alleviating the "curse of dimensinality" problem induced by multi-agent multi-step policy rollout commonly used in model-based methods. We show that such efficient consensus mechanism can guide all agents cooperatively reaching valuable future states. Results on Multi-agent Particle-Environments and Google Research Football environment demonstrate the superiority of MAGI in both sample efficiency and performance.


title: Solving the Clustering Reasoning Problems by Modeling a Deep-Learning-Based Probabilistic Model

abstract: Visual abstract reasoning problems pose significant challenges to the perception and cognition abilities of artificial intelligence algorithms, demanding deeper pattern recognition and inductive reasoning beyond mere identification of explicit image features. Research advancements in this field often provide insights and technical support for other similar domains. In this study, we introduce PMoC, a deep-learning-based probabilistic model, achieving high reasoning accuracy in the Bongard-Logo, which stands as one of the most challenging clustering reasoning tasks. PMoC is a novel approach for constructing probabilistic models based on deep learning, which is distinctly different from previous techniques. PMoC revitalizes the probabilistic approach, which has been relatively weak in visual abstract reasoning. As a bonus, we also designed Pose-Transformer for complex visual abstract reasoning tasks. Inspired by capsule networks, it focuses on positional relationships in image data, boosting accuracy when combined with PMoC. Our Pose-Transformer effectively addresses reasoning difficulties associated with changes in the position of entities, outperforming previous models on RAVEN dataset, and the PGM dataset. RAVEN and PGM represent two significant progressive pattern reasoning problems. Finally, considering the deployment difficulties of Pose-Transformer, we introduced Straw-Pose-Transformer, a lightweight version. This study contributes to enhancing the capabilities of artificial intelligence in abstract reasoning, cognitive pattern, and probabilistic modeling of complex systems.


title: MOKA: Open-Vocabulary Robotic Manipulation through Mark-Based Visual Prompting

abstract: Open-vocabulary generalization requires robotic systems to perform tasks involving complex and diverse environments and task goals. While the recent advances in vision language models (VLMs) present unprecedented opportunities to solve unseen problems, how to utilize their emergent capabilities to control robots in the physical world remains an open question. In this paper, we present MOKA (Marking Open-vocabulary Keypoint Affordances), an approach that employs VLMs to solve robotic manipulation tasks specified by free-form language descriptions. At the heart of our approach is a compact point-based representation of affordance and motion that bridges the VLM's predictions on RGB images and the robot's motions in the physical world. By prompting a VLM pre-trained on Internet-scale data, our approach predicts the affordances and generates the corresponding motions by leveraging the concept understanding and commonsense knowledge from broad sources. To scaffold the VLM's reasoning in zero-shot, we propose a visual prompting technique that annotates marks on the images, converting the prediction of keypoints and waypoints into a series of visual question answering problems that are feasible for the VLM to solve. Using the robot experiences collected in this way, we further investigate ways to bootstrap the performance through in-context learning and policy distillation. We evaluate and analyze MOKA's performance on a variety of manipulation tasks specified by free-form language descriptions, such as tool use, deformable body manipulation, and object rearrangement.


title: Remote sensing of soil moisture using Rydberg atoms and satellite signals of opportunity

abstract: Spaceborne radar remote sensing of the earth system is essential to study natural and man-made changes in the ecosystem, water and energy cycles, weather and air quality, sea level, and surface dynamics. A major challenge with current approaches is the lack of broad spectrum tunability due to narrow band microwave electronics, that limit systems to specific science variable retrievals. This results in a significant limitation in studying dynamic coupled earth system processes such as surface and subsurface hydrology, where broad spectrum radar remote sensing is needed to sense multiple variables simultaneously. Rydberg atomic sensors are highly sensitive broad-spectrum quantum detectors that can be dynamically tuned to cover micro-to-millimeter waves with no requirement for band-specific electronics. Rydberg atomic sensors can use existing transmitted signals such as navigation and communication satellites to enable remote sensing. We demonstrate remote sensing of soil moisture, an important earth system variable, via ground-based radar reflectometry with Rydberg atomic systems. To do this, we sensitize the atoms to XM satellite radio signals and use signal correlations to demonstrate use of these satellite signals for remote sensing of soil moisture. Our approach provides a step towards satellite-based broad-spectrum Rydberg atomic remote sensing.


title: Unifying and Certifying Top-Quality Planning

abstract: The growing utilization of planning tools in practical scenarios has sparked an interest in generating multiple high-quality plans. Consequently, a range of computational problems under the general umbrella of top-quality planning were introduced over a short time period, each with its own definition. In this work, we show that the existing definitions can be unified into one, based on a dominance relation. The different computational problems, therefore, simply correspond to different dominance relations. Given the unified definition, we can now certify the top-quality of the solutions, leveraging existing certification of unsolvability and optimality. We show that task transformations found in the existing literature can be employed for the efficient certification of various top-quality planning problems and propose a novel transformation to efficiently certify loopless top-quality planning.


title: Searching for globular clusters in the inner halo of the Circinus galaxy

abstract: In this study, we search for Globular Clusters (GCs) in the inner halo of the Circinus galaxy using a combination of observational data. Our dataset includes observations from the VISTA Variables in the V\'ia L\'actea Extended Survey (VVVX), optical data from Gaia Release 3 (DR3), and observations from the Dark Energy Camera (DECam). These multiple data sources provide a comprehensive basis for our analysis. Our search was concentrated within a 50 kpc radius from the centre, leading to the identification of 93 sources that met our established criteria. To ensure the reliability of our findings, we conducted multiple examinations for sample contamination. These examinations incorporated tests based on Gaia Astrometric Excess Noise (AEN), the Blue Photometer (BP)/Red Photometer (RP) Excess Factor (BRexcess), as well as comparisons with stellar population models. This analysis confidently classified 41 sources as genuine GCs, as they successfully passed both the 3$\sigma$ Gaia AEN and BRexcess tests. We used the ISHAPE program to determine the structural parameters (half-light radii) of the GC candidates, with a peak effective radius of 4$\pm$ 0.5 pc. The catalogue mainly consists of bright GCs. Relationships between colour, size, and distance were found in the GC candidates, alongside confirmation of bi-modality in colour distributions.


title: Reduction of Cosymplectic Groupoids

abstract: There is a well-known fact in Poisson geometry that reduction commutes with integration (of the associated integrable Lie algebroid). This is also valid for other types of geometries given by 2-dimensional closed forms. In this manuscript we extend this type of result to the particular case of cosymplectic groupoids, obtaining in particular the reduction of a central extension defined by a 2-IM form and a 1-IM form.


title: Quantum 2D Liouville Path-Integral Is a Sum over Geometries in AdS$_3$ Einstein Gravity

abstract: There is a renowned solution of the modular bootstrap that defines the UV complete quantum Liouville theory. We triangulate the path-integral of this Liouville CFT on any 2D surface $\mathcal{M}$, by proposing a shrinkable boundary condition for this special CFT that allows small holes to close, analogous to the proposal in rational CFTs [1-3]. This is essentially a tensor network that admits an interpretation of a state-sum of a 3D topological theory constructed with quantum 6j symbols of $\mathcal{U}_q(SL(2,\mathbb{R}))$ with non-trivial boundary conditions, and it reduces to a sum over 3D geometries weighted by the Einstein-Hilbert action to leading order in large $c$. The boundary conditions of quantum Liouville theory specifies a very special sum over bulk geometries to faithfully reproduce the CFT path-integral. The triangulation coincides with producing a network of geodesics in the AdS bulk, which can be changed making use of the pentagon identity and orthogonality condition satisfied by the 6j symbols, and arranged into a precise holographic tensor network.

categories: hep-th cond-mat.str-el gr-qc math-ph math.MP quant-ph


title: Shuffling Momentum Gradient Algorithm for Convex Optimization

abstract: The Stochastic Gradient Descent method (SGD) and its stochastic variants have become methods of choice for solving finite-sum optimization problems arising from machine learning and data science thanks to their ability to handle large-scale applications and big datasets. In the last decades, researchers have made substantial effort to study the theoretical performance of SGD and its shuffling variants. However, only limited work has investigated its shuffling momentum variants, including shuffling heavy-ball momentum schemes for non-convex problems and Nesterov's momentum for convex settings. In this work, we extend the analysis of the shuffling momentum gradient method developed in [Tran et al (2021)] to both finite-sum convex and strongly convex optimization problems. We provide the first analysis of shuffling momentum-based methods for the strongly convex setting, attaining a convergence rate of $O(1/nT^2)$, where $n$ is the number of samples and $T$ is the number of training epochs. Our analysis is a state-of-the-art, matching the best rates of existing shuffling stochastic gradient algorithms in the literature.


title: Behavior Generation with Latent Actions

abstract: Generative modeling of complex behaviors from labeled datasets has been a longstanding problem in decision making. Unlike language or image generation, decision making requires modeling actions - continuous-valued vectors that are multimodal in their distribution, potentially drawn from uncurated sources, where generation errors can compound in sequential prediction. A recent class of models called Behavior Transformers (BeT) addresses this by discretizing actions using k-means clustering to capture different modes. However, k-means struggles to scale for high-dimensional action spaces or long sequences, and lacks gradient information, and thus BeT suffers in modeling long-range actions. In this work, we present Vector-Quantized Behavior Transformer (VQ-BeT), a versatile model for behavior generation that handles multimodal action prediction, conditional generation, and partial observations. VQ-BeT augments BeT by tokenizing continuous actions with a hierarchical vector quantization module. Across seven environments including simulated manipulation, autonomous driving, and robotics, VQ-BeT improves on state-of-the-art models such as BeT and Diffusion Policies. Importantly, we demonstrate VQ-BeT's improved ability to capture behavior modes while accelerating inference speed 5x over Diffusion Policies. Videos and code can be found https://sjlee.cc/vq-bet


title: On the computation of stable coupled state-space models for dynamic substructuring applications

abstract: This paper aims at introducing a methodology to compute stable coupled state-space models for dynamic substructuring applications by introducing two novel approaches targeted to accomplish this task: a) a procedure to impose Newtons's second law without relying on the use of undamped RCMs (residual compensation modes) and b) a novel approach to impose stability on unstable coupled state-space models. The enforcement of stability is performed by dividing the unstable model into two different models, one composed by the stable poles (stable model) and the other composed by the unstable ones (unstable model). Then, the poles of the unstable state-space model are forced to be stable, leading to the computation of a stabilized state-space model. Afterwards, to make sure that the Frequency Response Functions (FRFs) of the stabilized model well match the FRFs of the unstable model, the Least-Squares Frequency Domain (LSFD) method is exploited to update the modal parameters of the stabilized model composed by the pairs of complex conjugate poles. The validity of the proposed methodologies is presented and discussed by exploiting experimental data. Indeed, by exploiting the FRFs of a real system, accurate state-space models respecting Newton's second law are computed. Then, decoupling and coupling operations are performed with the identified state-space models, no matter the models resultant from the decoupling/coupling operations are unstable. Stability is then imposed on the computed unstable coupled model by following the approach proposed in this paper. The methodology proved to work well on these data. Moreover, the paper also shows that the coupled state-space models obtained using this methodology are suitable to be exploited in time-domain analyses and simulations.


title: How Well Can Transformers Emulate In-context Newton's Method?

abstract: Transformer-based models have demonstrated remarkable in-context learning capabilities, prompting extensive research into its underlying mechanisms. Recent studies have suggested that Transformers can implement first-order optimization algorithms for in-context learning and even second order ones for the case of linear regression. In this work, we study whether Transformers can perform higher order optimization methods, beyond the case of linear regression. We establish that linear attention Transformers with ReLU layers can approximate second order optimization algorithms for the task of logistic regression and achieve $\epsilon$ error with only a logarithmic to the error more layers. As a by-product we demonstrate the ability of even linear attention-only Transformers in implementing a single step of Newton's iteration for matrix inversion with merely two layers. These results suggest the ability of the Transformer architecture to implement complex algorithms, beyond gradient descent.


title: Realistic photon-number resolution in Gaussian Boson Sampling

abstract: Gaussian Boson Sampling (GBS) is the model of non-universal quantum computation that has already demonstrated quantum supremacy in experiments. This model entails sampling photocounting events from a multimode Gaussian state at the outputs of a linear interferometer. In this scheme, collision events -- those with more than one photon for each mode -- are infrequent. However, they are still used for validation purposes. Therefore, the limitation of realistic detectors to perfectly resolve adjacent photon numbers becomes pivotal. We have derived the photocounting probability distribution in the GBS schemes, which is applicable for use with general detectors and photocounting techniques. This probability distribution is expressed in terms of functionals of the field-quadrature covariance matrix -- e.g., Hafnian and Torontonian in the well-known special cases of photon-number resolving and on-off detectors, respectively. Based on our results, we have considered a GBS validation technique involving detectors with realistic photon-number resolution.


title: Preventing Reward Hacking with Occupancy Measure Regularization

abstract: Reward hacking occurs when an agent performs very well with respect to a "proxy" reward function (which may be hand-specified or learned), but poorly with respect to the unknown true reward. Since ensuring good alignment between the proxy and true reward is extremely difficult, one approach to prevent reward hacking is optimizing the proxy conservatively. Prior work has particularly focused on enforcing the learned policy to behave similarly to a "safe" policy by penalizing the KL divergence between their action distributions (AD). However, AD regularization doesn't always work well since a small change in action distribution at a single state can lead to potentially calamitous outcomes, while large changes might not be indicative of any dangerous activity. Our insight is that when reward hacking, the agent visits drastically different states from those reached by the safe policy, causing large deviations in state occupancy measure (OM). Thus, we propose regularizing based on the OM divergence between policies instead of AD divergence to prevent reward hacking. We theoretically establish that OM regularization can more effectively avoid large drops in true reward. Then, we empirically demonstrate in a variety of realistic environments that OM divergence is superior to AD divergence for preventing reward hacking by regularizing towards a safe policy. Furthermore, we show that occupancy measure divergence can also regularize learned policies away from reward hacking behavior. Our code and data are available at https://github.com/cassidylaidlaw/orpo


title: Towards General Computer Control: A Multimodal Agent for Red Dead Redemption II as a Case Study

abstract: Despite the success in specific tasks and scenarios, existing foundation agents, empowered by large models (LMs) and advanced tools, still cannot generalize to different scenarios, mainly due to dramatic differences in the observations and actions across scenarios. In this work, we propose the General Computer Control (GCC) setting: building foundation agents that can master any computer task by taking only screen images (and possibly audio) of the computer as input, and producing keyboard and mouse operations as output, similar to human-computer interaction. The main challenges of achieving GCC are: 1) the multimodal observations for decision-making, 2) the requirements of accurate control of keyboard and mouse, 3) the need for long-term memory and reasoning, and 4) the abilities of efficient exploration and self-improvement. To target GCC, we introduce Cradle, an agent framework with six main modules, including: 1) information gathering to extract multi-modality information, 2) self-reflection to rethink past experiences, 3) task inference to choose the best next task, 4) skill curation for generating and updating relevant skills for given tasks, 5) action planning to generate specific operations for keyboard and mouse control, and 6) memory for storage and retrieval of past experiences and known skills. To demonstrate the capabilities of generalization and self-improvement of Cradle, we deploy it in the complex AAA game Red Dead Redemption II, serving as a preliminary attempt towards GCC with a challenging target. To our best knowledge, our work is the first to enable LMM-based agents to follow the main storyline and finish real missions in complex AAA games, with minimal reliance on prior knowledge or resources. The project website is at https://baai-agents.github.io/Cradle/.


title: Reliable, Adaptable, and Attributable Language Models with Retrieval

abstract: Parametric language models (LMs), which are trained on vast amounts of web data, exhibit remarkable flexibility and capability. However, they still face practical challenges such as hallucinations, difficulty in adapting to new data distributions, and a lack of verifiability. In this position paper, we advocate for retrieval-augmented LMs to replace parametric LMs as the next generation of LMs. By incorporating large-scale datastores during inference, retrieval-augmented LMs can be more reliable, adaptable, and attributable. Despite their potential, retrieval-augmented LMs have yet to be widely adopted due to several obstacles: specifically, current retrieval-augmented LMs struggle to leverage helpful text beyond knowledge-intensive tasks such as question answering, have limited interaction between retrieval and LM components, and lack the infrastructure for scaling. To address these, we propose a roadmap for developing general-purpose retrieval-augmented LMs. This involves a reconsideration of datastores and retrievers, the exploration of pipelines with improved retriever-LM interaction, and significant investment in infrastructure for efficient training and inference.


title: Towards Democratized Flood Risk Management: An Advanced AI Assistant Enabled by GPT-4 for Enhanced Interpretability and Public Engagement

abstract: Real-time flood forecasting plays a crucial role in enabling timely and effective emergency responses. However, a significant challenge lies in bridging the gap between complex numerical flood models and practical decision-making. Decision-makers often rely on experts to interpret these models for optimizing flood mitigation strategies. And the public requires complex techniques to inquiry and understand socio-cultural and institutional factors, often hinders the public's understanding of flood risks. To overcome these challenges, our study introduces an innovative solution: a customized AI Assistant powered by the GPT-4 Large Language Model. This AI Assistant is designed to facilitate effective communication between decision-makers, the general public, and flood forecasters, without the requirement of specialized knowledge. The new framework utilizes GPT-4's advanced natural language understanding and function calling capabilities to provide immediate flood alerts and respond to various flood-related inquiries. Our developed prototype integrates real-time flood warnings with flood maps and social vulnerability data. It also effectively translates complex flood zone information into actionable risk management advice. To assess its performance, we evaluated the prototype using six criteria within three main categories: relevance, error resilience, and understanding of context. Our research marks a significant step towards a more accessible and user-friendly approach in flood risk management. This study highlights the potential of advanced AI tools like GPT-4 in democratizing information and enhancing public engagement in critical social and environmental issues.


title: On Projective Planes of Order 16 Associated with 1-rotational 2-(52, 4, 1) Designs

abstract: A maximal arc of degree k in a finite projective plane P of order q = ks is a set of (q-s+1)k points that meets every line of P in either k or 0 points. The collection of the nonempty intersections of a maximal arc with the lines of P is a resolvable Steiner 2-((q-s+1)k, k, 1) design. Necessary and sufficient conditions for a resolvable Steiner 2- design to be embeddable as a maximal arc in a projective plane were proved recently in [8]. Steiner designs associated with maximal arcs in the known projective planes of order 16 were analyzed in [6], where it was shown that some of the associated designs are embeddable in two non-isomorphic planes. Using MAGMA, we conducted an analysis to ascertain whether any of the 22 non-isomorphic 1-rotational 2-(52,4,1) designs, previously classified in [3], could be embedded in maximal arcs of degree 4 within projective planes of order 16. This paper presents a summary of our findings, revealing that precisely only one out of the the twenty-two 1-rotational designs from [3] is embeddable in a plane of order 16, being the Desarguesian plane P G(2, 16).


title: Triple-CFN: Restructuring Concept and Feature Spaces for Enhancing Abstract Reasoning Process

abstract: Visual abstract reasoning poses challenges to AI algorithms, requiring cognitive abilities beyond perception. For methodology, this study emphasizes the need to separately extract concepts and features from visual abstract reasoning problems, employing the responses of features to concepts as elements in the reasoning process. It also advocates for clear concept and feature spaces to tackle visual abstract reasoning tasks effectively. For technology, we introduce the Cross-Feature Network (CFN), a framework that separately extracts concepts and features from reasoning problems, utilizing their responses as reasoning representations. The CFN integrates a dual Expectation-Maximization process to actively seek an ideal concept space for problem-solving, yielding notable results despite limitations in generalization tasks. To overcome these limitations, we propose the Triple-CFN, maximizing feature extraction and demonstrating effectiveness in Bongard-Logo and Raven's Progressive Matrices (RPM) problems. Additionally, we present Meta Triple-CFN, which constructs a promising concept space for RPM, ensuring high reasoning accuracy and concept interpretability. Furthermore, we design the Re-space layer, defining a clear feature space for (Meta) Triple-CFN, with its unique warm-start process aiding generalization. Overall, this work advances machine intelligence through innovative network designs for abstract reasoning.


title: Generic models for genus 2 curves with real multiplication

abstract: Explicit models of families of genus 2 curves with multiplication by $\sqrt D$ are known for $D= 2, 3, 5$. We obtain generic models for genus 2 curves over $\mathbb Q$ with real multiplication in 12 new cases, including all fundamental discriminants $D < 40$. A key step in our proof is to develop an algorithm for minimisation of conic bundles fibred over $\mathbb{P}^2$. We apply this algorithm to simplify the equations for the Mestre conic associated to the generic point on the Hilbert modular surface of fundamental discriminant $D < 100$ computed by Elkies--Kumar.


title: GA-NIFS: NIRSpec reveals evidence for non-circular motions and AGN feedback in GN20

abstract: We present rest-frame optical data of the z~4 sub-millimeter galaxy GN20 obtained with JWST/NIRSpec in integral field spectroscopy (IFS) mode. The H$\alpha$ emission is asymmetric and clumpy and extends over a projected distance of more than 15 kpc. To first order, the large-scale ionised gas kinematics are consistent with a turbulent ($\sigma\sim90$ km/s), rotating disc ($v_{\rm rot}\sim500$ km/s), congruent with previous studies of its molecular and ionised gas kinematics. However, we also find clear evidence for non-circular motions in the H$\alpha$ kinematics. We discuss their possible connection with various scenarios, such as external perturbations, accretion or radial flows. In the centre of GN20, we find broad line emission (FWHM $\sim1000-2000$ km/s) in the H$\alpha$+[N II] complex, suggestive of fast, AGN-driven winds or, alternatively, of the broad-line region of an active black hole. Elevated values of [N II]$\lambda6583$/H$\alpha>0.4$ and EW(H$\alpha)>6$ \r{A}, throughout large parts of GN20 suggest that feedback from the active black hole is able to photo-ionise the interstellar medium. Our data corroborates that GN20 offers a unique opportunity to observe key processes in the evolution of the most massive present-day galaxies acting in concert, over 12 billion years ago.


title: VeriEQL: Bounded Equivalence Verification for Complex SQL Queries with Integrity Constraints

abstract: The task of SQL query equivalence checking is important in various real-world applications (including query rewriting and automated grading) that involve complex queries with integrity constraints; yet, state-of-the-art techniques are very limited in their capability of reasoning about complex features (e.g., those that involve sorting, case statement, rich integrity constraints, etc.) in real-life queries. To the best of our knowledge, we propose the first SMT-based approach and its implementation, VeriEQL, capable of proving and disproving bounded equivalence of complex SQL queries. VeriEQL is based on a new logical encoding that models query semantics over symbolic tuples using the theory of integers with uninterpreted functions. It is simple yet highly practical -- our comprehensive evaluation on over 20,000 benchmarks shows that VeriEQL outperforms all state-of-the-art techniques by more than one order of magnitude in terms of the number of benchmarks that can be proved or disproved. VeriEQL can also generate counterexamples that facilitate many downstream tasks (such as finding serious bugs in systems like MySQL and Apache Calcite).


title: MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasets

abstract: Development of multimodal interactive systems is hindered by the lack of rich, multimodal (text, images) conversational data, which is needed in large quantities for LLMs. Previous approaches augment textual dialogues with retrieved images, posing privacy, diversity, and quality constraints. In this work, we introduce \textbf{M}ultimodal \textbf{A}ugmented \textbf{G}enerative \textbf{I}mages \textbf{D}ialogues (MAGID), a framework to augment text-only dialogues with diverse and high-quality images. Subsequently, a diffusion model is applied to craft corresponding images, ensuring alignment with the identified text. Finally, MAGID incorporates an innovative feedback loop between an image description generation module (textual LLM) and image quality modules (addressing aesthetics, image-text matching, and safety), that work in tandem to generate high-quality and multi-modal dialogues. We compare MAGID to other SOTA baselines on three dialogue datasets, using automated and human evaluation. Our results show that MAGID is comparable to or better than baselines, with significant improvements in human evaluation, especially against retrieval baselines where the image database is small.


title: Concentration-compactness via profile decomposition for systems of coupled Schr\"{o}dinger equations of Hamiltonian type

abstract: We analyse Hamiltonian-type systems of second-order elliptic PDE invariant under a non-compact group and, consequently, involve a lack of compactness of the Sobolev embedding. We show that the loss of compactness can be compensated by using a concentration-compactness principle via weak profile decomposition for bounded Palais-Smale sequences in Banach spaces. Our analysis to prove the existence of ground states involves a reduction by the inversion method of the system to a fourth-order equation combined with a variational principle of a minimax nature. Among other results, including regularity and a Pohozaev-type identity, we also prove the non-existence of weak solutions for a class of Lane-Emden systems.


title: SmartSantander: IoT Experimentation over a Smart City Testbed

abstract: This paper describes the deployment and experimentation architecture of the Internet of Things experimentation facility being deployed at Santander city. The facility is implemented within the SmartSantander project, one of the projects of the Future Internet Research and Experimentation initiative of the European Commission and represents a unique in the world city-scale experimental research facility. Additionally, this facility supports typical applications and services of a smart city. Tangible results are expected to influence the definition and specification of Future Internet architecture design from viewpoints of Internet of Things and Internet of Services. The facility comprises a large number of Internet of Things devices deployed in several urban scenarios which will be federated into a single testbed. In this paper the deployment being carried out at the main location, namely Santander city, is described. Besides presenting the current deployment, in this article the main insights in terms of the architectural design of a large-scale IoT testbed are presented as well. Furthermore, solutions adopted for implementation of the different components addressing the required testbed functionalities are also sketched out. The IoT experimentation facility described in this paper is conceived to provide a suitable platform for large scale experimentation and evaluation of IoT concepts under real-life conditions.


title: Metallic mean Wang tiles II: the dynamics of an aperiodic computer chip

abstract: We consider a new family $(\mathcal{T}_n)_{n\geq1}$ of aperiodic sets of Wang tiles and we describe the dynamical properties of the set $\Omega_n$ of valid configurations $\mathbb{Z}^2\to\mathcal{T}_n$. The tiles can be defined as the different instances of a square shape computer chip whose inputs and outputs are 3-dimensional integer vectors. The family include the Ammann aperiodic set of 16 Wang tiles and gathers the hallmarks of other small aperiodic sets of Wang tiles. Notably, the tiles satisfy additive versions of equations verified by the Kari--Culik aperiodic sets of 14 and 13 Wang tiles. Also configurations in $\Omega_n$ are the codings of a $\mathbb{Z}^2$-action on a 2-dimensional torus like the Jeandel--Rao aperiodic set of 11 Wang tiles. The family broadens the relation between quadratic integers and aperiodic tilings beyond the omnipresent golden ratio as the dynamics of $\Omega_n$ involves the positive root $\beta$ of the polynomial $x^2-nx-1$, also known as the $n$-th metallic mean. We show the existence of an almost one-to-one factor map $\Omega_n\to\mathbb{T}^2$ which commutes the shift action on $\Omega_n$ with horizontal and vertical translations by $\beta$ on $\mathbb{T}^2$. The factor map can be explicitely defined by the average of the top labels from the same row of tiles as in Kari and Culik examples. The proofs are based on the minimality of $\Omega_n$ (proved in a previous article) and a polygonal partition of $\mathbb{T}^2$ which we show is a Markov partition for the toral $\mathbb{Z}^2$-action. The partition and the sets of Wang tiles are symmetric which makes them, like Penrose tilings, worthy of investigation.


title: Surface and sub-surface modifications of copper electrodes exposed to high-field conditioning at cryogenic temperatures

abstract: In order to investigate the dependence of conditioning and field-holding on temperature, three pairs of copper electrodes underwent high voltage conditioning with direct current (DC) pulses while kept at a single temperature, unique for each set (300~K, 30~K and 10~K), until saturation field for each set was found. The sets conditioned at cold showed a significant increase in the field holding capability, reaching fields up to 147 MV/m after tens of millions of pulses and very few breakdowns (BDs). We interpret this as an indication of the conditioning effect being due to high field pulsing rather than exposure to BDs. The effect of the warm and cold conditioning was investigated with high-resolution microscopy, characterizing the BD spots on the anode and cathode according to their morphology and with scanning transmission electron microscopy (STEM) analyzing the changes in the sub-surface regions. Atypical BD spot features were found on the cryogenically conditioned cathode surfaces, with very shallow craters of a star-like shape. The number of atypical spots increased with decreased temperatures, reaching 26 and 53 percent of the total number of spots at 30~K and 10~K, respectively. A hypothesis explaining the formation of these features is also presented. The very different morphology of the anode and cathode BD spots is presented in detail that suggesting an unknown shielding mechanism that prevents the center of the anode spot from melting. These results provide important experimental input for the development of quantitative theories and models for BD initiation and inter-electrode plasma formation.


title: Operator Learning Renormalization Group

abstract: In this paper, we present a general framework for quantum many-body simulations called the operator learning renormalization group (OLRG). Inspired by machine learning perspectives, OLRG is a generalization of Wilson's numerical renormalization group and White's density matrix renormalization group, which recursively builds a simulatable system to approximate a target system of the same number of sites via operator maps. OLRG uses a loss function to minimize the error of a target property directly by learning the operator map in lieu of a state ansatz. This loss function is designed by a scaling consistency condition that also provides a provable bound for real-time evolution. We implement two versions of the operator maps for classical and quantum simulations. The former, which we call the Operator Matrix Map, can be implemented via neural networks on classical computers. The latter, which we call the Hamiltonian Expression Map, generates device pulse sequences to leverage the capabilities of quantum computing hardware. We illustrate the performance of both maps for calculating time-dependent quantities in the quantum Ising model Hamiltonian.


title: Concavity Properties of Solutions of Elliptic Equations under Conformal Deformations

abstract: We study the Dirichlet problem for the weighted Schr\"odinger operator \[-\Delta u +Vu = \lambda \rho u,\] where $\rho$ is a positive weighting function and $V$ is a potential. Such equations appear naturally in conformal geometry and in the composite membrane problem. Our primary goal is to establish concavity estimates for the principle eigenfunction with respect to conformal connections. Doing so, we obtain new bounds on the fundamental gap problem, which is the difference between the first and second eigenvalues. In particular, we partially resolve a conjecture of Nguyen, Stancu and Wei [IMRN 2022] on the fundamental gap of horoconvex domains. In addition, we obtain a power convexity estimate for solutions to the torsion problem in spherical geometry on convex domains which are not too large.


title: Site Symmetry and Multiorbital Flat Bands on Kagome and Pyrochlore Lattices

abstract: Flat bands in electronic band structures are intriguing platforms for strong correlation and topological physics, primarily due to the suppressed kinetic energy of electrons. Various methods have been developed to create flat bands, utilizing lattice geometry or finely tuned parameters. Despite this, the investigation of orbital symmetry in multiorbital materials is a relatively new area of focus. In this work, we propose a site symmetry based systematic approach to emerging multiorbital flat bands in lattices made of corner-connecting motifs such as the kagome and pyrochlore lattices. As a conceptual advance, the one-orbital flat bands are shown to originate as mutual eigenstates of isolated molecular motifs. Further developing the mutual eigenstate method for multiorbitals transforming differently under the site symmetries such as mirror and inversion, we derive multiorbital flat bands from the skew-symmetric interorbital Hamiltonian and introduce an isolated molecule enabled group-theoretic description of the flat band wavefunctions. Realizations of the multiorbital flatbands in relevant materials are shown to be possible under the Slater-Koster formalism. Our findings provide new directions for exploring flatband electronic structures for novel correlated and topological quantum states.


title: Quantum superpositions of current states in Rydberg-atom networks

abstract: Quantum simulation of many-body quantum systems using Rydberg-atom platforms has become of extreme interest in the last years. The possibility to realize spin Hamiltonians and the accurate control at the single atom level paved the way for the study of quantum phases of matter and dynamics. Here, we propose a quantum optimal control protocol to engineer current states: quantum states characterized by Rydberg excitations propagating in a given spatially closed tweezer networks. Indeed, current states with different winding numbers can be generated on demand. Besides those ones with single winding number, superposition of quantum current states characterized by more winding numbers can be obtained. The single current states are eigenstates of the current operator that therefore can define an observable that remains persistent at any time. In particular, the features of the excitations dynamics reflects the nature of current states, a fact that in principle can be used to characterize the nature of the flow experimentally without the need of accessing high order correlators.


title: CLEVR-POC: Reasoning-Intensive Visual Question Answering in Partially Observable Environments

abstract: The integration of learning and reasoning is high on the research agenda in AI. Nevertheless, there is only a little attention to use existing background knowledge for reasoning about partially observed scenes to answer questions about the scene. Yet, we as humans use such knowledge frequently to infer plausible answers to visual questions (by eliminating all inconsistent ones). Such knowledge often comes in the form of constraints about objects and it tends to be highly domain or environment-specific. We contribute a novel benchmark called CLEVR-POC for reasoning-intensive visual question answering (VQA) in partially observable environments under constraints. In CLEVR-POC, knowledge in the form of logical constraints needs to be leveraged to generate plausible answers to questions about a hidden object in a given partial scene. For instance, if one has the knowledge that all cups are colored either red, green or blue and that there is only one green cup, it becomes possible to deduce the color of an occluded cup as either red or blue, provided that all other cups, including the green one, are observed. Through experiments, we observe that the low performance of pre-trained vision language models like CLIP (~ 22%) and a large language model (LLM) like GPT-4 (~ 46%) on CLEVR-POC ascertains the necessity for frameworks that can handle reasoning-intensive tasks where environment-specific background knowledge is available and crucial. Furthermore, our demonstration illustrates that a neuro-symbolic model, which integrates an LLM like GPT-4 with a visual perception network and a formal logical reasoner, exhibits exceptional performance on CLEVR-POC.


title: Non-Gaussian two mode squeezed thermal states in continuous variable quantum teleportation

abstract: While photon catalyzed two mode squeezed vacuum state has been considered in context of quantum teleportation, similar studies have not been yet conducted for photon catalyzed two-mode squeezed thermal (TMST) state. This can be attributed to challenges involved in the evaluation of teleportation fidelity for photon catalyzed TMST state. In this article, we consider a practical scheme for the implementation of non-Gaussian operation, viz., photon subtraction, photon addition, and photon catalysis, on TMST state. The generated states are employed as resources in continuous-variable quantum teleportation. The results show that the three non-Gaussian operations can enhance the teleportation fidelity. Considering the success probability of the non-Gaussian operations, we identify single-photon catalysis and single photon subtraction to be optimal for teleporting input coherent states, at low and intermediate squeezing levels.


title: Finding Super-spreaders in Network Cascades

abstract: Suppose that a cascade (e.g., an epidemic) spreads on an unknown graph, and only the infection times of vertices are observed. What can be learned about the graph from the infection times caused by multiple distinct cascades? Most of the literature on this topic focuses on the task of recovering the entire graph, which requires $\Omega ( \log n)$ cascades for an $n$-vertex bounded degree graph. Here we ask a different question: can the important parts of the graph be estimated from just a few (i.e., constant number) of cascades, even as $n$ grows large? In this work, we focus on identifying super-spreaders (i.e., high-degree vertices) from infection times caused by a Susceptible-Infected process on a graph. Our first main result shows that vertices of degree greater than $n^{3/4}$ can indeed be estimated from a constant number of cascades. Our algorithm for doing so leverages a novel connection between vertex degrees and the second derivative of the cumulative infection curve. Conversely, we show that estimating vertices of degree smaller than $n^{1/2}$ requires at least $\log(n) / \log \log (n)$ cascades. Surprisingly, this matches (up to $\log \log n$ factors) the number of cascades needed to learn the \emph{entire} graph if it is a tree.

categories: math.ST cs.IT cs.SI math.IT math.PR stat.TH


title: Scaling Rectified Flow Transformers for High-Resolution Image Synthesis

abstract: Diffusion models create data from noise by inverting the forward paths of data towards noise and have emerged as a powerful generative modeling technique for high-dimensional, perceptual data such as images and videos. Rectified flow is a recent generative model formulation that connects data and noise in a straight line. Despite its better theoretical properties and conceptual simplicity, it is not yet decisively established as standard practice. In this work, we improve existing noise sampling techniques for training rectified flow models by biasing them towards perceptually relevant scales. Through a large-scale study, we demonstrate the superior performance of this approach compared to established diffusion formulations for high-resolution text-to-image synthesis. Additionally, we present a novel transformer-based architecture for text-to-image generation that uses separate weights for the two modalities and enables a bidirectional flow of information between image and text tokens, improving text comprehension, typography, and human preference ratings. We demonstrate that this architecture follows predictable scaling trends and correlates lower validation loss to improved text-to-image synthesis as measured by various metrics and human evaluations. Our largest models outperform state-of-the-art models, and we will make our experimental data, code, and model weights publicly available.


title: Thomas K. Gaisser, a Pioneer of Particle Astrophysics

abstract: We describe the pioneering contributions of Thomas K. Gaisser to the birth and development of particle astrophysics, a new field of research at the intersection of cosmic ray physics, astronomy, astrophysics, and particle physics that has emerged in the last few decades. We will especially focus on his studies of natural beams of neutrinos: those generated by the interactions of cosmic rays in the Earth's atmosphere and those emitted by astrophysical sources. Tom actively participated in the discovery of these cosmic neutrinos as well. His contributions also extend to gamma-ray astronomy, the study of the cosmic ray spectra and composition, and the modeling of cosmic ray interactions in the atmosphere and in astrophysical environments. Tom invariably focused his research on the theoretical and phenomenological problems of greatest interest at the time, producing frameworks that transparently interpreted often complex data. These studies have been very influential and have shaped the development of the field.


title: Active Statistical Inference

abstract: Inspired by the concept of active learning, we propose active inference$\unicode{x2013}$a methodology for statistical inference with machine-learning-assisted data collection. Assuming a budget on the number of labels that can be collected, the methodology uses a machine learning model to identify which data points would be most beneficial to label, thus effectively utilizing the budget. It operates on a simple yet powerful intuition: prioritize the collection of labels for data points where the model exhibits uncertainty, and rely on the model's predictions where it is confident. Active inference constructs provably valid confidence intervals and hypothesis tests while leveraging any black-box machine learning model and handling any data distribution. The key point is that it achieves the same level of accuracy with far fewer samples than existing baselines relying on non-adaptively-collected data. This means that for the same number of collected samples, active inference enables smaller confidence intervals and more powerful p-values. We evaluate active inference on datasets from public opinion research, census analysis, and proteomics.


title: Moment estimates, exponential integrability, concentration inequalities and exit times estimates on evolving manifolds

abstract: On a smooth (not necessarily compact) manifold $M$ equipped with a $\sf C^1$-family of complete Riemannian metrics $g(t)$ and a $\sf C^{1,\infty}$-family of vector fields $Z(t)$ both indexed by the real interval $[0,T)$ where $T \in (0,\infty]$, we prove moment estimates, exponential integrability, concentration inequalities and exit times estimates for diffusions on complete evolving Riemannian manifolds.


title: Anomalous continuum scattering and higher-order van Hove singularity in the strongly anisotropic S = 1/2 triangular lattice antiferromagnet

abstract: The S = 1/2 triangular lattice antiferromagnet (TLAF) stands out as a paradigmatic example of frustrated quantum magnetism. An ongoing challenge involves understanding the influence of exchange anisotropy on the collective behavior within such systems. Using inelastic neutron scattering (INS) and advanced calculation techniques, we have studied the low and high temperature spin dynamics of Ba2La2CoTe2O12 (BLCTO): a Co2+-based Jeff = 1/2 TLAF that exhibits 120 deg order below TN = 3.26 K. The spin Hamiltonian was determined by fitting the energy-resolved paramagnetic excitations measured at T > TN, revealing an exceptionally strong easy-plane XXZ exchange anisotropy. Below TN, the excitation spectrum exhibits a high energy continuum having a larger spectral weight than the single-magnon modes. Combined with advanced theoretical calculations of magnetic excitations based on magnons and spinons, this observation suggests a scenario characterized by a spinon confinement length that markedly exceeds the lattice spacing. We conjecture that this phenomenon arises due to the proximity to a quantum melting point, which persists even in the presence of strong easy-plane XXZ anisotropy. Finally, we highlight characteristic flat features in the excitation spectrum, which are connected to higher-order van Hove singularities in the magnon dispersion and are directly induced by easy-plane XXZ anisotropy. Our results provide a rare experimental insight into the nature of highly anisotropic S = 1/2 TLAFs between the Heisenberg and XY limits.


title: Extension Theory and Fermionic Strongly Fusion 2-Categories

abstract: We study group graded extensions of fusion 2-categories. As an application, we obtain a homotopy theoretic classification of fermionic strongly fusion 2-categories. We examine various examples in detail.


title: Performance of a modular ton-scale pixel-readout liquid argon time projection chamber

abstract: The Module-0 Demonstrator is a single-phase 600 kg liquid argon time projection chamber operated as a prototype for the DUNE liquid argon near detector. Based on the ArgonCube design concept, Module-0 features a novel 80k-channel pixelated charge readout and advanced high-coverage photon detection system. In this paper, we present an analysis of an eight-day data set consisting of 25 million cosmic ray events collected in the spring of 2021. We use this sample to demonstrate the imaging performance of the charge and light readout systems as well as the signal correlations between the two. We also report argon purity and detector uniformity measurements, and provide comparisons to detector simulations.


title: On the computation of lattice sums without translational invariance

abstract: This paper introduces a new method for the efficient computation of oscillatory multidimensional lattice sums in geometries with boundaries. Such sums are ubiquitous in both pure and applied mathematics, and have immediate applications in condensed matter physics and topological quantum physics. The challenge in their evaluation results from the combination of singular long-range interactions with the loss of translational invariance caused by the boundaries, rendering standard tools ineffective. Our work shows that these lattice sums can be generated from a generalization of the Riemann zeta function to multidimensional non-periodic lattice sums. We put forth a new representation of this zeta function together with a numerical algorithm that ensures exponential convergence across an extensive range of geometries. Notably, our method's runtime is influenced only by the complexity of the considered geometries and not by the number of particles, providing the foundation for efficient simulations of macroscopic condensed matter systems. We showcase the practical utility of our method by computing interaction energies in a three-dimensional crystal structure with $3\times 10^{23}$ particles. Our method's accuracy is demonstrated through extensive numerical experiments. A reference implementation is provided online along with this article.


title: Out of Time Order Correlation of the Hubbard Model with Random Local Disorder

abstract: The out of time order correlator (OTOC) serves as a powerful tool for investigating quantum information spreading and chaos in complex systems. We present a method employing non-equilibrium dynamical mean-field theory (DMFT) and coherent potential approximation (CPA) combined with diagrammatic perturbation on the Schwinger-Keldysh contour to calculate the OTOC for correlated fermionic systems subjected to both random disorder and electrons interaction. Our key finding is that random disorder enhances the OTOC decay in the Hubbard model for the metallic phase in the weak coupling limit. However, the current limitation of our perturbative solver restricts the applicability to weak interaction regimes.


title: A Safety-Critical Framework for UGVs in Complex Environments: A Data-Driven Discrepancy-Aware Approach

abstract: This work presents a novel data-driven multi-layered planning and control framework for the safe navigation of a class of unmanned ground vehicles (UGVs) in the presence of unknown stationary obstacles and additive modeling uncertainties. The foundation of this framework is a novel robust model predictive planner, designed to generate optimal collision-free trajectories given an occupancy grid map, and a paired ancillary controller, augmented to provide robustness against model uncertainties extracted from learning data. To tackle modeling discrepancies, we identify both matched (input discrepancies) and unmatched model residuals between the true and the nominal reduced-order models using closed-loop tracking errors as training data. Utilizing conformal prediction, we extract probabilistic upper bounds for the unknown model residuals, which serve to construct a robustifying ancillary controller. Further, we also determine maximum tracking discrepancies, also known as the robust control invariance tube, under the augmented policy, formulating them as collision buffers. Employing a LiDAR-based occupancy map to characterize the environment, we construct a discrepancy-aware cost map that incorporates these collision buffers. This map is then integrated into a sampling-based model predictive path planner that generates optimal and safe trajectories that can be robustly tracked by the augmented ancillary controller in the presence of model mismatches. The effectiveness of the framework is experimentally validated for autonomous high-speed trajectory tracking in a cluttered environment with four different vehicle-terrain configurations. We also showcase the framework's versatility by reformulating it as a driver-assist program, providing collision avoidance corrections based on user joystick commands.


title: On the (non-)degeneracy of massive neutrinos and elastic interactions in the dark sector

abstract: Cosmological models featuring an elastic interaction in the dark sector at linear order has been shown to provide a promising scenario for alleviating the $\sigma_8$ tension. A natural question for these scenarios is whether there could be a degeneracy between the interaction and massive neutrinos that also contribute to erasing structures at late times. In this work we investigate the presence of such a degeneracy and show that the two effects do not exhibit strong correlations.


title: Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusion

abstract: 3D patient body modeling is critical to the success of automated patient positioning for smart medical scanning and operating rooms. Existing CNN-based end-to-end patient modeling solutions typically require a) customized network designs demanding large amount of relevant training data, covering extensive realistic clinical scenarios (e.g., patient covered by sheets), which leads to suboptimal generalizability in practical deployment, b) expensive 3D human model annotations, i.e., requiring huge amount of manual effort, resulting in systems that scale poorly. To address these issues, we propose a generic modularized 3D patient modeling method consists of (a) a multi-modal keypoint detection module with attentive fusion for 2D patient joint localization, to learn complementary cross-modality patient body information, leading to improved keypoint localization robustness and generalizability in a wide variety of imaging (e.g., CT, MRI etc.) and clinical scenarios (e.g., heavy occlusions); and (b) a self-supervised 3D mesh regression module which does not require expensive 3D mesh parameter annotations to train, bringing immediate cost benefits for clinical deployment. We demonstrate the efficacy of the proposed method by extensive patient positioning experiments on both public and clinical data. Our evaluation results achieve superior patient positioning performance across various imaging modalities in real clinical scenarios.


title: The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning

abstract: The White House Executive Order on Artificial Intelligence highlights the risks of large language models (LLMs) empowering malicious actors in developing biological, cyber, and chemical weapons. To measure these risks of malicious use, government institutions and major AI labs are developing evaluations for hazardous capabilities in LLMs. However, current evaluations are private, preventing further research into mitigating risk. Furthermore, they focus on only a few, highly specific pathways for malicious use. To fill these gaps, we publicly release the Weapons of Mass Destruction Proxy (WMDP) benchmark, a dataset of 3,668 multiple-choice questions that serve as a proxy measurement of hazardous knowledge in biosecurity, cybersecurity, and chemical security. WMDP was developed by a consortium of academics and technical consultants, and was stringently filtered to eliminate sensitive information prior to public release. WMDP serves two roles: first, as an evaluation for hazardous knowledge in LLMs, and second, as a benchmark for unlearning methods to remove such hazardous knowledge. To guide progress on unlearning, we develop RMU, a state-of-the-art unlearning method based on controlling model representations. RMU reduces model performance on WMDP while maintaining general capabilities in areas such as biology and computer science, suggesting that unlearning may be a concrete path towards reducing malicious use from LLMs. We release our benchmark and code publicly at https://wmdp.ai


title: LC-Tsallis-INF: Generalized Best-of-Both-Worlds Linear Contextual Bandits

abstract: This study considers the linear contextual bandit problem with independent and identically distributed (i.i.d.) contexts. In this problem, existing studies have proposed Best-of-Both-Worlds (BoBW) algorithms whose regrets satisfy $O(\log^2(T))$ for the number of rounds $T$ in a stochastic regime with a suboptimality gap lower-bounded by a positive constant, while satisfying $O(\sqrt{T})$ in an adversarial regime. However, the dependency on $T$ has room for improvement, and the suboptimality-gap assumption can be relaxed. For this issue, this study proposes an algorithm whose regret satisfies $O(\log(T))$ in the setting when the suboptimality gap is lower-bounded. Furthermore, we introduce a margin condition, a milder assumption on the suboptimality gap. That condition characterizes the problem difficulty linked to the suboptimality gap using a parameter $\beta \in (0, \infty]$. We then show that the algorithm's regret satisfies $O\left(\left\{\log(T)\right\}^{\frac{1+\beta}{2+\beta}}T^{\frac{1}{2+\beta}}\right)$. Here, $\beta= \infty$ corresponds to the case in the existing studies where a lower bound exists in the suboptimality gap, and our regret satisfies $O(\log(T))$ in that case. Our proposed algorithm is based on the Follow-The-Regularized-Leader with the Tsallis entropy and referred to as the $\alpha$-Linear-Contextual (LC)-Tsallis-INF.


title: How much information can be extracted from galaxy clustering at the field level?

abstract: We present optimal Bayesian field-level cosmological constraints from nonlinear tracers of the large-scale structure, specifically the amplitude $\sigma_8$ of linear matter fluctuations inferred from rest-frame simulated dark matter halos in a comoving volume of $8\,(h^{-1}\mathrm{Gpc})^3$. Our constraint on $\sigma_8$ is entirely due to nonlinear information, and obtained by explicitly sampling the initial conditions along with bias and noise parameters via a Lagrangian EFT-based forward model, LEFTfield. The comparison with a simulation-based inference analysis employing the power spectrum and bispectrum -- likewise using the LEFTfield forward model -- shows that, when including precisely the same modes of the same data up to $k_{\mathrm{max}}= 0.10\,h\,\mathrm{Mpc}^{-1}$ ($0.12\,h\,\mathrm{Mpc}^{-1}$), the field-level approach yields a factor of 3.5 (5.2) improvement on the $\sigma_8$ constraint, from 20.0% to 5.7% (17.0% to 3.3%). This study provides direct insights into cosmological information encoded in galaxy clustering beyond low-order $n$-point functions.


title: FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimation

abstract: Estimating relative camera poses between images has been a central problem in computer vision. Methods that find correspondences and solve for the fundamental matrix offer high precision in most cases. Conversely, methods predicting pose directly using neural networks are more robust to limited overlap and can infer absolute translation scale, but at the expense of reduced precision. We show how to combine the best of both methods; our approach yields results that are both precise and robust, while also accurately inferring translation scales. At the heart of our model lies a Transformer that (1) learns to balance between solved and learned pose estimations, and (2) provides a prior to guide a solver. A comprehensive analysis supports our design choices and demonstrates that our method adapts flexibly to various feature extractors and correspondence estimators, showing state-of-the-art performance in 6DoF pose estimation on Matterport3D, InteriorNet, StreetLearn, and Map-free Relocalization.


title: Knowledge-guided EEG Representation Learning

abstract: Self-supervised learning has produced impressive results in multimedia domains of audio, vision and speech. This paradigm is equally, if not more, relevant for the domain of biosignals, owing to the scarcity of labelled data in such scenarios. The ability to leverage large-scale unlabelled data to learn robust representations could help improve the performance of numerous inference tasks on biosignals. Given the inherent domain differences between multimedia modalities and biosignals, the established objectives for self-supervised learning may not translate well to this domain. Hence, there is an unmet need to adapt these methods to biosignal analysis. In this work we propose a self-supervised model for EEG, which provides robust performance and remarkable parameter efficiency by using state space-based deep learning architecture. We also propose a novel knowledge-guided pre-training objective that accounts for the idiosyncrasies of the EEG signal. The results indicate improved embedding representation learning and downstream performance compared to prior works on exemplary tasks. Also, the proposed objective significantly reduces the amount of pre-training data required to obtain performance equivalent to prior works.


title: Exact Enforcement of Temporal Continuity in Sequential Physics-Informed Neural Networks

abstract: The use of deep learning methods in scientific computing represents a potential paradigm shift in engineering problem solving. One of the most prominent developments is Physics-Informed Neural Networks (PINNs), in which neural networks are trained to satisfy partial differential equations (PDEs). While this method shows promise, the standard version has been shown to struggle in accurately predicting the dynamic behavior of time-dependent problems. To address this challenge, methods have been proposed that decompose the time domain into multiple segments, employing a distinct neural network in each segment and directly incorporating continuity between them in the loss function of the minimization problem. In this work we introduce a method to exactly enforce continuity between successive time segments via a solution ansatz. This hard constrained sequential PINN (HCS-PINN) method is simple to implement and eliminates the need for any loss terms associated with temporal continuity. The method is tested for a number of benchmark problems involving both linear and non-linear PDEs. Examples include various first order time dependent problems in which traditional PINNs struggle, namely advection, Allen-Cahn, and Korteweg-de Vries equations. Furthermore, second and third order time-dependent problems are demonstrated via wave and Jerky dynamics examples, respectively. Notably, the Jerky dynamics problem is chaotic, making the problem especially sensitive to temporal accuracy. The numerical experiments conducted with the proposed method demonstrated superior convergence and accuracy over both traditional PINNs and the soft-constrained counterparts.


title: Reinforcement Learning Jazz Improvisation: When Music Meets Game Theory

abstract: Live performances of music are always charming, with the unpredictability of improvisation due to the dynamic between musicians and interactions with the audience. Jazz improvisation is a particularly noteworthy example for further investigation from a theoretical perspective. Here, we introduce a novel mathematical game theory model for jazz improvisation, providing a framework for studying music theory and improvisational methodologies. We use computational modeling, mainly reinforcement learning, to explore diverse stochastic improvisational strategies and their paired performance on improvisation. We find that the most effective strategy pair is a strategy that reacts to the most recent payoff (Stepwise Changes) with a reinforcement learning strategy limited to notes in the given chord (Chord-Following Reinforcement Learning). Conversely, a strategy that reacts to the partner's last note and attempts to harmonize with it (Harmony Prediction) strategy pair yields the lowest non-control payoff and highest standard deviation, indicating that picking notes based on immediate reactions to the partner player can yield inconsistent outcomes. On average, the Chord-Following Reinforcement Learning strategy demonstrates the highest mean payoff, while Harmony Prediction exhibits the lowest. Our work lays the foundation for promising applications beyond jazz: including the use of artificial intelligence (AI) models to extract data from audio clips to refine musical reward systems, and training machine learning (ML) models on existing jazz solos to further refine strategies within the game.

categories: physics.soc-ph cs.AI cs.LG cs.SD eess.AS


title: More Sample-Efficient Tuning of Particle Accelerators with Bayesian Optimization and Prior Mean Models

abstract: Tuning particle accelerators is a challenging and time-consuming task, but can be automated and carried out efficiently through the use of suitable optimization algorithms. With successful applications at various facilities, Bayesian optimization using Gaussian process modeling has proven to be a particularly powerful tool to address these challenges in practice. One of its major benefits is that it allows incorporating prior information, such as knowledge about the shape of the objective function or predictions based on archived data, simulations or surrogate models, into the model. In this work, we propose the use of a neural network model as an efficient way to include prior knowledge about the objective function into the Bayesian optimization process to speed up convergence. We report results obtained in simulations and experiments using neural network priors to perform optimization of electron and heavy-ion accelerator facilities, specifically the Linac Coherent Light Source and the Argonne Tandem Linear Accelerator System. Finally, we evaluate how the accuracy of the prior mean predictions affect optimization performance.


title: RMP screening in JOREK-CARIDDI

abstract: Edge localized modes (ELMs) are instabilities at the tokamak edge that can have short outbursts of highly energetic particles and heat, which can severely damage the walls of a plasma reactor. Resonant magnetic perturbations (RMPs) are used to mitigate or eliminate ELMs from the plasma. One effect that can reduce the intensity of the RMP is screening, which is caused by eddy currents in conducting structures or a plasma that are induced by a time-varying magnetic field. The eddy current code CARIDDI was recently coupled with the magnetohydrodynamics (MHD) code JOREK, and is able to capture the behavior of volumetric conducting structures that surround a plasma. The objective of this study is to characterize screening behavior in the JOREK-CARIDDI coupling. The analysis is divided in three parts. First, CARIDDI results are benchmarked against results from STARWALL, another JOREK extension that captures interactions of (two-dimensional) conducting structures. It is found that CARIDDI and STARWALL show good agreement, with slight variations. The second part covers the screening of time-varying RMP fields by conducting structures, oscillating at frequencies from 3 Hz to 10 kHz. The overall trends in screening behavior align qualitatively with findings from a previous analysis. However, an additional contribution to the screening at frequencies above 1 kHz was not observed, because the simulation in this report does not include screening by the RMP coil casing. Finally, a few tests were performed using a plasma configuration, to study the effect of plasma screening, including realistic plasma background flows. The results demonstrated the induction of eddy currents at rational surfaces within the plasma. These results contribute to an improved understanding of the screening of RMP fields, which is relevant for several applications to the operation of fusion reactors.


title: On GR dragging and effective galactic dark matter

abstract: In recent years, there has been an increase in the number of papers regarding general-relativistic explanations for the dark matter phenomena in disc galaxies. The main focus of this scientific discussion is whether a previously unexamined relativistic dragging vortex could support flat rotation curves, with various research groups taking different stances on its feasibility. In this paper, we discuss the different points of view by placing the various arguments within a general theoretical context. We explicitly state the conceptual assumptions, and indicate what we believe to be the correct interpretation for the physical quantities of interest. We show how the dragging conjecture fails under certain hypotheses, and discuss the flaws of the most common dragging models: the linearised gravitomagnetic description and the one of Balasin&Grumiller. On the other hand, we illustrate how to avoid failure scenarios for the conjecture, emphasizing the features for a physically reasonable disc galaxy dragging model. In particular, we stress that the non-linearities of the Einstein Equations must play an essential role in generating what we define as ``pseudo-solitonic" solutions -- the only non-trivial physically viable solutions for the class of models considered. Furthermore, the dragging vortex is proven to show important contributions to the gravitational lensing in these models, thus providing an ulterior measure of its relevance. Moreover, by qualitatively exploring these pseudo-solitonic solutions, we find that a dragging speed of just a few kilometers per second would be enough to explain a non-negligible fraction of the galactic dark matter. Finally, we propose and analyse the feasibility of three independent measurements which could be carried out to detect the presence of dragging vortices in disc galaxies.


title: Multiwinner Elections and the Spoiler Effect

abstract: In the popular debate over the use of ranked-choice voting, it is often claimed that the method of single transferable vote (STV) is immune or mostly immune to the so-called ``spoiler effect,'' where the removal of a losing candidate changes the set of winners. This claim has previously been studied only in the single-winner case. We investigate how susceptible STV is to the spoiler effect in multiwinner elections, where the output of the voting method is a committee of size at least two. To evaluate STV we compare it to numerous other voting methods including single non-transferable vote, $k$-Borda, and the Chamberlin-Courant rule. We provide simulation results under three different random models and empirical results using a large database of real-world multiwinner political elections from Scotland. Our results show that STV is not spoiler-proof in any meaningful sense in the multiwinner context, but it tends to perform well relative to other methods, especially when using real-world ballot data.


title: Embracing Uncertainty Flexibility: Harnessing a Supervised Tree Kernel to Empower Ensemble Modelling for 2D Echocardiography-Based Prediction of Right Ventricular Volume

abstract: The right ventricular (RV) function deterioration strongly predicts clinical outcomes in numerous circumstances. To boost the clinical deployment of ensemble regression methods that quantify RV volumes using tabular data from the widely available two-dimensional echocardiography (2DE), we propose to complement the volume predictions with uncertainty scores. To this end, we employ an instance-based method which uses the learned tree structure to identify the nearest training samples to a target instance and then uses a number of distribution types to more flexibly model the output. The probabilistic and point-prediction performances of the proposed framework are evaluated on a relatively small-scale dataset, comprising 100 end-diastolic and end-systolic RV volumes. The reference values for point performance were obtained from MRI. The results demonstrate that our flexible approach yields improved probabilistic and point performances over other state-of-the-art methods. The appropriateness of the proposed framework is showcased by providing exemplar cases. The estimated uncertainty embodies both aleatoric and epistemic types. This work aligns with trustworthy artificial intelligence since it can be used to enhance the decision-making process and reduce risks. The feature importance scores of our framework can be exploited to reduce the number of required 2DE views which could enhance the proposed pipeline's clinical application.


title: Large language models surpass human experts in predicting neuroscience results

abstract: Scientific discoveries often hinge on synthesizing decades of research, a task that potentially outstrips human information processing capacities. Large language models (LLMs) offer a solution. LLMs trained on the vast scientific literature could potentially integrate noisy yet interrelated findings to forecast novel results better than human experts. To evaluate this possibility, we created BrainBench, a forward-looking benchmark for predicting neuroscience results. We find that LLMs surpass experts in predicting experimental outcomes. BrainGPT, an LLM we tuned on the neuroscience literature, performed better yet. Like human experts, when LLMs were confident in their predictions, they were more likely to be correct, which presages a future where humans and LLMs team together to make discoveries. Our approach is not neuroscience-specific and is transferable to other knowledge-intensive endeavors.