title: Algorithmic syntactic causal identification

abstract: Causal identification in causal Bayes nets (CBNs) is an important tool in causal inference allowing the derivation of interventional distributions from observational distributions where this is possible in principle. However, most existing formulations of causal identification using techniques such as d-separation and do-calculus are expressed within the mathematical language of classical probability theory on CBNs. However, there are many causal settings where probability theory and hence current causal identification techniques are inapplicable such as relational databases, dataflow programs such as hardware description languages, distributed systems and most modern machine learning algorithms. We show that this restriction can be lifted by replacing the use of classical probability theory with the alternative axiomatic foundation of symmetric monoidal categories. In this alternative axiomatization, we show how an unambiguous and clean distinction can be drawn between the general syntax of causal models and any specific semantic implementation of that causal model. This allows a purely syntactic algorithmic description of general causal identification by a translation of recent formulations of the general ID algorithm through fixing. Our description is given entirely in terms of the non-parametric ADMG structure specifying a causal model and the algebraic signature of the corresponding monoidal category, to which a sequence of manipulations is then applied so as to arrive at a modified monoidal category in which the desired, purely syntactic interventional causal model, is obtained. We use this idea to derive purely syntactic analogues of classical back-door and front-door causal adjustment, and illustrate an application to a more complex causal model.


title: Universal Definitions of the Roman Factorial: Introduction to Foundational Functions and the Generalization Process

abstract: This paper introduces a new method for redefining the Roman factorial using universally applicable functions that are not expressed in closed form. We present a set of foundational functions, similar to Boolean operations, to simplify the factorial expression. Through a systematic process of generalization, termed generalization process, we aim to use these foundational functions to create recursive and non-recursive, global definitions of the Roman factorial.


title: High-dimensional expansion and soficity of groups

abstract: For $d \geq 4$ and $p$ a sufficiently large prime, we construct a lattice $\Gamma \leq {\rm PSp}_{2d}(\mathbb Q_p),$ such that its universal central extension cannot be sofic if $\Gamma$ satisfies some weak form of stability in permutations. In the proof, we make use of high-dimensional expansion phenomena and, extending results of Lubotzky, we construct new examples of cosystolic expanders over arbitrary finite abelian groups.


title: ExploRLLM: Guiding Exploration in Reinforcement Learning with Large Language Models

abstract: In image-based robot manipulation tasks with large observation and action spaces, reinforcement learning struggles with low sample efficiency, slow training speed, and uncertain convergence. As an alternative, large pre-trained foundation models have shown promise in robotic manipulation, particularly in zero-shot and few-shot applications. However, using these models directly is unreliable due to limited reasoning capabilities and challenges in understanding physical and spatial contexts. This paper introduces ExploRLLM, a novel approach that leverages the inductive bias of foundation models (e.g. Large Language Models) to guide exploration in reinforcement learning. We also exploit these foundation models to reformulate the action and observation spaces to enhance the training efficiency in reinforcement learning. Our experiments demonstrate that guided exploration enables much quicker convergence than training without it. Additionally, we validate that ExploRLLM outperforms vanilla foundation model baselines and that the policy trained in simulation can be applied in real-world settings without additional training.


title: Functions Analytic at Infinity and Normality

abstract: Given a charge and current distribution with compact support, the associated potentials and fields are generally not integrable in the classical sense. However, it is convenient to be able to define their Fourier transform in order to create solutions to the wave equation. This paper develops the technology for this by considering the class of quasi split normal functions, examples of which are the solutions to Poisson's equation with a forcing term having compact support.


title: A combinatorial approach to exponential patterns in multiplicative $IP^{\star}$ sets in $\mathbb{N}$

abstract: $IP$ sets play a fundamental role in arithmetic Ramsey theory. The Finite Sums Theorem states that if we partition $\mathbb{N}$ into finitely many cells, then atleast one cell is an $IP$-set. N.Hindman proved the Finite Sums Theorem comboinatorillay in \cite{H}, which was a conjecture of Graham and Rothschild, and an algebraic proof of the Finite Sums Theorem is followed from \cite[Corollary 5.10]{HS}. In \cite[Theorem 2.6]{BH94} V. Bergelson and Hindman combinatorially proved that for an additive $IP^{\star}$ set $A$ and any sequence $\langle x_{n}\rangle_{n=1}^{\infty}$ there exists a sum subsystem $\langle y_{n}\rangle_{n=1}^{\infty}$ of $\langle x_{n}\rangle_{n=1}^{\infty}$ such that $FS\left(\langle y_{n}\rangle_{n=1}^{\infty}\right)\cup FP \left(\langle y_{n}\rangle_{n=1}^{\infty}\right)\subset A$. For multiplicative $IP^{\star}$-set, an analogous study was made by A.sisto in \cite{S} using algebra of the Stone-$\check{C}$ Compactification of $\mathbb{N}$ and he proved that for any multiplicative $IP^{\star}$ set $A$ there exist some infinite sequences $\langle x_{n}\rangle_{n=1}^{\infty}$ and $\langle y_{n}\rangle_{n=1}^{\infty}$ of $\mathbb{N}$ such that $FS\left(\langle x_{n}\rangle_{n=1}^{\infty}\right)\cup FE^{I}\left(\langle x_{n}\rangle_{n=1}^{\infty}\right)\cup FP\left(\langle y_{n}\rangle_{n=1}^{\infty}\right)\cup FE^{II}\left(\langle y_{n}\rangle_{n=1}^{\infty}\right)\subseteq A$. In this article, we will provide a combinatorial proof of the same result.


title: Enhanced One-Step Neville Algorithm with Access to the Convergence Rate

abstract: The recursive Neville algorithm allows one to calculate interpolating functions recursively. Upon a judicious choice of the abscissas used for the interpolation (and extrapolation), this algorithm leads to a method for convergence acceleration. For example, one can use the Neville algorithm in order to successively eliminate inverse powers of the upper limit of the summation from the partial sums of a given, slowly convergent input series. Here, we show that, for a particular choice of the abscissas used for the extrapolation, one can replace the recursive Neville scheme by a simple one-step transformation, while also obtaining access to subleading terms for the transformed series after convergence acceleration. The matrix-based, unified formulas allow one to estimate the rate of convergence of the partial sums of the input series to their limit. In particular, Bethe logarithms for hydrogen are calculated to 100 decimal digits.


title: HEX: High-pressure Elemental Xstals, a complete Database

abstract: This paper introduces the HEX (High-pressure Elemental Xstals) database, a complete database of the ground-state crystal structures of the first 57 elements of the periodic table, from H to La, at 0, 100, 200 and 300 GPa. HEX aims to provide a unified reference for high-pressure research, by compiling all available experimental information on elements at high pressure, and complementing it with the results of accurate evolutionary crystal structure prediction runs based on Density Functional Theory. Besides offering a much-needed reference, our work also serves as a benchmark of the accuracy of current ab-initio methods for crystal structure prediction. We find that, in 98 % of the cases in which experimental information is available, ab-initio crystal structure prediction yields structures which either coincide or are degenerate in enthalpy to within 300 K with experimental ones. The main manuscript contains synthetic tables and figures, while the Crystallographic Information File (cif) for all structures will be available on a figshare online repository when the paper will be published.


title: Iterative Forgetting: Online Data Stream Regression Using Database-Inspired Adaptive Granulation

abstract: Many modern systems, such as financial, transportation, and telecommunications systems, are time-sensitive in the sense that they demand low-latency predictions for real-time decision-making. Such systems often have to contend with continuous unbounded data streams as well as concept drift, which are challenging requirements that traditional regression techniques are unable to cater to. There exists a need to create novel data stream regression methods that can handle these scenarios. We present a database-inspired datastream regression model that (a) uses inspiration from R*-trees to create granules from incoming datastreams such that relevant information is retained, (b) iteratively forgets granules whose information is deemed to be outdated, thus maintaining a list of only recent, relevant granules, and (c) uses the recent data and granules to provide low-latency predictions. The R*-tree-inspired approach also makes the algorithm amenable to integration with database systems. Our experiments demonstrate that the ability of this method to discard data produces a significant order-of-magnitude improvement in latency and training time when evaluated against the most accurate state-of-the-art algorithms, while the R*-tree-inspired granulation technique provides competitively accurate predictions


title: cosmocnc: A fast, flexible, and accurate galaxy cluster number count likelihood code for cosmology

abstract: We introduce cosmocnc, a Python package for computing the number count likelihood of galaxy cluster catalogues in a fast, flexible and accurate way. cosmocnc offers three types of likelihoods: an unbinned, a binned, and an extreme value likelihood. It also supports the addition of stacked cluster data, which is modelled consistently with the cluster catalogue. The unbinned likelihood, which is the main focus of the code, can take an arbitrary number of mass observables as input and deal with several complexities in the data, such as variations in the properties of the cluster observable across the survey footprint, the possibility of different clusters having measurements for different combinations of mass observables, redshift measurement uncertainties, and the presence on unconfirmed detections in the catalogue. If there are more than one mass observables, the unbinned likelihood is computed with the backward convolutional approach, a novel approach that is first implemented in cosmocnc. After developing the likelihood formalism and describing its implementation, we validate the code with synthetic Simons-Observatory-like catalogues, finding excellent agreement between their properties and cosmocnc's predictions and obtaining constraints on cosmological and scaling relation parameters featuring negligible biases. cosmocnc is publicly available at github.com/inigozubeldia/cosmocnc.


title: Matrix Mechanics of a Particle in a One-Dimensional Infinite Square Well

abstract: We solve the infinite potential well problem using the methods of Heisenberg's matrix mechanics. In addition to being of educational value, the matrix mechanics allows us to deal with various unphysical issues caused by this potential in a seemingly unproblematic fashion. We also show how to treat many particles within this representation.


title: The effect of spatially-varying collision frequency on the development of the Rayleigh-Taylor instability

abstract: The Rayleigh-Taylor (RT) instability is ubiquitously observed, yet has traditionally been studied using ideal fluid models. Collisionality can vary strongly across the fluid interface, and previous work demonstrates the necessity of kinetic models to completely capture dynamics in certain collisional regimes. Where previous kinetic simulations used spatially- and temporally-constant collision frequency, this work presents 5-dimensional (two spatial, three velocity dimensions) continuum-kinetic simulations of the RT instability using a more realistic spatially-varying collision frequency. Three cases of collisional variation are explored for two Atwood numbers: low to intermediate, intermediate to high, and low to high. The low to intermediate case exhibits no RT instability growth, while the intermediate to high case is similar to a fluid limit kinetic case with interface widening biased towards the lower collisionality region. A novel contribution of this work is the low to high collisionality case that shows significantly altered instability growth through upward movement of the interface and damped spike growth due to increased free-streaming particle diffusion in the lower region. Contributions to the energy-flux from the non-Maxwellian portions of the distribution function are not accessible to fluid models and are greatest in magnitude in the spike and regions of low collisionality. Increasing the Atwood number results in greater RT instability growth and reduced upward interface movement. Deviation of the distribution function from Maxwellian is inversely proportional to collision frequency and concentrated around the fluid interface. The linear phase of RT instability growth is well-described by theoretical linear growth rates accounting for viscosity and diffusion.


title: DungeonMaker: Embedding Tangible Creation and Destruction in Hybrid Board Games through Personal Fabrication Technology

abstract: Hybrid board games (HBGs) augment their analog origins digitally (e.g., through apps) and are an increasingly popular pastime activity. Continuous world and character development and customization, known to facilitate engagement in video games, remain rare in HBGs. If present, they happen digitally or imaginarily, often leaving physical aspects generic. We developed DungeonMaker, a fabrication-augmented HBG bridging physical and digital game elements: 1) the setup narrates a story and projects a digital game board onto a laser cutter; 2) DungeonMaker assesses player-crafted artifacts; 3) DungeonMaker's modified laser head senses and moves player- and non-player figures, and 4) can physically damage figures. An evaluation (n=4x3) indicated that DungeonMaker provides an engaging experience, may support players' connection to their figures, and potentially spark novices' interest in fabrication. DungeonMaker provides a rich constellation to play HBGs by blending aspects of craft and automation to couple the physical and digital elements of an HBG tightly.


title: Renovating Names in Open-Vocabulary Segmentation Benchmarks

abstract: Names are essential to both human cognition and vision-language models. Open-vocabulary models utilize class names as text prompts to generalize to categories unseen during training. However, the precision of these names is often overlooked in existing datasets. In this paper, we address this underexplored problem by presenting a framework for "renovating" names in open-vocabulary segmentation benchmarks (RENOVATE). Our framework features a renaming model that enhances the quality of names for each visual segment. Through experiments, we demonstrate that our renovated names help train stronger open-vocabulary models with up to 15% relative improvement and significantly enhance training efficiency with improved data quality. We also show that our renovated names improve evaluation by better measuring misclassification and enabling fine-grained model analysis. We will provide our code and relabelings for several popular segmentation datasets (MS COCO, ADE20K, Cityscapes) to the research community.


title: The Size-Linewidth Relation and Signatures of Feedback from Quiescent to Active Star Forming Regions in the LMC

abstract: To investigate the effects of stellar feedback on the gravitational state of giant molecular clouds (GMCs), we study $^{12}$CO and $^{13}$CO ALMA maps of nine GMCs distributed throughout the Large Magellanic Cloud (LMC), the nearest star-forming galaxy to our own. We perform noise and resolution matching on the sample, working at a common resolution of 3.5 arcseconds (0.85 pc at the LMC distance of 50 kpc), and use the \textit{SCIMES} clustering algorithm to identify discrete substructure, or "clumps." We supplement these data with three tracers of recent star formation: $8\mu$m surface brightness, continuum-subtracted H$\alpha$ flux, and interstellar radiation field energy density inferred from dust emission. The $^{12}$CO clumps identified cover a range of 3.6 dex in luminosity-based mass and 2.4 dex in average $8\mu$m surface brightness, representative of the wide range of conditions of the interstellar medium in the LMC. Our observations suggest evidence for increased turbulence in these clouds. While the turbulent linewidths are correlated with clump surface density, in agreement with previous observations, we find even better correlation with the three star formation activity tracers considered, suggesting stellar energy injection plays a significant role in the dynamical state of the clumps. The excess linewidths we measure do not appear to result from opacity broadening. $^{12}$CO clumps are found to be typically less gravitationally bound than $^{13}$CO clumps, with some evidence of the kinetic-to-gravitational potential energy ratio increasing with star-formation tracers. Further multi-line analysis may better constrain the assumptions made in these calculations.


title: A comprehensive study of orbital evolution of LMC X-4: Existence of a second derivative of the orbital period

abstract: We report here results from pulse arrival time delay analysis of the eclipsing high mass X-ray binary pulsar LMC X-4 using observations made with the Rossi X-ray Timing Explorer, XMM-Newton, NuSTAR and AstroSat. Combining the orbital parameters determined from these observations with the historical measurements dating back to 1998, we have extended the $T_{\pi/2}$ epoch history of LMC X-4 by about 4600 binary orbits spanning about 18 years. We also report mid-eclipse time measurements ($T_{ecl}$) using data obtained from wide-field X-ray monitors of MAXI-GSC and Swift-BAT. Combining the new $T_{\pi/2}$ and $T_{ecl}$ estimates with all the previously reported values, we have significantly improved the orbital evolution measurement, which indicates that the orbital period is evolving at a time scale ($P_{\rm orb}/\dot{P}_{\rm orb}$ ) of about 0.8 Myr. For the first time in an accreting X-ray pulsar system, we confirm the existence of a second derivative of the orbital period, having an evolution time scale ($\dot{P}_{orb}/\ddot{P}_{orb}$) of about 55 yr. Detection of a second derivative of the orbital period in LMC X-4 makes its orbital evolution timescale more uncertain, which may also be true for other HMXBs. Independent solutions for the orbital evolution measurement using the mid-eclipse data and the pulse timing data are consistent with each other, and help us put an upper limit of 0.009 on the eccentricity of the binary system.


title: Scalable Autonomous Drone Flight in the Forest with Visual-Inertial SLAM and Dense Submaps Built without LiDAR

abstract: Forestry constitutes a key element for a sustainable future, while it is supremely challenging to introduce digital processes to improve efficiency. The main limitation is the difficulty of obtaining accurate maps at high temporal and spatial resolution as a basis for informed forestry decision-making, due to the vast area forests extend over and the sheer number of trees. To address this challenge, we present an autonomous Micro Aerial Vehicle (MAV) system which purely relies on cost-effective and light-weight passive visual and inertial sensors to perform under-canopy autonomous navigation. We leverage visual-inertial simultaneous localization and mapping (VI-SLAM) for accurate MAV state estimates and couple it with a volumetric occupancy submapping system to achieve a scalable mapping framework which can be directly used for path planning. As opposed to a monolithic map, submaps inherently deal with inevitable drift and corrections from VI-SLAM, since they move with pose estimates as they are updated. To ensure the safety of the MAV during navigation, we also propose a novel reference trajectory anchoring scheme that moves and deforms the reference trajectory the MAV is tracking upon state updates from the VI-SLAM system in a consistent way, even upon large changes in state estimates due to loop-closures. We thoroughly validate our system in both real and simulated forest environments with high tree densities in excess of 400 trees per hectare and at speeds up to 3 m/s - while not encountering a single collision or system failure. To the best of our knowledge this is the first system which achieves this level of performance in such unstructured environment using low-cost passive visual sensors and fully on-board computation including VI-SLAM.


title: Tidal evolution of cored and cuspy dark matter halos

abstract: The internal structure and abundance of dark matter halos and subhalos are powerful probes of the nature of dark matter. In order to compare observations with dark matter models, accurate theoretical predictions of these quantities are needed. We present a fast and accurate method to describe the tidal evolution of subhalos within their parent halo, based on a semi-analytic approach. We first consider idealized N-body simulations of subhalos within their host halo, using a generalized mass density profile that describes their properties in a variety of dark matter models at infall, including popular warm, cold, and self-interacting ones. Using these simulations we construct tidal "tracks" for the evolution of subhalos based on their conditions at infall. Second, we use the results of these simulations to build semi-analytic models (SAMs) for tidal effects, including stripping and heating and implement them within the code GALACTICUS. Our SAMs can accurately predict the tidal evolution of both cored and cuspy subhalos, including the bound mass and density profiles, providing a powerful and efficient tool for studying the post-infall properties of subhalos in different dark matter models.


title: Mixture of Mixups for Multi-label Classification of Rare Anuran Sounds

abstract: Multi-label imbalanced classification poses a significant challenge in machine learning, particularly evident in bioacoustics where animal sounds often co-occur, and certain sounds are much less frequent than others. This paper focuses on the specific case of classifying anuran species sounds using the dataset AnuraSet, that contains both class imbalance and multi-label examples. To address these challenges, we introduce Mixture of Mixups (Mix2), a framework that leverages mixing regularization methods Mixup, Manifold Mixup, and MultiMix. Experimental results show that these methods, individually, may lead to suboptimal results; however, when applied randomly, with one selected at each training iteration, they prove effective in addressing the mentioned challenges, particularly for rare classes with few occurrences. Further analysis reveals that Mix2 is also proficient in classifying sounds across various levels of class co-occurrences.


title: Logical Discrete Graphical Models Must Supplement Large Language Models for Information Synthesis

abstract: Given the emergent reasoning abilities of large language models, information retrieval is becoming more complex. Rather than just retrieve a document, modern information retrieval systems advertise that they can synthesize an answer based on potentially many different documents, conflicting data sources, and using reasoning. We review recent literature and argue that the large language model has crucial flaws that prevent it from on its own ever constituting general intelligence, or answering general information synthesis requests. This review shows that the following are problems for large language models: hallucinations, complex reasoning, planning under uncertainty, and complex calculations. We outline how logical discrete graphical models can solve all of these problems, and outline a method of training a logical discrete model from unlabeled text.


title: Tree-Level Superstring Amplitudes: The Neveu-Schwarz Sector

abstract: We present a complete computation of superstring scattering amplitudes at tree level, for the case of Neveu-Schwarz insertions. Mathematically, this is to say that we determine explicitly the superstring measure on the moduli space $\mathcal{M}_{0,n,0}$ of super Riemann surfaces of genus zero with $n \ge 3$ Neveu-Schwarz punctures. While, of course, an expression for the measure was previously known, we do this from first principles, using the canonically defined super Mumford isomorphism. We thus determine the scattering amplitudes, explicitly in the global coordinates on $\mathcal{M}_{0,n,0}$, without the need for picture changing operators or ghosts, and are also able to determine canonically the value of the coupling constant. Our computation should be viewed as a step towards performing similar analysis on $\mathcal{M}_{0,0,n}$, to derive explicit tree-level scattering amplitudes with Ramond insertions.


title: Network-Controlled Repeater -- An Introduction

abstract: In fifth generation (5G) wireless cellular networks, millimeter wave spectrum opens room for several potential improvements in throughput, reliability, latency, among other aspects. However, it also brings challenges, such as a higher influence of blockage which may significantly limit the coverage. In this context, network-controlled repeaters (NCRs) are network nodes with low complexity that represent a technique to overcome coverage problems. In this paper, we introduce the NCR concept and study its performance gains and deployment options. Particularly, presenting the main specifications of NCR as agreed in 3rd generation partnership project (3GPP) Rel-18, we analyze different NCR deployments in an urban scenario and compare its performance with alternative deployments. As demonstrated, with a proper network planning and beamforming design, NCR is an attractive solution to cover blind spots the base stations (BSs) may have.


title: Parafermions with symmetry-protected non-Abelian statistics

abstract: Non-Abelian anyons have garnered extensive attention for obeying exotic non-Abelian statistics and having potential applications to fault-tolerant quantum computing. While the prior research has predominantly focused on non-Abelian statistics without the necessity of symmetry protection, recent progresses have shown that symmetries can play essential roles and bring a notion of the symmetry-protected non-Abelian (SPNA) statistics. In this work, we extend the concept of SPNA statistics to strongly-correlated systems which host parafermion zero modes (PZMs). This study involves a few fundamental results proved here. First, we unveil a generic unitary symmetry mechanism that protects PZMs from local couplings. Then, with this symmetry protection, the PZMs can be categorized into two nontrivial sectors, each maintaining its own parity conservation, even though the whole system cannot be dismantled into separate subsystems due to nonlinear interactions. Finally, by leveraging the parity conservation of each sector and the general properties of the effective braiding Hamiltonian, we prove rigorously that the PZMs intrinsically obey SPNA statistics. To further confirm the results, we derive the braiding matrix at a tri-junction. We also propose a correlated quantum nanowire model that accommodates a pair of PZMs protected by mirror symmetry and satisfying the generic theory. This work shows a broad spectrum of strongly-correlated systems capable of hosting fractional SPNA quasiparticles and enriches our comprehension of fundamental quantum statistics linked to the symmetries that govern the exchange dynamics.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.stat-mech cond-mat.supr-con quant-ph


title: Optimistic Verifiable Training by Controlling Hardware Nondeterminism

abstract: The increasing compute demands of AI systems has led to the emergence of services that train models on behalf of clients lacking necessary resources. However, ensuring correctness of training and guarding against potential training-time attacks, such as data poisoning, poses challenges. Existing works on verifiable training largely fall into two classes: proof-based systems, which struggle to scale due to requiring cryptographic techniques, and "optimistic" methods that consider a trusted third-party auditor who replicates the training process. A key challenge with the latter is that hardware nondeterminism between GPU types during training prevents an auditor from replicating the training process exactly, and such schemes are therefore non-robust. We propose a method that combines training in a higher precision than the target model, rounding after intermediate computation steps, and storing rounding decisions based on an adaptive thresholding procedure, to successfully control for nondeterminism. Across three different NVIDIA GPUs (A40, Titan XP, RTX 2080 Ti), we achieve exact training replication at FP32 precision for both full-training and fine-tuning of ResNet-50 (23M) and GPT-2 (117M) models. Our verifiable training scheme significantly decreases the storage and time costs compared to proof-based systems.


title: Extremal graphical modeling with latent variables

abstract: Extremal graphical models encode the conditional independence structure of multivariate extremes and provide a powerful tool for quantifying the risk of rare events. Prior work on learning these graphs from data has focused on the setting where all relevant variables are observed. For the popular class of H\"usler-Reiss models, we propose the \texttt{eglatent} method, a tractable convex program for learning extremal graphical models in the presence of latent variables. Our approach decomposes the H\"usler-Reiss precision matrix into a sparse component encoding the graphical structure among the observed variables after conditioning on the latent variables, and a low-rank component encoding the effect of a few latent variables on the observed variables. We provide finite-sample guarantees of \texttt{eglatent} and show that it consistently recovers the conditional graph as well as the number of latent variables. We highlight the improved performances of our approach on synthetic and real data.


title: Counterfactual contrastive learning: robust representations via causal image synthesis

abstract: Contrastive pretraining is well-known to improve downstream task performance and model generalisation, especially in limited label settings. However, it is sensitive to the choice of augmentation pipeline. Positive pairs should preserve semantic information while destroying domain-specific information. Standard augmentation pipelines emulate domain-specific changes with pre-defined photometric transformations, but what if we could simulate realistic domain changes instead? In this work, we show how to utilise recent progress in counterfactual image generation to this effect. We propose CF-SimCLR, a counterfactual contrastive learning approach which leverages approximate counterfactual inference for positive pair creation. Comprehensive evaluation across five datasets, on chest radiography and mammography, demonstrates that CF-SimCLR substantially improves robustness to acquisition shift with higher downstream performance on both in- and out-of-distribution data, particularly for domains which are under-represented during training.


title: Large Language Models and Causal Inference in Collaboration: A Comprehensive Survey

abstract: Causal inference has shown potential in enhancing the predictive accuracy, fairness, robustness, and explainability of Natural Language Processing (NLP) models by capturing causal relationships among variables. The emergence of generative Large Language Models (LLMs) has significantly impacted various NLP domains, particularly through their advanced reasoning capabilities. This survey focuses on evaluating and improving LLMs from a causal view in the following areas: understanding and improving the LLMs' reasoning capacity, addressing fairness and safety issues in LLMs, complementing LLMs with explanations, and handling multimodality. Meanwhile, LLMs' strong reasoning capacities can in turn contribute to the field of causal inference by aiding causal relationship discovery and causal effect estimations. This review explores the interplay between causal inference frameworks and LLMs from both perspectives, emphasizing their collective potential to further the development of more advanced and equitable artificial intelligence systems.


title: pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal Fabrication

abstract: Extended Reality (XR) allows in-situ previewing of designs to be manufactured through Personal Fabrication (PF). These in-situ interactions exhibit advantages for PF, like incorporating the environment into the design process. However, design-for-fabrication in XR often happens through either highly complex 3D-modeling or is reduced to rudimentary adaptations of crowd-sourced models. We present pARam, a tool combining parametric designs (PDs) and XR, enabling in-situ configuration of artifacts for PF. In contrast to modeling- or search-focused approaches, pARam supports customization through embodied and practical inputs (e.g., gestures, recommendations) and evaluation (e.g., lighting estimation) without demanding complex 3D-modeling skills. We implemented pARam for HoloLens 2 and evaluated it (n=20), comparing XR and desktop conditions. Users succeeded in choosing context-related parameters and took their environment into account for their configuration using pARam. We reflect on the prospects and challenges of PDs in XR to streamline complex design methods for PF while retaining suitable expressivity.


title: Interaction-Driven Instabilities in the Random-Field XXZ Chain

abstract: Despite enormous efforts devoted to the study of the many-body localization (MBL) phenomenon, the nature of the high-energy behavior of the Heisenberg spin chain in a strong random magnetic field is lacking consensus. Here, we take a step back by exploring the weak interaction limit starting from the Anderson localized (AL) insulator. Through shift-invert diagonalization, we find that below a certain disorder threshold $h^*$, weak interactions necessarily lead to ergodic instability, whereas at strong disorder the AL insulator directly turns into MBL. This agrees with a simple interpretation of the avalanche theory for restoration of ergodicity. We further map the phase diagram for the generic XXZ model in the disorder $h$ -- interaction $\Delta$ plane. Taking advantage of the total magnetization conservation, our results unveil the remarkable behavior of the spin-spin correlation functions: in the regime indicated as MBL by standard observables, their exponential decay undergoes a unique inversion of orientation $\xi_z>\xi_x$. We find that the longitudinal length $\xi_z$ is a key quantity for capturing ergodic instabilities, as it increases with system size near the thermal phase, in sharp contrast to its transverse counterpart $\xi_x$.


title: Generative reconstruction of 3D volume elements for Ti-6Al-4V basketweave microstructure by optimization of CNN-based microstructural descriptors

abstract: We present a methodology for the generative reconstruction of 3D Volume Elements (VE) for numerical multiscale analysis of Ti-6Al-4V processed by Additive Manufacturing (AM). The basketweave morphology, which is typically dominant in AM-processed Ti-6Al-4V, is analyzed in conventional Electron Backscatter Diffusion (EBSD) micrographs. Prior \b{eta}-grain reconstruction is performed to obtain the out-of-plane orientation of the observed grains leveraging Burgers orientation relationship. Convolutional Neural Network (CNN) - based microstructure descriptors are extracted from the 2D data, and used for cross-section-based optimization of pixel values on orthogonal planes in 3D, using the Microstructure Characterization and Reconstruction (MCR) implementation MCRpy [16]. In order to utilize MCRpy, which performs best for binary systems, the basketweave microstructure, which consists of up to twelve distinct grain orientations, is decomposed into several separate two-phase systems. Our reconstructions capture key characteristics of the titanium basketweave morphology and show qualitative resemblance to experimentally obtained 3D data. The preservation of volume fraction during assembly of the reconstruction remains an unadressed challenge at this stage.


title: Signal Recovery with Proximal Comixtures

abstract: In variational signal processing and machine learning problems, loss functions and linear operators are typically aggregated as an average of composite terms. We propose an alternative formulation using proximal comixtures, an operation that combines functions and linear operators in such a way that the proximity operator of the resulting function is computable explicitly. The benefits of comixture formulations are illustrated through image recovery and machine learning applications.


title: MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

abstract: In this work, we discuss building performant Multimodal Large Language Models (MLLMs). In particular, we study the importance of various architecture components and data choices. Through careful and comprehensive ablations of the image encoder, the vision language connector, and various pre-training data choices, we identified several crucial design lessons. For example, we demonstrate that for large-scale multimodal pre-training using a careful mix of image-caption, interleaved image-text, and text-only data is crucial for achieving state-of-the-art (SOTA) few-shot results across multiple benchmarks, compared to other published pre-training results. Further, we show that the image encoder together with image resolution and the image token count has substantial impact, while the vision-language connector design is of comparatively negligible importance. By scaling up the presented recipe, we build MM1, a family of multimodal models up to 30B parameters, including both dense models and mixture-of-experts (MoE) variants, that are SOTA in pre-training metrics and achieve competitive performance after supervised fine-tuning on a range of established multimodal benchmarks. Thanks to large-scale pre-training, MM1 enjoys appealing properties such as enhanced in-context learning, and multi-image reasoning, enabling few-shot chain-of-thought prompting.


title: Compute-first optical detection for noise-resilient visual perception

abstract: In the context of visual perception, the optical signal from a scene is transferred into the electronic domain by detectors in the form of image data, which are then processed for the extraction of visual information. In noisy and weak-signal environments such as thermal imaging for night vision applications, however, the performance of neural computing tasks faces a significant bottleneck due to the inherent degradation of data quality upon noisy detection. Here, we propose a concept of optical signal processing before detection to address this issue. We demonstrate that spatially redistributing optical signals through a properly designed linear transformer can enhance the detection noise resilience of visual perception tasks, as benchmarked with the MNIST classification. Our idea is supported by a quantitative analysis detailing the relationship between signal concentration and noise robustness, as well as its practical implementation in an incoherent imaging system. This compute-first detection scheme can pave the way for advancing infrared machine vision technologies widely used for industrial and defense applications.


title: Reawakening knowledge: Anticipatory recovery from catastrophic interference via structured training

abstract: We explore the training dynamics of neural networks in a structured non-IID setting where documents are presented cyclically in a fixed, repeated sequence. Typically, networks suffer from catastrophic interference when training on a sequence of documents; however, we discover a curious and remarkable property of LLMs fine-tuned sequentially in this setting: they exhibit anticipatory behavior, recovering from the forgetting on documents before encountering them again. The behavior emerges and becomes more robust as the architecture scales up its number of parameters. Through comprehensive experiments and visualizations, we uncover new insights into training over-parameterized networks in structured environments.


title: Localization in Digital Twin MIMO Networks: A Case for Massive Fingerprinting

abstract: Localization in outdoor wireless systems typically requires transmitting specific reference signals to estimate distance (trilateration methods) or angle (triangulation methods). These cause overhead on communication, need a LoS link to work well, and require multiple base stations, often imposing synchronization or specific hardware requirements. Fingerprinting has none of these drawbacks, but building its database requires high human effort to collect real-world measurements. For a long time, this issue limited the size of databases and thus their performance. This work proposes significantly reducing human effort in building fingerprinting databases by populating them with \textit{digital twin RF maps}. These RF maps are built from ray-tracing simulations on a digital replica of the environment across several frequency bands and beamforming configurations. Online user fingerprints are then matched against this spatial database. The approach was evaluated with practical simulations using realistic propagation models and user measurements. Our experiments show sub-meter localization errors on a NLoS location 95\% of the time using sensible user measurement report sizes. Results highlight the promising potential of the proposed digital twin approach for ubiquitous wide-area 6G localization.


title: PrompTHis: Visualizing the Process and Influence of Prompt Editing during Text-to-Image Creation

abstract: Generative text-to-image models, which allow users to create appealing images through a text prompt, have seen a dramatic increase in popularity in recent years. However, most users have a limited understanding of how such models work and it often requires many trials and errors to achieve satisfactory results. The prompt history contains a wealth of information that could provide users with insights into what have been explored and how the prompt changes impact the output image, yet little research attention has been paid to the visual analysis of such process to support users. We propose the Image Variant Graph, a novel visual representation designed to support comparing prompt-image pairs and exploring the editing history. The Image Variant Graph models prompt differences as edges between corresponding images and presents the distances between images through projection. Based on the graph, we developed the PrompTHis system through co-design with artists. Besides Image Variant Graph, PrompTHis also incorporates a detailed prompt-image history and a navigation mini-map. Based on the review and analysis of the prompting history, users can better understand the impact of prompt changes and have a more effective control of image generation. A quantitative user study with eleven amateur participants and qualitative interviews with five professionals and one amateur user were conducted to evaluate the effectiveness of PrompTHis. The results demonstrate PrompTHis can help users review the prompt history, make sense of the model, and plan their creative process.


title: Explore In-Context Segmentation via Latent Diffusion Models

abstract: In-context segmentation has drawn more attention with the introduction of vision foundation models. Most existing approaches adopt metric learning or masked image modeling to build the correlation between visual prompts and input image queries. In this work, we explore this problem from a new perspective, using one representative generation model, the latent diffusion model (LDM). We observe a task gap between generation and segmentation in diffusion models, but LDM is still an effective minimalist for in-context segmentation. In particular, we propose two meta-architectures and correspondingly design several output alignment and optimization strategies. We have conducted comprehensive ablation studies and empirically found that the segmentation quality counts on output alignment and in-context instructions. Moreover, we build a new and fair in-context segmentation benchmark that includes both image and video datasets. Experiments validate the efficiency of our approach, demonstrating comparable or even stronger results than previous specialist models or visual foundation models. Our study shows that LDMs can also achieve good enough results for challenging in-context segmentation tasks.


title: Generating functional of correlators of twist-$2$ operators in $\mathcal{N} = 1$ SUSY Yang-Mills theory, I

abstract: Extending our previous work in pure Yang-Mills (YM) theory, we compute the generating functional of correlators of collinear twist-$2$ operators that enter the components of balanced superfields -- i.e., superfields with an equal number of dotted and undotted indices in their spinor representation -- in $\mathcal{N} = 1$ SUSY SU($N$) YM theory in Minkowskian and Euclidean space-time, in the conformal limit and renormalization-group improved form, and to the leading and next-to-leading order in the large-$N$ expansion. The latter calculation sets strong UV asymptotic constraints on the nonperturbative solution of large-$N$ $\mathcal{N} = 1$ SUSY YM theory that may be a pivotal guide for the search of such a solution.


title: Dynamically accelerating the power iteration with momentum

abstract: In this paper, we propose, analyze and demonstrate a dynamic momentum method to accelerate power and inverse power iterations with minimal computational overhead. The method is appropriate for real, diagonalizable matrices, and does not require a priori spectral knowledge. We review and extend background results on previously developed static momentum accelerations for the power iteration through the connection between the momentum accelerated iteration and the standard power iteration applied to an augmented matrix. We show that the augmented matrix is defective for the optimal parameter choice. We then present our dynamic method which updates the momentum parameter at each iteration based on the Rayleigh quotient and two previous residuals. We present convergence and stability theory for the method by considering a power-like method consisting of multiplying an initial vector by a sequence of augmented matrices. We demonstrate the developed method on a number of benchmark problems, and see that it outperforms both the power iteration and often the static momentum acceleration with optimal parameter choice. Finally, we present and demonstrate an explicit extension of the algorithm to inverse power iterations.


title: Dynamics of Pseudoentanglement

abstract: The dynamics of quantum entanglement plays a central role in explaining the emergence of thermal equilibrium in isolated many-body systems. However, entanglement is notoriously hard to measure, and can in fact be forged: recent works have introduced a notion of pseudoentanglement describing ensembles of many-body states that, while only weakly entangled, cannot be efficiently distinguished from states with much higher entanglement, such as random states in the Hilbert space. In this work we initiate the study of the dynamical generation and propagation of pseudoentanglement. As generic quantum dynamics tends to maximize actual entanglement, we consider constrained models of time evolution: automaton (i.e. reversible classical) circuits that, when fed suitable input states, provably produce the "standard models" of pseudoentangled ensembles--uniformly random subset(-phase) states--at late times, a phenomenon we name 'pseudothermalization'. We examine (i) how a pseudoentangled ensemble on a small subsystem spreads to the whole system as a function of time, and (ii) how a pseudoentangled ensemble is generated from an initial product state. We map the above problems onto a family of classical Markov chains on subsets of the computational basis. The mixing times of such Markov chains are related to the time scales at which the states produced from the dynamics become indistinguishable from Haar-random states at the level of each statistical moment (or number of copies). Based on a combination of rigorous bounds and conjectures supported by numerics, we argue that each Markov chain's relaxation time and mixing time have different asymptotic behavior in the limit of large system size. This is a necessary condition for a cutoff phenomenon: an abrupt dynamical transition to equilibrium. We thus conjecture that our random circuits give rise to asymptotically sharp pseudothermalization transitions.


title: PosSAM: Panoptic Open-vocabulary Segment Anything

abstract: In this paper, we introduce an open-vocabulary panoptic segmentation model that effectively unifies the strengths of the Segment Anything Model (SAM) with the vision-language CLIP model in an end-to-end framework. While SAM excels in generating spatially-aware masks, it's decoder falls short in recognizing object class information and tends to oversegment without additional guidance. Existing approaches address this limitation by using multi-stage techniques and employing separate models to generate class-aware prompts, such as bounding boxes or segmentation masks. Our proposed method, PosSAM is an end-to-end model which leverages SAM's spatially rich features to produce instance-aware masks and harnesses CLIP's semantically discriminative features for effective instance classification. Specifically, we address the limitations of SAM and propose a novel Local Discriminative Pooling (LDP) module leveraging class-agnostic SAM and class-aware CLIP features for unbiased open-vocabulary classification. Furthermore, we introduce a Mask-Aware Selective Ensembling (MASE) algorithm that adaptively enhances the quality of generated masks and boosts the performance of open-vocabulary classification during inference for each image. We conducted extensive experiments to demonstrate our methods strong generalization properties across multiple datasets, achieving state-of-the-art performance with substantial improvements over SOTA open-vocabulary panoptic segmentation methods. In both COCO to ADE20K and ADE20K to COCO settings, PosSAM outperforms the previous state-of-the-art methods by a large margin, 2.4 PQ and 4.6 PQ, respectively. Project Website: https://vibashan.github.io/possam-web/.


title: Minimax Optimal and Computationally Efficient Algorithms for Distributionally Robust Offline Reinforcement Learning

abstract: Distributionally robust offline reinforcement learning (RL), which seeks robust policy training against environment perturbation by modeling dynamics uncertainty, calls for function approximations when facing large state-action spaces. However, the consideration of dynamics uncertainty introduces essential nonlinearity and computational burden, posing unique challenges for analyzing and practically employing function approximation. Focusing on a basic setting where the nominal model and perturbed models are linearly parameterized, we propose minimax optimal and computationally efficient algorithms realizing function approximation and initiate the study on instance-dependent suboptimality analysis in the context of robust offline RL. Our results uncover that function approximation in robust offline RL is essentially distinct from and probably harder than that in standard offline RL. Our algorithms and theoretical results crucially depend on a variety of new techniques, involving a novel function approximation mechanism incorporating variance information, a new procedure of suboptimality and estimation uncertainty decomposition, a quantification of the robust value function shrinkage, and a meticulously designed family of hard instances, which might be of independent interest.


title: Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

abstract: Visual text rendering poses a fundamental challenge for contemporary text-to-image generation models, with the core problem lying in text encoder deficiencies. To achieve accurate text rendering, we identify two crucial requirements for text encoders: character awareness and alignment with glyphs. Our solution involves crafting a series of customized text encoder, Glyph-ByT5, by fine-tuning the character-aware ByT5 encoder using a meticulously curated paired glyph-text dataset. We present an effective method for integrating Glyph-ByT5 with SDXL, resulting in the creation of the Glyph-SDXL model for design image generation. This significantly enhances text rendering accuracy, improving it from less than $20\%$ to nearly $90\%$ on our design image benchmark. Noteworthy is Glyph-SDXL's newfound ability for text paragraph rendering, achieving high spelling accuracy for tens to hundreds of characters with automated multi-line layouts. Finally, through fine-tuning Glyph-SDXL with a small set of high-quality, photorealistic images featuring visual text, we showcase a substantial improvement in scene text rendering capabilities in open-domain real images. These compelling outcomes aim to encourage further exploration in designing customized text encoders for diverse and challenging tasks.


title: Score-Guided Diffusion for 3D Human Recovery

abstract: We present Score-Guided Human Mesh Recovery (ScoreHMR), an approach for solving inverse problems for 3D human pose and shape reconstruction. These inverse problems involve fitting a human body model to image observations, traditionally solved through optimization techniques. ScoreHMR mimics model fitting approaches, but alignment with the image observation is achieved through score guidance in the latent space of a diffusion model. The diffusion model is trained to capture the conditional distribution of the human model parameters given an input image. By guiding its denoising process with a task-specific score, ScoreHMR effectively solves inverse problems for various applications without the need for retraining the task-agnostic diffusion model. We evaluate our approach on three settings/applications. These are: (i) single-frame model fitting; (ii) reconstruction from multiple uncalibrated views; (iii) reconstructing humans in video sequences. ScoreHMR consistently outperforms all optimization baselines on popular benchmarks across all settings. We make our code and models available at the https://statho.github.io/ScoreHMR.


title: Physically motivated improvements of Variational Quantum Eigensolvers

abstract: The Adaptive Derivative-Assembled Pseudo-Trotter Variational Quantum Eigensolver (ADAPT-VQE) has emerged as a pivotal promising approach for electronic structure challenges in quantum chemistry with noisy quantum devices. Nevertheless, to surmount existing technological constraints, this study endeavors to enhance ADAPT-VQE's efficacy. Leveraging insights from electronic structure theory, we concentrate on optimizing state preparation without added computational burden and guiding ansatz expansion to yield more concise wavefunctions with expedited convergence toward exact solutions. These advancements culminate in shallower circuits and, as demonstrated, reduced measurement requirements. This research delineates these enhancements and assesses their performance across mono, di, and tridimensional arrangements of H4 models, as well as in the water molecule. Ultimately, this work attests to the viability of physically-motivated strategies in fortifying ADAPT-VQE's efficiency, marking a significant stride in quantum chemistry simulations.


title: Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generation

abstract: Recent years have witnessed the strong power of 3D generation models, which offer a new level of creative flexibility by allowing users to guide the 3D content generation process through a single image or natural language. However, it remains challenging for existing 3D generation methods to create subject-driven 3D content across diverse prompts. In this paper, we introduce a novel 3D customization method, dubbed Make-Your-3D that can personalize high-fidelity and consistent 3D content from only a single image of a subject with text description within 5 minutes. Our key insight is to harmonize the distributions of a multi-view diffusion model and an identity-specific 2D generative model, aligning them with the distribution of the desired 3D subject. Specifically, we design a co-evolution framework to reduce the variance of distributions, where each model undergoes a process of learning from the other through identity-aware optimization and subject-prior optimization, respectively. Extensive experiments demonstrate that our method can produce high-quality, consistent, and subject-specific 3D content with text-driven modifications that are unseen in subject image.


title: Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding

abstract: Understanding videos is one of the fundamental directions in computer vision research, with extensive efforts dedicated to exploring various architectures such as RNN, 3D CNN, and Transformers. The newly proposed architecture of state space model, e.g., Mamba, shows promising traits to extend its success in long sequence modeling to video modeling. To assess whether Mamba can be a viable alternative to Transformers in the video understanding domain, in this work, we conduct a comprehensive set of studies, probing different roles Mamba can play in modeling videos, while investigating diverse tasks where Mamba could exhibit superiority. We categorize Mamba into four roles for modeling videos, deriving a Video Mamba Suite composed of 14 models/modules, and evaluating them on 12 video understanding tasks. Our extensive experiments reveal the strong potential of Mamba on both video-only and video-language tasks while showing promising efficiency-performance trade-offs. We hope this work could provide valuable data points and insights for future research on video understanding. Code is public: https://github.com/OpenGVLab/video-mamba-suite.


title: Spontaneous breaking of the $\text{SO}(2N)$ symmetry in the Gross-Neveu model

abstract: The canonical Gross-Neveu model for $N$ two-component Dirac fermions in $2+1$ dimensions suffers a continuous phase transition at a critical interaction $g_{c1} \sim 1/N$ at large $N$, at which its continuous symmetry $\text{SO}(2N)$ is preserved and a discrete (Ising) symmetry becomes spontaneously broken. A recent mean-field calculation, however, points to an additional transition at a different critical $g_{c2}\sim -N g_{c1}$, at which $\text{SO}(2N) \rightarrow \text{SO}(N) \times \text{SO}(N)$. To study the latter phase transition we rewrite the Gross-Neveu interaction $g (\bar{\psi} \psi)^2$ in terms of three different quartic terms for the single ($L=1$) $4N$-component real (Majorana) fermion, and then extend the theory to $L>1$. This allows us to track the evolution of the fixed points of the renormalization group transformation starting from $L\gg 1$, where one can discern three distinct critical points which correspond to continuous phase transitions into (1) $\text{SO}(2N)$-singlet mass-order-parameter, (2) $\text{SO}(2N)$-symmetric-tensor mass-order-parameters, and (3) $\text{SO}(2N)$-adjoint nematic-order-parameters, down to $L=1$ value that is relevant to the standard Gross-Neveu model. Below the critical value of $L_c (N)\approx 0.35 N$ for $N\gg1$ only the Gross-Neveu critical point (1) still implies a diverging susceptibility for its corresponding ($\text{SO}(2N)$-singlet) order parameter, whereas the two new critical points that existed at large $L$ ultimately become equivalent to the Gaussian fixed point at $L=1$. We interpret this metamorphosis of the $\text{SO}(2N)$-symmetric-tensor fixed point from critical to spurious as an indication that the transition at $g_{c2}$ in the original Gross-Neveu model is turned first-order by fluctuations.


title: From the Conformal Anomaly to the Virasoro Algebra

abstract: The conformal anomaly and the Virasoro algebra are fundamental aspects of 2D conformal field theory and conformally covariant models in planar random geometry. In this article, we explicitly derive the Virasoro algebra from an axiomatization of the conformal anomaly in terms of real determinant lines, one-dimensional vector spaces associated to Riemann surfaces with analytically parametrized boundary components. Here, analytical orientation-preserving diffeomorphisms and deformations of the circle naturally act on the boundary components. We introduce a sewing operation on the real determinant lines over the semigroup of annuli, which then induces central extensions of the diffeomorphism group, as well as of the complex deformations. Our main theorem shows that on the one hand, the cocycle associated to the central extension of diffeomorphisms is trivial, while on the other hand, the Lie algebra cocycle associated to the central extension of complex deformations is nontrivial, yielding the imaginary part of the Gel'fand-Fuks cocycle. We thus answer a question, partly negatively and partly affirmatively, discussed by Andre Henriques and Dylan Thurston in 2011. The proof uses concrete computations, which we aim to be accessible to a wide audience. We also show an explicit relation to loop Loewner energy, anticipating the real determinant lines to be pertinent to locally conformally covariant (Malliavin-Kontsevich-Suhov) measures on curves and loops, as well as to K\"ahler geometry and geometric quantization of moduli spaces of Riemann surfaces. Inherently, the conformal anomaly and real determinant line bundles are expected to be universal, following a classification of modular functors.


title: Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking

abstract: When writing and talking, people sometimes pause to think. Although reasoning-focused works have often framed reasoning as a method of answering questions or completing agentic tasks, reasoning is implicit in almost all written text. For example, this applies to the steps not stated between the lines of a proof or to the theory of mind underlying a conversation. In the Self-Taught Reasoner (STaR, Zelikman et al. 2022), useful thinking is learned by inferring rationales from few-shot examples in question-answering and learning from those that lead to a correct answer. This is a highly constrained setting -- ideally, a language model could instead learn to infer unstated rationales in arbitrary text. We present Quiet-STaR, a generalization of STaR in which LMs learn to generate rationales at each token to explain future text, improving their predictions. We address key challenges, including 1) the computational cost of generating continuations, 2) the fact that the LM does not initially know how to generate or use internal thoughts, and 3) the need to predict beyond individual next tokens. To resolve these, we propose a tokenwise parallel sampling algorithm, using learnable tokens indicating a thought's start and end, and an extended teacher-forcing technique. Encouragingly, generated rationales disproportionately help model difficult-to-predict tokens and improve the LM's ability to directly answer difficult questions. In particular, after continued pretraining of an LM on a corpus of internet text with Quiet-STaR, we find zero-shot improvements on GSM8K (5.9%$\rightarrow$10.9%) and CommonsenseQA (36.3%$\rightarrow$47.2%) and observe a perplexity improvement of difficult tokens in natural text. Crucially, these improvements require no fine-tuning on these tasks. Quiet-STaR marks a step towards LMs that can learn to reason in a more general and scalable way.


title: Generalized Predictive Model for Autonomous Driving

abstract: In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive data from the web and pair it with diverse and high-quality text descriptions. The resultant dataset accumulates over 2000 hours of driving videos, spanning areas all over the world with diverse weather conditions and traffic scenarios. Inheriting the merits from recent latent diffusion models, our model, dubbed GenAD, handles the challenging dynamics in driving scenes with novel temporal reasoning blocks. We showcase that it can generalize to various unseen driving datasets in a zero-shot manner, surpassing general or driving-specific video prediction counterparts. Furthermore, GenAD can be adapted into an action-conditioned prediction model or a motion planner, holding great potential for real-world driving applications.


title: 3D-VLA: A 3D Vision-Language-Action Generative World Model

abstract: Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from perception to action, neglecting the vast dynamics of the world and the relations between actions and dynamics. In contrast, human beings are endowed with world models that depict imagination about future scenarios to plan actions accordingly. To this end, we propose 3D-VLA by introducing a new family of embodied foundation models that seamlessly link 3D perception, reasoning, and action through a generative world model. Specifically, 3D-VLA is built on top of a 3D-based large language model (LLM), and a set of interaction tokens is introduced to engage with the embodied environment. Furthermore, to inject generation abilities into the model, we train a series of embodied diffusion models and align them into the LLM for predicting the goal images and point clouds. To train our 3D-VLA, we curate a large-scale 3D embodied instruction dataset by extracting vast 3D-related information from existing robotics datasets. Our experiments on held-in datasets demonstrate that 3D-VLA significantly improves the reasoning, multimodal generation, and planning capabilities in embodied environments, showcasing its potential in real-world applications.


title: Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image

abstract: At the core of portrait photography is the search for ideal lighting and viewpoint. The process often requires advanced knowledge in photography and an elaborate studio setup. In this work, we propose Holo-Relighting, a volumetric relighting method that is capable of synthesizing novel viewpoints, and novel lighting from a single image. Holo-Relighting leverages the pretrained 3D GAN (EG3D) to reconstruct geometry and appearance from an input portrait as a set of 3D-aware features. We design a relighting module conditioned on a given lighting to process these features, and predict a relit 3D representation in the form of a tri-plane, which can render to an arbitrary viewpoint through volume rendering. Besides viewpoint and lighting control, Holo-Relighting also takes the head pose as a condition to enable head-pose-dependent lighting effects. With these novel designs, Holo-Relighting can generate complex non-Lambertian lighting effects (e.g., specular highlights and cast shadows) without using any explicit physical lighting priors. We train Holo-Relighting with data captured with a light stage, and propose two data-rendering techniques to improve the data quality for training the volumetric relighting system. Through quantitative and qualitative experiments, we demonstrate Holo-Relighting can achieve state-of-the-arts relighting quality with better photorealism, 3D consistency and controllability.


title: On locally symmetric polynomial metrics: Riemannian and Finslerian surfaces

abstract: In the paper we investigate locally symmetric polynomial metrics in special cases of Riemannian and Finslerian surfaces. The Riemannian case will be presented by a collection of basic results (regularity of second root metrics) and formulas up to Gauss curvature. In case of Finslerian surfaces we formulate necessary and sufficient conditions for a locally symmetric fourth root metric in 2D to be positive definite. They are given in terms of the coefficients of the polynomial metric to make checking the positive definiteness as simple and direct as possible. Explicit examples are also presented. The situation is more complicated in case of spaces of dimension more than two. Some necessary conditions and an explicit example are given for a positive definite locally symmetric polynomial metric in 3D. Computations are supported by the MAPLE mathematics software (LinearAlgebra).


title: OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning

abstract: Visual object tracking aims to localize the target object of each frame based on its initial appearance in the first frame. Depending on the input modility, tracking tasks can be divided into RGB tracking and RGB+X (e.g. RGB+N, and RGB+D) tracking. Despite the different input modalities, the core aspect of tracking is the temporal matching. Based on this common ground, we present a general framework to unify various tracking tasks, termed as OneTracker. OneTracker first performs a large-scale pre-training on a RGB tracker called Foundation Tracker. This pretraining phase equips the Foundation Tracker with a stable ability to estimate the location of the target object. Then we regard other modality information as prompt and build Prompt Tracker upon Foundation Tracker. Through freezing the Foundation Tracker and only adjusting some additional trainable parameters, Prompt Tracker inhibits the strong localization ability from Foundation Tracker and achieves parameter-efficient finetuning on downstream RGB+X tracking tasks. To evaluate the effectiveness of our general framework OneTracker, which is consisted of Foundation Tracker and Prompt Tracker, we conduct extensive experiments on 6 popular tracking tasks across 11 benchmarks and our OneTracker outperforms other models and achieves state-of-the-art performance.


title: Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models

abstract: In spite of their huge success, transformer models remain difficult to scale in depth. In this work, we develop a unified signal propagation theory and provide formulae that govern the moments of the forward and backward signal through the transformer model. Our framework can be used to understand and mitigate vanishing/exploding gradients, rank collapse, and instability associated with high attention scores. We also propose DeepScaleLM, an initialization and scaling scheme that conserves unit output/gradient moments throughout the model, enabling the training of very deep models with 100s of layers. We find that transformer models could be much deeper - our deep models with fewer parameters outperform shallow models in Language Modeling, Speech Translation, and Image Classification, across Encoder-only, Decoder-only and Encoder-Decoder variants, for both Pre-LN and Post-LN transformers, for multiple datasets and model sizes. These improvements also translate into improved performance on downstream Question Answering tasks and improved robustness for image classification.


title: Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference

abstract: Transformers have emerged as the backbone of large language models (LLMs). However, generation remains inefficient due to the need to store in memory a cache of key-value representations for past tokens, whose size scales linearly with the input sequence length and batch size. As a solution, we propose Dynamic Memory Compression (DMC), a method for on-line key-value cache compression at inference time. Most importantly, the model learns to apply different compression rates in different heads and layers. We retrofit pre-trained LLMs such as Llama 2 (7B, 13B and 70B) into DMC Transformers, achieving up to ~3.7x throughput increase in auto-regressive inference on a NVIDIA H100 GPU. DMC is applied via continued pre-training on a negligible percentage of the original data without adding any extra parameters. We find that DMC preserves the original downstream performance with up to 4x cache compression, outperforming up-trained grouped-query attention (GQA). GQA and DMC can be even combined to obtain compounded gains. As a result DMC fits longer contexts and larger batches within any given memory budget.


title: GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping

abstract: Constructing a 3D scene capable of accommodating open-ended language queries, is a pivotal pursuit, particularly within the domain of robotics. Such technology facilitates robots in executing object manipulations based on human language directives. To tackle this challenge, some research efforts have been dedicated to the development of language-embedded implicit fields. However, implicit fields (e.g. NeRF) encounter limitations due to the necessity of processing a large number of input views for reconstruction, coupled with their inherent inefficiencies in inference. Thus, we present the GaussianGrasper, which utilizes 3D Gaussian Splatting to explicitly represent the scene as a collection of Gaussian primitives. Our approach takes a limited set of RGB-D views and employs a tile-based splatting technique to create a feature field. In particular, we propose an Efficient Feature Distillation (EFD) module that employs contrastive learning to efficiently and accurately distill language embeddings derived from foundational models. With the reconstructed geometry of the Gaussian field, our method enables the pre-trained grasping model to generate collision-free grasp pose candidates. Furthermore, we propose a normal-guided grasp module to select the best grasp pose. Through comprehensive real-world experiments, we demonstrate that GaussianGrasper enables robots to accurately query and grasp objects with language instructions, providing a new solution for language-guided manipulation tasks. Data and codes can be available at https://github.com/MrSecant/GaussianGrasper.


title: SCP-Diff: Photo-Realistic Semantic Image Synthesis with Spatial-Categorical Joint Prior

abstract: Semantic image synthesis (SIS) shows good promises for sensor simulation. However, current best practices in this field, based on GANs, have not yet reached the desired level of quality. As latent diffusion models make significant strides in image generation, we are prompted to evaluate ControlNet, a notable method for its dense control capabilities. Our investigation uncovered two primary issues with its results: the presence of weird sub-structures within large semantic areas and the misalignment of content with the semantic mask. Through empirical study, we pinpointed the cause of these problems as a mismatch between the noised training data distribution and the standard normal prior applied at the inference stage. To address this challenge, we developed specific noise priors for SIS, encompassing spatial, categorical, and a novel spatial-categorical joint prior for inference. This approach, which we have named SCP-Diff, has yielded exceptional results, achieving an FID of 10.53 on Cityscapes and 12.66 on ADE20K.The code and models can be accessed via the project page.


title: GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding

abstract: Self-supervised 3D representation learning aims to learn effective representations from large-scale unlabeled point clouds. Most existing approaches adopt point discrimination as the pretext task, which assigns matched points in two distinct views as positive pairs and unmatched points as negative pairs. However, this approach often results in semantically identical points having dissimilar representations, leading to a high number of false negatives and introducing a "semantic conflict" problem. To address this issue, we propose GroupContrast, a novel approach that combines segment grouping and semantic-aware contrastive learning. Segment grouping partitions points into semantically meaningful regions, which enhances semantic coherence and provides semantic guidance for the subsequent contrastive representation learning. Semantic-aware contrastive learning augments the semantic information extracted from segment grouping and helps to alleviate the issue of "semantic conflict". We conducted extensive experiments on multiple 3D scene understanding tasks. The results demonstrate that GroupContrast learns semantically meaningful representations and achieves promising transfer learning performance.


title: Proof of Aperiodicity of hat tile using the Golden Ratio

abstract: The Einstein tile is a novel type of non-periodic tile that can cover the plane without repeating itself. It has a simple shape that resembles a fedora. This research paper unveils the aperiodicity of the newly discovered Einstein tile using the golden ratio, marking a paradigm shift in the field of geometric tiling. This Through rigorous analysis, mathematical modeling, and computational simulations, we provide compelling evidence that the Einstein tile defies conventional periodicity, lacking any repeating pattern or translational symmetry. The unique properties of the Einstein tile open up new avenues for exploring aperiodic tiling systems and their implications in various scientific and technological domains. From cryptography to materials science, the aperiodicity of the Einstein tile presents exciting opportunities for advancements in diverse fields, expanding our understanding of tiling theory and inspiring future explorations into aperiodic structures.


title: Reformulating $\epsilon$-$\delta$ Limits in a Pedagogically Cleaner Way

abstract: We provide a simple reformulation of the $\epsilon$-$\delta$ limit definition introduced in undergraduate calculus courses that enhances its pedagogical value for conceptual understanding and computational skill.


title: p-composites of the main sequence of odd numbers as building blocks for $\pi(x)$

abstract: The prime-counting function $\pi(x)$ which returns the number of primes smaller or equal to a given number is a topic of interest in number theory. An algorithm based on a cyclic group isomorphic to $Z/nZ$, the so-called $Z$-functions, was proposed in view to outperform its pieers. The approach suggests a time complexity $\mathcal{O}(x^{1/2})$ in agreement with optimality of a 2-D squared adaptive-recursive algorithm. The present work is a presentation of various approaches as ascending factorization, the main sequence of odd numbers and partial sequences, T-series, counting function of prime composites, $Z$-modular forms and combinatorial aspects.


title: An Algebraic Extension of the General Leibniz Product rule for Fractional Indices and Applications

abstract: This paper presents a reformulation of the Leibniz product rule as a finite sum that expresses the fractional derivative of the product of two differentiable functions. This paper then proves the cases for when the product consists of an arbitrary differentiable function and a Sheffer sequence , and the case for when the product consists of an arbitrary differentiable function and a confluent hypergeometric limiting function with a positive integer order. Finally, this paper provides example expressions for certain Sheffer sequences: any Apell sequence, the falling factorial, the rising factorial, the exponential polynomial, and the Associated Laguerre polynomial.


title: An extension of Wilson's Theorem

abstract: Let $\mathcal{N}[k]$ be the multiset containing the $\binom{n-1}{k}$ products of $k$-subsets of $\{1,\ldots, n-1\}$. We show that if $n\geq (2c+3)^2$, then \begin{gather*}\left((-1)^c+\sum_{M\in \mathcal{N}[n-1-c]}M\right)\cdot(c+1)\equiv 0\pmod{n},\end{gather*} if and only if $n=(c+1)p$, where $p$ is prime. This provides a combinatorial extension of Wilson's Theorem, which is the special case where $c=0$.


title: Some Generalized Inequlities Involving Extended Beta and Gamma Functions for Several Variables

abstract: Recently, lot of developments and extension of gamma and beta function have been studied by many researchers due to their nice properties and variety of applications in different field of science. The aim of this paper is to investigate some generalized inequalities associated with extended beta and gamma functions.


title: On Unsupervised Image-to-image translation and GAN stability

abstract: The problem of image-to-image translation is one that is intruiging and challenging at the same time, for the impact potential it can have on a wide variety of other computer vision applications like colorization, inpainting, segmentation and others. Given the high-level of sophistication needed to extract patterns from one domain and successfully applying them to another, especially, in a completely unsupervised (unpaired) manner, this problem has gained much attention as of the last few years. It is one of the first problems where successful applications to deep generative models, and especially Generative Adversarial Networks achieved astounding results that are actually of realworld impact, rather than just a show of theoretical prowess; the such that has been dominating the GAN world. In this work, we study some of the failure cases of a seminal work in the field, CycleGAN [1] and hypothesize that they are GAN-stability related, and propose two general models to try to alleviate these problems. We also reach the same conclusion of the problem being ill-posed that has been also circulating in the literature lately.


title: A family of Mordell curves with the rank of at least three

abstract: We constructed a parametrized family of Mordell curves with the rank of at least three.


title: Stochastic Processes and Mean Square Calculus on Fractal Curves

abstract: In this paper, random and stochastic processes are defined on fractal curves. Fractal calculus is used to define cumulative distribution function, probability density function, moments, variance and correlation function of stochastic process on fractal curve. A new framework which is a generalization of mean square calculus is formulated. Sequence of random variable on fractal curve, fractal mean square continuity, mean square $F^{\alpha}$-derivative, and fractal mean square integral. The mean square solution of a fractal stochastic equation is derived and plotted in order to show the details.


title: Classical exponential bounds for p-generalized circular and hyperbolic functions

abstract: In this article, we obtain exponential bounds for the generalized circular and hyperbolic functions with one parameter p. Our results are natural generalizations of some existing results for classical circular and hyperbolic functions.


title: Discrete Opial type inequalities for interval-valued functions

abstract: We introduce the forward (backward) gH-difference operator of interval sequences, and establish some new discrete Opial type inequalities for interval-valued functions. Further, we obtain generalizations of classical discrete Opial type inequalities. Some examples are presented to illustrate our results.


title: Precision Agriculture: Crop Mapping using Machine Learning and Sentinel-2 Satellite Imagery

abstract: Food security has grown in significance due to the changing climate and its warming effects. To support the rising demand for agricultural products and to minimize the negative impact of climate change and mass cultivation, precision agriculture has become increasingly important for crop cultivation. This study employs deep learning and pixel-based machine learning methods to accurately segment lavender fields for precision agriculture, utilizing various spectral band combinations extracted from Sentinel-2 satellite imagery. Our fine-tuned final model, a U-Net architecture, can achieve a Dice coefficient of 0.8324. Additionally, our investigation highlights the unexpected efficacy of the pixel-based method and the RGB spectral band combination in this task.


title: Entropy-Maximizing Dynamics of Continuous Markets

abstract: By assuming the existence of the growth optimal portfolio (GOP), the stationarity of GOP-volatilities, and the maximization of relative entropy, the paper applies the benchmark approach to the modeling of the long-term dynamics of continuous markets. It reveals conservation laws, where the GOP is shown to follow a time-transformed squared Bessel process of dimension four. Moreover, it predicts the convergence of the averages of the GOP-volatilities with respect to the driving independent Brownian motions toward a common level.


title: A Resolution of the Diagonal for Smooth Toric Varieties

abstract: Beilinson gave a resolution of the diagonal for complex projective spaces which Bayer-Popescu-Sturmfels generalized to what they refer to as unimodular toric varieties. Here, we generalize the resolution of the diagonal due to Bayer-Popescu-Sturmfels to smooth toric varieties.


title: A Rapidly Converging Machin-like Formula for $\pi$

abstract: We present a simple recurrent formula to generate the Machin-like expression for calculating $\pi/4$. The method works for any denominator in the starting term and always provides a finite decomposition. We show that the terms in the Machin-like formula decrease so rapidly that the Lehmer's measure can be made arbitrarily small only by selecting the first term. We introduce the concept of the partial Machin-like formula. While the growth of the integer numbers may quickly render the computer implementation impractical, the same reason restricts the total contribution of the high terms. If the required precision is known in advance, the subset of the expression may be selected to satisfy it. We also present the Python program to compute the terms of the Machin-like formula (full and partial), and its Lehmer's measure.


title: Fixed points of generalized contractions on O-metric spaces

abstract: The class of O-metric spaces generalize several existing metric-types in literature including metric spaces, b-metric spaces, and ultra metric spaces. In this paper, we discuss the properties of the topology induced by an O-metric and establish in the setting, fixed point theorems of contractions and generalized contractions. The proofs of the theorems rely heavily on polygon O-inequalities which are a natural generalization of the triangle inequality, and the construction of which leads to the notion of O-series following a pattern of functions.


title: Sur l'article On some ideals of differentiable functions

abstract: This text is a commentary on the paper "On some ideals of differentiable functions" of Ren{\'e} Thom which appeared in Volume II of his "Oeuvres Math{\'e}matiques" published by the Soci{\'e}t{\'e} math{\'e}matique de France, s{\'e}rie "Documents Math{\'e}matiques", in 2019.


title: Inverse application of the generalized Littlewood theorem concerning integrals of the logarithm of analytic functions: an easy method to establish equalities between different analytic functions

abstract: Recently, we have established and used the generalized Littlewood theorem concerning contour integrals of the logarithm of analytical function to obtain new criteria equivalent to the Riemann hypothesis. Later, the same theorem was applied to calculate certain infinite sums and study the properties of zeroes of a few analytical functions. In this Note, we discuss what, in a sense, are inverse applications of this theorem. We first prove an easy Lemma that if two meromorphic on the whole complex plane functions $f(z)$ and $g(z)$ have the same zeroes and poles, taking into account their orders, and have appropriate asymptotic for large $|z|$, then for some integer $n$, $d^n \ln(f(z)/dz^n = d^n\ln(g(z)/dz^n$. The use of this Lemma enables easy proofs of many identities between elliptic functions and their transformation rules. In particular, we show how for any complex number $a$, $\wp(z)-a$, where $\wp(z)$ is Weierstrass $\wp$-function, can be presented as a product and ratio of three elliptic $\theta_1$-functions of certain arguments.


title: Equality of the Casoratian and the Wronsikian for some sets of functions and an application in difference equations

abstract: The Casoratian determinants are very important in the study of linear difference equation, just as the Wronskian determinants are very important in the study of linear ordinary differential equations. The Casoratian and Wronskian determinants of a given set of functions are generally different. In this paper, we show that the Wroskian $ W[1, x, x^2,...,x^n ]$ and the Casoratian $ C[1,x, x^2,...,x^n ] $ of the set of functions $ \{1, x, x^2,...,x^n: \, n \in \mathbb{N} \}$ are equal to each other and independent of the variable $x$. Furthermore, we show that $ W[p_1, p_2,...,p_n, p_{n+1} ]= C[p_1, p_2,..., p_n, p_{n+1} ]$ for any basis $ \mathcal{B} = \{ p_1, p_2,..., p_n, p_{n+1} \}$ of the vector space spanned by $ \{ 1, x, x^2,...,x^n \}$. Finally, we point out some applications of such a Casoratian in the general solution of some types of homogeneous linear difference equations.


title: A New Extended Range of Modified Gamma and Beta Functions

abstract: The aim of this paper is to obtain a new range of modified gamma and beta $k$ function. The author present a brief survey of a new range of modified gamma and beta $k$-function, first and second summation relation, various functional, symmetric, Mellian transform, and integral representation are obtained. Furthermore, mean, variance and the moment generating function for the beta Distribution is studied.


title: Dimensional analysis in forest mensuration

abstract: We apply dimensional analysis with Buckinghams "Pi" theorem to estimate the volume of wood in a tree stem, given the tree's height and diameter. We use Meyer's (1953) data on 31 cherry trees from the Allegheny National forest as the main example, and extend our model to look at other forest mensuration data sets.


title: Trigonometry and Analytic Tools in Olympiad Geometry Problems, Part I

abstract: This is the first part of a series of papers aiming to show how trigonometry and analytic tools can help into tackling demanding Olympiad geometry problems. We present several novel techniques for tackling hard problems from various international and national mathematical competitions, and develop the appropriate theoretical background. Several insightful examples and practice problems are included for the reader to sharpen their problem solving skills. The number of asterisks next to each problem indicate its (subjective) difficulty level, ranging from (*) (early IMO problem) to (***) (hard IMO problem), or ocassionaly (****) (too hard for an IMO problem). Lastly, at the end of the paper we devote a section on providing some historical information on mathematicians whose names appeared in the paper.


title: Constrained Multi-Relational Hyper-Graphons with Maximum Entropy

abstract: This work has two contributions. The first one is extending the Large Deviation Principle for uniform hyper-graphons from Lubetzky and Zhao \cite{lubetzky2015replica} to the multi-relational setting where each hyper-graphon can have different arities. This extension enables the formulation of the most typical possible world in Relational Probabilistic Logic with symmetric relational symbols in terms of entropy maximization subjected to constraints of quantum sub-hypergraph densities. The second contribution is to prove the most typical constrained multi-relational hyper-graphons (the most typical possible worlds) are computable by proving the solutions of the maximum entropy subjected by quantum sub-hypergraph densities in the space of multi-relational hyper-graphons are step functions except for in a zero measure set of combinations of quantum hyper-graphs densities with multiple relations. This result proves in a very general context the conjecture formulated by Radin et al.\ \cite{radin2014asymptotics} that states the constrained graphons with maximum entropy are step functions.


title: Exceptional Collections of Line Bundles for Smooth Toric Fano Surfaces and Threefolds

abstract: The cellular resolution of the diagonal given by Bayer-Popescu-Sturmfels for unimodular projective toric varieties yields a full, strong exceptional collection of line bundles on unimodular projective toric surfaces. The Hanlon-Hicks-Lazarev resolution of the diagonal yields a full, strong exceptional collection of line bundles for 16 of the 18 smooth toric Fano threefolds.


title: An extended version of the $_{r+1}R_{s,k}(B,C,z)$ matrix function

abstract: Recently, Shehata et al. [37] introduced the $_{r+1}R_{s,k}(B,C,z)$ matrix function and established some properties. The aim of this study established to devote and derive certain basic properties including analytic properties, recurrence matrix relations, differential properties, new integral representations, $k$-Beta transform, Laplace transform, fractional k-Fourier transform, fractional integral properties, the $k$-Riemann-Liouville and $k$-Weyl fractional integral and derivative operators an extended version of $_{r+1}R_{s,k}$ matrix function. We establish its relationships with other well known special matrix functions which have some particular cases in the context of three parametric Mittag-Leffer matrix function, $k$-Konhauser and $k$-Laguerre matrix polynomials. Finally, some special cases of the established formulas are also discussed.


title: Characterizations of quasi-homogeneous aggregation functions

abstract: In this article, we first give the characterizations of quasi-homogeneous aggregation functions, which show us that quasi-homogeneous aggregation functions are classified into three classes. We then introduce the concept of triple generator of quasi-homogeneous aggregation function, which is applied to construct a quasi-homogeneous aggregation function.


title: New characterizations of migrative 2-uninorms

abstract: This article pays attention to the $\alpha$-migrativity of 2-uninorms with $\alpha\in [0,1]$ deeply. It describes the $\alpha$-migrativity of 2-uninorms completely, which generalizes and unifies some current existing characterizations for $\alpha$-migrativity of triangular norm, triangular conorm, uninorms, nullnorms, uni-nullnorms and null-uninorms, respectively.


title: Should the choice of BOIN design parameter p.tox only depend on the target DLT rate?

abstract: When the early stopping parameter n.earlystop is relatively small or the cohortsize value is not optimized via simulation, it may be better to use p.tox < 1.4 * target.DLT.rate, or try out different cohort sizes, or increase n.earlystop, whichever is both feasible and provides better operating characteristics. This is because if the cohortsize was not optimized via simulation, even when n.earlystop = 12, the BOIN escalation/de-escalation rules generated using p.tox = 1.4 * target.DLT.rate could be exactly the same as those calculated using p.tox > 3 * target.DLT.rate, which might not be acceptable for some pediatric trials targeting 10% DLT rate. The traditional 3+3 design stops the dose finding process when 3 patients have been treated at the current dose level, 0 DLT has been observed, and the next higher dose has already been eliminated. If additional 3 patients were required to be treated at the current dose in the situation described above, the corresponding boundary table could be generated using BOIN design with target DLT rates ranging from 18% to 29%, p.saf ranging from 8% to 26%, and p.tox ranging from 39% to 99%. To generate the boundary table of this 3+3 design variant, BOIN parameters also need to satisfy a set of conditions.


title: Trustworthy Automated Driving through Qualitative Scene Understanding and Explanations

abstract: We present the Qualitative Explainable Graph (QXG): a unified symbolic and qualitative representation for scene understanding in urban mobility. QXG enables the interpretation of an automated vehicle's environment using sensor data and machine learning models. It leverages spatio-temporal graphs and qualitative constraints to extract scene semantics from raw sensor inputs, such as LiDAR and camera data, offering an intelligible scene model. Crucially, QXG can be incrementally constructed in real-time, making it a versatile tool for in-vehicle explanations and real-time decision-making across various sensor types. Our research showcases the transformative potential of QXG, particularly in the context of automated driving, where it elucidates decision rationales by linking the graph with vehicle actions. These explanations serve diverse purposes, from informing passengers and alerting vulnerable road users (VRUs) to enabling post-analysis of prior behaviours.