title: Measuring Feature Sparsity in Language Models

abstract: Recent works have proposed that activations in language models can be modelled as sparse linear combinations of vectors corresponding to features of input text. Under this assumption, these works aimed to reconstruct feature directions using sparse coding. We develop metrics to assess the success of these sparse coding techniques and test the validity of the linearity and sparsity assumptions. We show our metrics can predict the level of sparsity on synthetic sparse linear activations, and can distinguish between sparse linear data and several other distributions. We use our metrics to measure levels of sparsity in several language models. We find evidence that language model activations can be accurately modelled by sparse linear combinations of features, significantly more so than control datasets. We also show that model activations appear to be sparsest in the first and final layers.


title: Towards the Fundamental Limits of Knowledge Transfer over Finite Domains

abstract: We characterize the statistical efficiency of knowledge transfer through $n$ samples from a teacher to a probabilistic student classifier with input space $\mathcal S$ over labels $\mathcal A$. We show that privileged information at three progressive levels accelerates the transfer. At the first level, only samples with hard labels are known, via which the maximum likelihood estimator attains the minimax rate $\sqrt{{|{\mathcal S}||{\mathcal A}|}/{n}}$. The second level has the teacher probabilities of sampled labels available in addition, which turns out to boost the convergence rate lower bound to ${{|{\mathcal S}||{\mathcal A}|}/{n}}$. However, under this second data acquisition protocol, minimizing a naive adaptation of the cross-entropy loss results in an asymptotically biased student. We overcome this limitation and achieve the fundamental limit by using a novel empirical variant of the squared error logit loss. The third level further equips the student with the soft labels (complete logits) on ${\mathcal A}$ given every sampled input, thereby provably enables the student to enjoy a rate ${|{\mathcal S}|}/{n}$ free of $|{\mathcal A}|$. We find any Kullback-Leibler divergence minimizer to be optimal in the last case. Numerical simulations distinguish the four learners and corroborate our theory.

categories: cs.LG cs.AI cs.IT math.IT math.ST stat.ML stat.TH


title: Marital Sorting, Household Inequality and Selection

abstract: Using CPS data for 1976 to 2022 we explore how wage inequality has evolved for married couples with both spouses working full time full year, and its impact on household income inequality. We also investigate how marriage sorting patterns have changed over this period. To determine the factors driving income inequality we estimate a model explaining the joint distribution of wages which accounts for the spouses' employment decisions. We find that income inequality has increased for these households and increased assortative matching of wages has exacerbated the inequality resulting from individual wage growth. We find that positive sorting partially reflects the correlation across unobservables influencing both members' of the marriage wages. We decompose the changes in sorting patterns over the 47 years comprising our sample into structural, composition and selection effects and find that the increase in positive sorting primarily reflects the increased skill premia for both observed and unobserved characteristics.


title: Active Learning with Dual Model Predictive Path-Integral Control for Interaction-Aware Autonomous Highway On-ramp Merging

abstract: Merging into dense highway traffic for an autonomous vehicle is a complex decision-making task, wherein the vehicle must identify a potential gap and coordinate with surrounding human drivers, each of whom may exhibit diverse driving behaviors. Many existing methods consider other drivers to be dynamic obstacles and, as a result, are incapable of capturing the full intent of the human drivers via this passive planning. In this paper, we propose a novel dual control framework based on Model Predictive Path-Integral control to generate interactive trajectories. This framework incorporates a Bayesian inference approach to actively learn the agents' parameters, i.e., other drivers' model parameters. The proposed framework employs a sampling-based approach that is suitable for real-time implementation through the utilization of GPUs. We illustrate the effectiveness of our proposed methodology through comprehensive numerical simulations conducted in both high and low-fidelity simulation scenarios focusing on autonomous on-ramp merging.


title: Asymptotic freedom in (3+1)-dimensional projectable Horava gravity: connecting ultraviolet to infrared

abstract: We investigate the renormalization group flow of projectable Horava gravity in $(3+1)$ dimensions generated by marginal operators with respect to the Lifshitz scaling. The flow possesses a number of asymptotically free fixed points. We find a family of trajectories connecting one of these fixed points in the ultraviolet to the region of the parameter space where the kinetic term of the theory acquires the general relativistic form. The gravitational coupling exhibits non-monotonic behavior along the flow, vanishing both in the ultraviolet and the infrared.


title: DiPPeR: Diffusion-based 2D Path Planner applied on Legged Robots

abstract: In this work, we present DiPPeR, a novel and fast 2D path planning framework for quadrupedal locomotion, leveraging diffusion-driven techniques. Our contributions include a scalable dataset generator for map images and corresponding trajectories, an image-conditioned diffusion planner for mobile robots, and a training/inference pipeline employing CNNs. We validate our approach in several mazes, as well as in real-world deployment scenarios on Boston Dynamic's Spot and Unitree's Go1 robots. DiPPeR performs on average 23 times faster for trajectory generation against both search based and data driven path planning algorithms with an average of 87% consistency in producing feasible paths of various length in maps of variable size, and obstacle structure. Website: https://rpl-cs-ucl.github.io/DiPPeR


title: Towards a complete mean-field theory for the ductile and brittle yielding of amorphous solids: beyond the paradigm of the Ising model in a random field

abstract: Developing a unified theory describing both ductile and brittle yielding constitutes a fundamental challenge of non-equilibrium statistical physics. Recently, it has been proposed that the nature of the yielding transition is controlled by physics akin to that of the quasistatically driven Random field Ising model (RFIM), which has served as the paradigm for understanding the effect of quenched disorder in slowly driven systems with short-ranged interactions. However, this theoretical picture neglects both the dynamics of, and the elasticity-induced long-ranged interactions between, the mesoscopic material constituents. Here, we address these two aspects and provide a unified theory building on the H\'ebraud-Lequeux elastoplastic description. The first aspect is crucial to understanding the competition between the imposed deformation rate and the finite timescale of plastic rearrangements: we provide a dynamical description of the macroscopic stress drop and predictions for the divergence of the peak susceptibility with inverse shear rate. The second is essential in order to capture properly the behaviour in the limit of quasistatic driving, where avalanches of plasticity diverge with system size at any value of the strain. We fully characterise the avalanche behaviour, which is radically different to that of the RFIM. In the quasistatic, infinite size limit, we find that both models have mean-field Landau exponents, obscuring the effect of the interactions. We show, however, that the latter profoundly affect the behaviour of finite systems approaching the spinodal-like brittle yield point, where we recover qualitatively the finite-size trends found in particle simulations, and modify the nature of the random critical point separating ductile and brittle yielding, where we predict critical behaviour on top of the marginality present at any value of the strain.


title: Saturation-Aware Angular Velocity Estimation: Extending the Robustness of SLAM to Aggressive Motions

abstract: We propose a novel angular velocity estimation method to increase the robustness of Simultaneous Localization And Mapping (SLAM) algorithms against gyroscope saturations induced by aggressive motions. Field robotics expose robots to various hazards, including steep terrains, landslides, and staircases, where substantial accelerations and angular velocities can occur if the robot loses stability and tumbles. These extreme motions can saturate sensor measurements, especially gyroscopes, which are the first sensors to become inoperative. While the structural integrity of the robot is at risk, the resilience of the SLAM framework is oftentimes given little consideration. Consequently, even if the robot is physically capable of continuing the mission, its operation will be compromised due to a corrupted representation of the world. Regarding this problem, we propose a way to estimate the angular velocity using accelerometers during extreme rotations caused by tumbling. We show that our method reduces the median localization error by 71.5 % in translation and 65.5 % in rotation and reduces the number of SLAM failures by 73.3 % on the collected data. We also propose the Tumbling-Induced Gyroscope Saturation (TIGS) dataset, which consists of outdoor experiments recording the motion of a lidar subject to angular velocities four times higher than other available datasets. The dataset is available online at https://github.com/norlab-ulaval/Norlab_wiki/wiki/TIGS-Dataset.


title: On the synergic approach toward the experimental realization of interesting fundamental science within the framework of relativistic flying mirror concept

abstract: The relativistic flying parabolic mirror can provide a higher laser intensity than the intensity a current laser system can reach via the optical-focusing scheme. A weakly-relativistic laser intensity (1.8$\times$10$^{17}$ W/cm$^2$, $\eta$ = 0.29) can be intensified up to a super-strong intensity of >1$\times$10$^{27}$ W/cm$^2$ ($\eta$ $\approx$ 2.2$\times$10$^4$) by the relativistic flying mirror. Such a super-strong field can be applied to study the strong-field quantum electrodynamics in perturbative and non-perturbative regimes. In this review, the analytic derivations on the field strength and distribution obtained by the ideal relativistic flying parabolic mirror have been shown under the 4$\pi$-spherical focusing approach. The quantum nonlinearity parameter is calculated when such a super-strong field collides with the high-energy $\gamma$-photons. The peak quantum nonlinearity parameter reaches above 1600 when the 1-GeV $\gamma$-photon collides with a super-strong laser field reflected and focused by the relativistic flying mirror driven by a 10 PW laser pulse.


title: DAG-aware Synthesis Orchestration

abstract: The key methodologies of modern logic synthesis techniques are conducted on multi-level technology-independent representations such as And-Inverter-Graphs (AIGs) of the digital logic via directed-acyclic-graph (DAGs) traversal based structural rewriting, resubstitution, and refactoring. Existing state-of-the-art DAG-aware logic synthesis algorithms are all designed to perform stand-alone optimizations during a single DAG traversal. However, we empirically identify and demonstrate that these algorithms are limited in quality-of-results and runtime complexity due to this design concept. This work proposes Synthesis Orchestration, which orchestrates stand-alone operations within the single traversal of AIG. Thus, orchestration method explores more optimization opportunities and results in better performance. Our experimental results are comprehensively conducted on all 104 designs collected from ISCAS'85/89/99, VTR, and EPFL benchmark suites, with consistent logic minimization improvements over rewriting, resubstitution, refactoring, leading to an average of 4% more node reduction with improved runtime efficiency for the single optimization. Moreover, we evaluate orchestration as a plug-in algorithm in resyn and resyn3 flows in ABC, which demonstrates consistent logic minimization improvements (3.8% and 10.9% more node reduction on average). The runtime analysis demonstrates the orchestration outperforms stand-alone algorithms in both AIG minimization and runtime efficiency. Finally, we integrate the orchestration into OpenROAD for end-to-end performance evaluation. Our results demonstrate the advantages of the orchestration optimization technique, even after technology mapping and post-routing in the design flow have been conducted.


title: Dependency Practices for Vulnerability Mitigation

abstract: Relying on dependency packages accelerates software development, but it also increases the exposure to security vulnerabilities that may be present in dependencies. While developers have full control over which dependency packages (and which version) they use, they have no control over the dependencies of their dependencies. Such transitive dependencies, which often amount to a greater number than direct dependencies, can become infected with vulnerabilities and put software projects at risk. To mitigate this risk, Practitioners need to select dependencies that respond quickly to vulnerabilities to prevent the propagation of vulnerable code to their project. To identify such dependencies, we analyze more than 450 vulnerabilities in the npm ecosystem to understand why dependent packages remain vulnerable. We identify over 200,000 npm packages that are infected through their dependencies and use 9 features to build a prediction model that identifies packages that quickly adopt the vulnerability fix and prevent further propagation of vulnerabilities. We also study the relationship between these features and the response speed of vulnerable packages. We complement our work with a practitioner survey to understand the applicability of our findings. Developers can incorporate our findings into their dependency management practices to mitigate the impact of vulnerabilities from their dependency supply chain.


title: Framework for Question-Answering in Sanskrit through Automated Construction of Knowledge Graphs

abstract: Sanskrit (sa\d{m}sk\d{r}ta) enjoys one of the largest and most varied literature in the whole world. Extracting the knowledge from it, however, is a challenging task due to multiple reasons including complexity of the language and paucity of standard natural language processing tools. In this paper, we target the problem of building knowledge graphs for particular types of relationships from sa\d{m}sk\d{r}ta texts. We build a natural language question-answering system in sa\d{m}sk\d{r}ta that uses the knowledge graph to answer factoid questions. We design a framework for the overall system and implement two separate instances of the system on human relationships from mah\=abh\=arata and r\=am\=aya\d{n}a, and one instance on synonymous relationships from bh\=avaprak\=a\'sa nigha\d{n}\d{t}u, a technical text from \=ayurveda. We show that about 50% of the factoid questions can be answered correctly by the system. More importantly, we analyse the shortcomings of the system in detail for each step, and discuss the possible ways forward.


title: Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations

abstract: The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment. Researchers have recently explored using large language models (LLMs) to generate synthetic datasets as an alternative approach. However, the effectiveness of the LLM-generated synthetic data in supporting model training is inconsistent across different classification tasks. To better understand factors that moderate the effectiveness of the LLM-generated synthetic data, in this study, we look into how the performance of models trained on these synthetic data may vary with the subjectivity of classification. Our results indicate that subjectivity, at both the task level and instance level, is negatively associated with the performance of the model trained on synthetic data. We conclude by discussing the implications of our work on the potential and limitations of leveraging LLM for synthetic data generation.


title: Conformal prediction with local weights: randomization enables local guarantees

abstract: In this work, we consider the problem of building distribution-free prediction intervals with finite-sample conditional coverage guarantees. Conformal prediction (CP) is an increasingly popular framework for building prediction intervals with distribution-free guarantees, but these guarantees only ensure marginal coverage: the probability of coverage is averaged over a random draw of both the training and test data, meaning that there might be substantial undercoverage within certain subpopulations. Instead, ideally, we would want to have local coverage guarantees that hold for each possible value of the test point's features. While the impossibility of achieving pointwise local coverage is well established in the literature, many variants of conformal prediction algorithm show favorable local coverage properties empirically. Relaxing the definition of local coverage can allow for a theoretical understanding of this empirical phenomenon. We aim to bridge this gap between theoretical validation and empirical performance by proving achievable and interpretable guarantees for a relaxed notion of local coverage. Building on the localized CP method of Guan (2023) and the weighted CP framework of Tibshirani et al. (2019), we propose a new method, randomly-localized conformal prediction (RLCP), which returns prediction intervals that are not only marginally valid but also achieve a relaxed local coverage guarantee and guarantees under covariate shift. Through a series of simulations and real data experiments, we validate these coverage guarantees of RLCP while comparing it with the other local conformal prediction methods.


title: How do chaos and turbulence affect the predictability of natural complex fluid flow systems?

abstract: Natural complex fluid flow systems exhibit turbulent and chaotic behavior that determines their high-level complexity. Chaos has an accurate mathematical definition, while turbulence is a property of fluid flow without an accurate mathematical definition. Using the Kolmogorov complexity (KC) and its derivatives (KC spectrum and its highest value), permutation entropy (PE), and Lyapunov exponent (LE), we considered how chaos and turbulence affect the predictability of natural complex fluid flow systems. This paper applied KC, Kolmogorov complexity spectrum, PE, and LE measures to investigate the turbulent and chaotic behaviors of the monthly streamflow of rivers from Bosnia and Herzegovina, the United States, and the Mendoza Basin (Argentina) and evaluated their time horizons using the Lyapunov time (LT). Based on the measures applied for river streamflow, we derived four modes of the interrelationship between turbulence and chaos. Finally, using those modes, we clustered rivers with similar time horizons representing their predictability. In summary, the calculated quantities of the measures were in the following intervals: (i) KC (0.484, 0.992), (ii) PE (0.632, 0.866), (iii) LE (0.108, 0.278), and (iv) LT (3.4, 9.3 months).


title: On the Computational Complexity of Private High-dimensional Model Selection

abstract: We consider the problem of model selection in a high-dimensional sparse linear regression model under privacy constraints. We propose a differentially private best subset selection method with strong utility properties by adopting the well-known exponential mechanism for selecting the best model. We propose an efficient Metropolis-Hastings algorithm and establish that it enjoys polynomial mixing time to its stationary distribution. Furthermore, we also establish approximate differential privacy for the estimates of the mixed Metropolis-Hastings chain. Finally, we perform some illustrative experiments that show the strong utility of our algorithm.


title: Adaptive Quantization for Key Generation in Low-Power Wide-Area Networks

abstract: Physical layer key generation based on reciprocal and random wireless channels has been an attractive solution for securing resource-constrained low-power wide-area networks (LPWANs). When quantizing channel measurements, namely received signal strength indicator (RSSI), into key bits, the existing works mainly adopt fixed quantization levels and guard band parameters, which fail to fully extract keys from RSSI measurements. In this paper, we propose a novel adaptive quantization scheme for key generation in LPWANs, taking LoRa as a case study. The proposed adaptive quantization scheme can dynamically adjust the quantization parameters according to the randomness of RSSI measurements estimated by Lempel-Ziv complexity (LZ76), while ensuring a predefined key disagreement ratio (KDR). Specifically, our scheme uses pre-trained linear regression models to determine the appropriate quantization level and guard band parameter for each segment of RSSI measurements. Moreover, we propose a guard band parameter calibration scheme during information reconciliation during real-time key generation operation. Experimental evaluations using LoRa devices show that the proposed adaptive quantization scheme outperforms the benchmark differential quantization and fixed quantization with up to 2.35$\times$ and 1.51$\times$ key generation rate (KGR) gains, respectively.


title: VaPr: Variable-Precision Tensors to Accelerate Robot Motion Planning

abstract: High-dimensional motion generation requires numerical precision for smooth, collision-free solutions. Typically, double-precision or single-precision floating-point (FP) formats are utilized. Using these for big tensors imposes a strain on the memory bandwidth provided by the devices and alters the memory footprint, hence limiting their applicability to low-power edge devices needed for mobile robots. The uniform application of reduced precision can be advantageous but severely degrades solutions. Using decreased precision data types for important tensors, we propose to accelerate motion generation by removing memory bottlenecks. We propose variable-precision (VaPr) search optimization to determine the appropriate precision for large tensors from a vast search space of approximately 4 million unique combinations for FP data types across the tensors. To obtain the efficiency gains, we exploit existing platform support for an out-of-the-box GPU speedup and evaluate prospective precision converter units for GPU types that are not currently supported. Our experimental results on 800 planning problems for the Franka Panda robot on the MotionBenchmaker dataset across 8 environments show that a 4-bit FP format is sufficient for the largest set of tensors in the motion generation stack. With the software-only solution, VaPr achieves 6.3% and 6.3% speedups on average for a significant portion of motion generation over the SOTA solution (CuRobo) on Jetson Orin and RTX2080 Ti GPU, respectively, and 9.9%, 17.7% speedups with the FP converter.


title: CrIBo: Self-Supervised Learning via Cross-Image Object-Level Bootstrapping

abstract: Leveraging nearest neighbor retrieval for self-supervised representation learning has proven beneficial with object-centric images. However, this approach faces limitations when applied to scene-centric datasets, where multiple objects within an image are only implicitly captured in the global representation. Such global bootstrapping can lead to undesirable entanglement of object representations. Furthermore, even object-centric datasets stand to benefit from a finer-grained bootstrapping approach. In response to these challenges, we introduce a novel Cross-Image Object-Level Bootstrapping method tailored to enhance dense visual representation learning. By employing object-level nearest neighbor bootstrapping throughout the training, CrIBo emerges as a notably strong and adequate candidate for in-context learning, leveraging nearest neighbor retrieval at test time. CrIBo shows state-of-the-art performance on the latter task while being highly competitive in more standard downstream segmentation tasks. Our code and pretrained models are publicly available at https://github.com/tileb1/CrIBo.


title: Assessing Evaluation Metrics for Neural Test Oracle Generation

abstract: In this work, we revisit existing oracle generation studies plus ChatGPT to empirically investigate the current standing of their performance in both NLG-based and test adequacy metrics. Specifically, we train and run four state-of-the-art test oracle generation models on five NLG-based and two test adequacy metrics for our analysis. We apply two different correlation analyses between these two different sets of metrics. Surprisingly, we found no significant correlation between the NLG-based metrics and test adequacy metrics. For instance, oracles generated from ChatGPT on the project activemq-artemis had the highest performance on all the NLG-based metrics among the studied NOGs, however, it had the most number of projects with a decrease in test adequacy metrics compared to all the studied NOGs. We further conduct a qualitative analysis to explore the reasons behind our observations, we found that oracles with high NLG-based metrics but low test adequacy metrics tend to have complex or multiple chained method invocations within the oracle's parameters, making it hard for the model to generate completely, affecting the test adequacy metrics. On the other hand, oracles with low NLG-based metrics but high test adequacy metrics tend to have to call different assertion types or a different method that functions similarly to the ones in the ground truth. Overall, this work complements prior studies on test oracle generation with an extensive performance evaluation with both NLG and test adequacy metrics and provides guidelines for better assessment of deep learning applications in software test generation in the future.


title: On $(1+\varepsilon)$-Approximate Flow Sparsifiers

abstract: Given a large graph $G$ with a subset $|T|=k$ of its vertices called terminals, a quality-$q$ flow sparsifier is a small graph $G'$ that contains $T$ and preserves all multicommodity flows that can be routed between terminals in $T$, to within factor $q$. The problem of constructing flow sparsifiers with good (small) quality and (small) size has been a central problem in graph compression for decades. A natural approach of constructing $O(1)$-quality flow sparsifiers, which was adopted in most previous constructions, is contraction. Andoni, Krauthgamer, and Gupta constructed a sketch of size $f(k,\varepsilon)$ that stores all feasible multicommodity flows up to a factor of $(1+\varepsilon)$, raised the question of constructing quality-$(1+\varepsilon)$ flow sparsifiers whose size only depends on $k,\varepsilon$ (but not the number of vertices in the input graph $G$), and proposed a contraction-based framework towards it using their sketch result. In this paper, we settle their question for contraction-based flow sparsifiers, by showing that quality-$(1+\varepsilon)$ contraction-based flow sparsifiers with size $f(\varepsilon)$ exist for all $5$-terminal graphs, but not for all $6$-terminal graphs. Our hardness result on $6$-terminal graphs improves upon a recent hardness result by Krauthgamer and Mosenzon on exact (quality-$1$) flow sparsifiers, for contraction-based constructions. Our construction and proof utilize the notion of tight spans in metric geometry, which we believe is a powerful tool for future work.


title: QArchSearch: A Scalable Quantum Architecture Search Package

abstract: The current era of quantum computing has yielded several algorithms that promise high computational efficiency. While the algorithms are sound in theory and can provide potentially exponential speedup, there is little guidance on how to design proper quantum circuits to realize the appropriate unitary transformation to be applied to the input quantum state. In this paper, we present \texttt{QArchSearch}, an AI based quantum architecture search package with the \texttt{QTensor} library as a backend that provides a principled and automated approach to finding the best model given a task and input quantum state. We show that the search package is able to efficiently scale the search to large quantum circuits and enables the exploration of more complex models for different quantum applications. \texttt{QArchSearch} runs at scale and high efficiency on high-performance computing systems using a two-level parallelization scheme on both CPUs and GPUs, which has been demonstrated on the Polaris supercomputer.


title: Interaction graph engineering in trapped-ion quantum simulators with global drives

abstract: Trapped-ion quantum simulators have demonstrated a long history of studying the physics of interacting spin-lattice systems using globally addressed entangling operations. Here, we seek to broaden and delimit the classes of effective spin-spin interactions achievable using exclusively global driving fields. We find that new categories of interaction graphs become achievable with perfect or near-perfect theoretical fidelity by tailoring the coupling to each vibrational mode of the ion crystal, or by shaping the trapping potential to include specific anharmonic terms. We also derive a rigorous test to determine whether a desired interaction graph is accessible using only globally driven fields. These tools broaden the reach of trapped-ion quantum simulators so that they may more easily address open questions in materials science and quantum chemistry.


title: Generalized extremal branes in AdS/CMT and holographic superconductors

abstract: AdS$_4$ generalized extremal branes are scrutinized in the context of AdS/CFT. Holographic superconductors are studied as dual objects to AdS$_4$ generalized black branes, whose coefficients of response and transport in the dual condensed matter theory are calculated and discussed. The holographic Weyl anomaly is also addressed. The holographic superconductor bound current is shown to be enhanced by the parameter controlling the family of AdS$_4$ generalized extremal brane solutions, when compared to the standard AdS$_4$-Reissner-Nordstr\"om black brane results. In the probe limit, the electrical DC conductivity for holographic superconductors with AdS$_4$ generalized extremal brane dual background is also reported.


title: Non-isothermal nonlocal phase-field models with a double-obstacle potential

abstract: Phase-field models are a popular choice in computational physics to describe complex dynamics of substances with multiple phases and are widely used in various applications. We present nonlocal non-isothermal phase-field models of Cahn-Hilliard and Allen-Cahn types involving a nonsmooth double-well obstacle potential. Mathematically, in a weak form, the model translates to a system of variational inequalities coupled to a temperature evolution equation. We demonstrate that under certain conditions and with a careful choice of the nonlocal operator one can obtain a model that allows for sharp interfaces in the solution that evolve in time, which is a desirable property in many applications. This can be contrasted to the diffuse-interface local models that can not resolve sharp interfaces. We present the well-posedness analysis of the models, discuss an appropriate numerical discretization scheme, and supplement our findings with several numerical experiments.


title: An $\tilde\Omega\big(\sqrt{\log |T|}\big)$ Lower Bound for Steiner Point Removal

abstract: In the Steiner point removal (SPR) problem, we are given a (weighted) graph $G$ and a subset $T$ of its vertices called terminals, and the goal is to compute a (weighted) graph $H$ on $T$ that is a minor of $G$, such that the distance between every pair of terminals is preserved to within some small multiplicative factor, that is called the stretch of $H$. It has been shown that on general graphs we can achieve stretch $O(\log |T|)$ [Filtser, 2018]. On the other hand, the best-known stretch lower bound is $8$ [Chan-Xia-Konjevod-Richa, 2006], which holds even for trees. In this work, we show an improved lower bound of $\tilde\Omega\big(\sqrt{\log |T|}\big)$.


title: A rotating accretion disk around MWC297, a young B1.5 Ve star

abstract: High resolution spectra with iSHELL on IRTF in the K and M band of the young, heavily accreting B 1.5e star MWC297 show numerous double-peaked CO lines. These CO lines originate in an inclined gaseous disk in Keplerian rotation. MWC297 is the only early B star known to show a Keplerian disk in CO. Analysis of the spectra show that 12CO 1 - 0 is optically thick for the low excitation lines. Even the 13CO 1 - 0 and 12CO 2 - 1 have somewhat optically thick lines at low J levels. We find that the CO emission in the disk can be fitted with CO being in a narrow ring at a radius of 12 AU, with a temperature of 1500 K, and a CO column density of 1.6 e18 cm-2. This model underestimates the line strength of high J lines, indicating that they are excited by fluorescence. The CO overtone lines have a similar temperature, The 13CO lines are much brighter than expected from interstellar isotope ratios. The 13CO lines are wider than the 12CO ones suggesting different excitation conditions. The same is true for 12CO 2 - 1. We see strong absorption in 12CO and 13CO 1 - 0 at low J levels, which is due to two two cold foreground clouds. These clouds, one with a temperature of 8.3 K and a column density of 6.7 e17 cm-2, and the other one colder and with lower column density, can fully account for the observed extinction toward MWC297.


title: Towards Foundation Models for Materials Science: The Open MatSci ML Toolkit

abstract: Artificial intelligence and machine learning have shown great promise in their ability to accelerate novel materials discovery. As researchers and domain scientists seek to unify and consolidate chemical knowledge, the case for models with potential to generalize across different tasks within materials science - so-called "foundation models" - grows with ambitions. This manuscript reviews our recent progress with development of Open MatSci ML Toolkit, and details experiments that lay the groundwork for foundation model research and development with our framework. First, we describe and characterize a new pretraining task that uses synthetic data generated from symmetry operations, and reveal complex training dynamics at large scales. Using the pretrained model, we discuss a number of use cases relevant to foundation model development: semantic architecture of datasets, and fine-tuning for property prediction and classification. Our key results show that for simple applications, pretraining appears to provide worse modeling performance than training models from random initialization. However, for more complex instances, such as when a model is required to learn across multiple datasets and types of targets simultaneously, the inductive bias from pretraining provides significantly better performance. This insight will hopefully inform subsequent efforts into creating foundation models for materials science applications.


title: The Specter (and Spectra) of Miner Extractable Value

abstract: Miner extractable value (MEV) refers to any excess value that a transaction validator can realize by manipulating the ordering of transactions. In this work, we introduce a simple theoretical definition of the 'cost of MEV', prove some basic properties, and show that the definition is useful via a number of examples. In a variety of settings, this definition is related to the 'smoothness' of a function over the symmetric group. From this definition and some basic observations, we recover a number of results from the literature.


title: On the anisotropic distribution of clusters in the local Universe

abstract: In his 2021 lecture to the Canadian Association of Physicists Congress, P.J.E. Peebles pointed out that the brightest extra-galactic radio sources tend to be aligned with the plane of the de Vaucouleur Local Supercluster up to redshifts of $z=0.02$ ($d_{\rm MW}\approx 85~\rm{Mpc}$). He then asked whether such an alignment of clusters is anomalous in the standard $\Lambda$CDM framework. In this letter, we employ an alternative, absolute orientation agnostic, measure of the anisotropy based on the inertia tensor axis ratio of these brightest sources and use a large cosmological simulation from the FLAMINGO suite to measure how common such an alignment of structures is. We find that only 3.5% of randomly selected regions display an anisotropy of their clusters more extreme than the one found in the local Universe's radio data. This sets the region around the Milky Way as a $1.85\sigma$ outlier. Varying the selection parameters of the objects in the catalogue, we find that the clusters in the local Universe are never more than $2\sigma$ away from the simulations' prediction for the same selection. We thus conclude that the reported anisotropy, whilst note-worthy, is not in tension with the $\Lambda$CDM paradigm.


title: Cheap Talking Algorithms

abstract: We simulate behaviour of two independent reinforcement learning algorithms playing the Crawford and Sobel (1982) game of strategic information transmission. We adopt memoryless algorithms to capture learning in a static game where a large population interacts anonymously. We show that sender and receiver converge to Nash equilibrium play. The level of informativeness of the sender's cheap talk decreases as the bias increases and, at intermediate level of the bias, it matches the level predicted by the Pareto optimal equilibrium or by the second best one. Conclusions are robust to alternative specifications of the learning hyperparameters and of the game.


title: Viderman's algorithm for quantum LDPC codes

abstract: Quantum low-density parity-check (LDPC) codes, a class of quantum error correcting codes, are considered a blueprint for scalable quantum circuits. To use these codes, one needs efficient decoding algorithms. In the classical setting, there are multiple efficient decoding algorithms available, including Viderman's algorithm (Viderman, TOCT 2013). Viderman's algorithm for classical LDPC codes essentially reduces the error-correction problem to that of erasure-correction, by identifying a small envelope $L$ that is guaranteed to contain the error set. Our main result is a generalization of Viderman's algorithm to quantum LDPC codes, namely hypergraph product codes (Tillich, Z\'emor, IEEE T-IT, 2013). This is the first erasure-conversion algorithm that can correct up to $\Omega(D)$ errors for constant-rate quantum LDPC codes, where $D$ is the distance of the code. In that sense, it is also fundamentally different from existing decoding algorithms, in particular from the small-set-flip algorithm (Leverrier, Tillich, Z\'emor, FOCS, 2015). Moreover, in some parameter regimes, our decoding algorithm improves on the decoding radius of existing algorithms. We note that we do not yet have linear-time erasure-decoding algorithms for quantum LDPC codes, and thus the final running time of the whole decoding algorithm is not linear; however, we view our linear-time envelope-finding algorithm as an important first step.


title: Kronecker-structured Sparse Vector Recovery with Application to IRS-MIMO Channel Estimation

abstract: This paper studies the problem of Kronecker-structured sparse vector recovery from an underdetermined linear system with a Kronecker-structured dictionary. Such a problem arises in many real-world applications such as the sparse channel estimation of an intelligent reflecting surface-aided multiple-input multiple-output system. The prior art only exploits the Kronecker structure in the support of the sparse vector and solves the entire linear system together leading to high computational complexity. Instead, we break down the original sparse recovery problem into multiple independent sub-problems and solve them individually. We obtain the sparse vector as the Kronecker product of the individual solutions, retaining its structure in both support and nonzero entries. Our simulations demonstrate the superior performance of our methods in terms of accuracy and run time compared with the existing works, using synthetic data and the channel estimation application. We attribute the low run time to the reduced solution space due to the additional structure and improved accuracy to the denoising effect owing to the decomposition step.


title: Hierarchical planning-scheduling-control -- Optimality surrogates and derivative-free optimization

abstract: Planning, scheduling, and control typically constitute separate decision-making units within chemical companies. Traditionally, their integration is modelled sequentially, but recent efforts prioritize lower-level feasibility and optimality, leading to large-scale, potentially multi-level, hierarchical formulations. Data-driven techniques, like optimality surrogates or derivative-free optimization, become essential in addressing ensuing tractability challenges. We demonstrate a step-by-step workflow to find a tractable solution to a tri-level formulation of a multi-site, multi-product planning-scheduling-control case study. We discuss solution tractability-accuracy trade-offs and scaling properties for both methods. Despite individual improvements over conventional heuristics, both approaches present drawbacks. Consequently, we synthesize our findings into a methodology combining their strengths. Our approach remains agnostic to the level-specific formulations when the linking variables are identified and retains the heuristic sequential solution as fallback option. We advance the field by leveraging parallelization, hyperparameter tuning, and a combination of off- and on-line computation, to find tractable solutions to more accurate multi-level formulations.


title: Hierarchical Pretraining on Multimodal Electronic Health Records

abstract: Pretraining has proven to be a powerful technique in natural language processing (NLP), exhibiting remarkable success in various NLP downstream tasks. However, in the medical domain, existing pretrained models on electronic health records (EHR) fail to capture the hierarchical nature of EHR data, limiting their generalization capability across diverse downstream tasks using a single pretrained model. To tackle this challenge, this paper introduces a novel, general, and unified pretraining framework called MEDHMP, specifically designed for hierarchically multimodal EHR data. The effectiveness of the proposed MEDHMP is demonstrated through experimental results on eight downstream tasks spanning three levels. Comparisons against eighteen baselines further highlight the efficacy of our approach.


title: Monte Carlo methods for stationary solutions of general-relativistic Vlasov systems: Collisionless accretion onto black holes

abstract: We develop a Monte Carlo simulation method for computing stationary solutions of the general-relativistic Vlasov equation describing a gas of non-colliding particles. As specific examples, we select planar or spherically symmetric accretion models on the Schwarzschild background spacetime. In all cases the gas extends to infinity, which poses an additional difficulty in the Monte Carlo approach. We discuss models with monoenergetic particles as well as solutions obeying the Maxwell-J\"{u}ttner distribution at infinity. For all models, exact expressions for the particle current density are known or can be computed analytically. We demonstrate perfect agreement between exact expressions for the particle current density and the results of our Monte Carlo simulations.


title: Stability under scaling in the local phases of multiplicative functions

abstract: We introduce a strategy to tackle some known obstructions of current approaches to the Fourier uniformity conjecture. Assuming GRH, we then show the conjecture holds for intervals of length at least $(\log X)^{\psi(X)}$, with $\psi(X) \rightarrow \infty$ an arbitrarily slowly growing function of $X$. We expect the methods should adapt to nilsequences, thus also showing that the Generalised Riemann Hypothesis implies close to exponential growth in the sign patterns of the Liouville function.


title: Refined Mechanism Design for Approximately Structured Priors via Active Regression

abstract: We consider the problem of a revenue-maximizing seller with a large number of items $m$ for sale to $n$ strategic bidders, whose valuations are drawn independently from high-dimensional, unknown prior distributions. It is well-known that optimal and even approximately-optimal mechanisms for this setting are notoriously difficult to characterize or compute, and, even when they can be found, are often rife with various counter-intuitive properties. In this paper, following a model introduced recently by Cai and Daskalakis~\cite{cai2022recommender}, we consider the case that bidders' prior distributions can be well-approximated by a topic model. We design an active learning component, responsible for interacting with the bidders and outputting low-dimensional approximations of their types, and a mechanism design component, responsible for robustifying mechanisms for the low-dimensional model to work for the approximate types of the former component. On the active learning front, we cast our problem in the framework of Randomized Linear Algebra (RLA) for regression problems, allowing us to import several breakthrough results from that line of research, and adapt them to our setting. On the mechanism design front, we remove many restrictive assumptions of prior work on the type of access needed to the underlying distributions and the associated mechanisms. To the best of our knowledge, our work is the first to formulate connections between mechanism design, and RLA for active learning of regression problems, opening the door for further applications of randomized linear algebra primitives to mechanism design.


title: TabLib: A Dataset of 627M Tables with Context

abstract: It is well-established that large, diverse datasets play a pivotal role in the performance of modern AI systems for text and image modalities. However, there are no datasets for tabular data of comparable size and diversity to those available for text and images. Thus we present "TabLib'', a compilation of 627 million tables totaling 69 TiB, along with 867B tokens of context. TabLib was extracted from numerous file formats, including CSV, HTML, SQLite, PDF, Excel, and others, sourced from GitHub and Common Crawl. The size and diversity of TabLib offer considerable promise in the table modality, reminiscent of the original promise of foundational datasets for text and images, such as The Pile and LAION.


title: Rounding out the story of higher derivative consistent truncations

abstract: At the two-derivative order, the group manifold reduction of heterotic supergravity on $S^3$ results in a half-maximal 7D gauged supergravity coupled to three vector multiplets, and a further truncation can be taken to remove the vector multiplets. We demonstrate that this truncation remains consistent at the four-derivative level; we do so both by analysis of the equations of motion and the supersymmetry variations.


title: On splitting complete manifolds via infinity harmonic functions

abstract: In this paper, we prove some splitting results for manifolds supporting a non-constant infinity harmonic function which has at most linear growth on one side. Manifolds with non-negative Ricci or sectional curvature are considered. In dimension 2, we extend Savin's theorem on Lipschitz infinity harmonic functions in the plane to every surface with non-negative sectional curvature.


title: Coupled Scheme for Linear and Hamilton-Jacobi Equations: Theoretical and Numerical Aspects

abstract: We present a comprehensive analysis of the coupled scheme introduced in [Springer Proceedings in Mathematics \& Statistics, vol 237. Springer, Cham 2018 \cite{S2018}] for linear and Hamilton-Jacobi equations. This method merges two distinct schemes, each tailored to handle specific solution characteristics. It offers a versatile framework for coupling various schemes, enabling the integration of accurate methods for smooth solutions and the treatment of discontinuities and gradient jumps. In \cite{S2018}, the emphasis was on coupling an anti-dissipative scheme designed for discontinuous solutions with a semi-Lagrangian scheme developed for smooth solutions. In this paper, we rigorously establish the essential properties of the resulting coupled scheme, especially in the linear case. To illustrate the effectiveness of this coupled approach, we present a series of one-dimensional examples.


title: Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy Risks

abstract: Privacy is a key principle for developing ethical AI technologies, but how does including AI technologies in products and services change privacy risks? We constructed a taxonomy of AI privacy risks by analyzing 321 documented AI privacy incidents. We codified how the unique capabilities and requirements of AI technologies described in those incidents generated new privacy risks, exacerbated known ones, or otherwise did not meaningfully alter the risk. We present 12 high-level privacy risks that AI technologies either newly created (e.g., exposure risks from deepfake pornography) or exacerbated (e.g., surveillance risks from collecting training data). One upshot of our work is that incorporating AI technologies into a product can alter the privacy risks it entails. Yet, current approaches to privacy-preserving AI/ML (e.g., federated learning, differential privacy, checklists) only address a subset of the privacy risks arising from the capabilities and data requirements of AI.


title: Design Patterns of Biological Cells

abstract: Design patterns are generalized solutions to frequently recurring problems. They were initially developed by architects and computer scientists to create a higher level of abstraction for their designs. Here, we extend these concepts to cell biology in order to lend a new perspective on the evolved designs of cells' underlying reaction networks. We present a catalog of 21 design patterns divided into three categories: creational patterns describe processes that build the cell, structural patterns describe the layouts of reaction networks, and behavioral patterns describe reaction network function. Applying this pattern language to the E. coli central metabolic reaction network, the yeast pheromone response signaling network, and other examples lends new insights into these systems.


title: DeePref: Deep Reinforcement Learning For Video Prefetching In Content Delivery Networks

abstract: Content Delivery Networks carry the majority of Internet traffic, and the increasing demand for video content as a major IP traffic across the Internet highlights the importance of caching and prefetching optimization algorithms. Prefetching aims to make data available in the cache before the requester places its request to reduce access time and improve the Quality of Experience on the user side. Prefetching is well investigated in operating systems, compiler instructions, in-memory cache, local storage systems, high-speed networks, and cloud systems. Traditional prefetching techniques are well adapted to a particular access pattern, but fail to adapt to sudden variations or randomization in workloads. This paper explores the use of reinforcement learning to tackle the changes in user access patterns and automatically adapt over time. To this end, we propose, DeePref, a Deep Reinforcement Learning agent for online video content prefetching in Content Delivery Networks. DeePref is a prefetcher implemented on edge networks and is agnostic to hardware design, operating systems, and applications. Our results show that DeePref DRQN, using a real-world dataset, achieves a 17% increase in prefetching accuracy and a 28% increase in prefetching coverage on average compared to baseline approaches that use video content popularity as a building block to statically or dynamically make prefetching decisions. We also study the possibility of transfer learning of statistical models from one edge network into another, where unseen user requests from unknown distribution are observed. In terms of transfer learning, the increase in prefetching accuracy and prefetching coverage are [$30%$, $10%$], respectively. Our source code will be available on Github.


title: The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Research

abstract: In this paper, we investigate the practical relevance of explainable artificial intelligence (XAI) with a special focus on the producing industries and relate them to the current state of academic XAI research. Our findings are based on an extensive series of interviews regarding the role and applicability of XAI along the Machine Learning (ML) lifecycle in current industrial practice and its expected relevance in the future. The interviews were conducted among a great variety of roles and key stakeholders from different industry sectors. On top of that, we outline the state of XAI research by providing a concise review of the relevant literature. This enables us to provide an encompassing overview covering the opinions of the surveyed persons as well as the current state of academic research. By comparing our interview results with the current research approaches we reveal several discrepancies. While a multitude of different XAI approaches exists, most of them are centered around the model evaluation phase and data scientists. Their versatile capabilities for other stages are currently either not sufficiently explored or not popular among practitioners. In line with existing work, our findings also confirm that more efforts are needed to enable also non-expert users' interpretation and understanding of opaque AI models with existing methods and frameworks.


title: The spatial evolution of economic activities and the emergence of cities

abstract: This paper studies the spatial agglomeration of workers and income in a continuous space and time framework. Production and consumption are decided in local markets, characterized by the presence of spatial spillovers and amenities. Workers move across locations maximizing their instantaneous utility, subject to mobility costs. We prove the existence of a short-run Cournot-Nash equilibrium, and that, in the limit of an infinite number of workers, the sequence of short-run equilibria can be expressed by a partial differential equation. We characterize the conditions under which the long-run equilibrium displays spatial agglomerations. Social welfare is non-decreasing over time, and in the long-run equilibrium the expected utility of a representative worker is equalized over space and, therefore, the spatial allocation is efficient. The model can reproduce several stylized effects, such as the emergence of spatial agglomerations (cities) with different sizes and shapes; the dependence by history of spatial pattern of economic activities; a non-linear out-of-equilibrium dynamics; and finally, the phenomenon of metastability, where a long period of apparent stability in the spatial distribution is followed by a sharp transition to a new equilibrium.


title: Secretary Problems with Random Number of Candidates: How Prior Distributional Information Helps

abstract: We study variants of the secretary problem, where $N$, the number of candidates, is a random variable, and the decision maker wants to maximize the probability of success -- picking the largest number among the $N$ candidates -- using only the relative ranks of the candidates revealed so far. We consider three forms of prior information about $\mathbf p$, the probability distribution of $N$. In the full information setting, we assume $\mathbf p$ to be fully known. In that case, we show that single-threshold type of strategies can achieve $1/e$-approximation to the maximum probability of success among all possible strategies. In the upper bound setting, we assume that $N\leq \overline{n}$ (or $\mathbb E[N]\leq \bar{\mu}$), where $\bar{n}$ (or $\bar{\mu}$) is known. In that case, we show that randomization over single-threshold type of strategies can achieve the optimal worst case probability of success of $\frac{1}{\log(\bar{n})}$ (or $\frac{1}{\log(\bar{\mu})}$) asymptotically. Surprisingly, there is a single-threshold strategy (depending on $\overline{n}$) that can succeed with probability $2/e^2$ for all but an exponentially small fraction of distributions supported on $[\bar{n}]$. In the sampling setting, we assume that we have access to $m$ samples $N^{(1)},\ldots,N^{(m)}\sim_{iid} \mathbf p$. In that case, we show that if $N\leq T$ with probability at least $1-O(\epsilon)$ for some $T\in \mathbb N$, $m\gtrsim \frac{1}{\epsilon^2}\max(\log(\frac{1}{\epsilon}),\epsilon \log(\frac{\log(T)}{\epsilon}))$ is enough to learn a strategy that is at least $\epsilon$-suboptimal, and we provide a lower bound of $\Omega(\frac{1}{\epsilon^2})$, showing that the sampling algorithm is optimal when $\epsilon=O(\frac{1}{\log\log(T)})$.


title: Leader-Follower Neural Networks with Local Error Signals Inspired by Complex Collectives

abstract: The collective behavior of a network with heterogeneous, resource-limited information processing units (e.g., group of fish, flock of birds, or network of neurons) demonstrates high self-organization and complexity. These emergent properties arise from simple interaction rules where certain individuals can exhibit leadership-like behavior and influence the collective activity of the group. Motivated by the intricacy of these collectives, we propose a neural network (NN) architecture inspired by the rules observed in nature's collective ensembles. This NN structure contains workers that encompass one or more information processing units (e.g., neurons, filters, layers, or blocks of layers). Workers are either leaders or followers, and we train a leader-follower neural network (LFNN) by leveraging local error signals and optionally incorporating backpropagation (BP) and global loss. We investigate worker behavior and evaluate LFNNs through extensive experimentation. Our LFNNs trained with local error signals achieve significantly lower error rates than previous BP-free algorithms on MNIST and CIFAR-10 and even surpass BP-enabled baselines. In the case of ImageNet, our LFNN-l demonstrates superior scalability and outperforms previous BP-free algorithms by a significant margin.


title: A Survey of Feature Types and Their Contributions for Camera Tampering Detection

abstract: Camera tamper detection is the ability to detect unauthorized and unintentional alterations in surveillance cameras by analyzing the video. Camera tampering can occur due to natural events or it can be caused intentionally to disrupt surveillance. We cast tampering detection as a change detection problem, and perform a review of the existing literature with emphasis on feature types. We formulate tampering detection as a time series analysis problem, and design experiments to study the robustness and capability of various feature types. We compute ten features on real-world surveillance video and apply time series analysis to ascertain their predictability, and their capability to detect tampering. Finally, we quantify the performance of various time series models using each feature type to detect tampering.


title: Unsupervised Denoising for Signal-Dependent and Row-Correlated Imaging Noise

abstract: Accurate analysis of microscopy images is hindered by the presence of noise. This noise is usually signal-dependent and often additionally correlated along rows or columns of pixels. Current self- and unsupervised denoisers can address signal-dependent noise, but none can reliably remove noise that is also row- or column-correlated. Here, we present the first fully unsupervised deep learning-based denoiser capable of handling imaging noise that is row-correlated as well as signal-dependent. Our approach uses a Variational Autoencoder (VAE) with a specially designed autoregressive decoder. This decoder is capable of modeling row-correlated and signal-dependent noise but is incapable of independently modeling underlying clean signal. The VAE therefore produces latent variables containing only clean signal information, and these are mapped back into image space using a proposed second decoder network. Our method does not require a pre-trained noise model and can be trained from scratch using unpaired noisy data. We show that our approach achieves competitive results when applied to a range of different sensor types and imaging modalities.


title: Viability of Mobile Forms for Population Health Surveys in Low Resource Areas

abstract: Population health surveys are an important tool to effectively allocate limited resources in low resource communities. In such an environment, surveys are often done by local population with pen and paper. Data thus collected is difficult to tabulate and analyze. We conducted a series of interviews and experiments in the Philippines to assess if mobile forms can be a viable and more efficient survey method. We first conducted pilot interviews and found 60% of the local surveyors actually preferred mobile forms over paper. We then built a software that can generate mobile forms that are easy to use, capable of working offline, and able to track key metrics such as time to complete questions. Our mobile form was field tested in three locations in the Philippines with 33 surveyors collecting health survey responses from 266 subjects. The percentage of surveyors preferring mobile forms increased to 76% after just using the form a few times. The results demonstrate our mobile form is a viable method to conduct large scale population health surveys in a low resource environment.


title: LangNav: Language as a Perceptual Representation for Navigation

abstract: We explore the use of language as a perceptual representation for vision-and-language navigation (VLN), with a focus on low-data settings. Our approach uses off-the-shelf vision systems for image captioning and object detection to convert an agent's egocentric panoramic view at each time step into natural language descriptions. We then finetune a pretrained language model to select an action, based on the current view and the trajectory history, that would best fulfill the navigation instructions. In contrast to the standard setup which adapts a pretrained language model to work directly with continuous visual features from pretrained vision models, our approach instead uses (discrete) language as the perceptual representation. We explore several use cases of our language-based navigation (LangNav) approach on the R2R VLN benchmark: generating synthetic trajectories from a prompted language model (GPT-4) with which to finetune a smaller language model; domain transfer where we transfer a policy learned on one simulated environment (ALFRED) to another (more realistic) environment (R2R); and combining both vision- and language-based representations for VLN. Our approach is found to improve upon baselines that rely on visual features in settings where only a few expert trajectories (10-100) are available, demonstrating the potential of language as a perceptual representation for navigation.


title: Cut-Cell Microstructures for Two-scale Structural Optimization

abstract: Two-scale topology optimization, combined with the design of microstructure families with a broad range of effective material parameters, is increasingly widely used in many fabrication applications to achieve a target deformation behavior for a variety of objects. The main idea of this approach is to optimize the distribution of material properties in the object partitioned into relatively coarse cells, and then replace each cell with microstructure geometry that mimics these material properties. In this paper, we focus on adapting this approach to complex shapes in situations when preserving the shape's surface is important. Our approach extends any regular (i.e. defined on a regular lattice grid) microstructure family to complex shapes, by enriching it with individually optimized cut-cell tiles adapted to the geometry of the cut-cell. We propose an automated and robust pipeline based on this approach, and we show that the performance of the regular microstructure family is only minimally affected by our extension while allowing its use on 2D and 3D shapes of high complexity.


title: A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks

abstract: Feature learning is thought to be one of the fundamental reasons for the success of deep neural networks. It is rigorously known that in two-layer fully-connected neural networks under certain conditions, one step of gradient descent on the first layer can lead to feature learning; characterized by the appearance of a separated rank-one component -- spike -- in the spectrum of the feature matrix. However, with a constant gradient descent step size, this spike only carries information from the linear component of the target function and therefore learning non-linear components is impossible. We show that with a learning rate that grows with the sample size, such training in fact introduces multiple rank-one components, each corresponding to a specific polynomial feature. We further prove that the limiting large-dimensional and large sample training and test errors of the updated neural networks are fully characterized by these spikes. By precisely analyzing the improvement in the training and test errors, we demonstrate that these non-linear features can enhance learning.


title: ASV Station Keeping under Wind Disturbances using Neural Network Simulation Error Minimization Model Predictive Control

abstract: Station keeping is an essential maneuver for Autonomous Surface Vehicles (ASVs), mainly when used in confined spaces, to carry out surveys that require the ASV to keep its position or in collaboration with other vehicles where the relative position has an impact over the mission. However, this maneuver can become challenging for classic feedback controllers due to the need for an accurate model of the ASV dynamics and the environmental disturbances. This work proposes a Model Predictive Controller using Neural Network Simulation Error Minimization (NNSEM-MPC) to accurately predict the dynamics of the ASV under wind disturbances. The performance of the proposed scheme under wind disturbances is tested and compared against other controllers in simulation, using the Robotics Operating System (ROS) and the multipurpose simulation environment Gazebo. A set of six tests were conducted by combining two wind speeds (3 m/s and 6 m/s) and three wind directions (0$^\circ$, 90$^\circ$, and 180$^\circ$). The simulation results clearly show the advantage of the NNSEM-MPC over the following methods: backstepping controller, sliding mode controller, simplified dynamics MPC (SD-MPC), neural ordinary differential equation MPC (NODE-MPC), and knowledge-based NODE MPC (KNODE-MPC). The proposed NNSEM-MPC approach performs better than the rest in 4 out of the 6 test conditions, and it is the second best in the 2 remaining test cases, reducing the mean position and heading error by at least 31\% and 46\% respectively across all the test cases. In terms of execution speed, the proposed NNSEM-MPC is at least 36\% faster than the rest of the MPC controllers. The field experiments on two different ASV platforms showed that ASVs can effectively keep the station utilizing the proposed method, with a position error as low as $1.68$ m and a heading error as low as $6.14^{\circ}$ within time windows of at least $150$s.


title: Borel line graphs

abstract: We characterize Borel line graphs in terms of 10 forbidden induced subgraphs, namely the 9 finite graphs from the classical result of Beineke together with a 10th infinite graph associated to the equivalence relation $\mathbb{E}_0$ on the Cantor space. As a corollary, we prove a partial converse to the Feldman--Moore theorem, which allows us to characterize all locally countable Borel line graphs in terms of their Borel chromatic numbers.


title: Efficient Integrators for Diffusion Generative Models

abstract: Diffusion models suffer from slow sample generation at inference time. Therefore, developing a principled framework for fast deterministic/stochastic sampling for a broader class of diffusion models is a promising direction. We propose two complementary frameworks for accelerating sample generation in pre-trained models: Conjugate Integrators and Splitting Integrators. Conjugate integrators generalize DDIM, mapping the reverse diffusion dynamics to a more amenable space for sampling. In contrast, splitting-based integrators, commonly used in molecular dynamics, reduce the numerical simulation error by cleverly alternating between numerical updates involving the data and auxiliary variables. After extensively studying these methods empirically and theoretically, we present a hybrid method that leads to the best-reported performance for diffusion models in augmented spaces. Applied to Phase Space Langevin Diffusion [Pandey & Mandt, 2023] on CIFAR-10, our deterministic and stochastic samplers achieve FID scores of 2.11 and 2.36 in only 100 network function evaluations (NFE) as compared to 2.57 and 2.63 for the best-performing baselines, respectively. Our code and model checkpoints will be made publicly available at \url{https://github.com/mandt-lab/PSLD}.


title: Precise localization within the GI tract by combining classification of CNNs and time-series analysis of HMMs

abstract: This paper presents a method to efficiently classify the gastroenterologic section of images derived from Video Capsule Endoscopy (VCE) studies by exploring the combination of a Convolutional Neural Network (CNN) for classification with the time-series analysis properties of a Hidden Markov Model (HMM). It is demonstrated that successive time-series analysis identifies and corrects errors in the CNN output. Our approach achieves an accuracy of $98.04\%$ on the Rhode Island (RI) Gastroenterology dataset. This allows for precise localization within the gastrointestinal (GI) tract while requiring only approximately 1M parameters and thus, provides a method suitable for low power devices


title: NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration

abstract: Robotic learning for navigation in unfamiliar environments needs to provide policies for both task-oriented navigation (i.e., reaching a goal that the robot has located), and task-agnostic exploration (i.e., searching for a goal in a novel setting). Typically, these roles are handled by separate models, for example by using subgoal proposals, planning, or separate navigation strategies. In this paper, we describe how we can train a single unified diffusion policy to handle both goal-directed navigation and goal-agnostic exploration, with the latter providing the ability to search novel environments, and the former providing the ability to reach a user-specified goal once it has been located. We show that this unified policy results in better overall performance when navigating to visually indicated goals in novel environments, as compared to approaches that use subgoal proposals from generative models, or prior methods based on latent variable models. We instantiate our method by using a large-scale Transformer-based policy trained on data from multiple ground robots, with a diffusion model decoder to flexibly handle both goal-conditioned and goal-agnostic navigation. Our experiments, conducted on a real-world mobile robot platform, show effective navigation in unseen environments in comparison with five alternative methods, and demonstrate significant improvements in performance and lower collision rates, despite utilizing smaller models than state-of-the-art approaches. For more videos, code, and pre-trained model checkpoints, see https://general-navigation-models.github.io/nomad/


title: DeepNRMS: Unsupervised Deep Learning for Noise-Robust CO2 Monitoring in Time-Lapse Seismic Images

abstract: Monitoring stored CO2 in carbon capture and storage projects is crucial for ensuring safety and effectiveness. We introduce DeepNRMS, a novel noise-robust method that effectively handles time-lapse noise in seismic images. The DeepNRMS leverages unsupervised deep learning to acquire knowledge of time-lapse noise characteristics from pre-injection surveys. By utilizing this learned knowledge, our approach accurately discerns CO2-induced subtle signals from the high-amplitude time-lapse noise, ensuring fidelity in monitoring while reducing costs by enabling sparse acquisition. We evaluate our method using synthetic data and field data acquired in the Aquistore project. In the synthetic experiments, we simulate time-lapse noise by incorporating random near-surface effects in the elastic properties of the subsurface model. We train our neural networks exclusively on pre-injection seismic images and subsequently predict CO2 locations from post-injection seismic images. In the field data analysis from Aquistore, the images from pre-injection surveys are utilized to train the neural networks with the characteristics of time-lapse noise, followed by identifying CO2 plumes within two post-injection surveys. The outcomes demonstrate the improved accuracy achieved by the DeepNRMS, effectively addressing the strong time-lapse noise.


title: FlorDB: Multiversion Hindsight Logging for Continuous Training

abstract: Production Machine Learning involves continuous training: hosting multiple versions of models over time, often with many model versions running at once. When model performance does not meet expectations, Machine Learning Engineers (MLEs) debug issues by exploring and analyzing numerous prior versions of code and training data to identify root causes and mitigate problems. Traditional debugging and logging tools often fall short in managing this experimental, multi-version context. FlorDB introduces Multiversion Hindsight Logging, which allows engineers to use the most recent version's logging statements to query past versions, even when older versions logged different data. Log statement propagation enables consistent injection of logging statements into past code versions, regardless of changes to the codebase. Once log statements are propagated across code versions, the remaining challenge in Multiversion Hindsight Logging is to efficiently replay the new log statements based on checkpoints from previous runs. Finally, a coherent user experience is required to help MLEs debug across all versions of code and data. To this end, FlorDB presents a unified relational model for efficient handling of historical queries, offering a comprehensive view of the log history to simplify the exploration of past code iterations. We present a performance evaluation on diverse benchmarks confirming its scalability and the ability to deliver real-time query responses, leveraging query-based filtering and checkpoint-based parallelism for efficient replay.


title: RoboCLIP: One Demonstration is Enough to Learn Robot Policies

abstract: Reward specification is a notoriously difficult problem in reinforcement learning, requiring extensive expert supervision to design robust reward functions. Imitation learning (IL) methods attempt to circumvent these problems by utilizing expert demonstrations but typically require a large number of in-domain expert demonstrations. Inspired by advances in the field of Video-and-Language Models (VLMs), we present RoboCLIP, an online imitation learning method that uses a single demonstration (overcoming the large data requirement) in the form of a video demonstration or a textual description of the task to generate rewards without manual reward function design. Additionally, RoboCLIP can also utilize out-of-domain demonstrations, like videos of humans solving the task for reward generation, circumventing the need to have the same demonstration and deployment domains. RoboCLIP utilizes pretrained VLMs without any finetuning for reward generation. Reinforcement learning agents trained with RoboCLIP rewards demonstrate 2-3 times higher zero-shot performance than competing imitation learning methods on downstream robot manipulation tasks, doing so using only one video/text demonstration.


title: Asymptotics for power posterior mean estimation

abstract: Power posteriors "robustify" standard Bayesian inference by raising the likelihood to a constant fractional power, effectively downweighting its influence in the calculation of the posterior. Power posteriors have been shown to be more robust to model misspecification than standard posteriors in many settings. Previous work has shown that power posteriors derived from low-dimensional, parametric locally asymptotically normal models are asymptotically normal (Bernstein-von Mises) even under model misspecification. We extend these results to show that the power posterior moments converge to those of the limiting normal distribution suggested by the Bernstein-von Mises theorem. We then use this result to show that the mean of the power posterior, a point estimator, is asymptotically equivalent to the maximum likelihood estimator.


title: Satisfiability problems and algebras of boolean constraint system games

abstract: Mermin and Peres showed that there are boolean constraint systems (BCSs) which are not satisfiable, but which are satisfiable with quantum observables. This has led to a burgeoning theory of quantum satisfiability for constraint systems, connected to nonlocal games and quantum contextuality. In this theory, different types of quantum satisfying assignments can be understood as representations of the BCS algebra of the system. This theory is closely related to the theory of synchronous games and algebras, and every synchronous algebra is a BCS algebra and vice-versa. The purpose of this paper is to further develop the role of BCS algebras in this theory, and tie up some loose ends: We give a new presentation of BCS algebras in terms of joint spectral projections, and show that it is equivalent to the standard definition. We construct a constraint system which is $C^*$-satisfiable but not tracially satisfiable. We show that certain reductions between constraint systems lead to $*$-homomorphisms between the BCS algebras of the systems, and use this to streamline and strengthen several results of Atserias, Kolaitis, and Severini on analogues of Schaefer's dichotomy theorem. In particular, we show that the question of whether or not there is a non-hyperlinear group is linked to dichotomy theorems for $\mathcal{R}^{\mathcal{U}}$-satisfiability.


title: Unraveling the Single Tangent Space Fallacy: An Analysis and Clarification for Applying Riemannian Geometry in Robot Learning

abstract: In the realm of robotics, numerous downstream robotics tasks leverage machine learning methods for processing, modeling, or synthesizing data. Often, this data comprises variables that inherently carry geometric constraints, such as the unit-norm condition of quaternions representing rigid-body orientations or the positive definiteness of stiffness and manipulability ellipsoids. Handling such geometric constraints effectively requires the incorporation of tools from differential geometry into the formulation of machine learning methods. In this context, Riemannian manifolds emerge as a powerful mathematical framework to handle such geometric constraints. Nevertheless, their recent adoption in robot learning has been largely characterized by a mathematically-flawed simplification, hereinafter referred to as the "single tangent space fallacy". This approach involves merely projecting the data of interest onto a single tangent (Euclidean) space, over which an off-the-shelf learning algorithm is applied. This paper provides a theoretical elucidation of various misconceptions surrounding this approach and offers experimental evidence of its shortcomings. Finally, it presents valuable insights to promote best practices when employing Riemannian geometry within robot learning applications.


title: Sorting it out in Hardware: A State-of-the-Art Survey

abstract: Sorting is a fundamental operation in various applications and a traditional research topic in computer science. Improving the performance of sorting operations can have a significant impact on many application domains. For high-performance sorting, much attention has been paid to hardware-based solutions. These are often realized with application-specific integrated circuits (ASICs) or field-programmable gate arrays (FPGAs). Recently, in-memory sorting solutions have also been proposed to address the movement cost issue between memory and processing units, also known as Von Neumann bottleneck. Due to the complexity of the sorting algorithms, achieving an efficient hardware implementation for sorting data is challenging. A large body of prior solutions is built on compare-and-swap (CAS) units. These are categorized as comparison-based sorting. Some recent solutions offer comparison-free sorting. In this survey, we review the latest works in the area of hardware-based sorting. We also discuss the recent hardware solutions for partial and stream sorting. Finally, we will discuss some important concerns that need to be considered in the future designs of sorting systems.


title: From Realizability Modulo Theories to Synthesis Modulo Theories Part 1: Dynamic approach

abstract: Reactive synthesis is the process of using temporal logic specifications in LTL to generate correct controllers, but its use has been restricted to Boolean specifications. Recently, a Boolean abstraction technique allows to translate LTL T specifications that contain literals in theories into equi-realizable LTL specifications. However, no synthesis procedure exists yet. In synthesis modulo theories, the system to synthesize receives valuations of environment variables in a first-order theory T and outputs valuations of system variables from T . In this paper, we address how to syntheize a full controller using a combination of the static Boolean controller obtained from the Booleanized LTL specification together with dynamic queries to a solver that produces models of a satisfiable existential formulae from T . This is the first method that realizes reactive synthesis modulo theories.


title: Cover times of many random walkers on a discrete network

abstract: The speed of an exhaustive search can be measured by a cover time, which is defined as the time it takes a random searcher to visit every state in some target set. Cover times have been studied in both the physics and probability literatures, with most prior works focusing on a single searcher. In this paper, we prove an explicit formula for all the moments of the cover time for many searchers on an arbitrary discrete network. Our results show that such cover times depend only on properties of the network along the shortest paths to the most distant parts of the target. This mere local dependence contrasts with the well-known result that cover times for single searchers depend on global properties of the network. We illustrate our rigorous results by stochastic simulations.


title: Power Tracking Control of Heterogeneous Populations of TCLs with Partially Measured States

abstract: This paper presents a new aggregate power tracking control scheme for populations of thermostatically controlled loads (TCLs). The control design is performed in the framework of partial differential equations (PDEs) based on a late-lumping procedure without truncating the infinite-dimensional model describing the dynamics of the TCL population. An input-output linearization control scheme, which is independent of system parameters and uses only partial state measurement, is derived, and a sliding model-like control is applied to achieve finite-time input-to-state stability for tracking error dynamics. Such a control strategy can ensure robust performance in the presence of modeling uncertainties, while considerably reducing the communication burden in large scale distributed systems similar to that considered in the present work. A rigorous analysis of the closed-loop stability of the underlying PDE system was conducted, which guaranteed the validity of the developed control scheme. Simulation studies were performed while considering two TCL populations with a significant difference in their size, and the results show that the developed control scheme performs well in both cases, thereby confirming the effectiveness of the proposed solution.


title: The Pristine survey -- XXII. A serendipitous discovery of an extremely Li-rich very metal-poor giant and a new method of $^6$Li/$^7$Li isotope measurement

abstract: We report the serendipitous discovery of a very metal-poor (VMP) Li-rich giant star ($T_{\rm eff}$ = 4690$\pm$80 K, log g = 1.34$\pm$0.13, [Fe/H] = $-2.43\pm$0.07). We analyse the Li I 6103 and 6707 \r{A} lines accounting for departures from local thermodynamic equilibrium (NLTE) and correcting for 3D effects using literature data, which yields a lithium abundance $\log\varepsilon_{Li} = 3.42\pm0.07$. Comparing lithium abundances from the two lines, in 1D NLTE we measure the isotope ratio $^6$Li/$^7$Li = 1.64$^{+1.49}_{-1.08}$ %. When correcting for 3D effects, we detect the fragile $^6$Li isotope at $2$-sigma level and the ratio $^6$Li/$^7$Li = 5.65$^{+5.05}_{-2.51}$ %. To our knowledge, this is the first $^6$Li/$^7$Li measurement in an extremely Li-rich VMP star. The Cameron-Fowler mechanism, which is proposed to produce Li-rich stars, does not imply $^6$Li production and is therefore inconsistent with our measurement when applying 3D corrections. We also derive NLTE abundances for 16 elements, most of which show similar abundances to those found in VMP stars. Sodium is an exception: [Na/Fe]$_{\rm NLTE, 1D}$ = 0.07 $\pm 0.03$, which is 0.5 dex higher than what is typical for VMP stars. This star joins the sample of rare Li-rich VMP stars, and we offer a novel way to constrain the source of lithium in such stars through isotope ratio measurements.


title: Recurrent networks recognize patterns with low-dimensional oscillations

abstract: This study proposes a novel dynamical mechanism for pattern recognition discovered by interpreting a recurrent neural network (RNN) trained on a simple task inspired by the SET card game. We interpreted the trained RNN as recognizing patterns via phase shifts in a low-dimensional limit cycle in a manner analogous to transitions in a finite state automaton (FSA). We further validated this interpretation by handcrafting a simple oscillatory model that reproduces the dynamics of the trained RNN. Our findings not only suggest of a potential dynamical mechanism capable of pattern recognition, but also suggest of a potential neural implementation of FSA. Above all, this work contributes to the growing discourse on deep learning model interpretability.


title: Thickness-dependent Characteristics and Oxidation of Cadmium

abstract: In this study, the structural, electronic and vibrational properties of thinnest possible Cadmium crystal are investigated by performing first-principle calculations. Total energy optimization and dynamic stability calculations reveal that the thinnest possible crystal structure is a double-layered structure consisting of alternating layers formed by trigonal arrangements of Cd atoms. Excessive softening of optical phonons occurs as a result of structural relaxation when going from a bulk to a single layer (SL) structure. It is also shown that thinnest structure obtained from bulk Cd crystals maintains its metallic feature despite the dimensional crossover. In addition, it is predicted through calculations that the SL Cd crystal strongly interacts with oxygen and that the oxidized regions even undergo chemical transformation to form the CdO crystal. In the double-layer CdO crystal resulting from the oxidation of individual Cd layers, the layers are connected to each other with strong covalent bonds, and this structure is a semiconductor with a band gap of 2.10 eV. While the robust metallic structure of the thinnest possible Cd crystal provides flexibility in terms of its use in nanoscale applications, on the other hand, the fact that its electronic properties can be changed by oxidation is important for optoelectronic device applications.


title: Rheological signatures of a glass-glass transition in an aging colloidal clay

abstract: The occurrence of non-equilibrium transitions between arrested states has recently emerged as an intriguing issue in the field of soft glassy materials. The existence of one such transition has been suggested for aging colloidal clays (Laponite$^{\circledR}$ suspensions) at weight concentration 3.0%, although further experimental evidences are necessary to validate this scenario. Here, we test the occurrence of this transition for spontaneously aged (non-rejuvenated) samples, by exploiting the rheological tools of Dynamical Mechanical Analysis. On imposing consecutive compression cycles to differently aged clay suspensions, we find that a quite abrupt change of rheological parameters occurs for ages around three days. For the Young and elastic moduli, the change with the waiting time is essentially independent from the deformation rate, whereas other "fluid-like" properties, such as the loss modulus, do clearly display some rate dependence. We also show that the crossover identified by rheology coincides with deviations of the relaxation time (obtained through X-Ray Photon Correlation Spectroscopy) from its expected monotonic increase with aging. Thus, our results robustly support the existence of a glass-glass transition in aging colloidal clays, highlighting characteristic features of of their viscoelastic behaviour.


title: Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention

abstract: Scaling pre-trained language models has resulted in large performance gains in various natural language processing tasks but comes with a large cost in memory requirements. Inspired by the position embeddings in transformers, we aim to simplify and reduce the memory footprint of the multi-head attention (MHA) mechanism. We propose an alternative module that uses only a single shared projection matrix and multiple head embeddings (MHE), i.e. one per head. We empirically demonstrate that our MHE attention is substantially more memory efficient compared to alternative attention mechanisms while achieving high predictive performance retention ratio to vanilla MHA on several downstream tasks. MHE attention only requires a negligible fraction of additional parameters ($3nd$, where $n$ is the number of attention heads and $d$ the size of the head embeddings) compared to a single-head attention, while MHA requires $(3n^2-3n)d^2-3nd$ additional parameters.


title: Irreducibility of Markov Chains on simplicial complexes, the Spectrum of the Discrete Hodge Laplacian and Homology

abstract: Random walks on graphs are a fundamental concept in graph theory and play a crucial role in solving a wide range of theoretical and applied problems in discrete math, probability, theoretical computer science, network science, and machine learning. The connection between Markov chains on graphs and their geometric and topological structures is the main reason why such a wide range of theoretical and practical applications exist. Graph connectedness ensures irreducibility of a Markov chain. The convergence rate to the stationary distribution is determined by the spectrum of the graph Laplacian which is associated with lower bounds on graph curvature. Furthermore, walks on graphs are used to infer structural properties of underlying manifolds in data analysis and manifold learning. However, an important question remains: can similar connections be established between Markov chains on simplicial complexes and the topology, geometry, and spectral properties of complexes? Additionally, can we gain topological, geometric, or analytic information about a manifold by defining appropriate Markov chains on its triangulations? These questions are not only theoretically important but answers to them provide powerful tools for the analysis of complex networks that go beyond the analysis of pairwise interactions. In this paper, we provide an integrated overview of the existing results on random walks on simplicial complexes, using the novel perspective of signed graphs. This perspective sheds light on previously unknown aspects such as irreducibility conditions. We show that while up-walks on higher dimensional simplexes can never be irreducible, the down walks become irreducible if and only if the complex is orientable. We believe that this new integrated perspective can be extended beyond discrete structures and enables exploration of classical problems for triangulable manifolds.


title: ThunderBoltz: An Open-Source DSMC-based Boltzmann Solver for Plasma Transport, Chemical Kinetics, and 0D Plasma Modeling

abstract: Plasma-neutral interactions, including reactive kinetics, are often either studied in 0D using ODE based descriptions, or in multi-dimensional fluid or particle based plasma codes. The latter case involves a complex assembly of procedures that are not always necessary to test effects of underlying physical models and mechanisms for particle-based descriptions. Here we present ThunderBoltz, a lightweight, publicly available 0D Direct Simulation Monte Carlo (DSMC) code designed to accommodate a generalized combination of species and arbitrary cross sections without the overhead of expensive field solves. It can efficiently produce high-quality electron, ion, and neutral velocity distributions in applied AC/DC $E$-field and static $B$-field scenarios. The code is built in the C++ standard library and includes a convenient Python interface that allows for input file generation (including compatibility with cross section data from the LXCat database), electron transport and reaction rate constant post-processing, input parameter constraint satisfaction, calculation scheduling, and diagnostic plotting. In this work we compare ThunderBoltz transport calculations against Bolsig+ calculations, benchmark test problems, and swarm experiment data, finding good agreement with all three in the appropriate field regimes. In addition to this, we present example use cases where the electron, ion, and background neutral particle species are self consistently evolved providing an ability to model the background kinetics, a feature that is absent in fixed background Monte Carlo and n-term Boltzmann solvers. The latter functionality allows for the possibility of particle-based chemical kinetics simulations of the plasma and neutral species and is a new alternative to ODE based approaches.


title: A Semi-Parametric Approach to Fitting Gas Pressure Profiles of Galaxy Clusters

abstract: This study focuses on modelling galaxy cluster gas profiles via a semi-parametric nodal approach. While traditional methods like the generalised Navarro-Frenk-White (gNFW) often encounter parameter degeneracy, our flexible node-based method precisely defines a cluster gas pressure profile. Using Planck space telescope data from the Coma region, our model, focused on the pressure-radius relationship, showcases enhanced flexibility over the gNFW. Bayesian analyses indicated an optimal five-node structure for the Coma cluster pressure profile.


title: Tag Your Fish in the Broken Net: A Responsible Web Framework for Protecting Online Privacy and Copyright

abstract: The World Wide Web, a ubiquitous source of information, serves as a primary resource for countless individuals, amassing a vast amount of data from global internet users. However, this online data, when scraped, indexed, and utilized for activities like web crawling, search engine indexing, and, notably, AI model training, often diverges from the original intent of its contributors. The ascent of Generative AI has accentuated concerns surrounding data privacy and copyright infringement. Regrettably, the web's current framework falls short in facilitating pivotal actions like consent withdrawal or data copyright claims. While some companies offer voluntary measures, such as crawler access restrictions, these often remain inaccessible to individual users. To empower online users to exercise their rights and enable companies to adhere to regulations, this paper introduces a user-controlled consent tagging framework for online data. It leverages the extensibility of HTTP and HTML in conjunction with the decentralized nature of distributed ledger technology. With this framework, users have the ability to tag their online data at the time of transmission, and subsequently, they can track and request the withdrawal of consent for their data from the data holders. A proof-of-concept system is implemented, demonstrating the feasibility of the framework. This work holds significant potential for contributing to the reinforcement of user consent, privacy, and copyright on the modern internet and lays the groundwork for future insights into creating a more responsible and user-centric web ecosystem.