title: Identification and Inference on Treatment Effects under Covariate-Adaptive Randomization and Imperfect Compliance

abstract: Randomized controlled trials (RCTs) frequently utilize covariate-adaptive randomization (CAR) (e.g., stratified block randomization) and commonly suffer from imperfect compliance. This paper studies the identification and inference for the average treatment effect (ATE) and the average treatment effect on the treated (ATT) in such RCTs with a binary treatment. We first develop characterizations of the identified sets for both estimands. Since data are generally not i.i.d. under CAR, these characterizations do not follow from existing results. We then provide consistent estimators of the identified sets and asymptotically valid confidence intervals for the parameters. Our asymptotic analysis leads to concrete practical recommendations regarding how to estimate the treatment assignment probabilities that enter in estimated bounds. In the case of the ATE, using sample analog assignment frequencies is more efficient than using the true assignment probabilities. On the contrary, using the true assignment probabilities is preferable for the ATT.


title: Designing Child-Centered Content Exposure and Moderation

abstract: Research on children's online experience and computer interaction often overlooks the relationship children have with hidden algorithms that control the content they encounter. Furthermore, it is not only about how children interact with targeted content but also how their development and agency are largely affected by these. By engaging with the body of literature at the intersection of i) human-centered design approaches, ii) exclusion and discrimination in A.I., iii) privacy, transparency, and accountability, and iv) children's online citizenship, this article dives into the question of "How can we approach the design of a child-centered moderation process to (1) include aspects that families value for their children and (2) provide explanations for content appropriateness and removal so that we can scale (according to systems and human needs) the moderation process assisted by A.I.?". This article contributes a sociotechnical highlight of core challenges and opportunities of designing child-centered content control tools. The article concludes by grounding and characterizing design considerations for a child-centered, family-guided moderation system. We hope this work serves as a stepping stone for designers and researchers pursuing children's safety online with an eye on hidden agents controlling children's online experiences and, by extension, the values and opportunities children are exposed to.


title: PRIBOOT: A New Data-Driven Expert for Improved Driving Simulations

abstract: The development of Autonomous Driving (AD) systems in simulated environments like CARLA is crucial for advancing real-world automotive technologies. To drive innovation, CARLA introduced Leaderboard 2.0, significantly more challenging than its predecessor. However, current AD methods have struggled to achieve satisfactory outcomes due to a lack of sufficient ground truth data. Human driving logs provided by CARLA are insufficient, and previously successful expert agents like Autopilot and Roach, used for collecting datasets, have seen reduced effectiveness under these more demanding conditions. To overcome these data limitations, we introduce PRIBOOT, an expert agent that leverages limited human logs with privileged information. We have developed a novel BEV representation specifically tailored to meet the demands of this new benchmark and processed it as an RGB image to facilitate the application of transfer learning techniques, instead of using a set of masks. Additionally, we propose the Infraction Rate Score (IRS), a new evaluation metric designed to provide a more balanced assessment of driving performance over extended routes. PRIBOOT is the first model to achieve a Route Completion (RC) of 75% in Leaderboard 2.0, along with a Driving Score (DS) and IRS of 20% and 45%, respectively. With PRIBOOT, researchers can now generate extensive datasets, potentially solving the data availability issues that have hindered progress in this benchmark.


title: KSW criterion in large field models

abstract: We extend the analytic description of complex no-boundary solutions in the context of inflation to large field models. We discuss the Kontsevich-Segal-Witten (KSW) criterion and find it is satisfied in small field models, while in large field models it depends on an integral involving $V'(\phi)$ over the range of inflation. It follows that the criterion does not truly constrain inflationary phenomenology since one can complete any inflaton potential beyond observable scales so as to satisfy KSW.


title: State Soup: In-Context Skill Learning, Retrieval and Mixing

abstract: A new breed of gated-linear recurrent neural networks has reached state-of-the-art performance on a range of sequence modeling problems. Such models naturally handle long sequences efficiently, as the cost of processing a new input is independent of sequence length. Here, we explore another advantage of these stateful sequence models, inspired by the success of model merging through parameter interpolation. Building on parallels between fine-tuning and in-context learning, we investigate whether we can treat internal states as task vectors that can be stored, retrieved, and then linearly combined, exploiting the linearity of recurrence. We study this form of fast model merging on Mamba-2.8b, a pretrained recurrent model, and present preliminary evidence that simple linear state interpolation methods suffice to improve next-token perplexity as well as downstream in-context learning task performance.


title: Ultrasensitive single-ion electrometry in a magnetic field gradient

abstract: Hyperfine energy levels in trapped ions offer long-lived spin states. In addition, the motion of these charged particles couples strongly to external electric field perturbations. These characteristics make trapped ions attractive platforms for the quantum sensing of electric fields. However, the spin states do not exhibit a strong intrinsic coupling to electric fields. This limits the achievable sensitivities. Here, we amplify the coupling between electric field perturbations and the spin states by using a static magnetic field gradient. Displacements of the trapped ion resulting from the forces experienced by an applied external electric field perturbation are thereby mapped to an instantaneous change in the energy level splitting of the internal spin states. This gradient mediated coupling of the electric field to the spin enables the use of a range of well-established magnetometry protocols for electrometry. Using our quantum sensor, we demonstrate AC sensitivities of $\mathrm{S^{AC}_{min}=960(10)\times 10^{-6}~V m^{-1}Hz^{-\frac{1}{2}}}$ at a signal frequency of $\omega_{\epsilon}/2\pi=5.82~\mathrm{Hz}$, and DC sensitivities of $\mathrm{S^{DC}_{min}=1.97(3)\times 10^{-3} ~V m^{-1}Hz^{-\frac{1}{2}}}$ with a Hahn-echo type sensing sequence. We also employ a rotating frame relaxometry technique, with which our quantum sensor can be utilised as an electric field noise spectrum analyser. We measure electric field signals down to a noise floor of $\mathrm{S_{E}(\omega)=6.2(5)\times 10^{-12}~V^2 m^{-2}Hz^{-1}}$ at a frequency of $\mathrm{30.0(3)~kHz}$. We therefore demonstrate unprecedented electric field sensitivities for the measurement of both DC signals and AC signals across a frequency range of sub-Hz to $\sim\mathrm{500~kHz}$. Finally, we describe a set of hardware modifications that are capable of achieving a further improvement in sensitivity by up to six orders of magnitude.


title: AWGUNET: Attention-Aided Wavelet Guided U-Net for Nuclei Segmentation in Histopathology Images

abstract: Accurate nuclei segmentation in histopathological images is crucial for cancer diagnosis. Automating this process offers valuable support to clinical experts, as manual annotation is time-consuming and prone to human errors. However, automating nuclei segmentation presents challenges due to uncertain cell boundaries, intricate staining, and diverse structures. In this paper, we present a segmentation approach that combines the U-Net architecture with a DenseNet-121 backbone, harnessing the strengths of both to capture comprehensive contextual and spatial information. Our model introduces the Wavelet-guided channel attention module to enhance cell boundary delineation, along with a learnable weighted global attention module for channel-specific attention. The decoder module, composed of an upsample block and convolution block, further refines segmentation in handling staining patterns. The experimental results conducted on two publicly accessible histopathology datasets, namely Monuseg and TNBC, underscore the superiority of our proposed model, demonstrating its potential to advance histopathological image analysis and cancer diagnosis. The code is made available at: https://github.com/AyushRoy2001/AWGUNET.


title: Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL

abstract: Generating accurate SQL according to natural language questions (text-to-SQL) is a long-standing challenge due to the complexities involved in user question understanding, database schema comprehension, and SQL generation. Conventional text-to-SQL systems, comprising human engineering and deep neural networks, have made substantial progress. Subsequently, pre-trained language models (PLMs) have been developed and utilized for text-to-SQL tasks, achieving promising performance. As modern databases become more complex, the corresponding user questions also grow more challenging, leading PLMs with limited comprehension capabilities to produce incorrect SQL. This necessitates more sophisticated and tailored optimization methods for PLMs, which, in turn, restricts the applications of PLM-based systems. Most recently, large language models (LLMs) have demonstrated significant capabilities in natural language understanding as the model scale remains increasing. Therefore, integrating the LLM-based implementation can bring unique opportunities, improvements, and solutions to text-to-SQL research. In this survey, we present a comprehensive review of LLM-based text-to-SQL. Specifically, we propose a brief overview of the technical challenges and the evolutionary process of text-to-SQL. Then, we provide a detailed introduction to the datasets and metrics designed to evaluate text-to-SQL systems. After that, we present a systematic analysis of recent advances in LLM-based text-to-SQL. Finally, we discuss the remaining challenges in this field and propose expectations for future research directions.


title: Existence of nonnegative energy-dissipating solutions to a class of stochastic thin-film equations under weak slippage: Part II -- compactly supported initial data

abstract: We prove existence of martingale solutions to a class of stochastic thin-film equations for mobility exponents $n \in (2,3)$ and compactly supported initial data. With the perspective to study free-boundary problems related to stochastic thin-film equations in future work, we start from the surface-tension driven stochastic thin-film equation with Stratonovich noise and exploit the regime of coefficients in front of the Stratonovich correction term (which is of porous-media-type) for which energy dissipation can be established. By Bernis inequalities, third order spatial derivatives of appropriate powers of the solution are controlled. Analytically, we rely on approximation with $\mathbb{P}$-almost surely strictly positive solutions and compactness methods based on energy-entropy estimates as well as martingale identification techniques.


title: Improving Noise Robustness through Abstractions and its Impact on Machine Learning

abstract: Noise is a fundamental problem in learning theory with huge effects in the application of Machine Learning (ML) methods, due to real world data tendency to be noisy. Additionally, introduction of malicious noise can make ML methods fail critically, as is the case with adversarial attacks. Thus, finding and developing alternatives to improve robustness to noise is a fundamental problem in ML. In this paper, we propose a method to deal with noise: mitigating its effect through the use of data abstractions. The goal is to reduce the effect of noise over the model's performance through the loss of information produced by the abstraction. However, this information loss comes with a cost: it can result in an accuracy reduction due to the missing information. First, we explored multiple methodologies to create abstractions, using the training dataset, for the specific case of numerical data and binary classification tasks. We also tested how these abstractions can affect robustness to noise with several experiments that explore the robustness of an Artificial Neural Network to noise when trained using raw data \emph{vs} when trained using abstracted data. The results clearly show that using abstractions is a viable approach for developing noise robust ML methods.


title: A Sticker is Worth a Thousand Words: Characterizing the Use of Stickers in WhatsApp Political Groups in Brazil

abstract: With the increasing use of smartphones, instant messaging platforms turned into important communication tools. According to WhatsApp, more than 100 billion messages are sent each day on the app. Communication on these platforms has allowed individuals to express themselves in other types of media, rather than simple text, including audio, videos, images, and stickers. Particularly, stickers are a new multimedia format that emerged with messaging apps, promoting new forms of interactions among users, especially in the Brazilian context, transcending their role as a mere form of humor to become a key element in political strategy. In this regard, we investigate how stickers are being used, unveiling unique characteristics that these media bring to WhatsApp chats and the political use of this new media format. To achieve that, we collected a large sample of messages from WhatsApp public political discussion groups in Brazil and analyzed the sticker messages shared in this context


title: Testing Quantum and Simulated Annealers on the Drone Delivery Packing Problem

abstract: Using drones to perform human-related tasks can play a key role in various fields, such as defense, disaster response, agriculture, healthcare, and many others. The drone delivery packing problem (DDPP) arises in the context of logistics in response to an increasing demand in the delivery process along with the necessity of lowering human intervention. The DDPP is usually formulated as a combinatorial optimization problem, aiming to minimize drone usage with specific battery constraints while ensuring timely consistent deliveries with fixed locations and energy budget. In this work, we propose two alternative formulations of the DDPP as a quadratic unconstrained binary optimization (QUBO) problem, in order to test the performance of classical and quantum annealing (QA) approaches. We perform extensive experiments showing the advantages as well as the limitations of quantum annealers for this optimization problem, as compared to simulated annealing (SA) and classical state-of-the-art commercial tools for global optimization.


title: Diffusion Soup: Model Merging for Text-to-Image Diffusion Models

abstract: We present Diffusion Soup, a compartmentalization method for Text-to-Image Generation that averages the weights of diffusion models trained on sharded data. By construction, our approach enables training-free continual learning and unlearning with no additional memory or inference costs, since models corresponding to data shards can be added or removed by re-averaging. We show that Diffusion Soup samples from a point in weight space that approximates the geometric mean of the distributions of constituent datasets, which offers anti-memorization guarantees and enables zero-shot style mixing. Empirically, Diffusion Soup outperforms a paragon model trained on the union of all data shards and achieves a 30% improvement in Image Reward (.34 $\to$ .44) on domain sharded data, and a 59% improvement in IR (.37 $\to$ .59) on aesthetic data. In both cases, souping also prevails in TIFA score (respectively, 85.5 $\to$ 86.5 and 85.6 $\to$ 86.8). We demonstrate robust unlearning -- removing any individual domain shard only lowers performance by 1% in IR (.45 $\to$ .44) -- and validate our theoretical insights on anti-memorization using real data. Finally, we showcase Diffusion Soup's ability to blend the distinct styles of models finetuned on different shards, resulting in the zero-shot generation of hybrid styles.


title: Idealized Social Dynamics In Bayesian Space of Assessments

abstract: The purpose of this paper is to present an idealized hypotheses-drawn model describing dynamics of variability in business and other social areas. A new construct is introduced called the Bayesian space of assessments to consider changes in positions of individuals and intrinsically interrelated entities called social bodies. The bodies spatial coordinates are their assessments in any required for a specific purpose professional and or ethical dimensions. A concept of market power introduced originally in entrepreneurship and technology commercialization (Michael Danov, Brock Smith, and Ronald Mitchell, 2003) is extended to become a driving force applicable to other social processes. The model describes interrelations between driving forces acting on social bodies and changes in positions of these bodies in the Bayesian space of assessments. Implications are discussed for some business and political oscillations.


title: Dynamical control in a prethermalized molecular ultracold plasma: Local dissipation drives global relaxation

abstract: Prethermalization occurs as an important phase in the dynamics of many-body systems when strong coupling drives a quasi-equilibrium in a subspace separated from the thermodynamic equilibrium by the restriction of a gap in energy or other conserved quantity. Here, we report the signature of an enduring prethermal regime of arrested relaxation in the molecular ultracold plasma that forms following the avalanche of a state-selected Rydberg gas of nitric oxide. Electron collisions mix orbital angular momentum, scattering Rydberg molecules to states of very high-$\ell$. Spontaneous predissociation purifies this non-penetrating character, creating an extraordinary gap between the plasma states of $n \approx \ell$, with measured $n>200$ and penetrating states of $\ell = 0, ~1$ and 2. Evolution to a statistically equilibrated state of N and O atoms cannot occur without Rydberg electron penetration, and this gap blocks relaxation for a millisecond or more. Evolving through the critical phase, electrons that balance the NO$^+$ charge behave as though localized in the prethermal phase and play an ineffective role in bridging this gap. However, the application of a weak radiofrequency (RF) field promotes a dramatic degree of relaxation owing to electron collisions. On an entirely different scale, exciting a quantum-state transition in an exceedingly small fraction of the molecules in the prethermalized ensemble acts with even greater effect to drive the entire system toward equilibrium. We ascribe this to dissipative character added to a small fraction of the states in the prethermally localized ensemble. Using the Lindblad master equation, we illustrate qualitatively similar dynamics for a toy model of an open quantum system that consists of a localized set of spins on which dissipation acts locally at a single site.


title: TasTe: Teaching Large Language Models to Translate through Self-Reflection

abstract: Large language models (LLMs) have exhibited remarkable performance in various natural language processing tasks. Techniques like instruction tuning have effectively enhanced the proficiency of LLMs in the downstream task of machine translation. However, the existing approaches fail to yield satisfactory translation outputs that match the quality of supervised neural machine translation (NMT) systems. One plausible explanation for this discrepancy is that the straightforward prompts employed in these methodologies are unable to fully exploit the acquired instruction-following capabilities. To this end, we propose the TasTe framework, which stands for translating through self-reflection. The self-reflection process includes two stages of inference. In the first stage, LLMs are instructed to generate preliminary translations and conduct self-assessments on these translations simultaneously. In the second stage, LLMs are tasked to refine these preliminary translations according to the evaluation results. The evaluation results in four language directions on the WMT22 benchmark reveal the effectiveness of our approach compared to existing methods. Our work presents a promising approach to unleash the potential of LLMs and enhance their capabilities in MT. The codes and datasets are open-sourced at https://github.com/YutongWang1216/ReflectionLLMMT.


title: Wiki Entity Summarization Benchmark

abstract: Entity summarization aims to compute concise summaries for entities in knowledge graphs. Existing datasets and benchmarks are often limited to a few hundred entities and discard graph structure in source knowledge graphs. This limitation is particularly pronounced when it comes to ground-truth summaries, where there exist only a few labeled summaries for evaluation and training. We propose WikES, a comprehensive benchmark comprising of entities, their summaries, and their connections. Additionally, WikES features a dataset generator to test entity summarization algorithms in different areas of the knowledge graph. Importantly, our approach combines graph algorithms and NLP models as well as different data sources such that WikES does not require human annotation, rendering the approach cost-effective and generalizable to multiple domains. Finally, WikES is scalable and capable of capturing the complexities of knowledge graphs in terms of topology and semantics. WikES features existing datasets for comparison. Empirical studies of entity summarization methods confirm the usefulness of our benchmark. Data, code, and models are available at: https://github.com/msorkhpar/wiki-entity-summarization.


title: Visualization of atomic structures on faceted and non-flat surfaces by difference-of-gaussians approach

abstract: Detailed analysis of scanning probe microscopy (SPM) data acquired for tilted and non-flat surfaces is usually complicated due to presence of large number of surface areas tilted by large/variable angles relative to the scanning plane. As a consequence, standard methods of elimination of global/local slope by a plane subtraction or numerical differentiation seems to be ineffective. We demonstrate that simple difference-of-gaussians procedure provides us output data corresponding to a projection of considered surface onto scanning plane without undesirable modifications of contrast. This method allows us to minimize small-scale noise, finite slopes of SPM image along both fast and slow scanning directions and eliminate surface rippling. This method can be applied both for fast 'on-the-fly' visualization of experimental data and more detailed analysis, including high precision determination of lattice parameters and angles between translations vectors in different surface domains. In order to estimate geometrical distortions related to the difference-of-gaussians approach, we compare this method with direct image rotation in 3D space.


title: Effect of Cr Segregation on Grain Growth in Nanocrystalline {\alpha}-Fe Alloy: A Multiscale Modelling Approach

abstract: We present a multiscale modelling framework that integrates density functional theory (DFT) with a phase-field model (PFM) to explore the intricate dynamics of grain growth in nanocrystalline {\alpha}-Fe single-phase alloy in the presence of chromium (Cr) segregation. We begin our study by validating our simulation results for equilibrium segregation in stationary GB with Mclean isotherm. Polycrystal simulations featuring nanocrystalline grains at different temperatures reveal that the grain growth kinetics depends on the ratio of Cr diffusivity to intrinsic GB mobility. In the absence of segregation, the relationship between the square of average grain size (d 2 ) and time (t) demonstrates a linear correlation. We observe that the d 2 vs. t plot exhibits a consistent linear trend up to a threshold grain size, independent of Cr segregation at GB. However, when Cr is segregated at GB, a deviation from this linear trend with a decreasing slope is evident within the temperature range of 700K to 900K beyond the threshold size. This threshold grain size decreases with increasing temperature. Notably, at 1000K, the deviation from the linear trend is observed from the initial stages of grain growth with segregation, albeit with a linear trend exhibiting a smaller slope. We also present an analytical formulation based on Cahn solute drag theory to predict grain growth behaviour in the presence of solute segregation and our simulation results well aligned this analytical formulation.


title: Energy Spectrum of Primary Knock-on Atoms and Atomic Displacement Calculations in Metallic Alloys Under Neutron Irradiation

abstract: Materials subjected to neutron irradiation experience damage due to displacement cascades triggered by nuclear reactions. This paper presents a practical method to calculate primary atomic recoil events (PKAs), which lead to cascade damage, based on energy and recoiling species. We developed a custom code to identify PKAs and extract their properties using MCNPX and SRIM. This code determines the specifications of recoil atoms from the data provided by the PTRAC card in MCNPX. Consequently, the energy spectrum of PKAs generated through various reaction channels, including elastic/inelastic scattering and transmutations such as (n, {\alpha}), (n, p), and (n, {\gamma}), is calculated. This PKA spectrum is then input into SRIM, which calculates the total number of atomic displacements using the binary collision approximation (BCA) and provides crucial information about the spatial distribution of defects within the irradiated material. Our results indicate that elastic scattering is the predominant reaction, producing most PKAs with energies in the range of several keV. In contrast, inelastic scattering becomes the dominant interaction for generating high-energy PKAs (~EPKA>1 MeV). Additionally, we observed that the number of Frenkel pairs versus ion energy curves for light particle ion implantation (such as H and He) is significantly smaller than for heavier ions.


title: Coherent Optical Modems for Full-Wavefield Lidar

abstract: The advent of the digital age has driven the development of coherent optical modems -- devices that modulate the amplitude and phase of light in multiple polarization states. These modems transmit data through fiber optic cables that are thousands of kilometers in length at data rates exceeding one terabit per second. This remarkable technology is made possible through near-THz-rate programmable control and sensing of the full optical wavefield. While coherent optical modems form the backbone of telecommunications networks around the world, their extraordinary capabilities also provide unique opportunities for imaging. Here, we introduce full-wavefield lidar: a new imaging modality that repurposes off-the-shelf coherent optical modems to simultaneously measure distance, axial velocity, and polarization. We demonstrate this modality by combining a 74 GHz-bandwidth coherent optical modem with free-space coupling optics and scanning mirrors. We develop a time-resolved image formation model for this system and formulate a maximum-likelihood reconstruction algorithm to recover depth, velocity, and polarization information at each scene point from the modem's raw transmitted and received symbols. Compared to existing lidars, full-wavefield lidar promises improved mm-scale ranging accuracy from brief, microsecond exposure times, reliable velocimetry, and robustness to intererence from ambient light or other lidar signals.


title: Adaptive Swarm Mesh Refinement using Deep Reinforcement Learning with Local Rewards

abstract: Simulating physical systems is essential in engineering, but analytical solutions are limited to straightforward problems. Consequently, numerical methods like the Finite Element Method (FEM) are widely used. However, the FEM becomes computationally expensive as problem complexity and accuracy demands increase. Adaptive Mesh Refinement (AMR) improves the FEM by dynamically allocating mesh elements on the domain, balancing computational speed and accuracy. Classical AMR depends on heuristics or expensive error estimators, limiting its use in complex simulations. While learning-based AMR methods are promising, they currently only scale to simple problems. In this work, we formulate AMR as a system of collaborating, homogeneous agents that iteratively split into multiple new agents. This agent-wise perspective enables a spatial reward formulation focused on reducing the maximum mesh element error. Our approach, Adaptive Swarm Mesh Refinement (ASMR), offers efficient, stable optimization and generates highly adaptive meshes at user-defined resolution during inference. Extensive experiments, including volumetric meshes and Neumann boundary conditions, demonstrate that ASMR exceeds heuristic approaches and learned baselines, matching the performance of expensive error-based oracle AMR strategies. ASMR additionally generalizes to different domains during inference, and produces meshes that simulate up to 2 orders of magnitude faster than uniform refinements in more demanding settings.


title: A green solvent system for precursor phase-engineered sequential deposition of stable formamidinium lead triiodide for perovskite solar cells

abstract: Perovskite solar cells (PSCs) offer an efficient, inexpensive alternative to current photovoltaic technologies, with the potential for manufacture via high-throughput coating methods. However, challenges for commercial-scale solution-processing of metal-halide perovskites include the use of harmful solvents, the expense of maintaining controlled atmospheric conditions, and the inherent instabilities of PSCs under operation. Here, we address these challenges by introducing a high volatility, low toxicity, biorenewable solvent system to fabricate a range of 2D perovskites, which highly effective precursor phases for subsequent transformation to alpha-formamidinium lead triiodide (FAPbI3), fully processed under ambient conditions. PSCs utilising our FAPbI3 reproducibly show remarkable stability under illumination and elevated temperature (ISOS-L-2) and "damp heat" (ISOS-D-3) stressing, surpassing other state-of-the-art perovskite compositions. We determine that this enhancement is a consequence of the 2D precursor phase crystallisation route, which simultaneously avoids retention of residual low-volatility solvents (such as DMF and DMSO) and reduces the rate of degradation of FA+ in the material. Our findings highlight both the critical role of the initial crystallisation process in determining the operational stability of perovskite materials, and that neat FA+-based perovskites can be competitively stable despite the inherent metastability of the alpha-phase.


title: $\texttt{DiffLense}$: A Conditional Diffusion Model for Super-Resolution of Gravitational Lensing Data

abstract: Gravitational lensing data is frequently collected at low resolution due to instrumental limitations and observing conditions. Machine learning-based super-resolution techniques offer a method to enhance the resolution of these images, enabling more precise measurements of lensing effects and a better understanding of the matter distribution in the lensing system. This enhancement can significantly improve our knowledge of the distribution of mass within the lensing galaxy and its environment, as well as the properties of the background source being lensed. Traditional super-resolution techniques typically learn a mapping function from lower-resolution to higher-resolution samples. However, these methods are often constrained by their dependence on optimizing a fixed distance function, which can result in the loss of intricate details crucial for astrophysical analysis. In this work, we introduce $\texttt{DiffLense}$, a novel super-resolution pipeline based on a conditional diffusion model specifically designed to enhance the resolution of gravitational lensing images obtained from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). Our approach adopts a generative model, leveraging the detailed structural information present in Hubble Space Telescope (HST) counterparts. The diffusion model, trained to generate HST data, is conditioned on HSC data pre-processed with denoising techniques and thresholding to significantly reduce noise and background interference. This process leads to a more distinct and less overlapping conditional distribution during the model's training phase. We demonstrate that $\texttt{DiffLense}$ outperforms existing state-of-the-art single-image super-resolution techniques, particularly in retaining the fine details necessary for astrophysical analyses.


title: Transformation-Dependent Adversarial Attacks

abstract: We introduce transformation-dependent adversarial attacks, a new class of threats where a single additive perturbation can trigger diverse, controllable mis-predictions by systematically transforming the input (e.g., scaling, blurring, compression). Unlike traditional attacks with static effects, our perturbations embed metamorphic properties to enable different adversarial attacks as a function of the transformation parameters. We demonstrate the transformation-dependent vulnerability across models (e.g., convolutional networks and vision transformers) and vision tasks (e.g., image classification and object detection). Our proposed geometric and photometric transformations enable a range of targeted errors from one crafted input (e.g., higher than 90% attack success rate for classifiers). We analyze effects of model architecture and type/variety of transformations on attack effectiveness. This work forces a paradigm shift by redefining adversarial inputs as dynamic, controllable threats. We highlight the need for robust defenses against such multifaceted, chameleon-like perturbations that current techniques are ill-prepared for.


title: PixMamba: Leveraging State Space Models in a Dual-Level Architecture for Underwater Image Enhancement

abstract: Underwater Image Enhancement (UIE) is critical for marine research and exploration but hindered by complex color distortions and severe blurring. Recent deep learning-based methods have achieved remarkable results, yet these methods struggle with high computational costs and insufficient global modeling, resulting in locally under- or over- adjusted regions. We present PixMamba, a novel architecture, designed to overcome these challenges by leveraging State Space Models (SSMs) for efficient global dependency modeling. Unlike convolutional neural networks (CNNs) with limited receptive fields and transformer networks with high computational costs, PixMamba efficiently captures global contextual information while maintaining computational efficiency. Our dual-level strategy features the patch-level Efficient Mamba Net (EMNet) for reconstructing enhanced image feature and the pixel-level PixMamba Net (PixNet) to ensure fine-grained feature capturing and global consistency of enhanced image that were previously difficult to obtain. PixMamba achieves state-of-the-art performance across various underwater image datasets and delivers visually superior results. Code is available at: https://github.com/weitunglin/pixmamba.


title: SVSNet+: Enhancing Speaker Voice Similarity Assessment Models with Representations from Speech Foundation Models

abstract: Representations from pre-trained speech foundation models (SFMs) have shown impressive performance in many downstream tasks. However, the potential benefits of incorporating pre-trained SFM representations into speaker voice similarity assessment have not been thoroughly investigated. In this paper, we propose SVSNet+, a model that integrates pre-trained SFM representations to improve performance in assessing speaker voice similarity. Experimental results on the Voice Conversion Challenge 2018 and 2020 datasets show that SVSNet+ incorporating WavLM representations shows significant improvements compared to baseline models. In addition, while fine-tuning WavLM with a small dataset of the downstream task does not improve performance, using the same dataset to learn a weighted-sum representation of WavLM can substantially improve performance. Furthermore, when WavLM is replaced by other SFMs, SVSNet+ still outperforms the baseline models and exhibits strong generalization ability.


title: OLMES: A Standard for Language Model Evaluations

abstract: Progress in AI is often demonstrated by new models claiming improved performance on tasks measuring model capabilities. Evaluating language models in particular is challenging, as small changes to how a model is evaluated on a task can lead to large changes in measured performance. There is no common standard setup, so different models are evaluated on the same tasks in different ways, leading to claims about which models perform best not being reproducible. We propose OLMES, a completely documented, practical, open standard for reproducible LLM evaluations. In developing this standard, we identify and review the varying factors in evaluation practices adopted by the community - such as details of prompt formatting, choice of in-context examples, probability normalizations, and task formulation. In particular, OLMES supports meaningful comparisons between smaller base models that require the unnatural "cloze" formulation of multiple-choice questions against larger models that can utilize the original formulation. OLMES includes well-considered recommendations guided by results from existing literature as well as new experiments investigating open questions.


title: The Impact of Initialization on LoRA Finetuning Dynamics

abstract: In this paper, we study the role of initialization in Low Rank Adaptation (LoRA) as originally introduced in Hu et al. (2021). Essentially, to start from the pretrained model as initialization for finetuning, one can either initialize B to zero and A to random (default initialization in PEFT package), or vice-versa. In both cases, the product BA is equal to zero at initialization, which makes finetuning starts from the pretrained model. These two initialization schemes are seemingly similar. They should in-principle yield the same performance and share the same optimal learning rate. We demonstrate that this is an incorrect intuition and that the first scheme (initializing B to zero and A to random) on average yields better performance compared to the other scheme. Our theoretical analysis shows that the reason behind this might be that the first initialization allows the use of larger learning rates (without causing output instability) compared to the second initialization, resulting in more efficient learning of the first scheme. We validate our results with extensive experiments on LLMs.


title: Heterogeneous Beliefs Model of Stock Market Predictability

abstract: This paper proposes a theory of stock market predictability patterns based on a model of heterogeneous beliefs. In a discrete finite time framework, some agents receive news about an asset's fundamental value through a noisy signal. The investors are heterogeneous in that they have different beliefs about the stochastic supply. A momentum in the stock price arises from those agents who incorrectly underestimate the signal accuracy, dampening the initial price impact of the signal. A reversal in price occurs because the price reverts to the fundamental value in the long run. An extension of the model to multiple assets case predicts co-movement and lead-lag effect, in addition to cross-sectional momentum and reversal. The heterogeneous beliefs of investors about news demonstrate how the main predictability anomalies arise endogenously in a model of bounded rationality.


title: Existence of nonnegative energy-dissipating solutions to a class of stochastic thin-film equations under weak slippage: Part I -- positive solutions

abstract: For mobility exponents $n \in (2,3)$, we prove existence of strictly positive solutions to stochastic thin-film equations with singular effective interface potential and Stratonovich-type lower-order terms. With the perspective of using these solutions in Part II to construct surface-tension-energy dissipating solutions to stochastic thin-film equations with compactly supported initial data, for which finite speed of propagation is shown in future work, we establish decay estimates on the sum of surface-tension energy and effective interface potential -- without relying on further functionals involving initial data. Besides an extension of earlier techniques used in the case $n=2$ and a refinement of oscillation estimates for discrete solutions, the main analytical novelty of this paper is a discretization method which shows nonnegativity for a finite-element counterpart of the integral $\int_{\mathcal O} (u^{n-2}u_{x})_x u_{xx} dx$ under periodic boundary conditions in the parameter regime $n \in (2,3)$. This nonnegativity property serves to control It\^o-correction terms in the estimate for the decay of the surface-tension energy. This way, it is the key to obtain the desired decay estimates for the sum of surface-tension energy and effective interface potential which permit to establish the singular limit of vanishing effective interface potential in Part II.


title: Detection of Open Cluster Members Inside and Beyond Tidal Radius by Machine Learning Methods Based on Gaia DR3

abstract: In our previous work, we introduced a method that combines two unsupervised algorithms: DBSCAN and GMM. We applied this method to 12 open clusters based on Gaia EDR3 data, demonstrating its effectiveness in identifying reliable cluster members within the tidal radius. However, for studying cluster morphology, we need a method capable of detecting members both inside and outside the tidal radius. By incorporating a supervised algorithm into our approach, we successfully identified members beyond the tidal radius. In our current work, we initially applied DBSCAN and GMM to identify reliable members of cluster stars. Subsequently, we trained the Random Forest algorithm using DBSCAN and GMM-selected data. Leveraging the random forest, we can identify cluster members outside the tidal radius and observe cluster morphology across a wide field of view. Our method was then applied to 15 open clusters based on Gaia DR3, which exhibit a wide range of metallicity, distances, members, and ages. Additionally, we calculated the tidal radius for each of the 15 clusters using the King profile and detected stars both inside and outside this radius. Finally, we investigated mass segregation and luminosity distribution within the clusters. Overall, our approach significantly improved the estimation of the tidal radius and detection of mass segregation compared to previous work. We found that in Collinder 463, low-mass stars do not segregate in comparison to high-mass and middle-mass stars. Additionally, we detected a peak of luminosity in the clusters, some of which were located far from the center, beyond the tidal radius.


title: GUI Odyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices

abstract: Smartphone users often navigate across multiple applications (apps) to complete tasks such as sharing content between social media platforms. Autonomous Graphical User Interface (GUI) navigation agents can enhance user experience in communication, entertainment, and productivity by streamlining workflows and reducing manual intervention. However, prior GUI agents often trained with datasets comprising simple tasks that can be completed within a single app, leading to poor performance in cross-app navigation. To address this problem, we introduce GUI Odyssey, a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes from 6 mobile devices, spanning 6 types of cross-app tasks, 201 apps, and 1.4K app combos. Leveraging GUI Odyssey, we developed OdysseyAgent, a multimodal cross-app navigation agent by fine-tuning the Qwen-VL model with a history resampling module. Extensive experiments demonstrate OdysseyAgent's superior accuracy compared to existing models. For instance, OdysseyAgent surpasses fine-tuned Qwen-VL and zero-shot GPT-4V by 1.44\% and 55.49\% in-domain accuracy, and 2.29\% and 48.14\% out-of-domain accuracy on average. The dataset and code will be released in \url{https://github.com/OpenGVLab/GUI-Odyssey}.


title: Einstein Gravity from Einstein Action: Counterterms and Covariance

abstract: The field equations of general relativity can be derived from the Einstein action, which is quadratic in connection coefficients, rather than the standard action involving the Gibbons-Hawking-York term and counterterm. We show that it is possible to construct a new counterterm directly for the Einstein action, which removes divergences and naturally introduces a flat reference spacetime. The total action is then covariant under simultaneous transformation of both the spacetime and reference tetrads, and argue that this is analogous to the Gibbons-Hawking action. We then explore different perspectives arising naturally from different uses of the reference tetrad, and explore implications of viewing gravity as fundamentally described in terms of non-covariant connection coefficients.


title: ORES-Inspect: A technology probe for machine learning audits on enwiki

abstract: Auditing the machine learning (ML) models used on Wikipedia is important for ensuring that vandalism-detection processes remain fair and effective. However, conducting audits is challenging because stakeholders have diverse priorities and assembling evidence for a model's [in]efficacy is technically complex. We designed an interface to enable editors to learn about and audit the performance of the ORES edit quality model. ORES-Inspect is an open-source web tool and a provocative technology probe for researching how editors think about auditing the many ML models used on Wikipedia. We describe the design of ORES-Inspect and our plans for further research with this system.


title: Towards Musically Informed Evaluation of Piano Transcription Models

abstract: Automatic piano transcription models are typically evaluated using simple frame- or note-wise information retrieval (IR) metrics. Such benchmark metrics do not provide insights into the transcription quality of specific musical aspects such as articulation, dynamics, or rhythmic precision of the output, which are essential in the context of expressive performance analysis. Furthermore, in recent years, MAESTRO has become the de-facto training and evaluation dataset for such models. However, inference performance has been observed to deteriorate substantially when applied on out-of-distribution data, thereby questioning the suitability and reliability of transcribed outputs from such models for specific MIR tasks. In this work, we investigate the performance of three state-of-the-art piano transcription models in two experiments. In the first one, we propose a variety of musically informed evaluation metrics which, in contrast to the IR metrics, offer more detailed insight into the musical quality of the transcriptions. In the second experiment, we compare inference performance on real-world and perturbed audio recordings, and highlight musical dimensions which our metrics can help explain. Our experimental results highlight the weaknesses of existing piano transcription metrics and contribute to a more musically sound error analysis of transcription outputs.


title: AToM-Bot: Embodied Fulfillment of Unspoken Human Needs with Affective Theory of Mind

abstract: We propose AToM-Bot, a novel task generation and execution framework for proactive robot-human interaction, which leverages the human mental and physical state inference capabilities of the Vision Language Model (VLM) prompted by the Affective Theory of Mind (AToM). Without requiring explicit commands by humans, AToM-Bot proactively generates and follows feasible tasks to improve general human well-being. When around humans, AToM-Bot first detects current human needs based on inferred human states and observations of the surrounding environment. It then generates tasks to fulfill these needs, taking into account its embodied constraints. We designed 16 daily life scenarios spanning 4 common scenes and tasked the same visual stimulus to 59 human subjects and our robot. We used the similarity between human open-ended answers and robot output, and the human satisfaction scores to metric robot performance. AToM-Bot received high human evaluations in need detection (6.42/7, 91.7%), embodied solution (6.15/7, 87.8%) and task execution (6.17/7, 88.1%). We show that AToM-Bot excels in generating and executing feasible plans to fulfill unspoken human needs. Videos and code are available at https://affective-tom-bot.github.io.


title: Hidden symmetries and Dehn surgery on tetrahedral links

abstract: Motivated by a question of Neumann and Reid, we study whether Dehn fillings on all but one cusp of a hyperbolic link complement can produce infinite families of knot complements with hidden symmetries which geometrically converge to the original link complement. We prove several results relating the existence of such an infinite family of knot complements with hidden symmetries to the existence of certain symmetries of the horoball packings associated to the original link. Using these results, we develop an algorithm which when run on SnapPy can test when such symmetries do not exist. We then use this SnapPy code and two utilities from \cite{orbcenpract} to show that for any given link in the tetrahedral census of Fominykh-Garoufalidis-Goerner-Tarkaev-Vesnin, no such family of Dehn fillings exists. We establish the same result for two infinite families of cyclic covers of the Berge manifold and the $6^2_2$-complement as well.


title: ConceptHash: Interpretable Fine-Grained Hashing via Concept Discovery

abstract: Existing fine-grained hashing methods typically lack code interpretability as they compute hash code bits holistically using both global and local features. To address this limitation, we propose ConceptHash, a novel method that achieves sub-code level interpretability. In ConceptHash, each sub-code corresponds to a human-understandable concept, such as an object part, and these concepts are automatically discovered without human annotations. Specifically, we leverage a Vision Transformer architecture and introduce concept tokens as visual prompts, along with image patch tokens as model inputs. Each concept is then mapped to a specific sub-code at the model output, providing natural sub-code interpretability. To capture subtle visual differences among highly similar sub-categories (e.g., bird species), we incorporate language guidance to ensure that the learned hash codes are distinguishable within fine-grained object classes while maintaining semantic alignment. This approach allows us to develop hash codes that exhibit similarity within families of species while remaining distinct from species in other families. Extensive experiments on four fine-grained image retrieval benchmarks demonstrate that ConceptHash outperforms previous methods by a significant margin, offering unique sub-code interpretability as an additional benefit. Code at: https://github.com/kamwoh/concepthash.


title: Braided Logarithmic Vertex Algebras

abstract: We study a family of algebras defined using a locally-finite endomorphism called a braiding map. When the braiding map is semi-simple, the algebra is a generalized vertex algebra, while when the braiding map is locally-nilpotent we have a logarithmic vertex algebra. We describe a method that associates to these algebras non-local Poisson vertex algebras, and we use this relation to build a new example of a generalized vertex algebra motivated by the non-linear Schr\"odinger non-local Poisson vertex algebra


title: Consistent Theories for the DESI dark energy fit

abstract: We search for physically consistent realizations of evolving dark energy suggested by the cosmological fit of DESI, Planck and Supernovae data. First we note that any lagrangian description of the standard Chevallier-Linder-Polarski (CLP) parametrization for the dark energy equation of state $w_{\rm eff}$, allows for the addition of a cosmological constant. We perform the cosmological fit finding new regions of parameter space that however continue to favour dark energy with $w_{\rm eff}<-1$ at early times that are challenging to realize in theoretically consistent theories. Next, in the spirit of effective field theories, we consider the effect of higher order terms in the Taylor expansion of the equation of state around the present epoch. We find that non-linear corrections of the equation of state are weakly constrained, thus opening the way to scenarios that differ from CLP at early times, possibly with $w_{\rm eff}>-1$ at all times. We present indeed scenarios where evolving dark energy can be realized through quintessence models. We introduce in particular the ramp model where dark energy coincides with CLP at late times and approximates to a cosmological constant at early times. The latter model provides a much better fit than $\Lambda$CDM, and only slightly worse than $w_0w_a$CDM, but with the big advantage of being described by a simple and theoretically consistent lagrangian of a canonical quintessence model.


title: Critical Lambda-adic modular forms and bi-ordinary complexes

abstract: We produce a flat $\Lambda$-module of $\Lambda$-adic critical slope overconvergent modular forms, producing a Hida-type theory that interpolates such forms over $p$-adically varying integer weights. This provides a Hida-theoretic explanation for an observation of Coleman that the rank of such forms is locally constant in the weight. The key to the interpolation is to use Coleman's presentation of de Rham cohomology in terms of overconvergent forms to link critical slope overconvergent modular forms with the ordinary part of 1st coherent cohomology of modular curves interpolated by Boxer--Pilloni's higher Hida theory. We also set up a Galois deformation theory designed to conform to these critical overconvergent forms and prove "$R = T$" for it. As applications, we (1) produce a "formal" $\Lambda$-adic interpolation of the ordinary part of de Rham cohomology, (2) produce a bi-ordinary complex whose Hecke algebra $T$ is a natural candidate for an "$R = T$" theorem where $R$ is a deformation ring for 2-dimensional $p$-adic representations of ${\rm Gal}(\bar{\bf Q}/{\bf Q})$ that become reducible and decomposable upon restriction to a decomposition group at $p$, (3) produce a degree-shifting Hecke action on the cohomology of the bi-ordinary complex, and (4) specialize this degree-shifting action to weight 1 and apply the critical "$R = T$" theorem to find, under a supplemental assumption, an action of a Stark unit on the part of weight 1 coherent cohomology over ${\bf Z}_p$ that is isotypic for an ordinary eigenform with complex multiplication.


title: Bridging the Gap: Unravelling Local Government Data Sharing Barriers in Estonia and Beyond

abstract: Estonia's digital government success has received global acclaim, yet its Open Government Data (OGD) initiatives, especially at the local level, encounter persistent challenges. Despite significant progress of national OGD initiative in OGD rankings, local governments lag in OGD provision. This study aims to examine barriers hindering municipalities from openly sharing OGD. Employing a qualitative approach through interviews with Estonian municipalities and drawing on the OGD-adapted Innovation Resistance Theory model, the study sheds light on barriers impeding OGD sharing. Practical recommendations are proposed to bridge the gap between national policies and local implementation, including enhancing awareness, improving data governance frameworks, and fostering collaboration be-tween local and national authorities. By addressing overlooked weaknesses in the Estonian open data ecosystem and providing actionable recommendations, this research contributes to a more resilient and sustainable open data ecosystem. Additionally, by validating the OGD-adapted Innovation Resistance Theory model and proposing a revised version tailored for local government contexts, the study advances theoretical frameworks for understanding data sharing resistance. Ultimately, this study serves as a call to action for policymakers and practitioners to prioritize local OGD initiatives.


title: Periodic orbits of non-degenerate lacunary contact forms on prequantization bundles

abstract: A non-degenerate contact form is lacunary if the indexes of every contractible periodic Reeb orbit have the same parity. To the best of our knowledge, every contact form with finitely many periodic orbits known so far is non-degenerate and lacunary. We show that every non-degenerate lacunary contact form on a suitable prequantization of a closed symplectic manifold $B$ has precisely $r_B$ contractible closed orbits, where $r_B=\dim \mathrm{H}_*(B;{\mathbb Q})$. Examples of such prequantizations include the standard contact sphere and the unit cosphere bundle of a compact rank one symmetric space (CROSS). We also consider some prequantizations of orbifolds, like lens spaces and the unit cosphere bundle of lens spaces, and obtain multiplicity results for these prequantizations.


title: Self-supervised Learning of Neural Implicit Feature Fields for Camera Pose Refinement

abstract: Visual localization techniques rely upon some underlying scene representation to localize against. These representations can be explicit such as 3D SFM map or implicit, such as a neural network that learns to encode the scene. The former requires sparse feature extractors and matchers to build the scene representation. The latter might lack geometric grounding not capturing the 3D structure of the scene well enough. This paper proposes to jointly learn the scene representation along with a 3D dense feature field and a 2D feature extractor whose outputs are embedded in the same metric space. Through a contrastive framework we align this volumetric field with the image-based extractor and regularize the latter with a ranking loss from learned surface information. We learn the underlying geometry of the scene with an implicit field through volumetric rendering and design our feature field to leverage intermediate geometric information encoded in the implicit field. The resulting features are discriminative and robust to viewpoint change while maintaining rich encoded information. Visual localization is then achieved by aligning the image-based features and the rendered volumetric features. We show the effectiveness of our approach on real-world scenes, demonstrating that our approach outperforms prior and concurrent work on leveraging implicit scene representations for localization.


title: Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing

abstract: High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent existing open-source data creation methods from scaling effectively, potentially limiting the diversity and quality of public alignment datasets. Is it possible to synthesize high-quality instruction data at scale by extracting it directly from an aligned LLM? We present a self-synthesis method for generating large-scale alignment data named Magpie. Our key observation is that aligned LLMs like Llama-3-Instruct can generate a user query when we input only the left-side templates up to the position reserved for user messages, thanks to their auto-regressive nature. We use this method to prompt Llama-3-Instruct and generate 4 million instructions along with their corresponding responses. We perform a comprehensive analysis of the extracted data and select 300K high-quality instances. To compare Magpie data with other public instruction datasets, we fine-tune Llama-3-8B-Base with each dataset and evaluate the performance of the fine-tuned models. Our results indicate that in some tasks, models fine-tuned with Magpie perform comparably to the official Llama-3-8B-Instruct, despite the latter being enhanced with 10 million data points through supervised fine-tuning (SFT) and subsequent feedback learning. We also show that using Magpie solely for SFT can surpass the performance of previous public datasets utilized for both SFT and preference optimization, such as direct preference optimization with UltraFeedback. This advantage is evident on alignment benchmarks such as AlpacaEval, ArenaHard, and WildBench.


title: Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Data

abstract: Many machine learning tasks, such as principal component analysis and low-rank matrix completion, give rise to manifold optimization problems. Although there is a large body of work studying the design and analysis of algorithms for manifold optimization in the centralized setting, there are currently very few works addressing the federated setting. In this paper, we consider nonconvex federated learning over a compact smooth submanifold in the setting of heterogeneous client data. We propose an algorithm that leverages stochastic Riemannian gradients and a manifold projection operator to improve computational efficiency, uses local updates to improve communication efficiency, and avoids client drift. Theoretically, we show that our proposed algorithm converges sub-linearly to a neighborhood of a first-order optimal solution by using a novel analysis that jointly exploits the manifold structure and properties of the loss functions. Numerical experiments demonstrate that our algorithm has significantly smaller computational and communication overhead than existing methods.


title: Scaling Laws in Linear Regression: Compute, Parameters, and Data

abstract: Empirically, large-scale deep learning models often satisfy a neural scaling law: the test error of the trained model improves polynomially as the model size and data size grow. However, conventional wisdom suggests the test error consists of approximation, bias, and variance errors, where the variance error increases with model size. This disagrees with the general form of neural scaling laws, which predict that increasing model size monotonically improves performance. We study the theory of scaling laws in an infinite dimensional linear regression setup. Specifically, we consider a model with $M$ parameters as a linear function of sketched covariates. The model is trained by one-pass stochastic gradient descent (SGD) using $N$ data. Assuming the optimal parameter satisfies a Gaussian prior and the data covariance matrix has a power-law spectrum of degree $a>1$, we show that the reducible part of the test error is $\Theta(M^{-(a-1)} + N^{-(a-1)/a})$. The variance error, which increases with $M$, is dominated by the other errors due to the implicit regularization of SGD, thus disappearing from the bound. Our theory is consistent with the empirical neural scaling laws and verified by numerical simulation.


title: DafnyBench: A Benchmark for Formal Software Verification

abstract: We introduce DafnyBench, the largest benchmark of its kind for training and evaluating machine learning systems for formal software verification. We test the ability of LLMs such as GPT-4 and Claude 3 to auto-generate enough hints for the Dafny formal verification engine to successfully verify over 750 programs with about 53,000 lines of code. The best model and prompting scheme achieved 68% success rate, and we quantify how this rate improves when retrying with error message feedback and how it deteriorates with the amount of required code and hints. We hope that DafnyBench will enable rapid improvements from this baseline as LLMs and verification techniques grow in quality.


title: Observing formation and evolution of dislocation cells during plastic deformation

abstract: During plastic deformation of metals and alloys, dislocations self-organise in cells, which subsequently continuously decrease in size. How and when these processes take place has remained elusive, because observations of the structural dynamics in the bulk have not been feasible. We here present X-ray diffraction microscopy movies of the structural evolution during tensile deformation of a mm-sized aluminium (111) single crystal. The formation and subsequent development of 40,000 cells are visualised. We reveal that cells form in a stochastic and isotropic manner already at 1% strain. We show that the cell size and dislocation density distributions are log-normal and bi-modal Gaussian distributions, respectively, throughout. This insight leads to an interpretation of the formation and evolution steps in terms of universal stochastic multiplicative processes. This work will guide dislocation dynamics modelling, as it provides unique results on cell formation.


title: PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences

abstract: Large foundation models pretrained on raw web-scale data are not readily deployable without additional step of extensive alignment to human preferences. Such alignment is typically done by collecting large amounts of pairwise comparisons from humans ("Do you prefer output A or B?") and learning a reward model or a policy with the Bradley-Terry-Luce (BTL) model as a proxy for a human's underlying implicit preferences. These methods generally suffer from assuming a universal preference shared by all humans, which lacks the flexibility of adapting to plurality of opinions and preferences. In this work, we propose PAL, a framework to model human preference complementary to existing pretraining strategies, which incorporates plurality from the ground up. We propose using the ideal point model as a lens to view alignment using preference comparisons. Together with our novel reformulation and using mixture modeling, our framework captures the plurality of population preferences while simultaneously learning a common preference latent space across different preferences, which can few-shot generalize to new, unseen users. Our approach enables us to use the penultimate-layer representation of large foundation models and simple MLP layers to learn reward functions that are on-par with the existing large state-of-the-art reward models, thereby enhancing efficiency of reward modeling significantly. We show that PAL achieves competitive reward model accuracy compared to strong baselines on 1) Language models with Summary dataset ; 2) Image Generative models with Pick-a-Pic dataset ; 3) A new semisynthetic heterogeneous dataset generated using Anthropic Personas. Finally, our experiments also highlight the shortcoming of current preference datasets that are created using rigid rubrics which wash away heterogeneity, and call for more nuanced data collection approaches.


title: Charged pion condensation and color superconductivity phenomena in chirally asymmetric dense quark matter

abstract: In this paper, the question of the influence of color superconductivity (CSC) on the formation of a phase with condensation of charged pions in dense chirally asymmetric quark matter is studied. We consider it within the framework of the massless NJL model with a diquark interaction channel at zero temperature, but in the presence of baryon $\mu_B$, isospin $\mu_I$, chiral $\mu_{5}$ and chiral isospin $\mu_{I5}$ chemical potentials. It has been shown in the mean-field approximation that in the presence of chiral imbalance, when $\mu_{5}\ne 0$ and/or $\mu_{I5}\ne 0$, CSC phenomenon does not hinder the generation of charged pion condensation in dense quark matter even at largest baryon densities attainable in heavy ion collisions experiments and in cores of neutron stars and its mergers. So charged pion condensation in dense quark matter with chiral imbalance predicted earlier is not in a bit suppressed by the presence of CSC, highlighting the resilience of this phase in dense quark matter. This makes phase structure of dense quark matter even more rich, multifaceted and interesting, and shows that pion condensation in dense quark matter is viable phenomenon to be explored, for example, in intermediate energy heavy ion collisions experiments.


title: Surprise! Using Physiological Stress for Allostatic Regulation Under the Active Inference Framework [Pre-Print]

abstract: Allostasis proposes that long-term viability of a living system is achieved through anticipatory adjustments of its physiology and behaviour: emphasising physiological and affective stress as an adaptive state of adaptation that minimizes long-term prediction errors. More recently, the active inference framework (AIF) has also sought to explain action and long-term adaptation through the minimization of future errors (free energy), through the learning of statistical contingencies of the world, offering a formalism for allostatic regulation. We suggest that framing prediction errors through the lens of biological hormonal dynamics proposed by allostasis offers a way to integrate these two models together in a biologically-plausible manner. In this paper, we describe our initial work in developing a model that grounds prediction errors (surprisal) into the secretion of a physiological stress hormone (cortisol) acting as an adaptive, allostatic mediator on a homeostatically-controlled physiology. We evaluate this using a computational model in simulations using an active inference agent endowed with an artificial physiology, regulated through homeostatic and allostatic control in a stochastic environment. Our results find that allostatic functions of cortisol (stress), secreted as a function of prediction errors, provide adaptive advantages to the agent's long-term physiological regulation. We argue that the coupling of information-theoretic prediction errors to low-level, biological hormonal dynamics of stress can provide a computationally efficient model to long-term regulation for embodied intelligent systems.


title: RILe: Reinforced Imitation Learning

abstract: Reinforcement Learning has achieved significant success in generating complex behavior but often requires extensive reward function engineering. Adversarial variants of Imitation Learning and Inverse Reinforcement Learning offer an alternative by learning policies from expert demonstrations via a discriminator. Employing discriminators increases their data- and computational efficiency over the standard approaches; however, results in sensitivity to imperfections in expert data. We propose RILe, a teacher-student system that achieves both robustness to imperfect data and efficiency. In RILe, the student learns an action policy while the teacher dynamically adjusts a reward function based on the student's performance and its alignment with expert demonstrations. By tailoring the reward function to both performance of the student and expert similarity, our system reduces dependence on the discriminator and, hence, increases robustness against data imperfections. Experiments show that RILe outperforms existing methods by 2x in settings with limited or noisy expert data.


title: Strategies for Pretraining Neural Operators

abstract: Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining affects neural operators is still limited; studies generally propose tailored architectures and datasets that make it challenging to compare or examine different pretraining frameworks. To address this, we compare various pretraining methods without optimizing architecture choices to characterize pretraining dynamics on different models and datasets as well as to understand its scaling and generalization behavior. We find that pretraining is highly dependent on model and dataset choices, but in general transfer learning or physics-based pretraining strategies work best. In addition, pretraining performance can be further improved by using data augmentations. Lastly, pretraining is additionally beneficial when fine-tuning in scarce data regimes or when generalizing to downstream data similar to the pretraining distribution. Through providing insights into pretraining neural operators for physics prediction, we hope to motivate future work in developing and evaluating pretraining methods for PDEs.


title: Real2Code: Reconstruct Articulated Objects via Code Generation

abstract: We present Real2Code, a novel approach to reconstructing articulated objects via code generation. Given visual observations of an object, we first reconstruct its part geometry using an image segmentation model and a shape completion model. We then represent the object parts with oriented bounding boxes, which are input to a fine-tuned large language model (LLM) to predict joint articulation as code. By leveraging pre-trained vision and language models, our approach scales elegantly with the number of articulated parts, and generalizes from synthetic training data to real world objects in unstructured environments. Experimental results demonstrate that Real2Code significantly outperforms previous state-of-the-art in reconstruction accuracy, and is the first approach to extrapolate beyond objects' structural complexity in the training set, and reconstructs objects with up to 10 articulated parts. When incorporated with a stereo reconstruction model, Real2Code also generalizes to real world objects from a handful of multi-view RGB images, without the need for depth or camera information.


title: Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models

abstract: Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion models demonstrate strong generalization capability, they cannot provide multi-view shape priors with guaranteed 3D consistency. We propose Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion. Our key insight is that 2D multi-view diffusion and 3D reconstruction models provide complementary information for each other, and by coupling them in a tight manner, we can fully leverage the potential of both models. We introduce a novel image-conditioned generative 3D Gaussian Splats reconstruction model that leverages the priors from 2D multi-view diffusion models, and provides an explicit 3D representation, which further guides the 2D reverse sampling process to have better 3D consistency. Experiments show that our proposed framework outperforms state-of-the-art methods and enables the creation of realistic avatars from a single RGB image, achieving high-fidelity in both geometry and appearance. Extensive ablations also validate the efficacy of our design, (1) multi-view 2D priors conditioning in generative 3D reconstruction and (2) consistency refinement of sampling trajectory via the explicit 3D representation. Our code and models will be released on https://yuxuan-xue.com/human-3diffusion.


title: RMem: Restricted Memory Banks Improve Video Object Segmentation

abstract: With recent video object segmentation (VOS) benchmarks evolving to challenging scenarios, we revisit a simple but overlooked strategy: restricting the size of memory banks. This diverges from the prevalent practice of expanding memory banks to accommodate extensive historical information. Our specially designed "memory deciphering" study offers a pivotal insight underpinning such a strategy: expanding memory banks, while seemingly beneficial, actually increases the difficulty for VOS modules to decode relevant features due to the confusion from redundant information. By restricting memory banks to a limited number of essential frames, we achieve a notable improvement in VOS accuracy. This process balances the importance and freshness of frames to maintain an informative memory bank within a bounded capacity. Additionally, restricted memory banks reduce the training-inference discrepancy in memory lengths compared with continuous expansion. This fosters new opportunities in temporal reasoning and enables us to introduce the previously overlooked "temporal positional embedding." Finally, our insights are embodied in "RMem" ("R" for restricted), a simple yet effective VOS modification that excels at challenging VOS scenarios and establishes new state of the art for object state changes (on the VOST dataset) and long videos (on the Long Videos dataset). Our code and demo are available at https://restricted-memory.github.io/.


title: Improving LLMs for Recommendation with Out-Of-Vocabulary Tokens

abstract: Characterizing users and items through vector representations is crucial for various tasks in recommender systems. Recent approaches attempt to apply Large Language Models (LLMs) in recommendation through a question and answer format, where real users and items (e.g., Item No.2024) are represented with in-vocabulary tokens (e.g., "item", "20", "24"). However, since LLMs are typically pretrained on natural language tasks, these in-vocabulary tokens lack the expressive power for distinctive users and items, thereby weakening the recommendation ability even after fine-tuning on recommendation tasks. In this paper, we explore how to effectively tokenize users and items in LLM-based recommender systems. We emphasize the role of out-of-vocabulary (OOV) tokens in addition to the in-vocabulary ones and claim the memorization of OOV tokens that capture correlations of users/items as well as diversity of OOV tokens. By clustering the learned representations from historical user-item interactions, we make the representations of user/item combinations share the same OOV tokens if they have similar properties. Furthermore, integrating these OOV tokens into the LLM's vocabulary allows for better distinction between users and items and enhanced capture of user-item relationships during fine-tuning on downstream tasks. Our proposed framework outperforms existing state-of-the-art methods across various downstream recommendation tasks.


title: What If We Recaption Billions of Web Images with LLaMA-3?

abstract: Web-crawled image-text pairs are inherently noisy. Prior studies demonstrate that semantically aligning and enriching textual descriptions of these pairs can significantly enhance model training across various vision-language tasks, particularly text-to-image generation. However, large-scale investigations in this area remain predominantly closed-source. Our paper aims to bridge this community effort, leveraging the powerful and \textit{open-sourced} LLaMA-3, a GPT-4 level LLM. Our recaptioning pipeline is simple: first, we fine-tune a LLaMA-3-8B powered LLaVA-1.5 and then employ it to recaption 1.3 billion images from the DataComp-1B dataset. Our empirical results confirm that this enhanced dataset, Recap-DataComp-1B, offers substantial benefits in training advanced vision-language models. For discriminative models like CLIP, we observe enhanced zero-shot performance in cross-modal retrieval tasks. For generative models like text-to-image Diffusion Transformers, the generated images exhibit a significant improvement in alignment with users' text instructions, especially in following complex queries. Our project page is https://www.haqtu.me/Recap-Datacomp-1B/


title: Real3D: Scaling Up Large Reconstruction Models with Real-World Images

abstract: The default strategy for training single-view Large Reconstruction Models (LRMs) follows the fully supervised route using large-scale datasets of synthetic 3D assets or multi-view captures. Although these resources simplify the training procedure, they are hard to scale up beyond the existing datasets and they are not necessarily representative of the real distribution of object shapes. To address these limitations, in this paper, we introduce Real3D, the first LRM system that can be trained using single-view real-world images. Real3D introduces a novel self-training framework that can benefit from both the existing synthetic data and diverse single-view real images. We propose two unsupervised losses that allow us to supervise LRMs at the pixel- and semantic-level, even for training examples without ground-truth 3D or novel views. To further improve performance and scale up the image data, we develop an automatic data curation approach to collect high-quality examples from in-the-wild images. Our experiments show that Real3D consistently outperforms prior work in four diverse evaluation settings that include real and synthetic data, as well as both in-domain and out-of-domain shapes. Code and model can be found here: https://hwjiang1510.github.io/Real3D/


title: Linear equations with monomial constraints and decision problems in abelian-by-cyclic groups

abstract: We show that it is undecidable whether a system of linear equations over the Laurent polynomial ring $\mathbb{Z}[X^{\pm}]$ admit solutions where a specified subset of variables take value in the set of monomials $\{X^z \mid z \in \mathbb{Z}\}$. In particular, we construct a finitely presented $\mathbb{Z}[X^{\pm}]$-module, where it is undecidable whether a linear equation $X^{z_1} \boldsymbol{f}_1 + \cdots + X^{z_n} \boldsymbol{f}_n = \boldsymbol{f}_0$ has solutions $z_1, \ldots, z_n \in \mathbb{Z}$. This contrasts the decidability of the case $n = 1$, which can be deduced from Noskov's Lemma. We apply this result to settle a number of problems in computational group theory. We show that it is undecidable whether a system of equations has solutions in the wreath product $\mathbb{Z} \wr \mathbb{Z}$, providing a negative answer to an open problem of Kharlampovich, L\'{o}pez and Miasnikov (2020). We show that there exists a finitely generated abelian-by-cyclic group in which the problem of solving a single quadratic equation is undecidable. We also construct a finitely generated abelian-by-cyclic group, different to that of Mishchenko and Treier (2017), in which the Knapsack Problem is undecidable. In contrast, we show that the problem of Coset Intersection is decidable in all finitely generated abelian-by-cyclic groups.


title: Enhancing End-to-End Autonomous Driving with Latent World Model

abstract: End-to-end autonomous driving has garnered widespread attention. Current end-to-end approaches largely rely on the supervision from perception tasks such as detection, tracking, and map segmentation to aid in learning scene representations. However, these methods require extensive annotations, hindering the data scalability. To address this challenge, we propose a novel self-supervised method to enhance end-to-end driving without the need for costly labels. Specifically, our framework \textbf{LAW} uses a LAtent World model to predict future latent features based on the predicted ego actions and the latent feature of the current frame. The predicted latent features are supervised by the actually observed features in the future. This supervision jointly optimizes the latent feature learning and action prediction, which greatly enhances the driving performance. As a result, our approach achieves state-of-the-art performance in both open-loop and closed-loop benchmarks without costly annotations.


title: Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation

abstract: Diffusion models are the state of the art in text-to-image generation, but their perceptual variability remains understudied. In this paper, we examine how prompts affect image variability in black-box diffusion-based models. We propose W1KP, a human-calibrated measure of variability in a set of images, bootstrapped from existing image-pair perceptual distances. Current datasets do not cover recent diffusion models, thus we curate three test sets for evaluation. Our best perceptual distance outperforms nine baselines by up to 18 points in accuracy, and our calibration matches graded human judgements 78% of the time. Using W1KP, we study prompt reusability and show that Imagen prompts can be reused for 10-50 random seeds before new images become too similar to already generated images, while Stable Diffusion XL and DALL-E 3 can be reused 50-200 times. Lastly, we analyze 56 linguistic features of real prompts, finding that the prompt's length, CLIP embedding norm, concreteness, and word senses influence variability most. As far as we are aware, we are the first to analyze diffusion variability from a visuolinguistic perspective. Our project page is at http://w1kp.com


title: A suite of classical Cepheids tied to the binary cluster Berkeley 58 \& NGC 7790

abstract: The classical Cepheids CE Cas A, CE Cas B, CF Cas, and CG Cas are likely members of the binary open cluster comprising NGC 7790 and Berkeley 58. The clusters are of comparable age and in close proximity, as deduced from differentially dereddened $UuB_PBVGR_P$ photometry, and Cepheid period-age relations. Gaia DR3 astrometric and spectroscopic solutions for the clusters are likewise consistent. Conversely, the seemingly adjacent open cluster NGC 7788 is substantially younger and less distant.


title: Exploiting the diversity of modeling methods to probe systematic biases in strong lensing analyses

abstract: In the past decade, the diversity of strong lens modeling methods has exploded, from being purely analytical to pixelated and non-parametric, or based on deep learning. We embrace this diversity by selecting different software packages and use them to blindly model independently simulated Hubble Space Telescope imaging data. To overcome the difficulties arising from using different codes and conventions, we use the COde-independent Organized LEns STandard (COOLEST) to store, compare and release all models in a self-consistent and human-readable manner. From an ensemble of six modeling methods, we study the recovery of the lens potential parameters and properties of the reconstructed source. In particular, we simulate and infer parameters of an elliptical power-law mass distribution with external shear for the lens while each modeling method reconstructs the source differently. We find that overall, both lens and source properties are recovered reasonably well, but systematic biases arise in all methods. Interestingly, we do not observe that a single method is significantly more accurate than others, and the amount of bias largely depends on the specific lens or source property of interest. By combining posterior distributions from individual methods using equal weights, the maximal systematic biases on lens model parameters inferred from individual models are reduced by a factor of 5.4 on average. We investigate a selection of modeling effects that partly explain the observed biases, such as the cuspy nature of the background source and the accuracy of the point spread function. This work introduces, for the first time, a generic framework to compare and ease the combination of models obtained from different codes and methods, which will be key to retain accuracy in future strong lensing analyses.


title: Celestial Topology, Symmetry Theories, and Evidence for a Non-SUSY D3-Brane CFT

abstract: Symmetry Theories (SymThs) provide a flexible framework for analyzing the global categorical symmetries of a $D$-dimensional QFT$_{D}$ in terms of a $(D+1)$-dimensional bulk system SymTh$_{D+1}$. In QFTs realized via local string backgrounds, these SymThs naturally arise from dimensional reduction of the linking boundary geometry. To track possible time dependent effects we introduce a celestial generalization of the standard "boundary at infinity" of a SymTh. As an application of these considerations we revisit large $N$ quiver gauge theories realized by spacetime filling D3-branes probing a non-supersymmetric orbifold $\mathbb{R}^6 / \Gamma$. Comparing the imprint of symmetry breaking on the celestial geometry at small and large 't Hooft coupling we find evidence for an intermediate symmetry preserving conformal fixed point.


title: On Evaluating Adversarial Robustness of Volumetric Medical Segmentation Models

abstract: Volumetric medical segmentation models have achieved significant success on organ and tumor-based segmentation tasks in recent years. However, their vulnerability to adversarial attacks remains largely unexplored, raising serious concerns regarding the real-world deployment of tools employing such models in the healthcare sector. This underscores the importance of investigating the robustness of existing models. In this context, our work aims to empirically examine the adversarial robustness across current volumetric segmentation architectures, encompassing Convolutional, Transformer, and Mamba-based models. We extend this investigation across four volumetric segmentation datasets, evaluating robustness under both white box and black box adversarial attacks. Overall, we observe that while both pixel and frequency-based attacks perform reasonably well under white box setting, the latter performs significantly better under transfer-based black box attacks. Across our experiments, we observe transformer-based models show higher robustness than convolution-based models with Mamba-based models being the most vulnerable. Additionally, we show that large-scale training of volumetric segmentation models improves the model's robustness against adversarial attacks. The code and pretrained models will be made available at https://github.com/HashmatShadab/Robustness-of-Volumetric-Medical-Segmentation-Models.


title: Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models

abstract: Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning. Existing works usually employ a straightforward resolution upscaling method, where the image consists of global and local branches, with the latter being the sliced image patches but resized to the same resolution as the former. This means that higher resolution requires more local patches, resulting in exorbitant computational expenses, and meanwhile, the dominance of local image tokens may diminish the global context. In this paper, we dive into the problems and propose a new framework as well as an elaborate optimization strategy. Specifically, we extract contextual information from the global view using a mixture of adapters, based on the observation that different adapters excel at different tasks. With regard to local patches, learnable query embeddings are introduced to reduce image tokens, the most important tokens accounting for the user question will be further selected by a similarity-based selector. Our empirical results demonstrate a `less is more' pattern, where \textit{utilizing fewer but more informative local image tokens leads to improved performance}. Besides, a significant challenge lies in the training strategy, as simultaneous end-to-end training of the global mining block and local compression block does not yield optimal results. We thus advocate for an alternating training way, ensuring balanced learning between global and local aspects. Finally, we also introduce a challenging dataset with high requirements for image detail, enhancing the training of the local compression layer. The proposed method, termed LMM with Sophisticated Tasks, Local image compression, and Mixture of global Experts (SliME), achieves leading performance across various benchmarks with only 2 million training data.


title: ICE-G: Image Conditional Editing of 3D Gaussian Splats

abstract: Recently many techniques have emerged to create high quality 3D assets and scenes. When it comes to editing of these objects, however, existing approaches are either slow, compromise on quality, or do not provide enough customization. We introduce a novel approach to quickly edit a 3D model from a single reference view. Our technique first segments the edit image, and then matches semantically corresponding regions across chosen segmented dataset views using DINO features. A color or texture change from a particular region of the edit image can then be applied to other views automatically in a semantically sensible manner. These edited views act as an updated dataset to further train and re-style the 3D scene. The end-result is therefore an edited 3D model. Our framework enables a wide variety of editing tasks such as manual local edits, correspondence based style transfer from any example image, and a combination of different styles from multiple example images. We use Gaussian Splats as our primary 3D representation due to their speed and ease of local editing, but our technique works for other methods such as NeRFs as well. We show through multiple examples that our method produces higher quality results while offering fine-grained control of editing. Project page: ice-gaussian.github.io


title: A Polynomial Time Algorithm for 3SAT

abstract: It is shown that any two clauses in an instance of 3SAT sharing the same terminal which is positive in one clause and negated in the other can imply a new clause composed of the remaining terms from both clauses. Clauses can also imply other clauses as long as all the terms in the implying clauses exist in the implied clause. It is shown an instance of 3SAT is unsatisfiable if and only if it can derive contradicting 1-terminal clauses in exponential time. It is further shown that these contradicting clauses can be implied with the aforementioned techniques without processing clauses of length 4 or greater, reducing the computation to polynomial time. Therefore there is a polynomial time algorithm that will produce contradicting 1-terminal clauses if and only if the instance of 3SAT is unsatisfiable. Since such an algorithm exists and 3SAT is NP-Complete, P = NP.


title: An origami Universal Turing Machine design

abstract: It has been known since 1996 that deciding whether a collection of creases on a piece of paper can be fully folded flat without causing self-intersection or adding new creases is an NP-Hard problem (Bern and Hayes). In their proof, a binary state was implemented as a pleat, with the state corresponding to the pleat layering order; states then interact via pleat intersections. Building on some of the machinery of their result, we will present a method for constructing an origami NAND logic gate, leading to a theoretical origami Universal Turing Machine.


title: FPGA-based Distributed Union-Find Decoder for Surface Codes

abstract: A fault-tolerant quantum computer must decode and correct errors faster than they appear to prevent exponential slowdown due to error correction. The Union-Find (UF) decoder is promising with an average time complexity slightly higher than $O(d^3)$. We report a distributed version of the UF decoder that exploits parallel computing resources for further speedup. Using an FPGA-based implementation, we empirically show that this distributed UF decoder has a sublinear average time complexity with regard to $d$, given $O(d^3)$ parallel computing resources. The decoding time per measurement round decreases as $d$ increases, the first time for a quantum error decoder. The implementation employs a scalable architecture called Helios that organizes parallel computing resources into a hybrid tree-grid structure. Using a Xilinx VCU129 FPGA, we successfully implement $d$ up to 21 with an average decoding time of 11.5 ns per measurement round under 0.1\% phenomenological noise, and 23.7 ns for $d=17$ under equivalent circuit-level noise. This performance is significantly faster than any existing decoder implementation. Furthermore, we show that Helios can optimize for resource efficiency by decoding $d=51$ on a Xilinx VCU129 FPGA with an average latency of 544ns per measurement round.


title: ASI as the New God: Technocratic Theocracy

abstract: As Artificial General Intelligence edges closer to reality, Artificial Superintelligence does too. This paper argues that ASI's unparalleled capabilities might lead people to attribute godlike infallibility to it, resulting in a cognitive bias toward unquestioning acceptance of its decisions. By drawing parallels between ASI and divine attributes such as omnipotence, omniscience, and omnipresence, this analysis highlights the risks of conflating technological advancement with moral and ethical superiority. Such dynamics could engender a technocratic theocracy, where decision-making is abdicated to ASI, undermining human agency and critical thinking.


title: Equivalence of Countable and Computable

abstract: The concept of ``countable set'' is attributed to Georg Cantor, who set the boundary between countable and uncountable sets in 1874. The concept of ``computable set'' arose in the study of computing models in the 1930s by the founders of computer science, including \Godel, Church, and Turing. However, the connection between countability and computability has not been thoroughly studied in the past eight decades. A {\em counting bijection} of a set $S$ is a bijection from the set of natural numbers to $S$. We say $S$ is {\em enumerable} if either $S$ is finite or $S$ has a computable counting bijection. We prove that $S$ is enumerable if and only if $S$ is computable. This equivalence provides insights to the study of set theory and computability theory and reveals that the concept of countability is related to space and time complexity. We show that the set of total computable functions (or deciders, algorithms) is unenumerable. We also provide a sufficient and necessary condition for a set to be enumerable and use the concept of {\em counting order} to explain why some sets are unenumerable. We show that some popular statements about countable sets, such as ``every subset of a countable set is countable'' or ``every formal language is countable,'' lack a valid proof. These unproven statements are widely taught in college courses on discrete mathematics, set theory, and computability theory.