title: A Schur-Weyl duality analogue based on a commutative bilinear operation

abstract: Schur-Weyl duality concerns the actions of $\text{GL}_{n}(\mathbb{C})$ and $S_{k}$ on tensor powers of the form $V^{\otimes k}$ for an $n$-dimensional vector space $V$. There are rich histories within representation theory, combinatorics, and statistical mechanics involving the study and use of diagram algebras, which arise through the restriction of the action of $\text{GL}_{n}(\mathbb{C})$ to subgroups of $\text{GL}_{n}(\mathbb{C})$. This leads us to consider further variants of Schur-Weyl duality, with the use of variants of the tensor space $V^{\otimes k}$. Instead of taking repeated tensor products of $V$, we make use of a freest commutative bilinear operation in place of $\otimes$, and this is motivated by an associated invariance property given by the action of $S_{k}$. By then taking the centralizer algebra with respect to the action of the group of permutation matrices in $\text{GL}_{n}(\mathbb{C})$, this gives rise to a diagram-like algebra spanned by a new class of combinatorial objects. We construct orbit-type bases for the centralizer algebras introduced in this paper, and we apply these bases to prove a combinatorial formula for the dimensions of our centralizer algebras.


title: Applying Fine-Tuned LLMs for Reducing Data Needs in Load Profile Analysis

abstract: This paper presents a novel method for utilizing fine-tuned Large Language Models (LLMs) to minimize data requirements in load profile analysis, demonstrated through the restoration of missing data in power system load profiles. A two-stage fine-tuning strategy is proposed to adapt a pre-trained LLMs, i.e., GPT-3.5, for missing data restoration tasks. Through empirical evaluation, we demonstrate the effectiveness of the fine-tuned model in accurately restoring missing data, achieving comparable performance to state-of-the-art specifically designed models such as BERT-PIN. Key findings include the importance of prompt engineering and the optimal utilization of fine-tuning samples, highlighting the efficiency of few-shot learning in transferring knowledge from general user cases to specific target users. Furthermore, the proposed approach demonstrates notable cost-effectiveness and time efficiency compared to training models from scratch, making it a practical solution for scenarios with limited data availability and computing resources. This research has significant potential for application to other power system load profile analysis tasks. Consequently, it advances the use of LLMs in power system analytics, offering promising implications for enhancing the resilience and efficiency of power distribution systems.


title: Fairness Evolution in Continual Learning for Medical Imaging

abstract: Deep Learning (DL) has made significant strides in various medical applications in recent years, achieving remarkable results. In the field of medical imaging, DL models can assist doctors in disease diagnosis by classifying pathologies in Chest X-ray images. However, training on new data to expand model capabilities and adapt to distribution shifts is a notable challenge these models face. Continual Learning (CL) has emerged as a solution to this challenge, enabling models to adapt to new data while retaining knowledge gained from previous experiences. Previous studies have analyzed the behavior of CL strategies in medical imaging regarding classification performance. However, when considering models that interact with sensitive information, such as in the medical domain, it is imperative to disaggregate the performance of socially salient groups. Indeed, DL algorithms can exhibit biases against certain sub-populations, leading to discrepancies in predictive performance across different groups identified by sensitive attributes such as age, race/ethnicity, sex/gender, and socioeconomic status. In this study, we go beyond the typical assessment of classification performance in CL and study bias evolution over successive tasks with domain-specific fairness metrics. Specifically, we evaluate the CL strategies using the well-known CheXpert (CXP) and ChestX-ray14 (NIH) datasets. We consider a class incremental scenario of five tasks with 12 pathologies. We evaluate the Replay, Learning without Forgetting (LwF), LwF Replay, and Pseudo-Label strategies. LwF and Pseudo-Label exhibit optimal classification performance, but when including fairness metrics in the evaluation, it is clear that Pseudo-Label is less biased. For this reason, this strategy should be preferred when considering real-world scenarios in which it is crucial to consider the fairness of the model.


title: Hiding Text in Large Language Models: Introducing Unconditional Token Forcing Confusion

abstract: With the help of simple fine-tuning, one can artificially embed hidden text into large language models (LLMs). This text is revealed only when triggered by a specific query to the LLM. Two primary applications are LLM fingerprinting and steganography. In the context of LLM fingerprinting, a unique text identifier (fingerprint) is embedded within the model to verify licensing compliance. In the context of steganography, the LLM serves as a carrier for hidden messages that can be disclosed through a designated trigger. Our work demonstrates that embedding hidden text in the LLM via fine-tuning, though seemingly secure due to the vast number of potential triggers (any sequence of characters or tokens could serve as a trigger), is susceptible to extraction through analysis of the LLM's output decoding process. We propose a novel approach to extraction called Unconditional Token Forcing. It is premised on the hypothesis that iteratively feeding each token from the LLM's vocabulary into the model should reveal sequences with abnormally high token probabilities, indicating potential embedded text candidates. Additionally, our experiments show that when the first token of a hidden fingerprint is used as an input, the LLM not only produces an output sequence with high token probabilities, but also repetitively generates the fingerprint itself. We also present a method to hide text in such a way that it is resistant to Unconditional Token Forcing, which we named Unconditional Token Forcing Confusion.


title: Toeplitz non-liquids and Toeplitz braiding

abstract: We study a class of $3$D non-liquid states called ``Toeplitz non-liquids''. These states consist of a stack of $2$D twisted $\mathbb{Z}_N$ topologically ordered layers along the $z$-direction; nearby layers are coupled while keeping translational symmetry along $z$. The effective field theory is described by infinite Chern-Simons (iCS) theory, with a coefficient matrix called ``$K$-matrix'' that is of block-tridiagonal Toeplitz matrix-type. With open boundary conditions (OBC) along the $z$-direction, certain $K$-matrices exhibit an exotic phenomenon called ``Toeplitz braiding'', where the mutual braiding statistical phase between two anyons at opposite boundaries oscillates and remains non-zero in the thermodynamic limit. As a necessary condition, this requires boundary zero modes in the $K$-matrix spectrum under OBC. A key example is the $K$-matrix resembling the Hamiltonian of the $1$D Su-Schrieffer-Heeger insulator. Since the gauge invariance of Chern-Simons theory guarantees integer quantized entries for $K$-matrices, no usual global symmetries are needed to protect these zero modes or Toeplitz braiding. In order to obtain the general theory, we categorize $K$-matrices that support Toeplitz braiding into three types and analyze the conditions for each. We further numerically study the analytical results for all types of $K$-matrices. For comparison, a trivial case is numerically shown, where the mutual statistical phase angle decays exponentially to zero in the thermodynamic limit.


title: How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?

abstract: Partially manipulating a sentence can greatly change its meaning. Recent work shows that countermeasures (CMs) trained on partially spoofed audio can effectively detect such spoofing. However, the current understanding of the decision-making process of CMs is limited. We utilize Grad-CAM and introduce a quantitative analysis metric to interpret CMs' decisions. We find that CMs prioritize the artifacts of transition regions created when concatenating bona fide and spoofed audio. This focus differs from that of CMs trained on fully spoofed audio, which concentrate on the pattern differences between bona fide and spoofed parts. Our further investigation explains the varying nature of CMs' focus while making correct or incorrect predictions. These insights provide a basis for the design of CM models and the creation of datasets. Moreover, this work lays a foundation of interpretability in the field of partial spoofed audio detection that has not been well explored previously.


title: Endomorphisms of Artin groups of type $\tilde A_n$

abstract: We determine a classification of the endomorphisms of the Artin group of affine type $\tilde A_n$ for $n\ge 4$.


title: Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generation

abstract: Controllable text-to-image (T2I) diffusion models have shown impressive performance in generating high-quality visual content through the incorporation of various conditions. Current methods, however, exhibit limited performance when guided by skeleton human poses, especially in complex pose conditions such as side or rear perspectives of human figures. To address this issue, we present Stable-Pose, a novel adapter model that introduces a coarse-to-fine attention masking strategy into a vision Transformer (ViT) to gain accurate pose guidance for T2I models. Stable-Pose is designed to adeptly handle pose conditions within pre-trained Stable Diffusion, providing a refined and efficient way of aligning pose representation during image synthesis. We leverage the query-key self-attention mechanism of ViTs to explore the interconnections among different anatomical parts in human pose skeletons. Masked pose images are used to smoothly refine the attention maps based on target pose-related features in a hierarchical manner, transitioning from coarse to fine levels. Additionally, our loss function is formulated to allocate increased emphasis to the pose region, thereby augmenting the model's precision in capturing intricate pose details. We assessed the performance of Stable-Pose across five public datasets under a wide range of indoor and outdoor human pose scenarios. Stable-Pose achieved an AP score of 57.1 in the LAION-Human dataset, marking around 13% improvement over the established technique ControlNet. The project link and code is available at https://github.com/ai-med/StablePose.


title: A Temporal Kolmogorov-Arnold Transformer for Time Series Forecasting

abstract: Capturing complex temporal patterns and relationships within multivariate data streams is a difficult task. We propose the Temporal Kolmogorov-Arnold Transformer (TKAT), a novel attention-based architecture designed to address this task using Temporal Kolmogorov-Arnold Networks (TKANs). Inspired by the Temporal Fusion Transformer (TFT), TKAT emerges as a powerful encoder-decoder model tailored to handle tasks in which the observed part of the features is more important than the a priori known part. This new architecture combined the theoretical foundation of the Kolmogorov-Arnold representation with the power of transformers. TKAT aims to simplify the complex dependencies inherent in time series, making them more "interpretable". The use of transformer architecture in this framework allows us to capture long-range dependencies through self-attention mechanisms.


title: Investigating the Online Recruitment and Selection Journey of Novice Software Engineers: Anti-patterns and Recommendations

abstract: [Context] The growing software development market has increased the demand for qualified professionals in Software Engineering (SE). To this end, companies must enhance their Recruitment and Selection (R&S) processes to maintain high quality teams, including opening opportunities for beginners, such as trainees and interns. However, given the various judgments and sociotechnical factors involved, this complex process of R&S poses a challenge for recent graduates seeking to enter the market. [Objective] This paper aims to identify a set of anti-patterns and recommendations for early career SE professionals concerning R&S processes. [Method] Under an exploratory and qualitative methodological approach, we conducted six online Focus Groups with 18 recruiters with experience in R&S in the software industry. [Results] After completing our qualitative analysis, we identified 12 anti-patterns and 31 actionable recommendations regarding the hiring process focused on entry level SE professionals. The identified anti-patterns encompass behavioral and technical dimensions innate to R&S processes. [Conclusion] These findings provide a rich opportunity for reflection in the SE industry and offer valuable guidance for early-career candidates and organizations. From an academic perspective, this work also raises awareness of the intersection of Human Resources and SE, an area with considerable potential to be expanded in the context of cooperative and human aspects of SE.


title: Language-Universal Speech Attributes Modeling for Zero-Shot Multilingual Spoken Keyword Recognition

abstract: We propose a novel language-universal approach to end-to-end automatic spoken keyword recognition (SKR) leveraging upon (i) a self-supervised pre-trained model, and (ii) a set of universal speech attributes (manner and place of articulation). Specifically, Wav2Vec2.0 is used to generate robust speech representations, followed by a linear output layer to produce attribute sequences. A non-trainable pronunciation model then maps sequences of attributes into spoken keywords in a multilingual setting. Experiments on the Multilingual Spoken Words Corpus show comparable performances to character- and phoneme-based SKR in seen languages. The inclusion of domain adversarial training (DAT) improves the proposed framework, outperforming both character- and phoneme-based SKR approaches with 13.73% and 17.22% relative word error rate (WER) reduction in seen languages, and achieves 32.14% and 19.92% WER reduction for unseen languages in zero-shot settings.


title: Stability theory over toroidal or Novikov type base and Canonical modifications

abstract: We set up a generalization of ubiquitous one parameter families in algebraic geometry and its use for stability theories ([Mum65, HL14, AHLH23]) to families over toric varieties, Novikov type rings, or its complex analytic analogues. The language allows us to reformulate degenerations of "irrational" direction in various literatures as canonical objects in a unified manner. Compatibly, we generalize the stable reduction type theorem for $\Theta$-stratification in [AHLH23] of Langton type to our higher rank setup.


title: Ai-Sampler: Adversarial Learning of Markov kernels with involutive maps

abstract: Markov chain Monte Carlo methods have become popular in statistics as versatile techniques to sample from complicated probability distributions. In this work, we propose a method to parameterize and train transition kernels of Markov chains to achieve efficient sampling and good mixing. This training procedure minimizes the total variation distance between the stationary distribution of the chain and the empirical distribution of the data. Our approach leverages involutive Metropolis-Hastings kernels constructed from reversible neural networks that ensure detailed balance by construction. We find that reversibility also implies $C_2$-equivariance of the discriminator function which can be used to restrict its function space.


title: Neural network sampling of Bethe-Heitler process in particle-in-cell codes

abstract: This study uses neural networks to improve Monte Carlo (MC) implementations of the Bethe-Heitler process in Particle-In-Cell (PIC) codes. We provide a neural network that is as accurate as pre-calculated tables, and requires a hundred times less memory to store. It is trained to predict Bethe-Heitler pair production cross-sections for atomic numbers 1-50 and photon energies between 1 MeV and 10 GeV in the PIC code OSIRIS. We first validate our approach against a theoretical estimate in a simplified context. We later prove that both approaches have similar performance in a typical relativistic laser-plasma interaction scenario. The large memory decrease accessible with neural networks will enable introducing more advanced cross-section models for Bethe-Heitler pair production and other QED mechanisms in the MC modules of PIC codes.


title: Distrust of social media influencers in America

abstract: The popularity of social media influencers (SMI) as a means for businesses and causes to engage with the public and develop followers is undeniable. However, the use of SMI have been scrutinized due to various scandals that reflect poorly on brands and firms. Consequently, the distrust of SMI can create the potential for damage to a brand if audiences are not receptive to communications and messaging. This study (n=351) shares insights and findings of the apparent distrust of SMI that were discovered during the data analysis phase of my dissertation (Berry, 2024a). The study examines levels of trust and distrust toward SMI in the United States according to various demographic characteristics of respondents, specifically, age, gender, income level, education level, and region of the United States. Chi square analysis of the variables and a predictive model of trust of SMI are presented. Finally, recommendations and suggestions for future research are discussed.


title: Toggleability Spaces of Fences

abstract: We completely describe the order ideal (resp. antichain) toggleability space for general fences: the space of statistics which are linear combinations of order ideal (antichain) indicator functions and equal to a constant plus a linear combination of toggleability statistics. This allows us to strengthen some homomesies under rowmotion on fences proven by Elizalde et al. and prove some new homomesy results for combinatorial, piecewise-linear, and birational rowmotion.


title: Velocity Scanning Tomography for Room-Temperature Quantum Simulation

abstract: Quantum simulation offers an analog approach for exploring exotic quantum phenomena using controllable platforms, typically necessitating ultracold temperatures to maintain the quantum coherence. Superradiance lattices (SLs) have been harnessed to simulate coherent topological physics at room temperature, but the thermal motion of atoms remains a notable challenge in accurately measuring the physical quantities. To overcome this obstacle, we invent and validate a velocity scanning tomography technique to discern the responses of atoms with different velocities, allowing cold-atom spectroscopic resolution within room-temperature SLs. By comparing absorption spectra with and without atoms moving at specific velocities, we can derive the Wannier-Stark ladders of the SL across various effective static electric fields, their strengths being proportional to the atomic velocities. We extract the Zak phase of the SL by monitoring the ladder frequency shift as a function of the atomic velocity, effectively demonstrating the topological winding of the energy bands. Our research signifies the feasibility of room-temperature quantum simulation and facilitates their applications in quantum information processing.


title: GenS: Generalizable Neural Surface Reconstruction from Multi-View Images

abstract: Combining the signed distance function (SDF) and differentiable volume rendering has emerged as a powerful paradigm for surface reconstruction from multi-view images without 3D supervision. However, current methods are impeded by requiring long-time per-scene optimizations and cannot generalize to new scenes. In this paper, we present GenS, an end-to-end generalizable neural surface reconstruction model. Unlike coordinate-based methods that train a separate network for each scene, we construct a generalized multi-scale volume to directly encode all scenes. Compared with existing solutions, our representation is more powerful, which can recover high-frequency details while maintaining global smoothness. Meanwhile, we introduce a multi-scale feature-metric consistency to impose the multi-view consistency in a more discriminative multi-scale feature space, which is robust to the failures of the photometric consistency. And the learnable feature can be self-enhanced to continuously improve the matching accuracy and mitigate aggregation ambiguity. Furthermore, we design a view contrast loss to force the model to be robust to those regions covered by few viewpoints through distilling the geometric prior from dense input to sparse input. Extensive experiments on popular benchmarks show that our model can generalize well to new scenes and outperform existing state-of-the-art methods even those employing ground-truth depth supervision. Code is available at https://github.com/prstrive/GenS.


title: Kolmogorov-Arnold Networks for Time Series: Bridging Predictive Power and Interpretability

abstract: Kolmogorov-Arnold Networks (KAN) is a groundbreaking model recently proposed by the MIT team, representing a revolutionary approach with the potential to be a game-changer in the field. This innovative concept has rapidly garnered worldwide interest within the AI community. Inspired by the Kolmogorov-Arnold representation theorem, KAN utilizes spline-parametrized univariate functions in place of traditional linear weights, enabling them to dynamically learn activation patterns and significantly enhancing interpretability. In this paper, we explore the application of KAN to time series forecasting and propose two variants: T-KAN and MT-KAN. T-KAN is designed to detect concept drift within time series and can explain the nonlinear relationships between predictions and previous time steps through symbolic regression, making it highly interpretable in dynamically changing environments. MT-KAN, on the other hand, improves predictive performance by effectively uncovering and leveraging the complex relationships among variables in multivariate time series. Experiments validate the effectiveness of these approaches, demonstrating that T-KAN and MT-KAN significantly outperform traditional methods in time series forecasting tasks, not only enhancing predictive accuracy but also improving model interpretability. This research opens new avenues for adaptive forecasting models, highlighting the potential of KAN as a powerful and interpretable tool in predictive analytics.


title: Dropout MPC: An Ensemble Neural MPC Approach for Systems with Learned Dynamics

abstract: Neural networks are lately more and more often being used in the context of data-driven control, as an approximate model of the true system dynamics. Model Predictive Control (MPC) adopts this practise leading to neural MPC strategies. This raises a question of whether the trained neural network has converged and generalized in a way that the learned model encapsulates an accurate approximation of the true dynamic model of the system, thus making it a reliable choice for model-based control, especially for disturbed and uncertain systems. To tackle that, we propose Dropout MPC, a novel sampling-based ensemble neural MPC algorithm that employs the Monte-Carlo dropout technique on the learned system model. The closed loop is based on an ensemble of predictive controllers, that are used simultaneously at each time-step for trajectory optimization. Each member of the ensemble influences the control input, based on a weighted voting scheme, thus by employing different realizations of the learned system dynamics, neural control becomes more reliable by design. An additional strength of the method is that it offers by design a way to estimate future uncertainty, leading to cautious control. While the method aims in general at uncertain systems with complex dynamics, where models derived from first principles are hard to infer, to showcase the application we utilize data gathered in the laboratory from a real mobile manipulator and employ the proposed algorithm for the navigation of the robot in simulation.


title: The story of SN 2021aatd -- a peculiar 1987A-like supernova with an early-phase luminosity excess

abstract: There is a growing number of peculiar events that cannot be assigned to any of the main supernova (SN) classes. SN 1987A and a handful of similar objects, thought to be explosive outcomes of blue supergiant stars, belong to them: while their spectra closely resemble those of H-rich (IIP) SNe, their light-curve (LC) evolution is very different. Here we present the detailed photometric and spectroscopic analysis of SN 2021aatd, a peculiar Type II explosion: while its early-time evolution resembles that of the slowly evolving, double-peaked SN 2020faa (however, at a lower luminosity scale), after $\sim$40 days, its LC shape becomes similar to that of SN 1987A-like explosions. Beyond comparing LCs, color curves, and spectra of SN 2021aatd to that of SNe 2020faa, 1987A, and of other objects, we compare the observed spectra with our own SYN++ models and with the outputs of published radiative transfer models. We also modeled the pseudo-bolometric LCs of SNe 2021aatd and 1987A assuming a two-component (core+shell) ejecta, and involving the rotational energy of a newborn magnetar in addition to radioactive decay. We find that both the photometric and spectroscopic evolution of SN 2021aatd can be well described with the explosion of a $\sim$15 $M_\odot$ blue supergiant star. Nevertheless, SN 2021aatd shows higher temperatures and weaker Na ID and Ba II 6142 A lines than SN 1987A, which is reminiscent of rather to IIP-like atmospheres. With the applied two-component ejecta model (counting with both decay and magnetar energy), we can successfully describe the bolometric LC of SN 2021aatd, including the first $\sim$40-day long phase showing an excess compared to 87A-like SNe but being strikingly similar to that of the long-lived SN 2020faa. Nevertheless, finding a unified model that also explains the LCs of more luminous events (like SN 2020faa) is still a matter of concern.


title: Electronic properties of magnetic semiconductor $\textrm{CuMnO}_{2}$ : a first principles study

abstract: Geometrically frustrated magnetic semiconductor $\textrm{CuMnO}_{2}$ has potential applications as photo-catalyst, in photochemical cells and multi-ferroic devices. Electronic band structure in the antiferromagnetic and ferromagnetic phases of $\textrm{CuMnO}_{2}$ were calculated using first principle density functional theory (DFT) as implemented in VASP. Electronic band structure in the antiferromagnetic state shows indirect band gap ($\sim 0.53$ eV) where as in the ferromagnetic state it shows half-metallic state with 100\% spin polarization. The half-metallic state arises due to \textit{double exchange} mechanism. In the half-metallic state the density of states for the up spin channel shows asymmetric power law behaviour near the Fermi level while the down spin channel shows fully gapped behaviour. The calculated magnetic moment of Mn atom in the ferromagnetic (3.70 $\mu_{B}$) and antiferromagnetic (3.57 $\mu_{B}$) states are consistent with experimental values. Our calculation predicts potential application of $\textrm{CuMnO}_{2}$ in spintronic devices especially in the ferromagnetic state, as a spin injector for spin valves in spintronic devices.


title: Demystifying the Compression of Mixture-of-Experts Through a Unified Framework

abstract: Scaling large language models has revolutionized the performance across diverse domains, yet the continual growth in model size poses significant challenges for real-world deployment. The Mixture of Experts (MoE) approach addresses this by dynamically selecting and activating only a subset of experts, significantly reducing computational costs while maintaining high performance. However, MoE introduces potential redundancy (e.g., parameters) and extra costs (e.g., communication overhead). Despite numerous compression techniques developed for mitigating the redundancy in dense models, the compression of MoE remains under-explored. We first bridge this gap with a cutting-edge unified framework that not only seamlessly integrates mainstream compression methods but also helps systematically understand MoE compression. This framework approaches compression from two perspectives: Expert Slimming which compresses individual experts and Expert Trimming which removes structured modules. Within this framework, we explore the optimization space unexplored by existing methods,and further introduce aggressive Expert Trimming techniques, i.e., Layer Drop and Block Drop, to eliminate redundancy at larger scales. Based on these insights,we present a comprehensive recipe to guide practitioners in compressing MoE effectively. Extensive experimental results demonstrate the effectiveness of the compression methods under our framework and the proposed recipe, achieving a 6.05x speedup and only 20.0GB memory usage while maintaining over 92% of performance on Mixtral-8x7B. Code is released at \url{https://github.com/DaizeDong/Unified-MoE-Compression}.


title: The computational power of random quantum circuits in arbitrary geometries

abstract: Empirical evidence for a gap between the computational powers of classical and quantum computers has been provided by experiments that sample the output distributions of two-dimensional quantum circuits. Many attempts to close this gap have utilized classical simulations based on tensor network techniques, and their limitations shed light on the improvements to quantum hardware required to frustrate classical simulability. In particular, quantum computers having in excess of $\sim 50$ qubits are primarily vulnerable to classical simulation due to restrictions on their gate fidelity and their connectivity, the latter determining how many gates are required (and therefore how much infidelity is suffered) in generating highly-entangled states. Here, we describe recent hardware upgrades to Quantinuum's H2 quantum computer enabling it to operate on up to $56$ qubits with arbitrary connectivity and $99.843(5)\%$ two-qubit gate fidelity. Utilizing the flexible connectivity of H2, we present data from random circuit sampling in highly connected geometries, doing so at unprecedented fidelities and a scale that appears to be beyond the capabilities of state-of-the-art classical algorithms. The considerable difficulty of classically simulating H2 is likely limited only by qubit number, demonstrating the promise and scalability of the QCCD architecture as continued progress is made towards building larger machines.


title: Singular Subspace Perturbation Bounds via Rectangular Random Matrix Diffusions

abstract: Given a matrix $A \in \mathbb{R}^{m\times d}$ with singular values $\sigma_1\geq \cdots \geq \sigma_d$, and a random matrix $G \in \mathbb{R}^{m\times d}$ with iid $N(0,T)$ entries for some $T>0$, we derive new bounds on the Frobenius distance between subspaces spanned by the top-$k$ (right) singular vectors of $A$ and $A+G$. This problem arises in numerous applications in statistics where a data matrix may be corrupted by Gaussian noise, and in the analysis of the Gaussian mechanism in differential privacy, where Gaussian noise is added to data to preserve private information. We show that, for matrices $A$ where the gaps in the top-$k$ singular values are roughly $\Omega(\sigma_k-\sigma_{k+1})$ the expected Frobenius distance between the subspaces is $\tilde{O}(\frac{\sqrt{d}}{\sigma_k-\sigma_{k+1}} \times \sqrt{T})$, improving on previous bounds by a factor of $\frac{\sqrt{m}}{\sqrt{d}} \sqrt{k}$. To obtain our bounds we view the perturbation to the singular vectors as a diffusion process -- the Dyson-Bessel process -- and use tools from stochastic calculus to track the evolution of the subspace spanned by the top-$k$ singular vectors.

categories: math.ST cs.DS cs.NA math.NA math.PR stat.TH


title: Atomicity in integral domains

abstract: In algebra, atomicity is the study of divisibility by and factorizations into atoms (also called irreducibles). In one side of the spectrum of atomicity we find the antimatter algebraic structures, inside which there are no atoms and, therefore, divisibility by and factorizations into atoms are not possible. In the other (more interesting) side of the spectrum, we find the atomic algebraic structures, where essentially every element factors into atoms (the study of such objects is known as factorization theory). In this paper, we survey some of the most fundamental results on the atomicity of cancellative commutative monoids and integral domains, putting our emphasis on the latter. We mostly consider the realm of atomic domains. For integral domains, the distinction between being atomic and satisfying the ascending chain condition on principal ideals, or ACCP for short (which is a stronger and better-behaved algebraic condition) is subtle, so atomicity has been often studied in connection with the ACCP: we consider this connection at many parts of this survey. We discuss atomicity under various classical algebraic constructions, including localization, polynomial extensions, $D+M$ constructions, and monoid algebras. Integral domains having all their subrings atomic are also discussed. In the last section, we explore the middle ground of the spectrum of atomicity: some integral domains where some of but not all the elements factor into atoms, which are called quasi-atomic and almost atomic. We conclude providing techniques from homological algebra to measure how far quasi-atomic and almost atomic domains are from being atomic.


title: Towards an optimal marked correlation function analysis for the detection of modified gravity

abstract: Modified gravity (MG) theories have emerged as a promising alternative to explain the late-time acceleration of the Universe. However, the detection of MG in observations of the large-scale structure remains challenging due to the screening mechanisms that obscure any deviations from General Relativity (GR) in high-density regions. The marked two-point correlation function offers a promising approach to potentially detect MG signals. This work investigates novel marks based on large-scale environment estimates but also that exploit the anti-correlation between objects in low- and high-density regions. This is the first time discreteness effects in density-dependent marked correlation functions are investigated in depth. We assess the performance of various marks to distinguish GR from MG by using the ELEPHANT simulations, comprised of realisations of GR as well as $f(R)$ and nDGP gravity. In addition, discreteness effects are studied using the high-density Covmos catalogues. We establish a robust method to correct for shot-noise effects that allows the recovery of the true signal with an accuracy below $5\%$ over a wide range of scales. We find such correction to be crucial to measure the amplitude of the marked correlation function in an unbiased manner. Furthermore, we demonstrate that marks, anti-correlating objects in low- and high-density regions, are among the most effective in distinguishing between MG and GR. We report differences in the marked correlation function between $f(R)$ with $|f_{R0}|=10^{-6}$ and GR simulations of the order of 3-5$\sigma$ in real space up to scales of about $80\, h^{-1} \, {\rm Mpc}$. The redshift-space monopole exhibits similar features and performances. The combination of the proposed $\tanh$-mark with shot-noise correction paves the way towards an optimal approach for the detection of MG in current and future galaxy spectroscopic surveys.


title: Tensor Network Space-Time Spectral Collocation Method for Solving the Nonlinear Convection Diffusion Equation

abstract: Spectral methods provide highly accurate numerical solutions for partial differential equations, exhibiting exponential convergence with the number of spectral nodes. Traditionally, in addressing time-dependent nonlinear problems, attention has been on low-order finite difference schemes for time discretization and spectral element schemes for spatial variables. However, our recent developments have resulted in the application of spectral methods to both space and time variables, preserving spectral convergence in both domains. Leveraging Tensor Train techniques, our approach tackles the curse of dimensionality inherent in space-time methods. Here, we extend this methodology to the nonlinear time-dependent convection-diffusion equation. Our discretization scheme exhibits a low-rank structure, facilitating translation to tensor-train (TT) format. Nevertheless, controlling the TT-rank across Newton's iterations, needed to deal with the nonlinearity, poses a challenge, leading us to devise the "Step Truncation TT-Newton" method. We demonstrate the exponential convergence of our methods through various benchmark examples. Importantly, our scheme offers significantly reduced memory requirement compared to the full-grid scheme.


title: An Open-Source Tool for Mapping War Destruction at Scale in Ukraine using Sentinel-1 Time Series

abstract: Access to detailed war impact assessments is crucial for humanitarian organizations to effectively assist populations most affected by armed conflicts. However, maintaining a comprehensive understanding of the situation on the ground is challenging, especially in conflicts that cover vast territories and extend over long periods. This study presents a scalable and transferable method for estimating war-induced damage to buildings. We first train a machine learning model to output pixel-wise probability of destruction from Synthetic Aperture Radar (SAR) satellite image time series, leveraging existing, manual damage assessments as ground truth and cloud-based geospatial analysis tools for large-scale inference. We further post-process these assessments using open building footprints to obtain a final damage estimate per building. We introduce an accessible, open-source tool that allows users to adjust the confidence interval based on their specific requirements and use cases. Our approach enables humanitarian organizations and other actors to rapidly screen large geographic regions for war impacts. We provide two publicly accessible dashboards: a Ukraine Damage Explorer to dynamically view our pre-computed estimates, and a Rapid Damage Mapping Tool to easily run our method and produce custom maps.


title: Guiding a Diffusion Model with a Bad Version of Itself

abstract: The primary axes of interest in image-generating diffusion models are image quality, the amount of variation in the results, and how well the results align with a given condition, e.g., a class label or a text prompt. The popular classifier-free guidance approach uses an unconditional model to guide a conditional model, leading to simultaneously better prompt alignment and higher-quality images at the cost of reduced variation. These effects seem inherently entangled, and thus hard to control. We make the surprising observation that it is possible to obtain disentangled control over image quality without compromising the amount of variation by guiding generation using a smaller, less-trained version of the model itself rather than an unconditional model. This leads to significant improvements in ImageNet generation, setting record FIDs of 1.01 for 64x64 and 1.25 for 512x512, using publicly available networks. Furthermore, the method is also applicable to unconditional diffusion models, drastically improving their quality.


title: Radial canonical AdS$_3$ gravity and $T\bar{T}$

abstract: We employ an ADM deparametrization strategy to discuss the radial canonical formalism of asymptotically AdS$_3$ gravity. It leads to the identification of a radial 'time' before quantization, which is the volume time, canonically conjugate to York time. Holographically, this allows to interpret the semi-classical path integral of $T\bar T$ theory as a Schr\"odinger wavefunctional satisfying a Schr\"odinger evolution equation in volume time, and the $T\bar T$ operator expectation value in terms of the Hamiltonian that generates volume time translations -- both consistent with cut-off holography. We make use of the canonical perspective to construct the rotating BTZ solution from the Hamilton-Jacobi equation, with a finite cut-off energy spectrum that has a known holographic $T\bar T$ interpretation, as well as semi-classical Wheeler-DeWitt states for that solution.


title: CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation

abstract: Recently video diffusion models have emerged as expressive generative tools for high-quality video content creation readily available to general users. However, these models often do not offer precise control over camera poses for video generation, limiting the expression of cinematic language and user control. To address this issue, we introduce CamCo, which allows fine-grained Camera pose Control for image-to-video generation. We equip a pre-trained image-to-video generator with accurately parameterized camera pose input using Pl\"ucker coordinates. To enhance 3D consistency in the videos produced, we integrate an epipolar attention module in each attention block that enforces epipolar constraints to the feature maps. Additionally, we fine-tune CamCo on real-world videos with camera poses estimated through structure-from-motion algorithms to better synthesize object motion. Our experiments show that CamCo significantly improves 3D consistency and camera control capabilities compared to previous models while effectively generating plausible object motion. Project page: https://ir1d.github.io/CamCo/


title: Fairness-Optimized Synthetic EHR Generation for Arbitrary Downstream Predictive Tasks

abstract: Among various aspects of ensuring the responsible design of AI tools for healthcare applications, addressing fairness concerns has been a key focus area. Specifically, given the wide spread of electronic health record (EHR) data and their huge potential to inform a wide range of clinical decision support tasks, improving fairness in this category of health AI tools is of key importance. While such a broad problem (that is, mitigating fairness in EHR-based AI models) has been tackled using various methods, task- and model-agnostic methods are noticeably rare. In this study, we aimed to target this gap by presenting a new pipeline that generates synthetic EHR data, which is not only consistent with (faithful to) the real EHR data but also can reduce the fairness concerns (defined by the end-user) in the downstream tasks, when combined with the real data. We demonstrate the effectiveness of our proposed pipeline across various downstream tasks and two different EHR datasets. Our proposed pipeline can add a widely applicable and complementary tool to the existing toolbox of methods to address fairness in health AI applications such as those modifying the design of a downstream model. The codebase for our project is available at https://github.com/healthylaife/FairSynth


title: V-Express: Conditional Dropout for Progressive Training of Portrait Video Generation

abstract: In the field of portrait video generation, the use of single images to generate portrait videos has become increasingly prevalent. A common approach involves leveraging generative models to enhance adapters for controlled generation. However, control signals (e.g., text, audio, reference image, pose, depth map, etc.) can vary in strength. Among these, weaker conditions often struggle to be effective due to interference from stronger conditions, posing a challenge in balancing these conditions. In our work on portrait video generation, we identified audio signals as particularly weak, often overshadowed by stronger signals such as facial pose and reference image. However, direct training with weak signals often leads to difficulties in convergence. To address this, we propose V-Express, a simple method that balances different control signals through the progressive training and the conditional dropout operation. Our method gradually enables effective control by weak conditions, thereby achieving generation capabilities that simultaneously take into account the facial pose, reference image, and audio. The experimental results demonstrate that our method can effectively generate portrait videos controlled by audio. Furthermore, a potential solution is provided for the simultaneous and effective use of conditions of varying strengths.


title: Existence, Uniqueness and Asymptotic Dynamics of Nonlinear Schr\"odinger Equations With Quasi-Periodic Initial Data: II. The Derivative NLS

abstract: This is the second part of a two-paper series studying the nonlinear Schr\"odinger equation with quasi-periodic initial data. In this paper, we focus on the quasi-periodic Cauchy problem for the derivative nonlinear Schr\"odinger equation. Under the assumption that the Fourier coefficients of the initial data obey an exponential upper bound, we establish local existence of a solution that retains quasi-periodicity in space with a slightly weaker Fourier decay. Moreover, the solution is shown to be unique within this class of quasi-periodic functions. Also, we prove that, for the derivative nonlinear Schr\"odinger equation in a weakly nonlinear setting, within the time scale, as the small parameter of nonlinearity tends to zero, the nonlinear solution converges asymptotically to the linear solution in the sense of both sup-norm and analytic Sobolev-norm. The proof proceeds via a consideration of an associated infinite system of coupled ordinary differential equations for the Fourier coefficients and an explicit combinatorial analysis for the Picard iteration with the help of Feynman diagrams and the power of $\ast^{[\cdot]}$ labelling the complex conjugate.


title: Transient infrared nanoscopy resolves the millisecond photoswitching dynamics of single lipid vesicles in water

abstract: Understanding the biophysical and biochemical properties of molecular nanocarriers under physiological conditions and with minimal interference is crucial for advancing nanomedicine, photopharmacology, drug delivery, nanotheranostics and synthetic biology. Yet, analytical methods struggle to combine precise chemical imaging and measurements without perturbative labeling. This challenge is exemplified for azobenzene-based photoswitchable lipids, which are intriguing reagents for controlling nanocarrier properties on fast timescales, enabling, e.g., precise light-induced drug release processes. Here, we leverage the chemical recognition and high spatio-temporal resolution of scattering-type scanning near-field optical microscopy (s-SNOM) to demonstrate non-destructive, label-free mid-infrared (MIR) imaging and spectroscopy of photoswitchable liposomes below the diffraction limit and the tracking of their dynamics down to 50 ms resolution. The vesicles are adsorbed on an ultrathin 10-nm SiN membrane, which separates the sample space from the tip space for stable and hour-long observations. By implementing a transient nanoscopy approach, we accurately resolve, for the first time, photoinduced changes in both the shape and the MIR spectral signature of individual vesicles and reveal abrupt change dynamics of the underlying photoisomerization process. Our findings highlight the methods potential for future studies on the complex dynamics of unlabeled nanoscale soft matter, as well as, in a broader context, for host-guest systems, energy materials or drugs.


title: Approximate path decompositions of regular graphs

abstract: We show that the edges of any $d$-regular graph can be almost decomposed into paths of length roughly $d$, giving an approximate solution to a problem of Kotzig from 1957. Along the way, we show that almost all of the vertices of a $d$-regular graph can be partitioned into $n/(d+1)$ paths, asymptotically confirming a conjecture of Magnant and Martin from 2009.


title: Uncertainty of Joint Neural Contextual Bandit

abstract: Contextual bandit learning is increasingly favored in modern large-scale recommendation systems. To better utlize the contextual information and available user or item features, the integration of neural networks have been introduced to enhance contextual bandit learning and has triggered significant interest from both academia and industry. However, a major challenge arises when implementing a disjoint neural contextual bandit solution in large-scale recommendation systems, where each item or user may correspond to a separate bandit arm. The huge number of items to recommend poses a significant hurdle for real world production deployment. This paper focuses on a joint neural contextual bandit solution which serves all recommending items in one single model. The output consists of a predicted reward $\mu$, an uncertainty $\sigma$ and a hyper-parameter $\alpha$ which balances exploitation and exploration, e.g., $\mu + \alpha \sigma$. The tuning of the parameter $\alpha$ is typically heuristic and complex in practice due to its stochastic nature. To address this challenge, we provide both theoretical analysis and experimental findings regarding the uncertainty $\sigma$ of the joint neural contextual bandit model. Our analysis reveals that $\alpha$ demonstrates an approximate square root relationship with the size of the last hidden layer $F$ and inverse square root relationship with the amount of training data $N$, i.e., $\sigma \propto \sqrt{\frac{F}{N}}$. The experiments, conducted with real industrial data, align with the theoretical analysis, help understanding model behaviors and assist the hyper-parameter tuning during both offline training and online deployment.


title: Bottom spectrum of three-dimensional manifolds with scalar curvature lower bound

abstract: A classical result of Cheng states that the bottom spectrum of complete manifolds of fixed dimension and Ricci curvature lower bound achieves its maximal value on the corresponding hyperbolic space. The paper establishes an analogous result for three-dimensional complete manifolds with scalar curvature lower bound subject to some necessary topological assumptions. The rigidity issue is also addressed and a splitting theorem is obtained for such manifolds with the maximal bottom spectrum.


title: Deterministic Reversible Data Augmentation for Neural Machine Translation

abstract: Data augmentation is an effective way to diversify corpora in machine translation, but previous methods may introduce semantic inconsistency between original and augmented data because of irreversible operations and random subword sampling procedures. To generate both symbolically diverse and semantically consistent augmentation data, we propose Deterministic Reversible Data Augmentation (DRDA), a simple but effective data augmentation method for neural machine translation. DRDA adopts deterministic segmentations and reversible operations to generate multi-granularity subword representations and pulls them closer together with multi-view techniques. With no extra corpora or model changes required, DRDA outperforms strong baselines on several translation tasks with a clear margin (up to 4.3 BLEU gain over Transformer) and exhibits good robustness in noisy, low-resource, and cross-domain datasets.


title: DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Rendering

abstract: Digitally reconstructed radiographs (DRRs) are simulated 2D X-ray images generated from 3D CT volumes, widely used in preoperative settings but limited in intraoperative applications due to computational bottlenecks, especially for accurate but heavy physics-based Monte Carlo methods. While analytical DRR renderers offer greater efficiency, they overlook anisotropic X-ray image formation phenomena, such as Compton scattering. We present a novel approach that marries realistic physics-inspired X-ray simulation with efficient, differentiable DRR generation using 3D Gaussian splatting (3DGS). Our direction-disentangled 3DGS (DDGS) method separates the radiosity contribution into isotropic and direction-dependent components, approximating complex anisotropic interactions without intricate runtime simulations. Additionally, we adapt the 3DGS initialization to account for tomography data properties, enhancing accuracy and efficiency. Our method outperforms state-of-the-art techniques in image accuracy. Furthermore, our DDGS shows promise for intraoperative applications and inverse problems such as pose registration, delivering superior registration accuracy and runtime performance compared to analytical DRR methods.


title: The space of immersed polygons

abstract: We use the Schwarz-Christoffel formula to show that for every $n\geq 3$, the space of labelled immersed $n$-gons in the plane up to similarity is homeomorphic to $\mathbb{R}^{2n-4}$. We then prove that all immersed triangles, quadrilaterals, and pentagons are embedded, from which it follows that the space of labelled simple $n$-gons up to similarity is homeomorphic to $\mathbb{R}^{2n-4}$ if $n\in \{3,4,5\}$. This was first shown by Gonz\'ales and L\'opez-L\'opez for $n=4$ and conjectured to be true for every $n\geq 5$ by Gonz\'alez and Sedano-Mendoza.


title: Digital Privacy for Migrants: Exploring Current Research Trends and Future Prospects

abstract: This paper explores digital privacy challenges for migrants, analyzing trends from 2013 to 2023. Migrants face heightened risks such as government surveillance and identity theft. Understanding these threats is vital for raising awareness and guiding research towards effective solutions and policies to protect migrant digital privacy.


title: Superconducting magic-angle twisted trilayer graphene hosts competing magnetic order and moir\'e inhomogeneities

abstract: The microscopic mechanism of superconductivity in the magic-angle twisted graphene family, including magic-angle twisted trilayer graphene (MATTG), is poorly understood. Properties of MATTG, like Pauli limit violation, suggest unconventional superconductivity. Theoretical studies propose proximal magnetic states in the phase diagram, but direct experimental evidence is lacking. We show direct evidence for an in-plane magnetic order proximal to the superconducting state using two complementary electrical transport measurements. First, we probe the superconducting phase by using statistically significant switching events from superconducting to the dissipative state of MATTG. The system behaves like a network of Josephson junctions due to lattice relaxation-induced moir\'e inhomogeneity in the system. We observe non-monotonic and hysteretic responses in the switching distributions as a function of temperature and in-plane magnetic field. Second, in normal regions doped slightly away from the superconducting regime, we observe hysteresis in magnetoresistance with an in-plane magnetic field; showing evidence for in-plane magnetic order that vanishes $\sim$900 mK. Additionally, we show a broadened Berezinskii-Kosterlitz-Thouless transition due to relaxation-induced moir\'e inhomogeneity. We find superfluid stiffness $J_{\mathrm{s}}$$\sim$0.15 K with strong temperature dependence. Theoretically, the magnetic and superconducting order arising from the magnetic order's fluctuations have been proposed - we show direct evidence for both. Our observation that the hysteretic magnetoresistance is sensitive to the in-plane field may constrain possible intervalley-coherent magnetic orders and the resulting superconductivity that arises from its fluctuations.


title: Lichen-Mediated Self-Growing Construction Materials for Habitat Outfitting on Mars

abstract: As its next step in space exploration, the National Aeronautics and Space Administration (NASA) revealed plans to establish a permanent human presence on Mars. Habitat outfitting, i.e., the technology to provide the crew with the necessary equipment to perform mission tasks as well as a comfortable, safe, and livable habitable volume, has not been fully explored yet. This study proposes that, rather than shipping prefabricated outfitting elements to Mars, habitat outfitting can be realized by in-situ construction using cyanobacteria and fungi as building agents. A synthetic lichen system, composed of diazotrophic cyanobacteria and filamentous fungi, can be created to produce abundant biominerals (CaCO3) and biopolymers, which will glue Martian regolith into consolidated building blocks. These self-growing building blocks can be assembled into various structures, such as floors, walls, partitions, and furniture.

categories: q-bio.CB astro-ph.EP astro-ph.IM physics.pop-ph


title: RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots

abstract: Recent advancements in Artificial Intelligence (AI) have largely been propelled by scaling. In Robotics, scaling is hindered by the lack of access to massive robot datasets. We advocate using realistic physical simulation as a means to scale environments, tasks, and datasets for robot learning methods. We present RoboCasa, a large-scale simulation framework for training generalist robots in everyday environments. RoboCasa features realistic and diverse scenes focusing on kitchen environments. We provide thousands of 3D assets across over 150 object categories and dozens of interactable furniture and appliances. We enrich the realism and diversity of our simulation with generative AI tools, such as object assets from text-to-3D models and environment textures from text-to-image models. We design a set of 100 tasks for systematic evaluation, including composite tasks generated by the guidance of large language models. To facilitate learning, we provide high-quality human demonstrations and integrate automated trajectory generation methods to substantially enlarge our datasets with minimal human burden. Our experiments show a clear scaling trend in using synthetically generated robot data for large-scale imitation learning and show great promise in harnessing simulation data in real-world tasks. Videos and open-source code are available at https://robocasa.ai/


title: CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks

abstract: Large Language Models (LLMs) are revolutionizing various domains, yet verifying their answers remains a significant challenge, especially for intricate open-ended tasks such as consolidation, summarization, and extraction of knowledge. In this work, we propose CheckEmbed: an accurate, scalable, and simple LLM verification approach. CheckEmbed is driven by a straightforward yet powerful idea: in order to compare LLM solutions to one another or to the ground-truth, compare their corresponding answer-level embeddings obtained with a model such as GPT Text Embedding Large. This reduces a complex textual answer to a single embedding, facilitating straightforward, fast, and meaningful verification. We develop a comprehensive verification pipeline implementing the CheckEmbed methodology. The CheckEmbed pipeline also comes with metrics for assessing the truthfulness of the LLM answers, such as embedding heatmaps and their summaries. We show how to use these metrics for deploying practical engines that decide whether an LLM answer is satisfactory or not. We apply the pipeline to real-world document analysis tasks, including term extraction and document summarization, showcasing significant improvements in accuracy, cost-effectiveness, and runtime performance compared to existing token-, sentence-, and fact-level schemes such as BERTScore or SelfCheckGPT.


title: The Impact of Acquisition on Product Quality in the Console Gaming Industry

abstract: The console gaming industry, a dominant force in the global entertainment sector, has witnessed a wave of consolidation in recent years, epitomized by Microsoft's high-profile acquisitions of Activision Blizzard and Zenimax. This study investigates the repercussions of such mergers on consumer welfare and innovation within the gaming landscape, focusing on product quality as a key metric. Through a comprehensive analysis employing a difference-in-difference model, the research evaluates the effects of acquisition on game review ratings, drawing from a dataset comprising over 16,000 console games released between 2000 and 2023. The research addresses key assumptions underlying the difference-in-difference methodology, including parallel trends and spillover effects, to ensure the robustness of the findings. The DID results suggest a positive and statistically significant impact of acquisition on game review ratings, when controlling for genre and release year. The study contributes to the literature by offering empirical evidence on the direct consequences of industry consolidation on consumer welfare and competition dynamics within the gaming sector.


title: Homotopy similarity of maps. Maps of the circle

abstract: We describe the relation of $r$-similarity and finite-order invariants on the homotopy set $[S^1,Y]=\pi_1(Y)$.


title: Non-holomorphic modular flavor symmetry

abstract: The formalism of non-holomorphic modular flavor symmetry is developed, and the Yukawa couplings are level $N$ polyharmonic Maa{\ss} forms satisfying the Laplacian condition. We find that the integer (even) weight polyharmonic Maa{\ss} forms of level $N$ can be decomposed into multiplets of the finite modular group $\Gamma'_N$ ($\Gamma_N$). The original modular invariance approach is extended by the presence of negative weight polyharmonic Maa{\ss} forms. The non-holomorphic modular flavor symmetry can be consistently combined with the generalized CP symmetry. We present three example models for lepton sector based on the $\Gamma_3\cong A_4$ modular symmetry, the charged lepton masses and the neutrino oscillation data can be accommodated very well, and the predictions for the leptonic CP violation phases and the effective Majorana neutrino mass are studied.


title: Scalable MatMul-free Language Modeling

abstract: Matrix multiplication (MatMul) typically dominates the overall computational cost of large language models (LLMs). This cost only grows as LLMs scale to larger embedding dimensions and context lengths. In this work, we show that MatMul operations can be completely eliminated from LLMs while maintaining strong performance at billion-parameter scales. Our experiments show that our proposed MatMul-free models achieve performance on-par with state-of-the-art Transformers that require far more memory during inference at a scale up to at least 2.7B parameters. We investigate the scaling laws and find that the performance gap between our MatMul-free models and full precision Transformers narrows as the model size increases. We also provide a GPU-efficient implementation of this model which reduces memory usage by up to 61% over an unoptimized baseline during training. By utilizing an optimized kernel during inference, our model's memory consumption can be reduced by more than 10x compared to unoptimized models. To properly quantify the efficiency of our architecture, we build a custom hardware solution on an FPGA which exploits lightweight operations beyond what GPUs are capable of. We processed billion-parameter scale models at 13W beyond human readable throughput, moving LLMs closer to brain-like efficiency. This work not only shows how far LLMs can be stripped back while still performing effectively, but also points at the types of operations future accelerators should be optimized for in processing the next generation of lightweight LLMs. Our code implementation is available at https://github.com/ridgerchu/matmulfreellm.


title: ReLUs Are Sufficient for Learning Implicit Neural Representations

abstract: Motivated by the growing theoretical understanding of neural networks that employ the Rectified Linear Unit (ReLU) as their activation function, we revisit the use of ReLU activation functions for learning implicit neural representations (INRs). Inspired by second order B-spline wavelets, we incorporate a set of simple constraints to the ReLU neurons in each layer of a deep neural network (DNN) to remedy the spectral bias. This in turn enables its use for various INR tasks. Empirically, we demonstrate that, contrary to popular belief, one can learn state-of-the-art INRs based on a DNN composed of only ReLU neurons. Next, by leveraging recent theoretical works which characterize the kinds of functions ReLU neural networks learn, we provide a way to quantify the regularity of the learned function. This offers a principled approach to selecting the hyperparameters in INR architectures. We substantiate our claims through experiments in signal representation, super resolution, and computed tomography, demonstrating the versatility and effectiveness of our method. The code for all experiments can be found at https://github.com/joeshenouda/relu-inrs.


title: LongBet: Heterogeneous Treatment Effect Estimation in Panel Data

abstract: This paper introduces a novel approach for estimating heterogeneous treatment effects of binary treatment in panel data, particularly focusing on short panel data with large cross-sectional data and observed confoundings. In contrast to traditional literature in difference-in-differences method that often relies on the parallel trend assumption, our proposed model does not necessitate such an assumption. Instead, it leverages observed confoundings to impute potential outcomes and identify treatment effects. The method presented is a Bayesian semi-parametric approach based on the Bayesian causal forest model, which is extended here to suit panel data settings. The approach offers the advantage of the Bayesian approach to provides uncertainty quantification on the estimates. Simulation studies demonstrate its performance with and without the presence of parallel trend. Additionally, our proposed model enables the estimation of conditional average treatment effects, a capability that is rarely available in panel data settings.


title: Hybrid inflation and gravitational waves from accidentally light scalars

abstract: We construct a hybrid-inflation model where the inflaton potential is generated radiatively, as gauge symmetries guarantee it to be accidentally flat at tree level. The model can be regarded as a small-field version of Natural Inflation, with inflation ending when the mass of a second scalar, the waterfall field, turns tachyonic. This provides a minimal, robust realisation of hybrid inflation, which predicts specific correlations among CMB observables. Tachyonic preheating leads to the production of gravitational waves which, for a low inflationary scale, might be detected by upcoming experiments. Simple variations of the model can give rise to topological defects, such as unstable domain walls. Their dynamics produces a stochastic gravitational-wave background, which can be compatible with the recent detection by pulsar timing arrays.


title: SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices

abstract: As large language models gain widespread adoption, running them efficiently becomes crucial. Recent works on LLM inference use speculative decoding to achieve extreme speedups. However, most of these works implicitly design their algorithms for high-end datacenter hardware. In this work, we ask the opposite question: how fast can we run LLMs on consumer machines? Consumer GPUs can no longer fit the largest available models (50B+ parameters) and must offload them to RAM or SSD. When running with offloaded parameters, the inference engine can process batches of hundreds or thousands of tokens at the same time as just one token, making it a natural fit for speculative decoding. We propose SpecExec (Speculative Execution), a simple parallel decoding method that can generate up to 20 tokens per target model iteration for popular LLM families. It utilizes the high spikiness of the token probabilities distribution in modern LLMs and a high degree of alignment between model output probabilities. SpecExec takes the most probable tokens continuation from the draft model to build a "cache" tree for the target model, which then gets validated in a single pass. Using SpecExec, we demonstrate inference of 50B+ parameter LLMs on consumer GPUs with RAM offloading at 4-6 tokens per second with 4-bit quantization or 2-3 tokens per second with 16-bit weights.


title: SatSplatYOLO: 3D Gaussian Splatting-based Virtual Object Detection Ensembles for Satellite Feature Recognition

abstract: On-orbit servicing (OOS), inspection of spacecraft, and active debris removal (ADR). Such missions require precise rendezvous and proximity operations in the vicinity of non-cooperative, possibly unknown, resident space objects. Safety concerns with manned missions and lag times with ground-based control necessitate complete autonomy. In this article, we present an approach for mapping geometries and high-confidence detection of components of unknown, non-cooperative satellites on orbit. We implement accelerated 3D Gaussian splatting to learn a 3D representation of the satellite, render virtual views of the target, and ensemble the YOLOv5 object detector over the virtual views, resulting in reliable, accurate, and precise satellite component detections. The full pipeline capable of running on-board and stand to enable downstream machine intelligence tasks necessary for autonomous guidance, navigation, and control tasks.


title: Enhancing predictive imaging biomarker discovery through treatment effect analysis

abstract: Identifying predictive biomarkers, which forecast individual treatment effectiveness, is crucial for personalized medicine and informs decision-making across diverse disciplines. These biomarkers are extracted from pre-treatment data, often within randomized controlled trials, and have to be distinguished from prognostic biomarkers, which are independent of treatment assignment. Our study focuses on the discovery of predictive imaging biomarkers, aiming to leverage pre-treatment images to unveil new causal relationships. Previous approaches relied on labor-intensive handcrafted or manually derived features, which may introduce biases. In response, we present a new task of discovering predictive imaging biomarkers directly from the pre-treatment images to learn relevant image features. We propose an evaluation protocol for this task to assess a model's ability to identify predictive imaging biomarkers and differentiate them from prognostic ones. It employs statistical testing and a comprehensive analysis of image feature attribution. We explore the suitability of deep learning models originally designed for estimating the conditional average treatment effect (CATE) for this task, which previously have been primarily assessed for the precision of CATE estimation, overlooking the evaluation of imaging biomarker discovery. Our proof-of-concept analysis demonstrates promising results in discovering and validating predictive imaging biomarkers from synthetic outcomes and real-world image datasets.


title: Enhancing 2D Representation Learning with a 3D Prior

abstract: Learning robust and effective representations of visual data is a fundamental task in computer vision. Traditionally, this is achieved by training models with labeled data which can be expensive to obtain. Self-supervised learning attempts to circumvent the requirement for labeled data by learning representations from raw unlabeled visual data alone. However, unlike humans who obtain rich 3D information from their binocular vision and through motion, the majority of current self-supervised methods are tasked with learning from monocular 2D image collections. This is noteworthy as it has been demonstrated that shape-centric visual processing is more robust compared to texture-biased automated methods. Inspired by this, we propose a new approach for strengthening existing self-supervised methods by explicitly enforcing a strong 3D structural prior directly into the model during training. Through experiments, across a range of datasets, we demonstrate that our 3D aware representations are more robust compared to conventional self-supervised baselines.


title: Mitigate Position Bias in Large Language Models via Scaling a Single Dimension

abstract: Large Language Models (LLMs) are increasingly applied in various real-world scenarios due to their excellent generalization capabilities and robust generative abilities. However, they exhibit position bias, also known as "lost in the middle", a phenomenon that is especially pronounced in long-context scenarios, which indicates the placement of the key information in different positions of a prompt can significantly affect accuracy. This paper first explores the micro-level manifestations of position bias, concluding that attention weights are a micro-level expression of position bias. It further identifies that, in addition to position embeddings, causal attention mask also contributes to position bias by creating position-specific hidden states. Based on these insights, we propose a method to mitigate position bias by scaling this positional hidden states. Experiments on the NaturalQuestions Multi-document QA, KV retrieval, LongBench and timeline reorder tasks, using various models including RoPE models, context windowextended models, and Alibi models, demonstrate the effectiveness and generalizability of our approach. Our method can improve performance by up to 15.2% by modifying just one dimension of hidden states. Our code is available at https://aka.ms/PositionalHidden.


title: TopViewRS: Vision-Language Models as Top-View Spatial Reasoners

abstract: Top-view perspective denotes a typical way in which humans read and reason over different types of maps, and it is vital for localization and navigation of humans as well as of `non-human' agents, such as the ones backed by large Vision-Language Models (VLMs). Nonetheless, spatial reasoning capabilities of modern VLMs remain unattested and underexplored. In this work, we thus study their capability to understand and reason over spatial relations from the top view. The focus on top view also enables controlled evaluations at different granularity of spatial reasoning; we clearly disentangle different abilities (e.g., recognizing particular objects versus understanding their relative positions). We introduce the TopViewRS (Top-View Reasoning in Space) dataset, consisting of 11,384 multiple-choice questions with either realistic or semantic top-view map as visual input. We then use it to study and evaluate VLMs across 4 perception and reasoning tasks with different levels of complexity. Evaluation of 10 representative open- and closed-source VLMs reveals the gap of more than 50% compared to average human performance, and it is even lower than the random baseline in some cases. Although additional experiments show that Chain-of-Thought reasoning can boost model capabilities by 5.82% on average, the overall performance of VLMs remains limited. Our findings underscore the critical need for enhanced model capability in top-view spatial reasoning and set a foundation for further research towards human-level proficiency of VLMs in real-world multimodal tasks.


title: Helimagnetism in CrBr$_2$ and CrIBr

abstract: In CrX$_2$ (X=Br, I), a Jahn-Teller effect distorts the octahedral configuration of the anions about Cr, resulting in a "ribbon chain" structure. We previously observed helimagnetism in CrI$_2$ propagating along the ribbon chains, with an 80-90$^{\circ}$ rotation per Cr ion. Via neutron scattering, we report that CrBr$_2$ and the solid solution CrIBr are also helimagnetic, with N\'{e}el temperatures of 17 and 12 K, respectively, and signs of intermediate magnetic transitions in both compounds. The helical angle between spins on consecutive Cr ions along the ribbon chains increases with increasing Br substitution, from 89.7$^{\circ}$ (CrI$_2$) to 116$^{\circ}$ (CrIBr) to 147$^{\circ}$ (CrBr$_2$), possibly as a result of decreasing longer-range intrachain spin interactions with the increased electron localization of the lighter anions.


title: Parrot: Multilingual Visual Instruction Tuning

abstract: The rapid development of Multimodal Large Language Models (MLLMs) like GPT-4V has marked a significant step towards artificial general intelligence. Existing methods mainly focus on aligning vision encoders with LLMs through supervised fine-tuning (SFT) to endow LLMs with multimodal abilities, making MLLMs' inherent ability to react to multiple languages progressively deteriorate as the training process evolves. We empirically find that the imbalanced SFT datasets, primarily composed of English-centric image-text pairs, lead to significantly reduced performance in non-English languages. This is due to the failure of aligning the vision encoder and LLM with multilingual tokens during the SFT process. In this paper, we introduce Parrot, a novel method that utilizes textual guidance to drive visual token alignment at the language level. Parrot makes the visual tokens condition on diverse language inputs and uses Mixture-of-Experts (MoE) to promote the alignment of multilingual tokens. Specifically, to enhance non-English visual tokens alignment, we compute the cross-attention using the initial visual features and textual embeddings, the result of which is then fed into the MoE router to select the most relevant experts. The selected experts subsequently convert the initial visual tokens into language-specific visual tokens. Moreover, considering the current lack of benchmarks for evaluating multilingual capabilities within the field, we collect and make available a Massive Multilingual Multimodal Benchmark which includes 6 languages, 15 categories, and 12,000 questions, named as MMMB. Our method not only demonstrates state-of-the-art performance on multilingual MMBench and MMMB, but also excels across a broad range of multimodal tasks. Both the source code and the training dataset of Parrot will be made publicly available.


title: ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation

abstract: Diffusion transformers (DiTs) have exhibited remarkable performance in visual generation tasks, such as generating realistic images or videos based on textual instructions. However, larger model sizes and multi-frame processing for video generation lead to increased computational and memory costs, posing challenges for practical deployment on edge devices. Post-Training Quantization (PTQ) is an effective method for reducing memory costs and computational complexity. When quantizing diffusion transformers, we find that applying existing diffusion quantization methods designed for U-Net faces challenges in preserving quality. After analyzing the major challenges for quantizing diffusion transformers, we design an improved quantization scheme: "ViDiT-Q": Video and Image Diffusion Transformer Quantization) to address these issues. Furthermore, we identify highly sensitive layers and timesteps hinder quantization for lower bit-widths. To tackle this, we improve ViDiT-Q with a novel metric-decoupled mixed-precision quantization method (ViDiT-Q-MP). We validate the effectiveness of ViDiT-Q across a variety of text-to-image and video models. While baseline quantization methods fail at W8A8 and produce unreadable content at W4A8, ViDiT-Q achieves lossless W8A8 quantization. ViDiTQ-MP achieves W4A8 with negligible visual quality degradation, resulting in a 2.5x memory optimization and a 1.5x latency speedup.


title: Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting

abstract: Recent advancements in zero-shot video diffusion models have shown promise for text-driven video editing, but challenges remain in achieving high temporal consistency. To address this, we introduce Video-3DGS, a 3D Gaussian Splatting (3DGS)-based video refiner designed to enhance temporal consistency in zero-shot video editors. Our approach utilizes a two-stage 3D Gaussian optimizing process tailored for editing dynamic monocular videos. In the first stage, Video-3DGS employs an improved version of COLMAP, referred to as MC-COLMAP, which processes original videos using a Masked and Clipped approach. For each video clip, MC-COLMAP generates the point clouds for dynamic foreground objects and complex backgrounds. These point clouds are utilized to initialize two sets of 3D Gaussians (Frg-3DGS and Bkg-3DGS) aiming to represent foreground and background views. Both foreground and background views are then merged with a 2D learnable parameter map to reconstruct full views. In the second stage, we leverage the reconstruction ability developed in the first stage to impose the temporal constraints on the video diffusion model. To demonstrate the efficacy of Video-3DGS on both stages, we conduct extensive experiments across two related tasks: Video Reconstruction and Video Editing. Video-3DGS trained with 3k iterations significantly improves video reconstruction quality (+3 PSNR, +7 PSNR increase) and training efficiency (x1.9, x4.5 times faster) over NeRF-based and 3DGS-based state-of-art methods on DAVIS dataset, respectively. Moreover, it enhances video editing by ensuring temporal consistency across 58 dynamic monocular videos.


title: Loki: Low-Rank Keys for Efficient Sparse Attention

abstract: Inference on large language models can be expensive in terms of the compute and memory costs involved, especially when long sequence lengths are used. In particular, the self-attention mechanism used in such models contributes significantly to these costs, which has resulted in several recent works that propose sparse attention approximations for inference. In this work, we propose to approximate the self-attention computation by focusing on the dimensionality of key vectors computed in the attention block. Our analysis reveals that the key vectors lie in a significantly lower-dimensional space, consistently across several datasets and models. Exploiting this observation, we propose Loki, a novel sparse attention method that ranks and selects tokens in the KV-cache based on attention scores computed in low-dimensional space. Our evaluations show that Loki is able to maintain the efficacy of the models better than other popular approximation methods, while speeding up the attention computation due to reduced data movement (load/store) and compute costs.


title: To Believe or Not to Believe Your LLM

abstract: We explore uncertainty quantification in large language models (LLMs), with the goal to identify when uncertainty in responses given a query is large. We simultaneously consider both epistemic and aleatoric uncertainties, where the former comes from the lack of knowledge about the ground truth (such as about facts or the language), and the latter comes from irreducible randomness (such as multiple possible answers). In particular, we derive an information-theoretic metric that allows to reliably detect when only epistemic uncertainty is large, in which case the output of the model is unreliable. This condition can be computed based solely on the output of the model obtained simply by some special iterative prompting based on the previous responses. Such quantification, for instance, allows to detect hallucinations (cases when epistemic uncertainty is high) in both single- and multi-answer responses. This is in contrast to many standard uncertainty quantification strategies (such as thresholding the log-likelihood of a response) where hallucinations in the multi-answer case cannot be detected. We conduct a series of experiments which demonstrate the advantage of our formulation. Further, our investigations shed some light on how the probabilities assigned to a given output by an LLM can be amplified by iterative prompting, which might be of independent interest.


title: Asymmetry, Gap Opening and High Accretion Rate on DM Tau: A Hypothesis Based on Interaction of Magnetized Disk Wind with Planet

abstract: Over two hundred protoplanetary disk systems have been resolved by ALMA, and the vast majority suggest the presence of planets. The dust gaps in transition disks are considered evidence of giant planets sculpting gas and dust under appropriate disk viscosity. However, the unusually high accretion rates in many T Tauri stars hosting transition disks challenge this theory. As the only disk currently observed with high turbulence, the high accretion rate ($\sim10^{-8.3}M_{\odot}/yr$) observed in DM Tau indicates the presence of strong turbulence may within the system. Considering the recent theoretical advancements in magnetized disk winds is challenging the traditional gap-opening theories and viscosity-driven accretion models, our study presents a pioneering simulation incorporating a simplified magnetized disk wind model to explain the observed features in DM Tau. Employing multi-fluid simulations with an embedded medium mass planet, we successfully replicate the gap formation and asymmetric structures evident in ALMA Band 6 and the recently JVLA 7 mm observations. Our results suggest that when magnetized disk wind dominate the accretion mode of the system, it's entirely possible for a planet with a medium mass to exist within the gap inside 20 au of DM Tau. This means that DM Tau may not be as turbulence as imagined. However, viscosity within the disk should also contribute a few turbulence to maintain disk stability.


title: Robust and highly scalable estimation of directional couplings from time-shifted signals

abstract: The estimation of directed couplings between the nodes of a network from indirect measurements is a central methodological challenge in scientific fields such as neuroscience, systems biology and economics. Unfortunately, the problem is generally ill-posed due to the possible presence of unknown delays in the measurements. In this paper, we offer a solution of this problem by using a variational Bayes framework, where the uncertainty over the delays is marginalized in order to obtain conservative coupling estimates. To overcome the well-known overconfidence of classical variational methods, we use a hybrid-VI scheme where the (possibly flat or multimodal) posterior over the measurement parameters is estimated using a forward KL loss while the (nearly convex) conditional posterior over the couplings is estimated using the highly scalable gradient-based VI. In our ground-truth experiments, we show that the network provides reliable and conservative estimates of the couplings, greatly outperforming similar methods such as regression DCM.


title: Dark photon limits from patchy dark screening of the cosmic microwave background

abstract: Dark photons that kinetically mix with the Standard Model photon give rise to new spectral anisotropies (patchy dark screening) in the cosmic microwave background (CMB) due to conversion of photons to dark photons within large-scale structure. We utilize predictions for this patchy dark screening signal to provide the tightest constraints to date on the dark photon kinetic mixing parameter ($\varepsilon \lesssim 4\times 10^{-8}$ (95% confidence level)) over the mass range $10^{-13} \,\, {\rm eV} \lesssim m_{{A^\prime}} \lesssim 10^{-11}$ eV, almost an order of magnitude stronger than previous limits, by applying state-of-the-art component separation techniques to the cross-correlation of $\textit{Planck}$ CMB and $\textit{unWISE}$ galaxy survey data.


title: Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

abstract: Training models with longer in-context lengths is a significant challenge for multimodal model due to substantial GPU memory and computational costs. This exploratory study does not present state-of-the-art models; rather, it introduces an innovative method designed to increase in-context text length in multi-modality large language models (MLLMs) efficiently. We present Visualized In-Context Text Processing (VisInContext), which processes long in-context text using visual tokens. This technique significantly reduces GPU memory usage and floating point operations (FLOPs) for both training and inferenceing stage. For instance, our method expands the pre-training in-context text length from 256 to 2048 tokens with nearly same FLOPs for a 56 billion parameter MOE model. Experimental results demonstrate that model trained with VisInContext delivers superior performance on common downstream benchmarks for in-context few-shot evaluation. Additionally, VisInContext is complementary to existing methods for increasing in-context text length and enhances document understanding capabilities, showing great potential in document QA tasks and sequential document retrieval.


title: Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation

abstract: Recent works on open-vocabulary 3D instance segmentation show strong promise, but at the cost of slow inference speed and high computation requirements. This high computation cost is typically due to their heavy reliance on 3D clip features, which require computationally expensive 2D foundation models like Segment Anything (SAM) and CLIP for multi-view aggregation into 3D. As a consequence, this hampers their applicability in many real-world applications that require both fast and accurate predictions. To this end, we propose a fast yet accurate open-vocabulary 3D instance segmentation approach, named Open-YOLO 3D, that effectively leverages only 2D object detection from multi-view RGB images for open-vocabulary 3D instance segmentation. We address this task by generating class-agnostic 3D masks for objects in the scene and associating them with text prompts. We observe that the projection of class-agnostic 3D point cloud instances already holds instance information; thus, using SAM might only result in redundancy that unnecessarily increases the inference time. We empirically find that a better performance of matching text prompts to 3D masks can be achieved in a faster fashion with a 2D object detector. We validate our Open-YOLO 3D on two benchmarks, ScanNet200 and Replica, under two scenarios: (i) with ground truth masks, where labels are required for given object proposals, and (ii) with class-agnostic 3D proposals generated from a 3D proposal network. Our Open-YOLO 3D achieves state-of-the-art performance on both datasets while obtaining up to $\sim$16$\times$ speedup compared to the best existing method in literature. On ScanNet200 val. set, our Open-YOLO 3D achieves mean average precision (mAP) of 24.7\% while operating at 22 seconds per scene. Code and model are available at github.com/aminebdj/OpenYOLO3D.


title: Dreamguider: Improved Training free Diffusion-based Conditional Generation

abstract: Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for estimating the guidance direction. Moreover, these techniques often require handcrafted parameter tuning on a case-by-case basis. Although some recent works have introduced minimal compute methods for linear inverse problems, a generic lightweight guidance solution to both linear and non-linear guidance problems is still missing. To this end, we propose Dreamguider, a method that enables inference-time guidance without compute-heavy backpropagation through the diffusion network. The key idea is to regulate the gradient flow through a time-varying factor. Moreover, we propose an empirical guidance scale that works for a wide variety of tasks, hence removing the need for handcrafted parameter tuning. We further introduce an effective lightweight augmentation strategy that significantly boosts the performance during inference-time guidance. We present experiments using Dreamguider on multiple tasks across multiple datasets and models to show the effectiveness of the proposed modules. To facilitate further research, we will make the code public after the review process.


title: Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks

abstract: Large language models can solve tasks that were not present in the training set. This capability is believed to be due to in-context learning and skill composition. In this work, we study the emergence of in-context learning and skill composition in a collection of modular arithmetic tasks. Specifically, we consider a finite collection of linear modular functions $z = a \, x + b \, y \;\mathrm{mod}\; p$ labeled by the vector $(a, b) \in \mathbb{Z}_p^2$. We use some of these tasks for pre-training and the rest for out-of-distribution testing. We empirically show that a GPT-style transformer exhibits a transition from in-distribution to out-of-distribution generalization as the number of pre-training tasks increases. We find that the smallest model capable of out-of-distribution generalization requires two transformer blocks, while for deeper models, the out-of-distribution generalization phase is \emph{transient}, necessitating early stopping. Finally, we perform an interpretability study of the pre-trained models, revealing the highly structured representations in both phases; and discuss the learnt algorithm.


title: Local control and mixed dimensions: Exploring high-temperature superconductivity in optical lattices

abstract: The simulation of high-temperature superconducting materials by implementing strongly correlated fermionic models in optical lattices is one of the major objectives in the field of analog quantum simulation. Here we show that local control and optical bilayer capabilities create a versatile toolbox to study both nickelate and cuprate high-temperature superconductors. On the one hand, we present a scheme to implement a mixed-dimensional (mixD) bilayer model that has been proposed to capture the essential pairing physics of pressurized bilayer nickelates. This allows for the long-sought realization of a state with long-range superconducting order in current lattice quantum simulation machines. In particular, we show how coherent pairing correlations can be accessed in a partially particle-hole transformed and rotated basis. On the other hand, we demonstrate that control of local gates enables the observation of $d$-wave pairing order in the two-dimensional (single-layer) repulsive Fermi-Hubbard model through the simulation of a system with attractive interactions. Lastly, we introduce a scheme to measure momentum-resolved dopant densities, providing access to observables complementary to solid-state experiments -- which is of particular interest for future studies of the enigmatic pseudogap phase appearing in cuprates.


title: VHS: High-Resolution Iterative Stereo Matching with Visual Hull Priors

abstract: We present a stereo-matching method for depth estimation from high-resolution images using visual hulls as priors, and a memory-efficient technique for the correlation computation. Our method uses object masks extracted from supplementary views of the scene to guide the disparity estimation, effectively reducing the search space for matches. This approach is specifically tailored to stereo rigs in volumetric capture systems, where an accurate depth plays a key role in the downstream reconstruction task. To enable training and regression at high resolutions targeted by recent systems, our approach extends a sparse correlation computation into a hybrid sparse-dense scheme suitable for application in leading recurrent network architectures. We evaluate the performance-efficiency trade-off of our method compared to state-of-the-art methods, and demonstrate the efficacy of the visual hull guidance. In addition, we propose a training scheme for a further reduction of memory requirements during optimization, facilitating training on high-resolution data.


title: Rapid 2D 23Na MRI of the calf using a denoising convolutional neural network

abstract: 23Na MRI can be used to quantify in-vivo tissue sodium concentration (TSC), but the low 23Na signal leads to long scan times and/or noisy or low-resolution images. Reconstruction algorithms such as CS have been proposed to mitigate low SNR; although, these can result in unnatural images, suboptimal denoising and long processing times. Recently, ML has been used to denoise 1H MRI acquisitions; however, this approach typically requires large volumes of high-quality training data, which is not readily available for 23Na MRI. Here, we train a denoising CNN using 1H data, which we subsequently demonstrate on prospective 23Na images of the calf. 1893 1H transverse slices of the knee were used to train denoising CNNs for different levels of noise. Low SNR images were generated by adding gaussian noise to the high-quality 1H kspace data before reconstruction to create paired training data. For prospective testing, 23Na images of the calf were acquired in 10 volunteers with 150 averages, which were used as a reference throughout the study. From this data, lower-average images were reconstructed using a NUFFT as well as CS, with the NUFFT images subsequently denoised using the trained CNN. CNNs were successfully applied to 23Na images reconstructed with 50, 40 and 30 averages. SNR was significantly higher in CNN images compared to NUFFT, CS and reference images. Edge sharpness was equivalent for all images. For image quality ranking, CNN images ranked equally best with reference images and significantly better than NUFFT and CS images. Muscle and skin TSC quantification from CNN images were equivalent to those from CS images, with <0.9 mM bias compared to reference values. Denoising CNNs trained on 1H data can be successfully applied to 23Na images of the calf; thus, allowing scan time to be reduced from 10 minutes to 2 minutes with little impact on image quality or TSC quantification accuracy.