title: PromptWizard: Task-Aware Agent-driven Prompt Optimization Framework

abstract: Large language models (LLMs) have revolutionized AI across diverse domains, showcasing remarkable capabilities. Central to their success is the concept of prompting, which guides model output generation. However, manual prompt engineering is labor-intensive and domain-specific, necessitating automated solutions. This paper introduces PromptWizard, a novel framework leveraging LLMs to iteratively synthesize and refine prompts tailored to specific tasks. Unlike existing approaches, PromptWizard optimizes both prompt instructions and in-context examples, maximizing model performance. The framework iteratively refines prompts by mutating instructions and incorporating negative examples to deepen understanding and ensure diversity. It further enhances both instructions and examples with the aid of a critic, synthesizing new instructions and examples enriched with detailed reasoning steps for optimal performance. PromptWizard offers several key features and capabilities, including computational efficiency compared to state-of-the-art approaches, adaptability to scenarios with varying amounts of training data, and effectiveness with smaller LLMs. Rigorous evaluation across 35 tasks on 8 datasets demonstrates PromptWizard's superiority over existing prompt strategies, showcasing its efficacy and scalability in prompt optimization.


title: Cyclotomic Structures in Symplectic Topology

abstract: We extend the Cohen-Jones-Segal construction of stable homotopy types associated to flow categories of Morse-Smale functions $f$ to the setting where $f$ is equivariant under a finite group action and is Morse but no longer Morse-Smale. This setting occurs universally, as equivariant Morse functions can rarely be perturbed to nearby equivariant Morse-Smale functions. The method is very general, and allows one to do equivariant Floer theory while avoiding all the complications typically caused by issues of equivariant transversality. The construction assigns a (genuine) equivariant orthogonal spectrum to an equivariant framed virtually smooth flow category. Using this method, we construct, for a compact symplectic manifold $M$, which is symplectically atoroidal with contact boundary, and is equipped with an equivariant trivialization of its polarization class, a cyclotomic structure on the spectral lift of the symplectic cohomology $SH^*(M)$. This generalizes a variant of the map which sends loops to their $p$-fold covers on free loop spaces to the setting of general Liouville domains, and suggests a systematic connection between Floer homology and $p$-adic Hodge theory.


title: ML-QLS: Multilevel Quantum Layout Synthesis

abstract: Quantum Layout Synthesis (QLS) plays a crucial role in optimizing quantum circuit execution on physical quantum devices. As we enter the era where quantum computers have hundreds of qubits, we are faced with scalability issues using optimal approaches and degrading heuristic methods' performance due to the lack of global optimization. To this end, we introduce a hybrid design that obtains the much improved solution for the heuristic method utilizing the multilevel framework, which is an effective methodology to solve large-scale problems in VLSI design. In this paper, we present ML-QLS, the first multilevel quantum layout tool with a scalable refinement operation integrated with novel cost functions and clustering strategies. Our clustering provides valuable insights into generating a proper problem approximation for quantum circuits and devices. Our experimental results demonstrate that ML-QLS can scale up to problems involving hundreds of qubits and achieve a remarkable 52% performance improvement over leading heuristic QLS tools for large circuits, which underscores the effectiveness of multilevel frameworks in quantum applications.


title: Global Jacquet-Langlands Correspondence of Plancherel measures

abstract: We prove the global Jacquet-Langlands correspondence of GL(n) preserves each local Plancherel density if the Tamagawa measures are taken as the Haar measures.


title: A Hessian-Aware Stochastic Differential Equation for Modelling SGD

abstract: Continuous-time approximation of Stochastic Gradient Descent (SGD) is a crucial tool to study its escaping behaviors from stationary points. However, existing stochastic differential equation (SDE) models fail to fully capture these behaviors, even for simple quadratic objectives. Built on a novel stochastic backward error analysis framework, we derive the Hessian-Aware Stochastic Modified Equation (HA-SME), an SDE that incorporates Hessian information of the objective function into both its drift and diffusion terms. Our analysis shows that HA-SME matches the order-best approximation error guarantee among existing SDE models in the literature, while achieving a significantly reduced dependence on the smoothness parameter of the objective. Further, for quadratic objectives, under mild conditions, HA-SME is proved to be the first SDE model that recovers exactly the SGD dynamics in the distributional sense. Consequently, when the local landscape near a stationary point can be approximated by quadratics, HA-SME is expected to accurately predict the local escaping behaviors of SGD.


title: Hostile Counterspeech Drives Users From Hate Subreddits

abstract: Counterspeech -- speech that opposes hate speech -- has gained significant attention recently as a strategy to reduce hate on social media. While previous studies suggest that counterspeech can somewhat reduce hate speech, little is known about its effects on participation in online hate communities, nor which counterspeech tactics reduce harmful behavior. We begin to address these gaps by identifying 25 large hate communities ("subreddits") within Reddit and analyzing the effect of counterspeech on newcomers within these communities. We first construct a new public dataset of carefully annotated counterspeech and non-counterspeech comments within these subreddits. We use this dataset to train a state-of-the-art counterspeech detection model. Next, we use matching to evaluate the causal effects of hostile and non-hostile counterspeech on the engagement of newcomers in hate subreddits. We find that, while non-hostile counterspeech is ineffective at keeping users from fully disengaging from these hate subreddits, a single hostile counterspeech comment substantially reduces both future likelihood of engagement. While offering nuance to the understanding of counterspeech efficacy, these results a) leave unanswered the question of whether hostile counterspeech dissuades newcomers from participation in online hate writ large, or merely drives them into less-moderated and more extreme hate communities, and b) raises ethical considerations about hostile counterspeech, which is both comparatively common and might exacerbate rather than mitigate the net level of antagonism in society. These findings underscore the importance of future work to improve counterspeech tactics and minimize unintended harm.


title: Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning

abstract: Commonsense reasoning is one of the important aspect of natural language understanding, with several benchmarks developed to evaluate it. However, only a few of these benchmarks are available in languages other than English. Developing parallel benchmarks facilitates cross-lingual evaluation, enabling a better understanding of different languages. This research introduces a collection of Winograd Schemas in Thai, a novel dataset designed to evaluate commonsense reasoning capabilities in the context of the Thai language. Through a methodology involving native speakers, professional translators, and thorough validation, the schemas aim to closely reflect Thai language nuances, idioms, and cultural references while maintaining ambiguity and commonsense challenges. We evaluate the performance of popular large language models on this benchmark, revealing their strengths, limitations, and providing insights into the current state-of-the-art. Results indicate that while models like GPT-4 and Claude-3-Opus achieve high accuracy in English, their performance significantly drops in Thai, highlighting the need for further advancements in multilingual commonsense reasoning.


title: Empowering Source-Free Domain Adaptation with MLLM-driven Curriculum Learning

abstract: Source-Free Domain Adaptation (SFDA) aims to adapt a pre-trained source model to a target domain using only unlabeled target data. Current SFDA methods face challenges in effectively leveraging pre-trained knowledge and exploiting target domain data. Multimodal Large Language Models (MLLMs) offer remarkable capabilities in understanding visual and textual information, but their applicability to SFDA poses challenges such as instruction-following failures, intensive computational demands, and difficulties in performance measurement prior to adaptation. To alleviate these issues, we propose Reliability-based Curriculum Learning (RCL), a novel framework that integrates multiple MLLMs for knowledge exploitation via pseudo-labeling in SFDA. Our framework incorporates proposed Reliable Knowledge Transfer, Self-correcting and MLLM-guided Knowledge Expansion, and Multi-hot Masking Refinement to progressively exploit unlabeled data in the target domain. RCL achieves state-of-the-art (SOTA) performance on multiple SFDA benchmarks, e.g., $\textbf{+9.4%}$ on DomainNet, demonstrating its effectiveness in enhancing adaptability and robustness without requiring access to source data. Code: https://github.com/Dong-Jie-Chen/RCL.


title: LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models

abstract: The abilities of modern large language models (LLMs) in solving natural language processing, complex reasoning, sentiment analysis and other tasks have been extraordinary which has prompted their extensive adoption. Unfortunately, these abilities come with very high memory and computational costs which precludes the use of LLMs on most hardware platforms. To mitigate this, we propose an effective method of finding Pareto-optimal network architectures based on LLaMA2-7B using one-shot NAS. In particular, we fine-tune LLaMA2-7B only once and then apply genetic algorithm-based search to find smaller, less computationally complex network architectures. We show that, for certain standard benchmark tasks, the pre-trained LLaMA2-7B network is unnecessarily large and complex. More specifically, we demonstrate a 1.5x reduction in model size and 1.3x speedup in throughput for certain tasks with negligible drop in accuracy. In addition to finding smaller, higher-performing network architectures, our method does so more effectively and efficiently than certain pruning or sparsification techniques. Finally, we demonstrate how quantization is complementary to our method and that the size and complexity of the networks we find can be further decreased using quantization. We believe that our work provides a way to automatically create LLMs which can be used on less expensive and more readily available hardware platforms.


title: A Canonization Perspective on Invariant and Equivariant Learning

abstract: In many applications, we desire neural networks to exhibit invariance or equivariance to certain groups due to symmetries inherent in the data. Recently, frame-averaging methods emerged to be a unified framework for attaining symmetries efficiently by averaging over input-dependent subsets of the group, i.e., frames. What we currently lack is a principled understanding of the design of frames. In this work, we introduce a canonization perspective that provides an essential and complete view of the design of frames. Canonization is a classic approach for attaining invariance by mapping inputs to their canonical forms. We show that there exists an inherent connection between frames and canonical forms. Leveraging this connection, we can efficiently compare the complexity of frames as well as determine the optimality of certain frames. Guided by this principle, we design novel frames for eigenvectors that are strictly superior to existing methods -- some are even optimal -- both theoretically and empirically. The reduction to the canonization perspective further uncovers equivalences between previous methods. These observations suggest that canonization provides a fundamental understanding of existing frame-averaging methods and unifies existing equivariant and invariant learning methods.


title: A Note on the Prediction-Powered Bootstrap

abstract: We introduce PPBoot: a bootstrap-based method for prediction-powered inference. PPBoot is applicable to arbitrary estimation problems and is very simple to implement, essentially only requiring one application of the bootstrap. Through a series of examples, we demonstrate that PPBoot often performs nearly identically to (and sometimes better than) the earlier PPI(++) method based on asymptotic normality$\unicode{x2013}$when the latter is applicable$\unicode{x2013}$without requiring any asymptotic characterizations. Given its versatility, PPBoot could simplify and expand the scope of application of prediction-powered inference to problems where central limit theorems are hard to prove.


title: OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning

abstract: The rapid advancements in Large Language Models (LLMs) have revolutionized various natural language processing tasks. However, the substantial size of LLMs presents significant challenges in training or fine-tuning. While parameter-efficient approaches such as low-rank adaptation (LoRA) have gained popularity, they often compromise performance compared to full-rank fine-tuning. In this paper, we propose Outlier-weighed Layerwise Sampled Low-Rank Projection (OwLore), a new memory-efficient fine-tuning approach, inspired by the layerwise outlier distribution of LLMs, which dynamically samples pre-trained layers to fine-tune instead of adding additional adaptors. We first interpret the outlier phenomenon through the lens of Heavy-Tailed Self-Regularization theory (HT-SR), discovering that layers with more outliers tend to be more heavy-tailed and consequently better trained. Inspired by this finding, OwLore strategically assigns higher sampling probabilities to layers with more outliers to better leverage the knowledge stored in pre-trained LLMs. To further mitigate the memory demands of fine-tuning, we integrate gradient low-rank projection into our approach, which facilitates each layer to be efficiently trained in a low-rank manner. By incorporating the efficient characteristics of low-rank and optimal layerwise sampling, OwLore significantly improves the memory-performance trade-off in LLM pruning. Our extensive experiments across various architectures, including LLaMa2, LLaMa3, and Mistral, demonstrate that OwLore consistently outperforms baseline approaches, including full fine-tuning. Specifically, it achieves up to a 1.1% average accuracy gain on the Commonsense Reasoning benchmark, a 3.0% improvement on MMLU, and a notable 10% boost on MT-Bench, while being more memory efficient. OwLore allows us to fine-tune LLaMa2-7B with only 21GB of memory.


title: Short-time Fokker-Planck propagator beyond the Gaussian approximation

abstract: We present a perturbation approach to calculate the short-time propagator, or transition density, of the one-dimensional Fokker-Planck equation, to in principle arbitrary order in the time increment. Our approach preserves probability exactly and allows us to evaluate expectation values of analytical observables to in principle arbitrary accuracy; to showcase this, we derive perturbation expansions for the moments of the spatial increment, the finite-time Kramers-Moyal coefficients, and the mean medium entropy production rate. For an explicit multiplicative-noise system with available analytical solution, we validate all our perturbative results. Throughout, we compare our perturbative results to those obtained from the widely used Gaussian approximation of the short-time propagator; we demonstrate that this Gaussian propagator leads to errors that can be many orders of magnitude larger than those resulting from our perturbation approach. Potential applications of our results include parametrizing diffusive stochastic dynamics from observed time series, and sampling path spaces of stochastic trajectories numerically.

categories: cond-mat.stat-mech cond-mat.soft math.PR physics.chem-ph


title: Learning a conserved mechanism for early neuroectoderm morphogenesis

abstract: Morphogenesis is the process whereby the body of an organism develops its target shape. The morphogen BMP is known to play a conserved role across bilaterian organisms in determining the dorsoventral (DV) axis. Yet, how BMP governs the spatio-temporal dynamics of cytoskeletal proteins driving morphogenetic flow remains an open question. Here, we use machine learning to mine a morphodynamic atlas of Drosophila development, and construct a mathematical model capable of predicting the coupled dynamics of myosin, E-cadherin, and morphogenetic flow. Mutant analysis shows that BMP sets the initial condition of this dynamical system according to the following signaling cascade: BMP establishes DV pair-rule-gene patterns that set-up an E-cadherin gradient which in turn creates a myosin gradient in the opposite direction through mechanochemical feedbacks. Using neural tube organoids, we argue that BMP, and the signaling cascade it triggers, prime the conserved dynamics of neuroectoderm morphogenesis from fly to humans.


title: Brain Tumor Segmentation (BraTS) Challenge 2024: Meningioma Radiotherapy Planning Automated Segmentation

abstract: The 2024 Brain Tumor Segmentation Meningioma Radiotherapy (BraTS-MEN-RT) challenge aims to advance automated segmentation algorithms using the largest known multi-institutional dataset of radiotherapy planning brain MRIs with expert-annotated target labels for patients with intact or post-operative meningioma that underwent either conventional external beam radiotherapy or stereotactic radiosurgery. Each case includes a defaced 3D post-contrast T1-weighted radiotherapy planning MRI in its native acquisition space, accompanied by a single-label "target volume" representing the gross tumor volume (GTV) and any at-risk post-operative site. Target volume annotations adhere to established radiotherapy planning protocols, ensuring consistency across cases and institutions. For pre-operative meningiomas, the target volume encompasses the entire GTV and associated nodular dural tail, while for post-operative cases, it includes at-risk resection cavity margins as determined by the treating institution. Case annotations were reviewed and approved by expert neuroradiologists and radiation oncologists. Participating teams will develop, containerize, and evaluate automated segmentation models using this comprehensive dataset. Model performance will be assessed using the lesion-wise Dice Similarity Coefficient and the 95% Hausdorff distance. The top-performing teams will be recognized at the Medical Image Computing and Computer Assisted Intervention Conference in October 2024. BraTS-MEN-RT is expected to significantly advance automated radiotherapy planning by enabling precise tumor segmentation and facilitating tailored treatment, ultimately improving patient outcomes.


title: Decentralized Picosecond Synchronization for Distributed Wireless Systems

abstract: We demonstrate a wireless, decentralized time-alignment method for distributed antenna arrays and distributed wireless networks that achieves picosecond-level synchronization. Distributed antenna arrays consist of spatially separated antennas that coordinate their functionality at the wavelength level to achieve coherent operations such as distributed beamforming. Accurate time alignment (synchronization) of the local clocks on each node in the array is necessary to support accurate time-delay beamforming of modulated signals. In this work we combine a consensus averaging algorithm and a high-accuracy wireless two-way time transfer method to achieve decentralized time alignment, correcting for the time-varying bias of the clocks in a method that has no central node. Internode time transfer is based on a spectrally-sparse, two-tone signal achieving near-optimal time delay accuracy. We experimentally demonstrate the approach in a wireless four-node software-defined radio system, with various network connectivity graphs. We show that within 20 iterations all the nodes achieve convergence within a bias of less than 12 ps and a standard deviation of less than 3 ps. The performance is evaluated versus the bandwidth of the two-tone waveform, which impacts the synchronization error, and versus the signal-to-noise ratio.


title: Blocking Tracking JavaScript at the Function Granularity

abstract: Modern websites extensively rely on JavaScript to implement both functionality and tracking. Existing privacy enhancing content blocking tools struggle against mixed scripts, which simultaneously implement both functionality and tracking, because blocking the script would break functionality and not blocking it would allow tracking. We propose Not.js, a fine grained JavaScript blocking tool that operates at the function level granularity. Not.js's strengths lie in analyzing the dynamic execution context, including the call stack and calling context of each JavaScript function, and then encoding this context to build a rich graph representation. Not.js trains a supervised machine learning classifier on a webpage's graph representation to first detect tracking at the JavaScript function level and then automatically generate surrogate scripts that preserve functionality while removing tracking. Our evaluation of Not.js on the top 10K websites demonstrates that it achieves high precision (94%) and recall (98%) in detecting tracking JavaScript functions, outperforming the state of the art while being robust against off the shelf JavaScript obfuscation. Fine grained detection of tracking functions allows Not.js to automatically generate surrogate scripts that remove tracking JavaScript functions without causing major breakage. Our deployment of Not.js shows that mixed scripts are present on 62.3% of the top 10K websites, with 70.6% of the mixed scripts being third party that engage in tracking activities such as cookie ghostwriting. We share a sample of the tracking functions detected by Not.js within mixed scripts not currently on filter lists with filter list authors, who confirm that these scripts are not blocked due to potential functionality breakage, despite being known to implement tracking.


title: Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning

abstract: Recent advances in text-to-music editing, which employ text queries to modify music (e.g.\ by changing its style or adjusting instrumental components), present unique challenges and opportunities for AI-assisted music creation. Previous approaches in this domain have been constrained by the necessity to train specific editing models from scratch, which is both resource-intensive and inefficient; other research uses large language models to predict edited music, resulting in imprecise audio reconstruction. To Combine the strengths and address these limitations, we introduce Instruct-MusicGen, a novel approach that finetunes a pretrained MusicGen model to efficiently follow editing instructions such as adding, removing, or separating stems. Our approach involves a modification of the original MusicGen architecture by incorporating a text fusion module and an audio fusion module, which allow the model to process instruction texts and audio inputs concurrently and yield the desired edited music. Remarkably, Instruct-MusicGen only introduces 8% new parameters to the original MusicGen model and only trains for 5K steps, yet it achieves superior performance across all tasks compared to existing baselines, and demonstrates performance comparable to the models trained for specific tasks. This advancement not only enhances the efficiency of text-to-music editing but also broadens the applicability of music language models in dynamic music production environments.


title: A Review and Implementation of Object Detection Models and Optimizations for Real-time Medical Mask Detection during the COVID-19 Pandemic

abstract: Convolutional Neural Networks (CNN) are commonly used for the problem of object detection thanks to their increased accuracy. Nevertheless, the performance of CNN-based detection models is ambiguous when detection speed is considered. To the best of our knowledge, there has not been sufficient evaluation of the available methods in terms of the speed/accuracy trade-off in related literature. This work assesses the most fundamental object detection models on the Common Objects in Context (COCO) dataset with respect to this trade-off, their memory consumption, and computational and storage cost. Next, we select a highly efficient model called YOLOv5 to train on the topical and unexplored dataset of human faces with medical masks, the Properly-Wearing Masked Faces Dataset (PWMFD), and analyze the benefits of specific optimization techniques for real-time medical mask detection: transfer learning, data augmentations, and a Squeeze-and-Excitation attention mechanism. Using our findings in the context of the COVID-19 pandemic, we propose an optimized model based on YOLOv5s using transfer learning for the detection of correctly and incorrectly worn medical masks that surpassed more than two times in speed (69 frames per second) the state-of-the-art model SE-YOLOv3 on the PWMFD dataset while maintaining the same level of mean Average Precision (67%).


title: Natural numbers from integers

abstract: In homotopy type theory, a natural number type is freely generated by an element and an endomorphism. Similarly, an integer type is freely generated by an element and an automorphism. Using only dependent sums, identity types, extensional dependent products, and a type of two elements with large elimination, we construct a natural number type from an integer type. As a corollary, homotopy type theory with only $\Sigma$, $\mathsf{Id}$, $\Pi$, and finite colimits with descent (and no universes) admits a natural number type. This improves and simplifies a result by Rose.


title: Stability of the Parabolic Picard Sheaf

abstract: Let $X$ be a smooth irreducible complex projective curve of genus $g\,\geq\, 2$, and let $D\,=\,x_1+\dots+x_r$ be a reduced effective divisor on $X$. Denote by $U_{\alpha}(L)$ the moduli space of stable parabolic bundles on $X$ of rank $n$, determinant $L$ of degree $d$ with flag type $\{k^i_j\}$ and generic parabolic weights $\{\alpha^i_j\}$ at each $x_i$, $1\, \leq\, i\,\leq \, r$. There is a universal family on $X\times U_{\alpha}(L)$; its direct image to $U_{\alpha}(L)$ is called the parabolic Picard sheaf. We prove that the parabolic Picard sheaf is stable.


title: Global solutions to the Euler-Coriolis system

abstract: We prove the global well-posedness and scattering for the 3D incompressible Euler-Coriolis system with sufficiently small, regular and suitably localized initial data. Equivalently, we obtain the asymptotic stability for "rigid body" rotational solutions to the pure Euler equations. This extends the recent work of Guo, Pausader and Widmayer to the general non-axisymmetric setting.


title: Untangling Climate's Complexity: Methodological Insights

abstract: In this article, we review the interdisciplinary techniques (borrowed from physics, mathematics, statistics, machine-learning, etc.) and methodological framework that we have used to understand climate systems, which serve as examples of "complex systems". We believe that this would offer valuable insights to comprehend the complexity of climate variability and pave the way for drafting policies for action against climate change, etc. Our basic aim is to analyse time-series data structures across diverse climate parameters, extract Fourier-transformed features to recognize and model the trends/seasonalities in the climate variables using standard methods like detrended residual series analyses, correlation structures among climate parameters, Granger causal models, and other statistical machine-learning techniques. We cite and briefly explain two case studies: (i) the relationship between the Standardised Precipitation Index (SPI) and specific climate variables including Sea Surface Temperature (SST), El Ni\~no Southern Oscillation (ENSO), and Indian Ocean Dipole (IOD), uncovering temporal shifts in correlations between SPI and these variables, and reveal complex patterns that drive drought and wet climate conditions in South-West Australia; (ii) the complex interactions of North Atlantic Oscillation (NAO) index, with SST and sea ice extent (SIE), potentially arising from positive feedback loops.


title: Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

abstract: Scale has become a main ingredient in obtaining strong machine learning models. As a result, understanding a model's scaling properties is key to effectively designing both the right training setup as well as future generations of architectures. In this work, we argue that scale and training research has been needlessly complex due to reliance on the cosine schedule, which prevents training across different lengths for the same model size. We investigate the training behavior of a direct alternative - constant learning rate and cooldowns - and find that it scales predictably and reliably similar to cosine. Additionally, we show that stochastic weight averaging yields improved performance along the training trajectory, without additional training costs, across different scales. Importantly, with these findings we demonstrate that scaling experiments can be performed with significantly reduced compute and GPU hours by utilizing fewer but reusable training runs. Our code is available at https://github.com/epfml/schedules-and-scaling.


title: A Critique of Snapshot Isolation

abstract: The support for transactions is an essential part of a database management system (DBMS). Without this support, the developers are burdened with ensuring atomic execution of a transaction despite failures as well as concurrent accesses to the database by other transactions. Ideally, a transactional system provides serializability, which means that the outcome of concurrent transactions is equivalent to a serial execution of them. Based on experiences on lock-based implementations, nevertheless, serializability is known as an expensive feature that comes with high overhead and low concurrency. Commercial systems, hence, compromise serializability by implementing weaker guarantees such as snapshot isolation. The developers, therefore, are still burdened with the anomalies that could arise due to the lack of serializability. There have been recent attempts to enrich large-scale data stores, such as HBase and BigTable, with transactional support. Not surprisingly, inspired by traditional database management systems, serializability is usually compromised for the benefit of efficiency. For example, Google Percolator, implements lock-based snapshot isolation on top of BigTable. We show in this paper that this compromise is not necessary in lock-free implementations of transactional support. We introduce write-snapshot isolation, a novel isolation level that has a performance comparable with that of snapshot isolation, and yet provides serializability. The main insight in write-snapshot isolation is to prevent read-write conflicts in contrast to write-write conflicts that are prevented by snapshot isolation.


title: Ensemble Generalization of the Perdew-Zunger Self-Interaction Correction: a Way Out of Multiple Minima and Symmetry Breaking

abstract: The Perdew-Zunger (PZ) self-interaction correction (SIC) is an established tool to correct unphysical behavior in density functional approximations. Yet, PZ-SIC is well-known to sometimes break molecular symmetries. An example of this is the benzene molecule, for which PZ-SIC predicts a symmetry-broken electron density and molecular geometry, since the method does not describe the two possible Kekul\'e structures on an even footing, leading to local minima [Lehtola et al, J. Chem. Theory Comput. 2016, 12, 3195]. PZ-SIC is often implemented with Fermi-L\"owdin orbitals (FLOs), yielding the FLO-SIC method, which likewise has issues with symmetry breaking and local minima [Trepte et al, J. Chem. Phys. 2021, 155, 224109]. In this work, we propose a generalization of PZ-SIC - the ensemble PZ-SIC (E-PZ-SIC) method - which shares the asymptotic computational scaling of PZ-SIC (albeit with an additional prefactor). E-PZ-SIC is straightforwardly applicable to various molecules, merely requiring one to average the self-interaction correction over all possible Kekul\'e structures, in line with chemical intuition. We showcase the implementation of E-PZ-SIC with FLOs, as the resulting E-FLO-SIC method is easy to realize on top of an existing implementation of FLO-SIC. We show that E-FLO-SIC indeed eliminates symmetry breaking, reproducing a symmetric electron density and molecular geometry for benzene. The ensemble approach suggested herein could also be employed within locally scaled variants of PZ-SIC and their FLO-SIC versions.


title: MC-GTA: Metric-Constrained Model-Based Clustering using Goodness-of-fit Tests with Autocorrelations

abstract: A wide range of (multivariate) temporal (1D) and spatial (2D) data analysis tasks, such as grouping vehicle sensor trajectories, can be formulated as clustering with given metric constraints. Existing metric-constrained clustering algorithms overlook the rich correlation between feature similarity and metric distance, i.e., metric autocorrelation. The model-based variations of these clustering algorithms (e.g. TICC and STICC) achieve SOTA performance, yet suffer from computational instability and complexity by using a metric-constrained Expectation-Maximization procedure. In order to address these two problems, we propose a novel clustering algorithm, MC-GTA (Model-based Clustering via Goodness-of-fit Tests with Autocorrelations). Its objective is only composed of pairwise weighted sums of feature similarity terms (square Wasserstein-2 distance) and metric autocorrelation terms (a novel multivariate generalization of classic semivariogram). We show that MC-GTA is effectively minimizing the total hinge loss for intra-cluster observation pairs not passing goodness-of-fit tests, i.e., statistically not originating from the same distribution. Experiments on 1D/2D synthetic and real-world datasets demonstrate that MC-GTA successfully incorporates metric autocorrelation. It outperforms strong baselines by large margins (up to 14.3% in ARI and 32.1% in NMI) with faster and stabler optimization (>10x speedup).


title: What can machine learning help with microstructure-informed materials modeling and design?

abstract: Machine learning techniques have been widely employed as effective tools in addressing various engineering challenges in recent years, particularly for the challenging task of microstructure-informed materials modeling. This work provides a comprehensive review of the current machine learning-assisted and data-driven advancements in this field, including microstructure characterization and reconstruction, multiscale simulation, correlations among process, microstructure, and properties, as well as microstructure optimization and inverse design. It outlines the achievements of existing research through best practices and suggests potential avenues for future investigations. Moreover, it prepares the readers with educative instructions of basic knowledge and an overview on machine learning, microstructure descriptors and machine learning-assisted material modeling, lowering the interdisciplinary hurdles. It should help to stimulate and attract more research attention to the rapidly growing field of machine learning-based modeling and design of microstructured materials.


title: Curvature fluctuations in a baby quantum gravity model

abstract: Understanding the microscopic behavior of spacetime is critical for developing a theory of quantum gravity and perhaps solving the cosmological constant problem. In this context, it has been proposed that the quantity of interest is the quantum uncertainty in the Ricci scalar and here we investigate this for a discrete baby quantum gravity model based a single square cell. We find that the averaged Ricci scalar vanishes to leading order but has UV-divergent fluctuations. While this behavior is stable under renormalization, it appears not to be under the introduction of a small cosmological constant.


title: Unramified Gromov-Witten and Gopakumar-Vafa invariants

abstract: Kim, Kresch and Oh defined unramified Gromov-Witten invariants. For a threefold, Pandharipande conjectured that they are equal to Gopakumar-Vafa invariants (BPS invariants) in the case of Fano classes and primitive Calabi-Yau classes. We prove the conjecture using a wall-crossing technique. This provides an algebro-geometric construction of Gopakumar-Vafa invariants in these cases.


title: A simple, randomized algorithm for diagonalizing normal matrices

abstract: We present and analyze a simple numerical method that diagonalizes a complex normal matrix A by diagonalizing the Hermitian matrix obtained from a random linear combination of the Hermitian and skew-Hermitian parts of A.


title: Superposed Decoding: Multiple Generations from a Single Autoregressive Inference Pass

abstract: Many applications today provide users with multiple auto-complete drafts as they type, including GitHub's code completion, Gmail's smart compose, and Apple's messaging auto-suggestions. Under the hood, language models support this by running an autoregressive inference pass to provide a draft. Consequently, providing $k$ drafts to the user requires running an expensive language model $k$ times. To alleviate the computation cost of running $k$ inference passes, we propose Superposed Decoding, a new decoding algorithm that generates $k$ drafts at the computation cost of one autoregressive inference pass. We achieve this by feeding a superposition of the most recent token embeddings from the $k$ drafts as input to the next decoding step of the language model. At every inference step we combine the $k$ drafts with the top-$k$ tokens to get $k^2$ new drafts and cache the $k$ most likely options, using an n-gram interpolation with minimal compute overhead to filter out incoherent generations. Our experiments show that $k$ drafts from Superposed Decoding are at least as coherent and factual as Nucleus Sampling and Greedy Decoding respectively, while being at least $2.44\times$ faster for $k\ge3$. In a compute-normalized setting, user evaluations demonstrably favor text generated by Superposed Decoding over Nucleus Sampling. Code and more examples open-sourced at https://github.com/RAIVNLab/SuperposedDecoding.


title: Explicit Formulae to Interchangeably use Hyperplanes and Hyperballs using Inversive Geometry

abstract: Many algorithms require discriminative boundaries, such as separating hyperplanes or hyperballs, or are specifically designed to work on spherical data. By applying inversive geometry, we show that the two discriminative boundaries can be used interchangeably, and that general Euclidean data can be transformed into spherical data, whenever a change in point distances is acceptable. We provide explicit formulae to embed general Euclidean data into spherical data and to unembed it back. We further show a duality between hyperspherical caps, i.e., the volume created by a separating hyperplane on spherical data, and hyperballs and provide explicit formulae to map between the two. We further provide equations to translate inner products and Euclidean distances between the two spaces, to avoid explicit embedding and unembedding. We also provide a method to enforce projections of the general Euclidean space onto hemi-hyperspheres and propose an intrinsic dimensionality based method to obtain "all-purpose" parameters. To show the usefulness of the cap-ball-duality, we discuss example applications in machine learning and vector similarity search.


title: Antigenic Cooperation in Viral Populations: Redistribution of Loads Among Altruistic Viruses and Maximal Load per Altruist

abstract: The paper continues the study of the phenomenon of local immunodeficiency (LI) in viral cross-immunoreactivity networks, with a focus on the roles and interactions between altruistic and persistent viral variants. As always, only the state of stable (i.e. observable) LI is analysed. First, we show that a single altruistic viral variant has an upper limit for the number of persistent viral variants that it can support. Our findings reveal that in viral cross-immunoreactivity networks, altruistic viruses act essentially autonomously from each other. Namely, connections between altruistic viruses do not change neither their qualitative roles, nor the quantitative values of the strengths of their connections in the CRNs. In other words, each altruistic virus does exactly the same actions and with the same strengths with or without presence of other altruistic viruses. However, having more altruistic viruses allows to keep sizes of populations of persistent viruses at the higher levels. Likewise, the strength of the immune response against any altruistic virus remains at the same constant level regardless of how many persistent viruses this altruistic virus supports, i.e. shields from the immune response of the host's immune system. It is also shown that viruses strongly compete with each other in order to become persistent in the state of stable LI. We also present an example for a CRN with stable LI that only consists of persistent viral variants.


title: Batch VUV4 Characterization for the SBC-LAr10 scintillating bubble chamber

abstract: The Scintillating Bubble Chamber (SBC) collaboration purchased 32 Hamamatsu VUV4 silicon photomultipliers (SiPMs) for use in SBC-LAr10, a bubble chamber containing 10~kg of liquid argon. The VUV4 SiPMs, or Quads, underwent a characterization at two temperatures which measured the breakdown voltage ($V_{\text{BD}}$), the SiPM gain ($g_{\text{SiPM}}$), the rate of change of $g_{\text{SiPM}}$ with respect to voltage ($m$), the dark count rate (DCR), and the probability of a correlated avalanche (P$_{\text{CA}}$) as well as the temperature coefficients of these parameters. A Peltier-based chilled vacuum chamber was developed at Queen's University to cool down the Quads to $233.15\pm0.2$~K and $255.15\pm0.2$~K with average stability of $\pm20$~mK. A mostly assumption-free analysis was derived to estimate $V_{\text{BD}}$ to tens of mV precision and DCR close to Poissonian error. The temperature dependence of $V_{\text{BD}}$ was found to be $56\pm2$~mV~K$^{-1}$, and $m$ on average across all Quads was found to be $(459\pm3(\rm{stat.})\pm23(\rm{sys.}))\times 10^{3}~e^-$~PE$^{-1}$~V$^{-1}$. The average DCR temperature coefficient was estimated to be $0.099\pm0.008$~K$^{-1}$ corresponding to a reduction factor of 7 for every 20~K drop in temperature. The average temperature dependence of P$_{\text{CA}}$ was estimated to be $4000\pm1000$~ppm~K$^{-1}$. P$_{\text{CA}}$ estimated from the average across all SiPMs is a better estimator than the P$_{\text{CA}}$ calculated from individual SiPMs, whereas all of the other parameters, the opposite is true. All the estimated parameters were measured to the precision required for SBC-LAr10, and the Quads will be used in conditions to optimize the signal-to-noise ratio.


title: Distributed quantum multiparameter estimation with optimal local measurements

abstract: We study the multiparameter sensitivity bounds of a sensor made by an array of $d$ spatially-distributed Mach-Zehnder interferometers (MZIs). A generic single non-classical state is mixed with $d-1$ vacuums to create a $d$-modes entangled state, each mode entering one input port of a MZI, while a coherent state enters its second port. We show that local measurements, independently performed on each MZI, are sufficient to provide a sensitivity saturating the quantum Cram\'er-Rao bound. The sensor can overcome the shot noise limit for the estimation of arbitrary linear combinations of the $d$ phase shifts, provided that the non-classical probe state has an anti-squeezed quadrature variance. We compare the sensitivity bounds of this sensor with that achievable with $d$ independent MZIs, each probed with a nonclassical state and a coherent state. We find that the $d$ independent interferometers can achieve the same sensitivity of the entangled protocol but at the cost of using additional $d$ non-classical states rather than a single one. When using in the two protocols the same average number of particles per shot $\bar{n}_T$, we find analytically a sensitivity scaling $1/\bar{n}_T^2$ for the entangled case which provides a gain factor $d$ with respect to the separable case where the sensitivity scales as $d/\bar{n}_T^2$. We have numerical evidences that the gain factor $d$ is also obtained when fixing the total average number of particles, namely when optimizing with respect to the number of repeated measurements.


title: WIDIn: Wording Image for Domain-Invariant Representation in Single-Source Domain Generalization

abstract: Language has been useful in extending the vision encoder to data from diverse distributions without empirical discovery in training domains. However, as the image description is mostly at coarse-grained level and ignores visual details, the resulted embeddings are still ineffective in overcoming complexity of domains at inference time. We present a self-supervision framework WIDIn, Wording Images for Domain-Invariant representation, to disentangle discriminative visual representation, by only leveraging data in a single domain and without any test prior. Specifically, for each image, we first estimate the language embedding with fine-grained alignment, which can be consequently used to adaptively identify and then remove domain-specific counterpart from the raw visual embedding. WIDIn can be applied to both pretrained vision-language models like CLIP, and separately trained uni-modal models like MoCo and BERT. Experimental studies on three domain generalization datasets demonstrate the effectiveness of our approach.


title: RACCooN: Remove, Add, and Change Video Content with Auto-Generated Narratives

abstract: Recent video generative models primarily rely on carefully written text prompts for specific tasks, like inpainting or style editing. They require labor-intensive textual descriptions for input videos, hindering their flexibility to adapt personal/raw videos to user specifications. This paper proposes RACCooN, a versatile and user-friendly video-to-paragraph-to-video generative framework that supports multiple video editing capabilities such as removal, addition, and modification, through a unified pipeline. RACCooN consists of two principal stages: Video-to-Paragraph (V2P) and Paragraph-to-Video (P2V). In the V2P stage, we automatically describe video scenes in well-structured natural language, capturing both the holistic context and focused object details. Subsequently, in the P2V stage, users can optionally refine these descriptions to guide the video diffusion model, enabling various modifications to the input video, such as removing, changing subjects, and/or adding new objects. The proposed approach stands out from other methods through several significant contributions: (1) RACCooN suggests a multi-granular spatiotemporal pooling strategy to generate well-structured video descriptions, capturing both the broad context and object details without requiring complex human annotations, simplifying precise video content editing based on text for users. (2) Our video generative model incorporates auto-generated narratives or instructions to enhance the quality and accuracy of the generated content. It supports the addition of video objects, inpainting, and attribute modification within a unified framework, surpassing existing video editing and inpainting benchmarks. The proposed framework demonstrates impressive versatile capabilities in video-to-paragraph generation, video content editing, and can be incorporated into other SoTA video generative models for further enhancement.


title: Phased Consistency Model

abstract: The consistency model (CM) has recently made significant progress in accelerating the generation of diffusion models. However, its application to high-resolution, text-conditioned image generation in the latent space (a.k.a., LCM) remains unsatisfactory. In this paper, we identify three key flaws in the current design of LCM. We investigate the reasons behind these limitations and propose the Phased Consistency Model (PCM), which generalizes the design space and addresses all identified limitations. Our evaluations demonstrate that PCM significantly outperforms LCM across 1--16 step generation settings. While PCM is specifically designed for multi-step refinement, it achieves even superior or comparable 1-step generation results to previously state-of-the-art specifically designed 1-step methods. Furthermore, we show that PCM's methodology is versatile and applicable to video generation, enabling us to train the state-of-the-art few-step text-to-video generator. More details are available at https://g-u-n.github.io/projects/pcm/.


title: Consistency and Causality of Interconnected Nonsignaling Resources

abstract: This paper examines networks of $n$ measuring parties sharing $m$ independent nonsignaling resources that can be locally wired together: that is, each party follows a scheme to measure the resources in a cascaded fashion with inputs to later resources possibly depending on outputs of earlier-measured ones. A specific framework is provided for studying probability distributions arising in such networks, and this framework is used to directly prove some accepted, but often only implicitly invoked, facts: there is a uniquely determined and well-defined joint probability distribution for the outputs of all resources shared by the parties, and this joint distribution is nonsignaling. It is furthermore shown that is often sufficient to restrict consideration to only extremal nonsignaling resources when considering features and properties of such networks. Finally, the framework illustrates how the physical theory of nonsignaling boxes and local wirings is causal, supporting the applicability of the inflation technique to constrain such models. For an application, we probe the example of (3,2,2) inequalities that witness genuine three-party nonlocality according to the local-operations-shared-randomness definition, and show how all other examples can be derived from that of Mao et al. [Phys. Rev. Lett. 129:150401 (2022)]


title: Sections of Submonoids of Nilpotent Groups

abstract: We show that every product of f.g.\ submonoids of a group $G$ is a section of a f.g.\ submonoid of $G{\times}H_5(\mathbb{Z})$, where $H_5(\mathbb{Z})$ is a Heisenberg group. This gives us a converse of a reduction of Bodart, and a new simple proof of the existence of a submonoid of a nilpotent group of class 2 with undecidable membership problem.


title: Towards a Sampling Theory for Implicit Neural Representations

abstract: Implicit neural representations (INRs) have emerged as a powerful tool for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized by a neural network taking spatial coordinates as inputs. However, unlike traditional pixel representations, little is known about the sample complexity of estimating images using INRs in the context of linear inverse problems. Towards this end, we study the sampling requirements for recovery of a continuous domain image from its low-pass Fourier coefficients by fitting a single hidden-layer INR with ReLU activation and a Fourier features layer using a generalized form of weight decay regularization. Our key insight is to relate minimizers of this non-convex parameter space optimization problem to minimizers of a convex penalty defined over an infinite-dimensional space of measures. We identify a sufficient number of samples for which an image realized by a width-1 INR is exactly recoverable by solving the INR training problem, and give a conjecture for the general width-$W$ case. To validate our theory, we empirically assess the probability of achieving exact recovery of images realized by low-width single hidden-layer INRs, and illustrate the performance of INR on super-resolution recovery of more realistic continuous domain phantom images.


title: The adhesive contact problem for a piecewise-homogeneous orthotropic plate with an elastic patch

abstract: A piecewise-homogeneous elastic orthotropic plate, reinforced with a finite patch of the wedgeshaped, which meets the interface at a right angle and is loaded with tangential and normal forces is considered. By using methods of the theory of analytic functions, the problem is reduced to the system of singular integro-differential equations (SIDE) with fixed singularity. Under tension-compression of patch by using an integral transformation a Riemann problem is obtained, the solution of which is presented in explicit form. The tangential contact stresses along the contact line are determined and their asymptotic behavior in the neighborhood of singular points is established.


title: Tensor Methods in High Dimensional Data Analysis: Opportunities and Challenges

abstract: Large amount of multidimensional data represented by multiway arrays or tensors are prevalent in modern applications across various fields such as chemometrics, genomics, physics, psychology, and signal processing. The structural complexity of such data provides vast new opportunities for modeling and analysis, but efficiently extracting information content from them, both statistically and computationally, presents unique and fundamental challenges. Addressing these challenges requires an interdisciplinary approach that brings together tools and insights from statistics, optimization and numerical linear algebra among other fields. Despite these hurdles, significant progress has been made in the last decade. This review seeks to examine some of the key advancements and identify common threads among them, under eight different statistical settings.

categories: math.ST cs.NA math.NA stat.ME stat.ML stat.TH


title: Homophily-adjusted social influence estimation

abstract: Homophily and social influence are two key concepts of social network analysis. Distinguishing between these phenomena is difficult, and approaches to disambiguate the two have been primarily limited to longitudinal data analyses. In this study, we provide sufficient conditions for valid estimation of social influence through cross-sectional data, leading to a novel homophily-adjusted social influence model which addresses the backdoor pathway of latent homophilic features. The oft-used network autocorrelation model (NAM) is the special case of our proposed model with no latent homophily, suggesting that the NAM is only valid when all homophilic attributes are observed. We conducted an extensive simulation study to evaluate the performance of our proposed homophily-adjusted model, comparing its results with those from the conventional NAM. Our findings shed light on the nuanced dynamics of social networks, presenting a valuable tool for researchers seeking to estimate the effects of social influence while accounting for homophily. Code to implement our approach is available at https://github.com/hanhtdpham/hanam.


title: Don't Forget to Connect! Improving RAG with Graph-based Reranking

abstract: Retrieval Augmented Generation (RAG) has greatly improved the performance of Large Language Model (LLM) responses by grounding generation with context from existing documents. These systems work well when documents are clearly relevant to a question context. But what about when a document has partial information, or less obvious connections to the context? And how should we reason about connections between documents? In this work, we seek to answer these two core questions about RAG generation. We introduce G-RAG, a reranker based on graph neural networks (GNNs) between the retriever and reader in RAG. Our method combines both connections between documents and semantic information (via Abstract Meaning Representation graphs) to provide a context-informed ranker for RAG. G-RAG outperforms state-of-the-art approaches while having smaller computational footprint. Additionally, we assess the performance of PaLM 2 as a reranker and find it to significantly underperform G-RAG. This result emphasizes the importance of reranking for RAG even when using Large Language Models.


title: Why are Visually-Grounded Language Models Bad at Image Classification?

abstract: Image classification is one of the most fundamental capabilities of machine vision intelligence. In this work, we revisit the image classification task using visually-grounded language models (VLMs) such as GPT-4V and LLaVA. We find that existing proprietary and public VLMs, despite often using CLIP as a vision encoder and having many more parameters, significantly underperform CLIP on standard image classification benchmarks like ImageNet. To understand the reason, we explore several hypotheses concerning the inference algorithms, training objectives, and data processing in VLMs. Our analysis reveals that the primary cause is data-related: critical information for image classification is encoded in the VLM's latent space but can only be effectively decoded with enough training data. Specifically, there is a strong correlation between the frequency of class exposure during VLM training and instruction-tuning and the VLM's performance in those classes; when trained with sufficient data, VLMs can match the accuracy of state-of-the-art classification models. Based on these findings, we enhance a VLM by integrating classification-focused datasets into its training, and demonstrate that the enhanced classification performance of the VLM transfers to its general capabilities, resulting in an improvement of 11.8% on the newly collected ImageWikiQA dataset.


title: 3D StreetUnveiler with Semantic-Aware 2DGS

abstract: Unveiling an empty street from crowded observations captured by in-car cameras is crucial for autonomous driving. However, removing all temporarily static objects, such as stopped vehicles and standing pedestrians, presents a significant challenge. Unlike object-centric 3D inpainting, which relies on thorough observation in a small scene, street scene cases involve long trajectories that differ from previous 3D inpainting tasks. The camera-centric moving environment of captured videos further complicates the task due to the limited degree and time duration of object observation. To address these obstacles, we introduce StreetUnveiler to reconstruct an empty street. StreetUnveiler learns a 3D representation of the empty street from crowded observations. Our representation is based on the hard-label semantic 2D Gaussian Splatting (2DGS) for its scalability and ability to identify Gaussians to be removed. We inpaint rendered image after removing unwanted Gaussians to provide pseudo-labels and subsequently re-optimize the 2DGS. Given its temporal continuous movement, we divide the empty street scene into observed, partial-observed, and unobserved regions, which we propose to locate through a rendered alpha map. This decomposition helps us to minimize the regions that need to be inpainted. To enhance the temporal consistency of the inpainting, we introduce a novel time-reversal framework to inpaint frames in reverse order and use later frames as references for earlier frames to fully utilize the long-trajectory observations. Our experiments conducted on the street scene dataset successfully reconstructed a 3D representation of the empty street. The mesh representation of the empty street can be extracted for further applications. The project page and more visualizations can be found at: https://streetunveiler.github.io


title: A physics-inspired evolutionary machine learning method: from the Schr\"odinger equation to an orbital-free-DFT kinetic energy functional

abstract: We introduce a machine learning (ML) supervised model function that is inspired by the variational principle of physics. This ML hypothesis evolutionary method, termed ML-Omega, allows us to go from data to differential equation(s) underlying the physical (chemical, engineering, etc.) phenomena the data are derived from. The fundamental equations of physics can be derived from this ML-Omega evolutionary method when provided the proper training data. By training the ML-Omega model function with only three hydrogen-like atom energies, the method can find Schr\"odinger's exact functional and, from it, Schr\"odinger's fundamental equation. Then, in the field of density functional theory (DFT), when the model function is trained with the energies from the known Thomas-Fermi (TF) formula E = -0.7687Z^7/3, it correctly finds the exact TF functional. Finally, the method is applied to find a local orbital-free (OF) functional expression of the independent electron kinetic energy functional Ts based on the gamma-TF-lambda-vW model. By considering the theoretical energies of only 5 atoms (He, Be, Ne, Mg, Ar) as the training set, the evolutionary ML-Omega method finds an ML-Omega-OF-DFT local Ts functional (gamma-TF-lambda-vW (0.964, 1/4)) that outperforms all the OF- DFT functionals of a representative group. Moreover, our ML-Omega-OF functional overcomes the LDA's and some local GGA-DFT's functionals' difficulty to describe the stretched bond region at the correct spin configuration of diatomic molecules. Although our evolutionary ML-Omega model function can work without an explicit prior-form functional, by using the techniques of symbolic regression, in this work we exploit prior-form functional expressions to make the training process faster in the example problems presented here.


title: Hierarchical World Models as Visual Whole-Body Humanoid Controllers

abstract: Whole-body control for humanoids is challenging due to the high-dimensional nature of the problem, coupled with the inherent instability of a bipedal morphology. Learning from visual observations further exacerbates this difficulty. In this work, we explore highly data-driven approaches to visual whole-body humanoid control based on reinforcement learning, without any simplifying assumptions, reward design, or skill primitives. Specifically, we propose a hierarchical world model in which a high-level agent generates commands based on visual observations for a low-level agent to execute, both of which are trained with rewards. Our approach produces highly performant control policies in 8 tasks with a simulated 56-DoF humanoid, while synthesizing motions that are broadly preferred by humans. Code and videos: https://nicklashansen.com/rlpuppeteer


title: Exploring the Evolution of Altruistic Punishment with a PDE Model of Cultural Multilevel Selection

abstract: Two mechanisms that have been used to study the evolution of cooperative behavior are altruistic punishment, in which cooperative individuals pay additional costs to punish defection, and multilevel selection, in which competition between groups can help to counteract individual-level incentives to cheat. Boyd, Gintis, Bowles, and Richerson have used simulation models of cultural evolution to suggest that altruistic punishment and pairwise group-level competition can work in concert to promote cooperation, even when neither mechanism can do so on its own. In this paper, we formulate a PDE model for multilevel selection motivated by the approach of Boyd and coauthors, modeling individual-level birth-death competition with a replicator equation based on individual payoffs and describing group-level competition with pairwise conflicts based on differences in the average payoffs of the competing groups. Building off of existing PDE models for multilevel selection with frequency-independent group-level competition, we use analytical and numerical techniques to understand how the forms of individual and average payoffs can impact the long-time ability to sustain altruistic punishment in group-structured populations. We find several interesting differences between the behavior of our new PDE model with pairwise group-level competition and existing multilevel PDE models, including the observation that our new model can feature a non-monotonic dependence of the long-time collective payoff on the strength of altruistic punishment. Going forward, our PDE framework can serve as a way to connect and compare disparate approaches for understanding multilevel selection across the literature in evolutionary biology and anthropology.


title: On attractor behavior in braneworld constant-roll inflation

abstract: We investigate in detail the attractor behavior of some inflationary models based on braneworld dynamics under the constant-roll condition. We describe the dynamics of the models, assuming that the second slow-roll parameter remains constant during inflation. We show that the dynamics of the considered models have the property of a cosmological attractor.


title: Bifurcations in Latch-Mediated Spring Actuation (LaMSA) Systems

abstract: In nature, different species of smaller animals produce ultra-fast movements to aid in their locomotion or protect themselves against predators. These ultra-fast impulsive motions are possible, as often times, there exist a small latch in the organism that could hold the potential energy of the system, and once released, generate an impulsive motion. These types of systems are classified as Latch Mediated Spring Actuated (LaMSA) systems, a multi-dimensional, multi-mode hybrid system that switches between a latched and an unlatched state. The LaMSA mechanism has been studied extensively in the field of biology and is observed in a wide range of animal species, such as the mantis shrimp, grasshoppers, and trap-jaw ants. In recent years, research has been done in mathematically modeling the LaMSA behavior with physical implementations of the mechanism. A significant focus is given to mimicking the physiological behavior of the species and following an end-to-end trajectory of impulsive motion. This paper introduces a foundational analysis of the theoretical dynamics of the contact latch-based LaMSA mechanism. The authors answer the question on what makes these small-scale systems impulsive, with a focus on the intrinsic properties of the system using bifurcations. Necessary and sufficient conditions are derived for the existence of the saddle fixed points. The authors propose a mathematical explanation for mediating the latch when a saddle node exists, and the impulsive behavior after the bifurcation happens.


title: JWST-TST High Contrast: JWST/NIRCam observations of the young giant planet $\beta$ Pic b

abstract: We present the first JWST/NIRCam observations of the directly-imaged gas giant exoplanet $\beta$ Pic b. Observations in six filters using NIRCam's round coronagraphic masks provide a high signal-to-noise detection of $\beta$ Pic b and the archetypal debris disk around $\beta$ Pic over a wavelength range of $\sim$1.7-5 $\mu$m. This paper focuses on the detection of $\beta$ Pic b and other potential point sources in the NIRCam data, following a paper by Rebollido et al. which presented the NIRCam and MIRI view of the debris disk around $\beta$ Pic. We develop and validate approaches for obtaining accurate photometry of planets in the presence of bright, complex circumstellar backgrounds. By simultaneously fitting the planet's PSF and a geometric model for the disk, we obtain planet photometry that is in good agreement with previous measurements from the ground. The NIRCam data supports the cloudy nature of $\beta$ Pic b's atmosphere and the discrepancy between its mass as inferred from evolutionary models and the dynamical mass reported in the literature. We further identify five additional localized sources in the data, but all of them are found to be background stars or galaxies based on their color or spatial extent. We can rule out additional planets in the disk midplane above 1 Jupiter mass outward of 2 arcsec ($\sim$40 au) and away from the disk midplane above 0.05 Jupiter masses outward of 4 arcsec ($\sim$80 au). The inner giant planet $\beta$ Pic c remains undetected behind the coronagraphic masks of NIRCam in our observations.


title: Afterglow Linear Polarization Signatures from Shallow GRB Jets: Implications for Energetic GRBs

abstract: Gamma-ray bursts (GRBs) are powered by ultra-relativistic jets. The launching sites of these jets are surrounded by dense media, which the jets must cross before they can accelerate and release the high energy emission. Interaction with the medium leads to the formation of a mildly relativistic sheath around the jet resulting in an angular structures in the jet's asymptotic Lorentz factor and energy per solid angle, which modifies the afterglow emission. We build a semi-analytical tool to analyze the afterglow light curve and polarization signatures of jets observed from a wide range of viewing angles, and focus on ones with slowly declining energy profiles known as shallow jets. We find overall lower polarization compared to the classical top-hat jet model. We provide an analytical expression for the peak polarization degree as a function of the energy profile power-law index, magnetic field configuration and viewing angle, and show that it occurs near the light curve break time for all viewers. When applying our tool to GRB 221009A, suspected to originate from a shallow jet, we find that the suggested jet structures for this event agree with the upper limits placed on the afterglow polarization in the optical and X-ray bands. We also find that at early times the polarization levels may be significantly higher, allowing for a potential distinction between different jet structure models and possibly constraining the magnetization in both forward and reverse shocks at that stage.


title: 3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting

abstract: Scene image editing is crucial for entertainment, photography, and advertising design. Existing methods solely focus on either 2D individual object or 3D global scene editing. This results in a lack of a unified approach to effectively control and manipulate scenes at the 3D level with different levels of granularity. In this work, we propose 3DitScene, a novel and unified scene editing framework leveraging language-guided disentangled Gaussian Splatting that enables seamless editing from 2D to 3D, allowing precise control over scene composition and individual objects. We first incorporate 3D Gaussians that are refined through generative priors and optimization techniques. Language features from CLIP then introduce semantics into 3D geometry for object disentanglement. With the disentangled Gaussians, 3DitScene allows for manipulation at both the global and individual levels, revolutionizing creative expression and empowering control over scenes and objects. Experimental results demonstrate the effectiveness and versatility of 3DitScene in scene image editing. Code and online demo can be found at our project homepage: https://zqh0253.github.io/3DitScene/.


title: ViG: Linear-complexity Visual Sequence Learning with Gated Linear Attention

abstract: Recently, linear complexity sequence modeling networks have achieved modeling capabilities similar to Vision Transformers on a variety of computer vision tasks, while using fewer FLOPs and less memory. However, their advantage in terms of actual runtime speed is not significant. To address this issue, we introduce Gated Linear Attention (GLA) for vision, leveraging its superior hardware-awareness and efficiency. We propose direction-wise gating to capture 1D global context through bidirectional modeling and a 2D gating locality injection to adaptively inject 2D local details into 1D global context. Our hardware-aware implementation further merges forward and backward scanning into a single kernel, enhancing parallelism and reducing memory cost and latency. The proposed model, ViG, offers a favorable trade-off in accuracy, parameters, and FLOPs on ImageNet and downstream tasks, outperforming popular Transformer and CNN-based models. Notably, ViG-S matches DeiT-B's accuracy while using only 27% of the parameters and 20% of the FLOPs, running 2$\times$ faster on $224\times224$ images. At $1024\times1024$ resolution, ViG-T uses 5.2$\times$ fewer FLOPs, saves 90% GPU memory, runs 4.8$\times$ faster, and achieves 20.7% higher top-1 accuracy than DeiT-T. These results position ViG as an efficient and scalable solution for visual representation learning. Code is available at \url{https://github.com/hustvl/ViG}.


title: GFlow: Recovering 4D World from Monocular Video

abstract: Reconstructing 4D scenes from video inputs is a crucial yet challenging task. Conventional methods usually rely on the assumptions of multi-view video inputs, known camera parameters, or static scenes, all of which are typically absent under in-the-wild scenarios. In this paper, we relax all these constraints and tackle a highly ambitious but practical task, which we termed as AnyV4D: we assume only one monocular video is available without any camera parameters as input, and we aim to recover the dynamic 4D world alongside the camera poses. To this end, we introduce GFlow, a new framework that utilizes only 2D priors (depth and optical flow) to lift a video (3D) to a 4D explicit representation, entailing a flow of Gaussian splatting through space and time. GFlow first clusters the scene into still and moving parts, then applies a sequential optimization process that optimizes camera poses and the dynamics of 3D Gaussian points based on 2D priors and scene clustering, ensuring fidelity among neighboring points and smooth movement across frames. Since dynamic scenes always introduce new content, we also propose a new pixel-wise densification strategy for Gaussian points to integrate new visual content. Moreover, GFlow transcends the boundaries of mere 4D reconstruction; it also enables tracking of any points across frames without the need for prior training and segments moving objects from the scene in an unsupervised way. Additionally, the camera poses of each frame can be derived from GFlow, allowing for rendering novel views of a video scene through changing camera pose. By employing the explicit representation, we may readily conduct scene-level or object-level editing as desired, underscoring its versatility and power. Visit our project website at: https://littlepure2333.github.io/GFlow


title: Classifying Overlapping Gaussian Mixtures in High Dimensions: From Optimal Classifiers to Neural Nets

abstract: We derive closed-form expressions for the Bayes optimal decision boundaries in binary classification of high dimensional overlapping Gaussian mixture model (GMM) data, and show how they depend on the eigenstructure of the class covariances, for particularly interesting structured data. We empirically demonstrate, through experiments on synthetic GMMs inspired by real-world data, that deep neural networks trained for classification, learn predictors which approximate the derived optimal classifiers. We further extend our study to networks trained on authentic data, observing that decision thresholds correlate with the covariance eigenvectors rather than the eigenvalues, mirroring our GMM analysis. This provides theoretical insights regarding neural networks' ability to perform probabilistic inference and distill statistical patterns from intricate distributions.


title: DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention

abstract: Diffusion models with large-scale pre-training have achieved significant success in the field of visual content generation, particularly exemplified by Diffusion Transformers (DiT). However, DiT models have faced challenges with scalability and quadratic complexity efficiency. In this paper, we aim to leverage the long sequence modeling capability of Gated Linear Attention (GLA) Transformers, expanding its applicability to diffusion models. We introduce Diffusion Gated Linear Attention Transformers (DiG), a simple, adoptable solution with minimal parameter overhead, following the DiT design, but offering superior efficiency and effectiveness. In addition to better performance than DiT, DiG-S/2 exhibits $2.5\times$ higher training speed than DiT-S/2 and saves $75.7\%$ GPU memory at a resolution of $1792 \times 1792$. Moreover, we analyze the scalability of DiG across a variety of computational complexity. DiG models, with increased depth/width or augmentation of input tokens, consistently exhibit decreasing FID. We further compare DiG with other subquadratic-time diffusion models. With the same model size, DiG-XL/2 is $4.2\times$ faster than the recent Mamba-based diffusion model at a $1024$ resolution, and is $1.8\times$ faster than DiT with CUDA-optimized FlashAttention-2 under the $2048$ resolution. All these results demonstrate its superior efficiency among the latest diffusion models. Code is released at https://github.com/hustvl/DiG.


title: Actions of tensor categories on Kirchberg algebras

abstract: We characterize the simplicity of Pimsner algebras for non-proper C*-correspondences. With the aid of this criterion, we give a systematic strategy to produce outer actions of unitary tensor categories on Kirchberg algebras. In particular, every countable unitary tensor category admits an outer action on the Cuntz algebra $\mathcal{O}_2$. We also discuss the realizability of modules over fusion rings as K-groups of Kirchberg algebras acted by unitary tensor categories. Several new examples are provided, among which actions on Cuntz algebras of 3-cocycle twists of cyclic groups are constructed for all possible 3-cohomological classes by answering a question asked by Izumi.


title: Feasibility of Privacy-Preserving Entity Resolution on Confidential Healthcare Datasets Using Homomorphic Encryption

abstract: Patient datasets contain confidential information which is protected by laws and regulations such as HIPAA and GDPR. Ensuring comprehensive patient information necessitates privacy-preserving entity resolution (PPER), which identifies identical patient entities across multiple databases from different healthcare organizations while maintaining data privacy. Existing methods often lack cryptographic security or are computationally impractical for real-world datasets. We introduce a PPER pipeline based on AMPPERE, a secure abstract computation model utilizing cryptographic tools like homomorphic encryption. Our tailored approach incorporates extensive parallelization techniques and optimal parameters specifically for patient datasets. Experimental results demonstrate the proposed method's effectiveness in terms of accuracy and efficiency compared to various baselines.


title: A Ramsey theorem for the reals

abstract: We prove that for every colouring of pairs of reals with finitely-many colours, there is a set homeomorphic to the rationals which takes no more than two colours. This was conjectured by Galvin in 1970, and a colouring of Sierpi{\'n}ski from 1933 witnesses that the number of colours cannot be reduced to one. Previously in 1985 Shelah had shown that a stronger statement is consistent with a forcing construction assuming the existence of large cardinals. Then in 2018 Raghavan and Todor\v{c}evi\'c had proved it assuming the existence of large cardinals. We prove it in $ZFC$. In fact Raghavan and Todor\v{c}evi\'c proved, assuming more large cardinals, a similar result for a large class of topological spaces. We prove this also, again in $ZFC$.


title: On the Origin of Llamas: Model Tree Heritage Recovery

abstract: The rapid growth of neural network models shared on the internet has made model weights an important data modality. However, this information is underutilized as the weights are uninterpretable, and publicly available models are disorganized. Inspired by Darwin's tree of life, we define the Model Tree which describes the origin of models i.e., the parent model that was used to fine-tune the target model. Similarly to the natural world, the tree structure is unknown. In this paper, we introduce the task of Model Tree Heritage Recovery (MoTHer Recovery) for discovering Model Trees in the ever-growing universe of neural networks. Our hypothesis is that model weights encode this information, the challenge is to decode the underlying tree structure given the weights. Beyond the immediate application of model authorship attribution, MoTHer recovery holds exciting long-term applications akin to indexing the internet by search engines. Practically, for each pair of models, this task requires: i) determining if they are related, and ii) establishing the direction of the relationship. We find that certain distributional properties of the weights evolve monotonically during training, which enables us to classify the relationship between two given models. MoTHer recovery reconstructs entire model hierarchies, represented by a directed tree, where a parent model gives rise to multiple child models through additional training. Our approach successfully reconstructs complex Model Trees, as well as the structure of "in-the-wild" model families such as Llama 2 and Stable Diffusion.


title: Notes on Applicability of GPT-4 to Document Understanding

abstract: We perform a missing, reproducible evaluation of all publicly available GPT-4 family models concerning the Document Understanding field, where it is frequently required to comprehend text spacial arrangement and visual clues in addition to textual semantics. Benchmark results indicate that though it is hard to achieve satisfactory results with text-only models, GPT-4 Vision Turbo performs well when one provides both text recognized by an external OCR engine and document images on the input. Evaluation is followed by analyses that suggest possible contamination of textual GPT-4 models and indicate the significant performance drop for lengthy documents.


title: Modeling the Feedback of AI Price Estimations on Actual Market Values

abstract: Public availability of Artificial Intelligence generated information can change the markets forever, and its factoring into economical dynamics may take economists by surprise, out-dating models and schools of thought. Real estate hyper-inflation is not a new phenomenon but its consistent and almost monotonous persistence over 12 years, coinciding with prominence of public estimation information from Zillow, a successful Mass Real Estate Estimator (MREE), could not escape unobserved. What we model is a repetitive theoretical game between the MREE and the home owners, where each player has secret information and expertise. If the intention is to keep housing affordable and maintain old American lifestyle with broad home-ownership, new challenges are defined. Simulations show that a simple restriction of MREE-style price estimation availability to opt-in properties may help partially reduce feedback loop by acting on its likely causes, as suggested by experimental simulation models. The conjecture that the MREE pressure on real estate inflation rate is correlated with the absolute MREE estimation errors, which is logically explainable, is then validated in simulations.

categories: econ.GN cs.AI cs.CE cs.CY cs.GT q-fin.EC


title: QUBIQ: Uncertainty Quantification for Biomedical Image Segmentation Challenge

abstract: Uncertainty in medical image segmentation tasks, especially inter-rater variability, arising from differences in interpretations and annotations by various experts, presents a significant challenge in achieving consistent and reliable image segmentation. This variability not only reflects the inherent complexity and subjective nature of medical image interpretation but also directly impacts the development and evaluation of automated segmentation algorithms. Accurately modeling and quantifying this variability is essential for enhancing the robustness and clinical applicability of these algorithms. We report the set-up and summarize the benchmark results of the Quantification of Uncertainties in Biomedical Image Quantification Challenge (QUBIQ), which was organized in conjunction with International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2020 and 2021. The challenge focuses on the uncertainty quantification of medical image segmentation which considers the omnipresence of inter-rater variability in imaging datasets. The large collection of images with multi-rater annotations features various modalities such as MRI and CT; various organs such as the brain, prostate, kidney, and pancreas; and different image dimensions 2D-vs-3D. A total of 24 teams submitted different solutions to the problem, combining various baseline models, Bayesian neural networks, and ensemble model techniques. The obtained results indicate the importance of the ensemble models, as well as the need for further research to develop efficient 3D methods for uncertainty quantification methods in 3D segmentation tasks.


title: Partial Algebras of Sobolev Spaces and their Groupoid Characterization

abstract: The partial multiplication by weak product and the weak derivative operation delineate the Sobolev spaces $W^{k,p}(\Omega)$ as locally convex partial $^*$-algebras on $L^p(\Omega)$. We characterised them as locally convex Lie groupoids $\mathscr{W} := W^{k,p}(\Omega) \rightrightarrows L^p(\Omega)$. As invariant spaces of the convolution actions of the smooth algebra $\mathscr{K}(\Omega)$ on the Banach spaces $L^p(\Omega)$, the resulting Lie groupoids $\mathscr{W}$ is shown to have a unitary representation on a Hilbert bundle and a $^*$-representation on its $C^*$-algebra.


title: Transductive Zero-Shot and Few-Shot CLIP

abstract: Transductive inference has been widely investigated in few-shot image classification, but completely overlooked in the recent, fast growing literature on adapting vision-langage models like CLIP. This paper addresses the transductive zero-shot and few-shot CLIP classification challenge, in which inference is performed jointly across a mini-batch of unlabeled query samples, rather than treating each instance independently. We initially construct informative vision-text probability features, leading to a classification problem on the unit simplex set. Inspired by Expectation-Maximization (EM), our optimization-based classification objective models the data probability distribution for each class using a Dirichlet law. The minimization problem is then tackled with a novel block Majorization-Minimization algorithm, which simultaneously estimates the distribution parameters and class assignments. Extensive numerical experiments on 11 datasets underscore the benefits and efficacy of our batch inference approach.On zero-shot tasks with test batches of 75 samples, our approach yields near 20% improvement in ImageNet accuracy over CLIP's zero-shot performance. Additionally, we outperform state-of-the-art methods in the few-shot setting. The code is available at: https://github.com/SegoleneMartin/transductive-CLIP.


title: GHOST: Grounded Human Motion Generation with Open Vocabulary Scene-and-Text Contexts

abstract: The connection between our 3D surroundings and the descriptive language that characterizes them would be well-suited for localizing and generating human motion in context but for one problem. The complexity introduced by multiple modalities makes capturing this connection challenging with a fixed set of descriptors. Specifically, closed vocabulary scene encoders, which require learning text-scene associations from scratch, have been favored in the literature, often resulting in inaccurate motion grounding. In this paper, we propose a method that integrates an open vocabulary scene encoder into the architecture, establishing a robust connection between text and scene. Our two-step approach starts with pretraining the scene encoder through knowledge distillation from an existing open vocabulary semantic image segmentation model, ensuring a shared text-scene feature space. Subsequently, the scene encoder is fine-tuned for conditional motion generation, incorporating two novel regularization losses that regress the category and size of the goal object. Our methodology achieves up to a 30% reduction in the goal object distance metric compared to the prior state-of-the-art baseline model on the HUMANISE dataset. This improvement is demonstrated through evaluations conducted using three implementations of our framework and a perceptual study. Additionally, our method is designed to seamlessly accommodate future 2D segmentation methods that provide per-pixel text-aligned features for distillation.


title: The Polynomial Hierarchy does not collapse

abstract: The arithmetical hierarchy (AH) is similar to the polynomial hierarchy (PH). Unlike the PH, the AH does not collapse relative to any oracle. A language in the (k + 1)-st level of the AH is computable enumerable (c.e.) relative to the kth level. So, given an oracle in the kth level of the AH, we could use a black-box search to decide whether the input word is in the language. With very large padding arguments, i.e. the paddings grow faster than any relative to the level k of the AH computable function, we would construct a language contained in the k + 1 level of PH, if we use only a finite set of input words. From the oracle in AH, we would construct an analogue oracle at the kth level of PH. For the input words of the finite set, a word is in the language of AH, if and only if it is in the language of PH. And the input word is in the oracle set of AH, if and only if it is in the oracle of PH. As in the language of AH, we must apply a black-box search in the language of PH. So, we would also have exponentially many oracle queries in the language of PH. The PH does not collapse.


title: Spatiotemporal Diffusion Metamaterials: Theories and Applications

abstract: Diffusion metamaterials with artificial spatial structures have significant potential in controlling energy and mass transfer. Those static structures may lead to functionality and tunability constraints, impeding the application scope of diffusion metamaterials. Dynamic structures, adding the temporal dimension, have recently provided a new possibility for electric charge and heat diffusion regulation. This perspective introduces the fundamental theories and practical constructions of spatiotemporal diffusion metamaterials for achieving nonreciprocal, topological, or tunable properties. Compared with traditional static design, spatiotemporal modulation is promising to manipulate diffusion processes dynamically, with applications of real-time thermal coding and programming. Existing spatiotemporal diffusion explorations are primarily at macroscopic systems, and we may envision extending these results to microscale and other physical domains like thermal radiation and mass diffusion shortly.


title: On Nirmala indices based entropy measures for the complex structure of ruthenium bipyridine

abstract: A numerical parameter, known as a topological index, is employed to represent the molecular structure of a compound by considering its graph-theoretical properties. In the study of quantitative structure-activity relationships (QSAR) and quantitative structure-property relationships (QSPR), topological indices are used to predict the physicochemical properties of chemical compounds. Graph entropies have evolved as information-theoretic tools to investigate the structural information of a molecular graph. In this study, we compute the Nirmala index, the first and second inverse Nirmala index of the complex structure of ruthenium bipyridine, with the help of its M-polynomial. Furthermore, entropy measures for the complex structure of ruthenium bipyridine are computed using Shannon's entropy model. The comparison between the Nirmala indices and their associated entropy measures is presented through numerical computation. The correlation between the Nirmala indices and associated entropy measurements is then examined using a regression model. Finally, it is shown that the structural characteristics and properties of the complex structure of ruthenium bipyridine will be predicted by Nirmala indices-based entropy measures rather than the Nirmala indices.


title: Perspective: Probing elasto-quantum materials with X-ray techniques and in situ anisotropic strain

abstract: Anisotropic lattice deformation plays an important role in the quantum mechanics of solid state physics. The possibility of mediating the competition and cooperation among different order parameters by applying in situ strain/stress on quantum materials has led to discoveries of a variety of elasto-quantum effects on emergent phenomena. It has become increasingly critical to have the capability of combining the in situ strain tuning with X-ray techniques, especially those based on synchrotrons, to probe the microscopic elasto-responses of the lattice, spin, charge, and orbital degrees of freedom. Herein, we briefly review the recent studies that embarked on utilizing elasto-X-ray characterizations on representative material systems and demonstrated the emerging opportunities enabled by this method. With that, we further discuss the promising prospect in this rising area of quantum materials research and the bright future of elasto-X-ray techniques.


title: Using Thermal Crowding to Direct Pattern Formation on the Nanoscale

abstract: Metal films and other geometries of nanoscale thickness, when exposed to laser irradiation, melt and evolve as fluids as long as their temperature is sufficiently high. This evolution often leads to pattern formation, which may be influenced strongly by material parameters that are temperature dependent. In addition, the laser heat absorption itself depends on the time-dependent metal thickness. Self-consistent modeling of evolving metal films shows that, by controlling the amount and geometry of deposited metal, one could control the instability development. In particular, depositing additional metal leads to elevated temperatures through the `thermal crowding' effect, which strongly influences the metal film evolution. This influence may proceed via disjoint metal geometries, by heat diffusion through the underlying substrate. Fully self-consistent modeling focusing on the dominant effects, as well as accurate time-dependent simulations, allow us to describe the main features of thermal crowding and provide a route to control fluid instabilities and pattern formation on the nanoscale.


title: Discovering deposition process regimes: leveraging unsupervised learning for process insights, surrogate modeling, and sensitivity analysis

abstract: This work introduces a comprehensive approach utilizing data-driven methods to elucidate the deposition process regimes in Chemical Vapor Deposition (CVD) reactors and the interplay of physical mechanism that dominate in each one of them. Through this work, we address three key objectives. Firstly, our methodology relies on process outcomes, derived by a detailed CFD model, to identify clusters of "outcomes" corresponding to distinct process regimes, wherein the relative influence of input variables undergoes notable shifts. This phenomenon is experimentally validated through Arrhenius plot analysis, affirming the efficacy of our approach. Secondly, we demonstrate the development of an efficient surrogate model, based on Polynomial Chaos Expansion (PCE), that maintains accuracy, facilitating streamlined computational analyses. Finally, as a result of PCE, sensitivity analysis is made possible by means of Sobol' indices, that quantify the impact of process inputs across identified regimes. The insights gained from our analysis contribute to the formulation of hypotheses regarding phenomena occurring beyond the transition regime. Notably, the significance of temperature even in the diffusion-limited regime, as evidenced by the Arrhenius plot, suggests activation of gas phase reactions at elevated temperatures. Importantly, our proposed methods yield insights that align with experimental observations and theoretical principles, aiding decision-making in process design and optimization. By circumventing the need for costly and time-consuming experiments, our approach offers a pragmatic pathway towards enhanced process efficiency. Moreover, this study underscores the potential of data-driven computational methods for innovating reactor design paradigms.

categories: physics.chem-ph cs.LG cs.SY eess.SY stat.AP


title: "Stumbling-to-Fetters" mechanism and Virginia Creeper model in hydrogel for designing bionic cardiovascular system

abstract: Manufacturing hydrogels with identical electrochemical properties are typically riddled with unresolved inquiries and challenges. Here, we utilized ultra-light graphene flakes to trace the influence of convection phenomena during reactions on hydrogels' formation and structural non-uniformity, elucidating its mechanisms. Furthermore, we confirmed that an external electric field induced the orientation of functional groups of hydrogels along the direction of this field, revealing the mechanism of its influence on the structural non-uniformity and electrochemical properties of hydrogels. Additionally, we discovered that ion diffusion was "Stumbling-to-Fetters" by the functional groups on the polymer chains within the hydrogel, unveiling this mechanism and developing the Virginia Creeper (VC) model for hydrogels. We demonstrated the scalability and application of the VC model. Furthermore, we proposed a molecular-ion diffusion and current decay equation to describe the electrochemical properties of hydrogels. As an application of the VC model, we developed a bionic cardiovascular system and proved its potential to seamlessly interface with living organisms and generate bio-like bioelectricity. Our findings provide novel insights into triboelectricity and guidance for producing hydrogels with identical electrochemical properties, and offer a new pathway for bioelectric generation and the design of new hydrogel devices.


title: Two lower bounds for maximum matching

abstract: In this paper, we prove two lower bounds for the maximum matching size in an arbitrary undirected graph. Despite their simplicity, these results are not widely known. This article aims to bring pleasure to the reader by giving short combinatorial proofs of these easy-to-state estimates.