title: Superconductivity in twisted bilayer WSe$_2$

abstract: The discovery of superconductivity in twisted bilayer and twisted trilayer graphene has generated tremendous interest. The key feature of these systems is an interplay between interlayer coupling and a moir\'e superlattice that gives rise to low-energy flat bands with strong correlations. Flat bands can also be induced by moir\'e patterns in lattice-mismatched and or twisted heterostructures of other two-dimensional materials such as transition metal dichalcogenides (TMDs). Although a wide range of correlated phenomenon have indeed been observed in the moir\'e TMDs, robust demonstration of superconductivity has remained absent. Here we report superconductivity in 5 degree twisted bilayer WSe$_2$ (tWSe$_2$) with a maximum critical temperature of 426 mK. The superconducting state appears in a limited region of displacement field and density that is adjacent to a metallic state with Fermi surface reconstruction believed to arise from antiferromagnetic order. A sharp boundary is observed between the superconducting and magnetic phases at low temperature, reminiscent of spin-fluctuation mediated superconductivity. Our results establish that moir\'e flat-band superconductivity extends beyond graphene structures. Material properties that are absent in graphene but intrinsic among the TMDs such as a native band gap, large spin-orbit coupling, spin-valley locking, and magnetism offer the possibility to access a broader superconducting parameter space than graphene-only structures.


title: Logistic growth in seasonally changing environments

abstract: We consider a parameter dependent periodic-logistic problem with a logistic term involving a degeneracy that replicates time dependent refuges in the habitat of a population. Working under no or very minimal assumptions on the boundary regularity of the domain we show the existence of a time-periodic solution which bifurcates with respect to the parameter and show their stability. We show that under suitable assumptions that the periodic solution blows up on part of the domain and remains finite on other parts when the parameter approaches a critical value.


title: Dynamic properties of a class of van der Pol-Duffing oscillators

abstract: In this paper, we study the existence of bifurcation of a van der Pol-Duffing oscillator with quintic terms and its quasi-periodic solutions by means of qualitative and bifurcation theories. Firstly, we analyze the autonomous system and find that it has two kinds of local bifurcations and a global bifurcation: pitchfork bifurcation, Hopf bifurcation, homoclinic bifurcation. It is worth noting that the disappearance of the homoclinic orbit is synchronized with the emergence of a large limit cycle. Then, by discussing the stability of equilibria at infinity and the orientation of the trajectory, the existence and stability of limit circles of the autonomous system are analyzed by combining the Poincar\'{e}-Bendixson theorem and the index theory. The global phase portrait and the numerical simulation of the autonomous system in different parameter values are given. Finally, the existence of periodic and quasi-periodic solutions to periodic forced system is proved by a KAM theorem.


title: Post-hoc Part-prototype Networks

abstract: Post-hoc explainability methods such as Grad-CAM are popular because they do not influence the performance of a trained model. However, they mainly reveal "where" a model looks at for a given input, fail to explain "what" the model looks for (e.g., what is important to classify a bird image to a Scott Oriole?). Existing part-prototype networks leverage part-prototypes (e.g., characteristic Scott Oriole's wing and head) to answer both "where" and "what", but often under-perform their black box counterparts in the accuracy. Therefore, a natural question is: can one construct a network that answers both "where" and "what" in a post-hoc manner to guarantee the model's performance? To this end, we propose the first post-hoc part-prototype network via decomposing the classification head of a trained model into a set of interpretable part-prototypes. Concretely, we propose an unsupervised prototype discovery and refining strategy to obtain prototypes that can precisely reconstruct the classification head, yet being interpretable. Besides guaranteeing the performance, we show that our network offers more faithful explanations qualitatively and yields even better part-prototypes quantitatively than prior part-prototype networks.


title: Causal Inference from Competing Treatments

abstract: Many applications of RCTs involve the presence of multiple treatment administrators -- from field experiments to online advertising -- that compete for the subjects' attention. In the face of competition, estimating a causal effect becomes difficult, as the position at which a subject sees a treatment influences their response, and thus the treatment effect. In this paper, we build a game-theoretic model of agents who wish to estimate causal effects in the presence of competition, through a bidding system and a utility function that minimizes estimation error. Our main technical result establishes an approximation with a tractable objective that maximizes the sample value obtained through strategically allocating budget on subjects. This allows us to find an equilibrium in our model: we show that the tractable objective has a pure Nash equilibrium, and that any Nash equilibrium is an approximate equilibrium for our general objective that minimizes estimation error under broad conditions. Conceptually, our work successfully combines elements from causal inference and game theory to shed light on the equilibrium behavior of experimentation under competition.


title: Improving Users' Passwords with DPAR: a Data-driven Password Recommendation System

abstract: Passwords are the primary authentication method online, but even with password policies and meters, users still find it hard to create strong and memorable passwords. In this paper, we propose DPAR: a Data-driven PAssword Recommendation system based on a dataset of 905 million leaked passwords. DPAR generates password recommendations by analyzing the user's given password and suggesting specific tweaks that would make it stronger while still keeping it memorable and similar to the original password. We conducted two studies to evaluate our approach: verifying the memorability of generated passwords (n=317), and evaluating the strength and recall of DPAR recommendations against password meters (n=441). In a randomized experiment, we show that DPAR increased password strength by 34.8 bits on average and did not significantly affect the ability to recall their password. Furthermore, 36.6% of users accepted DPAR's recommendations verbatim. We discuss our findings and their implications for enhancing password management with recommendation systems.


title: Computational lower bounds for multi-frequency group synchronization

abstract: We consider a group synchronization problem with multiple frequencies which involves observing pairwise relative measurements of group elements on multiple frequency channels, corrupted by Gaussian noise. We study the computational phase transition in the problem of detecting whether a structured signal is present in such observations by analyzing low-degree polynomial algorithms. We show that, assuming the low-degree conjecture, in synchronization models over arbitrary finite groups as well as over the circle group $SO(2)$, a simple spectral algorithm is optimal among algorithms of runtime $\exp(\tilde{\Omega}(n^{1/3}))$ for detection from an observation including a constant number of frequencies. Combined with an upper bound for the statistical threshold shown in Perry et al., our results indicate the presence of a statistical-to-computational gap in such models with a sufficiently large number of frequencies.


title: Field Theory Approach to Classical $N$-Particle Systems In and Out of Equilibrium

abstract: We present an approach to solving the evolution of a classical $N$-particle ensemble based on the path integral approach to classical mechanics. This formulation provides a perturbative solution to the Liouville equation in terms of a propagator which can be expanded in a Dyson series. We show that this perturbative expansion exactly corresponds to an iterative solution of the BBGKY-hierarchy in orders of the interaction potential. Using the path integral formulation, we perform a Hubbard-Stratonovich transformation (HST) to obtain an effective field theoretic description in terms of macroscopic fields, which contains the full microscopic dynamics of the system in its vertices. Naturally, the HST leads to a new perturbative expansion scheme which contains an infinite order of microscopic interactions already at the lowest order of the perturbative expansion. Our approach can be applied to in and out of equilibrium systems with arbitrary interaction potentials and initial conditions. We show how (unequal-time) cumulants of the Klimontovich phase space densities can be computed within this framework and derive results for density and momentum correlations for a spatially homogeneous system. Under the explicit assumptions for the interaction potential and initial conditions, we show that well-known results related to plasma oscillations and the Jeans instability criterion for gravitational collapse can be recovered in the lowest order perturbative expansion and that both are the effect of the same collective behaviour of the many-body system.


title: Vertex Representation of Hyperbolic Tensor Networks

abstract: We propose a vertex representation of the tensor network (TN) in the anti-de Sitter space (AdS$_{2+0}$) that we model on a subset of hyperbolic lattices. The tensors form a network of regular $p$-sided polygons ($p>4$) with the coordination number four. The response to multi-state spin systems on the hyperbolic TN is analyzed for their entire parameter space. We show that entanglement entropy is sensitive to distinguish various hyperbolic geometries whereas other thermodynamic quantities are not. We test the numerical accuracy of vertex TNs in the phase transitions of the first, second, and infinite order at the point of maximal entanglement entropy. The hyperbolic structure of TNs induces non-critical properties in the bulk although boundary conditions significantly affect the total free energy in the thermodynamic limit. Thus developed vertex-type TN can be applied to study low-energy quantum states on AdS.


title: The strong data processing inequality under the heat flow

abstract: Let $\nu$ and $\mu$ be probability distributions on $\mathbb{R}^n$, and $\nu_s,\mu_s$ be their evolution under the heat flow, that is, the probability distributions resulting from convolving their density with the density of an isotropic Gaussian random vector with variance $s$ in each entry. This paper studies the rate of decay of $s\mapsto D(\nu_s\|\mu_s)$ for various divergences, including the $\chi^2$ and Kullback-Leibler (KL) divergences. We prove upper and lower bounds on the strong data-processing inequality (SDPI) coefficients corresponding to the source $\mu$ and the Gaussian channel. We also prove generalizations of de Brujin's identity, and Costa's result on the concavity in $s$ of the differential entropy of $\nu_s$. As a byproduct of our analysis, we obtain new lower bounds on the mutual information between $X$ and $Y=X+\sqrt{s} Z$, where $Z$ is a standard Gaussian vector in $\mathbb{R}^n$, independent of $X$, and on the minimum mean-square error (MMSE) in estimating $X$ from $Y$, in terms of the Poincar\'e constant of $X$.


title: HelloFresh: LLM Evaluations on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits

abstract: Benchmarks have been essential for driving progress in machine learning. A better understanding of LLM capabilities on real world tasks is vital for safe development. Designing adequate LLM benchmarks is challenging: Data from real-world tasks is hard to collect, public availability of static evaluation data results in test data contamination and benchmark overfitting, and periodically generating new evaluation data is tedious and may result in temporally inconsistent results. We introduce HelloFresh, based on continuous streams of real-world data generated by intrinsically motivated human labelers. It covers recent events from X (formerly Twitter) community notes and edits of Wikipedia pages, mitigating the risk of test data contamination and benchmark overfitting. Any X user can propose an X note to add additional context to a misleading post (formerly tweet); if the community classifies it as helpful, it is shown with the post. Similarly, Wikipedia relies on community-based consensus, allowing users to edit articles or revert edits made by other users. Verifying whether an X note is helpful or whether a Wikipedia edit should be accepted are hard tasks that require grounding by querying the web. We backtest state-of-the-art LLMs supplemented with simple web search access and find that HelloFresh yields a temporally consistent ranking. To enable continuous evaluation on HelloFresh, we host a public leaderboard and periodically updated evaluation data at https://tinyurl.com/hello-fresh-LLM.


title: Quantitative metastability of the Tikhonov-Mann iteration for countable families of mappings

abstract: In this paper, we obtain rates of metastability for the Tikhonov-Mann iteration for countable families of mappings in CAT(0) spaces. This iteration was recently defined by the author in the setting of W-hyperbolic spaces as a generalization of the strongly convergent version of the Krasnoselskii-Mann iteration introduced by Bot and Meier for finding common fixed points of families of nonexpansive mappings in Hilbert spaces, and as an extension of the Tikhonov-Mann iteration for single mappings, for which Leustean and the author obtained rates of asymptotic regularity in W-hyperbolic spaces.


title: Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis

abstract: Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their superior performance. Built upon these advances, transformers have conjoined CNNs as two leading foundational models for learning visual representations. However, transformers are hindered by the $\mathcal{O}(N^2)$ complexity of their attention mechanisms, while CNNs lack global receptive fields and dynamic weight allocation. State Space Models (SSMs), specifically the \textit{\textbf{Mamba}} model with selection mechanisms and hardware-aware architecture, have garnered immense interest lately in sequential modeling and visual representation learning, challenging the dominance of transformers by providing infinite context lengths and offering substantial efficiency maintaining linear complexity in the input sequence. Capitalizing on the advances in computer vision, medical imaging has heralded a new epoch with Mamba models. Intending to help researchers navigate the surge, this survey seeks to offer an encyclopedic review of Mamba models in medical imaging. Specifically, we start with a comprehensive theoretical review forming the basis of SSMs, including Mamba architecture and its alternatives for sequence modeling paradigms in this context. Next, we offer a structured classification of Mamba models in the medical field and introduce a diverse categorization scheme based on their application, imaging modalities, and targeted organs. Finally, we summarize key challenges, discuss different future research directions of the SSMs in the medical domain, and propose several directions to fulfill the demands of this field. In addition, we have compiled the studies discussed in this paper along with their open-source implementations on our GitHub repository.


title: CattleFace-RGBT: RGB-T Cattle Facial Landmark Benchmark

abstract: To address this challenge, we introduce CattleFace-RGBT, a RGB-T Cattle Facial Landmark dataset consisting of 2,300 RGB-T image pairs, a total of 4,600 images. Creating a landmark dataset is time-consuming, but AI-assisted annotation can help. However, applying AI to thermal images is challenging due to suboptimal results from direct thermal training and infeasible RGB-thermal alignment due to different camera views. Therefore, we opt to transfer models trained on RGB to thermal images and refine them using our AI-assisted annotation tool following a semi-automatic annotation approach. Accurately localizing facial key points on both RGB and thermal images enables us to not only discern the cattle's respiratory signs but also measure temperatures to assess the animal's thermal state. To the best of our knowledge, this is the first dataset for the cattle facial landmark on RGB-T images. We conduct benchmarking of the CattleFace-RGBT dataset across various backbone architectures, with the objective of establishing baselines for future research, analysis, and comparison. The dataset and models are at https://github.com/UARK-AICV/CattleFace-RGBT-benchmark


title: Bayesian inference for scale mixtures of skew-normal linear models under the centered parameterization

abstract: In many situations we are interested in modeling real data where the response distribution, even conditionally on the covariates, presents asymmetry and/or heavy/light tails. In these situations, it is more suitable to consider models based on the skewed and/or heavy/light tailed distributions, such as the class of scale mixtures of skew-normal distributions. The classical parameterization of this distributions may not be good due to the some inferential issues when the skewness parameter is in a neighborhood of 0, then, the centered parameterization becomes more appropriate. In this paper, we developed a class of scale mixtures of skew-normal distributions under the centered parameterization, also a linear regression model based on them was proposed. We explore a hierarchical representation and set up a MCMC scheme for parameter estimation. Furthermore, we developed residuals and influence analysis tools. A Monte Carlo experiment is conducted to evaluate the performance of the MCMC algorithm and the behavior of the residual distribution. The methodology is illustrated with the analysis of a real data set.


title: Cell divisions imprint long lasting elastic strain fields in epithelial tissues

abstract: A hallmark of biological tissues, viewed as complex cellular materials, is the active generation of mechanical stresses by cellular processes, such as cell divisions. Each cellular event generates a force dipole that deforms the surrounding tissue. Therefore, a quantitative description of these force dipoles, and their consequences on tissue mechanics, is one of the central problems in understanding the overall tissue mechanics. In this work we analyze previously published experimental data on fruit fly \textit{D. melanogaster} wing epithelia to quantitatively describe the deformation fields induced by a cell-scale force dipole. We find that the measured deformation field can be explained by a simple model of fly epithelium as a linearly elastic sheet. This fact allows us to use measurements of the strain field around cellular events, such as cell divisions, to infer the magnitude and dynamics of the mechanical forces they generate. In particular, we find that cell divisions exert a transient isotropic force dipole field, corresponding to the temporary localisation of the cell nucleus to the tissue surface during the division, and traceless-symmetric force dipole field that remains detectable from the tissue strain field for up to about $3.5$ hours after the division. This is the timescale on which elastic strains are erased by other mechanical processes and therefore it corresponds to the tissue fluidization timescale. In summary, we have developed a method to infer force dipoles induced by cell divisions, by observing the strain field in the surrounding tissues. Using this method we quantitatively characterize mechanical forces generated during a cell division, and their effects on the tissue mechanics.


title: Unified PAC-Bayesian Study of Pessimism for Offline Policy Learning with Regularized Importance Sampling

abstract: Off-policy learning (OPL) often involves minimizing a risk estimator based on importance weighting to correct bias from the logging policy used to collect data. However, this method can produce an estimator with a high variance. A common solution is to regularize the importance weights and learn the policy by minimizing an estimator with penalties derived from generalization bounds specific to the estimator. This approach, known as pessimism, has gained recent attention but lacks a unified framework for analysis. To address this gap, we introduce a comprehensive PAC-Bayesian framework to examine pessimism with regularized importance weighting. We derive a tractable PAC-Bayesian generalization bound that universally applies to common importance weight regularizations, enabling their comparison within a single framework. Our empirical results challenge common understanding, demonstrating the effectiveness of standard IW regularization techniques.


title: Stabilizing massless fields with fluxes in Landau-Ginzburg models

abstract: Recent work on flux compactifications suggests that the tadpole constraint generically allows only a limited number of complex structure moduli to become massive, i.e., be stabilized at quadratic order in the spacetime superpotential. We study the effects of higher-order terms systematically around the Fermat point in the $1^9$ Landau-Ginzburg model. This model lives at strong coupling and features no K\"ahler moduli. We show that, depending on the flux, several massless fields can indeed be stabilized in this fashion, and argue that this paves the way to explicit ${\mathcal N}=1$ Minkowski vacua without flat directions. Along the way, we complete the classification of integral flux vectors with small tadpole contribution. Thereby we are closing in on a future complete understanding of all possible flux configurations in the $1^9$ Landau-Ginzburg model.


title: Analytical Survival Analysis of the Non-autonomous Ornstein-Uhlenbeck Process

abstract: The survival probability for a periodic non-autonomous Ornstein-Uhlenbeck process is calculated analytically using two different methods. The first uses an asymptotic approach. We treat the associated Kolmogorov Backward Equation with an absorbing boundary by dividing the domain into an interior region, centered around the origin, and a "boundary layer" near the absorbing boundary. In each region we determine the leading-order analytical solutions, and construct a uniformly valid solution over the entire domain using asymptotic matching. In the second method we examine the integral relationship between the probability density function and the mean first passage time probability density function. These allow us to determine approximate analytical forms for the exit rate. The validity of the solutions derived from both methods is assessed numerically, and we find the asymptotic method to be superior.


title: Transfer Learning for Latent Variable Network Models

abstract: We study transfer learning for estimation in latent variable network models. In our setting, the conditional edge probability matrices given the latent variables are represented by $P$ for the source and $Q$ for the target. We wish to estimate $Q$ given two kinds of data: (1) edge data from a subgraph induced by an $o(1)$ fraction of the nodes of $Q$, and (2) edge data from all of $P$. If the source $P$ has no relation to the target $Q$, the estimation error must be $\Omega(1)$. However, we show that if the latent variables are shared, then vanishing error is possible. We give an efficient algorithm that utilizes the ordering of a suitably defined graph distance. Our algorithm achieves $o(1)$ error and does not assume a parametric form on the source or target networks. Next, for the specific case of Stochastic Block Models we prove a minimax lower bound and show that a simple algorithm achieves this rate. Finally, we empirically demonstrate our algorithm's use on real-world and simulated graph transfer problems.


title: CSI-GPT: Integrating Generative Pre-Trained Transformer with Federated-Tuning to Acquire Downlink Massive MIMO Channels

abstract: In massive multiple-input multiple-output (MIMO) systems, how to reliably acquire downlink channel state information (CSI) with low overhead is challenging. In this work, by integrating the generative pre-trained Transformer (GPT) with federated-tuning, we propose a CSI-GPT approach to realize efficient downlink CSI acquisition. Specifically, we first propose a Swin Transformer-based channel acquisition network (SWTCAN) to acquire downlink CSI, where pilot signals, downlink channel estimation, and uplink CSI feedback are jointly designed. Furthermore, to solve the problem of insufficient training data, we propose a variational auto-encoder-based channel sample generator (VAE-CSG), which can generate sufficient CSI samples based on a limited number of high-quality CSI data obtained from the current cell. The CSI dataset generated from VAE-CSG will be used for pre-training SWTCAN. To fine-tune the pre-trained SWTCAN for improved performance, we propose an online federated-tuning method, where only a small amount of SWTCAN parameters are unfrozen and updated using over-the-air computation, avoiding the high communication overhead caused by aggregating the complete CSI samples from user equipment (UEs) to the BS for centralized fine-tuning. Simulation results verify the advantages of the proposed SWTCAN and the communication efficiency of the proposed federated-tuning method.


title: Text-to-Events: Synthetic Event Camera Streams from Conditional Text Input

abstract: Event cameras are advantageous for tasks that require vision sensors with low-latency and sparse output responses. However, the development of deep network algorithms using event cameras has been slow because of the lack of large labelled event camera datasets for network training. This paper reports a method for creating new labelled event datasets by using a text-to-X model, where X is one or multiple output modalities, in the case of this work, events. Our proposed text-to-events model produces synthetic event frames directly from text prompts. It uses an autoencoder which is trained to produce sparse event frames representing event camera outputs. By combining the pretrained autoencoder with a diffusion model architecture, the new text-to-events model is able to generate smooth synthetic event streams of moving objects. The autoencoder was first trained on an event camera dataset of diverse scenes. In the combined training with the diffusion model, the DVS gesture dataset was used. We demonstrate that the model can generate realistic event sequences of human gestures prompted by different text statements. The classification accuracy of the generated sequences, using a classifier trained on the real dataset, ranges between 42% to 92%, depending on the gesture group. The results demonstrate the capability of this method in synthesizing event datasets.


title: Analysis of experimental data on neutron decay for the possibility of the existence of a right vector boson $W_R$

abstract: Due to the assumption that sterile neutrinos are right-handed neutrinos, an analysis of the modern experimental situation in neutron decay for right-handed currents was carried out. As a result of the analysis, it was found that there are indications of the existence of a right-handed vector boson $W_R$ with a mass $M_{W_R}\approx 870_{-140}^{+260} \text{GeV}$ and a mixing angle with $W_L$: $\zeta=0.061_{-0.024}^{+0.017}$. This circumstance is the basis for discussing the possibility of expanding the Standard Model with an additional gauge vector boson $W_R$ and right-handed neutrinos.


title: Cycles of Thought: Measuring LLM Confidence through Stable Explanations

abstract: In many high-risk machine learning applications it is essential for a model to indicate when it is uncertain about a prediction. While large language models (LLMs) can reach and even surpass human-level accuracy on a variety of benchmarks, their overconfidence in incorrect responses is still a well-documented failure mode. Traditional methods for ML uncertainty quantification can be difficult to directly adapt to LLMs due to the computational cost of implementation and closed-source nature of many models. A variety of black-box methods have recently been proposed, but these often rely on heuristics such as self-verbalized confidence. We instead propose a framework for measuring an LLM's uncertainty with respect to the distribution of generated explanations for an answer. While utilizing explanations is not a new idea in and of itself, by interpreting each possible model+explanation pair as a test-time classifier we can calculate a posterior answer distribution over the most likely of these classifiers. We demonstrate how a specific instance of this framework using explanation entailment as our classifier likelihood improves confidence score metrics (in particular AURC and AUROC) over baselines across five different datasets. We believe these results indicate that our framework is both a well-principled and effective way of quantifying uncertainty in LLMs.


title: Are language models rational? The case of coherence norms and belief revision

abstract: Do norms of rationality apply to machine learning models, in particular language models? In this paper we investigate this question by focusing on a special subset of rational norms: coherence norms. We consider both logical coherence norms as well as coherence norms tied to the strength of belief. To make sense of the latter, we introduce the Minimal Assent Connection (MAC) and propose a new account of credence, which captures the strength of belief in language models. This proposal uniformly assigns strength of belief simply on the basis of model internal next token probabilities. We argue that rational norms tied to coherence do apply to some language models, but not to others. This issue is significant since rationality is closely tied to predicting and explaining behavior, and thus it is connected to considerations about AI safety and alignment, as well as understanding model behavior more generally.


title: Investigating the Relationship Between User Specialization and Toxicity on Reddit: A Sentiment Analysis Approach

abstract: Online platforms host a diverse user base, which can be broadly categorized into "specialist users" with focused interests and "generalist users" who engage in a wide range of topics. This study explores the behavioral differences between these two user types on the popular platform Reddit, focusing on the level of toxicity in their posts and the associated sentiment scores across 24 emotional categories and a neutral state. By employing community embeddings to represent users in a high-dimensional space, we measure activity diversity using the GS score. We analyze a dataset of 16,291,992 posts from 4,926,237 users spanning the period from 2019 to 2021, assessing the degree of toxicity and sentiment scores for each post. Our findings indicate that specialist users exhibit higher levels of toxic behavior compared to generalist users. Furthermore, specialist users demonstrate elevated scores for annoyance, sadness, and fear, while generalist users show higher scores for curiosity, admiration, and love. These insights contribute to a better understanding of user behavior on online platforms and can inform strategies for fostering healthier online communities.


title: Sampling discretization theorems in Orlicz spaces

abstract: We obtain new sampling discretization results in Orlicz norms on finite dimensional spaces. As applications, we study sampling recovery problems, where the error of the recovery process is calculated with respect to different Orlicz norms. In particular, we are interested in the recovery by linear methods in the norms close to $L^2$.


title: Pre-trained Large Language Models Use Fourier Features to Compute Addition

abstract: Pre-trained large language models (LLMs) exhibit impressive mathematical reasoning capabilities, yet how they compute basic arithmetic, such as addition, remains unclear. This paper shows that pre-trained LLMs add numbers using Fourier features -- dimensions in the hidden state that represent numbers via a set of features sparse in the frequency domain. Within the model, MLP and attention layers use Fourier features in complementary ways: MLP layers primarily approximate the magnitude of the answer using low-frequency features, while attention layers primarily perform modular addition (e.g., computing whether the answer is even or odd) using high-frequency features. Pre-training is crucial for this mechanism: models trained from scratch to add numbers only exploit low-frequency features, leading to lower accuracy. Introducing pre-trained token embeddings to a randomly initialized model rescues its performance. Overall, our analysis demonstrates that appropriate pre-trained representations (e.g., Fourier features) can unlock the ability of Transformers to learn precise mechanisms for algorithmic tasks.


title: Fixed point results for contractions of polynomial type

abstract: We introduce two new classes of single-valued contractions of polynomial type defined on a metric space. For the first one, called the class of polynomial contractions, we establish two fixed point theorems. Namely, we first consider the case when the mapping is continuous. Next, we weaken the continuity condition. In particular, we recover Banach's fixed point theorem. The second class, called the class of almost polynomial contractions, includes the class of almost contractions introduced by Berinde [Nonlinear Analysis Forum. 9(1) (2004) 43--53]. A fixed point theorem is established for almost polynomial contractions. The obtained result generalizes that derived by Berinde in the above reference. Several examples showing that our generalizations are significant, are provided.


title: FILS: Self-Supervised Video Feature Prediction In Semantic Language Space

abstract: This paper demonstrates a self-supervised approach for learning semantic video representations. Recent vision studies show that a masking strategy for vision and natural language supervision has contributed to developing transferable visual pretraining. Our goal is to achieve a more semantic video representation by leveraging the text related to the video content during the pretraining in a fully self-supervised manner. To this end, we present FILS, a novel self-supervised video Feature prediction In semantic Language Space (FILS). The vision model can capture valuable structured information by correctly predicting masked feature semantics in language space. It is learned using a patch-wise video-text contrastive strategy, in which the text representations act as prototypes for transforming vision features into a language space, which are then used as targets for semantically meaningful feature prediction using our masked encoder-decoder structure. FILS demonstrates remarkable transferability on downstream action recognition tasks, achieving state-of-the-art on challenging egocentric datasets, like Epic-Kitchens, Something-SomethingV2, Charades-Ego, and EGTEA, using ViT-Base. Our efficient method requires less computation and smaller batches compared to previous works.


title: Even Integer Quantum Hall Effect in Materials with Hidden Spin Texture

abstract: Because spin-orbit coupling (SOC) is invisible in the band structure when inversion symmetry exists, whether spins are trivially degenerate or strongly coupled to momentum due to SOC is presumed to make little difference in transport measurements, such as magnetoresistance and quantum oscillations. In this work, however, we show that hidden Rashba SOC in a centrosymmetric two-dimensional material can lead to the quantum Hall effect with only even-integer plateaus, unlike a spinless electron gas. Here, two Rashba layers that are degenerate but with opposite SOC due to inversion symmetry, hybridize with each other and create two doubly-degenerate bands with hidden spin texture. Correspondingly, two branches of Landau levels interact, resulting in significant suppression of spin splitting due to the balancing of intralayer SOC and interlayer hybridization. Furthermore, we show that breaking inversion symmetry restores the ordinary quantum Hall fluid by introducing spin-split Fermi surfaces. Our theory can apply to centrosymmetric materials with strong SOC, as demonstrated in a recent experiment on the two-dimensional semiconductor Bi$_2$O$_2$Se.


title: Global fermionic mode optimization via swap gates

abstract: We propose a general approach to find an optimal representation of a quantum many body wave function for a given error margin via global fermionic mode optimization. The stationary point on a fixed rank matrix product state manifold is obtained via a joint optimization on the Grassman manifold [Phys. Rev. Lett. 117, 210402] together with swap gates controlled permutations. The minimization of the global quantity, the block entropy area, guarantees that the method fulfills all criteria with respect to partial derivatives. Numerical results via large scale density matrix renormalization group simulations on strongly correlated molecular systems and two-dimensional fermionic lattice models are discussed.


title: What is the Best Way for ChatGPT to Translate Poetry?

abstract: Machine translation (MT) has historically faced significant challenges when applied to literary works, particularly in the domain of poetry translation. The advent of Large Language Models such as ChatGPT holds potential for innovation in this field. This study examines ChatGPT's capabilities in English-Chinese poetry translation tasks, utilizing targeted prompts and small sample scenarios to ascertain optimal performance. Despite promising outcomes, our analysis reveals persistent issues in the translations generated by ChatGPT that warrant attention. To address these shortcomings, we propose an Explanation-Assisted Poetry Machine Translation (EAPMT) method, which leverages monolingual poetry explanation as a guiding information for the translation process. Furthermore, we refine existing evaluation criteria to better suit the nuances of modern poetry translation. We engaged a panel of professional poets for assessments, complemented evaluations by using GPT-4. The results from both human and machine evaluations demonstrate that our EAPMT method outperforms traditional translation methods of ChatGPT and the existing online systems. This paper validates the efficacy of our method and contributes a novel perspective to machine-assisted literary translation.


title: Towards the essence of \v{S}olt\'es' problem

abstract: We explore the question asking for graphs $G$ for which the total distance decreases, possibly by a fixed constant $k$, upon the removal of any of its vertices. We obtain results leading to intuition and doubts for the \v{S}olt\'es' problem ($k=0$) and its conjectures.


title: Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Types

abstract: There is abundant evidence of the fact that the way words change their meaning can be classified in different types of change, highlighting the relationship between the old and new meanings (among which generalization, specialization and co-hyponymy transfer). In this paper, we present a way of detecting these types of change by constructing a model that leverages information both from synchronic lexical relations and definitions of word meanings. Specifically, we use synset definitions and hierarchy information from WordNet and test it on a digitized version of Blank's (1997) dataset of semantic change types. Finally, we show how the sense relationships can improve models for both approximation of human judgments of semantic relatedness as well as binary Lexical Semantic Change Detection.


title: On a sign-change conjecture of Schlosser and Zhou

abstract: In this paper we prove a conjecture made by Schlosser--Zhou pertaining to sign changes of Fourier coefficients of certain infinite products.


title: Mission Design for Unmanned Aerial Vehicles using Hybrid Probabilistic Logic Program

abstract: Advanced Air Mobility (AAM) is a growing field that demands a deep understanding of legal, spatial and temporal concepts in navigation. Hence, any implementation of AAM is forced to deal with the inherent uncertainties of human-inhabited spaces. Enabling growth and innovation requires the creation of a system for safe and robust mission design, i.e., the way we formalize intentions and decide their execution as trajectories for the Unmanned Aerial Vehicle (UAV). Although legal frameworks have emerged to govern urban air spaces, their full integration into the decision process of autonomous agents and operators remains an open task. In this work we present ProMis, a system architecture for probabilistic mission design. It links the data available from various static and dynamic data sources with legal text and operator requirements by following principles of formal verification and probabilistic modeling. Hereby, ProMis enables the combination of low-level perception and high-level rules in AAM to infer validity over the UAV's state-space. To this end, we employ Hybrid Probabilistic Logic Programs (HPLP) as a unifying, intermediate representation between perception and action-taking. Furthermore, we present methods to connect ProMis with crowd-sourced map data by generating HPLP atoms that represent spatial relations in a probabilistic fashion. Our claims of the utility and generality of ProMis are supported by experiments on a diverse set of scenarios and a discussion of the computational demands associated with probabilistic missions.


title: Topological disclination states and charge fractionalization in a non-Hermitian lattice

abstract: We show that a non-Hermitian lattice with a disclination can host topological disclination states that are induced by on-site gain and loss. The disclination states are inherently non-Hermitian as they do not exist in the limit of zero gain/loss. They arise from charge fractionalization in the non-Hermitian lattice, which we establish using non-Hermitian Wilson loops calculated with biorthogonal products. The model can be realized using an array of optical resonators, with the emergence of the topological disclination states manifesting as an abrupt shift in emission intensity and frequency upon tuning the gain/loss level.


title: Recurrent neural chemical reaction networks that approximate arbitrary dynamics

abstract: Many important phenomena in chemistry and biology are realized via dynamical features such as multi-stability, oscillations, and chaos. Construction of novel chemical systems with such finely-tuned dynamics is a challenging problem central to the growing field of synthetic biology. In this paper, we address this problem by putting forward a molecular version of a recurrent artificial neural network, which we call a recurrent neural chemical reaction network (RNCRN). We prove that the RNCRN, with sufficiently many auxiliary chemical species and suitable fast reactions, can be systematically trained to achieve any dynamics. This approximation ability is shown to hold independent of the initial conditions for the auxiliary species, making the RNCRN more experimentally feasible. To demonstrate the results, we present a number of relatively simple RNCRNs trained to display a variety of biologically-important dynamical features.


title: Gravitational radiation from inspiralling compact binaries to N$^3$LO in the Effective Field Theory approach

abstract: Within the context of the Effective Field Theory (EFT) framework to gravitational dynamics, we compute the Hamiltonian, source quadrupole moment, and gravitational-wave energy flux for (non-spinning) inspiralling compact binaries at next-to-next-to-next-to leading order (N$^3$LO) in the Post-Newtonian (PN) expansion. We use the recently developed $d$-dimensional multipole-expanded effective theory, and explicitly perform the matching to the (pseudo-) stress-energy tensor. The calculation involves Feynman integrals up to three- (conservative) and two-loop (radiative) orders, evaluated within dimensional regularization. Our (ambiguity-free) results confirm (for the first time) the value of the gravitational-wave flux for quasi-circular orbits at 3PN order, while paving the way forward to the inclusion of spin effects as well as higher order computations.


title: Distributional Adversarial Loss

abstract: A major challenge in defending against adversarial attacks is the enormous space of possible attacks that even a simple adversary might perform. To address this, prior work has proposed a variety of defenses that effectively reduce the size of this space. These include randomized smoothing methods that add noise to the input to take away some of the adversary's impact. Another approach is input discretization which limits the adversary's possible number of actions. Motivated by these two approaches, we introduce a new notion of adversarial loss which we call distributional adversarial loss, to unify these two forms of effectively weakening an adversary. In this notion, we assume for each original example, the allowed adversarial perturbation set is a family of distributions (e.g., induced by a smoothing procedure), and the adversarial loss over each example is the maximum loss over all the associated distributions. The goal is to minimize the overall adversarial loss. We show generalization guarantees for our notion of adversarial loss in terms of the VC-dimension of the hypothesis class and the size of the set of allowed adversarial distributions associated with each input. We also investigate the role of randomness in achieving robustness against adversarial attacks in the methods described above. We show a general derandomization technique that preserves the extent of a randomized classifier's robustness against adversarial attacks. We corroborate the procedure experimentally via derandomizing the Random Projection Filters framework of \cite{dong2023adversarial}. Our procedure also improves the robustness of the model against various adversarial attacks.


title: LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection

abstract: In this paper, we present a light-weight detection transformer, LW-DETR, which outperforms YOLOs for real-time object detection. The architecture is a simple stack of a ViT encoder, a projector, and a shallow DETR decoder. Our approach leverages recent advanced techniques, such as training-effective techniques, e.g., improved loss and pretraining, and interleaved window and global attentions for reducing the ViT encoder complexity. We improve the ViT encoder by aggregating multi-level feature maps, and the intermediate and final feature maps in the ViT encoder, forming richer feature maps, and introduce window-major feature map organization for improving the efficiency of interleaved attention computation. Experimental results demonstrate that the proposed approach is superior over existing real-time detectors, e.g., YOLO and its variants, on COCO and other benchmark datasets. Code and models are available at (https://github.com/Atten4Vis/LW-DETR).


title: The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement

abstract: To obtain improved speech enhancement models, researchers often focus on increasing performance according to specific instrumental metrics. However, when the same metric is used in a loss function to optimize models, it may be detrimental to aspects that the given metric does not see. The goal of this paper is to illustrate the risk of overfitting a speech enhancement model to the metric used for evaluation. For this, we introduce enhancement models that exploit the widely used PESQ measure. Our "PESQetarian" model achieves 3.82 PESQ on VB-DMD while scoring very poorly in a listening experiment. While the obtained PESQ value of 3.82 would imply "state-of-the-art" PESQ-performance on the VB-DMD benchmark, our examples show that when optimizing w.r.t. a metric, an isolated evaluation on the same metric may be misleading. Instead, other metrics should be included in the evaluation and the resulting performance predictions should be confirmed by listening.


title: Polarization Wavefront Lidar: Learning Large Scene Reconstruction from Polarized Wavefronts

abstract: Lidar has become a cornerstone sensing modality for 3D vision, especially for large outdoor scenarios and autonomous driving. Conventional lidar sensors are capable of providing centimeter-accurate distance information by emitting laser pulses into a scene and measuring the time-of-flight (ToF) of the reflection. However, the polarization of the received light that depends on the surface orientation and material properties is usually not considered. As such, the polarization modality has the potential to improve scene reconstruction beyond distance measurements. In this work, we introduce a novel long-range polarization wavefront lidar sensor (PolLidar) that modulates the polarization of the emitted and received light. Departing from conventional lidar sensors, PolLidar allows access to the raw time-resolved polarimetric wavefronts. We leverage polarimetric wavefronts to estimate normals, distance, and material properties in outdoor scenarios with a novel learned reconstruction method. To train and evaluate the method, we introduce a simulated and real-world long-range dataset with paired raw lidar data, ground truth distance, and normal maps. We find that the proposed method improves normal and distance reconstruction by 53\% mean angular error and 41\% mean absolute error compared to existing shape-from-polarization (SfP) and ToF methods. Code and data are open-sourced at https://light.princeton.edu/pollidar.


title: Relaxation and fluctuations of a mass- and dipole-conserving stochastic lattice gas

abstract: Han et al. [Phys. Rev. Lett. 132, 137102 (2024)] have recently introduced a classical stochastic lattice gas model which, in addition to particle conservation, also conserves the particles' dipole moment. Because of its intrinsic nonlinearity this model exhibits unusual macroscopic scaling behaviors, different from those of lattice gases that conserve only the number of particles. Here we investigate some basic relaxation and fluctuation properties of this model at large scales and at long times. These properties crucially depend on whether the total number of particles is infinite or finite. We find similarity solutions, describing relaxation of the dipole-conserving gas (DCG) in several standard settings. A major part of our effort is an extension to this model of the macroscopic fluctuation theory (MFT), previously developed for lattice gases where only the number of particles is conserved. We apply the MFT to the calculation of the variance of nonequilibrium fluctuations of the excess number of particles on the positive semi-axis when starting from an (either deterministic, or random) constant density at $t=0$. Using the MFT, we also identify the equilibrium Boltzmann-Gibbs distribution for the DCG. Finally, based on these results, we determine the probability distribution of, and the most probable density history leading to, a large deviation in the form of a macroscopic void of a given size in an initially uniform DCG at equilibrium.


title: Gaussian Copula Models for Nonignorable Missing Data Using Auxiliary Marginal Quantiles

abstract: We present an approach for modeling and imputation of nonignorable missing data under Gaussian copulas. The analyst posits a set of quantiles of the marginal distributions of the study variables, for example, reflecting information from external data sources or elicited expert opinion. When these quantiles are accurately specified, we prove it is possible to consistently estimate the copula correlation and perform multiple imputation in the presence of nonignorable missing data. We develop algorithms for estimation and imputation that are computationally efficient, which we evaluate in simulation studies of multiple imputation inferences. We apply the model to analyze associations between lead exposure levels and end-of-grade test scores for 170,000 students in North Carolina. These measurements are not missing at random, as children deemed at-risk for high lead exposure are more likely to be measured. We construct plausible marginal quantiles for lead exposure using national statistics provided by the Centers for Disease Control and Prevention. Complete cases and missing at random analyses appear to underestimate the relationships between certain variables and end-of-grade test scores, while multiple imputation inferences under our model support stronger adverse associations between lead exposure and educational outcomes.


title: Node-wise Filtering in Graph Neural Networks: A Mixture of Experts Approach

abstract: Graph Neural Networks (GNNs) have proven to be highly effective for node classification tasks across diverse graph structural patterns. Traditionally, GNNs employ a uniform global filter, typically a low-pass filter for homophilic graphs and a high-pass filter for heterophilic graphs. However, real-world graphs often exhibit a complex mix of homophilic and heterophilic patterns, rendering a single global filter approach suboptimal. In this work, we theoretically demonstrate that a global filter optimized for one pattern can adversely affect performance on nodes with differing patterns. To address this, we introduce a novel GNN framework Node-MoE that utilizes a mixture of experts to adaptively select the appropriate filters for different nodes. Extensive experiments demonstrate the effectiveness of Node-MoE on both homophilic and heterophilic graphs.


title: Cycle integrals of meromorphic Hilbert modular forms

abstract: We establish a rationality result for linear combinations of traces of cycle integrals of certain meromorphic Hilbert modular forms. These are meromorphic counterparts to the Hilbert cusp forms $\omega_m(z_1,z_2)$, which Zagier investigated in the context of the Doi-Naganuma lift. We give an explicit formula for these cycle integrals, expressed in terms of the Fourier coefficients of harmonic Maass forms. A key element in our proof is the explicit construction of locally harmonic Hilbert-Maass forms on $\mathbb{H}^2$, which are analogous to the elliptic locally harmonic Maass forms examined by Bringmann, Kane, and Kohnen. Additionally, we introduce a regularized theta lift that maps elliptic harmonic Maass forms to locally harmonic Hilbert-Maass forms and is closely related to the Doi-Naganuma lift.


title: Parallel Quantum Computing Simulations via Quantum Accelerator Platform Virtualization

abstract: Quantum circuit execution is the central task in quantum computation. Due to inherent quantum-mechanical constraints, quantum computing workflows often involve a considerable number of independent measurements over a large set of slightly different quantum circuits. Here we discuss a simple model for parallelizing simulation of such quantum circuit executions that is based on introducing a large array of virtual quantum processing units, mapped to classical HPC nodes, as a parallel quantum computing platform. Implemented within the XACC framework, the model can readily take advantage of its backend-agnostic features, enabling parallel quantum circuit execution over any target backend supported by XACC. We illustrate the performance of this approach by demonstrating strong scaling in two pertinent domain science problems, namely in computing the gradients for the multi-contracted variational quantum eigensolver and in data-driven quantum circuit learning, where we vary the number of qubits and the number of circuit layers. The latter (classical) simulation leverages the cuQuantum SDK library to run efficiently on GPU-accelerated HPC platforms.


title: Topological defects and tensionless holography

abstract: We study topological defect lines in the symmetric-product orbifolds $\mathrm{Sym}^N(X)$ for a generic seed CFT $X$. We focus on the defects which preserve the maximum of the $S_N$ symmetry. When $X$ is taken to describe the free theory of four fermions and four bosons on a $\mathbb{T}^4$, we construct holographically dual backgrounds describing propagation of tensionless closed strings in the presence of spacetime defects wrapping the conformal boundary. We find a precise match between the spectra of local on-shell closed-string vertex operators in the bulk and the spectra of non-local disorder fields in the spacetime theory.


title: Fast randomized least-squares solvers can be just as accurate and stable as classical direct solvers

abstract: One of the greatest success stories of randomized algorithms for linear algebra has been the development of fast, randomized algorithms for highly overdetermined linear least-squares problems. However, none of the existing algorithms is backward stable, preventing them from being deployed as drop-in replacements for existing QR-based solvers. This paper introduces FOSSILS, a fast, provably backward stable randomized least-squares solver. FOSSILS combines iterative refinement with a preconditioned iterative method applied to the normal equations, and it converges at the same rate as existing randomized least-squares solvers. This work offers the promise of incorporating randomized least-squares solvers into existing software libraries while maintaining the same level of accuracy and stability as classical solvers.


title: Unifying atoms and colloids near the glass transition through bond-order topology

abstract: In this combined experimental and simulation study, we utilize bond-order topology to quantitatively match particle volume fraction in mechanically uniformly compressed colloidal suspensions with temperature in atomistic simulations. The obtained mapping temperature is above the dynamical glass transition temperature, indicating that the colloidal systems examined are structurally most like simulated undercooled liquids. Furthermore, the structural mapping procedure offers a unifying framework for quantifying relaxation in arrested colloidal systems.


title: SpikeZIP-TF: Conversion is All You Need for Transformer-based SNN

abstract: Spiking neural network (SNN) has attracted great attention due to its characteristic of high efficiency and accuracy. Currently, the ANN-to-SNN conversion methods can obtain ANN on-par accuracy SNN with ultra-low latency (8 time-steps) in CNN structure on computer vision (CV) tasks. However, as Transformer-based networks have achieved prevailing precision on both CV and natural language processing (NLP), the Transformer-based SNNs are still encounting the lower accuracy w.r.t the ANN counterparts. In this work, we introduce a novel ANN-to-SNN conversion method called SpikeZIP-TF, where ANN and SNN are exactly equivalent, thus incurring no accuracy degradation. SpikeZIP-TF achieves 83.82% accuracy on CV dataset (ImageNet) and 93.79% accuracy on NLP dataset (SST-2), which are higher than SOTA Transformer-based SNNs. The code is available in GitHub: https://github.com/Intelligent-Computing-Research-Group/SpikeZIP_transformer


title: Non-trivial copies of N*

abstract: We show that it is consistent to have regular closed non-clopen copies of $\mathbb N^*$ within $\mathbb N^*$ and a non-trivial self-map of $\mathbb N^*$ even if all autohomeomorphisms of $\mathbb N^*$ are trivial.


title: Solving Differential Equations using Physics-Informed Deep Equilibrium Models

abstract: This paper introduces Physics-Informed Deep Equilibrium Models (PIDEQs) for solving initial value problems (IVPs) of ordinary differential equations (ODEs). Leveraging recent advancements in deep equilibrium models (DEQs) and physics-informed neural networks (PINNs), PIDEQs combine the implicit output representation of DEQs with physics-informed training techniques. We validate PIDEQs using the Van der Pol oscillator as a benchmark problem, demonstrating their efficiency and effectiveness in solving IVPs. Our analysis includes key hyperparameter considerations for optimizing PIDEQ performance. By bridging deep learning and physics-based modeling, this work advances computational techniques for solving IVPs, with implications for scientific computing and engineering applications.


title: Mapping dynamical systems into chemical reactions

abstract: Dynamical systems with polynomials on the right-hand side can model a wide range of physical processes. A subset of such dynamical systems that can model chemical reactions under mass-action kinetics are called chemical systems. A central problem in synthetic biology is to map general polynomial dynamical systems into dynamically similar chemical ones. In this paper, we present a novel map, called the quasi-chemical map, that can systematically solve this problem. The quasi-chemical map introduces suitable state-dependent perturbations into any given polynomial dynamical system which then becomes chemical under suitably large translation of variables. We prove that this map preserves robust dynamical features, such as generic equilibria and limit cycles, as well as temporal properties, such as periods of oscillations. Furthermore, the resulting chemical systems are of only at most one degree higher than the original dynamical systems. We demonstrate the quasi-chemical map by designing relatively simple chemical systems with exotic dynamics and pre-defined bifurcation structures.


title: AD-H: Autonomous Driving with Hierarchical Agents

abstract: Due to the impressive capabilities of multimodal large language models (MLLMs), recent works have focused on employing MLLM-based agents for autonomous driving in large-scale and dynamic environments. However, prevalent approaches often directly translate high-level instructions into low-level vehicle control signals, which deviates from the inherent language generation paradigm of MLLMs and fails to fully harness their emergent powers. As a result, the generalizability of these methods is highly restricted by autonomous driving datasets used during fine-tuning. To tackle this challenge, we propose to connect high-level instructions and low-level control signals with mid-level language-driven commands, which are more fine-grained than high-level instructions but more universal and explainable than control signals, and thus can effectively bridge the gap in between. We implement this idea through a hierarchical multi-agent driving system named AD-H, including a MLLM planner for high-level reasoning and a lightweight controller for low-level execution. The hierarchical design liberates the MLLM from low-level control signal decoding and therefore fully releases their emergent capability in high-level perception, reasoning, and planning. We build a new dataset with action hierarchy annotations. Comprehensive closed-loop evaluations demonstrate several key advantages of our proposed AD-H system. First, AD-H can notably outperform state-of-the-art methods in achieving exceptional driving performance, even exhibiting self-correction capabilities during vehicle operation, a scenario not encountered in the training dataset. Second, AD-H demonstrates superior generalization under long-horizon instructions and novel environmental conditions, significantly surpassing current state-of-the-art methods. We will make our data and code publicly accessible at https://github.com/zhangzaibin/AD-H


title: Characterization of foam-filled hohlraums for inertial fusion experiments

abstract: On the path towards high-gain inertial confinement fusion ignition, foams are being considered to tamp the hohlraum wall-motion, and mitigate laser backscattering from Stimulated Raman Scattering (SRS) and Stimulated Brillouin Scattering (SBS). Here we present the results from an experimental campaign on foam-filled hohlraums conducted at the OMEGA laser facility. SiO2 foam-fills, with densities as low as 1 mg/cm3, successfully reduce the gold wall expansion, with laser backscattering comparable to gas-fill.


title: Does your data spark joy? Performance gains from domain upsampling at the end of training

abstract: Pretraining datasets for large language models (LLMs) have grown to trillions of tokens composed of large amounts of CommonCrawl (CC) web scrape along with smaller, domain-specific datasets. It is expensive to understand the impact of these domain-specific datasets on model capabilities as training at large FLOP scales is required to reveal significant changes to difficult and emergent benchmarks. Given the increasing cost of experimenting with pretraining data, how does one determine the optimal balance between the diversity in general web scrapes and the information density of domain specific data? In this work, we show how to leverage the smaller domain specific datasets by upsampling them relative to CC at the end of training to drive performance improvements on difficult benchmarks. This simple technique allows us to improve up to 6.90 pp on MMLU, 8.26 pp on GSM8K, and 6.17 pp on HumanEval relative to the base data mix for a 7B model trained for 1 trillion (T) tokens, thus rivaling Llama-2 (7B)$\unicode{x2014}$a model trained for twice as long. We experiment with ablating the duration of domain upsampling from 5% to 30% of training and find that 10% to 20% percent is optimal for navigating the tradeoff between general language modeling capabilities and targeted benchmarks. We also use domain upsampling to characterize at scale the utility of individual datasets for improving various benchmarks by removing them during this final phase of training. This tool opens up the ability to experiment with the impact of different pretraining datasets at scale, but at an order of magnitude lower cost compared to full pretraining runs.


title: Lagrangian filtering for wave-mean flow decomposition

abstract: Geophysical flows are typically composed of wave and mean motions with a wide range of overlapping temporal scales, making separation between the two types of motion in wave-resolving numerical simulations challenging. Lagrangian filtering - whereby a temporal filter is applied in the frame of the flow - is an effective way to overcome this challenge, allowing clean separation of waves from mean flow based on frequency separation in a Lagrangian frame. Previous implementations of Lagrangian filtering have used particle tracking approaches, which are subject to large memory requirements or difficulties with particle clustering. Kafiabad and Vanneste (2023, KV23) recently proposed a novel method for finding Lagrangian means without particle tracking by solving a set of partial differential equations alongside the governing equations of the flow. In this work, we adapt the approach of KV23 to develop a flexible, on-the-fly, PDE-based method for Lagrangian filtering using arbitrary convolutional filters. We present several different wave-mean decompositions, demonstrating that our Lagrangian methods are capable of recovering a clean wave-field from a nonlinear simulation of geostrophic turbulence interacting with Poincar\'e waves.


title: Convolutional Neural Networks and Vision Transformers for Fashion MNIST Classification: A Literature Review

abstract: Our review explores the comparative analysis between Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in the domain of image classification, with a particular focus on clothing classification within the e-commerce sector. Utilizing the Fashion MNIST dataset, we delve into the unique attributes of CNNs and ViTs. While CNNs have long been the cornerstone of image classification, ViTs introduce an innovative self-attention mechanism enabling nuanced weighting of different input data components. Historically, transformers have primarily been associated with Natural Language Processing (NLP) tasks. Through a comprehensive examination of existing literature, our aim is to unveil the distinctions between ViTs and CNNs in the context of image classification. Our analysis meticulously scrutinizes state-of-the-art methodologies employing both architectures, striving to identify the factors influencing their performance. These factors encompass dataset characteristics, image dimensions, the number of target classes, hardware infrastructure, and the specific architectures along with their respective top results. Our key goal is to determine the most appropriate architecture between ViT and CNN for classifying images in the Fashion MNIST dataset within the e-commerce industry, while taking into account specific conditions and needs. We highlight the importance of combining these two architectures with different forms to enhance overall performance. By uniting these architectures, we can take advantage of their unique strengths, which may lead to more precise and reliable models for e-commerce applications. CNNs are skilled at recognizing local patterns, while ViTs are effective at grasping overall context, making their combination a promising strategy for boosting image classification performance.


title: MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarization

abstract: The rapid proliferation of online content necessitates effective summarization methods, among which dynamic aspect-based summarization stands out. Unlike its traditional counterpart, which assumes a fixed set of known aspects, this approach adapts to the varied aspects of the input text. We introduce a novel multi-objective learning framework employing a Longformer-Encoder-Decoder for this task. The framework optimizes aspect number prediction, minimizes disparity between generated and reference summaries for each aspect, and maximizes dissimilarity across aspect-specific summaries. Extensive experiments show our method significantly outperforms baselines on three diverse datasets, largely due to the effective alignment of generated and reference aspect counts without sacrificing single-aspect summarization quality.


title: Unpacking Approaches to Learning and Teaching Machine Learning in K-12 Education: Transparency, Ethics, and Design Activities

abstract: In this conceptual paper, we review existing literature on artificial intelligence/machine learning (AI/ML) education to identify three approaches to how learning and teaching ML could be conceptualized. One of them, a data-driven approach, emphasizes providing young people with opportunities to create data sets, train, and test models. A second approach, learning algorithm-driven, prioritizes learning about how the learning algorithms or engines behind how ML models work. In addition, we identify efforts within a third approach that integrates the previous two. In our review, we focus on how the approaches: (1) glassbox and blackbox different aspects of ML, (2) build on learner interests and provide opportunities for designing applications, (3) integrate ethics and justice. In the discussion, we address the challenges and opportunities of current approaches and suggest future directions for the design of learning activities.


title: Exceptional Boundary Sets for Solutions of Fully Nonlinear Parabolic PDEs

abstract: This article investigates the exceptional set of the boundary for the following problem: \begin{equation*} \begin{aligned} -\frac{\partial u}{\partial t} + \mathcal{M}_{\lambda,\Lambda}^+(D^2u) + b(x,t)\cdot Du + c(x,t)u =0 \quad \rm{in} ~ \Omega_{T}, \end{aligned} \end{equation*} We provide a sufficient condition on the exceptional set in terms of the bound of the Hausdorff measure of this boundary portion. This condition ensures that even if the boundary values are not nonnegative on this portion, the supersolution remains nonnegative.


title: QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead

abstract: Serving LLMs requires substantial memory due to the storage requirements of Key-Value (KV) embeddings in the KV cache, which grows with sequence length. An effective approach to compress KV cache is quantization. However, traditional quantization methods face significant memory overhead due to the need to store quantization constants (at least a zero point and a scale) in full precision per data block. Depending on the block size, this overhead can add 1 or 2 bits per quantized number. We introduce QJL, a new quantization approach that consists of a Johnson-Lindenstrauss (JL) transform followed by sign-bit quantization. In contrast to existing methods, QJL eliminates memory overheads by removing the need for storing quantization constants. We propose an asymmetric estimator for the inner product of two vectors and demonstrate that applying QJL to one vector and a standard JL transform without quantization to the other provides an unbiased estimator with minimal distortion. We have developed an efficient implementation of the QJL sketch and its corresponding inner product estimator, incorporating a lightweight CUDA kernel for optimized computation. When applied across various LLMs and NLP tasks to quantize the KV cache to only 3 bits, QJL demonstrates a more than fivefold reduction in KV cache memory usage without compromising accuracy, all while achieving faster runtime. Codes are available at \url{https://github.com/amirzandieh/QJL}.


title: A Low Duty Cycle Pulsed UV Technique for Spectroscopy of Aluminum Monochloride

abstract: We present a novel technique to minimize UV-induced damage in experiments that employ second-harmonic generation cavities. The principle of our approach is to reduce the duty cycle of the UV light as much as possible to prolong the lifetime of the used optics. The low duty cycle is achieved by ramping the cavity into resonance for a short time during the experimental cycle when the light is used and tuning it to an off-resonant state otherwise. The necessary fast ramp and length-stabilization control of the cavity is implemented with the FPGA-based STEMlab platform. We demonstrate the utility of this method by measuring the isotope shift of the electronic transition ($X^1\Sigma \leftarrow A^1\Pi$) in AlCl at 261.5 nm in a pulsed molecular beam experiment.


title: Raman effects in Quantum Frequency Conversion using Bragg Scattering

abstract: We present a quantum-mechanical model that describes fiber-based frequency conversion by four-wave-mixing Bragg scattering in the presence of Raman interactions. In the case of continuous-wave pumps we find closed-form expressions for the conversion efficiency and photon statistics, characterized by the second-order correlation function. For pulsed pumps, we derive a highly general model based on Green functions, and provide a numerical solution method using a split-step scheme. In both cases, we find that noise from spontaneous Raman scattering can pose a serious challenge to this type of frequency conversion if the pumps are less than 30 THz from the quantum fields. However, this impact can be mitigated with crosspolarized pumps and on the anti-Stokes side, through cooling of the fiber.


title: Highway Value Iteration Networks

abstract: Value iteration networks (VINs) enable end-to-end learning for planning tasks by employing a differentiable "planning module" that approximates the value iteration algorithm. However, long-term planning remains a challenge because training very deep VINs is difficult. To address this problem, we embed highway value iteration -- a recent algorithm designed to facilitate long-term credit assignment -- into the structure of VINs. This improvement augments the "planning module" of the VIN with three additional components: 1) an "aggregate gate," which constructs skip connections to improve information flow across many layers; 2) an "exploration module," crafted to increase the diversity of information and gradient flow in spatial dimensions; 3) a "filter gate" designed to ensure safe exploration. The resulting novel highway VIN can be trained effectively with hundreds of layers using standard backpropagation. In long-term planning tasks requiring hundreds of planning steps, deep highway VINs outperform both traditional VINs and several advanced, very deep NNs.


title: BIPED: Pedagogically Informed Tutoring System for ESL Education

abstract: Large Language Models (LLMs) have a great potential to serve as readily available and cost-efficient Conversational Intelligent Tutoring Systems (CITS) for teaching L2 learners of English. Existing CITS, however, are designed to teach only simple concepts or lack the pedagogical depth necessary to address diverse learning strategies. To develop a more pedagogically informed CITS capable of teaching complex concepts, we construct a BIlingual PEDagogically-informed Tutoring Dataset (BIPED) of one-on-one, human-to-human English tutoring interactions. Through post-hoc analysis of the tutoring interactions, we come up with a lexicon of dialogue acts (34 tutor acts and 9 student acts), which we use to further annotate the collected dataset. Based on a two-step framework of first predicting the appropriate tutor act then generating the corresponding response, we implemented two CITS models using GPT-4 and SOLAR-KO, respectively. We experimentally demonstrate that the implemented models not only replicate the style of human teachers but also employ diverse and contextually appropriate pedagogical strategies.


title: Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trends

abstract: Recent advancements in large language models (LLMs) have considerably advanced the capabilities of summarization systems. However, they continue to face concerns about hallucinations. While prior work has evaluated LLMs extensively in news domains, most evaluation of dialogue summarization has focused on BART-based models, leaving a gap in our understanding of their faithfulness. Our work benchmarks the faithfulness of LLMs for dialogue summarization, using human annotations and focusing on identifying and categorizing span-level inconsistencies. Specifically, we focus on two prominent LLMs: GPT-4 and Alpaca-13B. Our evaluation reveals subtleties as to what constitutes a hallucination: LLMs often generate plausible inferences, supported by circumstantial evidence in the conversation, that lack direct evidence, a pattern that is less prevalent in older models. We propose a refined taxonomy of errors, coining the category of "Circumstantial Inference" to bucket these LLM behaviors and release the dataset. Using our taxonomy, we compare the behavioral differences between LLMs and older fine-tuned models. Additionally, we systematically assess the efficacy of automatic error detection methods on LLM summaries and find that they struggle to detect these nuanced errors. To address this, we introduce two prompt-based approaches for fine-grained error detection that outperform existing metrics, particularly for identifying "Circumstantial Inference."


title: Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training

abstract: The emergence of large language models (LLMs) relies heavily on distributed training strategies, among which pipeline parallelism plays a crucial role. As LLMs' training sequence length extends to 32k or even 128k, the current pipeline parallel methods face severe bottlenecks, including high memory footprints and substantial pipeline bubbles, greatly hindering model scalability and training throughput. To enhance memory efficiency and training throughput, in this work, we introduce an efficient sequence-level one-forward-one-backward (1F1B) pipeline scheduling method tailored for training LLMs on long sequences named Seq1F1B. Seq1F1B decomposes batch-level schedulable units into finer sequence-level units, reducing bubble size and memory footprint. Considering that Seq1F1B may produce slight extra bubbles if sequences are split evenly, we design a computation-wise strategy to partition input sequences and mitigate this side effect. Compared to competitive pipeline baseline methods such as Megatron 1F1B pipeline parallelism, our method achieves higher training throughput with less memory footprint. Notably, Seq1F1B efficiently trains a LLM with 30B parameters on sequences up to 64k using 64 NVIDIA A100 GPUs without recomputation strategies, a feat unachievable with existing methods. Our source code is based on Megatron-LM, and now is avaiable at: https://github.com/MayDomine/Seq1F1B.git.


title: A self-aligning recirculated crossed optical dipole trap for lithium atoms

abstract: Crossed optical dipole traps (ODTs) provide three-dimensional confinement of cold atoms and other optically trappable particles. However, the need to maintain the intersection of the two trapping beams poses strict requirements on alignment stability, and limits the ability to move the trap. Here we demonstrate a novel crossed ODT design that features inherent stability of the beam crossing, allowing the trap to move and remain aligned. The trap consists of a single high-power laser beam, imaged back onto itself at an angle to form a crossed trap. Self-aligning behavior results from employing an imaging system with positive magnification tuned precisely to unity. We employ laser-cooled samples of $^6$Li atoms to demonstrate that the trap remains well-aligned over a 4.3 mm travel range along an axis approximately perpendicular to the plane containing the crossed beams. Our scheme can be applied to bring an atomic cloud held in a crossed ODT close to a surface or field source for various applications in quantum simulation, sensing, and information processing.


title: Simultaneous retrieval of orbital phase resolved JWST/MIRI emission spectra of the hot Jupiter WASP-43b: evidence of water, ammonia and carbon monoxide

abstract: Spectroscopic phase curves of hot Jupiters measure their emission spectra at multiple orbital phases, thus enabling detailed characterisation of their atmospheres. Precise constraints on the atmospheric composition of these exoplanets offer insights into their formation and evolution. We analyse four phase-resolved emission spectra of the hot Jupiter WASP-43b, generated from a phase curve observed with the MIRI/LRS onboard the JWST, to retrieve its atmospheric properties. Using a parametric 2D temperature model and assuming a chemically homogeneous atmosphere within the observed pressure region, we simultaneously fit the four spectra to constrain the abundances of atmospheric constituents, thereby yielding more precise constraints than previous work that analysed each spectrum independently. Our analysis reveals statistically significant evidence of NH3 (4$\sigma$) in a hot Jupiter's emission spectra for the first time, along with evidence of H2O (6.5$\sigma$), CO (3.1$\sigma$), and a non-detection of CH4. With our abundance constraints, we tentatively estimate the metallicity of WASP-43b at 0.6-6.5$\times$solar and its C/O ratio at 0.6-0.9. Our findings offer vital insights into the atmospheric conditions and formation history of WASP-43b by simultaneously constraining the abundances of carbon, oxygen, and nitrogen-bearing species.


title: Detecting Phase Coherence of 2D Bose Gases via Noise Correlations

abstract: We measure the noise correlations of two-dimensional (2D) Bose gases after free expansion, which allows us to characterize the in-situ phase coherence across the Berezinskii-Kosterlitz-Thouless (BKT) transition. The noise correlation function features a characteristic spatial oscillatory behavior in the superfluid phase, which gives direct access to the superfluid exponent. This oscillatory behavior vanishes above the BKT critical point, as we demonstrate for both single-layer and decoupled bilayer 2D Bose gases. Our work establishes noise interferometry as a general tool to probe and identify many-body states of bilayer quantum gases.


title: The Logarithmic Memristor-Based Bayesian Machine

abstract: The demand for explainable and energy-efficient artificial intelligence (AI) systems for edge computing has led to significant interest in electronic systems dedicated to Bayesian inference. Traditional designs of such systems often rely on stochastic computing, which offers high energy efficiency but suffers from latency issues and struggles with low-probability values. In this paper, we introduce the logarithmic memristor-based Bayesian machine, an innovative design that leverages the unique properties of memristors and logarithmic computing as an alternative to stochastic computing. We present a prototype machine fabricated in a hybrid CMOS/hafnium-oxide memristor process. We validate the versatility and robustness of our system through experimental validation and extensive simulations in two distinct applications: gesture recognition and sleep stage classification. The logarithmic approach simplifies the computational model by converting multiplications into additions and enhances the handling of low-probability events, which are crucial in time-dependent tasks. Our results demonstrate that the logarithmic Bayesian machine achieves superior performance in terms of accuracy and energy efficiency compared to its stochastic counterpart, particularly in scenarios involving complex probabilistic models. This work paves the way for the deployment of advanced AI capabilities in edge devices, where power efficiency and reliability are paramount.


title: Stout smearing and Wilson flow in lattice perturbation theory

abstract: We present the expansion of stout smearing and the Wilson flow in lattice perturbation theory to order $g_0^3$, which is suitable for one-loop calculations. As the Wilson flow is generated by infinitesimal stout smearing steps, the results are related to each other by taking the appropriate limits. We show how to apply perturbative stout smearing or Wilson flow to the Feynman rules of any lattice fermion action and and illustrate them by calculating the self-energy of the clover-improved Wilson fermion.


title: Solving Poisson Equations using Neural Walk-on-Spheres

abstract: We propose Neural Walk-on-Spheres (NWoS), a novel neural PDE solver for the efficient solution of high-dimensional Poisson equations. Leveraging stochastic representations and Walk-on-Spheres methods, we develop novel losses for neural networks based on the recursive solution of Poisson equations on spheres inside the domain. The resulting method is highly parallelizable and does not require spatial gradients for the loss. We provide a comprehensive comparison against competing methods based on PINNs, the Deep Ritz method, and (backward) stochastic differential equations. In several challenging, high-dimensional numerical examples, we demonstrate the superiority of NWoS in accuracy, speed, and computational costs. Compared to commonly used PINNs, our approach can reduce memory usage and errors by orders of magnitude. Furthermore, we apply NWoS to problems in PDE-constrained optimization and molecular dynamics to show its efficiency in practical applications.


title: Grokking Modular Polynomials

abstract: Neural networks readily learn a subset of the modular arithmetic tasks, while failing to generalize on the rest. This limitation remains unmoved by the choice of architecture and training strategies. On the other hand, an analytical solution for the weights of Multi-layer Perceptron (MLP) networks that generalize on the modular addition task is known in the literature. In this work, we (i) extend the class of analytical solutions to include modular multiplication as well as modular addition with many terms. Additionally, we show that real networks trained on these datasets learn similar solutions upon generalization (grokking). (ii) We combine these "expert" solutions to construct networks that generalize on arbitrary modular polynomials. (iii) We hypothesize a classification of modular polynomials into learnable and non-learnable via neural networks training; and provide experimental evidence supporting our claims.

categories: cs.LG cond-mat.dis-nn hep-th math.NT stat.ML


title: Wings: Learning Multimodal LLMs without Text-only Forgetting

abstract: Multimodal large language models (MLLMs), initiated with a trained LLM, first align images with text and then fine-tune on multimodal mixed inputs. However, the MLLM catastrophically forgets the text-only instructions, which do not include images and can be addressed within the initial LLM. In this paper, we present Wings, a novel MLLM that excels in both text-only dialogues and multimodal comprehension. Analyzing MLLM attention in multimodal instructions reveals that text-only forgetting is related to the attention shifts from pre-image to post-image text. From that, we construct extra modules that act as the boosted learner to compensate for the attention shift. The complementary visual and textual learners, like "wings" on either side, are connected in parallel within each layer's attention block. Initially, image and text inputs are aligned with visual learners operating alongside the main attention, balancing focus on visual elements. Textual learners are later collaboratively integrated with attention-based routing to blend the outputs of the visual and textual learners. We design the Low-Rank Residual Attention (LoRRA) to guarantee high efficiency for learners. Our experimental results demonstrate that Wings outperforms equally-scaled MLLMs in both text-only and visual question-answering tasks. On a newly constructed Interleaved Image-Text (IIT) benchmark, Wings exhibits superior performance from text-only-rich to multimodal-rich question-answering tasks.


title: Divisor Functions: Train-like Structure and Density Properties

abstract: We investigate the density properties of generalized divisor functions $\displaystyle f_s(n)=\frac{\sum_{d|n}d^s}{n^s}$ and extend the analysis from the already-proven density of $s=1$ to $s\geq0$. We demonstrate that for every $s>0$, $f_s$ is locally dense, revealing the structure of $f_s$ as the union of infinitely many $trains$ -- specially organized collections of decreasing sequences -- which we define. We analyze Wolke's conjecture that $|f_1(n)-a|<\frac{1}{n^{1-\varepsilon}}$ has infinitely many solutions and prove it for points in the range of $f_s$. We establish that $f_s$ is dense for $0<s\leq1$ but loses density for $s>1$. As a result, in the latter case the graphs experience ruptures. We extend Wolke's discovery $\displaystyle |f_1(n)-a|<\frac{1}{n^{0.4-\varepsilon}}$ to all $0<s\leq1$. In the last section, we prove that the rational complement to the range of $f_s$ is dense for all $s>0$. Thus, the range of $f_1$ and its complement form a partition of rational numbers to two dense subsets. If we treat the divisor function as a uniformly distributed random variable, then its expectation turns out to be $\zeta(s+1)$. The theoretical findings are supported by computations. Ironically, perfect and multiperfect numbers do not exhibit any distinctive characteristics for divisor functions.


title: GWnext 2024: Meeting Summary

abstract: GWnext 2024 was a meeting held in the Kavli Institute for Astronomy and Astrophysics at Peking University in March $4^\text{th} - 8^\text{th}$, 2024. In the meeting researchers at different career stages -- with a particular focus on early career scientists -- working on the different aspects of gravitational wave (GW) astronomy gathered to discuss the current status as well as prospects of the field. The meeting was divided into three core sessions: Astrophysics, GW Theory, and Detection. Each session consisted of introductory talks and extended discussion sessions. Moreover, there was a poster session where students could present their results. In this paper, we summarize the results presented during the meeting and present the most important outcomes.


title: Estimated electric conductivities of thermal plasma for air-fuel combustion and oxy-fuel combustion with potassium or cesium seeding

abstract: A complete model for estimating the electric conductivity of combustion product gases, with added cesium (Cs) or potassium (K) vapor for ionization, is presented. Neutral carrier gases serve as the bulk fluid that carries the seed material, as well as the electrons generated by the partial thermal (equilibrium) ionization of the seed alkali metal. The model accounts for electron-neutral scattering, as well as electron-ion and electron-electron scattering. The model is tested through comparison with published data. The model is aimed at being utilized for the plasma within magnetohydrodynamic (MHD) channels, where direct power extraction from passing electrically conducting plasma gas enables electric power generation. The thermal ionization model is then used to estimate the electric conductivity of seeded combustion gases under complete combustion of three selected fuels, namely: hydrogen (H2), methane (CH4), and carbon (C). For each of these three fuels, two options for the oxidizer were applied, namely: air (21 % molecular oxygen, 79 % molecular nitrogen by mole), and pure oxygen (oxy-combustion). Two types of seeds (with 1 % mole fraction, based on the composition before ionization) were also applied for each of the six combinations of (fuel-oxidizer), leading to a total of 12 different MHD plasma cases. For each of these cases, the electric conductivity was computed for a range of temperatures from 2000 K to 3000 K. The smallest estimated electric conductivity was 0.35 S/m for oxy-hydrogen combustion at 2000 K, with potassium seeding. The largest estimated electric conductivity was 180.30 S/m for oxy-carbon combustion at 3000 K, with cesium seeding. At 2000 K, replacing potassium with cesium causes a gain in the electric conductivity by a multiplicative gain factor of about 3.6 regardless of the fuel and oxidizer. This gain factor declines to between 1.77 and 2.07 at 3000 K.

categories: physics.plasm-ph cs.NA math.NA physics.flu-dyn


title: Impact of aleatoric, stochastic and epistemic uncertainties on project cost contingency reserves

abstract: In construction projects, contingency reserves have traditionally been estimated based on a percentage of the total project cost, which is arbitrary and, thus, unreliable in practical cases. Monte Carlo simulation provides a more reliable estimation. However, works on this topic have focused exclusively on the effects of aleatoric uncertainty, but ignored the impacts of other uncertainty types. In this paper, we present a method to quantitatively determine project cost contingency reserves based on Monte Carlo Simulation that considers the impact of not only aleatoric uncertainty, but also of the effects of other uncertainty kinds (stochastic, epistemic) on the total project cost. The proposed method has been validated with a real-case construction project in Spain. The obtained results demonstrate that the approach will be helpful for construction Project Managers because the obtained cost contingency reserves are consistent with the actual uncertainty type that affects the risks identified in their projects.


title: Representation of preferences for multiple criteria decision aiding in a new seven-valued logic

abstract: The seven-valued logic considered in this paper naturally arises within the rough set framework, allowing to distinguish vagueness due to imprecision from ambiguity due to coarseness. Recently, we discussed its utility for reasoning about data describing multi-attribute classification of objects. We also showed that this logic contains, as a particular case, the celebrated Belnap four-valued logic. Here, we present how the seven-valued logic, as well as the other logics that derive from it, can be used to represent preferences in the domain of Multiple Criteria Decision Aiding (MCDA). In particular, we propose new forms of outranking and value function preference models that aggregate multiple criteria taking into account imperfect preference information. We demonstrate that our approach effectively addresses common challenges in preference modeling for MCDA, such as uncertainty, imprecision, and ill-determination of performances and preferences. To this end, we present a specific procedure to construct a seven-valued preference relation and use it to define recommendations that consider robustness concerns by utilizing multiple outranking or value functions representing the decision maker s preferences. Moreover, we discuss the main properties of the proposed seven-valued preference structure and compare it with current approaches in MCDA, such as ordinal regression, robust ordinal regression, stochastic multiattribute acceptability analysis, stochastic ordinal regression, and so on. We illustrate and discuss the application of our approach using a didactic example. Finally, we propose directions for future research and potential applications of the proposed methodology.


title: Quantum-Inspired Mean Field Probabilistic Model for Combinatorial Optimization Problems

abstract: Combinatorial optimization problems are pivotal across many fields. Among these, Quadratic Unconstrained Binary Optimization (QUBO) problems, central to fields like portfolio optimization, network design, and computational biology, are NP-hard and require exponential computational resources. To address these challenges, we develop a novel Quantum-Inspired Mean Field (QIMF) probabilistic model that approximates solutions to QUBO problems with enhanced accuracy and efficiency. The QIMF model draws inspiration from quantum measurement principles and leverages the mean field probabilistic model. We incorporate a measurement grouping technique and an amplitude-based shot allocation strategy, both critical for optimizing cost functions with a polynomial speedup over traditional methods. Our extensive empirical studies demonstrate significant improvements in solution evaluation for large-scale problems of portfolio selection, the weighted maxcut problem, and the Ising model. Specifically, using S&P 500 data from 2022 and 2023, QIMF improves cost values by 152.8% and 12.5%, respectively, compared to the state-of-the-art baselines. Furthermore, when evaluated on increasingly larger datasets for QUBO problems, QIMF's scalability demonstrates its potential for large-scale QUBO challenges.