title: Is Mamba Capable of In-Context Learning?

abstract: State of the art foundation models such as GPT-4 perform surprisingly well at in-context learning (ICL), a variant of meta-learning concerning the learned ability to solve tasks during a neural network forward pass, exploiting contextual information provided as input to the model. This useful ability emerges as a side product of the foundation model's massive pretraining. While transformer models are currently the state of the art in ICL, this work provides empirical evidence that Mamba, a newly proposed state space model which scales better than transformers w.r.t. the input sequence length, has similar ICL capabilities. We evaluated Mamba on tasks involving simple function approximation as well as more complex natural language processing problems. Our results demonstrate that, across both categories of tasks, Mamba closely matches the performance of transformer models for ICL. Further analysis reveals that, like transformers, Mamba appears to solve ICL problems by incrementally optimizing its internal representations. Overall, our work suggests that Mamba can be an efficient alternative to transformers for ICL tasks involving long input sequences. This is an exciting finding in meta-learning and may enable generalizations of in-context learned AutoML algorithms (like TabPFN or Optformer) to long input sequences.


title: Homograph Attacks on Maghreb Sentiment Analyzers

abstract: We examine the impact of homograph attacks on the Sentiment Analysis (SA) task of different Arabic dialects from the Maghreb North-African countries. Homograph attacks result in a 65.3% decrease in transformer classification from an F1-score of 0.95 to 0.33 when data is written in "Arabizi". The goal of this study is to highlight LLMs weaknesses' and to prioritize ethical and responsible Machine Learning.


title: Accurate and Well-Calibrated ICD Code Assignment Through Attention Over Diverse Label Embeddings

abstract: Although the International Classification of Diseases (ICD) has been adopted worldwide, manually assigning ICD codes to clinical text is time-consuming, error-prone, and expensive, motivating the development of automated approaches. This paper describes a novel approach for automated ICD coding, combining several ideas from previous related work. We specifically employ a strong Transformer-based model as a text encoder and, to handle lengthy clinical narratives, we explored either (a) adapting the base encoder model into a Longformer, or (b) dividing the text into chunks and processing each chunk independently. The representations produced by the encoder are combined with a label embedding mechanism that explores diverse ICD code synonyms. Experiments with different splits of the MIMIC-III dataset show that the proposed approach outperforms the current state-of-the-art models in ICD coding, with the label embeddings significantly contributing to the good performance. Our approach also leads to properly calibrated classification results, which can effectively inform downstream tasks such as quantification.


title: MULTI: Multimodal Understanding Leaderboard with Text and Images

abstract: Rapid progress in multimodal large language models (MLLMs) highlights the need to introduce challenging yet realistic benchmarks to the academic community, while existing benchmarks primarily focus on understanding simple natural images and short context. In this paper, we present MULTI as a cutting-edge benchmark for evaluating MLLMs on understanding complex tables and images, and reasoning with long context. MULTI provides multimodal inputs and requires responses that are either precise or open-ended, reflecting real-life examination styles. MULTI includes over 18,000 questions and challenges MLLMs with a variety of tasks, ranging from formula derivation to image detail analysis and cross-modality reasoning. We also introduce MULTI-Elite, a 500-question selected hard subset, and MULTI-Extend, with more than 4,500 external knowledge context pieces. Our evaluation indicates significant potential for MLLM advancement, with GPT-4V achieving a 63.7% accuracy rate on MULTI, in contrast to other MLLMs scoring between 28.5% and 55.3%. MULTI serves not only as a robust evaluation platform but also paves the way for the development of expert-level AI.


title: Decentralized Event-Triggered Online Learning for Safe Consensus of Multi-Agent Systems with Gaussian Process Regression

abstract: Consensus control in multi-agent systems has received significant attention and practical implementation across various domains. However, managing consensus control under unknown dynamics remains a significant challenge for control design due to system uncertainties and environmental disturbances. This paper presents a novel learning-based distributed control law, augmented by an auxiliary dynamics. Gaussian processes are harnessed to compensate for the unknown components of the multi-agent system. For continuous enhancement in predictive performance of Gaussian process model, a data-efficient online learning strategy with a decentralized event-triggered mechanism is proposed. Furthermore, the control performance of the proposed approach is ensured via the Lyapunov theory, based on a probabilistic guarantee for prediction error bounds. To demonstrate the efficacy of the proposed learning-based controller, a comparative analysis is conducted, contrasting it with both conventional distributed control laws and offline learning methodologies.


title: The Matrix: A Bayesian learning model for LLMs

abstract: In this paper, we introduce a Bayesian learning model to understand the behavior of Large Language Models (LLMs). We explore the optimization metric of LLMs, which is based on predicting the next token, and develop a novel model grounded in this principle. Our approach involves constructing an ideal generative text model represented by a multinomial transition probability matrix with a prior, and we examine how LLMs approximate this matrix. We discuss the continuity of the mapping between embeddings and multinomial distributions, and present the Dirichlet approximation theorem to approximate any prior. Additionally, we demonstrate how text generation by LLMs aligns with Bayesian learning principles and delve into the implications for in-context learning, specifically explaining why in-context learning emerges in larger models where prompts are considered as samples to be updated. Our findings indicate that the behavior of LLMs is consistent with Bayesian Learning, offering new insights into their functioning and potential applications.


title: Comparison of Topic Modelling Approaches in the Banking Context

abstract: Topic modelling is a prominent task for automatic topic extraction in many applications such as sentiment analysis and recommendation systems. The approach is vital for service industries to monitor their customer discussions. The use of traditional approaches such as Latent Dirichlet Allocation (LDA) for topic discovery has shown great performances, however, they are not consistent in their results as these approaches suffer from data sparseness and inability to model the word order in a document. Thus, this study presents the use of Kernel Principal Component Analysis (KernelPCA) and K-means Clustering in the BERTopic architecture. We have prepared a new dataset using tweets from customers of Nigerian banks and we use this to compare the topic modelling approaches. Our findings showed KernelPCA and K-means in the BERTopic architecture-produced coherent topics with a coherence score of 0.8463.


title: CIDAR: Culturally Relevant Instruction Dataset For Arabic

abstract: Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cater to English or are derived from English-dominated LLMs, resulting in inherent biases toward Western culture. This bias significantly impacts the linguistic structures of non-English languages such as Arabic, which has a distinct grammar reflective of the diverse cultures across the Arab region. This paper addresses this limitation by introducing CIDAR: https://hf.co/datasets/arbml/CIDAR, the first open Arabic instruction-tuning dataset culturally-aligned by human reviewers. CIDAR contains 10,000 instruction and output pairs that represent the Arab region. We discuss the cultural relevance of CIDAR via the analysis and comparison to other models fine-tuned on other datasets. Our experiments show that CIDAR can help enrich research efforts in aligning LLMs with the Arabic culture. All the code is available at https://github.com/ARBML/CIDAR.


title: Bounds of restriction of characters to submanifolds

abstract: To investigate concentration of Laplacian eigenfunctions on a compact manifold as the eigenvalue grows to infinity, an important route is to bound their restriction to submanifolds. In this paper we take the route in the setting of a compact Lie group, and provide sharp restriction bounds of general Laplacian eigenfunctions as well as important special ones such as matrix coefficients and in particular characters of irreducible representations of the group. We focus on two classes of submanifolds, namely, submanifolds of maximal flats and the conjugation-invariant submanifolds. We prove conjecturally sharp asymptotic $L^p$ bounds of restriction of general Laplacian eigenfunctions to submanifolds of maximal flats for all $p\geq 2$. We also prove sharp asymptotic $L^p$ bounds of restriction of characters to submanifolds of maximal tori for all $p>0$, of general matrix coefficients to submanifolds of maximal flats for all $p\geq 2$, and of characters to the conjugation-invariant submanifolds for all $p\geq 2$.


title: Cool-chic video: Learned video coding with 800 parameters

abstract: We propose a lightweight learned video codec with 900 multiplications per decoded pixel and 800 parameters overall. To the best of our knowledge, this is one of the neural video codecs with the lowest decoding complexity. It is built upon the overfitted image codec Cool-chic and supplements it with an inter coding module to leverage the video's temporal redundancies. The proposed model is able to compress videos using both low-delay and random access configurations and achieves rate-distortion close to AVC while out-performing other overfitted codecs such as FFNeRV. The system is made open-source: orange-opensource.github.io/Cool-Chic.


title: Nitrogen-polar growth of AlN on vicinal (0001) sapphire by MOVPE

abstract: We report about metalorganic vapour phase epitaxy of smooth nitrogen-polar AlN templates on vicinal (0001) sapphire substrates. The influence of V/III ratio, growth temperature, growth rate, as well as sapphire-nitridation time and temperature were studied. With 4{\deg} offcut sapphire, step-flow growth was possible only with V/III ratios below 2. However, optimal V/III ratio required precise adjustment, possibly dependent on reactor history and geometry. A rather narrow temperature window of less than 40{\deg}C existed for smooth surface morphology. Reducing the temperature affected adatom mobility, eventually disrupting step-flow growth; increasing the temperature favoured the formation of high-aspect-ratio defects on the epilayer. A low thermal-budget nitridation step with a short nitridation time of 15 s proved to be effective in controlling polarity without inducing excessive surface damage on the sapphire substrate. Growth rate also influenced surface morphology, with an increase in RMS roughness and step-bouncing for faster growths; however, at growth rates of 1.4 ${\mu}$m/h or higher step-flow growth could no longer form. Finally, we developed a V/III ratio fine-tuning procedure, whereby the reactor-specific value that induces optimal growth is inferred by growth-rate variations. With this method, N polar AlN templates with sub-nanometre RMS roughness were demonstrated for both 4{\deg} and 2{\deg} offcut sapphire substrates.


title: C-RAG: Certified Generation Risks for Retrieval-Augmented Language Models

abstract: Despite the impressive capabilities of large language models (LLMs) across diverse applications, they still suffer from trustworthiness issues, such as hallucinations and misalignments. Retrieval-augmented language models (RAG) have been proposed to enhance the credibility of generations by grounding external knowledge, but the theoretical understandings of their generation risks remains unexplored. In this paper, we answer: 1) whether RAG can indeed lead to low generation risks, 2) how to provide provable guarantees on the generation risks of RAG and vanilla LLMs, and 3) what sufficient conditions enable RAG models to reduce generation risks. We propose C-RAG, the first framework to certify generation risks for RAG models. Specifically, we provide conformal risk analysis for RAG models and certify an upper confidence bound of generation risks, which we refer to as conformal generation risk. We also provide theoretical guarantees on conformal generation risks for general bounded risk functions under test distribution shifts. We prove that RAG achieves a lower conformal generation risk than that of a single LLM when the quality of the retrieval model and transformer is non-trivial. Our intensive empirical results demonstrate the soundness and tightness of our conformal generation risk guarantees across four widely-used NLP datasets on four state-of-the-art retrieval models.


title: Empowering Time Series Analysis with Large Language Models: A Survey

abstract: Recently, remarkable progress has been made over large language models (LLMs), demonstrating their unprecedented capability in varieties of natural language tasks. However, completely training a large general-purpose model from the scratch is challenging for time series analysis, due to the large volumes and varieties of time series data, as well as the non-stationarity that leads to concept drift impeding continuous model adaptation and re-training. Recent advances have shown that pre-trained LLMs can be exploited to capture complex dependencies in time series data and facilitate various applications. In this survey, we provide a systematic overview of existing methods that leverage LLMs for time series analysis. Specifically, we first state the challenges and motivations of applying language models in the context of time series as well as brief preliminaries of LLMs. Next, we summarize the general pipeline for LLM-based time series analysis, categorize existing methods into different groups (i.e., direct query, tokenization, prompt design, fine-tune, and model integration), and highlight the key ideas within each group. We also discuss the applications of LLMs for both general and spatial-temporal time series data, tailored to specific domains. Finally, we thoroughly discuss future research opportunities to empower time series analysis with LLMs.


title: Predicting Configuration Performance in Multiple Environments with Sequential Meta-learning

abstract: Learning and predicting the performance of given software configurations are of high importance to many software engineering activities. While configurable software systems will almost certainly face diverse running environments (e.g., version, hardware, and workload), current work often either builds performance models under a single environment or fails to properly handle data from diverse settings, hence restricting their accuracy for new environments. In this paper, we target configuration performance learning under multiple environments. We do so by designing SeMPL - a meta-learning framework that learns the common understanding from configurations measured in distinct (meta) environments and generalizes them to the unforeseen, target environment. What makes it unique is that unlike common meta-learning frameworks (e.g., MAML and MetaSGD) that train the meta environments in parallel, we train them sequentially, one at a time. The order of training naturally allows discriminating the contributions among meta environments in the meta-model built, which fits better with the characteristic of configuration data that is known to dramatically differ between different environments. Through comparing with 15 state-of-the-art models under nine systems, our extensive experimental results demonstrate that SeMPL performs considerably better on 89% of the systems with up to 99% accuracy improvement, while being data-efficient, leading to a maximum of 3.86x speedup. All code and data can be found at our repository: https://github.com/ideas-labo/SeMPL.


title: A theorem on local scale invariance

abstract: We give a general proof that the only static and spherically symmetric, vacuum solutions of the local scale invariant conformally coupled scalar theory of gravity, are conformal to the Schwarzschild-de Sitter solution. In this context the physical relevance of local scale symmetry is discussed.


title: Stateless Quantum Structures and Extremal Graph Theory

abstract: We study hypergraphs which represent finite quantum event structures. We contribute to results of graph theory, regarding bounds on the number of edges, given the number of vertices. We develop a missing one for 3-graphs of girth 4. As an application of the graph-theoretical approach to quantum structures, we show that the smallest orthoalgebra with an empty state space has 10 atoms. Optimized constructions of an orthomodular poset and an orthomodular lattice with no group-valued measures are given. We present also a handcrafted construction of an orthoalgebra with no group-valued measure; it is larger, but its properties can be verified without a computer


title: Charting The Evolution of Solidity Error Handling

abstract: The usage of error handling in Solidity smart contracts is vital because smart contracts perform transactions that should be verified. Transactions that are not carefully handled, may lead to program crashes and vulnerabilities, implying financial loss and legal consequences. While Solidity designers attempt to constantly update the language with new features, including error-handling (EH) features, it is necessary for developers to promptly absorb how to use them. We conduct a large-scale empirical study on 283K unique open-source smart contracts to identify patterns regarding the usage of Solidity EH features over time. Overall, the usage of most EH features is limited. However, we observe an upward trend (> 60%) in the usage of a Solidity-tailored EH feature, i.e., require. This indicates that designers of modern programming languages may consider making error handling more tailored to the purposes of each language. Our analysis on 102 versions of the Solidity documentation indicates the volatile nature of Solidity, as the language changes frequently, i.e., there are changes on EH features once or twice a year. Such frequent releases may confuse smart contract developers, discouraging them to carefully read the Solidity documentation, and correctly adopt EH features. Furthermore, our findings reveal that nearly 70% of the examined smart contracts are exposed to potential failures due to missing error handing, e.g., unchecked external calls. Therefore, the use of EH features should be further supported via a more informative documentation containing (1) representative and meaningful examples and (2) details about the impact of potential EH misuses.


title: How Good is a Single Basin?

abstract: The multi-modal nature of neural loss landscapes is often considered to be the main driver behind the empirical success of deep ensembles. In this work, we probe this belief by constructing various "connected" ensembles which are restricted to lie in the same basin. Through our experiments, we demonstrate that increased connectivity indeed negatively impacts performance. However, when incorporating the knowledge from other basins implicitly through distillation, we show that the gap in performance can be mitigated by re-discovering (multi-basin) deep ensembles within a single basin. Thus, we conjecture that while the extra-basin knowledge is at least partially present in any given basin, it cannot be easily harnessed without learning it from other basins.


title: Towards mitigating uncann(eye)ness in face swaps via gaze-centric loss terms

abstract: Advances in face swapping have enabled the automatic generation of highly realistic faces. Yet face swaps are perceived differently than when looking at real faces, with key differences in viewer behavior surrounding the eyes. Face swapping algorithms generally place no emphasis on the eyes, relying on pixel or feature matching losses that consider the entire face to guide the training process. We further investigate viewer perception of face swaps, focusing our analysis on the presence of an uncanny valley effect. We additionally propose a novel loss equation for the training of face swapping models, leveraging a pretrained gaze estimation network to directly improve representation of the eyes. We confirm that viewed face swaps do elicit uncanny responses from viewers. Our proposed improvements significant reduce viewing angle errors between face swaps and their source material. Our method additionally reduces the prevalence of the eyes as a deciding factor when viewers perform deepfake detection tasks. Our findings have implications on face swapping for special effects, as digital avatars, as privacy mechanisms, and more; negative responses from users could limit effectiveness in said applications. Our gaze improvements are a first step towards alleviating negative viewer perceptions via a targeted approach.


title: Nagata Dimension and Lipschitz Extensions Into Quasi-Banach Spaces

abstract: Given two metric spaces $\mathcal N \subseteq \mathcal M$ in inclusion and $0<p\leq 1$, we wish to determine the smallest constant $\mathfrak{t}_p (\mathcal N, \mathcal M)$ such that any Lipschitz map $f: \mathcal N \to Z$ into any $p$-Banach space $Z$ can be extended to a Lipschitz map $f' : \mathcal M \to Z$ satisfying $\operatorname{Lip} f' \leq \mathfrak{t}_p (\mathcal N, \mathcal M)\cdot \operatorname{Lip} f$. In this article, we prove that if $\mathcal N$ has finite Nagata dimension at most $d$ with constant $\gamma$, then $\mathfrak{t}_p (\mathcal N, \mathcal M) \lesssim_p \gamma \cdot (d+1)^{1/p -1} \cdot \log (d+2)$ for all $0<p\leq 1$. We show that examples of spaces with finite Nagata dimension include doubling spaces, as well as minor-excluded metric graphs. We also establish that the constant $\mathfrak{t}_p (\mathcal N, \mathcal M)$ generally increases as $p$ approaches zero.


title: Unified Hallucination Detection for Multimodal Large Language Models

abstract: Despite significant strides in multimodal tasks, Multimodal Large Language Models (MLLMs) are plagued by the critical issue of hallucination. The reliable detection of such hallucinations in MLLMs has, therefore, become a vital aspect of model evaluation and the safeguarding of practical application deployment. Prior research in this domain has been constrained by a narrow focus on singular tasks, an inadequate range of hallucination categories addressed, and a lack of detailed granularity. In response to these challenges, our work expands the investigative horizons of hallucination detection. We present a novel meta-evaluation benchmark, MHaluBench, meticulously crafted to facilitate the evaluation of advancements in hallucination detection methods. Additionally, we unveil a novel unified multimodal hallucination detection framework, UNIHD, which leverages a suite of auxiliary tools to validate the occurrence of hallucinations robustly. We demonstrate the effectiveness of UNIHD through meticulous evaluation and comprehensive analysis. We also provide strategic insights on the application of specific tools for addressing various categories of hallucinations.


title: Isotropy, Clusters, and Classifiers

abstract: Whether embedding spaces use all their dimensions equally, i.e., whether they are isotropic, has been a recent subject of discussion. Evidence has been accrued both for and against enforcing isotropy in embedding spaces. In the present paper, we stress that isotropy imposes requirements on the embedding space that are not compatible with the presence of clusters -- which also negatively impacts linear classification objectives. We demonstrate this fact both mathematically and empirically and use it to shed light on previous results from the literature.


title: Multiple testing using uniform filtering of ordered p-values

abstract: We investigate the multiplicity model with m values of some test statistic independently drawn from a mixture of no effect (null) and positive effect (alternative), where we seek to identify, the alternative test results with a controlled error rate. We are interested in the case where the alternatives are rare. A number of multiple testing procedures filter the set of ordered p-values in order to eliminate the nulls. Such an approach can only work if the p-values originating from the alternatives form one or several identifiable clusters. The Benjamini and Hochberg (BH) method, for example, assumes that this cluster occurs in a small interval $(0,\Delta)$ and filters out all or most of the ordered p-values $p_{(r)}$ above a linear threshold $s \times r$. In repeated applications this filter controls the false discovery rate via the slope s. We propose a new adaptive filter that deletes the p-values from regions of uniform distribution. In cases where a single cluster remains, the p-values in an interval are declared alternatives, with the mid-point and the length of the interval chosen by controlling the data-dependent FDR at a desired level.


title: Spinning $Q$-ball Superradiance in 3+1D

abstract: Recently, it has been found that a $Q$-ball can amplify waves incident upon it, due to rotation in the internal space and the interaction of the two modes in the complex scalar field. While the spherically symmetric 3D case has been investigated previously, here we explore the 3D axi-symmetric case, which is numerically much more challenging. The difficulty comes because a partial wave expansion is needed, and the different partial waves can not be separated, for either the background spinning Q-ball solution or the perturbative scattering on top of it. A relaxation method and a high dimensional shooting method are applied to compute the Q-ball solutions and the amplification factors respectively. We also classify the behavior of the amplification factors and we discuss their bounds and the superradiance criteria.


title: Direct Antenna Frequency-Hopped M-FSK Modulation With Time-Modulated Arrays

abstract: We present an innovative approach that simultaneously enables direct antenna frequency-hopped M-ary frequency shift keying (DAFH-MFSK) modulation and beamsteering through the use of time-modulated arrays (TMAs). The distinctive feature of our approach lies in the modulation of the TMA excitations with binary periodic sequences, which can be easily frequency-adjusted and time-delayed to simultaneously allow for DAFH-MFSK direct antenna modulation and beamsteering. Notably, our TMA proposal offers a distinct advantage over conventional architectures in terms of performance metrics, including reduced insertion losses and enhanced phase resolution for beamsteering, while also simplifying hardware complexity.


title: Accommodating the LHC Charged Higgs Boson Excess at 130 GeV in the General Two-Higgs Doublet Model

abstract: Charged Higgs bosons are common predictions in most extensions of the Standard Model (SM) Higgs sector. Therefore, their observation would elucidate the nature of the Higgs sector. Motivated by the ATLAS collaboration's latest analysis performed with $139~\text{fb}^{-1}$ of Run 2 data intended to search for charged Higgs boson, produced in top quark decay and subsequently decaying via $H^\pm \rightarrow cb$, where an excess with a local significance of $3\sigma$ is observed at $m_{H^\pm} = 130~\rm{GeV}$, we discuss here the possibility of explaining such excess in the context of the general 2-Higgs Doublet Model (2HDM type-III), after satisfying all theoretical and up-to-date experimental constraints. We also propose phenomenological scenarios to further explore the mass region around 130 GeV in the four Yukawa types of the 2HDM type-III and suggest alternative decay channel $H^\pm \rightarrow cs$ and/or $H^\pm \rightarrow W^{\pm *}h$ to probe the nature of the observed excess (if it is not a statistical fluctuation). Future searches for $H^\pm$ will be critical in confirming or refuting the first hint of a light charged Higgs boson at the LHC.


title: Lightweight Masking Against Static Power Side-Channel Attacks

abstract: This paper presents a novel defense strategy against static power side-channel attacks (PSCAs), a critical threat to cryptographic security. Our method is based on (1) carefully tuning high-Vth versus low-Vth cell selection during synthesis, accounting for both security and timing impact, and (2), at runtime, randomly switching the operation between these cells. This approach serves to significantly obscure static power patterns, which are at the heart of static PSCAs. Our experimental results on a commercial 28nm node show a drastic increase in the effort required for a successful attack, namely up to 96 times more traces. When compared to prior countermeasures, ours incurs little cost, making it a lightweight defense.


title: Heavy-tailed $p$-value combinations from the perspective of extreme value theory

abstract: Handling multiplicity without losing much power has been a persistent challenge in various fields that often face the necessity of managing numerous statistical tests simultaneously. Recently, $p$-value combination methods based on heavy-tailed distributions, such as a Cauchy distribution, have received much attention for their ability to handle multiplicity without the prescribed knowledge of the dependence structure. This paper delves into these types of $p$-value combinations through the lens of extreme value theory. Distributions with regularly varying tails, a subclass of heavy tail distributions, are found to be useful in constructing such $p$-value combinations. Three $p$-value combination statistics (sum, max cumulative sum, and max) are introduced, of which left tail probabilities are shown to be approximately uniform when the global null is true. The primary objective of this paper is to bridge the gap between current developments in $p$-value combination methods and the literature on extreme value theory, while also offering guidance on selecting the calibrator and its associated parameters.


title: Blow-up Whitney forms, shadow forms, and Poisson processes

abstract: The Whitney forms on a simplex $T$ admit high-order generalizations that have received a great deal of attention in numerical analysis. Less well-known are the shadow forms of Brasselet, Goresky, and MacPherson. These forms generalize the Whitney forms, but have rational coefficients, allowing singularities near the faces of $T$. Motivated by numerical problems that exhibit these kinds of singularities, we introduce degrees of freedom for the shadow $k$-forms that are well-suited for finite element implementations. In particular, we show that the degrees of freedom for the shadow forms are given by integration over the $k$-dimensional faces of the blow-up $\tilde T$ of the simplex $T$. Consequently, we obtain an isomorphism between the cohomology of the complex of shadow forms and the cellular cohomology of $\tilde T$, which vanishes except in degree zero. Additionally, we discover a surprising probabilistic interpretation of shadow forms in terms of Poisson processes. This perspective simplifies several proofs and gives a way of computing bases for the shadow forms using a straightforward combinatorial calculation.


title: SOAP: A Social Authentication Protocol

abstract: Social authentication has been suggested as a usable authentication ceremony to replace manual key authentication in messaging applications. Using social authentication, chat partners authenticate their peers using digital identities managed by identity providers. In this paper, we formally define social authentication, present a protocol called SOAP that largely automates social authentication, formally prove SOAP's security, and demonstrate SOAP's practicality in two prototypes. One prototype is web-based, and the other is implemented in the open-source Signal messaging application. Using SOAP, users can significantly raise the bar for compromising their messaging accounts. In contrast to the default security provided by messaging applications such as Signal and WhatsApp, attackers must compromise both the messaging account and all identity provider-managed identities to attack a victim. In addition to its security and automation, SOAP is straightforward to adopt as it is built on top of the well-established OpenID Connect protocol.


title: Intertwined quantum phase transitions in the zirconium and niobium isotopes

abstract: Nuclei in the $A\approx100$ region exhibit intricate shape-evolution and configuration crossing signatures. Exploring both even-even and their adjacent odd-mass nuclei gives further insight on the emergence of deformation and shape-phase transitions. We employ the algebraic frameworks of the interacting boson model with configuration mixing and the new interacting boson-fermion model with configuration mixing in order to investigate the even-even zirconium with neutron number 52-70 ($^{40}$Zr) and odd-mass niobium ($_{41}$Nb) isotopes with 52-62. We compare between the evolution in energy levels, configuration and symmetry content of the wave functions, two neutron separation energies and $E2$ transition rates. The comparisons between the two chains of isotopes denote the occurrence of intertwined quantum phase transitions (IQPTs) in both chains. Such a situation occurs when two configurations, normal and intruder, cross through the critical point of a Type II quantum phase transition (QPT), and the intruder configuration undergoes on its own a Type I shape-evolution QPT from a spherical shape (weak coupling scenario) to axially deformed rotor (strong coupling scenario) in the Zr (Nb) isotopes.


title: Guidance with Spherical Gaussian Constraint for Conditional Diffusion

abstract: Recent advances in diffusion models attempt to handle conditional generative tasks by utilizing a differentiable loss function for guidance without the need for additional training. While these methods achieved certain success, they often compromise on sample quality and require small guidance step sizes, leading to longer sampling processes. This paper reveals that the fundamental issue lies in the manifold deviation during the sampling process when loss guidance is employed. We theoretically show the existence of manifold deviation by establishing a certain lower bound for the estimation error of the loss guidance. To mitigate this problem, we propose Diffusion with Spherical Gaussian constraint (DSG), drawing inspiration from the concentration phenomenon in high-dimensional Gaussian distributions. DSG effectively constrains the guidance step within the intermediate data manifold through optimization and enables the use of larger guidance steps. Furthermore, we present a closed-form solution for DSG denoising with the Spherical Gaussian constraint. Notably, DSG can seamlessly integrate as a plugin module within existing training-free conditional diffusion methods. Implementing DSG merely involves a few lines of additional code with almost no extra computational overhead, yet it leads to significant performance improvements. Comprehensive experimental results in various conditional generation tasks validate the superiority and adaptability of DSG in terms of both sample quality and time efficiency.


title: Leveraging IRS Induced Time Delay for Enhanced Physical Layer Security in VLC Systems

abstract: Indoor visible light communication (VLC) is considered secure against attackers outside the confined area where the light propagates, but it is still susceptible to interception from inside the coverage area. A new technology, intelligent reflecting surfaces (IRS), has been recently introduced, offering a way to enhance physical layer security (PLS). Most research on IRS-assisted VLC assumes the same time of arrival from all reflecting elements and overlooks the effect of time delay and the associated intersymbol interference. This paper tackles, for the first time, the effect of time delay on the secrecy rate in VLC systems. Our results show that, at a fixed light-emitting diode (LED) power of 3W, the secrecy rate can be enhanced by up to 253\% at random positions for the legitimate user when the eavesdropper is located within a 1-meter radius of the LED. Our results also show that careful allocation of the IRS elements can lead to enhanced PLS even when the eavesdropper has a more favourable position and, thus, a better channel gain than the legitimate user.


title: Right-censored models by the expectile method

abstract: Based on the expectile loss function and the adaptive LASSO penalty, the paper proposes and studies the estimation methods for the accelerated failure time (AFT) model. In this approach, we need to estimate the survival function of the censoring variable by the Kaplan-Meier estimator. The AFT model parameters are first estimated by the expectile method and afterwards, when the number of explanatory variables can be large, by the adaptive LASSO expectile method which directly carries out the automatic selection of variables. We also obtain the convergence rate and asymptotic normality for the two estimators, while showing the sparsity property for the censored adaptive LASSO expectile estimator. A numerical study using Monte Carlo simulations confirms the theoretical results and demonstrates the competitive performance of the two proposed estimators. The usefulness of these estimators is illustrated by applying them to three survival data sets.


title: Multi-agent Reinforcement Learning for Energy Saving in Multi-Cell Massive MIMO Systems

abstract: We develop a multi-agent reinforcement learning (MARL) algorithm to minimize the total energy consumption of multiple massive MIMO (multiple-input multiple-output) base stations (BSs) in a multi-cell network while preserving the overall quality-of-service (QoS) by making decisions on the multi-level advanced sleep modes (ASMs) and antenna switching of these BSs. The problem is modeled as a decentralized partially observable Markov decision process (DEC-POMDP) to enable collaboration between individual BSs, which is necessary to tackle inter-cell interference. A multi-agent proximal policy optimization (MAPPO) algorithm is designed to learn a collaborative BS control policy. To enhance its scalability, a modified version called MAPPO-neighbor policy is further proposed. Simulation results demonstrate that the trained MAPPO agent achieves better performance compared to baseline policies. Specifically, compared to the auto sleep mode 1 (symbol-level sleeping) algorithm, the MAPPO-neighbor policy reduces power consumption by approximately 8.7% during low-traffic hours and improves energy efficiency by approximately 19% during high-traffic hours, respectively.


title: Bad Science Matrices

abstract: Inspired by the bad scientist who keeps repeating an experiment 20 times to get a single outcome with $p < 0.05$, we consider matrices $A \in \mathbb{R}^{n \times n}$ whose rows are normalized in $\ell^2$ and for which $2^{-n}\sum_{x \in \left\{-1,1\right\}^n} \|Ax\|_{\ell^{\infty}}$ is large. They correspond to affine transformations of the discrete unit cube to points with, on average, at least one large coordinate. Such matrices can be seen as a collection of fair tests on a fair coin where at least one outcome is typically atypical. We prove that, as $n \rightarrow \infty$, the quantity can scale as $$ \max_{A \in \mathbb{R}^{n \times n}} \frac{1}{2^{n}}\sum_{x \in \left\{-1,1\right\}^n} \|Ax\|_{\ell^{\infty}} = (1+o(1)) \cdot \sqrt{2\log{n}}.$$ We also present candidate maximizers up to dimension $n \leq 8$ which appear to be highly structured and have nice closed-form solutions.


title: Inverse regression for spatially distributed functional data

abstract: Spatially distributed functional data are prevalent in many statistical applications such as meteorology, energy forecasting, census data, disease mapping, and neurological studies. Given their complex and high-dimensional nature, functional data often require dimension reduction methods to extract meaningful information. Inverse regression is one such approach that has become very popular in the past two decades. We study the inverse regression in the framework of functional data observed at irregularly positioned spatial sites. The functional predictor is the sum of a spatially dependent functional effect and a spatially independent functional nugget effect, while the relation between the scalar response and the functional predictor is modeled using the inverse regression framework. For estimation, we consider local linear smoothing with a general weighting scheme, which includes as special cases the schemes under which equal weights are assigned to each observation or to each subject. This framework enables us to present the asymptotic results for different types of sampling plans over time such as non-dense, dense, and ultra-dense. We discuss the domain-expanding infill (DEI) framework for spatial asymptotics, which is a mix of the traditional expanding domain and infill frameworks. The DEI framework overcomes the limitations of traditional spatial asymptotics in the existing literature. Under this unified framework, we develop asymptotic theory and identify conditions that are necessary for the estimated eigen-directions to achieve optimal rates of convergence. Our asymptotic results include pointwise and $L_2$ convergence rates. Simulation studies using synthetic data and an application to a real-world dataset confirm the effectiveness of our methods.


title: Light and Optimal Schr\"odinger Bridge Matching

abstract: Schr\"odinger Bridges (SB) have recently gained the attention of the ML community as a promising extension of classic diffusion models which is also interconnected to the Entropic Optimal Transport (EOT). Recent solvers for SB exploit the pervasive bridge matching procedures. Such procedures aim to recover a stochastic process transporting the mass between distributions given only a transport plan between them. In particular, given the EOT plan, these procedures can be adapted to solve SB. This fact is heavily exploited by recent works giving rives to matching-based SB solvers. The cornerstone here is recovering the EOT plan: recent works either use heuristical approximations (e.g., the minibatch OT) or establish iterative matching procedures which by the design accumulate the error during the training. We address these limitations and propose a novel procedure to learn SB which we call the \textbf{optimal Schr\"odinger bridge matching}. It exploits the optimal parameterization of the diffusion process and provably recovers the SB process \textbf{(a)} with a single bridge matching step and \textbf{(b)} with arbitrary transport plan as the input. Furthermore, we show that the optimal bridge matching objective coincides with the recently discovered energy-based modeling (EBM) objectives to learn EOT/SB. Inspired by this observation, we develop a light solver (which we call LightSB-M) to implement optimal matching in practice using the Gaussian mixture parameterization of the Schr\"odinger potential. We experimentally showcase the performance of our solver in a range of practical tasks. The code for the LightSB-M solver can be found at \url{https://github.com/SKholkin/LightSB-Matching}.


title: Synchronous Detection of Cosmic Rays and Correlated Errors in Superconducting Qubit Arrays

abstract: Quantum information processing at scale will require sufficiently stable and long-lived qubits, likely enabled by error-correction codes. Several recent superconducting-qubit experiments, however, reported observing intermittent spatiotemporally correlated errors that would be problematic for conventional codes, with ionizing radiation being a likely cause. Here, we directly measured the cosmic-ray contribution to spatiotemporally correlated qubit errors. We accomplished this by synchronously monitoring cosmic-ray detectors and qubit energy-relaxation dynamics of 10 transmon qubits distributed across a 5x5x0.35 mm$^3$ silicon chip. Cosmic rays caused correlated errors at a rate of 1/(10 min), accounting for 17$\pm$1% of all such events. Our qubits responded to essentially all of the cosmic rays and their secondary particles incident on the chip, consistent with the independently measured arrival flux. Moreover, we observed that the landscape of the superconducting gap in proximity to the Josephson junctions dramatically impacts the qubit response to cosmic rays. Given the practical difficulties associated with shielding cosmic rays, our results indicate the importance of radiation hardening -- for example, superconducting gap engineering -- to the realization of robust quantum error correction.


title: Examples of relative quantum cohomology

abstract: We compute the quantum cohomology relative to a Lagrangian submanifold in some complete intersections. For quadric hypersurfaces, we also give a full computation of the genus zero open Gromov-Witten invariants.


title: Universal Gradient Methods for Stochastic Convex Optimization

abstract: We develop universal gradient methods for Stochastic Convex Optimization (SCO). Our algorithms automatically adapt not only to the oracle's noise but also to the H\"older smoothness of the objective function without a priori knowledge of the particular setting. The key ingredient is a novel strategy for adjusting step-size coefficients in the Stochastic Gradient Method (SGD). Unlike AdaGrad, which accumulates gradient norms, our Universal Gradient Method accumulates appropriate combinations of gradient- and iterate differences. The resulting algorithm has state-of-the-art worst-case convergence rate guarantees for the entire H\"older class including, in particular, both nonsmooth functions and those with Lipschitz continuous gradient. We also present the Universal Fast Gradient Method for SCO enjoying optimal efficiency estimates.


title: Fast classical simulation of Harvard/QuEra IQP circuits

abstract: Establishing an advantage for (white-box) computations by a quantum computer against its classical counterpart is currently a key goal for the quantum computation community. A quantum advantage is achieved once a certain computational capability of a quantum computer is so complex that it can no longer be reproduced by classical means, and as such, the quantum advantage can be seen as a continued negotiation between classical simulations and quantum computational experiments. A recent publication (Bluvstein et al., Nature 626:58-65, 2024) introduces a type of Instantaneous Quantum Polynomial-Time (IQP) computation complemented by a $48$-qubit (logical) experimental demonstration using quantum hardware. The authors state that the ``simulation of such logical circuits is challenging'' and project the simulation time to grow rapidly with the number of CNOT layers added, see Figure 5d/bottom therein. However, we report a classical simulation algorithm that takes only $0.00257947$ seconds to compute an amplitude for the $48$-qubit computation, which is roughly $10^3$ times faster than that reported by the original authors. Our algorithm is furthermore not subject to a significant decline in performance due to the additional CNOT layers. We simulated these types of IQP computations for up to $96$ qubits, taking an average of $4.16629$ seconds to compute a single amplitude, and estimated that a $192$-qubit simulation should be tractable for computations relying on Tensor Processing Units.


title: Angular Momentum Transport in Binary Star Formation: The Enhancement of Magneto-Rotational Instability and Role of Outflows

abstract: The formation of binary stars is highly influenced by magnetic fields, which play a crucial role in transporting angular momentum. We conducted three-dimensional numerical simulations of binary star accretion via a circumbinary disk, taking into account a magnetic field perpendicular to the disk and an infalling envelope. Our simulations reproduce the following phenomena: (1) spiral arms associated with circumstellar disks, (2) turbulence in the circumbinary disk, induced by magneto-rotational instability (MRI), (3) a fast outflow launched from each circumstellar disk, and (4) a slow outflow from the circumbinary disk. The binary models exhibit a higher $\alpha$-parameter than the corresponding single star models, indicating that the binary stars enhance MRI turbulence. Moreover, an infalling envelope also enhance the turbulence, leading to a high $\alpha$-parameter. While the spiral arms promotes radial flow, causing transfer of mass and angular momentum within the circumbinary disk, the MRI turbulence and outflows are main drivers of angular momentum transfer to reduce the specific angular momentum of the system.


title: Nonlocal Structural Effects of Water on DNA Homology Recognition

abstract: The mechanism behind mutual recognition of homologous DNA sequences prior to genetic recombination is one of the remaining puzzles in molecular biology. Leading models of homology recognition, based on classical electrostatics, neglect the short-range nonlocal screening effects arising from structured water around DNA, and hence may only provide insight for relatively large separations between interacting DNAs. We elucidate the role of the effects of the nonlocal dielectric response of water on DNA-DNA interaction and show that these can dramatically enhance the driving force for recognition.

categories: physics.bio-ph cond-mat.soft cond-mat.stat-mech physics.chem-ph


title: Organic or Diffused: Can We Distinguish Human Art from AI-generated Images?

abstract: The advent of generative AI images has completely disrupted the art world. Distinguishing AI generated images from human art is a challenging problem whose impact is growing over time. A failure to address this problem allows bad actors to defraud individuals paying a premium for human art and companies whose stated policies forbid AI imagery. It is also critical for content owners to establish copyright, and for model trainers interested in curating training data in order to avoid potential model collapse. There are several different approaches to distinguishing human art from AI images, including classifiers trained by supervised learning, research tools targeting diffusion models, and identification by professional artists using their knowledge of artistic techniques. In this paper, we seek to understand how well these approaches can perform against today's modern generative models in both benign and adversarial settings. We curate real human art across 7 styles, generate matching images from 5 generative models, and apply 8 detectors (5 automated detectors and 3 different human groups including 180 crowdworkers, 4000+ professional artists, and 13 expert artists experienced at detecting AI). Both Hive and expert artists do very well, but make mistakes in different ways (Hive is weaker against adversarial perturbations while Expert artists produce higher false positives). We believe these weaknesses will remain as models continue to evolve, and use our data to demonstrate why a combined team of human and automated detectors provides the best combination of accuracy and robustness.


title: Sub-cycle resolved strong field ionization of chiral molecules and the origin of chiral photoelectron asymmetries

abstract: We report on strong field ionization of S- and R-propylene oxide in circularly polarized two-color laser fields. We find that the relative helicity of the two single color laser fields affects the photoelectron circular dichroism (PECD). Further, we observe that PECD is modulated as a function of the sub-cycle release time of the electron. Our experimental observations are successfully described by a heuristic model based on electrons in chiral initial states, which are selectively liberated by the laser field and, after tunneling, interact with an achiral Coulomb potential.


title: BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation

abstract: In this paper, we present a new embedding model, called M3-Embedding, which is distinguished for its versatility in Multi-Linguality, Multi-Functionality, and Multi-Granularity. It can support more than 100 working languages, leading to new state-of-the-art performances on multi-lingual and cross-lingual retrieval tasks. It can simultaneously perform the three common retrieval functionalities of embedding model: dense retrieval, multi-vector retrieval, and sparse retrieval, which provides a unified model foundation for real-world IR applications. It is able to process inputs of different granularities, spanning from short sentences to long documents of up to 8192 tokens. The effective training of M3-Embedding involves the following technical contributions. We propose a novel self-knowledge distillation approach, where the relevance scores from different retrieval functionalities can be integrated as the teacher signal to enhance the training quality. We also optimize the batching strategy, enabling a large batch size and high training throughput to ensure the discriminativeness of embeddings. To the best of our knowledge, M3-Embedding is the first embedding model which realizes such a strong versatility. The model and code will be publicly available at https://github.com/FlagOpen/FlagEmbedding.


title: Probability of entering an orthant by correlated fractional Brownian motion with drift: Exact asymptotics

abstract: For $\{B_H(t)= (B_{H,1}(t), \ldots, B_{H,d}(t)),t\ge0\}$, where $\{B_{H,i}(t),t\ge 0\}, 1\le i\le d$ are mutually independent fractional Brownian motions, we obtain the exact asymptotics of $$ \mathbb P (\exists t\ge 0: A B_{H}(t) - \mu t >\nu u), \ \ \ \ u\to\infty, $$ where $A$ is a non-singular $d\times d$ matrix and $\mu=(\mu_1,\ldots, \mu_d)\in R^d$, $\nu=(\nu_1, \ldots, \nu_d) \in R^d$ are such that there exists some $1\le i\le d$ such that $\mu_i>0, \nu_i>0.$


title: Determination of Schr\"odinger nonlinearities from the scattering map

abstract: We prove that the small-data scattering map uniquely determines the nonlinearity for a wide class of gauge-invariant, intercritical nonlinear Schr\"odinger equations. We use the Born approximation to reduce the analysis to a deconvolution problem involving the distribution function for linear Schr\"odinger solutions. We then solve this deconvolution problem using the Beurling--Lax Theorem.


title: Experiment-driven atomistic materials modeling: A case study combining X-ray photoelectron spectroscopy and machine learning potentials to infer the structure of oxygen-rich amorphous carbon

abstract: An important yet challenging aspect of atomistic materials modeling is reconciling experimental and computational results. Conventional approaches involve generating numerous configurations through molecular dynamics or Monte Carlo structure optimization and selecting the one with the closest match to experiment. However, this inefficient process is not guaranteed to succeed. We introduce a general method to combine atomistic machine learning (ML) with experimental observables that produces atomistic structures compatible with experiment by design. We use this approach in combination with grand-canonical Monte Carlo within a modified Hamiltonian formalism, to generate configurations that agree with experimental data and are chemically sound (low in energy). We apply our approach to understand the atomistic structure of oxygenated amorphous carbon (a-CO$_{x}$), an intriguing carbon-based material, to answer the question of how much oxygen can be added to carbon before it fully decomposes into CO and CO$_2$. Utilizing an ML-based X-ray photoelectron spectroscopy (XPS) model trained from $GW$ and density functional theory (DFT) data, in conjunction with an ML interatomic potential, we identify a-CO$_{x}$ structures compliant with experimental XPS predictions that are also energetically favorable with respect to DFT. Employing a network analysis, we accurately deconvolve the XPS spectrum into motif contributions, both revealing the inaccuracies inherent to experimental XPS interpretation and granting us atomistic insight into the structure of a-CO$_{x}$. This method generalizes to multiple experimental observables and allows for the elucidation of the atomistic structure of materials directly from experimental data, thereby enabling experiment-driven materials modeling with a degree of realism previously out of reach.


title: The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents

abstract: We investigate the training dynamics of two-layer neural networks when learning multi-index target functions. We focus on multi-pass gradient descent (GD) that reuses the batches multiple times and show that it significantly changes the conclusion about which functions are learnable compared to single-pass gradient descent. In particular, multi-pass GD with finite stepsize is found to overcome the limitations of gradient flow and single-pass GD given by the information exponent (Ben Arous et al., 2021) and leap exponent (Abbe et al., 2023) of the target function. We show that upon re-using batches, the network achieves in just two time steps an overlap with the target subspace even for functions not satisfying the staircase property (Abbe et al., 2021). We characterize the (broad) class of functions efficiently learned in finite time. The proof of our results is based on the analysis of the Dynamical Mean-Field Theory (DMFT). We further provide a closed-form description of the dynamical process of the low-dimensional projections of the weights, and numerical experiments illustrating the theory.


title: "Define Your Terms" : Enhancing Efficient Offensive Speech Classification with Definition

abstract: The propagation of offensive content through social media channels has garnered attention of the research community. Multiple works have proposed various semantically related yet subtle distinct categories of offensive speech. In this work, we explore meta-earning approaches to leverage the diversity of offensive speech corpora to enhance their reliable and efficient detection. We propose a joint embedding architecture that incorporates the input's label and definition for classification via Prototypical Network. Our model achieves at least 75% of the maximal F1-score while using less than 10% of the available training data across 4 datasets. Our experimental findings also provide a case study of training strategies valuable to combat resource scarcity.


title: The nonflow issue in connecting anisotropy measurements to hydrodynamics in relativistic heavy-ion collisions

abstract: Hydrodynamics can describe majority of the measured azimuthal anisotropies in relativistic heavy-ion collisions. Many of the anisotropy measurements are contaminated by nonflow correlations (i.e., those unrelated to global event-wise correlations). Those nonflow contamination can cause incorrectness or compromise the accuracy of the physics extracted from data-hydrodynamics comparison, particularly when one relies on subtle difference in the measurements. In the recent preprint by STAR (arXiv:2401.06625) extracting the Uranium nucleus deformation parameter, nonflow contamination is assessed by subevents in the limited STAR acceptance. In this note, we demonstrate that such assessment is inadequate and illustrate how large an effect nonflow can cause by using the HIJING model, in which all correlations are nonflow and non-hydrodynamic. We thereby conclude that the extracted Uranium deformation parameter is premature and emphasize the importance of an earnest assessment of or correction for nonflow contamination, not only for this STAR analysis but more generally for studies relying on comparing anisotropy measurements to hydrodynamic calculations.


title: English Prompts are Better for NLI-based Zero-Shot Emotion Classification than Target-Language Prompts

abstract: Emotion classification in text is a challenging task due to the processes involved when interpreting a textual description of a potential emotion stimulus. In addition, the set of emotion categories is highly domain-specific. For instance, literature analysis might require the use of aesthetic emotions (e.g., finding something beautiful), and social media analysis could benefit from fine-grained sets (e.g., separating anger from annoyance) than only those that represent basic categories as they have been proposed by Paul Ekman (anger, disgust, fear, joy, surprise, sadness). This renders the task an interesting field for zero-shot classifications, in which the label set is not known at model development time. Unfortunately, most resources for emotion analysis are English, and therefore, most studies on emotion analysis have been performed in English, including those that involve prompting language models for text labels. This leaves us with a research gap that we address in this paper: In which language should we prompt for emotion labels on non-English texts? This is particularly of interest when we have access to a multilingual large language model, because we could request labels with English prompts even for non-English data. Our experiments with natural language inference-based language models show that it is consistently better to use English prompts even if the data is in a different language.


title: Turbulence modelling in neutron star merger simulations

abstract: Observations of neutron star mergers have the potential to unveil detailed physics of matter and gravity in regimes inaccessible by other experiments. Quantitative comparisons to theory and parameter estimation require nonlinear numerical simulations. However, the detailed physics of energy and momentum transfer between different scales, and the formation and interaction of small scale structures, which can be probed by detectors, are not captured by current simulations. This is where turbulence enters neutron star modelling. This review will outline the theory and current status of turbulence modelling for relativistic neutron star merger simulations.


title: The change of vertex energy when joining trees

abstract: In this manuscript we study how the vertex energy of a tree is affected when joined with a bipartite graph. We find an alternating pattern with respect to the coalescence vertex: the energy decreases for vertices located at odd distances and increases for those located at even distances.


title: FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion

abstract: As machine learning models in critical fields increasingly grapple with multimodal data, they face the dual challenges of handling a wide array of modalities, often incomplete due to missing elements, and the temporal irregularity and sparsity of collected samples. Successfully leveraging this complex data, while overcoming the scarcity of high-quality training samples, is key to improving these models' predictive performance. We introduce ``FuseMoE'', a mixture-of-experts framework incorporated with an innovative gating function. Designed to integrate a diverse number of modalities, FuseMoE is effective in managing scenarios with missing modalities and irregularly sampled data trajectories. Theoretically, our unique gating function contributes to enhanced convergence rates, leading to better performance in multiple downstream tasks. The practical utility of FuseMoE in the real world is validated by a diverse set of challenging prediction tasks.


title: IGUANe: a 3D generalizable CycleGAN for multicenter harmonization of brain MR images

abstract: In MRI studies, the aggregation of imaging data from multiple acquisition sites enhances sample size but may introduce site-related variabilities that hinder consistency in subsequent analyses. Deep learning methods for image translation have emerged as a solution for harmonizing MR images across sites. In this study, we introduce IGUANe (Image Generation with Unified Adversarial Networks), an original 3D model that leverages the strengths of domain translation and straightforward application of style transfer methods for multicenter brain MR image harmonization. IGUANe extends CycleGAN architecture by integrating an arbitrary number of domains for training through a many-to-one strategy. During inference, the model can be applied to any image, even from an unknown acquisition site, making it a universal generator for harmonization. Trained on a dataset comprising T1-weighted images from 11 different scanners, IGUANe was evaluated on data from unseen sites. The assessments included the transformation of MR images with traveling subjects, the preservation of pairwise distances between MR images within domains, the evolution of volumetric patterns related to age and Alzheimer$^\prime$s disease (AD), and the performance in age regression and patient classification tasks. Comparisons with other harmonization and normalization methods suggest that IGUANe better preserves individual information in MR images and is more suitable for maintaining and reinforcing variabilities related to age and AD. Future studies may further assess IGUANe in other multicenter contexts, either using the same model or retraining it for applications to different image modalities.


title: Emerging double power-law through dynamical complex networks in motility-induced phase separation in Active Brownian Particles

abstract: We investigate the behavior of active Brownian particles (ABP) within a temporal complex network framework approach. We focused on the node degree distribution, average path length, and average clustering coefficient across the P\'eclet number and packing fraction region. In the single phase or gas region, particle interactions mirror a random graph, and the average number of unique interactions display a non-monotonic behavior with the packing fraction. As we ventured toward the Motility-Phase Separation (MIPS) frontier, a hybrid distribution with a time-evolving pattern emerged, combining Gaussian and power law components. Moreover, we discovered a double power-law distribution in the phase-separated region, with two characteristic slopes symbolizing the emerging gas and solid regions. Our approach involved various numerical and theoretical analyses to capture the role of the packing fraction and P\'eclet number in the topological properties of the dynamical complex network that arises during the ABP dynamics. These findings provide a robust understanding of a phase transition between two states and how this transition manifests as a random to scale-free behavior.


title: Disentangling high order effects in the transfer entropy

abstract: Transfer Entropy (TE), the primary method for determining directed information flow within a network system, can exhibit bias - either in deficiency or excess - during both pairwise and conditioned calculations, owing to high-order dependencies among the dynamic processes under consideration and the remaining processes in the system used for conditioning. Here, we propose a novel approach. Instead of conditioning TE on all network processes except the driver and target, as in its fully conditioned version, or not conditioning at all, as in the pairwise approach, our method searches for both the multiplets of variables that maximize information flow and those that minimize it. This provides a decomposition of TE into unique, redundant, and synergistic atoms. Our approach enables the quantification of the relative importance of high-order effects compared to pure two-body effects in information transfer between two processes, while also highlighting the processes that contribute to building these high-order effects alongside the driver. We demonstrate the application of our approach in climatology by analyzing data from El Ni\~{n}o and the Southern Oscillation.


title: Architecture Analysis and Benchmarking of 3D U-shaped Deep Learning Models for Thoracic Anatomical Segmentation

abstract: Recent rising interests in patient-specific thoracic surgical planning and simulation require efficient and robust creation of digital anatomical models from automatic medical image segmentation algorithms. Deep learning (DL) is now state-of-the-art in various radiological tasks, and U-shaped DL models have particularly excelled in medical image segmentation since the inception of the 2D UNet. To date, many variants of U-shaped models have been proposed by the integration of different attention mechanisms and network configurations. Systematic benchmark studies which analyze the architecture of these models by leveraging the recent development of the multi-label databases, can provide valuable insights for clinical deployment and future model designs, but such studies are still rare. We conduct the first systematic benchmark study for variants of 3D U-shaped models (3DUNet, STUNet, AttentionUNet, SwinUNETR, FocalSegNet, and a novel 3D SwinUnet with four variants) with a focus on CT-based anatomical segmentation for thoracic surgery. Our study systematically examines the impact of different attention mechanisms, the number of resolution stages, and network configurations on segmentation accuracy and computational complexity. To allow cross-reference with other recent benchmarking studies, we also included a performance assessment of the BTCV abdominal structural segmentation. With the STUNet ranking at the top, our study demonstrated the value of CNN-based U-shaped models for the investigated tasks and the benefit of residual blocks in network configuration designs to boost segmentation performance.


title: Improved prediction of future user activity in online A/B testing

abstract: In online randomized experiments or A/B tests, accurate predictions of participant inclusion rates are of paramount importance. These predictions not only guide experimenters in optimizing the experiment's duration but also enhance the precision of treatment effect estimates. In this paper we present a novel, straightforward, and scalable Bayesian nonparametric approach for predicting the rate at which individuals will be exposed to interventions within the realm of online A/B testing. Our approach stands out by offering dual prediction capabilities: it forecasts both the quantity of new customers expected in future time windows and, unlike available alternative methods, the number of times they will be observed. We derive closed-form expressions for the posterior distributions of the quantities needed to form predictions about future user activity, thereby bypassing the need for numerical algorithms such as Markov chain Monte Carlo. After a comprehensive exposition of our model, we test its performance on experiments on real and simulated data, where we show its superior performance with respect to existing alternatives in the literature.


title: Smart Flow Matching: On The Theory of Flow Matching Algorithms with Applications

abstract: The paper presents the exact formula for the vector field that minimizes the loss for the standard flow. This formula depends analytically on a given distribution \rho_0 and an unknown one \rho_1. Based on the presented formula, a new loss and algorithm for training a vector field model in the style of Conditional Flow Matching are provided. Our loss, in comparison to the standard Conditional Flow Matching approach, exhibits smaller variance when evaluated through Monte Carlo sampling methods. Numerical experiments on synthetic models and models on tabular data of large dimensions demonstrate better learning results with the use of the presented algorithm.


title: Spin-s Dicke states and their preparation

abstract: We introduce the notion of $su(2)$ spin-$s$ Dicke states, which are higher-spin generalizations of usual (spin-1/2) Dicke states. These multi-qudit states can be expressed as superpositions of $su(2s+1)$ qudit Dicke states. They satisfy a recursion formula, which we use to formulate an efficient quantum circuit for their preparation, whose size scales as $s k n$ for $k\ll 2 s n$, where $n$ is the number of qudits and $k$ is the number of times the total spin-lowering operator is applied to the highest-weight state. The algorithm is deterministic and does not require ancillary qudits.


title: Spectroscopic Insights into the Quiescent Stages of RS Ophiuchi (2006-2021): Photoionization Modeling and Accretion Dynamics

abstract: This paper presents a comprehensive spectroscopic analysis of the nova RS Ophiuchi during its quiescent stage, spanning a duration of approximately 13 years. The spectra exhibit prominent low-ionization emission features, including hydrogen, helium, iron, and TiO absorption features originating from the cool secondary component. The CLOUDY photoionization code is employed to model these spectra, allowing us to estimate various physical parameters such as temperature, luminosity, and hydrogen density, along with elemental abundances and accretion rate. The central ionizing sources exhibit temperatures in the range of $1.05 - 1.8~\times 10^4$ K and luminosities between $0.1 - 7.9~\times 10^{30}$ \ergs. Notably, \ion{He}{} displays an overabundance from 2008 to 2016, returning to solar values by 2020, while \ion{Fe}{} appears subsolar from 2008 to 2014 but becomes overabundant from 2006 onward. The mean accretion rate, as calculated from the model, is approximately $1.254 \times 10^{-8} M_{\odot}$ yr$^{-1}$. About 47\% of the critical mass was accreted after April, 2020 ($\sim$15 months before the 2021 outburst), and approximately 88\% of the critical mass was accreted after July 20, 2018. This non-uniform accretion rate suggests a more rapid approach towards reaching the critical mass in the final years, possibly attributed to the heightened gravitational pull resulting from previously accreted matter, influencing the accretion dynamics as the system approaches the critical mass limit.


title: ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detection

abstract: The curation of large-scale datasets is still costly and requires much time and resources. Data is often manually labeled, and the challenge of creating high-quality datasets remains. In this work, we fill the research gap using active learning for multi-modal 3D object detection. We propose ActiveAnno3D, an active learning framework to select data samples for labeling that are of maximum informativeness for training. We explore various continuous training methods and integrate the most efficient method regarding computational demand and detection performance. Furthermore, we perform extensive experiments and ablation studies with BEVFusion and PV-RCNN on the nuScenes and TUM Traffic Intersection dataset. We show that we can achieve almost the same performance with PV-RCNN and the entropy-based query strategy when using only half of the training data (77.25 mAP compared to 83.50 mAP) of the TUM Traffic Intersection dataset. BEVFusion achieved an mAP of 64.31 when using half of the training data and 75.0 mAP when using the complete nuScenes dataset. We integrate our active learning framework into the proAnno labeling tool to enable AI-assisted data selection and labeling and minimize the labeling costs. Finally, we provide code, weights, and visualization results on our website: https://active3d-framework.github.io/active3d-framework.


title: The Disruption of Dark Matter Minihalos by Successive Stellar Encounters

abstract: Scenarios such as the QCD axion with the Peccei-Quinn symmetry broken after inflation predict an enhanced matter power spectrum on sub-parsec scales. These theories lead to the formation of dense dark matter structures known as minihalos, which provide insights into early Universe dynamics and have implications for direct detection experiments. We examine the mass loss of minihalos during stellar encounters, building on previous studies that derived formulas for mass loss and performed N-body simulations. We propose a new formula for the mass loss that accounts for changes in the minihalo profile after disruption by a passing star. We also investigate the mass loss for multiple stellar encounters. We demonstrate that accurately assessing the mass loss in minihalos due to multiple stellar encounters necessitates considering the alterations in the minihalo's binding energy after each encounter, as overlooking this aspect results in a substantial underestimation of the mass loss.


title: Declipping and the recovery of vectors from saturated measurements

abstract: A frame $(x_j)_{j\in J}$ for a Hilbert space $H$ allows for a linear and stable reconstruction of any vector $x\in H$ from the linear measurements $(\langle x,x_j\rangle)_{j\in J}$. However, there are many situations where some information in the frame coefficients is lost. In applications where one is using sensors with a fixed dynamic range, any measurement above that range is registered as the maximum, and any measurement below that range is registered as the minimum. Depending on the context, recovering a vector from such measurements is called either declipping or saturation recovery. We initiate a frame theoretic approach to saturation recovery in a similar way to what [BCE06] did for phase retrieval. We characterize when saturation recovery is possible, show optimal frames for use with saturation recovery correspond to minimal multi-fold packings in projective space, and prove that the classical frame algorithm may be adapted to this non-linear problem to provide a reconstruction algorithm.


title: Alternate cleavage structure and electronic inhomogeneity in Ca-doped YBa$_2$Cu$_3$O$_{7-\delta}$

abstract: YBa$_2$Cu$_3$O$_{7-\delta}$ (YBCO) has favorable macroscopic superconducting properties of $T_\mathrm{c}$ up to 93 K and $H_{c2}$ up to 150 T. However, its nanoscale electronic structure remains mysterious because bulk-like electronic properties are not preserved near the surface of cleaved samples for easy access by local or surface-sensitive probes. It has been hypothesized that Ca-doping at the Y site could induce an alternate cleavage plane that mitigates this issue. We use scanning tunneling microscopy (STM) to study both Ca-free and 10% Ca-doped YBCO, and find that the Ca-doped samples do indeed cleave on an alternate plane, yielding a spatially-disordered partial (Y,Ca) layer. Our density functional theory calculations support the increased likelihood of this new cleavage plane in Ca-doped YBCO. On this surface, we image a superconducting gap with average value 24 $\pm$ 3 meV and characteristic length scale 1-2 nm, similar to Bi-based high-$T_\mathrm{c}$ cuprates, but the first map of gap inhomogeneity in the YBCO family.


title: Bluesky and the AT Protocol: Usable Decentralized Social Media

abstract: Bluesky is a new social network built upon the AT Protocol, a decentralized foundation for public social media. It was launched in private beta in February 2023, and has grown to over 3 million registered users in the following year. In this paper we introduce the architecture of Bluesky and the AT Protocol, which is inspired by the web itself, but modernized to include streams of real-time updates and cryptographic authentication. We explain how the technical design of Bluesky is informed by our goals: to enable decentralization by having multiple interoperable providers for every part of the system; to make it easy for users to switch providers; to give users agency over the content they see; and to provide a simple user experience that does not burden users with complexity arising from the system's decentralized nature. The system's openness allows anybody to contribute to content moderation and community management, and we invite the research community to use Bluesky as a dataset and testing ground for new approaches in social media moderation.


title: Presymplectic minimal models of local gauge theories

abstract: We elaborate on the recently proposed notion of a weak presymplectic gauge PDE. It is a $\mathbb{Z}$-graded bundle over the space-time manifold, equipped with a degree $1$ vector field and a compatible graded presymplectic structure. This geometrical data naturally defines a Lagrangian gauge field theory. Moreover, it encodes not only the Lagrangian of the theory but also its full-scale Batalin-Vilkovisky (BV) formulation. In particular, the respective field-antifield space arises as a symplectic quotient of the super-jet bundle of the initial fiber bundle. A remarkable property of this approach is that among the variety of presymplectic gauge PDEs encoding a given gauge theory we can pick a minimal one that usually turns out to be finite-dimensional, and unique in a certain sense. The approach can be considered as an extension of the familiar AKSZ construction to not necessarily topological and diffeomorphism-invariant theories. We present a variety of examples including $p$-forms, chiral Yang-Mills theory, Holst gravity, and conformal gravity. We also explain the explicit relation to the non-BV-BRST version of the formalism, which happens to be closely related to the covariant phase space and the multisymplectic approaches.


title: FROSTER: Frozen CLIP Is A Strong Teacher for Open-Vocabulary Action Recognition

abstract: In this paper, we introduce FROSTER, an effective framework for open-vocabulary action recognition. The CLIP model has achieved remarkable success in a range of image-based tasks, benefiting from its strong generalization capability stemming from pretaining on massive image-text pairs. However, applying CLIP directly to the open-vocabulary action recognition task is challenging due to the absence of temporal information in CLIP's pretraining. Further, fine-tuning CLIP on action recognition datasets may lead to overfitting and hinder its generalizability, resulting in unsatisfactory results when dealing with unseen actions. To address these issues, FROSTER employs a residual feature distillation approach to ensure that CLIP retains its generalization capability while effectively adapting to the action recognition task. Specifically, the residual feature distillation treats the frozen CLIP model as a teacher to maintain the generalizability exhibited by the original CLIP and supervises the feature learning for the extraction of video-specific features to bridge the gap between images and videos. Meanwhile, it uses a residual sub-network for feature distillation to reach a balance between the two distinct objectives of learning generalizable and video-specific features. We extensively evaluate FROSTER on open-vocabulary action recognition benchmarks under both base-to-novel and cross-dataset settings. FROSTER consistently achieves state-of-the-art performance on all datasets across the board. Project page: https://visual-ai.github.io/froster.


title: JOBSKAPE: A Framework for Generating Synthetic Job Postings to Enhance Skill Matching

abstract: Recent approaches in skill matching, employing synthetic training data for classification or similarity model training, have shown promising results, reducing the need for time-consuming and expensive annotations. However, previous synthetic datasets have limitations, such as featuring only one skill per sentence and generally comprising short sentences. In this paper, we introduce JobSkape, a framework to generate synthetic data that tackles these limitations, specifically designed to enhance skill-to-taxonomy matching. Within this framework, we create SkillSkape, a comprehensive open-source synthetic dataset of job postings tailored for skill-matching tasks. We introduce several offline metrics that show that our dataset resembles real-world data. Additionally, we present a multi-step pipeline for skill extraction and matching tasks using large language models (LLMs), benchmarking against known supervised methodologies. We outline that the downstream evaluation results on real-world data can beat baselines, underscoring its efficacy and adaptability.


title: PINN-BO: A Black-box Optimization Algorithm using Physics-Informed Neural Networks

abstract: Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain knowledge to enhance the efficacy of machine learning methods. Partial Differential Equations (PDEs) often provide an effective means for elucidating the fundamental principles governing the black-box functions. In this paper, we propose PINN-BO, a black-box optimization algorithm employing Physics-Informed Neural Networks that integrates the knowledge from Partial Differential Equations (PDEs) to improve the sample efficiency of the optimization. We analyze the theoretical behavior of our algorithm in terms of regret bound using advances in NTK theory and prove that the use of the PDE alongside the black-box function evaluations, PINN-BO leads to a tighter regret bound. We perform several experiments on a variety of optimization tasks and show that our algorithm is more sample-efficient compared to existing methods.


title: Skill Set Optimization: Reinforcing Language Model Behavior via Transferable Skills

abstract: Large language models (LLMs) have recently been used for sequential decision making in interactive environments. However, leveraging environment reward signals for continual LLM actor improvement is not straightforward. We propose Skill Set Optimization (SSO) for improving LLM actor performance through constructing and refining sets of transferable skills. SSO constructs skills by extracting common subtrajectories with high rewards and generating subgoals and instructions to represent each skill. These skills are provided to the LLM actor in-context to reinforce behaviors with high rewards. Then, SSO further refines the skill set by pruning skills that do not continue to result in high rewards. We evaluate our method in the classic videogame NetHack and the text environment ScienceWorld to demonstrate SSO's ability to optimize a set of skills and perform in-context policy improvement. SSO outperforms baselines by 40% in our custom NetHack task and outperforms the previous state-of-the-art in ScienceWorld by 35%.


title: On the Popov-Belevitch-Hautus tests for functional observability and output controllability

abstract: Functional observability and output controllability are properties that establish the conditions respectively for the partial estimation and partial control of the system state. In the special case of full-state observability and controllability, the Popov-Belevitch-Hautus (PBH) tests provide conditions for the properties to hold based on the system eigenspace. Generalizations of the Popov-Belevitch-Hautus (PBH) test have been recently proposed for functional observability and output controllability but were proved to be valid only for diagonalizable systems thus far. Here, we rigorously establish a more general class of systems based on their Jordan decomposition under which a generalized PBH test for functional observability is valid. Likewise, we determine the class of systems under which the generalized PBH test is sufficient and necessary for output controllability. These results have immediate implications for observer and controller design, pole assignment, and optimal placement of sensors and drivers.

categories: math.OC cond-mat.dis-nn cs.SY eess.SY math.DS physics.soc-ph


title: SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM

abstract: We present SGS-SLAM, the first semantic visual SLAM system based on Gaussian Splatting. It incorporates appearance, geometry, and semantic features through multi-channel optimization, addressing the oversmoothing limitations of neural implicit SLAM systems in high-quality rendering, scene understanding, and object-level geometry. We introduce a unique semantic feature loss that effectively compensates for the shortcomings of traditional depth and color losses in object optimization. Through a semantic-guided keyframe selection strategy, we prevent erroneous reconstructions caused by cumulative errors. Extensive experiments demonstrate that SGS-SLAM delivers state-of-the-art performance in camera pose estimation, map reconstruction, precise semantic segmentation, and object-level geometric accuracy, while ensuring real-time rendering capabilities.


title: HEANA: A Hybrid Time-Amplitude Analog Optical Accelerator with Flexible Dataflows for Energy-Efficient CNN Inference

abstract: Several photonic microring resonators (MRRs) based analog accelerators have been proposed to accelerate the inference of integer-quantized CNNs with remarkably higher throughput and energy efficiency compared to their electronic counterparts. However, the existing analog photonic accelerators suffer from three shortcomings: (i) severe hampering of wavelength parallelism due to various crosstalk effects, (ii) inflexibility of supporting various dataflows other than the weight-stationary dataflow, and (iii) failure in fully leveraging the ability of photodetectors to perform in-situ accumulations. These shortcomings collectively hamper the performance and energy efficiency of prior accelerators. To tackle these shortcomings, we present a novel Hybrid timE Amplitude aNalog optical Accelerator, called HEANA. HEANA employs hybrid time-amplitude analog optical multipliers (TAOMs) that increase the flexibility of HEANA to support multiple dataflows. A spectrally hitless arrangement of TAOMs significantly reduces the crosstalk effects, thereby increasing the wavelength parallelism in HEANA. Moreover, HEANA employs our invented balanced photo-charge accumulators (BPCAs) that enable buffer-less, in-situ, temporal accumulations to eliminate the need to use reduction networks in HEANA, relieving it from related latency and energy overheads. Our evaluation for the inference of four modern CNNs indicates that HEANA provides improvements of atleast 66x and 84x in frames-per-second (FPS) and FPS/W (energy-efficiency), respectively, for equal-area comparisons, on gmean over two MRR-based analog CNN accelerators from prior work.


title: On a question of Gary G. Gundersen concerning meromorphic functions sharing three distinct values IM and a fourth value CM

abstract: In 1992, Gundersen (Complex Var. Elliptic Equ.20 (1992), no. 1-4, 99-106.) proposed the following famous open question: if two non-constant meromorphic functions share three values IM and share a fourth value CM, then do the functions necessarily share all four values CM? The open question is a long-standing question in the studies of the Nevanlinna$'$s value distribution theory of meromorphic functions, and has not been completely resolved by now. In this paper, we prove that if two distinct non-constant meromorphic functions $f$ and $g$ of finite order share $0,$ $1,$ $c$ IM and $\infty$ CM, where $c$ is a finite complex value such that $c\not\in\{0,1\},$ then $f$ and $g$ share $0,$ $1,$ $c,$ $\infty$ CM. Applying the main result obtained in this paper, we completely resolve a question proposed by Gary G. Gundersen on Page 458 of his paper (J. London Math. Soc. 20(1979), no. 2, 457-466.)concerning the nonexistence of two distinct non-constant meromorphic functions sharing three distinct values DM and a fourth value CM. The obtained result also improves the corresponding result on Pages 109-117 in (E. Mues, Bemerkungen zum vier-punkte-satz, Complex Methods on Partial Diferential Equations, 109-117, Math. Res. 53, Akademie-Verlag, Berlin, 1989.) concerning the nonexistence of two distinct non-constant entire functions that share three distinct finite values DM. Examples are provided to show that the main results obtained in this paper, in a sense, are best possible.


title: Nonsense associations in Markov random fields with pairwise dependence

abstract: Yule (1926) identified the issue of "nonsense correlations" in time series data, where dependence within each of two random vectors causes overdispersion -- i.e. variance inflation -- for measures of dependence between the two. During the near century since then, much has been written about nonsense correlations -- but nearly all of it confined to the time series literature. In this paper we provide the first, to our knowledge, rigorous study of this phenomenon for more general forms of (positive) dependence, specifically for Markov random fields on lattices and graphs. We consider both binary and continuous random vectors and three different measures of association: correlation, covariance, and the ordinary least squares coefficient that results from projecting one random vector onto the other. In some settings we find variance inflation consistent with Yule's nonsense correlation. However, surprisingly, we also find variance deflation in some settings, and in others the variance is unchanged under dependence. Perhaps most notably, we find general conditions under which OLS inference that ignores dependence is valid despite positive dependence in the regression errors, contradicting the presentation of OLS in countless textbooks and courses.


title: The Fefferman-Phong uncertainty principle for representations of Lie groups and applications

abstract: We prove a new uncertainty principle for square-integrable irreducible unitary representations of connected Lie groups. The concentration of the matrix coefficients is measured in terms of weighted $L^p$ norms, with weights in the local Muckenhoupt class $A_{\infty,{\rm loc}}$ associated with a subRiemannian left-invariant metric and a relatively invariant measure. The result is reminiscent of the Fefferman-Phong uncertainty principle, and is new even for the Schr\"odinger representation of the reduced Heisenberg group, which corresponds to the short-time Fourier transform. As an application, we give an optimal estimate of the order of magnitude of the bottom of the spectrum and of the essential spectrum of semiclassical anti-Wick operators in $\mathbb{R}^d$ with a nonnegative symbol $a$ in the class $A_{\infty}$ (in particular, for polynomial symbols). Precisely, we show that the infimum $\inf _{(x_0,\omega_0)\in{\mathbb{R}^{2d}}} -\!\!\!\!\!\int_{B((x_0,\omega_0),\sqrt{h})} a(x,\omega)\, dx\,d\omega$ represents (up to multiplicative constants) both a lower bound and an upper bound for the bottom of the spectrum, uniformly with respect to $h>0$. Similarly the quantity $$\liminf_{(x_0,\omega_0)\to\infty} -\!\!\!\!\!\!\int_{B((x_0,\omega_0),\sqrt{h})} a(x,\omega)\, dx\,d\omega$$ represents both a lower bound and an upper bound for the bottom of the essential spectrum, uniformly with respect to $h>0$. Similar results are proved for semiclassical symbol classes.


title: CLIP Can Understand Depth

abstract: Recent studies on generalizing CLIP for monocular depth estimation reveal that CLIP pre-trained on web-crawled data is inefficient for deriving proper similarities between image patches and depth-related prompts. In this paper, we adapt CLIP for meaningful quality of monocular depth estimation with dense prediction, without fine-tuning its original vision-language alignment. By jointly training a compact deconvolutional decoder with a tiny learnable embedding matrix named mirror, as a static prompt for its text encoder, CLIP is enabled to understand depth. With this approach, our model exhibits impressive performance matching several previous state-of-the-art vision-only models on the NYU Depth v2 and KITTI datasets, outperforming every CLIP-based depth estimation model with a large margin. Experiments on temporal depth consistency and spatial continuity demonstrate that the prior knowledge of CLIP can be effectively refined by our proposed framework. Furthermore, an ablation study on mirror proves that the resulting model estimates depth utilizing knowledge not only from the image encoder but also text encoder despite not being given any prompt written in a human way. This research demonstrates that through minimal adjustments, the prior knowledge of vision-language foundation models, such as CLIP, can be generalized even to domains where learning during pretraining is challenging. We facilitate future works focused on methods to adjust suboptimal prior knowledge of vision-language models using non-human language prompts, achieving performance on par with task-specific state-of-the-art methodologies.


title: Fair Active Ranking from Pairwise Preferences

abstract: We investigate the problem of probably approximately correct and fair (PACF) ranking of items by adaptively evoking pairwise comparisons. Given a set of $n$ items that belong to disjoint groups, our goal is to find an $(\epsilon, \delta)$-PACF-Ranking according to a fair objective function that we propose. We assume access to an oracle, wherein, for each query, the learner can choose a pair of items and receive stochastic winner feedback from the oracle. Our proposed objective function asks to minimize the $\ell_q$ norm of the error of the groups, where the error of a group is the $\ell_p$ norm of the error of all the items within that group, for $p, q \geq 1$. This generalizes the objective function of $\epsilon$-Best-Ranking, proposed by Saha & Gopalan (2019). By adopting our objective function, we gain the flexibility to explore fundamental fairness concepts like equal or proportionate errors within a unified framework. Adjusting parameters $p$ and $q$ allows tailoring to specific fairness preferences. We present both group-blind and group-aware algorithms and analyze their sample complexity. We provide matching lower bounds up to certain logarithmic factors for group-blind algorithms. For a restricted class of group-aware algorithms, we show that we can get reasonable lower bounds. We conduct comprehensive experiments on both real-world and synthetic datasets to complement our theoretical findings.