title: SineNet: Learning Temporal Dynamics in Time-Dependent Partial Differential Equations

abstract: We consider using deep neural networks to solve time-dependent partial differential equations (PDEs), where multi-scale processing is crucial for modeling complex, time-evolving dynamics. While the U-Net architecture with skip connections is commonly used by prior studies to enable multi-scale processing, our analysis shows that the need for features to evolve across layers results in temporally misaligned features in skip connections, which limits the model's performance. To address this limitation, we propose SineNet, consisting of multiple sequentially connected U-shaped network blocks, referred to as waves. In SineNet, high-resolution features are evolved progressively through multiple stages, thereby reducing the amount of misalignment within each stage. We furthermore analyze the role of skip connections in enabling both parallel and sequential processing of multi-scale information. Our method is rigorously tested on multiple PDE datasets, including the Navier-Stokes equations and shallow water equations, showcasing the advantages of our proposed approach over conventional U-Nets with a comparable parameter budget. We further demonstrate that increasing the number of waves in SineNet while maintaining the same number of parameters leads to a monotonically improved performance. The results highlight the effectiveness of SineNet and the potential of our approach in advancing the state-of-the-art in neural PDE solver design. Our code is available as part of AIRS (https://github.com/divelab/AIRS).


title: Debiasing Cardiac Imaging with Controlled Latent Diffusion Models

abstract: The progress in deep learning solutions for disease diagnosis and prognosis based on cardiac magnetic resonance imaging is hindered by highly imbalanced and biased training data. To address this issue, we propose a method to alleviate imbalances inherent in datasets through the generation of synthetic data based on sensitive attributes such as sex, age, body mass index, and health condition. We adopt ControlNet based on a denoising diffusion probabilistic model to condition on text assembled from patient metadata and cardiac geometry derived from segmentation masks using a large-cohort study, specifically, the UK Biobank. We assess our method by evaluating the realism of the generated images using established quantitative metrics. Furthermore, we conduct a downstream classification task aimed at debiasing a classifier by rectifying imbalances within underrepresented groups through synthetically generated samples. Our experiments demonstrate the effectiveness of the proposed approach in mitigating dataset imbalances, such as the scarcity of younger patients or individuals with normal BMI level suffering from heart failure. This work represents a major step towards the adoption of synthetic data for the development of fair and generalizable models for medical classification tasks. Notably, we conduct all our experiments using a single, consumer-level GPU to highlight the feasibility of our approach within resource-constrained environments. Our code is available at https://github.com/faildeny/debiasing-cardiac-mri.


title: Phonetic Segmentation of the UCLA Phonetics Lab Archive

abstract: Research in speech technologies and comparative linguistics depends on access to diverse and accessible speech data. The UCLA Phonetics Lab Archive is one of the earliest multilingual speech corpora, with long-form audio recordings and phonetic transcriptions for 314 languages (Ladefoged et al., 2009). Recently, 95 of these languages were time-aligned with word-level phonetic transcriptions (Li et al., 2021). Here we present VoxAngeles, a corpus of audited phonetic transcriptions and phone-level alignments of the UCLA Phonetics Lab Archive, which uses the 95-language CMU re-release as our starting point. VoxAngeles also includes word- and phone-level segmentations from the original UCLA corpus, as well as phonetic measurements of word and phone durations, vowel formants, and vowel f0. This corpus enhances the usability of the original data, particularly for quantitative phonetic typology, as demonstrated through a case study of vowel intrinsic f0. We also discuss the utility of the VoxAngeles corpus for general research and pedagogy in crosslinguistic phonetics, as well as for low-resource and multilingual speech technologies. VoxAngeles is free to download and use under a CC-BY-NC 4.0 license.


title: On the Robustness of LDP Protocols for Numerical Attributes under Data Poisoning Attacks

abstract: Recent studies reveal that local differential privacy (LDP) protocols are vulnerable to data poisoning attacks where an attacker can manipulate the final estimate on the server by leveraging the characteristics of LDP and sending carefully crafted data from a small fraction of controlled local clients. This vulnerability raises concerns regarding the robustness and reliability of LDP in hostile environments. In this paper, we conduct a systematic investigation of the robustness of state-of-the-art LDP protocols for numerical attributes, i.e., categorical frequency oracles (CFOs) with binning and consistency, and distribution reconstruction. We evaluate protocol robustness through an attack-driven approach and propose new metrics for cross-protocol attack gain measurement. The results indicate that Square Wave and CFO-based protocols in the Server setting are more robust against the attack compared to the CFO-based protocols in the User setting. Our evaluation also unfolds new relationships between LDP security and its inherent design choices. We found that the hash domain size in local-hashing-based LDP has a profound impact on protocol robustness beyond the well-known effect on utility. Further, we propose a zero-shot attack detection by leveraging the rich reconstructed distribution information. The experiment show that our detection significantly improves the existing methods and effectively identifies data manipulation in challenging scenarios.


title: Improving Clinical NLP Performance through Language Model-Generated Synthetic Clinical Data

abstract: Generative models have been showing potential for producing data in mass. This study explores the enhancement of clinical natural language processing performance by utilizing synthetic data generated from advanced language models. Promising results show feasible applications in such a high-stakes domain.


title: Quantum Realization of the Finite Element Method

abstract: This paper presents a quantum algorithm for the solution of prototypical second-order linear elliptic partial differential equations discretized by $d$-linear finite elements on Cartesian grids of a bounded $d$-dimensional domain. An essential step in the construction is a BPX preconditioner, which transforms the linear system into a sufficiently well-conditioned one, making it amenable to quantum computation. We provide a constructive proof demonstrating that our quantum algorithm can compute suitable functionals of the solution to a given tolerance $\texttt{tol}$ with a complexity linear in $\texttt{tol}^{-1}$ for a fixed dimension $d$, neglecting logarithmic terms. This complexity is proportional to that of its one-dimensional counterpart and improves previous quantum algorithms by a factor of order $\texttt{tol}^{-2}$. We also detail the design and implementation of a quantum circuit capable of executing our algorithm, and present simulator results that support the quantum feasibility of the finite element method in the near future, paving the way for quantum computing approaches to a wide range of PDE-related challenges.


title: The profit-oriented hub line location problem with elastic demand

abstract: This paper deals with an extension of the hub line location problem considering demand elasticity with respect to travel times. The proposed model aims to capture the impact the hub network topology has on demand. The objective is to maximize the total revenue generated by each unit of demand using the hub line. We propose mixed-integer nonlinear formulations to model this problem. We study some properties of the nonlinear objective function associated with these formulations. Due to the inherent complexity involved in solving these nonlinear formulations with state-of-the-art solvers, we also present alternative mixed-integer linear programming formulations. Computational results compare the proposed formulations and the benefits of the presented model using benchmark instances commonly used in hub location. Moreover, a sensitivity analysis study is carried out with real data from the city of Montreal, Canada, to demonstrate the added value of incorporating demand elasticity when using the proposed model for public transportation planning.


title: CDIMC-net: Cognitive Deep Incomplete Multi-view Clustering Network

abstract: In recent years, incomplete multi-view clustering, which studies the challenging multi-view clustering problem on missing views, has received growing research interests. Although a series of methods have been proposed to address this issue, the following problems still exist: 1) Almost all of the existing methods are based on shallow models, which is difficult to obtain discriminative common representations. 2) These methods are generally sensitive to noise or outliers since the negative samples are treated equally as the important samples. In this paper, we propose a novel incomplete multi-view clustering network, called Cognitive Deep Incomplete Multi-view Clustering Network (CDIMC-net), to address these issues. Specifically, it captures the high-level features and local structure of each view by incorporating the view-specific deep encoders and graph embedding strategy into a framework. Moreover, based on the human cognition, i.e., learning from easy to hard, it introduces a self-paced strategy to select the most confident samples for model training, which can reduce the negative influence of outliers. Experimental results on several incomplete datasets show that CDIMC-net outperforms the state-of-the-art incomplete multi-view clustering methods.


title: On Bootstrapping Lasso in Generalized Linear Models and the Cross Validation

abstract: Generalized linear models or GLM constitutes an important set of models which generalizes the ordinary linear regression by connecting the response variable with the covariates through arbitrary link functions. On the other hand, Lasso is a popular and easy to implement penalization method in regression when all the covariates are not relevant. However, Lasso generally has non-tractable asymptotic distribution and hence development of an alternative method of distributional approximation is required for the purpose of statistical inference. In this paper, we develop a Bootstrap method which works as an approximation of the distribution of the Lasso estimator for all the sub-models of GLM. To connect the distributional approximation theory based on the proposed Bootstrap method with the practical implementation of Lasso, we explore the asymptotic properties of K-fold cross validation-based penalty parameter. The results established essentially justifies drawing valid statistical inference regarding the unknown parameters based on the proposed Bootstrap method for any sub model of GLM after selecting the penalty parameter using K-fold cross validation. Good finite sample properties are also shown through a moderately large simulation study. The method is also implemented on a real data set.


title: Maximum Likelihood Estimation on Stochastic Blockmodels for Directed Graph Clustering

abstract: This paper studies the directed graph clustering problem through the lens of statistics, where we formulate clustering as estimating underlying communities in the directed stochastic block model (DSBM). We conduct the maximum likelihood estimation (MLE) on the DSBM and thereby ascertain the most probable community assignment given the observed graph structure. In addition to the statistical point of view, we further establish the equivalence between this MLE formulation and a novel flow optimization heuristic, which jointly considers two important directed graph statistics: edge density and edge orientation. Building on this new formulation of directed clustering, we introduce two efficient and interpretable directed clustering algorithms, a spectral clustering algorithm and a semidefinite programming based clustering algorithm. We provide a theoretical upper bound on the number of misclustered vertices of the spectral clustering algorithm using tools from matrix perturbation theory. We compare, both quantitatively and qualitatively, our proposed algorithms with existing directed clustering methods on both synthetic and real-world data, thus providing further ground to our theoretical contributions.


title: XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold

abstract: We propose XScale-NVS for high-fidelity cross-scale novel view synthesis of real-world large-scale scenes. Existing representations based on explicit surface suffer from discretization resolution or UV distortion, while implicit volumetric representations lack scalability for large scenes due to the dispersed weight distribution and surface ambiguity. In light of the above challenges, we introduce hash featurized manifold, a novel hash-based featurization coupled with a deferred neural rendering framework. This approach fully unlocks the expressivity of the representation by explicitly concentrating the hash entries on the 2D manifold, thus effectively representing highly detailed contents independent of the discretization resolution. We also introduce a novel dataset, namely GigaNVS, to benchmark cross-scale, high-resolution novel view synthesis of realworld large-scale scenes. Our method significantly outperforms competing baselines on various real-world scenes, yielding an average LPIPS that is 40% lower than prior state-of-the-art on the challenging GigaNVS benchmark. Please see our project page at: xscalenvs.github.io.


title: Symmetry-guided inverse design of self-assembling multiscale DNA origami tilings

abstract: Recent advances enable the creation of nanoscale building blocks with complex geometries and interaction specificities for self-assembly. This nearly boundless design space necessitates design principles for defining the mutual interactions between multiple particle species to target a user-specified complex structure or pattern. In this article, we develop a symmetry-based method to generate the interaction matrices that specify the assembly of two-dimensional tilings which we illustrate using equilateral triangles. By exploiting the allowed 2D symmetries, we develop an algorithmic approach by which any periodic 2D tiling can be generated from an arbitrarily large number of subunit species, notably addressing an unmet challenge of engineering 2D crystals with periodicities that can be arbitrarily larger than subunit size. To demonstrate the utility of our design approach, we encode specific interactions between triangular subunits synthesized by DNA origami and show that we can guide their self-assembly into tilings with a wide variety of symmetries, using up to 12 unique species of triangles. By conjugating specific triangles with gold nanoparticles, we fabricate gold-nanoparticle supercrystals whose lattice parameter spans up to 300 nm. Finally, to generate economical design rules, we compare the design economy of various tilings. In particular, we show that (1) higher symmetries allow assembly of larger unit cells with fewer subunits and (2) linear supercrystals can be designed more economically using linear primitive unit cells. This work provides a simple algorithmic approach to designing periodic assemblies, which may open new doors to the multiscale assembly of superlattices of nanostructured "metatoms" with engineered plasmonic functions.


title: Laser Interactions with Gas Jets: EMP Emission and Nozzle Damage

abstract: We present a theoretical model of electromagnetic pulse emission and nozzle damage from high-power laser interactions with gas jets. As hot electrons are accelerated beyond the laser channel, they produce a positively-charged plasma that expands into the ambient gas until it reaches the gas jet nozzle. A strong plasma potential leads to electrical breakdown that ionises the gas even faster than the expanding plasma ions. When contact is made between the plasma and the conducting nozzle surface, a discharge current propagates to ground and an electromagnetic pulse is radiated via an antenna emission mechanism. Damage to gas jet nozzles is caused by heating from plasma ions rather than Ohmic heating via a discharge current. Our model agrees with experimental data from experiments on proton acceleration in near-critical plasmas at the Vulcan and VEGA-3 lasers.


title: Doubly special relativity as a non-local quantum field theory

abstract: In this work, we present the technical details of the discussion presented in [J.J. Relancio, L.Santamar\'ia-Sanz (2024) arXiv:2403.18772], where we establish the basis of quantum theories of the free massive scalar, the massive fermionic, and the electromagnetic fields, in a doubly special relativity scenario. This construction is based on a geometrical interpretation of the kinematics of these kind of theories. In order to describe the modified actions, we find that a higher (indeed infinite) derivative field theory is needed, from which the deformed kinematics can be read. From our construction we are able to restrict the possible models of doubly special relativity to particular bases that preserve linear Lorentz invariance. We quantize the theories and also obtain a deformed version of the Maxwell equations. We analyze the electromagnetic vector potential either for an electric point-like source and a magnetic dipole. We observe that the electric and magnetic fields do not diverge at the origin for some models described with an anti de Sitter space but do for the de Sitter one in both problems.


title: Interpreting Key Mechanisms of Factual Recall in Transformer-Based Language Models

abstract: In this paper, we delve into several mechanisms employed by Transformer-based language models (LLMs) for factual recall tasks. We outline a pipeline consisting of three major steps: (1) Given a prompt ``The capital of France is,'' task-specific attention heads extract the topic token, such as ``France,'' from the context and pass it to subsequent MLPs. (2) As attention heads' outputs are aggregated with equal weight and added to the residual stream, the subsequent MLP acts as an ``activation,'' which either erases or amplifies the information originating from individual heads. As a result, the topic token ``France'' stands out in the residual stream. (3) A deep MLP takes ``France'' and generates a component that redirects the residual stream towards the direction of the correct answer, i.e., ``Paris.'' This procedure is akin to applying an implicit function such as ``get\_capital($X$),'' and the argument $X$ is the topic token information passed by attention heads. To achieve the above quantitative and qualitative analysis for MLPs, we proposed a novel analytic method aimed at decomposing the outputs of the MLP into components understandable by humans. Additionally, we observed a universal anti-overconfidence mechanism in the final layer of models, which suppresses correct predictions. We mitigate this suppression by leveraging our interpretation to improve factual recall confidence. The above interpretations are evaluated across diverse tasks spanning various domains of factual knowledge, using various language models from the GPT-2 families, 1.3B OPT, up to 7B Llama-2, and in both zero- and few-shot setups.


title: Model Stock: All we need is just a few fine-tuned models

abstract: This paper introduces an efficient fine-tuning method for large pre-trained models, offering strong in-distribution (ID) and out-of-distribution (OOD) performance. Breaking away from traditional practices that need a multitude of fine-tuned models for averaging, our approach employs significantly fewer models to achieve final weights yet yield superior accuracy. Drawing from key insights in the weight space of fine-tuned weights, we uncover a strong link between the performance and proximity to the center of weight space. Based on this, we introduce a method that approximates a center-close weight using only two fine-tuned models, applicable during or after training. Our innovative layer-wise weight averaging technique surpasses state-of-the-art model methods such as Model Soup, utilizing only two fine-tuned models. This strategy can be aptly coined Model Stock, highlighting its reliance on selecting a minimal number of models to draw a more optimized-averaged model. We demonstrate the efficacy of Model Stock with fine-tuned models based upon pre-trained CLIP architectures, achieving remarkable performance on both ID and OOD tasks on the standard benchmarks, all while barely bringing extra computational demands. Our code and pre-trained models are available at https://github.com/naver-ai/model-stock.


title: twoPhaseInterTrackFoam: an OpenFOAM module for Arbitrary Lagrangian/Eulerian Interface Tracking with Surfactants and Subgrid-Scale Modeling

abstract: We provide an implementation of the unstructured Finite-Volume Arbitrary Lagrangian / Eulerian (ALE) Interface-Tracking method for simulating incompressible, immiscible two-phase flows as an OpenFOAM module. In addition to interface-tracking capabilities that include tracking of two fluid phases, an implementation of a Subgrid-Scale (SGS) modeling framework for increased accuracy when simulating sharp boundary layers is enclosed. The SGS modeling framework simplifies embedding subgrid-scale profiles into the unstructured Finite Volume discretization. Our design of the SGS model library significantly simplifies adding new SGS models and applying SGS modeling to Partial Differential Equations (PDEs) in OpenFOAM.


title: Joint ALMA/X-ray monitoring of the radio-quiet type 1 AGN IC 4329A

abstract: The origin of a compact millimeter (mm, 100-250 GHz) emission in radio-quiet active galactic nuclei (RQ AGN) remains debated. Recent studies propose a connection with self-absorbed synchrotron emission from the accretion disk X-ray corona. We present the first joint ALMA ($\sim$100 GHz) and X-ray (NICER/XMM-Newton/Swift; 2-10 keV) observations of the unobscured RQ AGN, IC 4329A ($z = 0.016$). The time-averaged mm-to-X-ray flux ratio aligns with recently established trends for larger samples (Kawamuro et al. 2022, Ricci et al. 2023), but with a tighter scatter ($\sim$0.1 dex) compared to previous studies. However, there is no significant correlation on timescales of less than 20 days. The compact mm emission exhibits a spectral index of $-0.23 \pm 0.18$, remains unresolved with a 13 pc upper limit, and shows no jet signatures. Notably, the mm flux density varies significantly (factor of 3) within 4 days, exceeding the contemporaneous X-ray variability (37% vs. 18%) and showing the largest mm variations ever detected in RQ AGN over daily timescales. The high amplitude variability rules out scenarios of heated dust and thermal free-free emission, pointing toward a synchrotron origin for the mm radiation in a source of $\sim$1 light day size. While the exact source is not yet certain, an X-ray corona scenario emerges as the most plausible compared to a scaled-down jet or outflow-driven shocks.}


title: Projectivity meets Uniform Post-Interpolant: Classical and Intuitionistic Logic

abstract: We examine the interplay between projectivity (in the sense that was introduced by S.~Ghilardi) and uniform post-interpolant for the classical and intuitionistic propositional logic. More precisely, we explore whether a projective substitution of a formula is equivalent to its uniform post-interpolant, assuming the substitution leaves the variables of the interpolant unchanged. We show that in classical logic, this holds for all formulas. Although such a nice property is missing in intuitionistic logic, we provide Kripke semantical characterisation for propositions with this property. As a main application of this, we show that the unification type of some extensions of intuitionistic logic are finitary. In the end, we study admissibility for intuitionistic logic, relative to some sets of formulae. The first author of this paper recently considered a particular case of this relativised admissibility and found it useful in characterising the provability logic of Heyting Arithmetic.


title: Logic and Languages of Higher-Dimensional Automata

abstract: In this paper we study finite higher-dimensional automata (HDAs) from the logical point of view. Languages of HDAs are sets of finite bounded-width interval pomsets with interfaces (iiPoms<=k) closed under order extension. We prove that languages of HDAs are MSO-definable. For the converse, we show that the order extensions of MSO-definable sets of iiPoms<=k are languages of HDAs. As a consequence, unlike the case of all pomsets, order extension of MSO-definable sets of iiPoms<=k is also MSO-definable.


title: Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation

abstract: Category-level 6D object pose estimation aims to estimate the rotation, translation and size of unseen instances within specific categories. In this area, dense correspondence-based methods have achieved leading performance. However, they do not explicitly consider the local and global geometric information of different instances, resulting in poor generalization ability to unseen instances with significant shape variations. To deal with this problem, we propose a novel Instance-Adaptive and Geometric-Aware Keypoint Learning method for category-level 6D object pose estimation (AG-Pose), which includes two key designs: (1) The first design is an Instance-Adaptive Keypoint Detection module, which can adaptively detect a set of sparse keypoints for various instances to represent their geometric structures. (2) The second design is a Geometric-Aware Feature Aggregation module, which can efficiently integrate the local and global geometric information into keypoint features. These two modules can work together to establish robust keypoint-level correspondences for unseen instances, thus enhancing the generalization ability of the model.Experimental results on CAMERA25 and REAL275 datasets show that the proposed AG-Pose outperforms state-of-the-art methods by a large margin without category-specific shape priors.


title: Gauge Theories With Infinite Multiplets of Fermions

abstract: We study the coupling constant renormalization of gauge theories with an infinite multiplet of fermions, using the zeta function method to make sense of the infinite sums over fermions. If the gauge group K is the maximal compact subgroup of a simple non-compact group G, such infinite multiplets can arise naturally, as reductions of discrete series unitary representations of G. The example K=U(1) and G=SU(1,1) will be studied in detail. Surprisingly, there are abelian gauge theories which are asymptotically free; and others that are UV finite.


title: Disentangling degree and tie strength heterogeneity in egocentric social networks

abstract: The structure of personal networks reflects how we organise and maintain social relationships. The distribution of tie strengths in personal networks is heterogeneous, with a few close, emotionally intense relationships and a larger number of weaker ties. Recent results indicate this feature is universal across communication channels. Within this general pattern, there is a substantial and persistent inter-individual variation that is also similarly distributed among channels. The reason for the observed universality is yet unclear -- one possibility is that people's traits determine their personal network features on any channel. To address this hypothesis, we need to compare an individual's personal networks across channels, which is a non-trivial task: while we are interested in measuring the differences in tie strength heterogeneity, personal network size is also expected to vary a lot across channels. Therefore, for any measure that compares personal networks, one needs to understand the sensitivity with respect to network size. Here, we study different measures of personal network similarity and show that a recently introduced alter-preferentiality parameter and the Gini coefficient are equally suitable measures for tie strength heterogeneity, as they are fairly insensitive to differences in network size. With these measures, we show that the earlier observed individual-level persistence of personal network structure cannot be attributed to network size stability alone, but that the tie strength heterogeneity is persistent too. We also demonstrate the effectiveness of the two measures on multichannel data, where tie strength heterogeneity in personal networks is seen to moderately correlate for the same users across two communication channels (calls and text messages).


title: Detecting Financial Bots on the Ethereum Blockchain

abstract: The integration of bots in Distributed Ledger Technologies (DLTs) fosters efficiency and automation. However, their use is also associated with predatory trading and market manipulation, and can pose threats to system integrity. It is therefore essential to understand the extent of bot deployment in DLTs; despite this, current detection systems are predominantly rule-based and lack flexibility. In this study, we present a novel approach that utilizes machine learning for the detection of financial bots on the Ethereum platform. First, we systematize existing scientific literature and collect anecdotal evidence to establish a taxonomy for financial bots, comprising 7 categories and 24 subcategories. Next, we create a ground-truth dataset consisting of 133 human and 137 bot addresses. Third, we employ both unsupervised and supervised machine learning algorithms to detect bots deployed on Ethereum. The highest-performing clustering algorithm is a Gaussian Mixture Model with an average cluster purity of 82.6%, while the highest-performing model for binary classification is a Random Forest with an accuracy of 83%. Our machine learning-based detection mechanism contributes to understanding the Ethereum ecosystem dynamics by providing additional insights into the current bot landscape.


title: SecGraph: Towards SGX-based Efficient and Confidentiality-Preserving Graph Search

abstract: Graphs have more expressive power and are widely researched in various search demand scenarios, compared with traditional relational and XML models. Today, many graph search services have been deployed on a third-party server, which can alleviate users from the burdens of maintaining large-scale graphs and huge computation costs. Nevertheless, outsourcing graph search services to the third-party server may invade users' privacy. PeGraph was recently proposed to achieve the encrypted search over the social graph. The main idea of PeGraph is to maintain two data structures XSet and TSet motivated by the OXT technology to support encrypted conductive search. However, PeGraph still has some limitations. First, PeGraph suffers from high communication and computation costs in search operations. Second, PeGraph cannot support encrypted search over dynamic graphs. In this paper, we propose an SGX-based efficient and confidentiality-preserving graph search scheme SecGraph that can support insertion and deletion operations. We first design a new proxy-token generation method to reduce the communication cost. Then, we design an LDCF-encoded XSet based on the Logarithmic Dynamic Cuckoo Filter to reduce the computation cost. Finally, we design a new dynamic version of TSet named Twin-TSet to enable encrypted search over dynamic graphs. We have demonstrated the confidentiality preservation property of SecGraph through rigorous security analysis. Experiment results show that SecGraph yields up to 208x improvement in search time compared with PeGraph and the communication cost in PeGraph is up to 540x larger than that in SecGraph.


title: Measuring Solar Neutrinos in the SNO+ Detector

abstract: The SNO+ experiment is a large multi-purpose neutrino detector, currently filled with liquid scintillator. For the first time in a single experiment, SNO+ is able to measure the neutrino oscillation parameters $\theta_{12}$ and $\Delta m^{2}_{21}$ simultaneously through both reactor anti-neutrinos and $^{8}B$ solar neutrinos. The latter approach is demonstrated here, with an analysis of an initial 80 days of scintillator phase data. A Bayesian statistical approach via Markov Chain Monte Carlo is used, allowing for the simultaneous fitting of the oscillation parameters, $^{8}B$ neutrino flux, background components with constraints, and systematic uncertainties. The neutrino oscillation parameter $\theta_{12}$ was measured to be $38.9^{\circ+8.0^{\circ}}_{-7.9^{\circ}}$, assuming the current global fit flux of $^{8}B$ solar neutrinos. This is consistent with the current global fit result for $\theta_{12}$. A sensitivity study shows that this measurement is statistics-limited, and precision could be improved by a factor of two with two years of livetime, assuming the same backgrounds and selections.


title: Coherent control from quantum committment probabilities

abstract: We introduce a general definition of a quantum committor in order to clarify reaction mechanisms and facilitate control in processes where coherent effects are important. With a quantum committor, we generalize the notion of a transition state to quantum superpositions and quantify the effect of interference on the progress of the reaction. The formalism is applicable to any linear quantum master equation supporting metastability for which absorbing boundary conditions designating the reactant and product states can be applied. We use this formalism to determine the dependence of the quantum transition state on coherences in a polaritonic system and optimize the initialization state of a conical intersection model to control reactive outcomes, achieving yields of the desired state approaching 100%. In addition to providing a practical tool, the quantum committor provides a conceptual framework for understanding reactions in cases when classical intuitions fail.


title: Locate, Assign, Refine: Taming Customized Image Inpainting with Text-Subject Guidance

abstract: Prior studies have made significant progress in image inpainting guided by either text or subject image. However, the research on editing with their combined guidance is still in the early stages. To tackle this challenge, we present LAR-Gen, a novel approach for image inpainting that enables seamless inpainting of masked scene images, incorporating both the textual prompts and specified subjects. Our approach adopts a coarse-to-fine manner to ensure subject identity preservation and local semantic coherence. The process involves (i) Locate: concatenating the noise with masked scene image to achieve precise regional editing, (ii) Assign: employing decoupled cross-attention mechanism to accommodate multi-modal guidance, and (iii) Refine: using a novel RefineNet to supplement subject details. Additionally, to address the issue of scarce training data, we introduce a novel data construction pipeline. This pipeline extracts substantial pairs of data consisting of local text prompts and corresponding visual instances from a vast image dataset, leveraging publicly available large models. Extensive experiments and varied application scenarios demonstrate the superiority of LAR-Gen in terms of both identity preservation and text semantic consistency. Project page can be found at \url{https://ali-vilab.github.io/largen-page/}.


title: Bright Coherent Ultrahigh Harmonics in the keV X-Ray Regime from Mid-Infrared Femtosecond Lasers

abstract: High harmonic generation traditionally combines ~100 near-infrared laser photons, to generate bright, phase matched, extreme ultraviolet beams when the emission from many atoms adds constructively. Here we show that by guiding a mid-infrared femtosecond laser in a high pressure gas, ultrahigh harmonics can be generated up to orders > 5000, that emerge as a bright supercontinuum that spans the entire electromagnetic spectrum from the ultraviolet to > 1.6 keV, allowing in-principle the generation of pulses as short as 2.5 attoseconds. The multi-atmosphere gas pressures required for bright, phase matched emission also supports laser beam self-confinement, further enhancing the x-ray yield. Finally, the x-ray beam exhibits high spatial coherence, even though at high gas density, the recolliding electrons responsible for high harmonic generation encounter other atoms during the emission process.


title: Complete Integrability of the Problem of Full Statistics of Nonstationary Mass Transfer in the Simple Inclusion Process

abstract: The Simple Inclusion Process (SIP) interpolates between two well-known lattice gas models: the independent random walkers and the Kipnis-Marchioro-Presutti model. Here we study large deviations of nonstationary mass transfer in the SIP at long times in one dimension. We suppose that $N\gg 1$ particles start from a single lattice site at the origin, and we are interested in the probability $\mathcal{P}(M,N,T)$ of observing $M$ particles, $0\leq M\leq N$, to the right of the origin at a specified time $T\gg 1$. At large times, the corresponding probability distribution has a large-deviation behavior, $-\ln \mathcal{P}(M,N,T) \simeq \sqrt{T} s(M/N,N/\sqrt{T})$. We determine the rate function $s$ exactly by uncovering and utilizing complete integrability, by the inverse scattering method, of the underlying equations of the macroscopic fluctuation theory. We also analyze different asymptotic limits of the rate function $s$.


title: Multi-product maximal covering second-level facility location problem

abstract: This paper introduces a new hierarchical facility location model with three levels: first-level facilities which manufacture different products, second-level facilities which act as warehouses and a third-level consisting of the clients who demand the products that have been manufactured in the first level and stored in the second level. In this model, called multi-product maximal covering second-level facility location problem (SL-MCFLP), the aim is to decide the location of the second-level facilities and the products to be stored in each of them maximizing the overall clients' satisfaction with respect their coverage. To deal with this model, we introduce a Mixed Integer Linear Program (MILP) which is reinforced by some families of valid inequalities. Since some of these families have an exponential number of constraints, separation algorithms are proposed. In addition, three variants of a matheuristic procedure are developed. Computational studies are included, showing the potentials and limits of the formulation and the effectiveness of the heuristic.


title: Superintegrability of the monomial Uglov matrix model

abstract: In this paper we propose a resolution to the problem of $\beta$-deforming the non-Gaussian monomial matrix models. The naive guess of substituting Schur polynomials with Jack polynomials does not work in that case, therefore, we are forced to look for another basis for superintegrability. We find that the relevant symmetric functions are given by Uglov polynomials, and that the integration measure should also be deformed. The measure appears to be related to the Uglov limit as well, when the quantum parameters $(q,t)$ go to a root of unity. The degree of the root must be equal to the degree of the potential. One cannot derive these results directly, for example, by studying Virasoro constraints. Instead, we use the recently developed techniques of $W$-operators to arrive at the root of unity limit. From the perspective of matrix models this new example demonstrates that even with a rather nontrivial integration measure one can find a superintegrability basis by studying the hidden symmetry of the moduli space of deformations.


title: De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts

abstract: Data-Free Knowledge Distillation (DFKD) is a promising task to train high-performance small models to enhance actual deployment without relying on the original training data. Existing methods commonly avoid relying on private data by utilizing synthetic or sampled data. However, a long-overlooked issue is that the severe distribution shifts between their substitution and original data, which manifests as huge differences in the quality of images and class proportions. The harmful shifts are essentially the confounder that significantly causes performance bottlenecks. To tackle the issue, this paper proposes a novel perspective with causal inference to disentangle the student models from the impact of such shifts. By designing a customized causal graph, we first reveal the causalities among the variables in the DFKD task. Subsequently, we propose a Knowledge Distillation Causal Intervention (KDCI) framework based on the backdoor adjustment to de-confound the confounder. KDCI can be flexibly combined with most existing state-of-the-art baselines. Experiments in combination with six representative DFKD methods demonstrate the effectiveness of our KDCI, which can obviously help existing methods under almost all settings, \textit{e.g.}, improving the baseline by up to 15.54\% accuracy on the CIFAR-100 dataset.


title: A third-order low-regularity trigonometric integrator for the semilinear Klein-Gordon equation

abstract: In this paper, we propose and analyze a novel third-order low-regularity trigonometric integrator for the semilinear Klein-Gordon equation in the $d$-dimensional space with $d=1,2,3$. The integrator is constructed based on the full use of Duhamel's formula and the technique of twisted function to the trigonometric integrals. Rigorous error estimates are presented and the proposed method is shown to have third-order accuracy in the energy space under a weak regularity requirement in $H^{2}\times H^{1}$. A numerical experiment shows that the proposed third-order low-regularity integrator is much more accurate than the well-known exponential integrators of order three for approximating the Klein-Gordon equation with nonsmooth solutions.


title: Comment on "Do near-threshold molecular states mix with neighboring $\bar QQ$ states?"

abstract: I comment on a paper by Christoph Hanhart and Alexey Nefediev, published in Phys. Rev. D 106, 114003 (2022). The authors discuss the interpretation of mesons close to their lowest decay threshold and present a mechanism for the formation of molecular states. The proposed formalism is then applied to the axial-vector mesons $D_{s1}(2536)$ and $D_{s1}(2460)$, presenting two scenarios for the lighter meson, namely a $D^\star K$ molecule or a compact $c\bar{s}$ state. The authors argue that the latter hypothesis requires a fine-tuning of the mixing angle between the $J^{PC}=1^{++}$ and $J^{PC}=1^{+-}$ $C$-parity eigenstates. In this Comment I show that no such fine-tuning is needed, as demonstrated in an article published in Phys. Rev. D 84, 094020 (2011), where a unitarized quark model was applied to the two $C$-parity eigenstates, coupled to several two-meson channels including $D^\star K$. The coupled-channel dynamics naturally leads to a mixing angle very close to the required one. Moreover, I argue that the $D_1(2420)$ and $D_1(2430)$ axial-vectors, not considered by the authors, as well as a lattice simulation in Phys. Rev. D 90, 034510 (2014), also not mentioned by the authors, do not lend support to a molecular interpretation of the $D_{s1}(2460)$. I conclude with some more general remarks about mesons coupling to $S$-wave thresholds.


title: Cosmological inference from combining Planck and ACT cluster counts

abstract: We have adapted the Planck cluster likelihood in such a way that it can be applied to the sample of clusters detected by the Atacama Cosmology Telescope (ACT). Applying it to the 2016 sample from Planck and the 2018 sample from ACT we find, by fixing the cosmology using CMB observations and the cluster model adopted by Planck, that the mass bias required by the two are $1-b_{\rm Planck}=0.61\pm 0.03$ and $1-b_{\rm ACT}=0.75\pm 0.06$. These are broadly in agreement but hint that the model could be adapted to reach a better agreement. By normalizing the cluster model using weak lensing observations, we find evidence for either evolution in the cluster model, quantified by the cluster modeling parameter describing redshift dependence $\beta=0.86 \pm 0.07$ using an updated CCCP-based normalization, or evolution in the cosmological model quantified by the dark energy equation of state parameter $w=-0.82 \pm 0.07$.


title: Lattice outlook on $B\to\rho\ell\bar{\nu}$ and $B\to K^\star \ell \ell$

abstract: Lattice Quantum Chromodynamics (QCD) has significantly contributed to our understanding of the CKM matrix through precise determinations of hadronic matrix elements. With advancements in theoretical methodologies and computational resources, investigations can now extend to processes involving QCD-unstable hadrons such as the $\rho$ and $K^\star(892)$. These resonances play vital roles in processes such as weak decays of $B$ mesons, opening new avenues for exploration. Finite-volume lattice QCD techniques involving complex computational methods are used to determine the transition amplitudes. Here, we present preliminary results for $B\to\rho\ell\bar{\nu}$.


title: Impact of Resin Molecular Weight on Drying Kinetics and Sag of Coatings

abstract: The work herein investigates the impact of resin molecular weight and solvent choice on drying kinetics and sag velocity in polymer films. These films, ranging in thickness from ~60 micrometer to ~120 micrometer were formulated with 45% by weight polymer resin in one of two solvent packages with different relative evaporation rates (RER). Gravimetry was initially used to track drying kinetics and a one-dimensional diffusion model was utilized to compute the apparent solvent diffusivity. In addition, the film thickness was tracked with optical profilometry. Results from these measurements showed that for fixed molecular weight the drying kinetics increased by approximately two-fold for the high RER solvent, whereas the apparent diffusivity tended to increase with increasing polymer molecular weight. Films formulated from higher molecular weight resins had greater initial viscosities and thicknesses for identical draw down blade clearance. By extension, the higher apparent diffusivities at greater molecular weights were attributed to effects of prolonged evaporation times for the thicker films. The sag velocity was measured through the thickness of the film for these systems at a 5 degree incline using the Variable Angle Inspection Microscope (VAIM). Measurements showed an increase in sag velocity for thinner and less viscous films, which was somewhat surprising both because a thinner film will experience lower gravitational stress and quicker drying times as compared to a thicker film. From these data we conclude that formulating a coating with higher molecular weight resin, although likely to increase drying time, will tend to deter sag because of the large impact of viscosity on these phenomena.


title: Lamarckian Inheritance Improves Robot Evolution in Dynamic Environments

abstract: This study explores the integration of Lamarckian system into evolutionary robotics (ER), comparing it with the traditional Darwinian model across various environments. By adopting Lamarckian principles, where robots inherit learned traits, alongside Darwinian learning without inheritance, we investigate adaptation in dynamic settings. Our research, conducted in six distinct environmental setups, demonstrates that Lamarckian systems outperform Darwinian ones in adaptability and efficiency, particularly in challenging conditions. Our analysis highlights the critical role of the interplay between controller \& morphological evolution and environment adaptation, with parent-offspring similarities and newborn \&survivors before and after learning providing insights into the effectiveness of trait inheritance. Our findings suggest Lamarckian principles could significantly advance autonomous system design, highlighting the potential for more adaptable and robust robotic solutions in complex, real-world applications. These theoretical insights were validated using real physical robots, bridging the gap between simulation and practical application.


title: Croissant: A Metadata Format for ML-Ready Datasets

abstract: Data is a critical resource for Machine Learning (ML), yet working with data remains a key friction point. This paper introduces Croissant, a metadata format for datasets that simplifies how data is used by ML tools and frameworks. Croissant makes datasets more discoverable, portable and interoperable, thereby addressing significant challenges in ML data management and responsible AI. Croissant is already supported by several popular dataset repositories, spanning hundreds of thousands of datasets, ready to be loaded into the most popular ML frameworks.


title: On the definition of the spin charge in asymptotically-flat spacetimes

abstract: We propose a solution to a classic problem in gravitational physics consisting of defining the spin associated with asymptotically-flat spacetimes. We advocate that the correct asymptotic symmetry algebra to approach this problem is the generalized-BMS algebra $\textsf{gbms}$ instead of the BMS algebra used hitherto in the literature for which a notion of spin is generically unavailable. We approach the problem of defining the spin charges from the perspective of coadjoint orbits of $\textsf{gbms}$ and construct the complete set of Casimir invariants that determine $\textsf{gbms}$ coadjoint orbits, using the notion of vorticity for $\textsf{gbms}$. This allows us to introduce spin charges for $\textsf{gbms}$ as the generators of area-preserving diffeomorphisms forming its isotropy subalgebra. To elucidate the parallelism between our analysis and the Poincar\'e case, we clarify several features of the Poincar\'e embedding in $\textsf{gbms}$ and reveal the presence of condensate fields associated with the symmetry breaking from $\textsf{gbms}$ to Poincar\'e. We also introduce the notion of a rest frame available only for this extended algebra. This allows us to construct, from the spin generator, the gravitational analog of the Pauli--Luba\'nski pseudo-vector. Finally, we obtain the $\textsf{gbms}$ moment map, which we use to construct the gravitational spin charges and gravitational Casimirs from their dual algebra counterparts.


title: WaterJudge: Quality-Detection Trade-off when Watermarking Large Language Models

abstract: Watermarking generative-AI systems, such as LLMs, has gained considerable interest, driven by their enhanced capabilities across a wide range of tasks. Although current approaches have demonstrated that small, context-dependent shifts in the word distributions can be used to apply and detect watermarks, there has been little work in analyzing the impact that these perturbations have on the quality of generated texts. Balancing high detectability with minimal performance degradation is crucial in terms of selecting the appropriate watermarking setting; therefore this paper proposes a simple analysis framework where comparative assessment, a flexible NLG evaluation framework, is used to assess the quality degradation caused by a particular watermark setting. We demonstrate that our framework provides easy visualization of the quality-detection trade-off of watermark settings, enabling a simple solution to find an LLM watermark operating point that provides a well-balanced performance. This approach is applied to two different summarization systems and a translation system, enabling cross-model analysis for a task, and cross-task analysis.


title: GlORIE-SLAM: Globally Optimized RGB-only Implicit Encoding Point Cloud SLAM

abstract: Recent advancements in RGB-only dense Simultaneous Localization and Mapping (SLAM) have predominantly utilized grid-based neural implicit encodings and/or struggle to efficiently realize global map and pose consistency. To this end, we propose an efficient RGB-only dense SLAM system using a flexible neural point cloud scene representation that adapts to keyframe poses and depth updates, without needing costly backpropagation. Another critical challenge of RGB-only SLAM is the lack of geometric priors. To alleviate this issue, with the aid of a monocular depth estimator, we introduce a novel DSPO layer for bundle adjustment which optimizes the pose and depth of keyframes along with the scale of the monocular depth. Finally, our system benefits from loop closure and online global bundle adjustment and performs either better or competitive to existing dense neural RGB SLAM methods in tracking, mapping and rendering accuracy on the Replica, TUM-RGBD and ScanNet datasets. The source code is available at https://github.com/zhangganlin/GlOIRE-SLAM


title: Spectral gap for surfaces of infinite volume with negative curvature

abstract: We prove that the imaginary parts of scattering resonances for negatively curved asymptotically hyperbolic surfaces are uniformly bounded away from zero and provide a resolvent bound in the resulting resonance-free strip. This provides an essential spectral gap without the pressure condition. This is done by adapting the methods of [arXiv:1004.3361], [arXiv:1012.4391] and [arXiv:2201.08259] and answers a question posed in [arXiv:1504.06589].


title: Entanglement-based quantum information protocols designed with silicon quantum dot platform

abstract: Electron spins in silicon quantum dot platform provide great potential for quantum information processing due to excellent physical properties and modern fabrication technologies. Spin-based quantum bit (qubit) operations are intensively studied to realize universal logic gates with a high fidelity, fast gating operations, and basic programmability. Although recent experimental achievements can be considered as remarkable results for utilizing quantum computation, more advanced quantum information protocols should be demonstrated with a large number of qubit system to enable programmability of silicon devices. Here, we computationally explore entanglement-based quantum information protocols in electrically defined five silicon quantum dot system. To this end, device simulations are employed to demonstrate $1$-qubit gate and $2$-qubit gate operations. Additionally, we discuss the implementations of three applications: the generation of magic states, entanglement swapping, and quantum teleportation in our silicon device. All the results will secure the scalability of quantum information processing with electron spin qubits in silicon quantum dot system.


title: Probing the dark Universe with gravitational waves

abstract: Gravitational waves (GW) are expected to interact with dark energy and dark matter, affecting their propagation on cosmological scales. In order to model this interaction, we derive a gauge invariant effective equation and action valid for all GWs polarizations, based on encoding the effects of the interaction of GWs at different order in perturbations, in a polarization, frequency and time dependent effective speed. The invariance of perturbations under time dependent conformal transformations and the gauge invariance of the GWs allow to obtain the unitary gauge effective action in any conformally related frame, making transparent the relation between Einstein and Jordan frame. The propagation time and luminosity distance of different GWs polarizations allow to probe at different frequencies and redshift the dark Universe, which act as an effective medium, whose physical properties can be modeled by the GWs effective speed.


title: Skoda-Zeriahi type integrability and entropy compactness for some measure with $L^1$-density

abstract: In this paper, we prove the Skoda-Zeriahi type integrability theorem with respect to some measure with $L^1$-density. In addition, we introduce the log-log threshold in order to detect singularities of K\"{a}hler potentials. We prove the positivity of the integrability threshold for such a measure and K\"{a}hler potentials with uniform log-log threshold. As an application, we prove the entropy compactness theorem for a family of potential functions of Poincar\'{e} type K\"{a}hler metrics with uniform log-log threshold. The Ohsawa-Takegoshi $L^2$-extension theorem and Skoda-Zeriahi's integrability theorem play a very important role in this paper.


title: Cross-Attention is Not Always Needed: Dynamic Cross-Attention for Audio-Visual Dimensional Emotion Recognition

abstract: In video-based emotion recognition, audio and visual modalities are often expected to have a complementary relationship, which is widely explored using cross-attention. However, they may also exhibit weak complementary relationships, resulting in poor representations of audio-visual features, thus degrading the performance of the system. To address this issue, we propose Dynamic Cross-Attention (DCA) that can dynamically select cross-attended or unattended features on the fly based on their strong or weak complementary relationship with each other, respectively. Specifically, a simple yet efficient gating layer is designed to evaluate the contribution of the cross-attention mechanism and choose cross-attended features only when they exhibit a strong complementary relationship, otherwise unattended features. We evaluate the performance of the proposed approach on the challenging RECOLA and Aff-Wild2 datasets. We also compare the proposed approach with other variants of cross-attention and show that the proposed model consistently improves the performance on both datasets.


title: On 5-cycles and strong 5-subtournaments in a tournament of odd order n

abstract: Let $T$ be a tournament of odd order $n\ge 5,$ $c_{m}(T)$ be the number of its $m$-cycles, and $s_{m}(T)$ be the number of its strongly connected $m$-subtournaments. Due to work of L.W. Beineke and F. Harary, it is well known that $s_{m}(T)\le s_{m}(RLT_{n}),$ where $RLT_{n}$ is the regular locally transitive tournament of order $n.$ For $m=3$ and $m=4,$ $c_{m}(T)$ equals $s_{m}(T),$ but it is not so for $m\ge 5.$ As J.W. Moon pointed out in his note in 1966, the problem of determining the maximum of $c_{m}(T)$ seems very difficult in general (i.e. for $m\ge 5$). In the present paper, based on the Komarov-Mackey formula for $c_{5}(T)$ obtained recently, we prove that $c_{5}(T)\le (n+1)n(n-1)(n-2)(n-3)/160$ with equality holding iff $T$ is doubly regular. A formula for $s_{5}(T)$ is also deduced. With the use of it, we show that $s_{5}(T)\le (n+1)n(n-1)(n-3)(11n-47)/1920$ with equality holding iff $T=RLT_{n}$ or $n=7$ and $T$ is regular or $n=5$ and $T$ is strong. It is also proved that for a regular tournament $T$ of (odd) order $n\ge 9,$ a lower bound $(n+1)n(n-1)(n-3)(17n-59)/3840\le s_{5}(T)$ holds with equality iff $T$ is doubly regular. These results are compared with the ones recently obtained by the author for $c_{5}(T).$


title: Expectation Maximization Aided Modified Weighted Sequential Energy Detector for Distributed Cooperative Spectrum Sensing

abstract: Distributed cooperative spectrum sensing usually involves a group of unlicensed secondary users (SUs) collaborating to detect the primary user (PU) in the channel, and thereby opportunistically utilize it without causing interference to the PU. The conventional energy detector (ED) based spectrum sensing ignores the dynamic nature of the PU by using energy statistic only from the present sensing interval for the PU detection. However, for a dynamic PU, previous studies have shown that improved detection capabilities can be achieved by aggregating both present and past energy samples in a test statistic. To this end, a weighted sequential energy detector (WSED) has been proposed, but it is based on aggregating all the collected energy samples over an observation window. For a highly dynamic PU, that involves also combining the outdated samples in the test statistic. In this paper, we propose a modified WSED (mWSED) that uses the primary user states information over the window to aggregate only the highly correlated energy samples in its test statistic. In practice, since the PU states are a priori unknown, we also develop a joint expectation-maximization and Viterbi (EM-Viterbi) algorithm based scheme to iteratively estimate the states by using the energy samples collected over the window. The estimated states are then used in mWSED to compute its test statistics, and the algorithm is referred to here as EM-mWSED. Simulation results are presented to demonstrate the states estimation performance of EM-Viterbi and the PU detection performance of EM-mWSED. The results show that, for both highly dynamic as well as slowly time-varying PU, these algorithms outperform the ED and WSED at PU detection, and their performances improve by either increasing the average number of neighbors per SU in the network, or by increasing the SNR or the number of samples per energy statistic.


title: The structure of subalgebras of full matrix algebras over a field satisfying the identity [x_1, y_1][x_2, y_2] ... [x_q, y_q] = 0

abstract: A subalgebra of the full matrix algebra Mn(K), K a field, satisfying the identity [x1, y1][x2, y2]...[xq, yq] = 0 is called a Dq subalgebra of Mn(K). In the paper we deal with the structure, conjugation and isomorphism problems of maximal Dq subalgebras of Mn(K). We show that a maximal Dq subalgebra A of Mn(K) is conjugated with a block triangular subalgebra of Mn(K) with maximal commutative diagonal blocks. By analysis of conjugations, the sizes of the obtained diagonal blocks are uniquely determined. It reduces the problem of conjugation of maximal Dq subalgebras of Mn(K) to the analogous problem in the class of commutative subalgebras of Mn(K). Further examining conjugations, in case A is contained in the upper triangular matrix algebra Un(K), we prove that A is already in a block triangular form. We consider the isomorphism problem in a certain class of maximal Dq subalgebras of Mn(K) which contain all Dq subalgebras of Mn(K) with maximum dimension. In case K is algebraically closed, we invoke Jacobson's characterization of maximal commutative subalgebras of Mn(K) with maximum (K-)dimension to show that isomorphic subalgebras in this class are already conjugated. To illustrate it, we invoke results from [17] and find all isomorphism (equivalently conjugation) classes of Dq subalgebras of Mn(K) with maximum possible dimension, in case K is algebraically closed.


title: Experimental determination of effective light transport properties in fully anisotropic media

abstract: Structurally anisotropic materials are ubiquitous in several application fields, yet their accurate optical characterization remains challenging due to the lack of general models linking their scattering coefficients to the macroscopic transport observables, and the need to combine multiple measurements to retrieve their direction-dependent values. Here, we present an improved method for the experimental determination of light transport tensor coefficients from the diffusive rates measured along all three directions, based on transient transmittance measurements and a generalized Monte Carlo model. We apply our method to the characterization of light transport properties in two common anisotropic materials - polytetrafluoroethylene (PTFE) tape and paper - highlighting the magnitude of systematic deviations that are typically incurred when neglecting anisotropy.


title: Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Dataset

abstract: Hate speech detection models are only as good as the data they are trained on. Datasets sourced from social media suffer from systematic gaps and biases, leading to unreliable models with simplistic decision boundaries. Adversarial datasets, collected by exploiting model weaknesses, promise to fix this problem. However, adversarial data collection can be slow and costly, and individual annotators have limited creativity. In this paper, we introduce GAHD, a new German Adversarial Hate speech Dataset comprising ca.\ 11k examples. During data collection, we explore new strategies for supporting annotators, to create more diverse adversarial examples more efficiently and provide a manual analysis of annotator disagreements for each strategy. Our experiments show that the resulting dataset is challenging even for state-of-the-art hate speech detection models, and that training on GAHD clearly improves model robustness. Further, we find that mixing multiple support strategies is most advantageous. We make GAHD publicly available at https://github.com/jagol/gahd.


title: Exploring Communication Dynamics: Eye-tracking Analysis in Pair Programming of Computer Science Education

abstract: Pair programming is widely recognized as an effective educational tool in computer science that promotes collaborative learning and mirrors real-world work dynamics. However, communication breakdowns within pairs significantly challenge this learning process. In this study, we use eye-tracking data recorded during pair programming sessions to study communication dynamics between various pair programming roles across different student, expert, and mixed group cohorts containing 19 participants. By combining eye-tracking data analysis with focus group interviews and questionnaires, we provide insights into communication's multifaceted nature in pair programming. Our findings highlight distinct eye-tracking patterns indicating changes in communication skills across group compositions, with participants prioritizing code exploration over communication, especially during challenging tasks. Further, students showed a preference for pairing with experts, emphasizing the importance of understanding group formation in pair programming scenarios. These insights emphasize the importance of understanding group dynamics and enhancing communication skills through pair programming for successful outcomes in computer science education.


title: Self-Improved Learning for Scalable Neural Combinatorial Optimization

abstract: The end-to-end neural combinatorial optimization (NCO) method shows promising performance in solving complex combinatorial optimization problems without the need for expert design. However, existing methods struggle with large-scale problems, hindering their practical applicability. To overcome this limitation, this work proposes a novel Self-Improved Learning (SIL) method for better scalability of neural combinatorial optimization. Specifically, we develop an efficient self-improved mechanism that enables direct model training on large-scale problem instances without any labeled data. Powered by an innovative local reconstruction approach, this method can iteratively generate better solutions by itself as pseudo-labels to guide efficient model training. In addition, we design a linear complexity attention mechanism for the model to efficiently handle large-scale combinatorial problem instances with low computation overhead. Comprehensive experiments on the Travelling Salesman Problem (TSP) and the Capacitated Vehicle Routing Problem (CVRP) with up to 100K nodes in both uniform and real-world distributions demonstrate the superior scalability of our method.


title: Extremality as a Consistency Condition on Subregion Duality

abstract: In JT gravity coupled to a CFT, I argue without using the path integral that the entanglement wedge of a boundary region is bounded by a quantum extremal surface (QES). For any candidate not bounded by a QES, a unitary in the complement can make reconstruction within the candidate inconsistent with boundary causality. The case without islands is a direct consequence of subregion duality, and the case with islands can also be dealt with with a stronger assumption.


title: Flexible Analysis of Individual Heterogeneity in Event Studies: Application to the Child Penalty

abstract: We provide a practical toolkit for analyzing effect heterogeneity in event studies. We develop an estimation algorithm and adapt existing econometric results to provide its theoretical justification. We apply these tools to Dutch administrative data to study individual heterogeneity in the child-penalty (CP) context in three ways. First, we document significant heterogeneity in the individual-level CP trajectories, emphasizing the importance of going beyond the average CP. Second, we use individual-level estimates to examine the impact of childcare supply expansion policies. Our approach uncovers nonlinear treatment effects, challenging the conventional policy evaluation methods constrained to less flexible specifications. Third, we use the individual-level estimates as a regressor on the right-hand side to study the intergenerational elasticity of the CP between mothers and daughters. After adjusting for the measurement error bias, we find the elasticity of 24\%. Our methodological framework contributes to empirical practice by offering a flexible approach tailored to specific research questions and contexts. We provide an open-source package ('unitdid') to facilitate widespread adoption.


title: Closedness of the singular locus and generation for derived categories

abstract: This work is concerned with a relationship regarding the closedness of the singular locus of a Noetherian scheme and existence of classical generators in its category of coherent sheaves, associated bounded derived category, and singularity category. Particularly, we extend an observation initially made by Iyengar and Takahashi in the affine context to the global setting. Furthermore, we furnish an example a Noetherian scheme whose bounded derived category admits a classical generator, yet not every finite scheme over it exhibits the same property.


title: Moduli stacks of Galois representations and the $p$-adic local Langlands correspondence for $\mathrm{GL}_2(\mathbb{Q}_p)$

abstract: We give a categorical formulation of the $p$-adic local Langlands correspondence for $\mathrm{GL}_2(\mathbb{Q}_p)$,as an embedding of the derived category of locally admissible representations into the category of Ind-coherent sheaves on the moduli stack of two-dimensional representations of $\mathrm{Gal}(\overline{\mathbb{Q}}_p/\mathbb{Q}_p)$. Moreover, we relate our version of the $p$-adic local Langlands correspondence for $\mathrm{GL}_2(\mathbb{Q}_p)$ to the cohomology of modular curves through a local-global compatibility formula.


title: Level-2 IFS Thermodynamic Formalism: Gibbs probabilities in the space of probabilities and the push-forward map

abstract: We will denote by $\mathcal{M}$ the space of Borel probabilities on the symbolic space $\Omega=\{1,2...,m\}^\mathbb{N}$. $\mathcal{M}$ is equipped Monge-Kantorovich metric. We consider here the push-forward map $\mathfrak{T}:\mathcal{M} \to \mathcal{M}$ as a dynamical system. The space of Borel probabilities on $\mathcal{M}$ is denoted by $\mathfrak{M}$. Given a continuous function $A: \mathcal{M}\to \mathbb{R}$, an {\it a priori} probability $\Pi_0$ on $\mathcal{M}$, and a certain convolution operation acting on pairs of probabilities on $\mathcal{M}$, we define an associated Level-2 IFS Ruelle operator. We show the existence of an eigenfunction and an eigenprobability $\hat{\Pi}\in\mathfrak{M}$ for such an operator. Under a normalization condition for $A$, we show the existence of some $\mathfrak{T}$-invariant probabilities $\hat{\Pi}\in\mathfrak{M}.$ We are able to define the variational entropy of such $\hat{\Pi}$ and a related maximization pressure problem associated to $A$. In some particular examples, we show how to get eigenprobabilities solutions on $\mathfrak{M}$ for the Level-2 Thermodynamic Formalism problem from eigenprobabilities on $\mathcal{M}$ for the classical (Level-1) Thermodynamic Formalism. These examples highlight the fact that our approach is a natural generalization of the classic case.

categories: math.DS cond-mat.stat-mech math-ph math.MP math.PR


title: Poissonian Actions of Polish Groups

abstract: We define and study Poissonian actions of Polish groups as a framework to Poisson suspensions, characterize them spectrally, and provide a complete characterization of their ergodicity. We further construct 'spatial' Poissonian actions, answering partially a question of Glasner, Tsirelson & Weiss about L\'evy groups. We also construct for every diffeomorphism group an ergodic free spatial probability preserving actions. This constitutes a new class of Polish groups admitting non-essentially countable orbit equivalence relations, obtaining progress on a problem of Kechris.


title: The motivic Hecke algebra for PEL Shimura varieties

abstract: We construct a motivic lift of the action of the Hecke algebra on the cohomology of PEL Shimura varieties $S_K$. To do so, when $S_K$ is associated with a reductive algebraic group $G$ and $V$ is a local system on $S_K$ coming from a $G$-representation, we define a motivic Hecke algebra $\mathcal{H}^M(G,K)$ as a natural sub-algebra of the endomorphism algebra, in the triangulated category of motives, of the constructible motive associated with $S_K$ and $V$. The algebra $\mathcal{H}^M(G,K)$ is such that realizations induce an epimorphism from it onto the classical Hecke algebra. We then consider Wildeshaus' theory of interior motives, along with the necessary hypotheses for it to be employed. Whenever those assumptions hold, one gets a Chow motive realizing to interior $V$-valued cohomology of $S_K$, equipped with an action of $\mathcal{H}^M(G,K)$ as an algebra of correspondences modulo rational equivalence. We give a list of known cases where this applies.


title: On reduced unicellular hypermonopoles

abstract: The problem of counting unicellular hypermonopoles by the number of their hyperedges is equivalent to describing the cycle length distribution of a product of two circular permutations, first solved by Zagier. The solution of this problem has also been used in the study of the cycle graph model of Bafna and Pevzner and of related models in mathematical biology. In this paper we develop a method to compute the finite number of reduced unicellular hypermonopoles of a given genus. The problem of representing any hypermap as a drawing is known to be simplifiable to solving the same problem for reduced unicellular hypermonopoles. We also outline a correspondence between our hypermap model, the cycle graph model of Bafna and Pevzner, and the polygon gluing model of Alexeev and Zograf. Reduced unicellular hypermonopoles correspond to reduced objects in the other models as well, and the notion of genus is the same.


title: GrINd: Grid Interpolation Network for Scattered Observations

abstract: Predicting the evolution of spatiotemporal physical systems from sparse and scattered observational data poses a significant challenge in various scientific domains. Traditional methods rely on dense grid-structured data, limiting their applicability in scenarios with sparse observations. To address this challenge, we introduce GrINd (Grid Interpolation Network for Scattered Observations), a novel network architecture that leverages the high-performance of grid-based models by mapping scattered observations onto a high-resolution grid using a Fourier Interpolation Layer. In the high-resolution space, a NeuralPDE-class model predicts the system's state at future timepoints using differentiable ODE solvers and fully convolutional neural networks parametrizing the system's dynamics. We empirically evaluate GrINd on the DynaBench benchmark dataset, comprising six different physical systems observed at scattered locations, demonstrating its state-of-the-art performance compared to existing models. GrINd offers a promising approach for forecasting physical systems from sparse, scattered observational data, extending the applicability of deep learning methods to real-world scenarios with limited data availability.


title: Ultrafast exciton transport in van der Waals heterostructures

abstract: Excitons in van der Waals heterostructures based on atomically thin transition metal dichalcogenides are considered as potential candidates for the formation of a superfluid state in two-dimensional systems. A number of studies reported observations of ultrafast nondiffusive propagation of excitons in van der Waals heterostructures, which was considered by their authors as possible evidence of collective effects in excitonic systems. In this paper, after a brief analysis of exciton propagation regimes in two-dimensional semiconductors, an alternative model of ultrafast exciton transport is proposed, based on the formation of waveguide modes in van der Waals heterostructures and the radiation transfer by these modes.


title: Swarm Characteristics Classification Using Neural Networks

abstract: Understanding the characteristics of swarming autonomous agents is critical for defense and security applications. This article presents a study on using supervised neural network time series classification (NN TSC) to predict key attributes and tactics of swarming autonomous agents for military contexts. Specifically, NN TSC is applied to infer two binary attributes - communication and proportional navigation - which combine to define four mutually exclusive swarm tactics. We identify a gap in literature on using NNs for swarm classification and demonstrate the effectiveness of NN TSC in rapidly deducing intelligence about attacking swarms to inform counter-maneuvers. Through simulated swarm-vs-swarm engagements, we evaluate NN TSC performance in terms of observation window requirements, noise robustness, and scalability to swarm size. Key findings show NNs can predict swarm behaviors with 97% accuracy using short observation windows of 20 time steps, while also demonstrating graceful degradation down to 80% accuracy under 50% noise, as well as excellent scalability to swarm sizes from 10 to 100 agents. These capabilities are promising for real-time decision-making support in defense scenarios by rapidly inferring insights about swarm behavior.


title: $q$-Chromatic polynomials

abstract: We introduce and study a $q$-version of the chromatic polynomial of a given graph $G=(V,E)$, namely, \[ \chi_G^\lambda(q,n) \ := \sum_{\substack{\text{proper colorings}\\ c\,:\,V\to[n]}} q^{ \sum_{ v \in V } \lambda_v c(v) }, \] where $\lambda \in \mathbb{Z}^V$ is a fixed linear form. Via work of Chapoton (2016) on $q$-Ehrhart polynomials, $\chi_G^\lambda(q,n)$ turns out to be a polynomial in the $q$-integer $[n]_q$, with coefficients that are rational functions in $q$. Additionally, we prove structural results for $\chi_G^\lambda(q,n)$ and exhibit connections to neighboring concepts, e.g., chromatic symmetric functions and the arithmetic of order polytopes. We offer a strengthened version of Stanley's conjecture that the chromatic symmetric function distinguishes trees, which leads to an analogue of $P$-partitions for graphs.


title: Measurement of double-differential cross sections for mesonless charged-current muon neutrino interactions on argon with final-state protons using the MicroBooNE detector

abstract: Charged-current neutrino interactions with final states containing zero mesons and at least one proton are of high interest for current and future accelerator-based neutrino oscillation experiments. Using the Booster Neutrino Beam and the MicroBooNE detector at Fermi National Accelerator Laboratory, we have obtained the first double-differential cross section measurements of this channel for muon neutrino scattering on an argon target with a proton momentum threshold of 0.25 GeV/c. We also report a flux-averaged total cross section of $\sigma = (11.8 \pm 1.2) \times 10^{-38}$ cm$^2$ / Ar and several single-differential measurements which extend and improve upon previous results. Statistical and systematic uncertainties are quantified with a full treatment of correlations across 359 kinematic bins, including correlations between distributions describing different observables. The resulting data set provides the most detailed information obtained to date for testing models of mesonless neutrino-argon scattering.


title: A search for super-imposed oscillations to the primordial power spectrum in Planck and SPT-3G 2018 data

abstract: We search for super-imposed oscillations linearly or logarithmically spaced in Fourier wavenumbers in Planck and South Pole Telescope (SPT-3G) 2018 temperature and polarization data. The SPT-3G temperature and polarization data provide a new window to test these oscillations at high multipoles beyond the Planck angular resolution and sensitivity. We consider both models with a constant and a Gaussian modulated amplitude, which correspond to three and four additional parameters beyond power-law primordial power spectrum for the templates considered, respectively. We find that each of the four models considered can provide an improved fit to Planck data, consistently with previous findings, and to SPT-3G data, always compared to $\Lambda$CDM. For a constant amplitude of the superimposed oscillations, we find tighter constraints on the amplitude of the oscillations from the combined Planck/SPT-3G data set than in each individual data sets. When the ranges of parameters which provide a better fit to Planck and SPT-3G data overlap, as in the case of Gaussian modulated oscillations, we find a larger $\Delta \chi^2$ - $- 17 \, (-16)$ for logarithmic (linear) oscillations - in a combined Planck/SPT-3G data set than in each individual data sets. These findings will be further tested with upcoming CMB temperature and polarization measurements at high multipoles provided by ongoing ground experiments.


title: The complement of tropical curves in moderate position on tropical surfaces

abstract: L\'opez de Medrano, Rinc\'on and Shaw defined the Chern classes on tropical manifolds as an extension of their theory of the Chern-Schwartz-MacPherson cycles on matroids. This makes it possible to define the Riemann-Roch number of tropical Cartier divisors on compact tropical manifolds. In this paper, we introduce the notion of a moderate position, and discuss a conjecture that the Riemann-Roch number $\operatorname{RR}(X;D)$ of a tropical submanifold $D$ of codimension $1$ in moderate position on a compact tropical manifold $X$ is equal to the topological Euler characteristic of the complement $X\setminus D$. In particular, we prove it and its generalization when $\dim X=2$ and $X$ admits a Delzant face structure.


title: A Public and Reproducible Assessment of the Topics API on Real Data

abstract: The Topics API for the web is Google's privacy-enhancing alternative to replace third-party cookies. Results of prior work have led to an ongoing discussion between Google and research communities about the capability of Topics to trade off both utility and privacy. The central point of contention is largely around the realism of the datasets used in these analyses and their reproducibility; researchers using data collected on a small sample of users or generating synthetic datasets, while Google's results are inferred from a private dataset. In this paper, we complement prior research by performing a reproducible assessment of the latest version of the Topics API on the largest and publicly available dataset of real browsing histories. First, we measure how unique and stable real users' interests are over time. Then, we evaluate if Topics can be used to fingerprint the users from these real browsing traces by adapting methodologies from prior privacy studies. Finally, we call on web actors to perform and enable reproducible evaluations by releasing anonymized distributions. We find that 46%, 55%, and 60% of the 1207 users in the dataset are uniquely re-identified across websites after only 1, 2, and 3 observations of their topics by advertisers, respectively. This paper shows on real data that Topics does not provide the same privacy guarantees to all users, further highlighting the need for public and reproducible evaluations of the claims made by new web proposals.


title: Keypoint Action Tokens Enable In-Context Imitation Learning in Robotics

abstract: We show that off-the-shelf text-based Transformers, with no additional training, can perform few-shot in-context visual imitation learning, mapping visual observations to action sequences that emulate the demonstrator's behaviour. We achieve this by transforming visual observations (inputs) and trajectories of actions (outputs) into sequences of tokens that a text-pretrained Transformer (GPT-4 Turbo) can ingest and generate, via a framework we call Keypoint Action Tokens (KAT). Despite being trained only on language, we show that these Transformers excel at translating tokenised visual keypoint observations into action trajectories, performing on par or better than state-of-the-art imitation learning (diffusion policies) in the low-data regime on a suite of real-world, everyday tasks. Rather than operating in the language domain as is typical, KAT leverages text-based Transformers to operate in the vision and action domains to learn general patterns in demonstration data for highly efficient imitation learning, indicating promising new avenues for repurposing natural language models for embodied tasks. Videos are available at https://www.robot-learning.uk/keypoint-action-tokens.


title: The Bad Batches: Enhancing Self-Supervised Learning in Image Classification Through Representative Batch Curation

abstract: The pursuit of learning robust representations without human supervision is a longstanding challenge. The recent advancements in self-supervised contrastive learning approaches have demonstrated high performance across various representation learning challenges. However, current methods depend on the random transformation of training examples, resulting in some cases of unrepresentative positive pairs that can have a large impact on learning. This limitation not only impedes the convergence of the learning process but the robustness of the learnt representation as well as requiring larger batch sizes to improve robustness to such bad batches. This paper attempts to alleviate the influence of false positive and false negative pairs by employing pairwise similarity calculations through the Fr\'echet ResNet Distance (FRD), thereby obtaining robust representations from unlabelled data. The effectiveness of the proposed method is substantiated by empirical results, where a linear classifier trained on self-supervised contrastive representations achieved an impressive 87.74\% top-1 accuracy on STL10 and 99.31\% on the Flower102 dataset. These results emphasize the potential of the proposed approach in pushing the boundaries of the state-of-the-art in self-supervised contrastive learning, particularly for image classification tasks.


title: OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagation

abstract: In the current state of 3D object detection research, the severe scarcity of annotated 3D data, substantial disparities across different data modalities, and the absence of a unified architecture, have impeded the progress towards the goal of universality. In this paper, we propose \textbf{OV-Uni3DETR}, a unified open-vocabulary 3D detector via cycle-modality propagation. Compared with existing 3D detectors, OV-Uni3DETR offers distinct advantages: 1) Open-vocabulary 3D detection: During training, it leverages various accessible data, especially extensive 2D detection images, to boost training diversity. During inference, it can detect both seen and unseen classes. 2) Modality unifying: It seamlessly accommodates input data from any given modality, effectively addressing scenarios involving disparate modalities or missing sensor information, thereby supporting test-time modality switching. 3) Scene unifying: It provides a unified multi-modal model architecture for diverse scenes collected by distinct sensors. Specifically, we propose the cycle-modality propagation, aimed at propagating knowledge bridging 2D and 3D modalities, to support the aforementioned functionalities. 2D semantic knowledge from large-vocabulary learning guides novel class discovery in the 3D domain, and 3D geometric knowledge provides localization supervision for 2D detection images. OV-Uni3DETR achieves the state-of-the-art performance on various scenarios, surpassing existing methods by more than 6\% on average. Its performance using only RGB images is on par with or even surpasses that of previous point cloud based methods. Code and pre-trained models will be released later.


title: Tuning intrinsic anomalous Hall effect from large to zero in two ferromagnetic states of SmMn2Ge2

abstract: The intrinsic anomalous Hall conductivity (AHC) in a ferromagnetic metal is completely determined by its band structure. Since the spin orientation direction is an important band structure tuning parameter, it is highly desirable to study the anomalous Hall effect in a system with multiple spin reorientation transitions. We study a layered tetragonal room temperature ferromagnet SmMn2Ge2, which gives us the opportunity to measure magneto-transport properties where the long c-axis and the short a-axis can both be magnetically easy axes depending on the temperature range we choose. We show a moderately large fully intrinsic AHC up to room temperature when the crystal is magnetized along the c-axis. Interestingly, the AHC can be tuned to completely extrinsic with extremely large values when the crystal is magnetized along the a-axis, regardless of whether the a-axis is magnetically easy or hard axis. First principles calculations show that nodal line states originate from Mn-d orbitals just below the Fermi energy (EF) in the electronic band structure when the spins are oriented along the c-axis. Intrinsic AHC originates from the Berry curvature effect of the gapped nodal lines in the presence of spin-orbit coupling. AHC almost disappears when the spins are aligned along the a-axis because the nodal line states shift above EF and become unoccupied states. Since the AHC can be changed from fully extrinsic to intrinsic even at 300 K, SmMn2Ge2 becomes a potential candidate for room temperature spintronics applications.


title: Generalized law of iterated logarithm for the Lorentz gas with infinite horizon

abstract: We obtain a generalized law of iterated logarithm for a class of dependent processes with superdiffusive behaviour. Our results apply in particular to the Lorentz gas with infinite horizon.


title: A nontrivial uniform algebra Dirichlet on its maximal ideal space

abstract: It is shown that there exists a nontrivial uniform algebra that is Dirichlet on its maximal ideal space and has a dense set of elements that are exponentials. This answers a 64-year-old question of John Wermer and a 16-year-old question of Garth Dales and Joel Feinstein. Our example is P(X) for a certain compact set X in complex Euclidean 2-space ($\mathbb{C}^2$). It is also shown that there exists a logmodular uniform algebra with proper Shilov boundary but with no nontrivial Gleason parts. This answers a modified form of another 64-year-old question of Wermer.


title: Img2Loc: Revisiting Image Geolocalization using Multi-modality Foundation Models and Image-based Retrieval-Augmented Generation

abstract: Geolocating precise locations from images presents a challenging problem in computer vision and information retrieval.Traditional methods typically employ either classification, which dividing the Earth surface into grid cells and classifying images accordingly, or retrieval, which identifying locations by matching images with a database of image-location pairs. However, classification-based approaches are limited by the cell size and cannot yield precise predictions, while retrieval-based systems usually suffer from poor search quality and inadequate coverage of the global landscape at varied scale and aggregation levels. To overcome these drawbacks, we present Img2Loc, a novel system that redefines image geolocalization as a text generation task. This is achieved using cutting-edge large multi-modality models like GPT4V or LLaVA with retrieval augmented generation. Img2Loc first employs CLIP-based representations to generate an image-based coordinate query database. It then uniquely combines query results with images itself, forming elaborate prompts customized for LMMs. When tested on benchmark datasets such as Im2GPS3k and YFCC4k, Img2Loc not only surpasses the performance of previous state-of-the-art models but does so without any model training.


title: Refining tree-decompositions so that they display the k-blocks

abstract: Carmesin and Gollin proved that every finite graph has a canonical tree-decomposition $(T, \mathcal{V})$ of adhesion less than $k$ that efficiently distinguishes every two distinct $k$-profiles, and which has the further property that every separable $k$-block is equal to the unique part of $(T, \mathcal{V})$ in which it is contained. We give a shorter proof of this result by showing that such a tree-decomposition can in fact be obtained from any canonical tight tree-decomposition of adhesion less than $k$. For this, we decompose the parts of such a tree-decomposition by further tree-decompositions. As an application, we also obtain a generalization of Carmesin and Gollin's result to locally finite graphs.


title: TOGS: Gaussian Splatting with Temporal Opacity Offset for Real-Time 4D DSA Rendering

abstract: Four-dimensional Digital Subtraction Angiography (4D DSA) is a medical imaging technique that provides a series of 2D images captured at different stages and angles during the process of contrast agent filling blood vessels. It plays a significant role in the diagnosis of cerebrovascular diseases. Improving the rendering quality and speed under sparse sampling is important for observing the status and location of lesions. The current methods exhibit inadequate rendering quality in sparse views and suffer from slow rendering speed. To overcome these limitations, we propose TOGS, a Gaussian splatting method with opacity offset over time, which can effectively improve the rendering quality and speed of 4D DSA. We introduce an opacity offset table for each Gaussian to model the temporal variations in the radiance of the contrast agent. By interpolating the opacity offset table, the opacity variation of the Gaussian at different time points can be determined. This enables us to render the 2D DSA image at that specific moment. Additionally, we introduced a Smooth loss term in the loss function to mitigate overfitting issues that may arise in the model when dealing with sparse view scenarios. During the training phase, we randomly prune Gaussians, thereby reducing the storage overhead of the model. The experimental results demonstrate that compared to previous methods, this model achieves state-of-the-art reconstruction quality under the same number of training views. Additionally, it enables real-time rendering while maintaining low storage overhead. The code will be publicly available.


title: Taming the Interacting Particle Langevin Algorithm -- the superlinear case

abstract: Recent advances in stochastic optimization have yielded the interactive particle Langevin algorithm (IPLA), which leverages the notion of interacting particle systems (IPS) to efficiently sample from approximate posterior densities. This becomes particularly crucial within the framework of Expectation-Maximization (EM), where the E-step is computationally challenging or even intractable. Although prior research has focused on scenarios involving convex cases with gradients of log densities that grow at most linearly, our work extends this framework to include polynomial growth. Taming techniques are employed to produce an explicit discretization scheme that yields a new class of stable, under such non-linearities, algorithms which are called tamed interactive particle Langevin algorithms (tIPLA). We obtain non-asymptotic convergence error estimates in Wasserstein-2 distance for the new class under an optimal rate.


title: DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs

abstract: This paper revives Densely Connected Convolutional Networks (DenseNets) and reveals the underrated effectiveness over predominant ResNet-style architectures. We believe DenseNets' potential was overlooked due to untouched training methods and traditional design elements not fully revealing their capabilities. Our pilot study shows dense connections through concatenation are strong, demonstrating that DenseNets can be revitalized to compete with modern architectures. We methodically refine suboptimal components - architectural adjustments, block redesign, and improved training recipes towards widening DenseNets and boosting memory efficiency while keeping concatenation shortcuts. Our models, employing simple architectural elements, ultimately surpass Swin Transformer, ConvNeXt, and DeiT-III - key architectures in the residual learning lineage. Furthermore, our models exhibit near state-of-the-art performance on ImageNet-1K, competing with the very recent models and downstream tasks, ADE20k semantic segmentation, and COCO object detection/instance segmentation. Finally, we provide empirical analyses that uncover the merits of the concatenation over additive shortcuts, steering a renewed preference towards DenseNet-style designs. Our code is available at https://github.com/naver-ai/rdnet.