title: Fast and Secure Decentralized Optimistic Rollups Using Setchain

abstract: Modern blockchains face a scalability challenge due to the intrinsic throughput limitations of consensus protocols. Layer 2 optimistic rollups (L2) are a faster alternative that offer the same interface in terms of smart contract development and user interaction. Optimistic rollups perform most computations offchain and make light use of an underlying blockchain (L1) to guarantee correct behavior, implementing a cheaper blockchain on a blockchain solution. With optimistic rollups, a sequencer calculates offchain batches of L2 transactions and commits batches (compressed or hashed) to the L1 blockchain. The use of hashes requires a data service to translate hashes into their corresponding batches. Current L2 implementations consist of a centralized sequencer (central authority) and an optional data availability committee (DAC). In this paper, we propose a decentralized L2 optimistic rollup based on Setchain, a decentralized Byzantine-tolerant implementation of sets. The main contribution is a fully decentralized "arranger" where arrangers are a formal definition combining sequencers and DACs. We prove our implementation correct and show empirical evidence that our solution scales. A final contribution is a system of incentives (payments) for servers that implement the sequencer and data availability committee protocols correctly, and a fraud-proof mechanism to detect violations of the protocol.


title: Generative Conditional Distributions by Neural (Entropic) Optimal Transport

abstract: Learning conditional distributions is challenging because the desired outcome is not a single distribution but multiple distributions that correspond to multiple instances of the covariates. We introduce a novel neural entropic optimal transport method designed to effectively learn generative models of conditional distributions, particularly in scenarios characterized by limited sample sizes. Our method relies on the minimax training of two neural networks: a generative network parametrizing the inverse cumulative distribution functions of the conditional distributions and another network parametrizing the conditional Kantorovich potential. To prevent overfitting, we regularize the objective function by penalizing the Lipschitz constant of the network output. Our experiments on real-world datasets show the effectiveness of our algorithm compared to state-of-the-art conditional distribution learning techniques. Our implementation can be found at https://github.com/nguyenngocbaocmt02/GENTLE.


title: PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection

abstract: With the proliferation of mobile sensing techniques, huge amounts of time series data are generated and accumulated in various domains, fueling plenty of real-world applications. In this setting, time series anomaly detection is practically important. It endeavors to identify deviant samples from the normal sample distribution in time series. Existing approaches generally assume that all the time series is available at a central location. However, we are witnessing the decentralized collection of time series due to the deployment of various edge devices. To bridge the gap between the decentralized time series data and the centralized anomaly detection algorithms, we propose a Parameter-efficient Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. PeFAD for the first time employs the pre-trained language model (PLM) as the body of the client's local model, which can benefit from its cross-modality knowledge transfer capability. To reduce the communication overhead and local model adaptation cost, we propose a parameter-efficient federated training module such that clients only need to fine-tune small-scale parameters and transmit them to the server for update. PeFAD utilizes a novel anomaly-driven mask selection strategy to mitigate the impact of neglected anomalies during training. A knowledge distillation operation on a synthetic privacy-preserving dataset that is shared by all the clients is also proposed to address the data heterogeneity issue across clients. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74\%.


title: Pricing and calibration in the 4-factor path-dependent volatility model

abstract: We consider the path-dependent volatility (PDV) model of Guyon and Lekeufack (2023), where the instantaneous volatility is a linear combination of a weighted sum of past returns and the square root of a weighted sum of past squared returns. We discuss the influence of an additional parameter that unlocks enough volatility on the upside to reproduce the implied volatility smiles of S&P 500 and VIX options. This PDV model, motivated by empirical studies, comes with computational challenges, especially in relation to VIX options pricing and calibration. We propose an accurate neural network approximation of the VIX which leverages on the Markovianity of the 4-factor version of the model. The VIX is learned as a function of the Markovian factors and the model parameters. We use this approximation to tackle the joint calibration of S&P 500 and VIX options.


title: Compositional dynamic modelling for causal prediction in multivariate time series

abstract: Theoretical developments in sequential Bayesian analysis of multivariate dynamic models underlie new methodology for causal prediction. This extends the utility of existing models with computationally efficient methodology, enabling routine exploration of Bayesian counterfactual analyses with multiple selected time series as synthetic controls. Methodological contributions also define the concept of outcome adaptive modelling to monitor and inferentially respond to changes in experimental time series following interventions designed to explore causal effects. The benefits of sequential analyses with time-varying parameter models for causal investigations are inherited in this broader setting. A case study in commercial causal analysis-- involving retail revenue outcomes related to marketing interventions-- highlights the methodological advances.


title: A Bayesian nonlinear stationary model with multiple frequencies for business cycle analysis

abstract: We design a novel, nonlinear single-source-of-error model for analysis of multiple business cycles. The model's specification is intended to capture key empirical characteristics of business cycle data by allowing for simultaneous cycles of different types and lengths, as well as time-variable amplitude and phase shift. The model is shown to feature relevant theoretical properties, including stationarity and pseudo-cyclical autocovariance function, and enables a decomposition of overall cyclic fluctuations into separate frequency-specific components. We develop a Bayesian framework for estimation and inference in the model, along with an MCMC procedure for posterior sampling, combining the Gibbs sampler and the Metropolis-Hastings algorithm, suitably adapted to address encountered numerical issues. Empirical results obtained from the model applied to the Polish GDP growth rates imply co-existence of two types of economic fluctuations: the investment and inventory cycles, and support the stochastic variability of the amplitude and phase shift, also capturing some business cycle asymmetries. Finally, the Bayesian framework enables a fully probabilistic inference on the business cycle clocks and dating, which seems the most relevant approach in view of economic uncertainties.


title: A Survey of Transformer Enabled Time Series Synthesis

abstract: Generative AI has received much attention in the image and language domains, with the transformer neural network continuing to dominate the state of the art. Application of these models to time series generation is less explored, however, and is of great utility to machine learning, privacy preservation, and explainability research. The present survey identifies this gap at the intersection of the transformer, generative AI, and time series data, and reviews works in this sparsely populated subdomain. The reviewed works show great variety in approach, and have not yet converged on a conclusive answer to the problems the domain poses. GANs, diffusion models, state space models, and autoencoders were all encountered alongside or surrounding the transformers which originally motivated the survey. While too open a domain to offer conclusive insights, the works surveyed are quite suggestive, and several recommendations for best practice, and suggestions of valuable future work, are provided.


title: The geometric Toda equations for noncompact symmetric spaces

abstract: This paper has two purposes. The first is to classify all those versions of the Toda equations which govern the existence of $\tau$-primitive harmonic maps from a surface into a homogeneous space $G/T$ for which $G$ is a noncomplex noncompact simple real Lie group and $T$ is a maximal compact torus, i.e., a maximal torus inside a maximal compact subgroup $H < G$. Here $\tau$ is the Coxeter automorphism which Drinfel'd & Sokolov assigned to each affine Dynkin diagram. This allows $\tau$ to be either an inner or an outer automorphism. We show that, up to equivalence, the real forms $G<G^\mathbb{C}$ which are compatible with $\tau$ can be classified using a simple labelling of the corresponding affine diagram. The second purpose is to establish when stability criteria can be used to prove the existence of solutions. We interpret the Toda equations over a compact Riemann surface $\Sigma$ as equations for a metric on a holomorphic principal $T^\mathbb{C}$-bundle $Q^\mathbb{C}$ over $\Sigma$. The corresponding Chern connection, when combined with a holomorphic field $\varphi$, produces a $G$-connection which is flat precisely when the Toda equations hold. We call the pair $(Q^\mathbb{C},\varphi)$ a Toda pair. We classify those real forms of the Toda equations for which the Toda pair is a principal pair (in the sense of Bradlow et al.) and we call these totally noncompact Toda pairs. Using the stability theory for principal pairs we prove that for totally noncompact cyclic Toda pairs $(Q^\mathbb{C},\varphi)$ the corresponding Toda equations always admit solutions. Every solution to the geometric Toda equations has a corresponding $G$-Higgs bundle. We explain how to construct this $G$-Higgs bundle directly from the Toda pair and show that Baraglia's cyclic Higgs bundles arise from a very special case of totally noncompact cyclic Toda pairs.


title: V-SeMo: a digital learning environment for teaching general relativity with sector models

abstract: The teaching of general relativity at the secondary school and lower undergraduate university levels is necessarily based on approaches with a restricted use of mathematics. An important aspect of teaching general relativity at this level are suitable learner activities. While a substantial number of such activities has been reported for studying the non-Euclidean geometry of curved surfaces, there are far fewer reports of activities that let learners actually study spacetimes and infer physical phenomena from their geometry. In this article we report on the digital learning environment V-SeMo that brings sector models (Zahn and Kraus 2014, arXiv:1405.0323) into an interactive web application. V-SeMo lets learners explore relativistic spacetimes by constructing geodesics and assessing curvature. We describe the didactic design and the user interface of V-SeMo, discuss the extended possibilities of virtual sector models compared to the paper models described previously, and present an activity on light deflection near neutron stars by way of example. We further report on an evaluation carried out with secondary school students. Results indicate a high learning effectiveness in both the V-SeMo-based and the paper-based versions of a teaching unit on relativistic light deflection. The teaching materials presented in this article are available online for teaching purposes at https://www.spacetimetravel.org .


title: Technical Language Processing for Telecommunications Specifications

abstract: Large Language Models (LLMs) are continuously being applied in a more diverse set of contexts. At their current state, however, even state-of-the-art LLMs such as Generative Pre-Trained Transformer 4 (GTP-4) have challenges when extracting information from real-world technical documentation without a heavy preprocessing. One such area with real-world technical documentation is telecommunications engineering, which could greatly benefit from domain-specific LLMs. The unique format and overall structure of telecommunications internal specifications differs greatly from standard English and thus it is evident that the application of out-of-the-box Natural Language Processing (NLP) tools is not a viable option. In this article, we outline the limitations of out-of-the-box NLP tools for processing technical information generated by telecommunications experts, and expand the concept of Technical Language Processing (TLP) to the telecommunication domain. Additionally, we explore the effect of domain-specific LLMs in the work of Specification Engineers, emphasizing the potential benefits of adopting domain-specific LLMs to speed up the training of experts in different telecommunications fields.


title: Jet formation model from accretion disks of electron-ion-photon gas

abstract: The problem of Astrophysical Jet formation from relativistic accretion disks through the establishment of relativistic disk-powerful jet equilibrium structure is studied applying the Beltrami-Bernoulli equilibrium approach of Shatashvili & Yoshida 2011; Arshilava et al. 2019. Accretion disk is weakly magnetized consisting of fully ionized relativistic electron-ion plasma and photon gas strongly coupled to electrons due to Thompson Scattering. %hence, making the behavior of photon gas similar to that of "a charged fluid". Analysis is based on the generalized Shakura-Sunyaev $\alpha $-turbulent dissipation model for local viscosity (being the main source of accretion), in which the contributions from both the photon and ion gases are taken into account. Ignoring the self-gravitation in the disk we constructed the analytical self-similar solutions for the equilibrium relativistic disk-jet structure characteristic parameters in the field of gravitating central compact object for the force-free condition. It is shown, that the magnetic field energy in the Jet is several orders greater compared to that of accretion disk, while jet-outflow is locally Super-Alfv\'enic with local {\it Plasma-beta} $< 1$ near the jet-axis. The derived solutions can be used to analyze the astrophysical jets observed in binary systems during the star formation process linking the jet properties with the parameters of relativistic accretion disks of electron-ion-photon gas.


title: Continual Unsupervised Out-of-Distribution Detection

abstract: Deep learning models excel when the data distribution during training aligns with testing data. Yet, their performance diminishes when faced with out-of-distribution (OOD) samples, leading to great interest in the field of OOD detection. Current approaches typically assume that OOD samples originate from an unconcentrated distribution complementary to the training distribution. While this assumption is appropriate in the traditional unsupervised OOD (U-OOD) setting, it proves inadequate when considering the place of deployment of the underlying deep learning model. To better reflect this real-world scenario, we introduce the novel setting of continual U-OOD detection. To tackle this new setting, we propose a method that starts from a U-OOD detector, which is agnostic to the OOD distribution, and slowly updates during deployment to account for the actual OOD distribution. Our method uses a new U-OOD scoring function that combines the Mahalanobis distance with a nearest-neighbor approach. Furthermore, we design a confidence-scaled few-shot OOD detector that outperforms previous methods. We show our method greatly improves upon strong baselines from related fields.


title: SimpleSpeech: Towards Simple and Efficient Text-to-Speech with Scalar Latent Transformer Diffusion Models

abstract: In this study, we propose a simple and efficient Non-Autoregressive (NAR) text-to-speech (TTS) system based on diffusion, named SimpleSpeech. Its simpleness shows in three aspects: (1) It can be trained on the speech-only dataset, without any alignment information; (2) It directly takes plain text as input and generates speech through an NAR way; (3) It tries to model speech in a finite and compact latent space, which alleviates the modeling difficulty of diffusion. More specifically, we propose a novel speech codec model (SQ-Codec) with scalar quantization, SQ-Codec effectively maps the complex speech signal into a finite and compact latent space, named scalar latent space. Benefits from SQ-Codec, we apply a novel transformer diffusion model in the scalar latent space of SQ-Codec. We train SimpleSpeech on 4k hours of a speech-only dataset, it shows natural prosody and voice cloning ability. Compared with previous large-scale TTS models, it presents significant speech quality and generation speed improvement. Demos are released.


title: On Affine Homotopy between Language Encoders

abstract: Pre-trained language encoders -- functions that represent text as vectors -- are an integral component of many NLP tasks. We tackle a natural question in language encoder analysis: What does it mean for two encoders to be similar? We contend that a faithful measure of similarity needs to be \emph{intrinsic}, that is, task-independent, yet still be informative of \emph{extrinsic} similarity -- the performance on downstream tasks. It is common to consider two encoders similar if they are \emph{homotopic}, i.e., if they can be aligned through some transformation. In this spirit, we study the properties of \emph{affine} alignment of language encoders and its implications on extrinsic similarity. We find that while affine alignment is fundamentally an asymmetric notion of similarity, it is still informative of extrinsic similarity. We confirm this on datasets of natural language representations. Beyond providing useful bounds on extrinsic similarity, affine intrinsic similarity also allows us to begin uncovering the structure of the space of pre-trained encoders by defining an order over them.


title: Universality arising from invertible weighted composition operators

abstract: A linear operator $U$ acting boundedly on an infinite-dimensional separable complex Hilbert space $H$ is universal if every linear bounded operator acting on $H$ is similar to a scalar multiple of a restriction of $U$ to one of its invariant subspaces. It turns out that characterizing the lattice of closed invariant subspaces of a universal operator is equivalent to solve the Invariant Subspace Problem for Hilbert spaces. In this paper, we consider invertible weighted hyperbolic composition operators and we prove the universality of the translations by eigenvalues of such operators, acting on Hardy and weighted Bergman spaces. Some consequences for the Banach space case are also discussed.


title: Translation Deserves Better: Analyzing Translation Artifacts in Cross-lingual Visual Question Answering

abstract: Building a reliable visual question answering~(VQA) system across different languages is a challenging problem, primarily due to the lack of abundant samples for training. To address this challenge, recent studies have employed machine translation systems for the cross-lingual VQA task. This involves translating the evaluation samples into a source language (usually English) and using monolingual models (i.e., translate-test). However, our analysis reveals that translated texts contain unique characteristics distinct from human-written ones, referred to as translation artifacts. We find that these artifacts can significantly affect the models, confirmed by extensive experiments across diverse models, languages, and translation processes. In light of this, we present a simple data augmentation strategy that can alleviate the adverse impacts of translation artifacts.


title: Extended Mind Transformers

abstract: Pre-trained language models demonstrate general intelligence and common sense, but long inputs quickly become a bottleneck for memorizing information at inference time. We resurface a simple method, Memorizing Transformers (Wu et al., 2022), that gives the model access to a bank of pre-computed memories. We show that it is possible to fix many of the shortcomings of the original method, such as the need for fine-tuning, by critically assessing how positional encodings should be updated for the keys and values retrieved. This intuitive method uses the model's own key/query system to select and attend to the most relevant memories at each generation step, rather than using external embeddings. We demonstrate the importance of external information being retrieved in a majority of decoder layers, contrary to previous work. We open source a new counterfactual long-range retrieval benchmark, and show that Extended Mind Transformers outperform today's state of the art by 6% on average.


title: Towards Neural Architecture Search for Transfer Learning in 6G Networks

abstract: The future 6G network is envisioned to be AI-native, and as such, ML models will be pervasive in support of optimizing performance, reducing energy consumption, and in coping with increasing complexity and heterogeneity. A key challenge is automating the process of finding optimal model architectures satisfying stringent requirements stemming from varying tasks, dynamicity and available resources in the infrastructure and deployment positions. In this paper, we describe and review the state-of-the-art in Neural Architecture Search and Transfer Learning and their applicability in networking. Further, we identify open research challenges and set directions with a specific focus on three main requirements with elements unique to the future network, namely combining NAS and TL, multi-objective search, and tabular data. Finally, we outline and discuss both near-term and long-term work ahead.


title: $\textit{Kilonova Seekers}$: the GOTO project for real-time citizen science in time-domain astrophysics

abstract: Time-domain astrophysics continues to grow rapidly, with the inception of new surveys drastically increasing data volumes. Democratised, distributed approaches to training sets for machine learning classifiers are crucial to make the most of this torrent of discovery -- with citizen science approaches proving effective at meeting these requirements. In this paper, we describe the creation of and the initial results from the $\textit{Kilonova Seekers}$ citizen science project, built to find transient phenomena from the GOTO telescopes in near real-time. $\textit{Kilonova Seekers}$ launched in July 2023 and received over 600,000 classifications from approximately 2,000 volunteers over the course of the LIGO-Virgo-KAGRA O4a observing run. During this time, the project has yielded 20 discoveries, generated a `gold-standard' training set of 17,682 detections for augmenting deep-learned classifiers, and measured the performance and biases of Zooniverse volunteers on real-bogus classification. This project will continue throughout the lifetime of GOTO, pushing candidates at ever-greater cadence, and directly facilitate the next-generation classification algorithms currently in development.


title: Probing the Category of Verbal Aspect in Transformer Language Models

abstract: We investigate how pretrained language models (PLM) encode the grammatical category of verbal aspect in Russian. Encoding of aspect in transformer LMs has not been studied previously in any language. A particular challenge is posed by "alternative contexts": where either the perfective or the imperfective aspect is suitable grammatically and semantically. We perform probing using BERT and RoBERTa on alternative and non-alternative contexts. First, we assess the models' performance on aspect prediction, via behavioral probing. Next, we examine the models' performance when their contextual representations are substituted with counterfactual representations, via causal probing. These counterfactuals alter the value of the "boundedness" feature--a semantic feature, which characterizes the action in the context. Experiments show that BERT and RoBERTa do encode aspect--mostly in their final layers. The counterfactual interventions affect perfective and imperfective in opposite ways, which is consistent with grammar: perfective is positively affected by adding the meaning of boundedness, and vice versa. The practical implications of our probing results are that fine-tuning only the last layers of BERT on predicting aspect is faster and more effective than fine-tuning the whole model. The model has high predictive uncertainty about aspect in alternative contexts, which tend to lack explicit hints about the boundedness of the described action.


title: Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation

abstract: We present polynomial-augmented neural networks (PANNs), a novel machine learning architecture that combines deep neural networks (DNNs) with a polynomial approximant. PANNs combine the strengths of DNNs (flexibility and efficiency in higher-dimensional approximation) with those of polynomial approximation (rapid convergence rates for smooth functions). To aid in both stable training and enhanced accuracy over a variety of problems, we present (1) a family of orthogonality constraints that impose mutual orthogonality between the polynomial and the DNN within a PANN; (2) a simple basis pruning approach to combat the curse of dimensionality introduced by the polynomial component; and (3) an adaptation of a polynomial preconditioning strategy to both DNNs and polynomials. We test the resulting architecture for its polynomial reproduction properties, ability to approximate both smooth functions and functions of limited smoothness, and as a method for the solution of partial differential equations (PDEs). Through these experiments, we demonstrate that PANNs offer superior approximation properties to DNNs for both regression and the numerical solution of PDEs, while also offering enhanced accuracy over both polynomial and DNN-based regression (each) when regressing functions with limited smoothness.


title: Laplacian Renormalization Group: An introduction to heterogeneous coarse-graining

abstract: The renormalization group (RG) constitutes a fundamental framework in modern theoretical physics. It allows the study of many systems showing states with large-scale correlations and their classification in a relatively small set of universality classes. RG is the most powerful tool for investigating organizational scales within dynamic systems. However, the application of RG techniques to complex networks has presented significant challenges, primarily due to the intricate interplay of correlations on multiple scales. Existing approaches have relied on hypotheses involving hidden geometries and based on embedding complex networks into hidden metric spaces. Here, we present a practical overview of the recently introduced Laplacian Renormalization Group for heterogeneous networks. First, we present a brief overview that justifies the use of the Laplacian as a natural extension for well-known field theories to analyze spatial disorder. We then draw an analogy to traditional real-space renormalization group procedures, explaining how the LRG generalizes the concept of "Kadanoff supernodes" as block nodes that span multiple scales. These supernodes help mitigate the effects of cross-scale correlations due to small-world properties. Additionally, we rigorously define the LRG procedure in momentum space in the spirit of Wilson RG. Finally, we show different analyses for the evolution of network properties along the LRG flow following structural changes when the network is properly reduced.


title: Linguistic Fingerprint in Transformer Models: How Language Variation Influences Parameter Selection in Irony Detection

abstract: This paper explores the correlation between linguistic diversity, sentiment analysis and transformer model architectures. We aim to investigate how different English variations impact transformer-based models for irony detection. To conduct our study, we used the EPIC corpus to extract five diverse English variation-specific datasets and applied the KEN pruning algorithm on five different architectures. Our results reveal several similarities between optimal subnetworks, which provide insights into the linguistic variations that share strong resemblances and those that exhibit greater dissimilarities. We discovered that optimal subnetworks across models share at least 60% of their parameters, emphasizing the significance of parameter values in capturing and interpreting linguistic variations. This study highlights the inherent structural similarities between models trained on different variants of the same language and also the critical role of parameter values in capturing these nuances.


title: Train Localization During GNSS Outages: A Minimalist Approach Using Track Geometry And IMU Sensor Data

abstract: Train localization during Global Navigation Satellite Systems (GNSS) outages presents challenges for ensuring failsafe and accurate positioning in railway networks. This paper proposes a minimalist approach exploiting track geometry and Inertial Measurement Unit (IMU) sensor data. By integrating a discrete track map as a Look-Up Table (LUT) into a Particle Filter (PF) based solution, accurate train positioning is achieved with only an IMU sensor and track map data. The approach is tested on an open railway positioning data set, showing that accurate positioning (absolute errors below 10 m) can be maintained during GNSS outages up to 30 s in the given data. We simulate outages on different track segments and show that accurate positioning is reached during track curves and curvy railway lines. The approach can be used as a redundant complement to established positioning solutions to increase the position estimate's reliability and robustness.


title: Geometric interpretation of the vanishing Lie Bracket for two-dimensional rough vector fields

abstract: In this paper, we prove that if $X,Y$ are continuous, Sobolev vector fields with bounded divergence on the real plane and $[X,Y]=0$, then their flows commute. In particular, we improve the previous result of Colombo-Tione (2021), where the authors require the additional assumption of the weak Lie differentiability on one of the two flows. We also discuss possible extensions to the $\text{BV}$ setting.


title: QCDGE database, Quantum Chemistry Database with Ground- and Excited-state Properties of 450 Kilo Molecules

abstract: Due to rapid advancements in deep learning techniques, the demand for large-volume high-quality databases grows significantly in chemical research. We developed a quantum-chemistry database that includes 443,106 small organic molecules with sizes up to 10 heavy atoms including carbon (C), nitrogen (N), oxygen (O), and fluorine (F). Ground-state geometry optimizations and frequency calculations of all compounds were performed at the B3LYP/6-31G* level with the BJD3 dispersion correction, while the excited-state single-point calculations were conducted at the $\omega$B97X-D/6-31G* level. Totally twenty seven molecular properties, such as geometric, thermodynamic, electronic and energetic properties, were gathered from these calculations. Meanwhile, we also established a comprehensive protocol for the construction of a high-volume quantum-chemistry database. Our QCDGE (Quantum Chemistry Database with Ground- and Excited-State Properties) database contains a substantial volume of data, exhibits high chemical diversity, and most importantly includes excited-state information. This database, along with its construction protocol, is expected to have a significant impact on the broad applications of machine learning studies across different fields of chemistry, especially in the area of excited-state research.


title: Spectral representation in Klein space: simplifying celestial leaf amplitudes

abstract: In this paper, we explore the spectral representation in Klein space which is the split $(2,2)$ signature flat spacetime. The Klein space can be foliated into Lorentzian $\mathrm{AdS}_3 /\mathbb{Z}$ slices, and its identity resolution has both continuous and discrete parts. We calculate the identity resolution, and the plancherel measure in these slices. Using the foliation of Klein space into the slices, and the identity resolution, and the plancherel measure in each slices, we compute the spectral representation of the massive bulk-to-bulk propagator in Klein space. It can be expressed as the sum of product of two massive (or tachyonic) conformal primary wavefunctions, with both continuous and discrete parts, and sharing a common boundary coordinate. An interesting point in Klein space is that since the identity resolution has both discrete and continuous parts, a new type of conformal primary wavefunction naturally arises for the massive (or tachyonic) case. For the conformal primary wavefunctions, both the discrete and continuous parts involve integrating over the common boundary coordinate and the real (or imaginary) mass. In the discrete part, the conformal dimension is summed, whereas in the continuous part, it is integrated. The spectral representation in Klein space is a computational tool to derive conformal block expansions for celestial amplitude in Klein space and its building blocks called celestial leaf amplitudes, by integrating the particle interaction vertex over a single slice of foliation.


title: Cluster-Aware Similarity Diffusion for Instance Retrieval

abstract: Diffusion-based re-ranking is a common method used for retrieving instances by performing similarity propagation in a nearest neighbor graph. However, existing techniques that construct the affinity graph based on pairwise instances can lead to the propagation of misinformation from outliers and other manifolds, resulting in inaccurate results. To overcome this issue, we propose a novel Cluster-Aware Similarity (CAS) diffusion for instance retrieval. The primary concept of CAS is to conduct similarity diffusion within local clusters, which can reduce the influence from other manifolds explicitly. To obtain a symmetrical and smooth similarity matrix, our Bidirectional Similarity Diffusion strategy introduces an inverse constraint term to the optimization objective of local cluster diffusion. Additionally, we have optimized a Neighbor-guided Similarity Smoothing approach to ensure similarity consistency among the local neighbors of each instance. Evaluations in instance retrieval and object re-identification validate the effectiveness of the proposed CAS, our code is publicly available.


title: Incorporating Navigation Context into Inland Vessel Trajectory Prediction: A Gaussian Mixture Model and Transformer Approach

abstract: Using data sources beyond the Automatic Identification System to represent the context a vessel is navigating in and consequently improve situation awareness is still rare in machine learning approaches to vessel trajectory prediction (VTP). In inland shipping, where vessel movement is constrained within fairways, navigational context information is indispensable. In this contribution targeting inland VTP, Gaussian Mixture Models (GMMs) are applied, on a fused dataset of AIS and discharge measurements, to generate multi-modal distribution curves, capturing typical lateral vessel positioning in the fairway and dislocation speeds along the waterway. By sampling the probability density curves of the GMMs, feature vectors are derived which are used, together with spatio-temporal vessel features and fairway geometries, as input to a VTP transformer model. The incorporation of these distribution features of both the current and forthcoming navigation context improves prediction accuracy. The superiority of the model over a previously proposed transformer model for inland VTP is shown. The novelty lies in the provision of preprocessed, statistics-based features representing the conditioned spatial context, rather than relying on the model to extract relevant features for the VTP task from contextual data. Oversimplification of the complexity of inland navigation patterns by assuming a single typical route or selecting specific clusters prior to model application is avoided by giving the model access to the entire distribution information. The methodology's generalizability is demonstrated through the usage of data of 3 distinct river sections. It can be integrated into an interaction-aware prediction framework, where insights into the positioning of the actual vessel behavior in the overall distribution at the current location and discharge can enhance trajectory prediction accuracy.


title: Progressive Confident Masking Attention Network for Audio-Visual Segmentation

abstract: Audio and visual signals typically occur simultaneously, and humans possess an innate ability to correlate and synchronize information from these two modalities. Recently, a challenging problem known as Audio-Visual Segmentation (AVS) has emerged, intending to produce segmentation maps for sounding objects within a scene. However, the methods proposed so far have not sufficiently integrated audio and visual information, and the computational costs have been extremely high. Additionally, the outputs of different stages have not been fully utilized. To facilitate this research, we introduce a novel Progressive Confident Masking Attention Network (PMCANet). It leverages attention mechanisms to uncover the intrinsic correlations between audio signals and visual frames. Furthermore, we design an efficient and effective cross-attention module to enhance semantic perception by selecting query tokens. This selection is determined through confidence-driven units based on the network's multi-stage predictive outputs. Experiments demonstrate that our network outperforms other AVS methods while requiring less computational resources.


title: Noninvasive magnetic detection of 2D van der Waals room-temperature ferromagnet Fe3GaTe2 using divacancy spins in SiC

abstract: Room-temperature (RT) two-dimensional (2D) van der Waals (vdW) ferromagnets hold immense promise for next-generation spintronic devices for information storage and processing. To achieve high-density energy-efficient spintronic devices, it is essential to understand local magnetic properties of RT 2D vdW magnets. In this work, we realize noninvasive in situ magnetic detection in vdW-layered ferromagnet Fe3GaTe2 using divacancy spins quantum sensor in silicon carbide (SiC) at RT. The structural features and magnetic properties of the Fe3GaTe2 are characterized utilizing Raman spectrum, magnetization and magneto-transport measurements. Further detailed analysis of temperature- and magnetic field-dependent optically detected magnetic resonances of the PL6 divacancy near the Fe3GaTe2 reveal that, the Curie temperature (Tc) of Fe3GaTe2 is ~360K, and the magnetization increases with external magnetic fields. Additionally, spin relaxometry technology is employed to probe the magnetic fluctuations of Fe3GaTe2, revealing a peak in the spin relaxation rate around Tc. These experiments give insights into the intriguing local magnetic properties of 2D vdW RT ferromagnet Fe3GaTe2 and pave the way for the application of SiC quantum sensors in noninvasive in situ magnetic detection of related 2D vdW magnets.


title: Flash Diffusion: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation

abstract: In this paper, we propose an efficient, fast, and versatile distillation method to accelerate the generation of pre-trained diffusion models: Flash Diffusion. The method reaches state-of-the-art performances in terms of FID and CLIP-Score for few steps image generation on the COCO2014 and COCO2017 datasets, while requiring only several GPU hours of training and fewer trainable parameters than existing methods. In addition to its efficiency, the versatility of the method is also exposed across several tasks such as text-to-image, inpainting, face-swapping, super-resolution and using different backbones such as UNet-based denoisers (SD1.5, SDXL) or DiT (Pixart-$\alpha$), as well as adapters. In all cases, the method allowed to reduce drastically the number of sampling steps while maintaining very high-quality image generation. The official implementation is available at https://github.com/gojasper/flash-diffusion.


title: AMOSL: Adaptive Modality-wise Structure Learning in Multi-view Graph Neural Networks For Enhanced Unified Representation

abstract: While Multi-view Graph Neural Networks (MVGNNs) excel at leveraging diverse modalities for learning object representation, existing methods assume identical local topology structures across modalities that overlook real-world discrepancies. This leads MVGNNs straggles in modality fusion and representations denoising. To address these issues, we propose adaptive modality-wise structure learning (AMoSL). AMoSL captures node correspondences between modalities via optimal transport, and jointly learning with graph embedding. To enable efficient end-to-end training, we employ an efficient solution for the resulting complex bilevel optimization problem. Furthermore, AMoSL adapts to downstream tasks through unsupervised learning on inter-modality distances. The effectiveness of AMoSL is demonstrated by its ability to train more accurate graph classifiers on six benchmark datasets.


title: CADE: Cosine Annealing Differential Evolution for Spiking Neural Network

abstract: Spiking neural networks (SNNs) have gained prominence for their potential in neuromorphic computing and energy-efficient artificial intelligence, yet optimizing them remains a formidable challenge for gradient-based methods due to their discrete, spike-based computation. This paper attempts to tackle the challenges by introducing Cosine Annealing Differential Evolution (CADE), designed to modulate the mutation factor (F) and crossover rate (CR) of differential evolution (DE) for the SNN model, i.e., Spiking Element Wise (SEW) ResNet. Extensive empirical evaluations were conducted to analyze CADE. CADE showed a balance in exploring and exploiting the search space, resulting in accelerated convergence and improved accuracy compared to existing gradient-based and DE-based methods. Moreover, an initialization method based on a transfer learning setting was developed, pretraining on a source dataset (i.e., CIFAR-10) and fine-tuning the target dataset (i.e., CIFAR-100), to improve population diversity. It was found to further enhance CADE for SNN. Remarkably, CADE elevates the performance of the highest accuracy SEW model by an additional 0.52 percentage points, underscoring its effectiveness in fine-tuning and enhancing SNNs. These findings emphasize the pivotal role of a scheduler for F and CR adjustment, especially for DE-based SNN. Source Code on Github: https://github.com/Tank-Jiang/CADE4SNN.


title: LlamaCare: A Large Medical Language Model for Enhancing Healthcare Knowledge Sharing

abstract: Large language models (LLMs) have shown amazing capabilities in knowledge memorization and the present. However, when it comes to domain-specific knowledge and downstream tasks like medical, general LLMs are often unable to give precise answers. In addition, when people want LLMs to answer classification questions, they usually go through instruction tuning first. However, LLMs do not always give a direct index of the categorization after instruction tuning. In this paper, we proposed LlamaCare, a fine-tuned medical language model, and Extended Classification Integration(ECI), a module to handle classification problems of LLMs. Our contributions are : (i) We fine-tuned a large language model of medical knowledge with very low carbon emissions and achieved similar performance with ChatGPT by a 24G GPU. (ii) We solved the problem of redundant categorical answers and improved the performance of LLMs by proposing a new module called Extended Classification Integration. (iii) We released our processed data for one-shot and few-shot training for some benchmarks such as PubMedQA and USMLE 1-3 step. Our method achieves a close performance comparable to some state-of-the-art models with the same quantity of parameters on benchmarks, while being more environmentally friendly by using less GPU computation time. Our models, codes, and datasets can be found at \url{https://github.com/Stephen-SMJ/LLamaCare}.


title: Integral curvature estimates for solutions to Ricci flow with $L^p$ bounded scalar curvature

abstract: In this paper we prove $\textit{localised, weighted}$ curvature integral estimates for solutions to the Ricci flow in the setting of a smooth four dimensional Ricci flow or a closed $n$-dimensional K\"ahler Ricci flow. These integral estimates improve and extend the integral curvature estimates shown by the second author in an earlier paper. If the scalar curvature is uniformly bounded in the spatial $L^p$ sense for some $p>2,$ then the estimates imply a uniform bound on the spatial $L^2$ norm of the Riemannian curvature tensor. Stronger integral estimates are shown to hold if one further assumes a weak non-inflating condition. In a sequel paper, we show that in many natural settings, a non-inflating condition holds.


title: System-Aware Neural ODE Processes for Few-Shot Bayesian Optimization

abstract: We consider the problem of optimizing initial conditions and timing in dynamical systems governed by unknown ordinary differential equations (ODEs), where evaluating different initial conditions is costly and there are constraints on observation times. To identify the optimal conditions within several trials, we introduce a few-shot Bayesian Optimization (BO) framework based on the system's prior information. At the core of our approach is the System-Aware Neural ODE Processes (SANODEP), an extension of Neural ODE Processes (NODEP) designed to meta-learn ODE systems from multiple trajectories using a novel context embedding block. Additionally, we propose a multi-scenario loss function specifically for optimization purposes. Our two-stage BO framework effectively incorporates search space constraints, enabling efficient optimization of both initial conditions and observation timings. We conduct extensive experiments showcasing SANODEP's potential for few-shot BO. We also explore SANODEP's adaptability to varying levels of prior information, highlighting the trade-off between prior flexibility and model fitting accuracy.


title: A compact stellarator-tokamak hybrid

abstract: Tokamaks and stellarators are the leading two magnetic confinement devices for producing fusion energy, begging the question of whether the strengths of the two could be merged into a single concept. To meet this challenge, we propose a first-of-its kind optimized stellarator-tokamak hybrid. Compared to a typical tokamak coil set, only a single simple type of stellarator coil has to be added which leads to a compact, volume- and transport-preserving magnetic field, with an added rotational transform that reaches levels thought to enhance stability.


title: Label-wise Aleatoric and Epistemic Uncertainty Quantification

abstract: We present a novel approach to uncertainty quantification in classification tasks based on label-wise decomposition of uncertainty measures. This label-wise perspective allows uncertainty to be quantified at the individual class level, thereby improving cost-sensitive decision-making and helping understand the sources of uncertainty. Furthermore, it allows to define total, aleatoric, and epistemic uncertainty on the basis of non-categorical measures such as variance, going beyond common entropy-based measures. In particular, variance-based measures address some of the limitations associated with established methods that have recently been discussed in the literature. We show that our proposed measures adhere to a number of desirable properties. Through empirical evaluation on a variety of benchmark data sets -- including applications in the medical domain where accurate uncertainty quantification is crucial -- we establish the effectiveness of label-wise uncertainty quantification.


title: FedDr+: Stabilizing Dot-regression with Global Feature Distillation for Federated Learning

abstract: Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in FL is client drift, where data heterogeneity impedes the aggregation of scattered knowledge. Recent studies have tackled the client drift issue by identifying significant divergence in the last classifier layer. To mitigate this divergence, strategies such as freezing the classifier weights and aligning the feature extractor accordingly have proven effective. Although the local alignment between classifier and feature extractor has been studied as a crucial factor in FL, we observe that it may lead the model to overemphasize the observed classes within each client. Thus, our objectives are twofold: (1) enhancing local alignment while (2) preserving the representation of unseen class samples. This approach aims to effectively integrate knowledge from individual clients, thereby improving performance for both global and personalized FL. To achieve this, we introduce a novel algorithm named FedDr+, which empowers local model alignment using dot-regression loss. FedDr+ freezes the classifier as a simplex ETF to align the features and improves aggregated global models by employing a feature distillation mechanism to retain information about unseen/missing classes. Consequently, we provide empirical evidence demonstrating that our algorithm surpasses existing methods that use a frozen classifier to boost alignment across the diverse distribution.


title: Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks

abstract: The ability (and inability) of large language models (LLMs) to perform arithmetic tasks has been the subject of much theoretical and practical debate. We show that LLMs are frequently able to correctly and confidently predict the first digit of n-digit by m-digit multiplication tasks without using chain of thought reasoning, despite these tasks require compounding operations to solve. Simultaneously, LLMs in practice often fail to correctly or confidently predict the last digit of an n-digit by m-digit multiplication, a task equivalent to 1-digit by 1-digit multiplication which can be easily learned or memorized. We show that the latter task can be solved more robustly when the LLM is conditioned on all of the correct higher-order digits, which on average increases the confidence of the correct last digit on 5-digit by 5-digit multiplication tasks using Llama 2-13B by over 230% (0.13 to 0.43) and Mistral-7B by 150% (0.22 to 0.55).


title: The complexity of approximate (coarse) correlated equilibrium for incomplete information games

abstract: We study the iteration complexity of decentralized learning of approximate correlated equilibria in incomplete information games. On the negative side, we prove that in $\mathit{extensive}$-$\mathit{form}$ $\mathit{games}$, assuming $\mathsf{PPAD} \not\subset \mathsf{TIME}(n^{\mathsf{polylog}(n)})$, any polynomial-time learning algorithms must take at least $2^{\log_2^{1-o(1)}(|\mathcal{I}|)}$ iterations to converge to the set of $\epsilon$-approximate correlated equilibrium, where $|\mathcal{I}|$ is the number of nodes in the game and $\epsilon > 0$ is an absolute constant. This nearly matches, up to the $o(1)$ term, the algorithms of [PR'24, DDFG'24] for learning $\epsilon$-approximate correlated equilibrium, and resolves an open question of Anagnostides, Kalavasis, Sandholm, and Zampetakis [AKSZ'24]. Our lower bound holds even for the easier solution concept of $\epsilon$-approximate $\mathit{coarse}$ correlated equilibrium On the positive side, we give uncoupled dynamics that reach $\epsilon$-approximate correlated equilibria of a $\mathit{Bayesian}$ $\mathit{game}$ in polylogarithmic iterations, without any dependence of the number of types. This demonstrates a separation between Bayesian games and extensive-form games.


title: Understanding the chemistry of the young stellar object G29.862-0.0044

abstract: In previous works, we have investigated the star-forming region G29.96$-$0.02 where the massive young stellar object (MYSO) G29.862$-$0.0044 (hereafter G29) is embedded in a hot molecular core. In one of them, of multiwavelength nature, using data from the Atacama Submillimeter Telescope Experiment (ASTE), data from the Atacama Large Millimeter Array (ALMA), and photometric data from NIRI-Gemini, G29 was investigated at different spatial scales. However, the intriguing morphology of G29 in the near-infrared, together with the distribution of the associated molecular gas, reveals that the star-formation scenario is far from being understood. This work incorporates the analysis of the emission of several molecular lines acquired with ALMA that were not previously examined (eg.,~CH$_{3}$OH, HC$_{3}$N, H$_{ 2}$CO, C$^{34}$S, H$_{2}$CS) as well as a new determination of the temperature of the region. Additionally, we present the progress of results obtained through new observations in the near-infrared, in this case spectroscopic, using NIFS-Gemini, and in radio continnum obtained with the Karl G. Jansky Very Large Array (JVLA). This research allows us to carry out a detailed chemical study of the region, which will contribute to the understanding of the physical processes involved in the high-mass star formation.


title: Primordial gravitational wave backgrounds from phase transitions with next generation ground based detectors

abstract: Third generation ground-based gravitational wave (GW) detectors, such as Einstein Telescope and Cosmic Explorer, will operate in the $(\text{few}-10^4)$ Hz frequency band, with a boost in sensitivity providing an unprecedented reach into primordial cosmology. Working concurrently with pulsar timing arrays in the nHz band, and LISA in the mHz band, these 3G detectors will be powerful probes of beyond the standard model particle physics on scales $T\gtrsim 10^{7}$GeV. Here we focus on their ability to probe phase transitions (PTs) in the early universe. We first overview the landscape of detectors across frequencies, discuss the relevance of astrophysical foregrounds, and provide convenient and up-to-date power-law integrated sensitivity curves for these detectors. We then present the constraints expected from GW observations on first order PTs and on topological defects (strings and domain walls), which may be formed when a symmetry is broken irrespective of the order of the phase transition. These constraints can then be applied to specific models leading to first order PTs and/or topological defects. In particular we discuss the implications for axion models, which solve the strong CP problem by introducing a spontaneously broken Peccei-Quinn (PQ) symmetry. For post-inflationary breaking, the PQ scale must lie in the $10^{8}-10^{11}$ GeV range, and so the signal from a first order PQ PT falls within reach of ground based 3G detectors. A scan in parameter space of signal-to-noise ratio in a representative model reveals their large potential to probe the nature of the PQ transition. Additionally, in heavy axion type models domain walls form, which can lead to a detectable GW background. We discuss their spectrum and summarise the expected constraints on these models from 3G detectors, together with SKA and LISA.


title: A Practical Approach for Exploring Granger Connectivity in High-Dimensional Networks of Time Series

abstract: This manuscript presents a novel method for discovering effective connectivity between specified pairs of nodes in a high-dimensional network of time series. To accurately perform Granger causality analysis from the first node to the second node, it is essential to eliminate the influence of all other nodes within the network. The approach proposed is to create a low-dimensional representation of all other nodes in the network using frequency-domain-based dynamic principal component analysis (spectral DPCA). The resulting scores are subsequently removed from the first and second nodes of interest, thus eliminating the confounding effect of other nodes within the high-dimensional network. To conduct hypothesis testing on Granger causality, we propose a permutation-based causality test. This test enhances the accuracy of our findings when the error structures are non-Gaussian. The approach has been validated in extensive simulation studies, which demonstrate the efficacy of the methodology as a tool for causality analysis in complex time series networks. The proposed methodology has also been demonstrated to be both expedient and viable on real datasets, with particular success observed on multichannel EEG networks.


title: Using Self-supervised Learning Can Improve Model Fairness

abstract: Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with supervised methods, comprehensive efforts to assess SSL's impact on machine learning fairness (i.e., performing equally on different demographic breakdowns) are lacking. Hypothesizing that SSL models would learn more generic, hence less biased representations, this study explores the impact of pre-training and fine-tuning strategies on fairness. We introduce a fairness assessment framework for SSL, comprising five stages: defining dataset requirements, pre-training, fine-tuning with gradual unfreezing, assessing representation similarity conditioned on demographics, and establishing domain-specific evaluation processes. We evaluate our method's generalizability on three real-world human-centric datasets (i.e., MIMIC, MESA, and GLOBEM) by systematically comparing hundreds of SSL and fine-tuned models on various dimensions spanning from the intermediate representations to appropriate evaluation metrics. Our findings demonstrate that SSL can significantly improve model fairness, while maintaining performance on par with supervised methods-exhibiting up to a 30% increase in fairness with minimal loss in performance through self-supervision. We posit that such differences can be attributed to representation dissimilarities found between the best- and the worst-performing demographics across models-up to x13 greater for protected attributes with larger performance discrepancies between segments.


title: Temporal Graph Rewiring with Expander Graphs

abstract: Evolving relations in real-world networks are often modelled by temporal graphs. Graph rewiring techniques have been utilised on Graph Neural Networks (GNNs) to improve expressiveness and increase model performance. In this work, we propose Temporal Graph Rewiring (TGR), the first approach for graph rewiring on temporal graphs. TGR enables communication between temporally distant nodes in a continuous time dynamic graph by utilising expander graph propagation to construct a message passing highway for message passing between distant nodes. Expander graphs are suitable candidates for rewiring as they help overcome the oversquashing problem often observed in GNNs. On the public tgbl-wiki benchmark, we show that TGR improves the performance of a widely used TGN model by a significant margin. Our code repository is accessible at https://github.com/kpetrovicc/TGR.git .


title: Learning dynamical models from stochastic trajectories

abstract: The dynamics of biological systems, from proteins to cells to organisms, is complex and stochastic. To decipher their physical laws, we need to bridge between experimental observations and theoretical modeling. Thanks to progress in microscopy and tracking, there is today an abundance of experimental trajectories reflecting these dynamical laws. Inferring physical models from noisy and imperfect experimental data, however, is challenging. Because there are no inference methods that are robust and efficient, model reconstruction from experimental trajectories is a bottleneck to data-driven biophysics. In this Thesis, I present a set of tools developed to bridge this gap and permit robust and universal inference of stochastic dynamical models from experimental trajectories. These methods are rooted in an information-theoretical framework that quantifies how much can be inferred from trajectories that are short, partial and noisy. They permit the efficient inference of dynamical models for overdamped and underdamped Langevin systems, as well as the inference of entropy production rates. I finally present early applications of these techniques, as well as future research directions.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.data-an


title: Probing the zero energy shell wave functions of triangular graphene quantum dots with broken sublattice symmetry using a localized impurity

abstract: We present here a method of probing the wave functions of a degenerate shell in a triangular graphene quantum dot, triangulene, using a localized substitutional impurity. We demonstrate its applicability to the example of aza-triangulenes. Using the analytical solution for degenerate states of an all-carbon triangulene as a basis for a triangulene containing a nitrogen impurity, we predict the structure of the zero energy shell in the presence of this impurity. We show that the impurity allows probing of the wave functions of a degenerate shell on a carbon site where it is located. We confirm our predictions by a comparison with the tight-binding and ab-initio calculation as well as with experiment.


title: Exploiting Chordal Sparsity for Fast Global Optimality with Application to Localization

abstract: In recent years, many estimation problems in robotics have been shown to be solvable to global optimality using their semidefinite relaxations. However, the runtime complexity of off-the-shelf semidefinite programming solvers is up to cubic in problem size, which inhibits real-time solutions of problems involving large state dimensions. We show that for a large class of problems, namely those with chordal sparsity, we can reduce the complexity of these solvers to linear in problem size. In particular, we show how to replace the large positive-semidefinite variable by a number of smaller interconnected ones using the well-known chordal decomposition. This formulation also allows for the straightforward application of the alternating direction method of multipliers (ADMM), which can exploit parallelism for increased scalability. We show in simulation that the algorithms provide a significant speed up for two example problems: matrix-weighted and range-only localization.


title: Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models

abstract: Diffusion models (DMs) produce very detailed and high-quality images. Their power results from extensive training on large amounts of data, usually scraped from the internet without proper attribution or consent from content creators. Unfortunately, this practice raises privacy and intellectual property concerns, as DMs can memorize and later reproduce their potentially sensitive or copyrighted training images at inference time. Prior efforts prevent this issue by either changing the input to the diffusion process, thereby preventing the DM from generating memorized samples during inference, or removing the memorized data from training altogether. While those are viable solutions when the DM is developed and deployed in a secure and constantly monitored environment, they hold the risk of adversaries circumventing the safeguards and are not effective when the DM itself is publicly released. To solve the problem, we introduce NeMo, the first method to localize memorization of individual data samples down to the level of neurons in DMs' cross-attention layers. Through our experiments, we make the intriguing finding that in many cases, single neurons are responsible for memorizing particular training samples. By deactivating these memorization neurons, we can avoid the replication of training data at inference time, increase the diversity in the generated outputs, and mitigate the leakage of private and copyrighted data. In this way, our NeMo contributes to a more responsible deployment of DMs.


title: A Note on and Generalization of "Exploring Modified Kaniadakis Entropy: MOND Theory and the Bekenstein Bound Conjecture"

abstract: In a recent paper by Ambr\'osio et al. [arXiv:2405.14799], it was shown that the gravitational force law of the Modified Newtonian Dynamics (MOND) phenomenology can be derived within the framework of entropic gravity and the holographic principle by assuming an entropy function other than the conventional Boltzmann-Gibbs entropy. In particular, they derived the standard interpolation function of MOND together with an analytical expression for the acceleration constant $a_0$ by utilizing Kaniadakis' modified entropy. In this short note, using the same methodology, we generalize this result and show that MONDian behavior is a rather general consequence of combining entropic gravity with non-Boltzmann-Gibbs entropies, which depends on only a few conditions imposed on the generalized entropy function.


abstract: Large language models (LLMs) have achieved remarkable progress in the field of natural language processing (NLP), demonstrating remarkable abilities in producing text that resembles human language for various tasks. This opens up new opportunities for employing them in recommender systems (RSs). In this paper, we specifically examine the sample efficiency of LLM-enhanced recommender systems, which pertains to the model's capacity to attain superior performance with a limited quantity of training data. Conventional recommendation models (CRMs) often need a large amount of training data because of the sparsity of features and interactions. Hence, we propose and verify our core viewpoint: Large Language Models Make Sample-Efficient Recommender Systems. We propose a simple yet effective framework (i.e., Laser) to validate the viewpoint from two aspects: (1) LLMs themselves are sample-efficient recommenders; and (2) LLMs, as feature generators and encoders, make CRMs more sample-efficient. Extensive experiments on two public datasets show that Laser requires only a small fraction of training samples to match or even surpass CRMs that are trained on the entire training set, demonstrating superior sample efficiency.


title: Identifying Sample Size and Accuracy and Precision of the Estimators in Case-Crossover Designs with Distributed Lags of Heteroskedastic Time-Varying Continuous Exposures Measured with Simple or Complex Error

abstract: Understanding of sample size, statistical power, and the accuracy and precision of the estimator in epidemiological research can facilitate power and bias analyses. However, such understanding can become complicated for several reasons. First, exposures varying spatiotemporally may be heteroskedastic. Second, distributed lags of exposures may be used to identify critical exposure time-windows. Third, exposure measurement error may exist, impacting the accuracy and/or precision of the estimator that consequently affects sample size and statistical power. Fourth, research may rely on different study designs, so understanding may differ. For example, case-crossover designs as matched case-control designs, are used to estimate health effects of short-term exposures. To address these gaps, I developed approximation equations for sample size, estimates of the estimators and standard errors, including polynomials for non-linear effect estimation. With air pollution exposure estimates, I examined approximations using statistical simulations. Overall, sample size, the accuracy and precision of the estimators can be approximated based on external information about validation, without validation data in hand. For distributed lags, approximations may perform well if residual confounding due to covariate measurement errors is not severe. This condition may be difficult to identify without validation data, so validation research is recommended in identifying critical exposure time-windows.


title: Query-based Semantic Gaussian Field for Scene Representation in Reinforcement Learning

abstract: Latent scene representation plays a significant role in training reinforcement learning (RL) agents. To obtain good latent vectors describing the scenes, recent works incorporate the 3D-aware latent-conditioned NeRF pipeline into scene representation learning. However, these NeRF-related methods struggle to perceive 3D structural information due to the inefficient dense sampling in volumetric rendering. Moreover, they lack fine-grained semantic information included in their scene representation vectors because they evenly consider free and occupied spaces. Both of them can destroy the performance of downstream RL tasks. To address the above challenges, we propose a novel framework that adopts the efficient 3D Gaussian Splatting (3DGS) to learn 3D scene representation for the first time. In brief, we present the Query-based Generalizable 3DGS to bridge the 3DGS technique and scene representations with more geometrical awareness than those in NeRFs. Moreover, we present the Hierarchical Semantics Encoding to ground the fine-grained semantic features to 3D Gaussians and further distilled to the scene representation vectors. We conduct extensive experiments on two RL platforms including Maniskill2 and Robomimic across 10 different tasks. The results show that our method outperforms the other 5 baselines by a large margin. We achieve the best success rates on 8 tasks and the second-best on the other two tasks.


title: Values distribution of holomorphic curves on annuli into projective varieties with hypersurface targets

abstract: The purpose of this paper has twofold. The first is to establish a Cartan-Nochka theorem for holomorphic curves from annuli into projective varieties intersecting hypersurfaces in subgeneral position with truncated counting functions. The second is to give a second main theorem for such curves with arbitrary families of hypersurfaces, where the truncation level of the counting functions is explicitly estimated not depending on the number of hypersurfaces. As an application, we give a uniqueness theorem for such curves sharing a few hypersurfaces in a projective variety ignoring multiplicity. Our results generalize and improve the recent previous results in this topic.


title: Braided scalar quantum field theory

abstract: We formulate scalar field theories in a curved braided $L_\infty$-algebra formalism and analyse their correlation functions using Batalin-Vilkovisky quantization. We perform detailed calculations in cubic braided scalar field theory up to two-loop order and three-point multiplicity. The divergent tadpole contributions are eliminated by a suitable choice of central curvature for the $L_\infty$-structure, and we confirm the absence of UV/IR mixing. The calculations of higher loop and higher multiplicity correlators in homological perturbation theory are facilitated by the introduction of a novel diagrammatic calculus. We derive an algebraic version of the Schwinger-Dyson equations based on the homological perturbation lemma, and use them to prove the braided Wick theorem.


title: WST -- Widefield Spectroscopic Telescope: design of a new 12m class telescope dedicated to widefield Multi-object and Integral Field Spectroscopy

abstract: The Wide-Field Spectroscopic Telescope (WST) is a concept for a 12-m class seeing-limited telescope providing two concentric fields of view for simultaneous Multi-Object Spectroscopy and Integral Field Spectroscopy. The specified wavelength range is 0.35-1.6 microns. The baseline optical design relies on a corrected Cassegrain solution feeding Multi-Object spectrographs through fibres, while the central area of the field is propagated down to a gravity-stable Integral Field Station housing 144 spectrographs. The Cassegrain corrector also provides for atmospheric dispersion compensation. All optical components are within commercially available dimensions. With a view to minimizing risks and costs, to the maximum possible extent the telescope relies on proven subsystem solutions. An exception is the tip-tilt secondary mirror, which would likely have to provide some rejection of wind shake. An iteration of the optical design is ongoing, with a view to mitigating the weaknesses of the first baseline design. The telescope would be wavefront-controlled on-sky at the common-path MOS focus. Controls in the IFS path will need to compensate for the effect of subsequent differentials - wavefront and line of sight. There is no shortage of degrees of freedom and metrology solution to do so. The size of the dome is driven by the Nasmyth footprint and the height of the pier, which houses the IFS station. The baseline assumption is that a VLT-like enclosure would provide suitable shielding and ventilation.


title: Direct measurement of the viscocapillary lift force near a liquid interface

abstract: Lift force of viscous origin is widespread across disciplines, from mechanics to biology. Here, we present the first direct measurement of the lift force acting on a particle moving in a viscous fluid along the liquid interface that separates two liquids. The force arises from the coupling between the viscous flow induced by the particle motion and the capillary deformation of the interface. The measurements show that the lift force increases as the distance between the sphere and the interface decreases, reaching saturation at small distances. The experimental results are in good agreement with the model and numerical calculation developed within the framework of the soft lubrication theory.


title: Some aspects of the theory of nodal orders

abstract: In this paper, we elaborate ring theoretic properties of nodal orders. In particular, we prove that they are closed under taking crossed products with finite groups.


title: Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs

abstract: The growing popularity of Large Language Models has sparked interest in context compression for Large Language Models (LLMs). However, the performance of previous methods degrades dramatically as compression ratios increase, sometimes even falling to the closed-book level. This decline can be attributed to the loss of key information during the compression process. Our preliminary study supports this hypothesis, emphasizing the significance of retaining key information to maintain model performance under high compression ratios. As a result, we introduce Query-Guided Compressor (QGC), which leverages queries to guide the context compression process, effectively preserving key information within the compressed context. Additionally, we employ a dynamic compression strategy. We validate the effectiveness of our proposed QGC on the Question Answering task, including NaturalQuestions, TriviaQA, and HotpotQA datasets. Experimental results show that QGC can consistently perform well even at high compression ratios, which also offers significant benefits in terms of inference cost and throughput.


title: XRec: Large Language Models for Explainable Recommendation

abstract: Recommender systems help users navigate information overload by providing personalized recommendations aligned with their preferences. Collaborative Filtering (CF) is a widely adopted approach, but while advanced techniques like graph neural networks (GNNs) and self-supervised learning (SSL) have enhanced CF models for better user representations, they often lack the ability to provide explanations for the recommended items. Explainable recommendations aim to address this gap by offering transparency and insights into the recommendation decision-making process, enhancing users' understanding. This work leverages the language capabilities of Large Language Models (LLMs) to push the boundaries of explainable recommender systems. We introduce a model-agnostic framework called XRec, which enables LLMs to provide comprehensive explanations for user behaviors in recommender systems. By integrating collaborative signals and designing a lightweight collaborative adaptor, the framework empowers LLMs to understand complex patterns in user-item interactions and gain a deeper understanding of user preferences. Our extensive experiments demonstrate the effectiveness of XRec, showcasing its ability to generate comprehensive and meaningful explanations that outperform baseline approaches in explainable recommender systems. We open-source our model implementation at https://github.com/HKUDS/XRec.


title: On the Intrinsic Self-Correction Capability of LLMs: Uncertainty and Latent Concept

abstract: Large Language Models (LLMs) can improve their responses when instructed to do so, a capability known as self-correction. When these instructions lack specific details about the issues in the response, this is referred to as leveraging the intrinsic self-correction capability. The empirical success of self-correction can be found in various applications, e.g., text detoxification and social bias mitigation. However, leveraging this self-correction capability may not always be effective, as it has the potential to revise an initially correct response into an incorrect one. In this paper, we endeavor to understand how and why leveraging the self-correction capability is effective. We identify that appropriate instructions can guide LLMs to a convergence state, wherein additional self-correction steps do not yield further performance improvements. We empirically demonstrate that model uncertainty and activated latent concepts jointly characterize the effectiveness of self-correction. Furthermore, we provide a mathematical formulation indicating that the activated latent concept drives the convergence of the model uncertainty and self-correction performance. Our analysis can also be generalized to the self-correction behaviors observed in Vision-Language Models (VLMs). Moreover, we highlight that task-agnostic debiasing can benefit from our principle in terms of selecting effective fine-tuning samples. Such initial success demonstrates the potential extensibility for better instruction tuning and safety alignment.


title: Entanglement accelerates quantum simulation

abstract: Quantum entanglement is an essential feature of many-body systems that impacts both quantum information processing and fundamental physics. The growth of entanglement is a major challenge for classical simulation methods. In this work, we investigate the relationship between quantum entanglement and quantum simulation, showing that product-formula approximations can perform better for entangled systems. We establish a tighter upper bound for algorithmic error in terms of entanglement entropy and develop an adaptive simulation algorithm incorporating measurement gadgets to estimate the algorithmic error. This shows that entanglement is not only an obstacle to classical simulation, but also a feature that can accelerate quantum algorithms.


title: EUFCC-340K: A Faceted Hierarchical Dataset for Metadata Annotation in GLAM Collections

abstract: In this paper, we address the challenges of automatic metadata annotation in the domain of Galleries, Libraries, Archives, and Museums (GLAMs) by introducing a novel dataset, EUFCC340K, collected from the Europeana portal. Comprising over 340,000 images, the EUFCC340K dataset is organized across multiple facets: Materials, Object Types, Disciplines, and Subjects, following a hierarchical structure based on the Art & Architecture Thesaurus (AAT). We developed several baseline models, incorporating multiple heads on a ConvNeXT backbone for multi-label image tagging on these facets, and fine-tuning a CLIP model with our image text pairs. Our experiments to evaluate model robustness and generalization capabilities in two different test scenarios demonstrate the utility of the dataset in improving multi-label classification tools that have the potential to alleviate cataloging tasks in the cultural heritage sector.


title: Kirigami: large convolutional kernels improve deep learning-based RNA secondary structure prediction

abstract: We introduce a novel fully convolutional neural network (FCN) architecture for predicting the secondary structure of ribonucleic acid (RNA) molecules. Interpreting RNA structures as weighted graphs, we employ deep learning to estimate the probability of base pairing between nucleotide residues. Unique to our model are its massive 11-pixel kernels, which we argue provide a distinct advantage for FCNs on the specialized domain of RNA secondary structures. On a widely adopted, standardized test set comprised of 1,305 molecules, the accuracy of our method exceeds that of current state-of-the-art (SOTA) secondary structure prediction software, achieving a Matthews Correlation Coefficient (MCC) over 11-40% higher than that of other leading methods on overall structures and 58-400% higher on pseudoknots specifically.


title: Closed forms for spatiotemporal optical vortices and sagittal skyrmionic pulses

abstract: Spatiotemporal optical vortices (STOVs) are short pulses that present a vortex whose axis is perpendicular to the main propagation direction. We present analytic expressions for these pulses that satisfy exactly Maxwell's equation, by applying appropriate differential operators to complex focus pulses with Poisson-like frequency spectrum. We also provide a simple ray picture for understanding the deformation of these pulses under propagation. Finally, we use these solutions to propose a type of pulse with sagittal skyrmionic polarization distribution covering all states of transverse polarization.


title: Learning to Edit Visual Programs with Self-Supervision

abstract: We design a system that learns how to edit visual programs. Our edit network consumes a complete input program and a visual target. From this input, we task our network with predicting a local edit operation that could be applied to the input program to improve its similarity to the target. In order to apply this scheme for domains that lack program annotations, we develop a self-supervised learning approach that integrates this edit network into a bootstrapped finetuning loop along with a network that predicts entire programs in one-shot. Our joint finetuning scheme, when coupled with an inference procedure that initializes a population from the one-shot model and evolves members of this population with the edit network, helps to infer more accurate visual programs. Over multiple domains, we experimentally compare our method against the alternative of using only the one-shot model, and find that even under equal search-time budgets, our editing-based paradigm provides significant advantages.


title: Second-order optimality conditions for the sparse optimal control of nonviscous Cahn-Hilliard systems

abstract: In this paper we study the optimal control of an initial-boundary value problem for the classical nonviscous Cahn-Hilliard system with zero Neumann boundary conditions. Phase field systems of this type govern the evolution of diffusive phase transition processes with conserved order parameter. For such systems, optimal control problems have been studied in the past. We focus here on the situation when the cost functional of the optimal control problem contains a sparsity-enhancing nondifferentiable term like the L1-norm. For such cases, we establish first-order necessary and second-order sufficient optimality conditions for locally optimal controls, where in the approach to second-order sufficient conditions we employ a technique introduced by E. Casas, C. Ryll and F. Tr\"oltzsch in the paper [SIAM J. Control Optim. 53 (2015), 2168-2202]. The main novelty of this paper is that this method, which has recently been successfully applied to systems of viscous Cahn-Hilliard type, can be adapted also to the classical nonviscous case. Since in the case without viscosity the solutions to the state and adjoint systems turn out to be considerably less regular than in the viscous case, numerous additional technical difficulties have to be overcome, and additional conditions have to be imposed. In particular, we have to restrict ourselves to the case when the nonlinearity driving the phase separation is regular, while in the presence of a viscosity term also nonlinearities of logarithmic type turn could be admitted. In addition, the implicit function theorem, which was employed to establish the needed differentiability properties of the control-to-state operator in the viscous case, does not apply in our situation and has to be substituted by other arguments.


title: Low-Rank Adaption on Transformer-based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing Images

abstract: Deep learning models in satellite onboard enable real-time interpretation of remote sensing images, reducing the need for data transmission to the ground and conserving communication resources. As satellite numbers and observation frequencies increase, the demand for satellite onboard real-time image interpretation grows, highlighting the expanding importance and development of this technology. However, updating the extensive parameters of models deployed on the satellites for spaceborne object detection model is challenging due to the limitations of uplink bandwidth in wireless satellite communications. To address this issue, this paper proposes a method based on parameter-efficient fine-tuning technology with low-rank adaptation (LoRA) module. It involves training low-rank matrix parameters and integrating them with the original model's weight matrix through multiplication and summation, thereby fine-tuning the model parameters to adapt to new data distributions with minimal weight updates. The proposed method combines parameter-efficient fine-tuning with full fine-tuning in the parameter update strategy of the oriented object detection algorithm architecture. This strategy enables model performance improvements close to full fine-tuning effects with minimal parameter updates. In addition, low rank approximation is conducted to pick an optimal rank value for LoRA matrices. Extensive experiments verify the effectiveness of the proposed method. By fine-tuning and updating only 12.4$\%$ of the model's total parameters, it is able to achieve 97$\%$ to 100$\%$ of the performance of full fine-tuning models. Additionally, the reduced number of trainable parameters accelerates model training iterations and enhances the generalization and robustness of the oriented object detection model. The source code is available at: \url{https://github.com/fudanxu/LoRA-Det}.


title: Multifractality in monitored single-particle dynamics

abstract: We study multifractal properties in time evolution of a single particle subject to repeated measurements. For quantum systems, we consider circuit models consisting of local unitary gates and local projective measurements. For classical systems, we consider models for estimating the trajectory of a particle evolved under local transition processes by partially measuring particle occupations. In both cases, multifractal behaviors appear in the ensemble of wave functions or probability distributions conditioned on measurement outcomes after a sufficiently long time. While the nature of particle transport (diffusive or ballistic) qualitatively affects the multifractal properties, they are even quantitatively robust to the measurement rate or specific protocols. On the other hand, multifractality is generically lost by generalized measurements allowing erroneous outcomes or by postselection of the outcomes with no particle detection. We demonstrate these properties by numerical simulations and also propose several simplified models, which allow us to analytically obtain multifractal properties in the monitored single-particle systems.


title: A fast neural emulator for interstellar chemistry

abstract: Astrochemical models are important tools to interpret observations of molecular and atomic species in different environments. However, these models are time-consuming, precluding a thorough exploration of the parameter space, leading to uncertainties and biased results. Using neural networks to simulate the behavior of astrochemical models is a way to circumvent this problem, providing fast calculations that are based on real astrochemical models. In this paper, we present a fast neural emulator of the astrochemical code Nautilus based on conditional neural fields. The resulting model produces the abundance of 192 species for arbitrary times between 1 and 10$^7$ years. Uncertainties well below 0.2 dex are found for all species, while the computing time is of the order of 10$^4$ smaller than Nautilus. This will open up the possibility of performing much more complex forward models to better understand the physical properties of the interstellar medium. As an example of the power of these models, we ran a feature importance analysis on the electron abundance predicted by Nautilus. We found that the electron density is coupled to the initial sulphur abundance in a low density gas. Increasing the initial sulphur abundance from a depleted scenario to the cosmic abundance leads to an enhancement of an order of magnitude of the electron density. This enhancement can potentially influence the dynamics of the gas in star formation sites.


title: Spin-Orbit Locked Coupling of Localized Microwaves to Magnons

abstract: We address the photonic spin-orbit coupling known from nano-optics and plasmonics in the microwave regime. The transverse spin $\mathbf{S}$ and momentum $\mathbf{q}$ of microwaves emitted by an excited magnetic dot are locked by $\mathbf{q}\cdot\mathbf{S}=0$ with a fixed chirality $\hat{\mathbf{n}}\cdot(\hat{\bf S}\times\hat{\bf q})=1$ when evanescent along $\hat{\mathbf{n}}\perp {\bf q}$. This field excites magnons in a nearby magnetic film in the form of directional beams that rotate with the magnetization direction. The exchange of these magnons through a magnetic substrate leads to a highly tunable strong coupling and entanglement between two distant nanomagnets.


title: Role of surfactants on droplet formation in piezoacoustic inkjet printing across microsecond-to-second timescales

abstract: In piezo acoustic drop-on-demand inkjet printing a single droplet is produced for each piezo driving pulse. This droplet is typically multicomponent, including surfactants to control the spreading and drying of the droplet on the substrate. However, the role of these surfactants on the droplet formation process remains rather elusive. Surfactant concentration gradients may manifest across microsecond-to-second timescales, spanning both the rapid ejection of ink from the nozzle exit and the comparatively slower idling timescale governing the firing of successive droplets. In the present work, we study the influence of surfactants on droplet formation across 6 orders of magnitude in time. To this end, we visualize the microsecond droplet formation process using stroboscopic laser-induced fluorescence microscopy while we vary the nozzle idle time. Our results show that increasing the idle time up to O(1) s affects only the break-up dynamics of the inkjet but not its velocity. By contrast, for idle times $>$ O(1) s, both the break-up dynamics are altered and the velocity of the inkjet increases. We show that the increased velocity results from a decreased surface tension of the ejected droplet, which we extracted from the observed shape oscillations of the jetted droplets in flight. The measured decrease in surface tension is surprising as the $\mu$s timescale of droplet formation is much faster than the typical ms-to-s timescale of surfactant adsorption. By varying the bulk surfactant concentration, we show that the fast decrease in surface tension results from a local surfactant concentration increase to more than 200 times the CMC. Our results suggest that a local high concentration of surfactant allows for surfactant adsorption to the interface of an inkjet at the $\mu$s-to-ms timescale, which is much faster than the typical ms-to-s timescale of surfactant adsorption.


title: Utilizing Voronoi Tessellations to Determine Radial Density Profiles

abstract: We have developed a novel method of determining 2D radial density profiles for astronomical systems of discrete objects using Voronoi tessellations. This Voronoi-based method was tested against the standard annulus-based method on 5 simulated systems of objects, following known Hubble density profiles of varying parameters and sizes. It was found that the Voronoi-based method returned radial density fits with lower uncertainties on the fitting parameters across all 5 systems compared to the annulus-based method. The Voronoi-based method also consistently returned more accurate estimates of the total number of objects in each system than the annulus-based method, and this accuracy increased with increasing system size. Finally, the Voronoi-based method was applied to two observed globular cluster systems around brightest cluster galaxies ESO 444-G046 and 2MASX J13272961-3123237 and the results were compared to previous results for these galaxies obtained with the annulus-based method. Again, it was found that the Voronoi-based method returned fits with lower uncertainties on the fitting parameters, and the total number of globular clusters returned are within errors of the annulus-based method estimates, however also with lower uncertainties.


title: Demonstration of Erasure Conversion in a Molecular Tweezer Array

abstract: Programmable optical tweezer arrays of molecules are an emerging platform for quantum simulation and quantum information science. For these applications, reducing and mitigating errors that arise during initial state preparation and subsequent evolution remain major challenges. In this paper, we present work on site-resolved detection of internal state errors and quantum erasures, which are qubit errors with known locations. First, using a new site-resolved detection scheme, we demonstrate robust and enhanced tweezer array preparation fidelities. This enables creating molecular arrays with low defect rates, opening the door to high-fidelity simulation of quantum many-body systems. Second, for the first time in molecules, we demonstrate mid-circuit detection of erasures using a composite detection scheme that minimally affects error-free qubits. We also demonstrate mid-circuit conversion of blackbody-induced errors into detectable erasures. Our demonstration of erasure conversion, which has been shown to significantly reduce overheads for fault-tolerant quantum error correction, could be useful for quantum information processing in molecular tweezer arrays.


title: Note on $Spin(3,1)$ tensors, the Dirac field and $GL(k, \mathbb{R})$ symmetry

abstract: We show that the rank decomposition of a real matrix $r$, which is a $Spin(3,1)$ tensor, leads to $2k$ Majorana bispinors, where $k= rank\: r$. The Majorana bispinors are determined up to local $GL(k, \mathbb{R})$ transformations. The bispinors are combined in pairs to form $k$ complex Dirac fields. We analyze in detail the case $k=1$, in which there is just one Dirac field with the standard Lagrangian. The $GL(1, \mathbb{R})$ symmetry gives rise to a new conserved current, different from the well known $U(1)$ current. The $U(1)$ symmetry is present too. All global continuous internal symmetries in the $k=1$ case form the $SO(2,1)$ group. As a side result, we clarify the discussed in literature issue whether there exist algebraic constraints for the matrix $r$ which would be equivalent to the condition $rank\: r=1$.


title: Valley-dependent transport through graphene quantum dots due to proximity-induced, staggered spin-orbit couplings

abstract: We study a system composed of graphene decorated with an array of islands with C_3v symmetry that induce quantum dot (IQD) regions via proximity effects and give rise to several spin-orbit couplings (SOCs). We evaluate transport properties for an array of IQDs and analyze the conditions for realizing isolated valley conductances and valley-state localization. The resulting transmission shows a square-type behavior with wide gaps that can be tuned by adjusting the strength of the staggered intrinsic SOCs. Realistic proximity effects are characterized by weak SOC strengths, and the analysis of our results in this regime shows that the Rashba coupling is the important interaction controlling valley properties. As a consequence, a top gate voltage can be used to tune the valley polarization and switch the valley scattering for positive or negative incident energies. A proper choice of SOC strengths leads to higher localization of valley states around the linear array of IQDs. These systems can be implemented in heterostructures composed of graphene and semiconducting transition-metal dichalcogenides (TMDs) such as MoSe2, WSe2, MoS2, or WS2. In these setups, the magnitudes of induced SOCs depend on the twist angle, and due to broken valley degeneracy, valley-polarized currents at the edges can be generated in a controllable manner as well as localized valley states. Our findings suggest an alternative approach for producing valley-polarized currents and propose a corresponding mechanism for valley-dependent electron optics and optoelectronic devices.