title: SincVAE: a New Approach to Improve Anomaly Detection on EEG Data Using SincNet and Variational Autoencoder

abstract: Over the past few decades, electroencephalography (EEG) monitoring has become a pivotal tool for diagnosing neurological disorders, particularly for detecting seizures. Epilepsy, one of the most prevalent neurological diseases worldwide, affects approximately the 1 \% of the population. These patients face significant risks, underscoring the need for reliable, continuous seizure monitoring in daily life. Most of the techniques discussed in the literature rely on supervised Machine Learning (ML) methods. However, the challenge of accurately labeling variations in epileptic EEG waveforms complicates the use of these approaches. Additionally, the rarity of ictal events introduces an high imbalancing within the data, which could lead to poor prediction performance in supervised learning approaches. Instead, a semi-supervised approach allows to train the model only on data not containing seizures, thus avoiding the issues related to the data imbalancing. This work proposes a semi-supervised approach for detecting epileptic seizures from EEG data, utilizing a novel Deep Learning-based method called SincVAE. This proposal incorporates the learning of an ad-hoc array of bandpass filter as a first layer of a Variational Autoencoder (VAE), potentially eliminating the preprocessing stage where informative band frequencies are identified and isolated. Results indicate that SincVAE improves seizure detection in EEG data and is capable of identifying early seizures during the preictal stage as well as monitoring patients throughout the postictal stage.


title: SKD-TSTSAN: Three-Stream Temporal-Shift Attention Network Based on Self-Knowledge Distillation for Micro-Expression Recognition

abstract: Micro-expressions (MEs) are subtle facial movements that occur spontaneously when people try to conceal the real emotions. Micro-expression recognition (MER) is crucial in many fields, including criminal analysis and psychotherapy. However, MER is challenging since MEs have low intensity and ME datasets are small in size. To this end, a three-stream temporal-shift attention network based on self-knowledge distillation (SKD-TSTSAN) is proposed in this paper. Firstly, to address the low intensity of ME muscle movements, we utilize learning-based motion magnification modules to enhance the intensity of ME muscle movements. Secondly, we employ efficient channel attention (ECA) modules in the local-spatial stream to make the network focus on facial regions that are highly relevant to MEs. In addition, temporal shift modules (TSMs) are used in the dynamic-temporal stream, which enables temporal modeling with no additional parameters by mixing ME motion information from two different temporal domains. Furthermore, we introduce self-knowledge distillation (SKD) into the MER task by introducing auxiliary classifiers and using the deepest section of the network for supervision, encouraging all blocks to fully explore the features of the training set. Finally, extensive experiments are conducted on four ME datasets: CASME II, SAMM, MMEW, and CAS(ME)3. The experimental results demonstrate that our SKD-TSTSAN outperforms other existing methods and achieves new state-of-the-art performance. Our code will be available at https://github.com/GuanghaoZhu663/SKD-TSTSAN.


title: The influence of final state interactions in attosecond photoelectron interferometry

abstract: Fano resonances are ubiquitous phenomena appearing in many fields of physics, e.g. atomic or molecular photoionization, or electron transport in quantum dots. Recently, attosecond interferometric techniques have been used to measure the amplitude and phase of photoelectron wavepackets close to Fano resonances in argon and helium, allowing for the retrieval of the temporal dynamics of the photoionization process. In this work, we study the photoionization of argon atoms close to the $3s^13p^64p$ autoionizing state using an interferometric technique with high spectral resolution. The phase shows a monotonic $2{\pi}$ increase across the resonance or a sigmo\"idal less than ${\pi}$ variation depending on experimental conditions, e.g. the probe laser bandwidth. Using three different, state-of-the-art calculations, we show that the measured phase is influenced by the interaction between final states reached by two-photon transitions.


title: The SUPER excitation of quantum emitters is a multi-photon process

abstract: The swing-up of quantum emitter population (SUPER) scheme allows to populate the excited state of a quantum emitter with near-unity fidelity using two red-detuned laser pulses. Its off-resonant, yet fully coherent nature has attracted significant interest in quantum photonics as a valuable tool for preparing single-photon sources in their excited state on demand, while simultaneously ensuring straightforward spectral filtering of the laser. However, the physical understanding of this mechanism in terms of energy exchange between the electromagnetic field and the emitter is still lacking. Here, we present a fully quantized model of the swing-up excitation and demonstrate that it is in fact a multi-photon process, where one of the modes loses two or more photons while the other gains at least one. Our findings provide an unexpected physical interpretation of the SUPER scheme and unveil a new non-linear interaction between single emitters and multiple field modes.


title: Principal Component Clustering for Semantic Segmentation in Synthetic Data Generation

abstract: This technical report outlines our method for generating a synthetic dataset for semantic segmentation using a latent diffusion model. Our approach eliminates the need for additional models specifically trained on segmentation data and is part of our submission to the CVPR 2024 workshop challenge, entitled CVPR 2024 workshop challenge "SyntaGen Harnessing Generative Models for Synthetic Visual Datasets". Our methodology uses self-attentions to facilitate a novel head-wise semantic information condensation, thereby enabling the direct acquisition of class-agnostic image segmentation from the Stable Diffusion latents. Furthermore, we employ non-prompt-influencing cross-attentions from text to pixel, thus facilitating the classification of the previously generated masks. Finally, we propose a mask refinement step by using only the output image by Stable Diffusion.


title: CDQuant: Accurate Post-training Weight Quantization of Large Pre-trained Models using Greedy Coordinate Descent

abstract: Large language models (LLMs) have recently demonstrated remarkable performance across diverse language tasks. But their deployment is often constrained by their substantial computational and storage requirements. Quantization has emerged as a key technique for addressing this challenge, enabling the compression of large models with minimal impact on performance. The recent GPTQ algorithm, a post-training quantization (PTQ) method, has proven highly effective for compressing LLMs, sparking a wave of research that leverages GPTQ as a core component. Recognizing the pivotal role of GPTQ in the PTQ landscape, we introduce CDQuant, a simple and scalable alternative to GPTQ with improved performance. CDQuant uses coordinate descent to minimize the layer-wise reconstruction loss to achieve high-quality quantized weights. Our algorithm is easy to implement and scales efficiently to models with hundreds of billions of parameters. Through extensive evaluation on the PaLM2 model family, we demonstrate that CDQuant consistently outperforms GPTQ across diverse model sizes and quantization levels. In particular, for INT2 quantization of PaLM2-Otter, CDQuant achieves a 10% reduction in perplexity compared to GPTQ.


title: A microscopic approach to crystallization: challenging the classical/non-classical dichotomy

abstract: Recently, it was shown that a theoretical description of nucleation based on fluctuating hydrodynamics and classical density functional theory can be used to determine non-classical nucleation pathways for crystallization (Lutsko, Sci. Adv. 5, eaav7399 (2019)). The advantage of the approach is that it is free of any assumptions regarding order parameters and that requires no input other than molecular interaction potentials. We now extend this fundamental framework so as to describe the dynamics of non-classical nucleation. We use it to study the nucleation of both droplets and crystalline solids from a low-concentration solution of colloidal particles using two different interaction potentials. We find that the nucleation pathways of both droplets and crystals are remarkably similar at the early stages of nucleation until they diverge due to a rapid ordering along the solid pathways in line with the paradigm of "non-classical" crystallization. We compute the unstable modes at the critical clusters and find that despite the non-classical nature of solid nucleation, the size of the nucleating clusters remains the principle order parameter in all cases supporting a "classical" description of the {\it dynamics} of crystallization. We show that nucleation rates can be extracted from our formalism in a systematic way. Our results suggest that in some cases, despite the non-classical nature of the nucleation pathways, classical nucleation theory can give reasonable results for solids but that there are circumstances where it may fail. This contributes a nuanced perspective to recent experimental and simulation work suggesting that important aspects of crystal nucleation can be described within a classical framework.


title: Diophantine approximation with a quaternary problem

abstract: Let $1<k<7/6$, $\lambda_1,\lambda_2,\lambda_3$ and $\lambda_4$ be non-zero real numbers, not all of the same sign such that $\lambda_1/\lambda_2$ is irrational and let $\omega$ be a real number. We prove that the inequality $|\lambda_1p_1^2+\lambda_2p_2^2+\lambda_3p_3^2+\lambda_4p_4^k-\omega|\le (\max_j p_j)^{-\frac{7-6k}{14k}+\varepsilon}$ has infinitely many solutions in prime variables $p_1,p_2,p_3,p_4$ for any $\varepsilon>0$.


title: Accelerated creation of NOON states with ultracold atoms via counterdiabatic driving

abstract: A quantum control protocol is proposed for the creation of NOON states with N ultracold bosonic atoms on two modes, corresponding to the coherent superposition $\vert N,0\rangle + \vert 0,N\rangle$. This state can be prepared by using a third mode where all bosons are initially placed and which is symmetrically coupled to the two other modes. Tuning the energy of this third mode across the energy level of the other modes allows the adiabatic creation of the NOON state. While this process normally takes too much time to be of practical usefulness, due to the smallness of the involved spectral gap, it can be drastically boosted through counterdiabatic driving which allows for efficient gap engineering. We demonstrate that this process can be implemented in terms of static parameter adaptations that are experimentally feasible with ultracold quantum gases. Gain factors in the required protocol speed are obtained that increase exponentially with the number of involved atoms and thus counterbalance the exponentially slow collective tunneling process underlying this adiabatic transition.


title: Spin waves and three-dimensionality in the high-pressure antiferromagnetic phase of SrCu$_2$(BO$_3$)$_2$

abstract: Quantum magnetic materials can provide explicit realizations of paradigm models in quantum many-body physics. In this context, SrCu$_2$(BO$_3$)$_2$ is a faithful realization of the Shastry-Sutherland model (SSM) for ideally frustrated spin dimers, even displaying several of its quantum magnetic phases as a function of pressure. We perform inelastic neutron scattering (INS) measurements on SrCu$_2$(BO$_3$)$_2$ at 5.5 GPa and 4.5 K, observing spin waves that characterize the high-pressure antiferromagnetic phase. The experimental spectra are well described by linear spin-wave calculations on a SSM with an inter-layer interaction, which is determined accurately as $J_c = 0.053(3)$ meV. The presence of $J_c$ indicates the need to account for the three-dimensional nature of SrCu$_2$(BO$_3$)$_2$ in theoretical models, also at lower pressures. We find that the ratio between in-plane interactions, $J'/J = 1.8(2)$, undergoes a dramatic change compared to lower pressures that we deduce is driven by a sharp drop in the dimer coupling, $J$. Our results underline the wide horizons opened by high-pressure INS experiments on quantum magnetic materials.


title: Detection of Synthetic Face Images: Accuracy, Robustness, Generalization

abstract: An experimental study on detecting synthetic face images is presented. We collected a dataset, called FF5, of five fake face image generators, including recent diffusion models. We find that a simple model trained on a specific image generator can achieve near-perfect accuracy in separating synthetic and real images. The model handles common image distortions (reduced resolution, compression) by using data augmentation. Moreover, partial manipulations, where synthetic images are blended into real ones by inpainting, are identified and the area of the manipulation is localized by a simple model of YOLO architecture. However, the model turned out to be vulnerable to adversarial attacks and does not generalize to unseen generators. Failure to generalize to detect images produced by a newer generator also occurs for recent state-of-the-art methods, which we tested on Realistic Vision, a fine-tuned version of StabilityAI's Stable Diffusion image generator.


title: Laminator: Verifiable ML Property Cards using Hardware-assisted Attestations

abstract: Regulations increasingly call for various assurances from machine learning (ML) model providers about their training data, training process, and the behavior of resulting models during inference. For better transparency, companies (e.g., Huggingface and Google) have adopted model cards and datasheets which describe different properties of the training datasets and models. In the same vein, we introduce the notion of an inference card to describe the properties of a given inference (e.g., binding output to the model and its corresponding input). We collectively refer to these as ML property cards. A malicious model provider can include false information in ML property cards, raising a need for verifiable ML property cards. We show how to realized them using property attestation, technical mechanisms by which a prover (e.g., a model provider) can attest different ML properties during training and inference to a verifier (e.g., an auditor). However, prior attestation mechanisms based purely on cryptography are often narrowly focused (lacking versatility) and inefficient. There is a need to efficiently attest different types properties across the ML model training and inference pipeline. Recent developments make it possible to run and even train models inside hardware-assisted trusted execution environments (TEEs), which can provide highly efficient attestation. We propose Laminator, the first framework for verifiable ML property cards using hardware-assisted ML property attestations to efficiently furnish attestations for various ML properties for training and inference. It scales to multiple verifiers, and is independent of the model configuration.


title: General Guide Concepts for Compact, High-Brilliance Neutron Moderators

abstract: The trend in neutron sciences is toward integrating compact, high-brightness moderators into new or upgraded facilities. Transporting neutrons from the source to the sample position with a phase-space distribution tailored to specific requirements is crucial to leverage high source brilliance. We have investigated four guide concepts using Monte Carlo ray tracing simulations: Montel beamline with nested Kirkpatrick-Baez mirrors, curved-tapered beamline with a bender and straight sections, straight-elliptical beamline, and curved-elliptical beamline. The straight-elliptical (curved-elliptical) beamline features two half-ellipse guides connected by a straight (non-straight) guide section. The neutron transport efficiency and phase space homogeneity have been quantitatively compared. Our results show that the straight-elliptical beamline performs best because of few neutron bounces on the guide surface with small reflection angles, minimizing flux loss. The Montel beamline provides the best spatial confinement of neutrons within the desired region; however, there is a high thermal-neutron loss due to large reflection angles. The curved-tapered beamline suffers from significant flux loss due to high bounces, and it shows a non-uniform angular distribution related to broad ranges of bounces and reflection angles. The non-straight guide section of the curved-elliptical beamline increases phase space inhomogeneity, leading to a spatially non-uniform beam profile. The results apply to general neutron instruments that require transporting thermal and cold neutrons from a compact, high-brilliance moderator to the sample location with a moderate phase-space volume.


title: Anisotropic Brownian particles under resetting

abstract: We study analytically the dynamics of an anisotropic particle subjected to different stochastic resetting schemes in two dimensions. The Brownian motion of shape-asymmetric particles in two dimensions results in anisotropic diffusion at short times, while the late-time transport is isotropic due to rotational diffusion. We show that the presence of orientational resetting promotes the anisotropy to late times. When the spatial (i.e. translational) degrees of freedom are reset, we find that a non-trivial spatial probability distribution emerges in the steady state that is determined by the initial orientation, particle asymmetry and the resetting rate. When only spatial degrees of freedom are reset while the orientational degree of freedom is allowed to evolve freely, the steady state is independent of the particle asymmetry. When only particle orientation is reset, the late-time probability density is given by a Gaussian with an effective diffusion tensor, including off-diagonal terms, determined by the resetting rate. Generally, the coupling between the translational and rotational degrees of freedom, when combined with stochastic resetting, gives rise to unique behaviour at late times not present in the case of symmetric particles. Considering recent developments in experimental implementations of resetting, our results can be useful for the control of asymmetric colloids, for example in self-assembly processes.


title: Sharing tripartite nonlocality sequentially using only projective measurements

abstract: Bell nonlocality is a valuable resource in quantum information processing tasks. Scientists are interested in whether a single entangled state can generate a long sequence of nonlocal correlations. Previous work has accomplished sequential tripartite nonlocality sharing through unsharp measurements. In this paper, we investigate the sharing of tripartite nonlocality using only projective measurements and sharing classical randomness. For the generalized GHZ state, we have demonstrated that using unbiased measurement choices, two Charlies can share the standard tripartite nonlocality with a single Alice and a single Bob, while at most one Charlie can share the genuine tripartite nonlocality with a single Alice and a single Bob. However, with biased measurement choices, the number of Charlies sharing the genuine tripartite nonlocality can be increased to two. Nonetheless, we find that using biased measurements does not increase the number of sequential observers sharing the standard tripartite nonlocality. Moreover, we provide the feasible range of double violation for the parameters of the measurement combination probability with respect to the state.


title: A Weighted-Median Model of Opinion Dynamics on Networks

abstract: Social interactions influence people's opinions. In some situations, these interactions result in a consensus opinion; in others, they result in opinion fragmentation and the formation of different opinion groups in the form of "echo chambers". Consider a social network of individuals, who hold continuous-valued scalar opinions and change their opinions when they interact with each other. In such an opinion model, it is common for an opinion-update rule to depend on the mean opinion of interacting individuals. However, we consider an alternative update rule - which may be more realistic in some situations - that instead depends on a weighted median opinion of interacting individuals. Through numerical simulations of our opinion model, we investigate how the limit opinion distribution depends on network structure. For configuration-model networks, we also derive a mean-field approximation for the asymptotic dynamics of the opinion distribution when there are infinitely many individuals in a network.


title: Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft

abstract: In the Minecraft Collaborative Building Task, two players collaborate: an Architect (A) provides instructions to a Builder (B) to assemble a specified structure using 3D blocks. In this work, we investigate the use of large language models (LLMs) to predict the sequence of actions taken by the Builder. Leveraging LLMs' in-context learning abilities, we use few-shot prompting techniques, that significantly improve performance over baseline methods. Additionally, we present a detailed analysis of the gaps in performance for future work


title: Security-Aware Availability Modeling of a 5G-MEC System

abstract: Multi-access Edge Computing (MEC) is an essential technology for the fifth generation (5G) of mobile networks. MEC enables low-latency services by bringing computing resources close to the end-users. The integration of 5G and MEC technologies provides a favorable platform for a wide range of applications, including various mission-critical applications, such as smart grids, industrial internet, and telemedicine, which require high dependability and security. Ensuring both security and dependability is a complex and critical task, and not achieving the necessary goals can lead to severe consequences. Joint modeling can help to assess and achieve the necessary requirements. Under these motivations, we propose an extension of a two-level availability model for a 5G-MEC system. In comparison to the existing work, our extended model (i) includes the failure of the connectivity between the 5G-MEC elements and (ii) considers attacks against the 5G-MEC elements or their interconnection. We implement and run the model in M\"{o}bius. The results show that a three-element redundancy, especially of the management and core elements, is needed and still enough to reach around 4-nines availability even when connectivity and security are considered. Moreover, the evaluation shows that slow detection of attacks, slow recovery from attacks, and bad connectivity are the most significant factors that influence the overall system availability.


A response to commenter Ke Lan's comment on our paper published in Nature Communications (2023)14:5782 by J. Yan et al


title: Modularity Based Community Detection in Hypergraphs

abstract: In this paper, we propose a scalable community detection algorithm using hypergraph modularity function, h-Louvain. It is an adaptation of the classical Louvain algorithm in the context of hypergraphs. We observe that a direct application of the Louvain algorithm to optimize the hypergraph modularity function often fails to find meaningful communities. We propose a solution to this issue by adjusting the initial stage of the algorithm via carefully and dynamically tuned linear combination of the graph modularity function of the corresponding two-section graph and the desired hypergraph modularity function. The process is guided by Bayesian optimization of the hyper-parameters of the proposed procedure. Various experiments on synthetic as well as real-world networks are performed showing that this process yields improved results in various regimes.


title: The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

abstract: The performance of a large language model (LLM) depends heavily on the quality and size of its pretraining dataset. However, the pretraining datasets for state-of-the-art open LLMs like Llama 3 and Mixtral are not publicly available and very little is known about how they were created. In this work, we introduce FineWeb, a 15-trillion token dataset derived from 96 Common Crawl snapshots that produces better-performing LLMs than other open pretraining datasets. To advance the understanding of how best to curate high-quality pretraining datasets, we carefully document and ablate all of the design choices used in FineWeb, including in-depth investigations of deduplication and filtering strategies. In addition, we introduce FineWeb-Edu, a 1.3-trillion token collection of educational text filtered from FineWeb. LLMs pretrained on FineWeb-Edu exhibit dramatically better performance on knowledge- and reasoning-intensive benchmarks like MMLU and ARC. Along with our datasets, we publicly release our data curation codebase and all of the models trained during our ablation experiments.


title: Electronic spin susceptibility in metallic strontium titanate

abstract: Metallic strontium titanate (SrTiO$_3$) is known to have both normal-state and superconducting properties that vary strongly over a wide range of charge carrier densities. This indicates the importance of nonlinear dynamics, and has hindered the development of a clear qualitative description of the observed behaviour. A major challenge is to understand how the charge carriers themselves evolve with doping and temperature, with possible polaronic effects and evidence of an effective mass that strongly increases with temperature. Here we use $^{47,49}$Ti nuclear magnetic resonance (NMR) to perform a comprehensive study of the electronic spin susceptibility in the dilute metallic state of strontium titanate across the doping-temperature phase diagram. We find a temperature-dependent Knight shift that can be quantitatively understood within a non-degenerate Fermi gas model that fully takes into account the complex band structure of SrTiO$_3$. Our data are consistent with a temperature-independent effective mass, and we show that the behavior of the spin susceptibility is universal in a wide range of temperatures and carrier concentrations. These results provide a microscopic foundation for the understanding of the properties of the unconventional low-density metallic state in strontium titanate and related materials.


title: Minimal Interaction Edge Tuning: A New Paradigm for Visual Adaptation

abstract: The rapid scaling of large vision pretrained models makes fine-tuning tasks more and more difficult on edge devices with low computational resources. We explore a new visual adaptation paradigm called edge tuning, which treats large pretrained models as standalone feature extractors that run on powerful cloud servers. The fine-tuning carries out on edge devices with small networks which require low computational resources. Existing methods that are potentially suitable for our edge tuning paradigm are discussed. But, three major drawbacks hinder their application in edge tuning: low adaptation capability, large adapter network, and high information transfer overhead. To address these issues, we propose Minimal Interaction Edge Tuning, or MIET, which reveals that the sum of intermediate features from pretrained models not only has minimal information transfer but also has high adaptation capability. With a lightweight attention-based adaptor network, MIET achieves information transfer efficiency, parameter efficiency, computational and memory efficiency, and at the same time demonstrates competitive results on various visual adaptation benchmarks.


title: Null Lagrangians in Schwarzian mechanics

abstract: In addition to standard and non-standard Lagrangians of classical mechanics, we consider, in this work, null Lagrangians that (i) identically satisfy the Euler-Lagrange equation and at the same time can be expressed as (ii) the total derivative of some scalar function. As an addendum to the properties in (i) and (ii) we find that null Lagrangians are also characterized by (iii) vanishing energy functions or Jacobi integrals. By working with higher-order SL(2;R) invariant Schwarzian derivatives introduced recently by Krivonos we demonstrate that these Schwarzians, especially the even-order ones, provide a natural basis to introduce higher-order null Lagrangians in Schwarzian mechanics.


title: Improving density matrix electronic structure method by deep learning

abstract: The combination of deep learning and ab initio materials calculations is emerging as a trending frontier of materials science research, with deep-learning density functional theory (DFT) electronic structure being particularly promising. In this work, we introduce a neural-network method for modeling the DFT density matrix, a fundamental yet previously unexplored quantity in deep-learning electronic structure. Utilizing an advanced neural network framework that leverages the nearsightedness and equivariance properties of the density matrix, the method demonstrates high accuracy and excellent generalizability in multiple example studies, as well as capability to precisely predict charge density and reproduce other electronic structure properties. Given the pivotal role of the density matrix in DFT as well as other computational methods, the current research introduces a novel approach to the deep-learning study of electronic structure properties, opening up new opportunities for deep-learning enhanced computational materials study.


title: Low Excess Noise, High Quantum Efficiency Avalanche Photodiodes for Beyond 2 {\mu}m Wavelength Detection

abstract: The increasing concentration of greenhouse gases, notably CH4 and CO2, has fueled global temperature increases, intensifying concerns regarding the prevailing climate crisis. Effectively monitoring these gases demands a detector spanning the extended short-wavelength infrared (~2.4 {\mu}m) range, covering wavelengths of CH4 (1.65 {\mu}m) and CO2 (2.05 {\mu}m). The state-of-the-art HgCdTe avalanche photodetectors (APDs) offer exceptional performance metrics, including high gain (M) and low excess noise (F). However, their widespread adoption is hindered by inherent challenges such as manufacturability, reproducibility, and cost factors. Moreover, their reliance on cryogenic cooling adds to the cost, size, weight, and power of the system. We have demonstrated a linear mode APD combining an InGaAs/GaAsSb type-II superlattice absorber and an AlGaAsSb multiplier lattice matched to InP substrates. This APD has demonstrated a room temperature M of 178, a maximum measurable external quantum efficiency of 3560 % at 2 {\mu}m, an extremely low excess noise (F < 2 at M < 20), and a small temperature coefficient of breakdown (7.58 mV/K {\mu}m). Such a high performance APD with manufacturable semiconductor materials could lead to a rapid transition to a commercial III-V foundry, holding the promise of revolutionizing high-sensitivity receivers for greenhouse gas monitoring.


title: Multi-property Steering of Large Language Models with Dynamic Activation Composition

abstract: Activation steering methods were shown to be effective in conditioning language model generation by additively intervening over models' intermediate representations. However, the evaluation of these techniques has so far been limited to single conditioning properties and synthetic settings. In this work, we conduct a comprehensive evaluation of various activation steering strategies, highlighting the property-dependent nature of optimal parameters to ensure a robust effect throughout generation. To address this issue, we propose Dynamic Activation Composition, an information-theoretic approach to modulate the steering intensity of one or more properties throughout generation. Our experiments on multi-property steering show that our method successfully maintains high conditioning while minimizing the impact of conditioning on generation fluency.


title: From the Lagrange Triangle to the Figure Eight Choreography: Proof of Marchal's Conjecture

abstract: For the three body problem with equal masses, we prove that the most symmetric continuation class of Lagrange's equilateral triangle solution, also referred to as the $P_{12}$ family of Marchal, contains the remarkable figure eight choreography discovered by Moore in 1993, and proven to exist by Chenciner and Montgomery in 2000. This settles a conjecture of Marchal which dates back to the 1999 conference on Celestial Mechanics in Evanston Illinois, celebrating Donald Saari's 60th birthday.


title: MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool

abstract: Large language model (LLM) serving has transformed from stateless to stateful systems, utilizing techniques like context caching and disaggregated inference. These optimizations extend the lifespan and domain of the KV cache, necessitating a new architectural approach. We present MemServe, a unified system that integrates both inter-request and intra-request optimizations. MemServe introduces MemPool, an elastic memory pool managing distributed memory and KV caches across serving instances. Using MemPool APIs, MemServe combines context caching with disaggregated inference for the first time, supported by a global scheduler that enhances cache reuse through a global prompt tree-based locality-aware policy. Tests show that MemServe significantly improves job completion time and time-to-first-time.


title: FrenchToxicityPrompts: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts

abstract: Large language models (LLMs) are increasingly popular but are also prone to generating bias, toxic or harmful language, which can have detrimental effects on individuals and communities. Although most efforts is put to assess and mitigate toxicity in generated content, it is primarily concentrated on English, while it's essential to consider other languages as well. For addressing this issue, we create and release FrenchToxicityPrompts, a dataset of 50K naturally occurring French prompts and their continuations, annotated with toxicity scores from a widely used toxicity classifier. We evaluate 14 different models from four prevalent open-sourced families of LLMs against our dataset to assess their potential toxicity across various dimensions. We hope that our contribution will foster future research on toxicity detection and mitigation beyond Englis


title: Transfer Learning for High Dimensional Robust Regression

abstract: Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic variance or inhomogeneous covariate effects. To solve this problem, this paper proposes a robust transfer learning based on the Huber regression, specifically designed for scenarios where the transferable source data set is known. This method effectively mitigates the impact of data heteroscedasticity, leading to improvements in estimation and prediction accuracy. Moreover, when the transferable source data set is unknown, the paper introduces an efficient detection algorithm to identify informative sources. The effectiveness of the proposed method is proved through numerical simulation and empirical analysis using superconductor data.


title: Perspective on Majorana bound-states in hybrid superconductor-semiconductor nanowires

abstract: Topological quantum computing and Majorana bound states were initially theorized between 2000 and 2010. These concepts gradually transitioned to practical implementations during the subsequent decade (2010-2020). Various directions have been investigated with mixed success. With respect to hybrid superconductor-semiconductor devices, great progress has been achieved in the larger area of mesoscopic superconductivity. Firm evidence for a topological phase in hybrid 1D nanowires, however, has not been demonstrated. Now, in the third decade, the lack of definitive topological results prompts a reevaluation. As an active participant, I have witnessed phases of hope, exuberance, and a return to realism and taking a step back. This Perspective provides a personal account of the past decade, my view on the current situation and challenges ahead. I assume the reader is familiar with the subject at the level of, e.g. the review by Prada et al. [1] from which I repeat as little as possible and refer to the extensive reference list for a comprehensive overview. The purpose of this Perspective is to share personal experiences and motivations.


title: Characterising transport in a quantum gas by measuring Drude weights

abstract: Transport properties play a crucial role in defining materials as insulators, metals, or superconductors. A fundamental parameter in this regard is the Drude weight, which quantify the ballistic transport of charge carriers. In this work, we measure the Drude weights of an ultracold gas of interacting bosonic atoms confined to one dimension, characterising the induced atomic and energy currents in response to perturbations with an external potential. We induce currents through two distinct experimental protocols; by applying a constant force to the gas, and by joining two subsystems prepared in different equilibrium states. By virtue of integrability, dynamics of the system is governed by ballistically propagating, long-lived quasi-particle excitations, whereby Drude weights almost fully characterise large-scale transport. Indeed, our results align with predictions from a recently developed hydrodynamic theory, demonstrating almost fully dissipationless transport, even at finite temperatures and interactions. These findings not only provide experimental validation of the hydrodynamic predictions but also offer methodologies applicable to various condensed matter systems, facilitating further studies on the transport properties of strongly correlated quantum matter.


title: Thermocavitation in gold-coated microchannels for needle-free jet injection

abstract: Continuous-wave lasers generated bubbles in microfluidic channels are proposed for applications such as needle-free jet injection due to their small size and affordable price of these lasers. However, water is transparent in the visible and near-IR regime, where the affordable diode lasers operate. Therefore a dye is required for absorption, which is often unwanted in thermocavitation applications such as vaccines or cosmetics. In this work we explore a different mechanism of the absorption of optical energy. The microfluidic channel wall is partially covered with a thin gold layer which absorbs light from a blue laser diode. This surface absorption is compared with the conventional volumetric absorption by a red dye. The results show that this surface absorption can be used to generate bubbles without the requirement of a dye. However, the generated bubbles are smaller and grow slower when compared to the dye-generated bubbles. Furthermore, heat dissipation in the glass channel walls affect the overall efficiency. Finally, degradation of the gold layer over time reduces the reproducibility and limits its lifetime. Further experiments and simulations are proposed to potentially solve these problems and optimize the bubble formation. Our findings can inform the design and operation of microfluidic devices used in phase transition experiments and other cavitation phenomena, such as jet injectors or liquid dispensing for bio-engineering.


title: Causal Responder Detection

abstract: We introduce the causal responders detection (CARD), a novel method for responder analysis that identifies treated subjects who significantly respond to a treatment. Leveraging recent advances in conformal prediction, CARD employs machine learning techniques to accurately identify responders while controlling the false discovery rate in finite sample sizes. Additionally, we incorporate a propensity score adjustment to mitigate bias arising from non-random treatment allocation, enhancing the robustness of our method in observational settings. Simulation studies demonstrate that CARD effectively detects responders with high power in diverse scenarios.


title: Ranking nodes in bipartite systems with a non-linear iterative map

abstract: This paper introduces a method based on a non-linear iterative map to evaluate node relevance in bipartite networks. By tuning a single parameter gamma, the method captures different concepts of node importance, including established measures like degree centrality, eigenvector centrality and the fitness-complexity ranking used in economics. The algorithm's flexibility allows for efficient ranking optimization tailored to specific tasks. As an illustrative example, we apply this method to ecological mutualistic networks, where ranking quality can be assessed by the extinction area - the rate at which the system collapses when species are removed in a certain order. The map with the optimal gamma value, which is dataset-specific, surpasses existing ranking methods on this task. Additionally, our method excels in evaluating nestedness, another crucial structural property of ecological systems, requiring specific node rankings. The final part of the paper explores the theoretical aspects of the map, revealing a phase transition at a critical $\gamma$ value dependent on the data structure that can be characterized analytically for random networks. Near the critical point, the map exhibits unique features and a distinctive triangular packing pattern of the adjacency matrix.


title: Moir\'e lattice of twisted bilayer graphene as template for non-covalent functionalization

abstract: We present a novel approach to achieve spatial variations in the degree of non-covalent functionalization of twisted bilayer graphene (tBLG). The tBLG with twist angles varying between ~ 5{\deg} and 7{\deg} was non-covalently functionalized with 1,4,5,8,9,11-hexaazatriphenylenehexacarbonitrile (HATCN) molecules. Our results show a correlation between the degree of functionalization and the twist angle of tBLG. This correlation was determined through Raman spectroscopy, where areas with larger twist angles exhibited a lower HATCN peak intensity compared to areas with smaller twist angles. We suggest that the HATCN adsorption follows the moir\'e pattern of tBLG by avoiding AA-stacked areas and attach predominantly to areas with a local AB-stacking order of tBLG, forming an overall ABA-stacking configuration. This is supported by density functional theory (DFT) calculations. Our work highlights the role of the moir\'e lattice in controlling the non-covalent functionalization of tBLG. Our approach can be generalized for designing nanoscale patterns on two-dimensional (2D) materials using moir\'e structures as a template.


title: Beyond Text-to-SQL for IoT Defense: A Comprehensive Framework for Querying and Classifying IoT Threats

abstract: Recognizing the promise of natural language interfaces to databases, prior studies have emphasized the development of text-to-SQL systems. While substantial progress has been made in this field, existing research has concentrated on generating SQL statements from text queries. The broader challenge, however, lies in inferring new information about the returned data. Our research makes two major contributions to address this gap. First, we introduce a novel Internet-of-Things (IoT) text-to-SQL dataset comprising 10,985 text-SQL pairs and 239,398 rows of network traffic activity. The dataset contains additional query types limited in prior text-to-SQL datasets, notably temporal-related queries. Our dataset is sourced from a smart building's IoT ecosystem exploring sensor read and network traffic data. Second, our dataset allows two-stage processing, where the returned data (network traffic) from a generated SQL can be categorized as malicious or not. Our results show that joint training to query and infer information about the data can improve overall text-to-SQL performance, nearly matching substantially larger models. We also show that current large language models (e.g., GPT3.5) struggle to infer new information about returned data, thus our dataset provides a novel test bed for integrating complex domain-specific reasoning into LLMs.


title: Toward Universal Medical Image Registration via Sharpness-Aware Meta-Continual Learning

abstract: Current deep learning approaches in medical image registration usually face the challenges of distribution shift and data collection, hindering real-world deployment. In contrast, universal medical image registration aims to perform registration on a wide range of clinically relevant tasks simultaneously, thus having tremendous potential for clinical applications. In this paper, we present the first attempt to achieve the goal of universal 3D medical image registration in sequential learning scenarios by proposing a continual learning method. Specifically, we utilize meta-learning with experience replay to mitigating the problem of catastrophic forgetting. To promote the generalizability of meta-continual learning, we further propose sharpness-aware meta-continual learning (SAMCL). We validate the effectiveness of our method on four datasets in a continual learning setup, including brain MR, abdomen CT, lung CT, and abdomen MR-CT image pairs. Results have shown the potential of SAMCL in realizing universal image registration, which performs better than or on par with vanilla sequential or centralized multi-task training strategies.The source code will be available from https://github.com/xzluo97/Continual-Reg.


title: Leveraging Reinforcement Learning in Red Teaming for Advanced Ransomware Attack Simulations

abstract: Ransomware presents a significant and increasing threat to individuals and organizations by encrypting their systems and not releasing them until a large fee has been extracted. To bolster preparedness against potential attacks, organizations commonly conduct red teaming exercises, which involve simulated attacks to assess existing security measures. This paper proposes a novel approach utilizing reinforcement learning (RL) to simulate ransomware attacks. By training an RL agent in a simulated environment mirroring real-world networks, effective attack strategies can be learned quickly, significantly streamlining traditional, manual penetration testing processes. The attack pathways revealed by the RL agent can provide valuable insights to the defense team, helping them identify network weak points and develop more resilient defensive measures. Experimental results on a 152-host example network confirm the effectiveness of the proposed approach, demonstrating the RL agent's capability to discover and orchestrate attacks on high-value targets while evading honeyfiles (decoy files strategically placed to detect unauthorized access).


title: Advancing Cell Detection in Anterior Segment Optical Coherence Tomography Images

abstract: Anterior uveitis, a common form of eye inflammation, can lead to permanent vision loss if not promptly diagnosed. Monitoring this condition involves quantifying inflammatory cells in the anterior chamber (AC) of the eye, which can be captured using Anterior Segment Optical Coherence Tomography (AS-OCT). However, manually identifying cells in AS-OCT images is time-consuming and subjective. Moreover, existing automated approaches may have limitations in both the effectiveness of detecting cells and the reliability of their detection results. To address these challenges, we propose an automated framework to detect cells in the AS-OCT images. This framework consists of a zero-shot chamber segmentation module and a cell detection module. The first module segments the AC area in the image without requiring human-annotated training data. Subsequently, the second module identifies individual cells within the segmented AC region. Through experiments, our framework demonstrates superior performance compared to current state-of-the-art methods for both AC segmentation and cell detection tasks. Notably, we find that previous cell detection approaches could suffer from low recall, potentially overlooking a significant number of cells. In contrast, our framework offers an improved solution, which could benefit the diagnosis and study of anterior uveitis. Our code for cell detection is publicly available at: https://github.com/joeybyc/cell_detection.


title: Sparse-view Signal-domain Photoacoustic Tomography Reconstruction Method Based on Neural Representation

abstract: Photoacoustic tomography is a hybrid biomedical technology, which combines the advantages of acoustic and optical imaging. However, for the conventional image reconstruction method, the image quality is affected obviously by artifacts under the condition of sparse sampling. in this paper, a novel model-based sparse reconstruction method via implicit neural representation was proposed for improving the image quality reconstructed from sparse data. Specially, the initial acoustic pressure distribution was modeled as a continuous function of spatial coordinates, and parameterized by a multi-layer perceptron. The weights of multi-layer perceptron were determined by training the network in self-supervised manner. And the total variation regularization term was used to offer the prior knowledge. We compared our result with some ablation studies, and the results show that out method outperforms existing methods on simulation and experimental data. Under the sparse sampling condition, our method can suppress the artifacts and avoid the ill-posed problem effectively, which reconstruct images with higher signal-to-noise ratio and contrast-to-noise ratio than traditional methods. The high-quality results for sparse data make the proposed method hold the potential for further decreasing the hardware cost of photoacoustic tomography system.


title: Preserving and Increasing Symmetries of Polyhedral Maps

abstract: In this article we investigate the question which local symmetry preserving operations can not only preserve, but also increase the symmetry of a polyhedral map. Often operations that can increase symmetry, can nevertheless not do so for polyhedral maps of every genus. So for maps that can increase symmetry, we also investigate for which genera they can do so. We give complete answers for operations with inflation factor at most 6 (that is: that increase the number of edges by a factor of at most 6) and for the chemically relevant Goldberg-Coxeter operations and the leapfrog operation.


title: Experimental Evaluation of Distributed k-Core Decomposition

abstract: Given an undirected graph, the $k$-core is a subgraph in which each node has at least $k$ connections, which is widely used in graph analytics to identify core subgraphs within a larger graph. The sequential $k$-core decomposition algorithm faces limitations due to memory constraints and data graphs can be inherently distributed. A distributed approach is proposed to overcome limitations by allowing each vertex to independently do calculation by only using local information. This paper explores the experimental evaluation of a distributed $k$-core decomposition algorithm. By assuming that each vertex is a client as a single computing unit, we simulate the process using Golang, leveraging its Goroutine and message passing. Due to the fact that the real-world data graphs can be large with millions of vertices, it is expensive to build such a distributed environment with millions of clients if the experiments run in a real-life scenario. Therefore, our experimental simulation can effectively evaluate the running time and message passing for the distributed $k$-core decomposition.


title: Epistemic Horizons From Deterministic Laws: Lessons From a Nomic Toy Theory

abstract: Quantum theory has an epistemic horizon, i.e. exact values cannot be assigned simultaneously to incompatible physical quantities. As shown by Spekkens' toy theory, positing an epistemic horizon akin to Heisenberg's uncertainty principle in a classical mechanical setting also leads to a plethora of quantum phenomena. We introduce a deterministic theory - nomic toy theory - in which information gathering agents are explicitly modelled as physical systems. Our main result shows the presence of an epistemic horizon for such agents. They can only simultaneously learn the values of observables whose Poisson bracket vanishes. Therefore, nomic toy theory has incompatible measurements and the complete state of a physical system cannot be known. The best description of a system by an agent is via an epistemic state of Spekkens' toy theory. Our result reconciles us to measurement uncertainty as an aspect of the inseparability of subjects and objects. Significantly, the claims follow even though nomic toy theory is essentially classical. This work invites further investigations of epistemic horizons, such as the one of (full) quantum theory.


title: Crafting Dynamic Virtual Activities with Advanced Multimodal Models

abstract: In this paper, we investigate the use of large multimodal models (LMMs) for generating virtual activities, leveraging the integration of vision-language modalities to enable the interpretation of virtual environments. This approach not only facilitates the recognition of scene layouts, semantic contexts, and object identities, but also empowers LMMs to abstract the elements of a scene. By correlating these abstractions with massive knowledge about human activities, LMMs are capable of generating adaptive and contextually relevant virtual activities. We propose a structured framework for articulating abstract activity descriptions, with an emphasis on delineating character interactions within the virtual milieu. Utilizing the derived high-level contexts, our methodology proficiently positions virtual characters, ensuring that their interactions and behaviors are realistically and contextually congruent through strategic optimizations. The implications of our findings are significant, offering a novel pathway for enhancing the realism and contextual appropriateness of virtual activities in simulated environments.


title: Towards Compositional Interpretability for XAI

abstract: Artificial intelligence (AI) is currently based largely on black-box machine learning models which lack interpretability. The field of eXplainable AI (XAI) strives to address this major concern, being critical in high-stakes areas such as the finance, legal and health sectors. We present an approach to defining AI models and their interpretability based on category theory. For this we employ the notion of a compositional model, which sees a model in terms of formal string diagrams which capture its abstract structure together with its concrete implementation. This comprehensive view incorporates deterministic, probabilistic and quantum models. We compare a wide range of AI models as compositional models, including linear and rule-based models, (recurrent) neural networks, transformers, VAEs, and causal and DisCoCirc models. Next we give a definition of interpretation of a model in terms of its compositional structure, demonstrating how to analyse the interpretability of a model, and using this to clarify common themes in XAI. We find that what makes the standard 'intrinsically interpretable' models so transparent is brought out most clearly diagrammatically. This leads us to the more general notion of compositionally-interpretable (CI) models, which additionally include, for instance, causal, conceptual space, and DisCoCirc models. We next demonstrate the explainability benefits of CI models. Firstly, their compositional structure may allow the computation of other quantities of interest, and may facilitate inference from the model to the modelled phenomenon by matching its structure. Secondly, they allow for diagrammatic explanations for their behaviour, based on influence constraints, diagram surgery and rewrite explanations. Finally, we discuss many future directions for the approach, raising the question of how to learn such meaningfully structured models in practice.


title: Local Spherical Collapsing Box in Athena++: Numerical Implementation and Benchmark Tests

abstract: We implement a local model for a spherical collapsing/expanding gas cloud into the Athena++ magnetohydrodynamic code. This local model consists of a Cartesian periodic box with time-dependent geometry. We present a series of benchmark test problems, including non-linear solutions and linear perturbations of the local model, confirming the code's desired performance. During a spherical collapse, a horizontal shear flow is amplified, corresponding to angular momentum conservation of zonal flows in the global problem; wave speed and amplitude of sound waves increase in the local frame, due to the reduction in the characteristic length scale of the box, which can lead to an anisotropic effective sound speed in the local box. Our code conserves both mass and momentum to machine precision. This numerical implementation of the local model has potential applications to the study of local physics and hydrodynamic instabilities during protostellar collapse, providing a powerful framework for better understanding the earliest stages of star and planet formation.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: Learning Dynamic Bayesian Networks from Data: Foundations, First Principles and Numerical Comparisons

abstract: In this paper, we present a guide to the foundations of learning Dynamic Bayesian Networks (DBNs) from data in the form of multiple samples of trajectories for some length of time. We present the formalism for a generic as well as a set of common types of DBNs for particular variable distributions. We present the analytical form of the models, with a comprehensive discussion on the interdependence between structure and weights in a DBN model and their implications for learning. Next, we give a broad overview of learning methods and describe and categorize them based on the most important statistical features, and how they treat the interplay between learning structure and weights. We give the analytical form of the likelihood and Bayesian score functions, emphasizing the distinction from the static case. We discuss functions used in optimization to enforce structural requirements. We briefly discuss more complex extensions and representations. Finally we present a set of comparisons in different settings for various distinct but representative algorithms across the variants.


title: Benchmarking SLAM Algorithms in the Cloud: The SLAM Hive System

abstract: Evaluating the performance of Simultaneous Localization and Mapping (SLAM) algorithms is essential for scientists and users of robotic systems alike. But there are a multitude different permutations of possible options of hardware setups and algorithm configurations, as well as different datasets and algorithms, such that it is infeasible to thoroughly compare SLAM systems against the full state of the art. To solve that we present the SLAM Hive Benchmarking Suite, which is able to analyze SLAM algorithms in thousands of mapping runs, through its utilization of container technology and deployment in the cloud. This paper presents the architecture and open source implementation of SLAM Hive and compares it to existing efforts on SLAM evaluation. We perform mapping runs of many of the most popular visual and LiDAR based SLAM algorithms against commonly used datasets and show how SLAM Hive and then be used to conveniently analyze the results against various aspects. Through this we envision that SLAM Hive can become an essential tool for proper comparisons and evaluations of SLAM algorithms and thus drive the scientific development in the research on SLAM. The open source software as well as a demo to show the live analysis of 100s of mapping runs can be found on our SLAM Hive website.


title: Small-ball estimates for random walks on groups

abstract: We prove a new inequality bounding the probability that the random walk on a group has small total displacement in terms of the spectral and isoperimetric profiles of the group. This inequality implies that if the random walk on the group is diffusive then Cheeger's inequality is sharp in the sense that the isoperimetric profile $\Phi$ and spectral profile $\Lambda$ of the group are related by $\Lambda \simeq \Phi^2$. Our inequality also yields substantial progress on a conjecture of Lyons, Peres, Sun, and Zheng (2017) stating that for any transient random walk on an infinite, finitely generated group, the expected occupation time of the ball of radius $r$ is $O(r^2)$: We prove that this conjecture holds for every group of superpolynomial growth whose spectral profile is slowly varying, which we conjecture is always the case. For groups of exponential or stretched-exponential growth satisfying a further mild regularity assumption on their spectral profile, our method yields the strong quantitative small-ball estimate \[-\log \mathbb{P}\bigl(d(X_0,X_n) \leq \varepsilon n^{1/2}\bigr) \succeq \frac{1}{\varepsilon^2} \wedge (-\log \mathbb{P}(X_n=X_0)),\] which is sharp for the lamplighter group. Finally, we prove that the regularity assumptions needed to apply the strongest versions our results are satisfied for several classical examples where the spectral profile is not known explicitly, including the first Grigorchuk group and Thompson's group $F$.


title: LongIns: A Challenging Long-context Instruction-based Exam for LLMs

abstract: The long-context capabilities of large language models (LLMs) have been a hot topic in recent years. To evaluate the performance of LLMs in different scenarios, various assessment benchmarks have emerged. However, as most of these benchmarks focus on identifying key information to answer questions, which mainly requires the retrieval ability of LLMs, these benchmarks can partially represent the reasoning performance of LLMs from large amounts of information. Meanwhile, although LLMs often claim to have context windows of 32k, 128k, 200k, or even longer, these benchmarks fail to reveal the actual supported length of these LLMs. To address these issues, we propose the LongIns benchmark dataset, a challenging long-context instruction-based exam for LLMs, which is built based on the existing instruction datasets. Specifically, in our LongIns, we introduce three evaluation settings: Global Instruction & Single Task (GIST), Local Instruction & Single Task (LIST), and Local Instruction & Multiple Tasks (LIMT). Based on LongIns, we perform comprehensive evaluations on existing LLMs and have the following important findings: (1). The top-performing GPT-4 with 128k context length performs poorly on the evaluation context window of 16k in our LongIns. (2). For the multi-hop reasoning ability of many existing LLMs, significant efforts are still needed under short context windows (less than 4k).


title: Assessment of the environmental impacts of the Cherenkov Telescope Array Mid-Sized Telescope

abstract: Astronomical observatories have been identified as substantial contributors to the carbon footprint of astrophysical research. Being part of the collaboration that currently develops the Medium-Sized Telescope (MST) of the Cherenkov Telescope Array, a ground-based observatory for very-high-energy gamma rays that will comprise 64 telescopes deployed on two sites, we assessed the environmental impacts of one MST on the Northern site by means of a Life Cycle Assessment. We identified resource use and climate change as the most significant impacts, being driven by telescope manufacturing and energy consumption during operations. We estimate life cycle greenhouse gas emissions of 2,660 +/- 274 tCO2 equivalent for the telescope, 44% of which arise from construction, 1% from on-site assembly and commissioning, and 55% from operations over 30 years. Environmental impacts can be reduced by using renewable energies during construction and operations, use of less electronic components and metal casting, and use of recycled materials. We propose complementing project requirements with environmental budgets as an effective measure for impact management and reductions.


title: Multimodal Chaptering for Long-Form TV Newscast Video

abstract: We propose a novel approach for automatic chaptering of TV newscast videos, addressing the challenge of structuring and organizing large collections of unsegmented broadcast content. Our method integrates both audio and visual cues through a two-stage process involving frozen neural networks and a trained LSTM network. The first stage extracts essential features from separate modalities, while the LSTM effectively fuses these features to generate accurate segment boundaries. Our proposed model has been evaluated on a diverse dataset comprising over 500 TV newscast videos of an average of 41 minutes gathered from TF1, a French TV channel, with varying lengths and topics. Experimental results demonstrate that this innovative fusion strategy achieves state of the art performance, yielding a high precision rate of 82% at IoU of 90%. Consequently, this approach significantly enhances analysis, indexing and storage capabilities for TV newscast archives, paving the way towards efficient management and utilization of vast audiovisual resources.


title: DocParseNet: Advanced Semantic Segmentation and OCR Embeddings for Efficient Scanned Document Annotation

abstract: Automating the annotation of scanned documents is challenging, requiring a balance between computational efficiency and accuracy. DocParseNet addresses this by combining deep learning and multi-modal learning to process both text and visual data. This model goes beyond traditional OCR and semantic segmentation, capturing the interplay between text and images to preserve contextual nuances in complex document structures. Our evaluations show that DocParseNet significantly outperforms conventional models, achieving mIoU scores of 49.12 on validation and 49.78 on the test set. This reflects a 58% accuracy improvement over state-of-the-art baseline models and an 18% gain compared to the UNext baseline. Remarkably, DocParseNet achieves these results with only 2.8 million parameters, reducing the model size by approximately 25 times and speeding up training by 5 times compared to other models. These metrics, coupled with a computational efficiency of 0.034 TFLOPs (BS=1), highlight DocParseNet's high performance in document annotation. The model's adaptability and scalability make it well-suited for real-world corporate document processing applications. The code is available at https://github.com/ahmad-shirazi/DocParseNet


title: MC-EKRT: Monte Carlo event generator with saturated minijet production for initializing 3+1 D fluid dynamics in high energy nuclear collisions

abstract: We present a novel Monte-Carlo implementation of the EKRT model, MC-EKRT, for computing partonic initial states in high-energy nuclear collisions. Our new MC-EKRT event generator is based on collinearly factorized, dynamically fluctuating pQCD minijet production, supplemented with a saturation conjecture that controls the low-$p_T$ particle production. Previously, the EKRT model has been very successful in describing low-$p_T$ observables at mid-rapidity in heavy-ion collisions at the LHC and RHIC energies. As novel features, our new MC implementation gives a full 3-dimensional initial state event-by-event, includes dynamical minijet-multiplicity fluctuations in the saturation and particle production, introduces a new type of spatially dependent nuclear parton distribution functions, and accounts for the conservation of energy/momentum and valence-quark number. In this proof-of-principle study, we average a large set of event-by-event MC-EKRT initial conditions and compute the rapidity and centrality dependence of the charged hadron multiplicities and elliptic flow for the LHC Pb+Pb and RHIC Au+Au collisions using 3+1 D viscous fluid-dynamical evolution. Also event-by-event fluctuations and decorrelations of initial eccentricities are studied. The good agreement with the rapidity-dependent data suggests that the same saturation mechanism that has been very successful in explaining the mid-rapidity observables, works well also at larger rapidities.


title: On simultaneous rationality of two Ahmes series

abstract: Paul Erd\H{o}s asked how rapidly a sequence of positive integers $(n_k)$ can grow if both series $\sum_k 1/n_k$ and $\sum_k 1/(n_k-1)$ have rational sums. In this note we show that there exists an exponentially growing sequence $(n_k)$ with this property. Previous records had polynomial growth, even for easier variants of the problem, regarding the series $\sum_k 1/n_k$ and $\sum_k 1/(n_k-d)$ for any concrete nonzero integer $d$.


title: The Classical Limit of Teleparallel Gravity

abstract: I consider the classical (i.e., non-relativistic) limit of Teleparallel Gravity, a relativistic theory of gravity that is empirically equivalent to General Relativity and features torsional forces. I show that as the speed of light is allowed to become infinite, Teleparallel Gravity reduces to Newtonian Gravity without torsion. I compare these results to the torsion-free context and discuss their implications on the purported underdetermination between Teleparallel Gravity and General Relativity. I conclude by considering alternative approaches to the classical limit developed in the literature.


title: Density-Based Long-Range Electrostatic Descriptors for Machine Learning Force Fields

abstract: This study presents a long-range descriptor for machine learning force fields (MLFFs) that maintains translational and rotational symmetry, similar to short-range descriptors while being able to incorporate long-range electrostatic interactions. The proposed descriptor is based on an atomic density representation and is structurally similar to classical short-range atom-centered descriptors, making it straightforward to integrate into machine learning schemes. The effectiveness of our model is demonstrated through comparative analysis with the long-distance equivariant (LODE) descriptor. In a toy model with purely electrostatic interactions, our model achieves errors below 0.1%. The application of our descriptors, in combination with local descriptors representing the atomic density, to materials where monopole-monopole interactions are important such as sodium chloride successfully captures long-range interactions, improving predictive accuracy. The study highlights the limitations of the combined LODE method in materials where intermediate-range effects play a significant role. Our work presents a promising approach to addressing the challenge of incorporating long-range interactions into MLFFs, which enhances predictive accuracy for charged materials to the level of state-of-the-art Message Passing Neural Networks.


title: Flux and fluence effects on the Vacuum-UV photodesorption and photoprocessing of CO$_2$ ices

abstract: CO$_2$ is a major component of the icy mantles surrounding dust grains in planet and star formation regions. Understanding its photodesorption is crucial for explaining gas phase abundances in the coldest environments of the interstellar medium irradiated by vacuum-UV (VUV) photons. Photodesorption yields determined experimentally from CO$_2$ samples grown at low temperatures (T=15~K) have been found to be very sensitive to experimental methods and conditions. Several mechanisms have been suggested for explaining the desorption of CO$_2$, O$_2$ and CO from CO$_2$ ices. In the present study, the cross sections characterizing the dynamics of photodesorption as a function of photon fluence (determined from released molecules in the gas phase) and of ice composition modification (determined in situ in the solid phase) are compared for the first time for different photon flux conditions (from 7.3$\times 10^{12}$~photon/s/cm$^2$ to 2.2$\times 10^{14}$~photon/s/cm$^2$) using monochromatic synchrotron radiation in the VUV range (on the DESIRS beamline at SOLEIL). This approach reveals that CO and O$_2$ desorption are decorrelated from that of CO$_2$. CO and O$_2$ photodesorption yields depend on photon flux conditions and can be linked to surface chemistry. By contrast, the phodesorption yield of CO$_2$ is independent of the photon flux conditions and can be linked to bulk ice chemical modification, consistently with an indirect desorption induced by electronic transition (DIET) process.


title: Constructing structured tensor priors for Bayesian inverse problems

abstract: Specifying a prior distribution is an essential part of solving Bayesian inverse problems. The prior encodes a belief on the nature of the solution and this regularizes the problem. In this article we completely characterize a Gaussian prior that encodes the belief that the solution is a structured tensor. We first define the notion of (A,b)-constrained tensors and show that they describe a large variety of different structures such as Hankel, circulant, triangular, symmetric, and so on. Then we completely characterize the Gaussian probability distribution of such tensors by specifying its mean vector and covariance matrix. Furthermore, explicit expressions are proved for the covariance matrix of tensors whose entries are invariant under a permutation. These results unlock a whole new class of priors for Bayesian inverse problems. We illustrate how new kernel functions can be designed and efficiently computed and apply our results on two particular Bayesian inverse problems: completing a Hankel matrix from a few noisy measurements and learning an image classifier of handwritten digits. The effectiveness of the proposed priors is demonstrated for both problems. All applications have been implemented as reactive Pluto notebooks in Julia.

categories: math.NA cs.LG cs.NA cs.SY eess.SP eess.SY math.ST stat.TH


title: Prior-Informed AGN-Host Spectral Decomposition Using PyQSOFit

abstract: We introduce an improved method for decomposing the emission of active galactic nuclei (AGN) and their host galaxies using templates from principal component analysis (PCA). This approach integrates prior information from PCA with a penalized pixel fitting mechanism which improves the precision and effectiveness of the decomposition process. Specifically, we have reduced the degeneracy and over-fitting in AGN-host decomposition, particularly for those with low signal-to-noise ratios (SNR), where traditional methods tend to fail. By applying our method to 76,565 SDSS Data Release 16 quasars with $z<0.8$, we achieve a success rate of $\approx$ 94%, thus establishing the largest host-decomposed spectral catalog of quasars to date. Our fitting results consider the impact of the host galaxy on the overestimation of the AGN luminosity and black hole mass ($M_{\rm BH}$). Furthermore, we obtained stellar velocity dispersion ($\sigma_*$) measurements for 4,137 quasars. The slope of the $M_{\rm BH}-\sigma_*$ relation in this subsample is generally consistent with previous quasar studies beyond the local universe. Our method provides a robust and efficient approach to disentangle the AGN and host galaxy components across a wide range of SNRs and redshifts.


title: Illuminating the dark: mono-$\gamma$ signals at NA62

abstract: Dipole interactions between dark sector states or between a Standard Model particle and a dark state can efficiently be searched for via high-intensity fixed-target facilities. We propose to look for the associated mono-$\gamma$ signature at the NA62 experiment running in beam-dump mode. Focusing on models of dipole inelastic Dark Matter and active-sterile neutrino dipole interactions, we compute the corresponding expected sensitivities finding promising prospects for discovery.


title: "Seeing the Big through the Small": Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations?

abstract: Human label variation (HLV) is a valuable source of information that arises when multiple human annotators provide different labels for valid reasons. In Natural Language Inference (NLI) earlier approaches to capturing HLV involve either collecting annotations from many crowd workers to represent human judgment distribution (HJD) or use expert linguists to provide detailed explanations for their chosen labels. While the former method provides denser HJD information, obtaining it is resource-intensive. In contrast, the latter offers richer textual information but it is challenging to scale up to many human judges. Besides, large language models (LLMs) are increasingly used as evaluators (``LLM judges'') but with mixed results, and few works aim to study HJDs. This study proposes to exploit LLMs to approximate HJDs using a small number of expert labels and explanations. Our experiments show that a few explanations significantly improve LLMs' ability to approximate HJDs with and without explicit labels, thereby providing a solution to scale up annotations for HJD. However, fine-tuning smaller soft-label aware models with the LLM-generated model judgment distributions (MJDs) presents partially inconsistent results: while similar in distance, their resulting fine-tuned models and visualized distributions differ substantially. We show the importance of complementing instance-level distance measures with a global-level shape metric and visualization to more effectively evaluate MJDs against human judgment distributions.


title: Director3D: Real-world Camera Trajectory and 3D Scene Generation from Text

abstract: Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes, remains largely unexplored. In this work, we delve into the key challenge of the complex and scene-specific camera trajectories found in real-world captures. We introduce Director3D, a robust open-world text-to-3D generation framework, designed to generate both real-world 3D scenes and adaptive camera trajectories. To achieve this, (1) we first utilize a Trajectory Diffusion Transformer, acting as the Cinematographer, to model the distribution of camera trajectories based on textual descriptions. (2) Next, a Gaussian-driven Multi-view Latent Diffusion Model serves as the Decorator, modeling the image sequence distribution given the camera trajectories and texts. This model, fine-tuned from a 2D diffusion model, directly generates pixel-aligned 3D Gaussians as an immediate 3D scene representation for consistent denoising. (3) Lastly, the 3D Gaussians are refined by a novel SDS++ loss as the Detailer, which incorporates the prior of the 2D diffusion model. Extensive experiments demonstrate that Director3D outperforms existing methods, offering superior performance in real-world 3D generation.


title: Quasiperiodic Quadrupole Insulators

abstract: Higher-order topological insulators are an intriguing new family of topological states that host lower-dimensional boundary states. Concurrently, quasiperiodic systems have garnered significant interest due to their complex localization and topological properties. In this work we study the impact of quasiperiodic modulations on the paradigmatic Benalcazar-Bernevig-Hughes model, which hosts topological insulating phases with zero-energy corner modes. We find that the topological properties are not only robust to the quasiperiodic modulation, but can even be enriched. In particular, we unveil the first instance of a quasiperiodic induced second-order topological insulating phase. Furthermore, in contrast with disorder, we find that quasiperiodic modulations can induce multiple reentrant topological transitions, showing an intricate sequence of localization properties. Our results open a promising avenue for exploring the rich interplay between higher-order topology and quasiperiodicity.


title: Experimental timing and control using microcontrollers

abstract: Modern physics experiments rely on precise timing provided by programmable digital pulse generators. In many experimental control systems, this role is filled by custom devices built on Field Programmable Gate Arrays (FPGAs). While highly flexible and performant, these systems can be difficult to scale to very large systems due to cost and complexity. Recent advances in microcontroller systems allows these much simpler systems to fill the role of digital pulse generators. Here we demonstrate one such alternative based on the Raspberry Pi Pico microcontroller which allows for timing resolution down to 7.5 ns with a minimum pulse width of of 37.5 ns.


title: Optimizing Energy-Efficient Braking Trajectories with Anticipatory Road Data for Automated Vehicles

abstract: Trajectory planning in automated driving typically focuses on satisfying safety and comfort requirements within the vehicle's onboard sensor range. This paper introduces a method that leverages anticipatory road data, such as speed limits, road slopes, and traffic lights, beyond the local perception range to optimize energy-efficient braking trajectories. For that, coasting, which reduces energy consumption, and active braking are combined to transition from the current vehicle velocity to a lower target velocity at a given distance ahead. Finding the switching instants between the coasting phases and the continuous control for the braking phase is addressed as an optimal trade-off between maximizing coasting periods and minimizing braking effort. The resulting switched optimal control problem is solved by deriving necessary optimality conditions. To facilitate the incorporation of additional feasibility constraints for multi-phase trajectories, a sub-optimal alternative solution based on parametric optimization is proposed. Both methods are compared in simulation.


title: NativE: Multi-modal Knowledge Graph Completion in the Wild

abstract: Multi-modal knowledge graph completion (MMKGC) aims to automatically discover the unobserved factual knowledge from a given multi-modal knowledge graph by collaboratively modeling the triple structure and multi-modal information from entities. However, real-world MMKGs present challenges due to their diverse and imbalanced nature, which means that the modality information can span various types (e.g., image, text, numeric, audio, video) but its distribution among entities is uneven, leading to missing modalities for certain entities. Existing works usually focus on common modalities like image and text while neglecting the imbalanced distribution phenomenon of modal information. To address these issues, we propose a comprehensive framework NativE to achieve MMKGC in the wild. NativE proposes a relation-guided dual adaptive fusion module that enables adaptive fusion for any modalities and employs a collaborative modality adversarial training framework to augment the imbalanced modality information. We construct a new benchmark called WildKGC with five datasets to evaluate our method. The empirical results compared with 21 recent baselines confirm the superiority of our method, consistently achieving state-of-the-art performance across different datasets and various scenarios while keeping efficient and generalizable. Our code and data are released at https://github.com/zjukg/NATIVE


title: Diffusion-based Adversarial Purification for Intrusion Detection

abstract: The escalating sophistication of cyberattacks has encouraged the integration of machine learning techniques in intrusion detection systems, but the rise of adversarial examples presents a significant challenge. These crafted perturbations mislead ML models, enabling attackers to evade detection or trigger false alerts. As a reaction, adversarial purification has emerged as a compelling solution, particularly with diffusion models showing promising results. However, their purification potential remains unexplored in the context of intrusion detection. This paper demonstrates the effectiveness of diffusion models in purifying adversarial examples in network intrusion detection. Through a comprehensive analysis of the diffusion parameters, we identify optimal configurations maximizing adversarial robustness with minimal impact on normal performance. Importantly, this study reveals insights into the relationship between diffusion noise and diffusion steps, representing a novel contribution to the field. Our experiments are carried out on two datasets and against 5 adversarial attacks. The implementation code is publicly available.


title: Low-Crosstalk, Silicon-Fabricated Optical Waveguides for Laser Delivery to Matter Qubits

abstract: Reliable control of quantum information in matter-based qubits requires precisely applied external fields, and unaccounted for spatial cross-talk of these fields between adjacent qubits leads to loss of fidelity. We report a CMOS foundry-produced, micro-fabricated silicon nitride (Si3N4) optical waveguide for addressing a chain of eight, unequally-spaced trapped barium ions with crosstalk compatible with scalable quantum information processing. The crosstalk mitigation techniques incorporated into the chip design result in a reduction of the measured optical field by at least 50.8(1.3) dB between adjacent waveguide outputs near 650 nm and similar behavior for devices designed for 493 nm and 585 nm. The waveguide outputs near 650 nm, along with a global laser near 493 nm were used to laser-cool a chain of eight barium-138 ions, and a camera imaged the resulting fluorescence at 493 nm.


title: Test-Time Generative Augmentation for Medical Image Segmentation

abstract: In this paper, we propose a novel approach to enhance medical image segmentation during test time. Instead of employing hand-crafted transforms or functions on the input test image to create multiple views for test-time augmentation, we advocate for the utilization of an advanced domain-fine-tuned generative model (GM), e.g., stable diffusion (SD), for test-time augmentation. Given that the GM has been trained to comprehend and encapsulate comprehensive domain data knowledge, it is superior than segmentation models in terms of representing the data characteristics and distribution. Hence, by integrating the GM into test-time augmentation, we can effectively generate multiple views of a given test sample, aligning with the content and appearance characteristics of the sample and the related local data distribution. This approach renders the augmentation process more adaptable and resilient compared to conventional handcrafted transforms. Comprehensive experiments conducted across three medical image segmentation tasks (nine datasets) demonstrate the efficacy and versatility of the proposed TTGA in enhancing segmentation outcomes. Moreover, TTGA significantly improves pixel-wise error estimation, thereby facilitating the deployment of a more reliable segmentation system. Code will be released at: https://github.com/maxiao0234/TTGA.


title: Position and Time Determination without Prior State Knowledge via Onboard Optical Observations of Delta Scuti Variable Stars

abstract: We present a navigation concept for solving the lost in space and time problem using optical observations of $\delta$ Scuti variable stars. Only a small number of techniques exist that allow a spacecraft to recover from being lost in both space and time, which can be caused by a failure of the onboard clock and navigation systems. Optical observations of $\delta$ Scuti stars, which can be collected onboard from star trackers or navigation cameras, may enable faster and/or more accurate position and time solutions compared to existing techniques without requiring additional equipment. Our results indicate that one day of observation by the OSIRIS-APEX MapCam may enable position and time determination accuracy within 0.05 au (3$\sigma$) and 15 s (3$\sigma$).


title: YAQQ: Yet Another Quantum Quantizer -- Design Space Exploration of Quantum Gate Sets using Novelty Search

abstract: In the standard circuit model of quantum computation, the number and quality of the quantum gates composing the circuit influence the runtime and fidelity of the computation. The fidelity of the decomposition of quantum algorithms, represented as unitary matrices, to bounded depth quantum circuits depends strongly on the set of gates available for the decomposition routine. To investigate this dependence, we explore the design space of discrete quantum gate sets and present a software tool for comparative analysis of quantum processing units and control protocols based on their native gates. The evaluation is conditioned on a set of unitary transformations representing target use cases on the quantum processors. The cost function considers three key factors: (i) the statistical distribution of the decomposed circuits' depth, (ii) the statistical distribution of process fidelities for the approximate decomposition, and (iii) the relative novelty of a gate set compared to other gate sets in terms of the aforementioned properties. The developed software, YAQQ (Yet Another Quantum Quantizer), enables the discovery of an optimized set of quantum gates through this tunable joint cost function. To identify these gate sets, we use the novelty search algorithm, circuit decomposition techniques, and stochastic optimization to implement YAQQ within the Qiskit quantum simulator environment. YAQQ exploits reachability tradeoffs conceptually derived from quantum algorithmic information theory. Our results demonstrate the pragmatic application of identifying gate sets that are advantageous to popularly used quantum gate sets in representing quantum algorithms. Consequently, we demonstrate pragmatic use cases of YAQQ in comparing transversal logical gate sets in quantum error correction codes, designing optimal quantum instruction sets, and compiling to specific quantum processors.


title: Distributed Training of Large Graph Neural Networks with Variable Communication Rates

abstract: Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to training GNNs on large graphs. However, as the graph cannot generally be decomposed into small non-interacting components, data communication between the training machines quickly limits training speeds. Compressing the communicated node activations by a fixed amount improves the training speeds, but lowers the accuracy of the trained GNN. In this paper, we introduce a variable compression scheme for reducing the communication volume in distributed GNN training without compromising the accuracy of the learned model. Based on our theoretical analysis, we derive a variable compression method that converges to a solution equivalent to the full communication case, for all graph partitioning schemes. Our empirical results show that our method attains a comparable performance to the one obtained with full communication. We outperform full communication at any fixed compression ratio for any communication budget.


title: On the chaotic behavior of the Lagrangian flow of the 2D Navier-Stokes system with bounded degenerate noise

abstract: We consider a fluid governed by the randomly forced 2D Navier-Stokes system. It is assumed that the force is bounded, acts directly only on a small number of Fourier modes, and satisfies some natural decomposability and observability properties. Under these assumptions, we show that the Lagrangian flow associated with the random fluid exhibits chaotic behavior characterized by the strict positivity of the top Lyapunov exponent. To achieve this, we introduce a new abstract result that allows to derive positivity of the top Lyapunov exponent from controllability properties of the underlying deterministic system.


title: Counting of surfaces and computational complexity in column sums of symmetric group character tables

abstract: The character table of the symmetric group $S_n$, of permutations of $n$ objects, is of fundamental interest in theoretical physics, combinatorics as well as computational complexity theory. We investigate the implications of an identity, which has a geometrical interpretation in combinatorial topological field theories, relating the column sum of normalised central characters of $S_n$ to a sum of structure constants of multiplication in the centre of the group algebra of $S_n$. The identity leads to the proof that a combinatorial computation of the column sum belongs to complexity class \shP. The sum of structure constants has an interpretation in terms of the counting of branched covers of the sphere. This allows the identification of a tractable subset of the structure constants related to genus zero covers. We use this subset to prove that the column sum for a conjugacy class labelled by partition $\lambda$ is non-vanishing if and only if the permutations in the conjugacy class are even. This leads to the result that the determination of the vanishing or otherwise of the column sum is in complexity class \pP. The subset gives a positive lower bound on the column sum for any even $ \lambda$. For any disjoint decomposition of $ \lambda$ as $\lambda_1 \sqcup \lambda_2 $ we obtain a lower bound for the column sum at $ \lambda$ in terms of the product of the column sums for $ \lambda_1$ and$\lambda_2$. This can be expressed as a super-additivity property for the logarithms of column sums of normalized characters.


title: MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization

abstract: Pre-trained models have been a foundational approach in speech recognition, albeit with associated additional costs. In this study, we propose a regularization technique that facilitates the training of visual and audio-visual speech recognition models (VSR and AVSR) from scratch. This approach, abbreviated as \textbf{MSRS} (Multimodal Speech Recognition from Scratch), introduces a sparse regularization that rapidly learns sparse structures within the dense model at the very beginning of training, which receives healthier gradient flow than the dense equivalent. Once the sparse mask stabilizes, our method allows transitioning to a dense model or keeping a sparse model by updating non-zero values. MSRS achieves competitive results in VSR and AVSR with 21.1% and 0.9% WER on the LRS3 benchmark, while reducing training time by at least 2x. We explore other sparse approaches and show that only MSRS enables training from scratch by implicitly masking the weights affected by vanishing gradients.


title: Aligning Programming Language and Natural Language: Exploring Design Choices in Multi-Modal Transformer-Based Embedding for Bug Localization

abstract: Bug localization refers to the identification of source code files which is in a programming language and also responsible for the unexpected behavior of software using the bug report, which is a natural language. As bug localization is labor-intensive, bug localization models are employed to assist software developers. Due to the domain difference between source code files and bug reports, modern bug-localization systems, based on deep learning models, rely heavily on embedding techniques that project bug reports and source code files into a shared vector space. The creation of an embedding involves several design choices, but the impact of these choices on the quality of embedding and the performance of bug localization models remains unexplained in current research. To address this gap, our study evaluated 14 distinct embedding models to gain insights into the effects of various design choices. Subsequently, we developed bug localization models utilizing these embedding models to assess the influence of these choices on the performance of the localization models. Our findings indicate that the pre-training strategies significantly affect the quality of the embedding. Moreover, we discovered that the familiarity of the embedding models with the data has a notable impact on the bug localization model's performance. Notably, when the training and testing data are collected from different projects, the performance of the bug localization models exhibits substantial fluctuations.


title: Semiorthogonal decompositions of projective spaces from small quantum cohomology

abstract: In a recent article Halpern-Leistner defines the notion of quasi--convergent path in the space of Bridgeland stability conditions. Such a path induces a semiorthogonal decomposition of the derived category. We investigate quasi-convergent paths in the stability manifold of projective spaces and answer positively to two questions posed by Halpern-Leistner. We construct quasi-convergent paths that start from the geometric region of the stability space and whose central charge is given by a fundamental solution of the quantum differential equation. We also construct quasi-convergent paths whose central charges are the quantum cohomology central charges defined by Iritani.


title: Embedded event based object detection with spiking neural network

abstract: The complexity of event-based object detection (OD) poses considerable challenges. Spiking Neural Networks (SNNs) show promising results and pave the way for efficient event-based OD. Despite this success, the path to efficient SNNs on embedded devices remains a challenge. This is due to the size of the networks required to accomplish the task and the ability of devices to take advantage of SNNs benefits. Even when "edge" devices are considered, they typically use embedded GPUs that consume tens of watts. In response to these challenges, our research introduces an embedded neuromorphic testbench that utilizes the SPiking Low-power Event-based ArchiTecture (SPLEAT) accelerator. Using an extended version of the Qualia framework, we can train, evaluate, quantize, and deploy spiking neural networks on an FPGA implementation of SPLEAT. We used this testbench to load a state-of-the-art SNN solution, estimate the performance loss associated with deploying the network on dedicated hardware, and run real-world event-based OD on neuromorphic hardware specifically designed for low-power spiking neural networks. Remarkably, our embedded spiking solution, which includes a model with 1.08 million parameters, operates efficiently with 490 mJ per prediction.