title: Monoidal Context Theory

abstract: We universally characterize the produoidal category of monoidal lenses over a monoidal category. In the same way that each category induces a cofree promonoidal category of spliced arrows, each monoidal category induces a cofree produoidal category of monoidal spliced arrows; monoidal lenses are the free normalization of the cofree produoidal category of monoidal spliced arrows. We apply the characterization of symmetric monoidal lenses to the analysis of multi-party message-passing protocols. We introduce a minimalistic axiomatization of message passing -- message theories -- and we construct combinatorially the free message theory over a set. Symmetric monoidal lenses are the derivations of the free message theory over a symmetric monoidal category.


title: Dynamics of large oscillator populations with random interactions

abstract: We explore large populations of phase oscillators interacting via random coupling functions. Two types of coupling terms, the Kuramoto-Daido coupling and the Winfree coupling, are considered. Under the assumption of statistical independence of the phases and the couplings, we derive reduced averaged equations with effective non-random coupling terms. As a particular example, we study interactions that have the same shape but possess random coupling strengths and random phase shifts. While randomness in coupling strengths just renormalizes the interaction, a distribution of the phase shifts in coupling reshapes the coupling function.


title: Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detection

abstract: Open-vocabulary human-object interaction (HOI) detection, which is concerned with the problem of detecting novel HOIs guided by natural language, is crucial for understanding human-centric scenes. However, prior zero-shot HOI detectors often employ the same levels of feature maps to model HOIs with varying distances, leading to suboptimal performance in scenes containing human-object pairs with a wide range of distances. In addition, these detectors primarily rely on category names and overlook the rich contextual information that language can provide, which is essential for capturing open vocabulary concepts that are typically rare and not well-represented by category names alone. In this paper, we introduce a novel end-to-end open vocabulary HOI detection framework with conditional multi-level decoding and fine-grained semantic enhancement (CMD-SE), harnessing the potential of Visual-Language Models (VLMs). Specifically, we propose to model human-object pairs with different distances with different levels of feature maps by incorporating a soft constraint during the bipartite matching process. Furthermore, by leveraging large language models (LLMs) such as GPT models, we exploit their extensive world knowledge to generate descriptions of human body part states for various interactions. Then we integrate the generalizable and fine-grained semantics of human body parts to improve interaction recognition. Experimental results on two datasets, SWIG-HOI and HICO-DET, demonstrate that our proposed method achieves state-of-the-art results in open vocabulary HOI detection. The code and models are available at https://github.com/ltttpku/CMD-SE-release.


title: Uniform approximation on certain polynomial polyhedra in $\mathbb{C}^2$

abstract: In this paper we extend the dichotomy given by Samuelsson and Wold that can be thought of as an analogue of the Wermer maximality theorem in $\mathbb{C}^2$ for certain polynomial polyhedra. We consider complex non-degenerate simply connected polynomial polyhedra of the form $\Omega:=\{z\in\mathbb{C}^2: |p_1(z)|<1, |p_2(z)|<1\}$ such that $\overline{\Omega}$ is compact. Under a mild condition of the polynomials $p_1$ and $p_2$, we prove that either the uniform algebra, generated by polynomials and some continuous functions $f_1,\dots, f_N$ on the distinguished boundary that extends as pluriharmonic functions on $\Omega$, is all continuous functions on the distinguished boundary or there exists an algebraic variety in $\overline{\Omega}$ on which each $f_j$ is holomorphic. We also compute the polynomial hull of the graph of pluriharmonic functions in some cases where the pluriharmonic functions are conjugates of holomorphic polynomials. We also give a couple of general theorem about uniform approximation on the domains with low boundary regularity.


title: Permissible extensions of classical to quantum games combining three strategies

abstract: We study the extension of classical games to the quantum domain, generated by the addition of one unitary strategy to two classical strategies of each player. The conditions that need to be met by unitary operations to ensure that the extended game is invariant with respect to the isomorphic transformations of the input game are determined. It has been shown that there are three types of these extensions, two of them are purely quantum. On the other hand, it has been demonstrated that the extensions of two versions of the same classical game by a unitary operator that does not meet these conditions may result in quantum games that are non-equivalent, e.g. having different Nash equilibria. We use the obtained results to extend the classical Prisoner's Dilemma game to a quantum game that has a unique Nash equilibrium closer to Pareto-optimal solutions than the original one.


title: SUPPLY: Sustainable multi-UAV Performance-aware Placement Algorithm for Flying Networks

abstract: Unmanned Aerial Vehicles (UAVs) are used for a wide range of applications. Due to characteristics such as the ability to hover and carry cargo on-board, rotary-wing UAVs have been considered suitable platforms for carrying communications nodes, including Wi-Fi Access Points and cellular Base Stations. This gave rise to the concept of Flying Networks (FNs), now making part of the so-called Non-Terrestrial Networks (NTNs) defined in 3GPP. In scenarios where the deployment of terrestrial networks is not feasible, the use of FNs has emerged as a solution to provide wireless connectivity. However, the management of the communications resources in FNs imposes significant challenges, especially regarding the positioning of the UAVs so that the Quality of Service (QoS) offered to the Ground Users (GUs) and devices is maximized. Moreover, unlike terrestrial networks that are directly connected to the power grid, UAVs typically rely on on-board batteries that need to be recharged. In order to maximize the UAVs' flying time, the energy consumed by the UAVs needs to be minimized. When it comes to multi-UAV placement, most state-of-the-art solutions focus on maximizing the coverage area and assume that the UAVs keep hovering in a fixed position while serving GUs. Also, they do not address the energy-aware multi-UAV placement problem in networking scenarios where the GUs may have different QoS requirements and may not be uniformly distributed across the area of interest. In this work, we propose the Sustainable multi-UAV Performance-aware Placement (SUPPLY) algorithm. SUPPLY defines the energy and performance-aware positioning of multiple UAVs in an FN. To accomplish this, SUPPLY defines trajectories that minimize UAVs' energy consumption, while ensuring the targeted QoS levels. The obtained results show up to 25% energy consumption reduction with minimal impact on throughput and delay.


title: The impact of data set similarity and diversity on transfer learning success in time series forecasting

abstract: Models, pre-trained on a similar or diverse source data set, have become pivotal in enhancing the efficiency and accuracy of time series forecasting on target data sets by leveraging transfer learning. While benchmarks validate the performance of model generalization on various target data sets, there is no structured research providing similarity and diversity measures explaining which characteristics of source and target data lead to transfer learning success. Our study pioneers in systematically evaluating the impact of source-target similarity and source diversity on zero-shot and fine-tuned forecasting outcomes in terms of accuracy, bias, and uncertainty estimation. We investigate these dynamics using pre-trained neural networks across five public source datasets, applied in forecasting five target data sets, including real-world wholesales data. We identify two feature-based similarity and diversity measures showing: Source-target similarity enhances forecasting accuracy and reduces bias, while source diversity enhances forecasting accuracy and uncertainty estimation and increases the bias.


title: Strong-field ionization of chiral molecules with bicircular laser fields : sub-barrier dynamics, interference, and vortices

abstract: Strong-field ionization by counter-rotating two-color laser fields produces quantum interference between photoelectrons emitted on the leading and trailing edges of the laser field oscillations. We show that in chiral molecules, this interference is asymmetric along the light propagation direction and strongly enhances the sensitivity of the attoclock scheme to molecular chirality. Calculations in a toy-model molecule with a short-range chiral potential show that this enhanced sensitivity already emerges at the exit of the tunnel. We investigate the possible sources of chiral sensitivity in the tunneling process, and find that the interference between electron vortices plays a crucial role in the chiral response.


title: Further Understanding of a Local Gaussian Process Approximation: Characterising Convergence in the Finite Regime

abstract: We show that common choices of kernel functions for a highly accurate and massively scalable nearest-neighbour based GP regression model (GPnn: \cite{GPnn}) exhibit gradual convergence to asymptotic behaviour as dataset-size $n$ increases. For isotropic kernels such as Mat\'{e}rn and squared-exponential, an upper bound on the predictive MSE can be obtained as $O(n^{-\frac{p}{d}})$ for input dimension $d$, $p$ dictated by the kernel (and $d>p$) and fixed number of nearest-neighbours $m$ with minimal assumptions on the input distribution. Similar bounds can be found under model misspecification and combined to give overall rates of convergence of both MSE and an important calibration metric. We show that lower bounds on $n$ can be given in terms of $m$, $l$, $p$, $d$, a tolerance $\varepsilon$ and a probability $\delta$. When $m$ is chosen to be $O(n^{\frac{p}{p+d}})$ minimax optimal rates of convergence are attained. Finally, we demonstrate empirical performance and show that in many cases convergence occurs faster than the upper bounds given here.


title: Open-Source AI-based SE Tools: Opportunities and Challenges of Collaborative Software Learning

abstract: Large Language Models (LLMs) have become instrumental in advancing software engineering (SE) tasks, showcasing their efficacy in code understanding and beyond. Like traditional SE tools, open-source collaboration is key in realising the excellent products. However, with AI models, the essential need is in data. The collaboration of these AI-based SE models hinges on maximising the sources of high-quality data. However, data especially of high quality, often holds commercial or sensitive value, making it less accessible for open-source AI-based SE projects. This reality presents a significant barrier to the development and enhancement of AI-based SE tools within the software engineering community. Therefore, researchers need to find solutions for enabling open-source AI-based SE models to tap into resources by different organisations. Addressing this challenge, our position paper investigates one solution to facilitate access to diverse organizational resources for open-source AI models, ensuring privacy and commercial sensitivities are respected. We introduce a governance framework centered on federated learning (FL), designed to foster the joint development and maintenance of open-source AI code models while safeguarding data privacy and security. Additionally, we present guidelines for developers on AI-based SE tool collaboration, covering data requirements, model architecture, updating strategies, and version control. Given the significant influence of data characteristics on FL, our research examines the effect of code data heterogeneity on FL performance.


title: Automated National Urban Map Extraction

abstract: Developing countries usually lack the proper governance means to generate and regularly update a national rooftop map. Using traditional photogrammetry and surveying methods to produce a building map at the federal level is costly and time consuming. Using earth observation and deep learning methods, we can bridge this gap and propose an automated pipeline to fetch such national urban maps. This paper aims to exploit the power of fully convolutional neural networks for multi-class buildings' instance segmentation to leverage high object-wise accuracy results. Buildings' instance segmentation from sub-meter high-resolution satellite images can be achieved with relatively high pixel-wise metric scores. We detail all engineering steps to replicate this work and ensure highly accurate results in dense and slum areas witnessed in regions that lack proper urban planning in the Global South. We applied a case study of the proposed pipeline to Lebanon and successfully produced the first comprehensive national building footprint map with approximately 1 Million units with an 84% accuracy. The proposed architecture relies on advanced augmentation techniques to overcome dataset scarcity, which is often the case in developing countries.


title: A Comprehensive Benchmarking Analysis of Fault Recovery in Stream Processing Frameworks

abstract: Nowadays, several software systems rely on stream processing architectures to deliver scalable performance and handle large volumes of data in near real-time. Stream processing frameworks facilitate scalable computing by distributing the application's execution across multiple machines. Despite performance being extensively studied, the measurement of fault tolerance-a key feature offered by stream processing frameworks-has still not been measured properly with updated and comprehensive testbeds. Moreover, the impact that fault recovery can have on performance is mostly ignored. This paper provides a comprehensive analysis of fault recovery performance, stability, and recovery time in a cloud-native environment with modern open-source frameworks, namely Flink, Kafka Streams, and Spark Structured Streaming. Our benchmarking analysis is inspired by chaos engineering to inject failures. Generally, our results indicate that much has changed compared to previous studies on fault recovery in distributed stream processing. In particular, the results indicate that Flink is the most stable and has one of the best fault recovery. Moreover, Kafka Streams shows performance instabilities after failures, which is due to its current rebalancing strategy that can be suboptimal in terms of load balancing. Spark Structured Streaming shows suitable fault recovery performance and stability, but with higher event latency. Our study intends to (i) help industry practitioners in choosing the most suitable stream processing framework for efficient and reliable executions of data-intensive applications; (ii) support researchers in applying and extending our research method as well as our benchmark; (iii) identify, prevent, and assist in solving potential issues in production deployments.


title: Precise measurements of $W$- and $Z$-boson transverse momentum spectra with the ATLAS detector using $pp$ collisions at $\sqrt{s} = 5.02$ TeV and $13$ TeV

abstract: This paper describes measurements of the transverse momentum spectra of $W$ and $Z$ bosons produced in proton-proton collisions at centre-of-mass energies of $\sqrt{s}=5.02$ TeV and $\sqrt{s}=13$ TeV with the ATLAS experiment at the Large Hadron Collider. Measurements are performed in the electron and muon channels, $W \to \ell\nu$ and $Z \to \ell\ell$ ($\ell=e$ or $\mu$), and for $W$ events further separated by charge. The data were collected in 2017 and 2018, in dedicated runs with reduced instantaneous luminosity, and correspond to $255$ pb$^{-1}$ and $338$ pb$^{-1}$ at $\sqrt{s}=5.02$ TeV and $13$ TeV, respectively. These conditions optimise the reconstruction of the $W$-boson transverse momentum. The distributions observed in the electron and muon channels are unfolded, combined, and compared to QCD calculations based on parton shower Monte Carlo event generators and analytical resummation. The description of the transverse momentum distributions by Monte Carlo event generators is imperfect and shows significant differences largely common to $W^-$, $W^+$ and $Z$ production. The agreement is better at $\sqrt{s}=5.02$ TeV, especially for predictions that were tuned to $Z$ production data at $\sqrt{s}=7$ TeV. Higher-order, resummed predictions based on DYTurbo generally match the data best across the spectra. Distribution ratios are also presented and test the understanding of differences between the production processes.


title: Adaptive Unit Root Inference in Autoregressions using the Lasso Solution Path

abstract: We show that the activation knot of a potentially non-stationary regressor on the adaptive Lasso solution path in autoregressions can be leveraged for selection-free inference about a unit root. The resulting test has asymptotic power against local alternatives in $1/T$ neighbourhoods, unlike post-selection inference methods based on consistent model selection. Exploiting the information enrichment principle devised by Reinschl\"ussel and Arnold arXiv:2402.16580 [stat.ME] to improve the Lasso-based selection of ADF models, we propose a composite statistic and analyse its asymptotic distribution and local power function. Monte Carlo evidence shows that the combined test dominates the comparable post-selection inference methods of Tibshirani et al. [JASA, 2016, 514, 600-620] and may surpass the power of established unit root tests against local alternatives. We apply the new tests to groundwater level time series for Germany and find evidence rejecting stochastic trends to explain observed long-term declines in mean water levels.


title: Deep Learning Method for Computing Committor Functions with Adaptive Sampling

abstract: The committor function is a central object for quantifying the transitions between metastable states of dynamical systems. Recently, a number of computational methods based on deep neural networks have been developed for computing the high-dimensional committor function. The success of the methods relies on sampling adequate data for the transition, which still is a challenging task for complex systems at low temperatures. In this work, we propose a deep learning method with two novel adaptive sampling schemes (I and II). In the two schemes, the data are generated actively with a modified potential where the bias potential is constructed from the learned committor function. We theoretically demonstrate the advantages of the sampling schemes and show that the data in sampling scheme II are uniformly distributed along the transition tube. This makes a promising method for studying the transition of complex systems. The efficiency of the method is illustrated in high-dimensional systems including the alanine dipeptide and a solvated dimer system.


title: Leveraging edge detection and neural networks for better UAV localization

abstract: We propose a novel method for geolocalizing Unmanned Aerial Vehicles (UAVs) in environments lacking Global Navigation Satellite Systems (GNSS). Current state-of-the-art techniques employ an offline-trained encoder to generate a vector representation (embedding) of the UAV's current view, which is then compared with pre-computed embeddings of geo-referenced images to determine the UAV's position. Here, we demonstrate that the performance of these methods can be significantly enhanced by preprocessing the images to extract their edges, which exhibit robustness to seasonal and illumination variations. Furthermore, we establish that utilizing edges enhances resilience to orientation and altitude inaccuracies. Additionally, we introduce a confidence criterion for localization. Our findings are substantiated through synthetic experiments.


title: Straight to zigzag transition of foam pseudo Plateau borders on textured surfaces

abstract: The structure of liquid foams follows simple geometric rules formulated by Plateau 150 years ago. By placing such foam on a microtextured hydrophilic surface, we show that the bubble footprint exhibits a morphological transition. This transition concerns the liquid channels, also called pseudo Plateau borders, which are straight between vertices on a smooth surface. We demonstrate experimentally that for a sufficiently large roughness size compared to the width of the liquid channels, the footprint adopts a zigzag shape. This transition is associated with the absence of a wetting film between the pillars caused by capillary suction of the foam, observed by confocal microscopy. We rationalize the number of zigzag segments by a geometric distribution describing the observations made with the footprint perimeter and the mesh size of the asperities.


title: Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models

abstract: While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data. Specifically, we introduce a variety of different techniques to assess whether a language model has seen a tabular dataset during training. This investigation reveals that LLMs have memorized many popular tabular datasets verbatim. We then compare the few-shot learning performance of LLMs on datasets that were seen during training to the performance on datasets released after training. We find that LLMs perform better on datasets seen during training, indicating that memorization leads to overfitting. At the same time, LLMs show non-trivial performance on novel datasets and are surprisingly robust to data transformations. We then investigate the in-context statistical learning abilities of LLMs. Without fine-tuning, we find them to be limited. This suggests that much of the few-shot performance on novel datasets is due to the LLM's world knowledge. Overall, our results highlight the importance of testing whether an LLM has seen an evaluation dataset during pre-training. We make the exposure tests we developed available as the tabmemcheck Python package at https://github.com/interpretml/LLM-Tabular-Memorization-Checker


title: Coherence and imaginarity of quantum states

abstract: Baumgratz, Cramer and Plenio established a rigorous framework (BCP framework) for quantifying the coherence of quantum states [\href{http://dx.doi.org/10.1103/PhysRevLett.113.140401}{Phys. Rev. Lett. 113, 140401 (2014)}]. In BCP framework, a quantum state is called incoherent if it is diagonal in the fixed orthonormal basis, and a coherence measure should satisfy some conditions. For a fixed orthonormal basis, if a quantum state $\rho $ has nonzero imaginary part, then $\rho $ must be coherent. How to quantitatively characterize this fact? In this work, we show that any coherence measure $C$ in BCP framework has the property $C(\rho )-C($Re$\rho )\geq 0$ if $C$ is invariant under state complex conjugation, i.e., $C(\rho )=C(\rho ^{\ast })$, here $\rho ^{\ast }$ is the conjugate of $\rho ,$ Re$\rho $ is the real part of $\rho .$ If $C$ does not satisfy $C(\rho )=C(\rho ^{\ast }),$ we can define a new coherence measure $C^{\prime }(\rho )=\frac{1}{2}[C(\rho )+C(\rho ^{\ast })]$ such that $C^{\prime }(\rho )=C^{\prime }(\rho ^{\ast }).$ We also establish some similar results for bosonic Gaussian states.


title: Unified Physical-Digital Attack Detection Challenge

abstract: Face Anti-Spoofing (FAS) is crucial to safeguard Face Recognition (FR) Systems. In real-world scenarios, FRs are confronted with both physical and digital attacks. However, existing algorithms often address only one type of attack at a time, which poses significant limitations in real-world scenarios where FR systems face hybrid physical-digital threats. To facilitate the research of Unified Attack Detection (UAD) algorithms, a large-scale UniAttackData dataset has been collected. UniAttackData is the largest public dataset for Unified Attack Detection, with a total of 28,706 videos, where each unique identity encompasses all advanced attack types. Based on this dataset, we organized a Unified Physical-Digital Face Attack Detection Challenge to boost the research in Unified Attack Detections. It attracted 136 teams for the development phase, with 13 qualifying for the final round. The results re-verified by the organizing team were used for the final ranking. This paper comprehensively reviews the challenge, detailing the dataset introduction, protocol definition, evaluation criteria, and a summary of published results. Finally, we focus on the detailed analysis of the highest-performing algorithms and offer potential directions for unified physical-digital attack detection inspired by this competition. Challenge Website: https://sites.google.com/view/face-anti-spoofing-challenge/welcome/challengecvpr2024.


title: OmniFusion Technical Report

abstract: Last year, multimodal architectures served up a revolution in AI-based approaches and solutions, extending the capabilities of large language models (LLM). We propose an \textit{OmniFusion} model based on a pretrained LLM and adapters for visual modality. We evaluated and compared several architecture design principles for better text and visual data coupling: MLP and transformer adapters, various CLIP ViT-based encoders (SigLIP, InternVIT, etc.), and their fusing approach, image encoding method (whole image or tiles encoding) and two 7B LLMs (the proprietary one and open-source Mistral). Experiments on 8 visual-language benchmarks show the top score for the best OmniFusion setup in terms of different VQA tasks in comparison with open-source LLaVA-like solutions: VizWiz, Pope, MM-Vet, ScienceQA, MMBench, TextVQA, VQAv2, MMMU. We also propose a variety of situations, where OmniFusion provides highly-detailed answers in different domains: housekeeping, sightseeing, culture, medicine, handwritten and scanned equations recognition, etc. Mistral-based OmniFusion model is an open-source solution with weights, training and inference scripts available at https://github.com/AIRI-Institute/OmniFusion.


title: Quantum Approach to Bound States in Field Theory

abstract: It is well known that (possibly non-unique) suitable field dynamics can be prescribed in spacetimes with timelike boundaries by means of appropriate boundary conditions. In Ref. [J. Math. Phys. {\bf 21}, 2802 (1980)], Wald derived a conserved energy functional for each prescribed dynamics. This conserved energy is related to the positive self-adjoint extensions of the spatial part $A$ of the wave equation $\partial^2\Phi/\partial t^2=-A\Phi$ ($A$ may not be, in principle, essentially self-adjoint). This is quite surprising since the canonical energy is not conserved in these cases. In this paper, we rederive this energy functional from an action principle (with appropriate boundary terms) following Ref. [Phys. Rev. D, {\bf 69}, 085005, (2004)] and consider field dynamics arising from non-positive self-adjoint extensions of $A$. The spectrum of the resulting theory fails to be positive and unstable mode solutions for classical fields come to light. By studying fields in half-Minkowski spacetime, we illustrate that these unstable classical solutions come as a consequence of an inverted parabolic potential governing their dynamics. From the quantum mechanical point of view, this leads to an effective inverted harmonic oscillator at the boundary. We then explore these unstable modes behavior, as well as their instabilities, at the quantum level.


title: [Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus

abstract: After last year's successful BabyLM Challenge, the competition will be hosted again in 2024/2025. The overarching goals of the challenge remain the same; however, some of the competition rules will be different. The big changes for this year's competition are as follows: First, we replace the loose track with a paper track, which allows (for example) non-model-based submissions, novel cognitively-inspired benchmarks, or analysis techniques. Second, we are relaxing the rules around pretraining data, and will now allow participants to construct their own datasets provided they stay within the 100M-word or 10M-word budget. Third, we introduce a multimodal vision-and-language track, and will release a corpus of 50% text-only and 50% image-text multimodal data as a starting point for LM model training. The purpose of this CfP is to provide rules for this year's challenge, explain these rule changes and their rationale in greater detail, give a timeline of this year's competition, and provide answers to frequently asked questions from last year's challenge.


title: Affine complements in the projective space with the trivial group of automorphisms

abstract: We construct a new class of affine complements ${\mathbb P}^M\setminus S$ with the trivial group of automorphisms, where $S\subset {\mathbb P}^M$ is a rational hypersurface, $M\geqslant 5$.


title: Privacy-preserving Scanpath Comparison for Pervasive Eye Tracking

abstract: As eye tracking becomes pervasive with screen-based devices and head-mounted displays, privacy concerns regarding eye-tracking data have escalated. While state-of-the-art approaches for privacy-preserving eye tracking mostly involve differential privacy and empirical data manipulations, previous research has not focused on methods for scanpaths. We introduce a novel privacy-preserving scanpath comparison protocol designed for the widely used Needleman-Wunsch algorithm, a generalized version of the edit distance algorithm. Particularly, by incorporating the Paillier homomorphic encryption scheme, our protocol ensures that no private information is revealed. Furthermore, we introduce a random processing strategy and a multi-layered masking method to obfuscate the values while preserving the original order of encrypted editing operation costs. This minimizes communication overhead, requiring a single communication round for each iteration of the Needleman-Wunsch process. We demonstrate the efficiency and applicability of our protocol on three publicly available datasets with comprehensive computational performance analyses and make our source code publicly accessible.


title: VI-OOD: A Unified Representation Learning Framework for Textual Out-of-distribution Detection

abstract: Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD detection has received less attention. Only a few attempts have been made to directly apply general OOD detection methods to natural language processing (NLP) tasks, without adequately considering the characteristics of textual data. In this paper, we delve into textual OOD detection with Transformers. We first identify a key problem prevalent in existing OOD detection methods: the biased representation learned through the maximization of the conditional likelihood $p(y\mid x)$ can potentially result in subpar performance. We then propose a novel variational inference framework for OOD detection (VI-OOD), which maximizes the likelihood of the joint distribution $p(x, y)$ instead of $p(y\mid x)$. VI-OOD is tailored for textual OOD detection by efficiently exploiting the representations of pre-trained Transformers. Through comprehensive experiments on various text classification tasks, VI-OOD demonstrates its effectiveness and wide applicability. Our code has been released at \url{https://github.com/liam0949/LLM-OOD}.


title: Quantum Circuit $C^*$-algebra Net

abstract: This paper introduces quantum circuit $C^*$-algebra net, which provides a connection between $C^*$-algebra nets proposed in classical machine learning and quantum circuits. Using $C^*$-algebra, a generalization of the space of complex numbers, we can represent quantum gates as weight parameters of a neural network. By introducing additional parameters, we can induce interaction among multiple circuits constructed by quantum gates. This interaction enables the circuits to share information among them, which contributes to improved generalization performance in machine learning tasks. As an application, we propose to use the quantum circuit $C^*$-algebra net to encode classical data into quantum states, which enables us to integrate classical data into quantum algorithms. Numerical results demonstrate that the interaction among circuits improves performance significantly in image classification, and encoded data by the quantum circuit $C^*$-algebra net are useful for downstream quantum machine learning tasks.


title: Automatic Defect Detection in Sewer Network Using Deep Learning Based Object Detector

abstract: Maintaining sewer systems in large cities is important, but also time and effort consuming, because visual inspections are currently done manually. To reduce the amount of aforementioned manual work, defects within sewer pipes should be located and classified automatically. In the past, multiple works have attempted solving this problem using classical image processing, machine learning, or a combination of those. However, each provided solution only focus on detecting a limited set of defect/structure types, such as fissure, root, and/or connection. Furthermore, due to the use of hand-crafted features and small training datasets, generalization is also problematic. In order to overcome these deficits, a sizable dataset with 14.7 km of various sewer pipes were annotated by sewer maintenance experts in the scope of this work. On top of that, an object detector (EfficientDet-D0) was trained for automatic defect detection. From the result of several expermients, peculiar natures of defects in the context of object detection, which greatly effect annotation and training process, are found and discussed. At the end, the final detector was able to detect 83% of defects in the test set; out of the missing 17%, only 0.77% are very severe defects. This work provides an example of applying deep learning-based object detection into an important but quiet engineering field. It also gives some practical pointers on how to annotate peculiar "object", such as defects.


title: Zero-Shot Relational Learning for Multimodal Knowledge Graphs

abstract: Relational learning is an essential task in the domain of knowledge representation, particularly in knowledge graph completion (KGC).While relational learning in traditional single-modal settings has been extensively studied, exploring it within a multimodal KGC context presents distinct challenges and opportunities. One of the major challenges is inference on newly discovered relations without any associated training data. This zero-shot relational learning scenario poses unique requirements for multimodal KGC, i.e., utilizing multimodality to facilitate relational learning. However, existing works fail to support the leverage of multimodal information and leave the problem unexplored. In this paper, we propose a novel end-to-end framework, consisting of three components, i.e., multimodal learner, structure consolidator, and relation embedding generator, to integrate diverse multimodal information and knowledge graph structures to facilitate the zero-shot relational learning. Evaluation results on two multimodal knowledge graphs demonstrate the superior performance of our proposed method.


title: Polarization and quantum entanglement effects in $B^\pm_c\to J/\psi+\pi^\pm +\pi^0$ process

abstract: Motivated by the very recent observation of the $B^+_c\to J/\psi+\pi^+ +\pi^0$ decay using proton-proton collision data by the LHCb collaboration, we study the four-body angular distributions and the quantum entanglement effects in the $B^+_c\to J/\psi+\pi^+ +\pi^0$ associated with $J/\psi\to \mu^++\mu^-$. The helicity angular distributions are given in the QCD effective theory and the von Neumann entropy is obtained in $B^\pm_c\to J/\psi(\to \mu^+\mu^-)+\rho^\pm(\to \pi^\pm \pi^0)$ decay process.


title: Lifetimes of excited states in Rh-

abstract: The radiative decay of excited states of the negative ion of rhodium, Rh$^-$, has been investigated experimentally and theoretically. The experiments were conducted at the Double ElectroStatic Ion Ring Experiment (DESIREE) facility at Stockholm University using selective photodetachment from a stored ion beam to monitor the time evolution of the excited state populations. The lifetimes of the Rh$^-$ $^3F_{3}$ and $^3F_{2}$ fine structure levels were measured to be 3.2(6)~s and 21(4)~s, respectively. An additional, previously unreported, higher-lying bound state of mixed $^1D_2+^3P_2+(4d^95s)^1D_2+^3F_2$ composition was observed and found to have a lifetime of 10.9(8)s. The binding energy of this state was determined to be in the interval $0.1584(2) $ eV $ < E_b < 0.2669(2)$ eV, using laser photodetachment threshold (LPT) spectroscopy. An autodetaching state with a lifetime of 480(10) microseconds was also observed. Theoretical calculations of the excited-state compositions, energies, and magnetic-dipole transition lifetimes were performed using the multiconfiguration Dirac-Hartree-Fock and relativistic configuration interaction methods. The calculated lifetimes of the $^3F_{3}$ and $^3F_{2}$ fine structure levels are in excellent agreement with the measured values. The present study should provide valuable insights into electron correlation effects in negative ions and forbidden radiative transitions.


title: Dark sterile neutrinos on a linear seesaw of neutrino masses

abstract: Sterile neutrinos as source of the mass and flavor mixing of active neutrinos as well as genesis of the dark matter (DM) and matter-antimatter asymmetry have gained special interest. Here we study the case of the Standard Model (SM) extended with three right-handed (RH) neutrinos and a dark sector with two extra sterile neutrinos, odd under a discrete $Z_2$ symmetry. The RH neutrinos are responsible for producing the baryon asymmetry via the high-scale unflavored leptogenesis. They are superheavy and their abundance at the electroweak broken stage is vanishingly small, so that they have no impact on the phenomenology at low energies. The two dark neutrinos generate the tiny mass of two active neutrinos through a mechanism similar to the minimal linear seesaw, and saturate the relic abundance as freeze-in DM via decay of the heavy SM bosons. The absence of the dark Majorana mass terms in the dark linear seesaw is explained by invoking a hidden symmetry, the so-called presymmetry, and the DM candidate appears in the form of a quasi-Dirac neutrino. The $Z_2$ symmetry is broken in the dark neutrino sector, but exact in the realm of RH neutrinos. The required coupling weakness for the freeze-in DM neutrino is related to a very small breach of unitarity in the active neutrino mixing matrix. We show how phenomenological constraints on the production and decay of the DM neutrino imply an upper bound around 1 MeV for its mass and unitarity up to $\mathcal{O}(10^{-7})$ for the mixing matrix.


title: Low-Cost Generation and Evaluation of Dictionary Example Sentences

abstract: Dictionary example sentences play an important role in illustrating word definitions and usage, but manually creating quality sentences is challenging. Prior works have demonstrated that language models can be trained to generate example sentences. However, they relied on costly customized models and word sense datasets for generation and evaluation of their work. Rapid advancements in foundational models present the opportunity to create low-cost, zero-shot methods for the generation and evaluation of dictionary example sentences. We introduce a new automatic evaluation metric called OxfordEval that measures the win-rate of generated sentences against existing Oxford Dictionary sentences. OxfordEval shows high alignment with human judgments, enabling large-scale automated quality evaluation. We experiment with various LLMs and configurations to generate dictionary sentences across word classes. We complement this with a novel approach of using masked language models to identify and select sentences that best exemplify word meaning. The eventual model, FM-MLM, achieves over 85.1% win rate against Oxford baseline sentences according to OxfordEval, compared to 39.8% win rate for prior model-generated sentences.


title: Message Passing Variational Autoregressive Network for Solving Intractable Ising Models

abstract: Many deep neural networks have been used to solve Ising models, including autoregressive neural networks, convolutional neural networks, recurrent neural networks, and graph neural networks. Learning a probability distribution of energy configuration or finding the ground states of a disordered, fully connected Ising model is essential for statistical mechanics and NP-hard problems. Despite tremendous efforts, a neural network architecture with the ability to high-accurately solve these fully connected and extremely intractable problems on larger systems is still lacking. Here we propose a variational autoregressive architecture with a message passing mechanism, which can effectively utilize the interactions between spin variables. The new network trained under an annealing framework outperforms existing methods in solving several prototypical Ising spin Hamiltonians, especially for larger spin systems at low temperatures. The advantages also come from the great mitigation of mode collapse during the training process of deep neural networks. Considering these extremely difficult problems to be solved, our method extends the current computational limits of unsupervised neural networks to solve combinatorial optimization problems.


title: Precision measurements on Si-

abstract: High-precision measurements of the electron affinities (EA) of the three stable isotopes of silicon, $^{28}$Si, $^{29}$Si and $^{30}$Si, have been performed at the cryogenic electrostatic ion-beam storage ring DESIREE. The quantum states of the ions were manipulated using laser depletion, and the ions were photodetached by laser photodetachment threshold spectroscopy. These EA values are the first reported for $^{29}$Si$^-$ and $^{30}$Si$^-$ and provide a reduced uncertainty for $^{28}$Si$^-$. The resulting EAs are $EA(^{28}$Si$) = 1.38952201(17)$ eV, $EA(^{29}$Si$) = 1.38952172(12)$ eV and $EA(^{29}$Si$) = 1.38952078(12)$ eV, with the corresponding isotope shifts $IS(^{29-28}$Si$) = 0.29(16)$ micro eV and $IS(^{30-28}$Si$) = 1.23(16) $ micro eV. In addition to these measurements, the resolution and signal-to-background level was sufficient to reveal the hyperfine structure splitting in the $^{29}$Si$^-$ isotope, which we report to be $1.8(4) micro eV.


title: Multimodal Road Network Generation Based on Large Language Model

abstract: With the increasing popularity of ChatGPT, large language models (LLMs) have demonstrated their capabilities in communication and reasoning, promising for transportation sector intelligentization. However, they still face challenges in domain-specific knowledge. This paper aims to leverage LLMs' reasoning and recognition abilities to replace traditional user interfaces and create an "intelligent operating system" for transportation simulation software, exploring their potential with transportation modeling and simulation. We introduce Network Generation AI (NGAI), integrating LLMs with road network modeling plugins, validated through experiments for accuracy and robustness. NGAI's effective use has reduced modeling costs, revolutionized transportation simulations, optimized user steps, and proposed a novel approach for LLM integration in the transportation field.


title: Understanding Cross-Lingual Alignment -- A Survey

abstract: Cross-lingual alignment, the meaningful similarity of representations across languages in multilingual language models, has been an active field of research in recent years. We survey the literature of techniques to improve cross-lingual alignment, providing a taxonomy of methods and summarising insights from throughout the field. We present different understandings of cross-lingual alignment and their limitations. We provide a qualitative summary of results from a large number of surveyed papers. Finally, we discuss how these insights may be applied not only to encoder models, where this topic has been heavily studied, but also to encoder-decoder or even decoder-only models, and argue that an effective trade-off between language-neutral and language-specific information is key.


title: Towards Autonomous Driving with Small-Scale Cars: A Survey of Recent Development

abstract: While engaging with the unfolding revolution in autonomous driving, a challenge presents itself, how can we effectively raise awareness within society about this transformative trend? While full-scale autonomous driving vehicles often come with a hefty price tag, the emergence of small-scale car platforms offers a compelling alternative. These platforms not only serve as valuable educational tools for the broader public and young generations but also function as robust research platforms, contributing significantly to the ongoing advancements in autonomous driving technology. This survey outlines various small-scale car platforms, categorizing them and detailing the research advancements accomplished through their usage. The conclusion provides proposals for promising future directions in the field.


title: Aggressive or Imperceptible, or Both: Network Pruning Assisted Hybrid Byzantines in Federated Learning

abstract: Federated learning (FL) has been introduced to enable a large number of clients, possibly mobile devices, to collaborate on generating a generalized machine learning model thanks to utilizing a larger number of local samples without sharing to offer certain privacy to collaborating clients. However, due to the participation of a large number of clients, it is often difficult to profile and verify each client, which leads to a security threat that malicious participants may hamper the accuracy of the trained model by conveying poisoned models during the training. Hence, the aggregation framework at the parameter server also needs to minimize the detrimental effects of these malicious clients. A plethora of attack and defence strategies have been analyzed in the literature. However, often the Byzantine problem is analyzed solely from the outlier detection perspective, being oblivious to the topology of neural networks (NNs). In the scope of this work, we argue that by extracting certain side information specific to the NN topology, one can design stronger attacks. Hence, inspired by the sparse neural networks, we introduce a hybrid sparse Byzantine attack that is composed of two parts: one exhibiting a sparse nature and attacking only certain NN locations with higher sensitivity, and the other being more silent but accumulating over time, where each ideally targets a different type of defence mechanism, and together they form a strong but imperceptible attack. Finally, we show through extensive simulations that the proposed hybrid Byzantine attack is effective against 8 different defence methods.


title: Understanding the thermal and magnetic properties of a X-class flare in the low solar atmosphere

abstract: We analyse the spatial distribution and vertical stratification of the physical parameters of the solar atmosphere when an X-class flare occurs. We made use of observations acquired by the Interferometric Bidimensional Spectropolarimeter instrument when observing the full Stokes parameters for the Fe I 6173 A and Ca II 8542 A transitions. We analysed the observed spectra using the newly developed DeSIRe code to infer the atmospheric parameters at photospheric and chromospheric layers over the entire observed field of view. Our findings reveal that the chromosphere is characterised by temperature enhancements and strong upflows in the flare ribbon area, which indicates that the flaring event is producing hot material that is moving outwards from the Sun. We did not detect any trace of temperature enhancements or strong velocities (of any sign) at photospheric layers, signalling that the impact of the flaring event mainly happens at the middle and upper layers. The information about the magnetic field vector revealed relatively smooth stratifications with height for both magnetic field strength and inclination. Still, when examining the spatial distribution of the magnetic field inclination, we observed the presence of large-scale mixed polarities in the regions where the flare ribbon is located. These results suggest that the interaction between those mixed polarities could be the flare's triggering mechanism.


title: One-Dimensional Model for Coupled Flexural, Torsional and Extensional Motions of Elastic Beams with Embedded Point Magnets under Magnetic Fields

abstract: This paper establishes a one-dimensional theoretical model for an elastic beam with embedded point magnets in extensional, bending and torsional motions. The beam has a circular cross-section. The point magnets may be in the interior or at the ends of the beam. They are assumed to be small and rigid, and may be ferromagnetic with spontaneous magnetic moments that can change their directions with respect to the magnets. The model shows that the extensional, flexural and torsional motions of the beam may be coupled by the point magnets when an external magnetic field is applied. A few examples are given. Piezoelectric beams with point magnets are also discussed.


title: A Semantic Proof of Generalised Cut Elimination for Deep Inference

abstract: Multiplicative-Additive System Virtual (MAV) is a logic that extends Multiplicative-Additive Linear Logic with a self-dual non-commutative operator expressing the concept of "before" or "sequencing". MAV is also an extenson of the the logic Basic System Virtual (BV) with additives. Formulas in BV have an appealing reading as processes with parallel and sequential composition. MAV adds internal and external choice operators. BV and MAV are also closely related to Concurrent sKleene Algebras. Proof systems for MAV and BV are Deep Inference systems, which allow inference rules to be applied anywhere inside a structure. As with any proof system, a key question is whether proofs in MAV can be reduced to a normal form, removing detours and the introduction of structures not present in the original goal. In Sequent Calcluli systems, this property is referred to as Cut Elimination. Deep Inference systems have an analogous Cut rule and other rules that are not present in normalised proofs. Cut Elimination for Deep Inference systems has the same metatheoretic benefits as for Sequent Calculi systems, including consistency and decidability. Proofs of Cut Elimination for BV, MAV, and other Deep Inference systems present in the literature have relied on intrincate syntactic reasoning and complex termination measures. We present a concise semantic proof that all MAV proofs can be reduced to a normal form avoiding the Cut rule and other "non analytic" rules. We also develop soundness and completeness proofs of MAV (and BV) with respect to a class of models. We have mechanised all our proofs in the Agda proof assistant, which provides both assurance of their correctness as well as yielding an executable normalisation procedure.


title: The Rubin Observatory's Legacy Survey of Space and Time DP0.2 processing campaign at CC-IN2P3

abstract: The Vera C. Rubin Observatory, currently in construction in Chile, will start performing the Legacy Survey of Space and Time (LSST) in 2025 for 10 years. Its 8.4-meter telescope will survey the southern sky in less than 4 nights in six optical bands, and repeatedly generate about 2 000 exposures per night, corresponding to a data volume of about 20 TiB every night. Three data facilities are preparing to contribute to the production of the annual data releases: the US Data Facility will process 35% of the raw data, the UK data facility will process 25% of the raw data and the French data facility, operated by CC-IN2P3, will locally process the remaining 40% of the raw data. In the context of the Data Preview 0.2 (DP0.2), the Data Release Production pipelines have been executed on the DC-2 simulated dataset (generated by the Dark Energy Science Collaboration, DESC). This dataset includes 20 000 simulated exposures, representing 300 square degrees of Rubin images with a typical depth of 5 years. DP0.2 ran at the Interim Data Facility (based on Google cloud), and the full exercise was independently replicated at CC-IN2P3. During this exercise, 3 PiB of data and more than 200 million files were produced. In this contribution we will present a detailed description of the system that we set up to perform this processing campaign using CC-IN2P3's computing and storage infrastructure. Several topics will be addressed: workflow generation and execution, batch job submission, memory and I/O requirements, etc. We will focus on the issues that arose during this campaign and how we addressed them and will present some perspectives after this exercise.


title: Universal Deformations and Inhomogeneities in Isotropic Cauchy Elasticity

abstract: For a given class of materials, \emph{universal deformations} are those deformations that can be maintained in the absence of body forces and by applying solely boundary tractions. For inhomogeneous bodies, in addition to the universality constraints that determine the universal deformations, there are extra constraints on the form of the material inhomogeneities -- \emph{universal inhomogeneity constraints}. Those inhomogeneities compatible with the universal inhomogeneity constraints are called \emph{universal inhomogeneities}. In a Cauchy elastic solid, stress at a given point and at an instance of time is a function of strain at that point and that exact moment in time, without any dependence on prior history. A Cauchy elastic solid does not necessarily have an energy function, i.e., Cauchy elastic solids are, in general, non-hyperelastic (or non-Green elastic). In this paper we characterize universal deformations in both compressible and incompressible inhomogeneous isotropic Cauchy elasticity. As Cauchy elasticity includes hyperelasticity, one expects the universal deformations of Cauchy elasticity to be a subset of those of hyperelasticity both in the compressible and incompressible cases. It is also expected that the universal inhomogeneity constraints to be more strict than those of hyperelasticity, and hence, the set of universal inhomogeneities to be smaller than that of hyperelasticity. We prove the unexpected result that the sets of universal deformations of isotropic Cauchy elasticity and isotropic hyperelasticity are identical, in both the compressible and incompressible cases. We also prove that their corresponding universal inhomogeneities are identical as well.


title: Towards Robust Domain Generation Algorithm Classification

abstract: In this work, we conduct a comprehensive study on the robustness of domain generation algorithm (DGA) classifiers. We implement 32 white-box attacks, 19 of which are very effective and induce a false-negative rate (FNR) of $\approx$ 100\% on unhardened classifiers. To defend the classifiers, we evaluate different hardening approaches and propose a novel training scheme that leverages adversarial latent space vectors and discretized adversarial domains to significantly improve robustness. In our study, we highlight a pitfall to avoid when hardening classifiers and uncover training biases that can be easily exploited by attackers to bypass detection, but which can be mitigated by adversarial training (AT). In our study, we do not observe any trade-off between robustness and performance, on the contrary, hardening improves a classifier's detection performance for known and unknown DGAs. We implement all attacks and defenses discussed in this paper as a standalone library, which we make publicly available to facilitate hardening of DGA classifiers: https://gitlab.com/rwth-itsec/robust-dga-detection


title: Intra- and intercycle analysis of intraband high-order harmonic generation

abstract: We study intraband high-order harmonic generation arising from a band-gap material driven by a linearly polarized laser field. We factorize the intraband high-order harmonic-generation signal into intracycle and intercycle terms. The intracycle term uniquely determines the spectral characteristics whereas the intercycle term merely modulates the spectral features by imposing energy conservation in the long-pulse limit. Through analysis of the intracycle interference, the cutoff is identified, and the origin of the harmonic selection rules is revealed. Further, it is outlined how different components of the bandstructure contribute to different regions of the harmonic spectrum, giving rise to non-trivial intensity scaling of individual harmonics in the plateau region.


title: Least Squares-Based Permutation Tests in Time Series

abstract: This paper studies permutation tests for regression parameters in a time series setting, where the time series is assumed stationary but may exhibit an arbitrary (but weak) dependence structure. In such a setting, it is perhaps surprising that permutation tests can offer any type of inference guarantees, since permuting of covariates can destroy its relationship with the response. Indeed, the fundamental assumption of exchangeability of errors required for the finite-sample exactness of permutation tests, can easily fail. However, we show that permutation tests may be constructed which are asymptotically valid for a wide class of stationary processes, but remain exact when exchangeability holds. We also consider the problem of testing for no monotone trend and we construct asymptotically valid permutation tests in this setting as well.


title: Permutation Testing for Monotone Trend

abstract: In this paper, we consider the fundamental problem of testing for monotone trend in a time series. While the term "trend" is commonly used and has an intuitive meaning, it is first crucial to specify its exact meaning in a hypothesis testing context. A commonly used well-known test is the Mann-Kendall test, which we show does not offer Type 1 error control even in large samples. On the other hand, by an appropriate studentization of the Mann-Kendall statistic, we construct permutation tests that offer asymptotic error control quite generally, but retain the exactness property of permutation tests for i.i.d. observations. We also introduce "local" Mann-Kendall statistics as a means of testing for local rather than global trend in a time series. Similar properties of permutation tests are obtained for these tests as well.


title: Hyperparameter-Free Medical Image Synthesis for Sharing Data and Improving Site-Specific Segmentation

abstract: Sharing synthetic medical images is a promising alternative to sharing real images that can improve patient privacy and data security. To get good results, existing methods for medical image synthesis must be manually adjusted when they are applied to unseen data. To remove this manual burden, we introduce a Hyperparameter-Free distributed learning method for automatic medical image Synthesis, Sharing, and Segmentation called HyFree-S3. For three diverse segmentation settings (pelvic MRIs, lung X-rays, polyp photos), the use of HyFree-S3 results in improved performance over training only with site-specific data (in the majority of cases). The hyperparameter-free nature of the method should make data synthesis and sharing easier, potentially leading to an increase in the quantity of available data and consequently the quality of the models trained that may ultimately be applied in the clinic. Our code is available at https://github.com/AwesomeLemon/HyFree-S3


title: Confirmable Workflows in OSCAR

abstract: We discuss what is special about the reproducibility of workflows in computer algebra. It is emphasized how the programming language Julia and the new computer algebra system OSCAR support such a reproducibility, and how users can benefit for their own work.


title: Redshift drift in a universe with structure III: Numerical relativity

abstract: Measurements of the cosmic redshift drift - the change in redshift of a source over time - will enable independent detection of cosmological expansion thanks to the immense precision soon reached by new facilities such as the Square Kilometer Array Observatory and the Extremely Large Telescope. We conduct the first ever redshift drift computation in fully relativistic cosmological simulations, with the simulations performed with the Einstein Toolkit. We compute the redshift drift over the full skies of 50 synthetic observers in the simulation. We compare all-sky averages for each observer - and across all observers - to the Einstein-de Sitter (EdS) model which represents the large-scale spatially-averaged spacetime of the simulation. We find that at $z\approx0.2$ the mean redshift drift across the sky for all observers deviates from the EdS prediction at the percent level, reducing to $\sim0.1\%$ by $z\approx 1$. However, fluctuations in the redshift drift across the sky are $\sim 10-30\%$ at $z\approx 0.1$ and a few percent at $z\approx 0.5$. Such fluctuations are large enough to potentially exceed the expected precision of upcoming redshift drift measurements. Additionally, we find that along 0.48% of the light rays the redshift drift becomes temporarily positive at very low redshift of $z\lesssim 0.02$. This occurs despite our simulation data being based on a matter-dominated model universe. By including a cosmological constant, we expect a slower growth of structures than in the leading-order EdS space-time, and this may reduce the anisotropy over the observers' skies, although we generally expect our results to hold as order-of-magnitude estimates. Redshift drift is arguably one of the most important measurements to be made by next-generation telescopes. Our results collectively serve as preparation for interpreting such a measurement in the presence of realistic cosmic structures.


title: ActNetFormer: Transformer-ResNet Hybrid Method for Semi-Supervised Action Recognition in Videos

abstract: Human action or activity recognition in videos is a fundamental task in computer vision with applications in surveillance and monitoring, self-driving cars, sports analytics, human-robot interaction and many more. Traditional supervised methods require large annotated datasets for training, which are expensive and time-consuming to acquire. This work proposes a novel approach using Cross-Architecture Pseudo-Labeling with contrastive learning for semi-supervised action recognition. Our framework leverages both labeled and unlabelled data to robustly learn action representations in videos, combining pseudo-labeling with contrastive learning for effective learning from both types of samples. We introduce a novel cross-architecture approach where 3D Convolutional Neural Networks (3D CNNs) and video transformers (VIT) are utilised to capture different aspects of action representations; hence we call it ActNetFormer. The 3D CNNs excel at capturing spatial features and local dependencies in the temporal domain, while VIT excels at capturing long-range dependencies across frames. By integrating these complementary architectures within the ActNetFormer framework, our approach can effectively capture both local and global contextual information of an action. This comprehensive representation learning enables the model to achieve better performance in semi-supervised action recognition tasks by leveraging the strengths of each of these architectures. Experimental results on standard action recognition datasets demonstrate that our approach performs better than the existing methods, achieving state-of-the-art performance with only a fraction of labeled data. The official website of this work is available at: https://github.com/rana2149/ActNetFormer.


title: Anchor-based Robust Finetuning of Vision-Language Models

abstract: We aim at finetuning a vision-language model without hurting its out-of-distribution (OOD) generalization. We address two types of OOD generalization, i.e., i) domain shift such as natural to sketch images, and ii) zero-shot capability to recognize the category that was not contained in the finetune data. Arguably, the diminished OOD generalization after finetuning stems from the excessively simplified finetuning target, which only provides the class information, such as ``a photo of a [CLASS]''. This is distinct from the process in that CLIP was pretrained, where there is abundant text supervision with rich semantic information. Therefore, we propose to compensate for the finetune process using auxiliary supervision with rich semantic information, which acts as anchors to preserve the OOD generalization. Specifically, two types of anchors are elaborated in our method, including i) text-compensated anchor which uses the images from the finetune set but enriches the text supervision from a pretrained captioner, ii) image-text-pair anchor which is retrieved from the dataset similar to pretraining data of CLIP according to the downstream task, associating with the original CLIP text with rich semantics. Those anchors are utilized as auxiliary semantic information to maintain the original feature space of CLIP, thereby preserving the OOD generalization capabilities. Comprehensive experiments demonstrate that our method achieves in-distribution performance akin to conventional finetuning while attaining new state-of-the-art results on domain shift and zero-shot learning benchmarks.


title: On cubic graphs having the maximal coalition number

abstract: A coalition in a graph $G$ with vertex set $V$ consists of two disjoint sets $V_1, V_2\subset V$ such that neither $V_1$ nor $V_2$ is a dominating set, but the union $V_1\cup V_2$ is a dominating set in $G$. A partition of graph vertices is called a coalition partition $\mathcal{P}$ if every non-dominating set of $\mathcal{P}$ is a member of a coalition and every dominating set is a single-vertex set. The coalition number $C(G)$ of a graph $G$ is the maximum cardinality of its coalition partition. It is known that for cubic graphs $C(G)\le 9$. The existence of cubic graphs with the maximal coalition number is an unsolved problem. In this paper, an infinite family of cubic graphs satisfying $C(G)=9$ is constructed.


title: GHNeRF: Learning Generalizable Human Features with Efficient Neural Radiance Fields

abstract: Recent advances in Neural Radiance Fields (NeRF) have demonstrated promising results in 3D scene representations, including 3D human representations. However, these representations often lack crucial information on the underlying human pose and structure, which is crucial for AR/VR applications and games. In this paper, we introduce a novel approach, termed GHNeRF, designed to address these limitations by learning 2D/3D joint locations of human subjects with NeRF representation. GHNeRF uses a pre-trained 2D encoder streamlined to extract essential human features from 2D images, which are then incorporated into the NeRF framework in order to encode human biomechanic features. This allows our network to simultaneously learn biomechanic features, such as joint locations, along with human geometry and texture. To assess the effectiveness of our method, we conduct a comprehensive comparison with state-of-the-art human NeRF techniques and joint estimation algorithms. Our results show that GHNeRF can achieve state-of-the-art results in near real-time.


title: LRR: Language-Driven Resamplable Continuous Representation against Adversarial Tracking Attacks

abstract: Visual object tracking plays a critical role in visual-based autonomous systems, as it aims to estimate the position and size of the object of interest within a live video. Despite significant progress made in this field, state-of-the-art (SOTA) trackers often fail when faced with adversarial perturbations in the incoming frames. This can lead to significant robustness and security issues when these trackers are deployed in the real world. To achieve high accuracy on both clean and adversarial data, we propose building a spatial-temporal continuous representation using the semantic text guidance of the object of interest. This novel continuous representation enables us to reconstruct incoming frames to maintain semantic and appearance consistency with the object of interest and its clean counterparts. As a result, our proposed method successfully defends against different SOTA adversarial tracking attacks while maintaining high accuracy on clean data. In particular, our method significantly increases tracking accuracy under adversarial attacks with around 90% relative improvement on UAV123, which is even higher than the accuracy on clean data.


title: Scalar fields, localized structures and the Starobinsky model

abstract: This work deals with the presence of localized static structures in the real line, described by relativistic real scalar fields in two spacetime dimensions. We consider models featuring both standard and modified kinematics, where we employ two intriguing potentials supporting defect solutions. The first potential can transform kink into compacton in the standard framework, while the second one is based on the inflationary Starobinsky model. Interesting possibilities unseen in previous investigations are described, in particular, for the case related to the Starobinsky potential. The addressed potentials are inserted into a broader framework, and so the extended models are described by a wider set of solutions. This investigation also reveals the presence of the twinlike behavior for a specific compact configuration, which solves two distinct models.


title: Perturbative Construction of Equilibrium States for Interacting Fermionic Field Theories

abstract: In this paper, we aim to extend to interacting massive and massless fermionic theories the recent perturbative construction of equilibrium states developed within the framework of perturbative algebraic quantum field theory. We analyze the case of interactions which depend on time by a smooth switch-on function and on space by a suitably bounded function that multiplies an interaction Lagrangian density constructed with the field of the theory. The construction is achieved by first considering the case of compact support and, in a second step, by removing the space cutoff with a suitable limit (adiabatic limit). As an application, we consider a Dirac field interacting with a classical stationary background electromagnetic potential, and we compute at first perturbative order (linear response) the expectation value of the conserved current on the equilibrium state for the interacting theory. The resulting expectation value is written as a convolution, in the space coordinates, between the electromagnetic potential and an integral kernel which, at vanishing conjugate momentum, gives the inverse of the square Debye screening length at finite temperature. The corresponding Debye screening effect is visible in the backreaction treated semiclassically of this current on the classical background electromagnetic potential sourced by a classical external current.


title: On checking $\mathrm{L}^p$-admissibility for parabolic control systems

abstract: In this note we discuss the difficulty of verifying $\mathrm{L}^p$-admissibility for $p\neq 2$ -- that even manifests in the presence of a self-adjoint semigroup generator on a Hilbert space -- and survey tests for $\mathrm{L}^p$-admissibility of given control operators. These tests are obtained by virtue of either mapping properties of boundary trace operators, yielding a characterization of admissibility via abstract interpolation spaces; or through Laplace--Carleson embeddings, slightly extending results from Jacob, Partington and Pott to a class of systems which are not necessarily diagonal with respect to sequence spaces. Special focus is laid on illustrating the theory by means of examples based on the heat equation on various domains.


title: ColorMNet: A Memory-based Deep Spatial-Temporal Feature Propagation Network for Video Colorization

abstract: How to effectively explore spatial-temporal features is important for video colorization. Instead of stacking multiple frames along the temporal dimension or recurrently propagating estimated features that will accumulate errors or cannot explore information from far-apart frames, we develop a memory-based feature propagation module that can establish reliable connections with features from far-apart frames and alleviate the influence of inaccurately estimated features. To extract better features from each frame for the above-mentioned feature propagation, we explore the features from large-pretrained visual models to guide the feature estimation of each frame so that the estimated features can model complex scenarios. In addition, we note that adjacent frames usually contain similar contents. To explore this property for better spatial and temporal feature utilization, we develop a local attention module to aggregate the features from adjacent frames in a spatial-temporal neighborhood. We formulate our memory-based feature propagation module, large-pretrained visual model guided feature estimation module, and local attention module into an end-to-end trainable network (named ColorMNet) and show that it performs favorably against state-of-the-art methods on both the benchmark datasets and real-world scenarios. The source code and pre-trained models will be available at \url{https://github.com/yyang181/colormnet}.


title: Design and Characterization of Strategy-Proof Mechanisms for Two-Facility Game on a Line

abstract: We focus on the problem of placing two facilities along a linear space to serve a group of agents. Each agent is committed to minimizing the distance between her location and the closest facility. A mechanism is an algorithm that maps the reported agent locations to the facility locations. We are interested in mechanisms without money that are deterministic, strategy-proof, and provide a bounded approximation ratio for social cost. It is a fundamental problem to characterize the family of strategy-proof mechanisms with a bounded approximation ratio. Fotakis and Tzamos already demonstrated that the deterministic strategy-proof mechanisms for the 2-facility game problem are mechanisms with a unique dictator and the leftmost-rightmost mechanism. In this paper, we first present a more refined characterization of the first family. We then reveal three new classes of strategy-proof mechanisms that show the intricacy of structure within this family. This helps us get a more complete picture of the characterization of the 2-facility game problem, and may also have value in understanding and solving more general facility allocation game problems. Besides, based on our refined characterization, we surprisingly find that prediction cannot effectively improve the performance of the mechanism in the two-facility game problem, while this methodology to overcome bad approximation ratio works in many other mechanism design problems. We show that if we require that the mechanism admits a bounded approximation ratio when the prediction is arbitrarily bad, then at the same time, the mechanism can never achieve sublinear approximation ratios even with perfect prediction.


title: From Barlow Twins to Triplet Training: Differentiating Dementia with Limited Data

abstract: Differential diagnosis of dementia is challenging due to overlapping symptoms, with structural magnetic resonance imaging (MRI) being the primary method for diagnosis. Despite the clinical value of computer-aided differential diagnosis, research has been limited, mainly due to the absence of public datasets that contain diverse types of dementia. This leaves researchers with small in-house datasets that are insufficient for training deep neural networks (DNNs). Self-supervised learning shows promise for utilizing unlabeled MRI scans in training, but small batch sizes for volumetric brain scans make its application challenging. To address these issues, we propose Triplet Training for differential diagnosis with limited target data. It consists of three key stages: (i) self-supervised pre-training on unlabeled data with Barlow Twins, (ii) self-distillation on task-related data, and (iii) fine-tuning on the target dataset. Our approach significantly outperforms traditional training strategies, achieving a balanced accuracy of 75.6%. We further provide insights into the training process by visualizing changes in the latent space after each step. Finally, we validate the robustness of Triplet Training in terms of its individual components in a comprehensive ablation study. Our code is available at https://github.com/ai-med/TripletTraining.


title: Modularity of special 0-cycles on toroidal compactifications of Shimura Varieties

abstract: We consider the generating series of appropriately completed 0-dimensional special cycles on a toroidal compactification of an orthogonal or unitary Shimura variety with values in the Chow group. We prove that it is a holomorphic Siegel, respectively Hermitian, modular form


title: A Large-Scale Simulation Method for Neuromorphic Circuits

abstract: Splitting algorithms are well-established in convex optimization and are designed to solve large-scale problems. Using such algorithms to simulate the behavior of nonlinear circuit networks provides scalable methods for the simulation and design of neuromorphic systems. For circuits made of linear capacitors and inductors with nonlinear resistive elements, we propose a splitting that breaks the network into its LTI lossless component and its static resistive component. This splitting has both physical and algorithmic advantages and allows for separate calculations in the time domain and in the frequency domain. To demonstrate the scalability of this approach, a network made from one hundred neurons modeled by the well-known FitzHugh-Nagumo circuit with all-to-all diffusive coupling is simulated.


title: Label-Efficient 3D Object Detection For Road-Side Units

abstract: Occlusion presents a significant challenge for safety-critical applications such as autonomous driving. Collaborative perception has recently attracted a large research interest thanks to the ability to enhance the perception of autonomous vehicles via deep information fusion with intelligent roadside units (RSU), thus minimizing the impact of occlusion. While significant advancement has been made, the data-hungry nature of these methods creates a major hurdle for their real-world deployment, particularly due to the need for annotated RSU data. Manually annotating the vast amount of RSU data required for training is prohibitively expensive, given the sheer number of intersections and the effort involved in annotating point clouds. We address this challenge by devising a label-efficient object detection method for RSU based on unsupervised object discovery. Our paper introduces two new modules: one for object discovery based on a spatial-temporal aggregation of point clouds, and another for refinement. Furthermore, we demonstrate that fine-tuning on a small portion of annotated data allows our object discovery models to narrow the performance gap with, or even surpass, fully supervised models. Extensive experiments are carried out in simulated and real-world datasets to evaluate our method.


title: DDPG-E2E: A Novel Policy Gradient Approach for End-to-End Communication Systems

abstract: The End-to-end (E2E) learning-based approach has great potential to reshape the existing communication systems by replacing the transceivers with deep neural networks. To this end, the E2E learning approach needs to assume the availability of prior channel information to mathematically formulate a differentiable channel layer for the backpropagation (BP) of the error gradients, thereby jointly optimizing the transmitter and the receiver. However, accurate and instantaneous channel state information is hardly obtained in practical wireless communication scenarios. Moreover, the existing E2E learning-based solutions exhibit limited performance in data transmissions with large block lengths. In this article, these practical issues are addressed by our proposed deep deterministic policy gradient-based E2E communication system. In particular, the proposed solution utilizes a reward feedback mechanism to train both the transmitter and the receiver, which alleviates the information loss of error gradients during BP. In addition, a convolutional neural network (CNN)-based architecture is developed to mitigate the curse of dimensionality problem when transmitting messages with large block lengths. Extensive simulations then demonstrate that our proposed solution can not only jointly train the transmitter and the receiver simultaneously without requiring the prior channel knowledge but also can obtain significant performance improvement on block error rate compared to state-of-the-art solutions.


title: Robust feature knowledge distillation for enhanced performance of lightweight crack segmentation models

abstract: Vision-based crack detection faces deployment challenges due to the size of robust models and edge device limitations. These can be addressed with lightweight models trained with knowledge distillation (KD). However, state-of-the-art (SOTA) KD methods compromise anti-noise robustness. This paper develops Robust Feature Knowledge Distillation (RFKD), a framework to improve robustness while retaining the precision of light models for crack segmentation. RFKD distils knowledge from a teacher model's logit layers and intermediate feature maps while leveraging mixed clean and noisy images to transfer robust patterns to the student model, improving its precision, generalisation, and anti-noise performance. To validate the proposed RFKD, a lightweight crack segmentation model, PoolingCrack Tiny (PCT), with only 0.5 M parameters, is also designed and used as the student to run the framework. The results show a significant enhancement in noisy images, with RFKD reaching a 62% enhanced mean Dice score (mDS) compared to SOTA KD methods.


title: Stress out of charmonia

abstract: We investigate the gravitational form factors of charmonium. Our method is based on a Hamiltonian formalism on the light front known as basis light-front quantization. The charmonium mass spectrum and light-front wave functions were obtained from diagonalizing an effective Hamiltonian that incorporates confinement from holographic QCD and one-gluon exchange interaction from light-front QCD. We proposed a quantum many-body approach to construct the hadronic matrix elements of the energy momentum tensor $T^{++}$ and $T^{+-}$, which are used to extract the gravitational form factors $A(Q^2)$ and $D(Q^2)$. The obtained form factors satisfy the known constraints, e.g. von Laue condition. From these quantities, we also extract the energy, pressure and light-front energy distributions of the system. We find that hadrons are multi-layer systems.


title: Distributed finite element solution using model order reduction

abstract: We present a method for the distributed finite element solution of elliptic boundary value problems using model order reduction on each subdomain of the domain decomposition. We show that the error of the reduction can be succesfully controlled in the $H^1$ norm due to the properly weighted $l^2$ low-rank approximation. Our numerical results demonstrate the technique using tetrahedral meshes with up to 85 million degrees-of-freedom on a laptop computer by distributing the bulk of the model order reduction to the cloud.


title: Playing to Vision Foundation Model's Strengths in Stereo Matching

abstract: Stereo matching has become a key technique for 3D environment perception in intelligent vehicles. For a considerable time, convolutional neural networks (CNNs) have remained the mainstream choice for feature extraction in this domain. Nonetheless, there is a growing consensus that the existing paradigm should evolve towards vision foundation models (VFM), particularly those developed based on vision Transformers (ViTs) and pre-trained through self-supervision on extensive, unlabeled datasets. While VFMs are adept at extracting informative, general-purpose visual features, specifically for dense prediction tasks, their performance often lacks in geometric vision tasks. This study serves as the first exploration of a viable approach for adapting VFMs to stereo matching. Our ViT adapter, referred to as ViTAS, is constructed upon three types of modules: spatial differentiation, patch attention fusion, and cross-attention. The first module initializes feature pyramids, while the latter two aggregate stereo and multi-scale contextual information into fine-grained features, respectively. ViTAStereo, which combines ViTAS with cost volume-based stereo matching back-end processes, achieves the top rank on the KITTI Stereo 2012 dataset and outperforms the second-best network StereoBase by approximately 7.9% in terms of the percentage of error pixels, with a tolerance of 3 pixels. Additional experiments across diverse scenarios further demonstrate its superior generalizability compared to all other state-of-the-art approaches. We believe this new paradigm will pave the way for the next generation of stereo matching networks.


title: A Constant self-consistent scattering lifetime in superconducting Strontium Ruthenate

abstract: In this numerical work, we find a self-consistent constant scattering superconducting lifetime for two different values of the disorder parameters, the inverse atomic strength, and the stoichiometric impurity in the triplet paired unconventional super-conductor strontium ruthenate. This finding is relevant for experimentalists given that the expressions for the ultrasound attenuation and the electronic thermal conductivity depend on the superconducting scattering lifetime, and a constant lifetime fits well nonequilibrium experimental data. Henceforth, this work helps experimentalists in their interpretation of the acquired data. Additionally, we encountered tiny imaginary parts of the self-energy that resembles the Miyake-Narikiyo tiny gap out-side the unitary elastic scattering limit, and below the threshold zero gap value of 1.0 meV.


title: The walled Brauer category and stable cohomology of $\mathrm{IA}_n$

abstract: The IA-automorphism group is the group of automorphisms of the free group $F_n$ that act trivially on the abelianization $F_n^{\mathrm{ab}}$. This group is in many ways analoguous to Torelli groups of surfaces and their higher dimensional analogues. In recent work, the stable rational cohomology of such groups was studied by Kupers and Randal-Williams, using the machinery of so-called Brauer categories. In this paper, we adapt their methods to study the stable rational cohomology of the IA-automorphism group. We obtain a conjectural description of the algebraic part of the stable rational cohomology and prove that it holds up to degree $Q+1$, given the assumption that the stable cohomology groups are stably finite dimensional in degrees up to $Q$. In particular, this allows us to compute the algebraic part of the stable cohomology in degree 2, which we show agrees with the part generated by the first cohomology group via the cup product map and which has previously been computed by Pettet. In the appendix, written by Mai Katada, it is shown how the results of the paper can be applied to compute the stable Albanese (co)homology of the IA-automorphism group.


title: From Stochastic Hamiltonian to Quantum Simulation: Exploring Memory Effects in Exciton Dynamics

abstract: The unraveling of open quantum system dynamics in terms of stochastic quantum trajectories offers a picture of open system dynamics that consistently considers memory effects stemming from the finite correlation time of environment fluctuations. These fluctuations significantly influence the coherence and energy transport properties of excitonic systems. When their correlation time is comparable to the timescale of the Hamiltonian evolution, it leads to the departure of open system dynamics from the Markovian limit. In this work, we leverage the unraveling of exciton dynamics through stochastic Hamiltonian propagators to design quantum circuits that simulate exciton transport, capturing finite memory effects. In addition to enabling the synthesis of parametrizable quantum circuits, stochastic unitary propagators provide a transparent framework for investigating non-Markovian effects on exciton transport. Our analysis reveals a nuanced relationship between environment correlation time and transport efficiency, identifying a regime of "memory-assisted" quantum transport where time-correlated fluctuations allow the system to reach higher efficiency. However, this property is not universal and can only be realized in conjunction with specific features of the system Hamiltonian.


title: Spatial-Temporal Multi-level Association for Video Object Segmentation

abstract: Existing semi-supervised video object segmentation methods either focus on temporal feature matching or spatial-temporal feature modeling. However, they do not address the issues of sufficient target interaction and efficient parallel processing simultaneously, thereby constraining the learning of dynamic, target-aware features. To tackle these limitations, this paper proposes a spatial-temporal multi-level association framework, which jointly associates reference frame, test frame, and object features to achieve sufficient interaction and parallel target ID association with a spatial-temporal memory bank for efficient video object segmentation. Specifically, we construct a spatial-temporal multi-level feature association module to learn better target-aware features, which formulates feature extraction and interaction as the efficient operations of object self-attention, reference object enhancement, and test reference correlation. In addition, we propose a spatial-temporal memory to assist feature association and temporal ID assignment and correlation. We evaluate the proposed method by conducting extensive experiments on numerous video object segmentation datasets, including DAVIS 2016/2017 val, DAVIS 2017 test-dev, and YouTube-VOS 2018/2019 val. The favorable performance against the state-of-the-art methods demonstrates the effectiveness of our approach. All source code and trained models will be made publicly available.


title: Quantifying the U $5f$ covalence and degree of localization in U intermetallics

abstract: A procedure for quantifying the U $5f$ electrons' covalence and degree of localization in U intermetallic compounds is presented. To this end, bulk sensitive hard and soft x-ray photoelectron spectroscopy were utilized in combination with density-functional theory (DFT) plus dynamical mean-field theory (DMFT) calculations. The energy dependence of the photoionization cross-sections allows the disentanglement of the U\,$5f$ contribution to the valence band from the various other atomic subshells so that the computational parameters in the DFT\,+\,DMFT can be reliably determined. Applying this method to UGa$_2$ and UB$_2$ as model compounds from opposite ends of the (de)localization range, we have achieved excellent simulations of the valence band and core-level spectra. The width in the distribution of atomic U\,$5f$ configurations contributing to the ground state, as obtained from the calculations, quantifies the correlated nature and degree of localization of the U\,5$f$. The findings permit answering the longstanding question why different spectroscopic techniques give seemingly different numbers for the U 5$f$ valence in intermetallic U compounds.


title: PGTNet: A Process Graph Transformer Network for Remaining Time Prediction of Business Process Instances

abstract: We present PGTNet, an approach that transforms event logs into graph datasets and leverages graph-oriented data for training Process Graph Transformer Networks to predict the remaining time of business process instances. PGTNet consistently outperforms state-of-the-art deep learning approaches across a diverse range of 20 publicly available real-world event logs. Notably, our approach is most promising for highly complex processes, where existing deep learning approaches encounter difficulties stemming from their limited ability to learn control-flow relationships among process activities and capture long-range dependencies. PGTNet addresses these challenges, while also being able to consider multiple process perspectives during the learning process.


title: Kostka polynomials of $G(\ell,1,m)$

abstract: For each integer $n, m, \ell \ge 1$ such that $n > m$, we exhibit an equivalence between the category of polynomial modules over a paraholic subalgebra $\mathfrak p$ of an affine Lie algebra of $\mathfrak{gl}(n\ell)$ and the module category of the smash product algebra $A$ of the complex reflection group $G(\ell,1,m)$ with $\mathbb C [X_1,\ldots,X_m]$. Then, we transfer the collection of $\mathfrak p$-modules considered in [Feigin-Makedonskyi-Khoroshkhin, arXiv:2311.12673] to $A$. Applying the Lusztig-Shoji algorithm [Shoji, Invent. Math. 74 (1983)] (or rather its homological variant [K. Ann. Sci. ENS 48(5) (2015)]), we conclude that the multiplicity counts of these modules yield the Kostka polynomials attached to limit symbols in the sense of [Shoji, ASPM 40 (2004)]. This particularly settles a conjecture of Shoji [loc. cit. \S 3.13] and answers a question in [Shoji, Sci. China Math. 61 (2018)].


title: A recursive smoothing method for input and state estimation of vibrating structures

abstract: Recursive Bayesian filters have been widely deployed in structural system identification where output-only filters are of higher practicality. Unfortunately, the estimation obtained by instantaneous system inversion via filters can be compromised by an ill-conditionedness of the system, which is a consequence of the architecture of the sensor network. To significantly reduce the ill-conditioning and increase the robustness to available networks, a new recursive smoothing algorithm is proposed for simultaneous input and state estimation of linear systems. Unlike the existing minimum-variance unbiased (MVU) smoothing methods that are restricted to either systems with no direct feedthrough or systems with a full-rank feedforward matrix, the proposed smoothing algorithm is universally applicable to linear systems with and without direct feedthrough as well as those with a rank-deficient feedforward matrix. The proposed smoothing method does not assume any prior knowledge of the statistical characteristics or evolutionary model pertaining to the input. A different indexing of the discrete-time input leads to a distinct linear algebra from the existing MVU smoothing methods. An eight-storey shear frame and the Taipei 101 tower in Taiwan are used as case studies, and a thorough comparison is established with the Augmented Kalman Filter, MVU filters and MVU smoothing methods. It is shown that the incorporation of singular value truncation for system inversion can result in a noticeable improvement in the estimation. Moreover, across various sensor networks and in the presence of a rank-deficient feedforward matrix, the proposed method could achieve at least 67% noise reduction compared to other filters and at least 30% improvement compared to other smoothing methods.


title: 3D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesis

abstract: In this paper, we propose a 3D geometry-aware deformable Gaussian Splatting method for dynamic view synthesis. Existing neural radiance fields (NeRF) based solutions learn the deformation in an implicit manner, which cannot incorporate 3D scene geometry. Therefore, the learned deformation is not necessarily geometrically coherent, which results in unsatisfactory dynamic view synthesis and 3D dynamic reconstruction. Recently, 3D Gaussian Splatting provides a new representation of the 3D scene, building upon which the 3D geometry could be exploited in learning the complex 3D deformation. Specifically, the scenes are represented as a collection of 3D Gaussian, where each 3D Gaussian is optimized to move and rotate over time to model the deformation. To enforce the 3D scene geometry constraint during deformation, we explicitly extract 3D geometry features and integrate them in learning the 3D deformation. In this way, our solution achieves 3D geometry-aware deformation modeling, which enables improved dynamic view synthesis and 3D dynamic reconstruction. Extensive experimental results on both synthetic and real datasets prove the superiority of our solution, which achieves new state-of-the-art performance. The project is available at https://npucvr.github.io/GaGS/


title: On the Goncharov's conjecture in degree $m-1$ and weight $m$

abstract: Let $\mathbb K$ be a field of characteristic zero. We prove that its motivic cohomology in degree $m-1$ and weight $m$ is rationally isomorphic to the cohomology of the polylogarithmic complex. This gives a partial extension of A. Suslin theorem describing the indecomposable $K_3$ of a field.


title: The Gravitational Chiral Anomaly at Finite Temperature and Density

abstract: We investigate the gravitational anomaly vertex $\langle TTJ_5\rangle$ (graviton - graviton - axial current) under conditions of finite density and temperature. Through a direct analysis of perturbative contributions, we demonstrate that neither finite temperature nor finite fermion density affects the gravitational chiral anomaly. These results find application in several contexts, from topological materials to the early universe plasma. They affect the decay of any axion or axion-like particle into gravitational waves, in very dense and hot environments.