title: Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent

abstract: Large Language Models (LLMs) have revolutionized open-domain dialogue agents but encounter challenges in multi-character role-playing (MCRP) scenarios. To address the issue, we present Neeko, an innovative framework designed for efficient multiple characters imitation. Unlike existing methods, Neeko employs a dynamic low-rank adapter (LoRA) strategy, enabling it to adapt seamlessly to diverse characters. Our framework breaks down the role-playing process into agent pre-training, multiple characters playing, and character incremental learning, effectively handling both seen and unseen roles. This dynamic approach, coupled with distinct LoRA blocks for each character, enhances Neeko's adaptability to unique attributes, personalities, and speaking patterns. As a result, Neeko demonstrates superior performance in MCRP over most existing methods, offering more engaging and versatile user interaction experiences. Code and data are available at https://github.com/weiyifan1023/Neeko.


title: $\infty$Bench: Extending Long Context Evaluation Beyond 100K Tokens

abstract: Processing and reasoning over long contexts is crucial for many practical applications of Large Language Models (LLMs), such as document comprehension and agent construction. Despite recent strides in making LLMs process contexts with more than 100K tokens, there is currently a lack of a standardized benchmark to evaluate this long-context capability. Existing public benchmarks typically focus on contexts around 10K tokens, limiting the assessment and comparison of LLMs in processing longer contexts. In this paper, we propose $\infty$Bench, the first LLM benchmark featuring an average data length surpassing 100K tokens. $\infty$Bench comprises synthetic and realistic tasks spanning diverse domains, presented in both English and Chinese. The tasks in $\infty$Bench are designed to require well understanding of long dependencies in contexts, and make simply retrieving a limited number of passages from contexts not sufficient for these tasks. In our experiments, based on $\infty$Bench, we evaluate the state-of-the-art proprietary and open-source LLMs tailored for processing long contexts. The results indicate that existing long context LLMs still require significant advancements to effectively process 100K+ context. We further present three intriguing analyses regarding the behavior of LLMs processing long context.


title: Informative Simultaneous Confidence Intervals for Graphical Test Procedures

abstract: Simultaneous confidence intervals (SCIs) that are compatible with a given closed test procedure are often non-informative. More precisely, for a one-sided null hypothesis, the bound of the SCI can stick to the border of the null hypothesis, irrespective of how far the point estimate deviates from the null hypothesis. This has been illustrated for the Bonferroni-Holm and fall-back procedures, for which alternative SCIs have been suggested, that are free of this deficiency. These informative SCIs are not fully compatible with the initial multiple test, but are close to it and hence provide similar power advantages. They provide a multiple hypothesis test with strong family-wise error rate control that can be used in replacement of the initial multiple test. The current paper extends previous work for informative SCIs to graphical test procedures. The information gained from the newly suggested SCIs is shown to be always increasing with increasing evidence against a null hypothesis. The new SCIs provide a compromise between information gain and the goal to reject as many hypotheses as possible. The SCIs are defined via a family of dual graphs and the projection method. A simple iterative algorithm for the computation of the intervals is provided. A simulation study illustrates the results for a complex graphical test procedure.


title: Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding

abstract: Speculative decoding is a widely used method that accelerates the generation process of large language models (LLMs) with no compromise in model performance. It achieves this goal by using an existing smaller model for drafting and then employing the target LLM to verify the draft in a low-cost parallel manner. Under such a drafting-verification framework, drafting efficiency has become a bottleneck in the final speedup of speculative decoding. Therefore, generating longer drafts at less cost can lead to better decoding speedup. To achieve this, we introduce Ouroboros, which can generate draft phrases to parallelize the drafting process and meanwhile lengthen drafts in a training-free manner. The experimental results on various typical text generation tasks show that Ouroboros can achieve speedups of up to $2.4\times$ over speculative decoding and $3.9\times$ over vanilla decoding, without fine-tuning draft and target models.


title: Global quark spin correlations in relativistic heavy ion collisions

abstract: The observation of the vector meson's global spin alignment by the STAR Collaboration reveals that strong spin correlations may exist for quarks and antiquarks in relativistic heavy-ion collisions in the normal direction of the reaction plane. We propose a systematic method to describe such correlations in the quark matter. The correlations can be classified as local and long range types. We show in particular that the effective quark spin correlations contain the genuine spin correlations originated directly from the dynamical process as well as those induced by averaging over other degrees of freedom. We also show that such correlations can be studied by measuring the vector meson's spin density matrix and hyperon-hyperon and hyperon-anti-hyperon spin correlations. We present the relationships between these measurable quantities and spin correlations of quarks and antiquarks.


title: Exploiting Adaptive Contextual Masking for Aspect-Based Sentiment Analysis

abstract: Aspect-Based Sentiment Analysis (ABSA) is a fine-grained linguistics problem that entails the extraction of multifaceted aspects, opinions, and sentiments from the given text. Both standalone and compound ABSA tasks have been extensively used in the literature to examine the nuanced information present in online reviews and social media posts. Current ABSA methods often rely on static hyperparameters for attention-masking mechanisms, which can struggle with context adaptation and may overlook the unique relevance of words in varied situations. This leads to challenges in accurately analyzing complex sentences containing multiple aspects with differing sentiments. In this work, we present adaptive masking methods that remove irrelevant tokens based on context to assist in Aspect Term Extraction and Aspect Sentiment Classification subtasks of ABSA. We show with our experiments that the proposed methods outperform the baseline methods in terms of accuracy and F1 scores on four benchmark online review datasets. Further, we show that the proposed methods can be extended with multiple adaptations and demonstrate a qualitative analysis of the proposed approach using sample text for aspect term extraction.


title: The Effect of Batch Size on Contrastive Self-Supervised Speech Representation Learning

abstract: Foundation models in speech are often trained using many GPUs, which implicitly leads to large effective batch sizes. In this paper we study the effect of batch size on pre-training, both in terms of statistics that can be monitored during training, and in the effect on the performance of a downstream fine-tuning task. By using batch sizes varying from 87.5 seconds to 80 minutes of speech we show that, for a fixed amount of iterations, larger batch sizes result in better pre-trained models. However, there is lower limit for stability, and an upper limit for effectiveness. We then show that the quality of the pre-trained model depends mainly on the amount of speech data seen during training, i.e., on the product of batch size and number of iterations. All results are produced with an independent implementation of the wav2vec 2.0 architecture, which to a large extent reproduces the results of the original work (arXiv:2006.11477). Our extensions can help researchers choose effective operating conditions when studying self-supervised learning in speech, and hints towards benchmarking self-supervision with a fixed amount of seen data. Code and model checkpoints are available at https://github.com/nikvaessen/w2v2-batch-size.


title: Bring Your Own Character: A Holistic Solution for Automatic Facial Animation Generation of Customized Characters

abstract: Animating virtual characters has always been a fundamental research problem in virtual reality (VR). Facial animations play a crucial role as they effectively convey emotions and attitudes of virtual humans. However, creating such facial animations can be challenging, as current methods often involve utilization of expensive motion capture devices or significant investments of time and effort from human animators in tuning animation parameters. In this paper, we propose a holistic solution to automatically animate virtual human faces. In our solution, a deep learning model was first trained to retarget the facial expression from input face images to virtual human faces by estimating the blendshape coefficients. This method offers the flexibility of generating animations with characters of different appearances and blendshape topologies. Second, a practical toolkit was developed using Unity 3D, making it compatible with the most popular VR applications. The toolkit accepts both image and video as input to animate the target virtual human faces and enables users to manipulate the animation results. Furthermore, inspired by the spirit of Human-in-the-loop (HITL), we leveraged user feedback to further improve the performance of the model and toolkit, thereby increasing the customization properties to suit user preferences. The whole solution, for which we will make the code public, has the potential to accelerate the generation of facial animations for use in VR applications.


title: Sparse and Structured Hopfield Networks

abstract: Modern Hopfield networks have enjoyed recent interest due to their connection to attention in transformers. Our paper provides a unified framework for sparse Hopfield networks by establishing a link with Fenchel-Young losses. The result is a new family of Hopfield-Fenchel-Young energies whose update rules are end-to-end differentiable sparse transformations. We reveal a connection between loss margins, sparsity, and exact memory retrieval. We further extend this framework to structured Hopfield networks via the SparseMAP transformation, which can retrieve pattern associations instead of a single pattern. Experiments on multiple instance learning and text rationalization demonstrate the usefulness of our approach.


title: ExaLogLog: Space-Efficient and Practical Approximate Distinct Counting up to the Exa-Scale

abstract: This work introduces ExaLogLog, a new data structure for approximate distinct counting, which has the same practical properties as the popular HyperLogLog algorithm. It is commutative, idempotent, mergeable, reducible, has a constant-time insert operation, and supports distinct counts up to the exa-scale. At the same time, as theoretically derived and experimentally verified, it requires 43% less space to achieve the same estimation error.


title: Variable Mass and the Noisy Feynman Propagator in Scalar Fields

abstract: We utilize a mass independent Klein-Gordon equation that is first order in a variable that plays the role of time, the approach taken in parametric time formulations. Using concepts from semigroup evolution, we examine the sign of a noisy Feynman propagator in a quantum field theory, namely, scalar electrodynamics.


title: Average gradient outer product as a mechanism for deep neural collapse

abstract: Deep Neural Collapse (DNC) refers to the surprisingly rigid structure of the data representations in the final layers of Deep Neural Networks (DNNs). Though the phenomenon has been measured in a variety of settings, its emergence is typically explained via data-agnostic approaches, such as the unconstrained features model. In this work, we introduce a data-dependent setting where DNC forms due to feature learning through the average gradient outer product (AGOP). The AGOP is defined with respect to a learned predictor and is equal to the uncentered covariance matrix of its input-output gradients averaged over the training dataset. Deep Recursive Feature Machines are a method that constructs a neural network by iteratively mapping the data with the AGOP and applying an untrained random feature map. We demonstrate theoretically and empirically that DNC occurs in Deep Recursive Feature Machines as a consequence of the projection with the AGOP matrix computed at each layer. We then provide evidence that this mechanism holds for neural networks more generally. We show that the right singular vectors and values of the weights can be responsible for the majority of within-class variability collapse for DNNs trained in the feature learning regime. As observed in recent work, this singular structure is highly correlated with that of the AGOP.


title: Hybrid Video Diffusion Models with 2D Triplane and 3D Wavelet Representation

abstract: Generating high-quality videos that synthesize desired realistic content is a challenging task due to their intricate high-dimensionality and complexity of videos. Several recent diffusion-based methods have shown comparable performance by compressing videos to a lower-dimensional latent space, using traditional video autoencoder architecture. However, such method that employ standard frame-wise 2D and 3D convolution fail to fully exploit the spatio-temporal nature of videos. To address this issue, we propose a novel hybrid video diffusion model, called HVDM, which can capture spatio-temporal dependencies more effectively. The HVDM is trained by a hybrid video autoencoder which extracts a disentangled representation of the video including: (i) a global context information captured by a 2D projected latent (ii) a local volume information captured by 3D convolutions with wavelet decomposition (iii) a frequency information for improving the video reconstruction. Based on this disentangled representation, our hybrid autoencoder provide a more comprehensive video latent enriching the generated videos with fine structures and details. Experiments on video generation benchamarks (UCF101, SkyTimelapse, and TaiChi) demonstrate that the proposed approach achieves state-of-the-art video generation quality, showing a wide range of video applications (e.g., long video generation, image-to-video, and video dynamics control).


title: Radiative Quarkonium decays into an Invisible ALP

abstract: In this talk the ALP production from radiative quarkonium decays is presented. To this purpose, the relevant cross-section is computed from a $d=5$ effective Lagrangian containing simultaneous ALP couplings to $b(c)$-quarks and photons. The interplay between resonant and non-resonant contributions is shown to be relevant for experiments operating at $\sqrt{s}=m_{\Upsilon(nS)}$, with $n=1,2,3$, while the non-resonant contribution dominates at the $\Upsilon(4S)$ resonance. These effects imply that the experimental searches performed at with different experimental setups are sensitive to complementary combinations of ALP couplings. To illustrate these results, constraints from existing BaBar, Belle and Belle II data on ALPs decaying into invisible final states are derived. Finally, constrains from the recent BESIII measurements of the $J/\Psi \to \gamma \,a$ decay rate are also included for comparison.


title: Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models

abstract: Large language models (LLMs) store extensive factual knowledge, but the underlying mechanisms remain unclear. Previous research suggests that factual knowledge is stored within multi-layer perceptron weights, and some storage units exhibit degeneracy, referred to as Degenerate Knowledge Neurons (DKNs). Despite the novelty and unique properties of this concept, it has not been rigorously defined or systematically studied. We first consider the connection weight patterns of MLP neurons and define DKNs from both structural and functional aspects. Based on this, we introduce the Neurological Topology Clustering method, which allows the formation of DKNs in any numbers and structures, leading to a more accurate DKN acquisition. Furthermore, inspired by cognitive science, we explore the relationship between DKNs and the robustness, evolvability, and complexity of LLMs. Our execution of 34 experiments under 6 settings demonstrates the connection between DKNs and these three properties. The code will be available soon.


title: On optimal error rates for strong approximation of SDEs with a drift coefficient of fractional Sobolev regularity

abstract: We study strong approximation of scalar additive noise driven stochastic differential equations (SDEs) at time point $1$ in the case that the drift coefficient is bounded and has Sobolev regularity $s\in(0,1)$. Recently, it has been shown in [arXiv:2101.12185v2 (2022)] that for such SDEs the equidistant Euler approximation achieves an $L^2$-error rate of at least $(1+s)/2$, up to an arbitrary small $\varepsilon$, in terms of the number of evaluations of the driving Brownian motion $W$. In the present article we prove a matching lower error bound for $s\in(1/2,1)$. More precisely we show that, for every $s\in(1/2,1)$, the $L^2$-error rate $(1+s)/2$ can, up to a logarithmic term, not be improved in general by no numerical method based on finitely many evaluations of $W$ at fixed time points. Up to now, this result was known in the literature only for the cases $s=1/2-$ and $s=1-$. For the proof we employ the coupling of noise technique recently introduced in [arXiv:2010.00915 (2020)] to bound the $L^2$-error of an arbitrary approximation from below by the $L^2$-distance of two occupation time functionals provided by a specifically chosen drift coefficient with Sobolev regularity $s$ and two solutions of the corresponding SDE with coupled driving Brownian motions. For the analysis of the latter distance we employ a transformation of the original SDE to overcome the problem of correlated increments of the difference of the two coupled solutions, occupation time estimates to cope with the lack of regularity of the chosen drift coefficient around the point $0$ and scaling properties of the drift coefficient.


title: Laplace's first law of errors applied to diffusive motion

abstract: In biological, glassy, and active systems, various tracers exhibit Laplace-like, i.e., exponential, spreading of the diffusing packet of particles. The limitations of the central limit theorem in fully capturing the behaviors of such diffusive processes, especially in the tails, have been studied using the continuous time random walk model. For cases when the jump length distribution is super-exponential, e.g., a Gaussian, we use large deviations theory and relate it to the appearance of exponential tails. When the jump length distribution is sub-exponential the packet of spreading particles is described by the big jump principle. We demonstrate the applicability of our approach for finite time, indicating that rare events and the asymptotics of the large deviations rate function can be sampled for large length scales within a reasonably short measurement time.


title: Testing Outlier Detection Algorithms for Identifying Early-Stage Solute Clusters in Atom Probe Tomography

abstract: Atom probe tomography is commonly used to study solute clustering and precipitation in materials. However, standard techniques, such as the density based spatial clustering applications with noise (DBSCAN) perform poorly with respect to small clusters of less than 25 atoms. This is a fundamental limitation of density-based clustering techniques due to the usage of Nmin, an arbitrary lower limit placed on cluster sizes. Therefore, this paper attempts to consider atom probe clustering as an outlier detection problem of which KNN, LOF, LUNAR algorithms were tested against a simulated dataset and compared to the standard method, for a range of cluster sizes. The decision score output of the algorithms was then auto thresholded by the Karcher mean to remove human bias. Each of the major models tested outperforms DBSCAN for cluster sizes of less than 25 atoms but underperforms for sizes greater than 30 atoms. However, the new combined kNN and DBSCAN method presented was able to perform well at all cluster sizes. The combined kNN and DBSCAN method is presented as a possible new standard approach to identifying solute clusters in atom probe tomography.


title: Branching capacity and Brownian snake capacity

abstract: The branching capacity has been introduced by [Zhu 2016] as the limit of the hitting probability of a symmetric branching random walk in $\mathbb Z^d$, $d\ge 5$. Similarly, we define the Brownian snake capacity in $\mathbb R^d$, as the scaling limit of the hitting probability by the Brownian snake starting from afar. Then, we prove our main result on the vague convergence of the rescaled branching capacity towards this Brownian snake capacity. Our proof relies on a precise convergence rate for the approximation of the branching capacity by hitting probabilities.


title: Penetrative magneto-convection of a rotating Boussinesq flow in $f$-planes

abstract: In this study, we conducted a linear instability analysis of penetrative magneto-convection in rapidly rotating Boussinesq flows within tilted f-planes, under the influence of a uniform background magnetic field. We integrated wave theory and convection theory to elucidate the penetration dynamics in rotating magneto-convection. Our findings suggest that efficient penetration in rapidly rotating flows with weakly stratified stable layers at low latitudes can be attributed to the resonance of wave transmission near the interface between unstable and stable layers. In the context of strongly stratified flows, we derived the scaling relationships of penetrative distances $\Delta$ with the stability parameter $\delta$. Our calculation shows that, for both rotation-dominated and magnetism-dominated flows, $\Delta$ obeys a scaling of $\Delta\sim O(\delta^{-1/2})$. In rotation-dominated flows, we noted a general decrease in penetrative distance with increased rotational effect, and a minor decrease in penetrative distance with increased latitude. When a background magnetic field is introduced, we observed a significant shift in penetrative distance as the Elsasser number $\Lambda$ approaches one. The penetrative distance tends to decrease when $\Lambda \ll 1$ and increase when $\Lambda \gg 1$ with the rotational effect, indicating a transition from rotation-dominated to magnetism-dominated flow. We have further investigated the impact of the background magnetic field when it is not aligned with the rotational axis. This presents a notable contrast to the case where the magnetic field is parallel to the rotational axis.

categories: physics.flu-dyn astro-ph.SR physics.ao-ph physics.geo-ph


title: SRNDiff: Short-term Rainfall Nowcasting with Condition Diffusion Model

abstract: Diffusion models are widely used in image generation because they can generate high-quality and realistic samples. This is in contrast to generative adversarial networks (GANs) and variational autoencoders (VAEs), which have some limitations in terms of image quality.We introduce the diffusion model to the precipitation forecasting task and propose a short-term precipitation nowcasting with condition diffusion model based on historical observational data, which is referred to as SRNDiff. By incorporating an additional conditional decoder module in the denoising process, SRNDiff achieves end-to-end conditional rainfall prediction. SRNDiff is composed of two networks: a denoising network and a conditional Encoder network. The conditional network is composed of multiple independent UNet networks. These networks extract conditional feature maps at different resolutions, providing accurate conditional information that guides the diffusion model for conditional generation.SRNDiff surpasses GANs in terms of prediction accuracy, although it requires more computational resources.The SRNDiff model exhibits higher stability and efficiency during training than GANs-based approaches, and generates high-quality precipitation distribution samples that better reflect future actual precipitation conditions. This fully validates the advantages and potential of diffusion models in precipitation forecasting, providing new insights for enhancing rainfall prediction.


title: A mixed finite-element, finite-volume, semi-implicit discretisation for atmospheric dynamics: Spherical geometry

abstract: The reformulation of the Met Office's dynamical core for weather and climate prediction previously described by the authors is extended to spherical domains using a cubed-sphere mesh. This paper updates the semi-implicit mixed finite-element formulation to be suitable for spherical domains. In particular the finite-volume transport scheme is extended to take account of non-uniform, non-orthogonal meshes and uses an advective-then-flux formulation so that increment from the transport scheme is linear in the divergence. The resulting model is then applied to a standard set of dry dynamical core tests and compared to the existing semi-implicit semi-Lagrangian dynamical core currently used in the Met Office's operational model.


title: Hidden Gems in the Rough: Computational Notebooks as an Uncharted Oasis for IDEs

abstract: In this paper, we outline potential ways for the further development of computational notebooks in Integrated Development Environments (IDEs). We discuss notebooks integration with IDEs, focusing on three main areas: facilitating experimentation, adding collaborative features, and improving code comprehension. We propose that better support of notebooks will not only benefit the notebooks, but also enhance IDEs by supporting new development processes native to notebooks. In conclusion, we suggest that adapting IDEs for more experimentation-oriented notebook processes will prepare them for the future of AI-powered programming.


title: From Text to CQL: Bridging Natural Language and Corpus Search Engine

abstract: Natural Language Processing (NLP) technologies have revolutionized the way we interact with information systems, with a significant focus on converting natural language queries into formal query languages such as SQL. However, less emphasis has been placed on the Corpus Query Language (CQL), a critical tool for linguistic research and detailed analysis within text corpora. The manual construction of CQL queries is a complex and time-intensive task that requires a great deal of expertise, which presents a notable challenge for both researchers and practitioners. This paper presents the first text-to-CQL task that aims to automate the translation of natural language into CQL. We present a comprehensive framework for this task, including a specifically curated large-scale dataset and methodologies leveraging large language models (LLMs) for effective text-to-CQL task. In addition, we established advanced evaluation metrics to assess the syntactic and semantic accuracy of the generated queries. We created innovative LLM-based conversion approaches and detailed experiments. The results demonstrate the efficacy of our methods and provide insights into the complexities of text-to-CQL task.


title: Unlocking Instructive In-Context Learning with Tabular Prompting for Relational Triple Extraction

abstract: The in-context learning (ICL) for relational triple extraction (RTE) has achieved promising performance, but still encounters two key challenges: (1) how to design effective prompts and (2) how to select proper demonstrations. Existing methods, however, fail to address these challenges appropriately. On the one hand, they usually recast RTE task to text-to-text prompting formats, which is unnatural and results in a mismatch between the output format at the pre-training time and the inference time for large language models (LLMs). On the other hand, they only utilize surface natural language features and lack consideration of triple semantics in sample selection. These issues are blocking improved performance in ICL for RTE, thus we aim to tackle prompt designing and sample selection challenges simultaneously. To this end, we devise a tabular prompting for RTE (\textsc{TableIE}) which frames RTE task into a table generation task to incorporate explicit structured information into ICL, facilitating conversion of outputs to RTE structures. Then we propose instructive in-context learning (I$^2$CL) which only selects and annotates a few samples considering internal triple semantics in massive unlabeled samples.


title: $q$-Equilibrium of Gas in Spacetime of Multi-horizon Black Holes

abstract: We investigate the possibility of describing the thermal system with different temperatures for a black hole with multiple horizons. The black hole with two horizons such as Schwarzschild-de Sitter black hole corresponds to two thermal systems with generically different temperatures. Then, it is not suitable to describe these systems with equilibrium thermodynamics corresponding to Gibbs-Boltzmann kinetic theory. In the present work, we investigate such thermal systems by using hydrostatic equilibrium thermodynamics. Assuming that the gas between the horizons obeys the Tsallis statistical mechanics, we found that it is possible to obtain the temperature gradient for the classical gas. Interestingly, the gas behaves as classical gas near the horizon and behaves like quantum gas around flat spacetime with constant temperature. As a result, the multi-horizon black holes in hydrostatic equilibrium can be in a stable configuration with the aspect of the $q$-kinetic theory.


title: Non-unique Ergodicity for the 2D Stochastic Navier-Stokes Equations with Derivative of Space-Time White Noise

abstract: We prove existence of infinitely many stationary solutions as well as ergodic stationary solutions for the stochastic Navier-Stokes equations on $\mathbb{T}^2$ \begin{align*} \dif u+\div(u\otimes u)\dif t+\nabla p\dif t&=\Delta u\dif t + (-\Delta)^{\fa/2}\dif B_t,\ \ \ \ \div u=0,\notag \end{align*} driven by derivative of space-time white noise, where $\fa\in[0,\frac13)$. In this setting, the solutions are not function valued and probabilistic renormalization is required to give a meaning to the equations. Finally, we show that the stationary distributions are not Gaussian distribution $N(0,\frac12(-\Delta)^{\fa-1})$. The proof relies on a time-dependent decomposition and a stochastic version of the convex integration method which provides uniform moment bounds in some function spaces.


title: Reasoning Algorithmically in Graph Neural Networks

abstract: The development of artificial intelligence systems with advanced reasoning capabilities represents a persistent and long-standing research question. Traditionally, the primary strategy to address this challenge involved the adoption of symbolic approaches, where knowledge was explicitly represented by means of symbols and explicitly programmed rules. However, with the advent of machine learning, there has been a paradigm shift towards systems that can autonomously learn from data, requiring minimal human guidance. In light of this shift, in latest years, there has been increasing interest and efforts at endowing neural networks with the ability to reason, bridging the gap between data-driven learning and logical reasoning. Within this context, Neural Algorithmic Reasoning (NAR) stands out as a promising research field, aiming to integrate the structured and rule-based reasoning of algorithms with the adaptive learning capabilities of neural networks, typically by tasking neural models to mimic classical algorithms. In this dissertation, we provide theoretical and practical contributions to this area of research. We explore the connections between neural networks and tropical algebra, deriving powerful architectures that are aligned with algorithm execution. Furthermore, we discuss and show the ability of such neural reasoners to learn and manipulate complex algorithmic and combinatorial optimization concepts, such as the principle of strong duality. Finally, in our empirical efforts, we validate the real-world utility of NAR networks across different practical scenarios. This includes tasks as diverse as planning problems, large-scale edge classification tasks and the learning of polynomial-time approximate algorithms for NP-hard combinatorial problems. Through this exploration, we aim to showcase the potential integrating algorithmic reasoning in machine learning models.


title: Infrared Imaging using thermally stable HgTe/CdS nanocrystals

abstract: Transferring the nanocrystals (NCs) from the laboratory environment toward practical applications has raised new challenges. In the case of NCs for display and lightning, the focus was on reduced Auger recombination and maintaining luminescence at high temperatures. When it comes to infrared sensing, narrow band gap materials are required and HgTe appears as the most spectrally tunable platform. Its low-temperature synthesis reduces the growth energy cost yet also favors sintering. As a result, once coupled to a read-out circuit, the Joule effect aggregates the particles leading to a poorly defined optical edge and dramatically large dark current. Here, we demonstrate that CdS shells bring the expected thermal stability (no redshift upon annealing, reduced tendency to form amalgams and preservation of photoconduction after an atomic layer deposition process). The peculiar electronic structure of these confined particles is unveiled using k.p self-consistent simulations showing a significant exciton biding energy at around 200 meV. After shelling, the material displays a p-type behavior that favors the generation of photoconductive gain. The latter is then used to increase the external quantum


title: A Unified Knowledge Graph to Permit Interoperability of Heterogeneous Digital Evidence

abstract: The modern digital world is highly heterogeneous, encompassing a wide variety of communications, devices, and services. This interconnectedness generates, synchronises, stores, and presents digital information in multidimensional, complex formats, often fragmented across multiple sources. When linked to misuse, this digital information becomes vital digital evidence. Integrating and harmonising these diverse formats into a unified system is crucial for comprehensively understanding evidence and its relationships. However, existing approaches to date have faced challenges limiting investigators' ability to query heterogeneous evidence across large datasets. This paper presents a novel approach in the form of a modern unified data graph. The proposed approach aims to seamlessly integrate, harmonise, and unify evidence data, enabling cross-platform interoperability, efficient data queries, and improved digital investigation performance. To demonstrate its efficacy, a case study is conducted, highlighting the benefits of the proposed approach and showcasing its effectiveness in enabling the interoperability required for advanced analytics in digital investigations.


title: A Ray Launching Approach for Computing Exact Paths with Point Clouds

abstract: Ray tracing is a deterministic method that produces propagation paths between a transmitter and a receiver. The simulation accuracy is significantly influenced by the environment details. One way to capture the environment with great precision is the utilization of depth sensors and cameras. Such reconstructed environment is in the form of a point cloud. However, utilizing such data directly in ray tracing, a key aspect on vision-aided wireless communications, often involves a significant trade-off between accuracy and execution time. In this paper, we propose an open source novel and fast point cloud-based ray launching algorithm that produces exact paths, which provide a good basis for accurate modeling of radio channel characteristics. In experiments, preliminary validation of the ray tracer output is obtained with the aid of a commercial ray tracer.


title: Nonlinear effects within invariance principles

abstract: Functional central limit theorems for random processes viewed as rough paths were obtained in a wide range of models and settings in recent years. Each result of this kind has described and identified the limit Brownian rough path within the specifically suitable set-up. Taking a unified point of view, we provide simple and exact formulae, of Green-Kubo type, that characterize the limit Brownian rough path and demonstrate how they naturally apply in each case.


title: Possible origins of anomalous H$\,$I gas around MHONGOOSE galaxy, NGC 5068

abstract: The existing reservoirs of neutral atomic hydrogen gas (H$\,$I) in galaxies are insufficient to have maintained the observed levels of star formation without some kind of replenishment. {This refuelling of the H$\,$I reservoirs} is likely to occur at column densities an order of magnitude lower than previous observational limits (N$_{\rm{H\,I}\, limit} \sim 10^{19}\,$cm$^{-2}$ at 30$''$ resolution over a linewidth of $20\,$km/s). In this paper, we present recent deep H$\,$I observations of NGC 5068, a nearby isolated star-forming galaxy observed by MeerKAT as part of the MHONGOOSE survey. With these new data, we are able to detect low column density H$\,$I around NGC 5068 with a $3\sigma$ detection limit of N$_{\rm{H\,I}} = 6.4 \times 10^{17}\,$cm$^{-2}$ at 90$''$ resolution over a $20\,$km/s linewidth. The high sensitivity and resolution of the MeerKAT data reveal a complex morphology of the H$\,$I in this galaxy -- a regularly rotating inner disk coincident with the main star-forming disk of the galaxy, a warped outer disk of low column density gas (N$_{\rm{H\,I}} < 9 \times 10^{19}\,$cm$^{-2}$), in addition to clumps of gas on the north west side of the galaxy. We employ a simple two disk model that describe the inner and outer disks, and are able to identify anomalous gas that deviates from the rotation of the main galaxy. The morphology and the kinematics of the anomalous gas suggest a possible extra-galactic origin. We explore a number of possible origin scenarios that may explain the anomalous gas, and conclude that fresh accretion is the most likely scenario.


title: Breaking the Barrier: Utilizing Large Language Models for Industrial Recommendation Systems through an Inferential Knowledge Graph

abstract: Recommendation systems are widely used in e-commerce websites and online platforms to address information overload. However, existing systems primarily rely on historical data and user feedback, making it difficult to capture user intent transitions. Recently, Knowledge Base (KB)-based models are proposed to incorporate expert knowledge, but it struggle to adapt to new items and the evolving e-commerce environment. To address these challenges, we propose a novel Large Language Model based Complementary Knowledge Enhanced Recommendation System (LLM-KERec). It introduces an entity extractor that extracts unified concept terms from item and user information. To provide cost-effective and reliable prior knowledge, entity pairs are generated based on entity popularity and specific strategies. The large language model determines complementary relationships in each entity pair, constructing a complementary knowledge graph. Furthermore, a new complementary recall module and an Entity-Entity-Item (E-E-I) weight decision model refine the scoring of the ranking model using real complementary exposure-click samples. Extensive experiments conducted on three industry datasets demonstrate the significant performance improvement of our model compared to existing approaches. Additionally, detailed analysis shows that LLM-KERec enhances users' enthusiasm for consumption by recommending complementary items. In summary, LLM-KERec addresses the limitations of traditional recommendation systems by incorporating complementary knowledge and utilizing a large language model to capture user intent transitions, adapt to new items, and enhance recommendation efficiency in the evolving e-commerce landscape.


title: Multi-step topological transitions among meron and skyrmion crystals in a centrosymmetric magnet

abstract: Topological swirling spin textures, such as skyrmions and merons, have recently attracted much attention as a unique building block for high-density magnetic information devices. The controlled transformation among different types of such quasi-particles is an important challenge, while it was previously achieved only in a few non-centrosymmetric systems characterized by Dzyaloshinskii-Moriya interaction. Here, we report an experimental discovery of multi-step topological transitions among a variety of meron and skyrmion crystal states in a centrosymmetric magnet GdRu$_2$Ge$_2$. By performing the detailed magnetic structure analysis based on resonant X-ray and neutron scattering experiments as well as electron transport measurements, we have found that this compound hosts periodic lattice of elliptic skyrmions, meron/anti-meron pairs, and circular skyrmions as a function of external magnetic field. The diameter of these objects is as small as 2.7 nm, which is almost two orders of magnitude smaller than typical non-centrosymmetric magnets. Such an intricate manner of topological magnetic transitions are well reproduced by a theoretical model considering the competition between RKKY interactions at inequivalent wave vectors. The present findings demonstrate that even a simple centrosymmetric magnet with competing interactions can be a promising material platform to realize a richer variety of nanometric magnetic quasi-particles with distinctive symmetry and topology, whose stability may be tunable by various external stimuli.


title: AI-Powered Predictions for Electricity Load in Prosumer Communities

abstract: The flexibility in electricity consumption and production in communities of residential buildings, including those with renewable energy sources and energy storage (a.k.a., prosumers), can effectively be utilized through the advancement of short-term demand response mechanisms. It is known that flexibility can further be increased if demand response is performed at the level of communities of prosumers, since aggregated groups can better coordinate electricity consumption. However, the effectiveness of such short-term optimization is highly dependent on the accuracy of electricity load forecasts both for each building as well as for the whole community. Structural variations in the electricity load profile can be associated with different exogenous factors, such as weather conditions, calendar information and day of the week, as well as user behavior. In this paper, we review a wide range of electricity load forecasting techniques, that can provide significant assistance in optimizing load consumption in prosumer communities. We present and test artificial intelligence (AI) powered short-term load forecasting methodologies that operate with black-box time series models, such as Facebook's Prophet and Long Short-term Memory (LSTM) models; season-based SARIMA and smoothing Holt-Winters models; and empirical regression-based models that utilize domain knowledge. The integration of weather forecasts into data-driven time series forecasts is also tested. Results show that the combination of persistent and regression terms (adapted to the load forecasting task) achieves the best forecast accuracy.


title: LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

abstract: Large context window is a desirable feature in large language models (LLMs). However, due to high fine-tuning costs, scarcity of long texts, and catastrophic values introduced by new token positions, current extended context windows are limited to around 128k tokens. This paper introduces LongRoPE that, for the first time, extends the context window of pre-trained LLMs to an impressive 2048k tokens, with up to only 1k fine-tuning steps at within 256k training lengths, while maintaining performance at the original short context window. This is achieved by three key innovations: (i) we identify and exploit two forms of non-uniformities in positional interpolation through an efficient search, providing a better initialization for fine-tuning and enabling an 8x extension in non-fine-tuning scenarios; (ii) we introduce a progressive extension strategy that first fine-tunes a 256k length LLM and then conducts a second positional interpolation on the fine-tuned extended LLM to achieve a 2048k context window; (iii) we readjust LongRoPE on 8k length to recover the short context window performance. Extensive experiments on LLaMA2 and Mistral across various tasks demonstrate the effectiveness of our method. Models extended via LongRoPE retain the original architecture with minor modifications to the positional embedding, and can reuse most pre-existing optimizations.


title: Reinforcement learning-assisted quantum architecture search for variational quantum algorithms

abstract: A significant hurdle in the noisy intermediate-scale quantum (NISQ) era is identifying functional quantum circuits. These circuits must also adhere to the constraints imposed by current quantum hardware limitations. Variational quantum algorithms (VQAs), a class of quantum-classical optimization algorithms, were developed to address these challenges in the currently available quantum devices. However, the overall performance of VQAs depends on the initialization strategy of the variational circuit, the structure of the circuit (also known as ansatz), and the configuration of the cost function. Focusing on the structure of the circuit, in this thesis, we improve the performance of VQAs by automating the search for an optimal structure for the variational circuits using reinforcement learning (RL). Within the thesis, the optimality of a circuit is determined by evaluating its depth, the overall count of gates and parameters, and its accuracy in solving the given problem. The task of automating the search for optimal quantum circuits is known as quantum architecture search (QAS). The majority of research in QAS is primarily focused on a noiseless scenario. Yet, the impact of noise on the QAS remains inadequately explored. In this thesis, we tackle the issue by introducing a tensor-based quantum circuit encoding, restrictions on environment dynamics to explore the search space of possible circuits efficiently, an episode halting scheme to steer the agent to find shorter circuits, a double deep Q-network (DDQN) with an $\epsilon$-greedy policy for better stability. The numerical experiments on noiseless and noisy quantum hardware show that in dealing with various VQAs, our RL-based QAS outperforms existing QAS. Meanwhile, the methods we propose in the thesis can be readily adapted to address a wide range of other VQAs.


title: Adaptive Massively Parallel Coloring in Sparse Graphs

abstract: Classic symmetry-breaking problems on graphs have gained a lot of attention in models of modern parallel computation. The Adaptive Massively Parallel Computation (AMPC) is a model that captures the central challenges in data center computations. Chang et al. [PODC'2019] gave an extremely fast, constant time, algorithm for the $(\Delta + 1)$-coloring problem, where $\Delta$ is the maximum degree of an input graph of $n$ nodes. The algorithm works in the most restrictive low-space setting, where each machine has $n^{\delta}$ local space for a constant $0 < \delta < 1$. In this work, we study the vertex-coloring problem in sparse graphs parameterized by their arboricity $\alpha$, a standard measure for sparsity. We give deterministic algorithms that in constant, or almost constant, time give $\text{poly} ~\alpha$ and $O(\alpha)$-colorings, where $\alpha$ can be arbitrarily smaller than $\Delta$. A strong and standard approach to compute arboricity-dependent colorings is through the Nash-Williams forest decomposition, which gives rise to an (acyclic) orientation of the edges such that each node has a small out-degree. Our main technical contribution is giving efficient deterministic algorithms to compute these orientations and showing how to leverage them to find colorings in low-space AMPC. A key technical challenge is that the color of a node may depend on almost all of the other nodes in the graph and these dependencies cannot be stored on a single machine. Nevertheless, our novel and careful exploration technique yields the orientation, and the arboricity-dependent coloring, with a sublinear number of adaptive queries per node.


title: High-throughput Visual Nano-drone to Nano-drone Relative Localization using Onboard Fully Convolutional Networks

abstract: Relative drone-to-drone localization is a fundamental building block for any swarm operations. We address this task in the context of miniaturized nano-drones, i.e., 10cm in diameter, which show an ever-growing interest due to novel use cases enabled by their reduced form factor. The price for their versatility comes with limited onboard resources, i.e., sensors, processing units, and memory, which limits the complexity of the onboard algorithms. A traditional solution to overcome these limitations is represented by lightweight deep learning models directly deployed aboard nano-drones. This work tackles the challenging relative pose estimation between nano-drones using only a gray-scale low-resolution camera and an ultra-low-power System-on-Chip (SoC) hosted onboard. We present a vertically integrated system based on a novel vision-based fully convolutional neural network (FCNN), which runs at 39Hz within 101mW onboard a Crazyflie nano-drone extended with the GWT GAP8 SoC. We compare our FCNN against three State-of-the-Art (SoA) systems. Considering the best-performing SoA approach, our model results in an R-squared improvement from 32 to 47% on the horizontal image coordinate and from 18 to 55% on the vertical image coordinate, on a real-world dataset of 30k images. Finally, our in-field tests show a reduction of the average tracking error of 37% compared to a previous SoA work and an endurance performance up to the entire battery lifetime of 4 minutes.


title: Critical Behavior and Collective Modes at the Superfluid Transition in Amorphous Systems

abstract: We investigate the critical behavior and the dynamics of the amplitude (Higgs) mode close to the superfluid-insulator quantum phase transition in an amorphous system (i.e., a system subject to topological randomness). In particular, we map the two-dimensional Bose-Hubbard Hamiltonian defined on a random Voronoi-Delaunay lattice onto a (2+1)-dimensional layered classical XY model with correlated topological disorder. We study the resulting model by laying recourse to classical Monte Carlo simulations. We specifically focus on the scalar susceptibility of the order parameter to study the dynamics of the amplitude mode. To do so, we harness the maximum entropy method to perform the analytic continuation of the scalar susceptibility to real frequencies. Our analysis shows that the amplitude mode remains delocalized in the presence of such topological disorder, quite at odds with its behavior in generic disordered systems, where the randomness localizes the Higgs mode. Furthermore, we show that the critical behavior of the topologically disordered system is identical to that of its translationally invariant counterpart, consistent with a modified Harris criterion. This suggests that the localization of the collective excitations in the presence of disorder is tied to the critical behavior of the quantum phase transition rather than a simple Anderson-localization-type interference mechanism.


title: Factual Consistency Evaluation of Summarisation in the Era of Large Language Models

abstract: Factual inconsistency with source documents in automatically generated summaries can lead to misinformation or pose risks. Existing factual consistency(FC) metrics are constrained by their performance, efficiency, and explainability. Recent advances in Large language models (LLMs) have demonstrated remarkable potential in text evaluation but their effectiveness in assessing FC in summarisation remains underexplored. Prior research has mostly focused on proprietary LLMs, leaving essential factors that affect their assessment capabilities unexplored. Additionally, current FC evaluation benchmarks are restricted to news articles, casting doubt on the generality of the FC methods tested on them. In this paper, we first address the gap by introducing TreatFact a dataset of LLM-generated summaries of clinical texts, annotated for FC by domain experts. Moreover, we benchmark 11 LLMs for FC evaluation across news and clinical domains and analyse the impact of model size, prompts, pre-training and fine-tuning data. Our findings reveal that despite proprietary models prevailing on the task, open-source LLMs lag behind. Nevertheless, there is potential for enhancing the performance of open-source LLMs through increasing model size, expanding pre-training data, and developing well-curated fine-tuning data. Experiments on TreatFact suggest that both previous methods and LLM-based evaluators are unable to capture factual inconsistencies in clinical summaries, posing a new challenge for FC evaluation.


title: Coupled exciton internal and center-of-mass motions in two-dimensional semiconductors by a periodic electrostatic potential

abstract: We theoretically investigated the coupling between the exciton internal and center-of-mass motions in monolayer transition metal dichalcogenides subjected to a periodic electrostatic potential. The coupling leads to the emergence of multiple absorption peaks in the exciton spectrum which are the hybridizations of 1s, 2s and 2p$\pm$ Rydberg states with different center-of-mass momentums. The energies and wave functions of hybrid states can be strongly modulated by varying the profile of the periodic electrostatic potential, which well reproduces the recent experimental observations. Combined with the electron-hole exchange interaction, non-degenerate valley-coherent bright excitons can be realized by applying an in-plane electric field, with the valley coherence determined by the field direction.


title: Leaving No Matter Unturned -- Analysing existing LHC measurements and events with jets and missing transverse energy measured by the ATLAS Experiment insearch of Dark Matter

abstract: Various astrophysical observations point towards an as-of-yet unexplained, mainly gravitationally interacting type of matter. If this matter, called Dark Matter, is an elementary particle, it could be produced in particle collisions at the Large Hadron Collider. Given its weak interaction with ordinary matter, however, it would not be directly observable with the general-purpose detectors at the Large Hadron Collider. Its production would therefore manifest as events in which detector-visible objects recoil against the detector-invisible Dark Matter, giving rise to missing transverse energy. This thesis focuses on final states in which these visible objects are jets. A measurement of the final state of large missing transverse energy and at least one jet in 139 fb$^{-1}$ of proton-proton collisions at 13 TeV recorded with the ATLAS detector at the Large Hadron Collider is performed in this thesis. Good agreement between measured data and Standard-Model prediction is found in a statistical fit, corresponding to a reduced chi-square of 1.37. The measurement is corrected for detector effects to facilitate later reinterpretation. Measurements prepared in such a way can, for example, be exploited by the CONTUR toolkit to set constraints on new theories. Both, the results of the measurement and the CONTUR toolkit making use of existing measurements at the Large Hadron Collider, are employed to set exclusion limits on a model able to explain Dark Matter, the two-Higgs-doublet model with a pseudoscalar mediator to Dark Matter. At $\tan\beta=1$, masses of the pseudoscalar $A$ up to 425 GeV and larger than 1600 GeV are excluded at 95 % confidence level. At $m_H\equiv m_A\equiv m_{H^\pm}=$ 600 GeV, masses of the pseudoscalar $a$ up to 550 GeV and values of $\tan\beta$ up to 1.5 as well as larger than 20 are excluded at 95 % confidence level.


title: Optimizing the Cavity-Arm Ratio of V-Shaped Semiconductor Disk Lasers

abstract: Passively mode-locked semiconductor disk lasers have received tremendous attention from both science and industry. Their relatively inexpensive production combined with excellent pulse performance and great emission wavelength flexibility make them suitable laser candidates for applications ranging from frequency comb tomography to spectroscopy. However, due to the interaction of the active medium dynamics and the device geometry, emission instabilities occur at high pump powers and thereby limit their performance potential. Hence, understanding those instabilities becomes critical for an optimal laser design. Using a delay-differential equation model, we are able to detect, understand, and classify three distinct instabilities that limit the maximum achievable pump power for the fundamental mode-locking state and link them to characteristic positive net-gain windows. We furthermore derive a simple analytic approximation in order to quantitatively describe the stability boundary. Our results enable us to predict the optimal laser cavity configuration with respect to positive net-gain instabilities and are therefore of great relevance for the future development of passively mode-locking semiconductor disk lasers.


title: Sharpening the dark matter signature in gravitational waveforms II: Numerical simulations with the NbodyIMRI code

abstract: Future gravitational wave observatories can probe dark matter by detecting the dephasing in the waveform of binary black hole mergers induced by dark matter overdensities. Such a detection hinges on the accurate modelling of the dynamical friction, induced by dark matter on the secondary compact object in intermediate and extreme mass ratio inspirals. In this paper, we introduce NbodyIMRI, a new publicly available code designed for simulating binary systems within cold dark matter `spikes'. Leveraging higher particle counts and finer timesteps, we validate the applicability of the standard dynamical friction formalism and provide an accurate determination of the maximum impact parameter of particles which can effectively scatter with a compact object, across various mass ratios. We also show that in addition to feedback due to dynamical friction, the dark matter also evolves through a `stirring' effect driven by the time-dependent potential of the binary. We introduce a simple semi-analytical scheme to account for this effect and demonstrate that including stirring tends to slow the rate of dark matter depletion and therefore enhances the impact of dark matter on the dynamics of the binary.


title: Music Style Transfer with Time-Varying Inversion of Diffusion Models

abstract: With the development of diffusion models, text-guided image style transfer has demonstrated high-quality controllable synthesis results. However, the utilization of text for diverse music style transfer poses significant challenges, primarily due to the limited availability of matched audio-text datasets. Music, being an abstract and complex art form, exhibits variations and intricacies even within the same genre, thereby making accurate textual descriptions challenging. This paper presents a music style transfer approach that effectively captures musical attributes using minimal data. We introduce a novel time-varying textual inversion module to precisely capture mel-spectrogram features at different levels. During inference, we propose a bias-reduced stylization technique to obtain stable results. Experimental results demonstrate that our method can transfer the style of specific instruments, as well as incorporate natural sounds to compose melodies. Samples and source code are available at https://lsfhuihuiff.github.io/MusicTI/.


title: CriticBench: Evaluating Large Language Models as Critic

abstract: Critique ability are crucial in the scalable oversight and self-improvement of Large Language Models (LLMs). While many recent studies explore the critique ability of LLMs to judge and refine flaws in generations, how to comprehensively and reliably measure the critique abilities of LLMs is under-explored. This paper introduces CriticBench, a novel benchmark designed to comprehensively and reliably evaluate four key critique ability dimensions of LLMs: feedback, comparison, refinement and meta-feedback. CriticBench encompasses nine diverse tasks, each assessing the LLMs' ability to critique responses at varying levels of quality granularity. Our extensive evaluations of open-source and closed-source LLMs reveal intriguing relationships between the critique ability and tasks, response qualities, and model scales. Datasets, resources and evaluation toolkit for CriticBench will be publicly released at https://github.com/open-compass/CriticBench.


title: Accuracy-Preserving Calibration via Statistical Modeling on Probability Simplex

abstract: Classification models based on deep neural networks (DNNs) must be calibrated to measure the reliability of predictions. Some recent calibration methods have employed a probabilistic model on the probability simplex. However, these calibration methods cannot preserve the accuracy of pre-trained models, even those with a high classification accuracy. We propose an accuracy-preserving calibration method using the Concrete distribution as the probabilistic model on the probability simplex. We theoretically prove that a DNN model trained on cross-entropy loss has optimality as the parameter of the Concrete distribution. We also propose an efficient method that synthetically generates samples for training probabilistic models on the probability simplex. We demonstrate that the proposed method can outperform previous methods in accuracy-preserving calibration tasks using benchmarks.


title: Worldline path integral for the massive graviton

abstract: We compute the counterterms necessary for the renormalization of the one-loop effective action of massive gravity from a worldline perspective. This is achieved by employing the recently proposed massive $\mathcal{N}=4$ spinning particle model to describe the propagation of the massive graviton on those backgrounds that solve the Einstein equations without cosmological constant, namely on Ricci-flat manifolds, in four dimensions. The model is extended to be consistent in $D$ spacetime dimensions by relaxing the gauging of the full SO(4) R-symmetry group to a parabolic subgroup, together with the inclusion of a suitable Chern-Simons term. Then, constructing the worldline path integral on the one-dimensional torus allows for the correct calculation of the one-loop divergencies in arbitrary $D$ dimensions. Our primary contribution is the determination of the Seleey-DeWitt coefficients up to the fourth coefficient $a_3(D)$, which to our knowledge has never been reported in the literature. Its calculation is generally laborious on the quantum field theory side, as a general formula for these coefficients is not available for operators that are non-minimal in the heat kernel sense. This work illustrates the computational efficiency of worldline methods in this regard. Heat kernel coefficients characterize linearized massive gravity in a gauge-independent manner due to the on-shell condition of the background on which the graviton propagates. They could serve as a benchmark for verifying alternative approaches to massive gravity, and, for this reason, their precise expression should be known explicitly.


title: Generalized Red-Blue Circular Annulus Cover Problem

abstract: We study the Generalized Red-Blue Annulus Cover problem for two sets of points, red ($R$) and blue ($B$), where each point $p \in R\cup B$ is associated with a positive penalty ${\cal P}(p)$. The red points have non-covering penalties, and the blue points have covering penalties. The objective is to compute a circular annulus ${\cal A}$ such that the value of the function ${\cal P}({R}^{out})$ + ${\cal P}({ B}^{in})$ is minimum, where ${R}^{out} \subseteq {R}$ is the set of red points not covered by ${\cal A}$ and ${B}^{in} \subseteq {B}$ is the set of blue points covered by $\cal A$. We also study another version of this problem, where all the red points in $R$ and the minimum number of points in $B$ are covered by the circular annulus in two dimensions. We design polynomial-time algorithms for all such circular annulus problems.


title: Democratizing Uncertainty Quantification

abstract: Uncertainty Quantification (UQ) is vital to safety-critical model-based analyses, but the widespread adoption of sophisticated UQ methods is limited by technical complexity. In this paper, we introduce UM-Bridge (the UQ and Modeling Bridge), a high-level abstraction and software protocol that facilitates universal interoperability of UQ software with simulation codes. It breaks down the technical complexity of advanced UQ applications and enables separation of concerns between experts. UM-Bridge democratizes UQ by allowing effective interdisciplinary collaboration, accelerating the development of advanced UQ methods, and making it easy to perform UQ analyses from prototype to High Performance Computing (HPC) scale. In addition, we present a library of ready-to-run UQ benchmark problems, all easily accessible through UM-Bridge. These benchmarks support UQ methodology research, enabling reproducible performance comparisons. We demonstrate UM-Bridge with several scientific applications, harnessing HPC resources even using UQ codes not designed with HPC support.


title: General Debiasing for Graph-based Collaborative Filtering via Adversarial Graph Dropout

abstract: Graph neural networks (GNNs) have shown impressive performance in recommender systems, particularly in collaborative filtering (CF). The key lies in aggregating neighborhood information on a user-item interaction graph to enhance user/item representations. However, we have discovered that this aggregation mechanism comes with a drawback, which amplifies biases present in the interaction graph. For instance, a user's interactions with items can be driven by both unbiased true interest and various biased factors like item popularity or exposure. However, the current aggregation approach combines all information, both biased and unbiased, leading to biased representation learning. Consequently, graph-based recommenders can learn distorted views of users/items, hindering the modeling of their true preferences and generalizations. To address this issue, we introduce a novel framework called Adversarial Graph Dropout (AdvDrop). It differentiates between unbiased and biased interactions, enabling unbiased representation learning. For each user/item, AdvDrop employs adversarial learning to split the neighborhood into two views: one with bias-mitigated interactions and the other with bias-aware interactions. After view-specific aggregation, AdvDrop ensures that the bias-mitigated and bias-aware representations remain invariant, shielding them from the influence of bias. We validate AdvDrop's effectiveness on five public datasets that cover both general and specific biases, demonstrating significant improvements. Furthermore, our method exhibits meaningful separation of subgraphs and achieves unbiased representations for graph-based CF models, as revealed by in-depth analysis. Our code is publicly available at https://github.com/Arthurma71/AdvDrop.


title: Room-temperature sub-100 nm N\'eel-type skyrmions in non-stoichiometric van der Waals ferromagnet $\rm Fe_{3-x}GaTe_{2}$ with ultrafast laser writability

abstract: Realizing room-temperature magnetic skyrmions in two-dimensional van der Waals ferromagnets offers unparalleled prospects for future spintronic applications. However, due to the intrinsic spin fluctuations that suppress atomic long-range magnetic order and the inherent inversion crystal symmetry that excludes the presence of the Dzyaloshinskii-Moriya interaction, achieving room-temperature skyrmions in 2D magnets remains a formidable challenge. In this study, we target room-temperature 2D magnet $\rm Fe_3GaTe_2$ and unveil that the introduction of iron-deficient into this compound enables spatial inversion symmetry breaking, thus inducing a significant Dzyaloshinskii-Moriya interaction that brings about room-temperature N\'eel-type skyrmions with unprecedentedly small size. To further enhance the practical applications of this finding, we employ a homemade in-situ optical Lorentz transmission electron microscopy to demonstrate ultrafast writing of skyrmions in $\rm Fe_{3-x}GaTe_2$ using a single femtosecond laser pulse. Our results manifest the $\rm Fe_{3-x}GaTe_2$ as a promising building block for realizing skyrmion-based magneto-optical functionalities.


title: Mask-up: Investigating Biases in Face Re-identification for Masked Faces

abstract: AI based Face Recognition Systems (FRSs) are now widely distributed and deployed as MLaaS solutions all over the world, moreso since the COVID-19 pandemic for tasks ranging from validating individuals' faces while buying SIM cards to surveillance of citizens. Extensive biases have been reported against marginalized groups in these systems and have led to highly discriminatory outcomes. The post-pandemic world has normalized wearing face masks but FRSs have not kept up with the changing times. As a result, these systems are susceptible to mask based face occlusion. In this study, we audit four commercial and nine open-source FRSs for the task of face re-identification between different varieties of masked and unmasked images across five benchmark datasets (total 14,722 images). These simulate a realistic validation/surveillance task as deployed in all major countries around the world. Three of the commercial and five of the open-source FRSs are highly inaccurate; they further perpetuate biases against non-White individuals, with the lowest accuracy being 0%. A survey for the same task with 85 human participants also results in a low accuracy of 40%. Thus a human-in-the-loop moderation in the pipeline does not alleviate the concerns, as has been frequently hypothesized in literature. Our large-scale study shows that developers, lawmakers and users of such services need to rethink the design principles behind FRSs, especially for the task of face re-identification, taking cognizance of observed biases.


title: Parameter identification algorithm for a LTV system with partially unknown state matrix

abstract: In this paper an adaptive state observer and parameter identification algorithm for a linear time-varying system are developed under condition that the state matrix of the system contains unknown time-varying parameters of a known form. The state vector is observed using only output and input measurements without identification of the unknown parameters. When the state vector estimate is obtained, the identification algorithm is applied to find unknown parameters of the system.


title: Spatial-Domain Wireless Jamming with Reconfigurable Intelligent Surfaces

abstract: Today, we rely heavily on the constant availability of wireless communication systems. As a result, wireless jamming continues to prevail as an imminent threat: Attackers can create deliberate radio interference to overshadow desired signals, leading to denial of service. Although the broadcast nature of radio signal propagation makes such an attack possible in the first place, it likewise poses a challenge for the attacker, preventing precise targeting of single devices. In particular, the jamming signal will likely not only reach the victim receiver but also other neighboring devices. In this work, we introduce spatial control of wireless jamming signals, granting a new degree of freedom to leverage for jamming attacks. Our novel strategy employs an environment-adaptive reconfigurable intelligent surface (RIS), exploiting multipath signal propagation to spatially focus jamming signals on particular victim devices. We investigate this effect through extensive experimentation and show that our approach can disable the wireless communication of a victim device while leaving neighbouring devices unaffected. In particular, we demonstrate complete denial-of-service of a Wi-Fi device while a second device located at a distance as close as 5 mm remains unaffected, sustaining wireless communication at a data rate of 60 Mbit/s. We also show that the attacker can change the attack target on-the-fly, dynamically selecting the device to be jammed.


title: The Adams operators on connected graded Hopf algebras

abstract: The Adams operators on a Hopf algebra $H$ are the convolution powers of the identity map of $H$. They are also called Hopf powers or Sweedler powers. It is a natural family of operators on $H$ that contains the antipode. We study the linear properties of the Adams operators when $H=\bigoplus_{m\in \mathbb{N}} H_m$ is connected graded. The main result is that for any of such $H$, there exist a PBW type homogeneous basis and a natural partial order on it such that the restrictions $\Psi_n|_{H_m}$ of the Adams operators are simultaneously upper triangularizable with respect to this ordered basis. Moreover, the diagonal coefficients are determined in terms of $n$ and a combinatorial number assigned to the basis elements. As an immediate consequence, we obtain a complete description of the characteristic polynomial of $\Psi_n|_{H_m}$, both on eigenvalues and their multiplicities, when $H$ is locally finite and the base field is of characteristic zero. It recovers the main result of the paper [2] by Aguiar and Lauve, where the approach is different to ours.


title: Top cell attachment for a Poincare Duality complex

abstract: Let M be a simply-connected closed Poincare Duality complex of dimension n. Then M is obtained by attaching a cell of highest dimension to its (n-1)-skeleton M'. Conditions are given for when the skeletal inclusion i:M' --> M has the property that the based loops on i has a right homotopy inverse. This is an integral version of the rational statement that such a right homotopy inverse always exists provided the rational cohomology of M is not generated by a single element. New methods are developed in order to do the integral case. These lead to p-local versions and recover the full rational statement. Families for which the integral statement holds include moment-angle manifolds and quasi-toric manifolds.


title: Cas-DiffCom: Cascaded diffusion model for infant longitudinal super-resolution 3D medical image completion

abstract: Early infancy is a rapid and dynamic neurodevelopmental period for behavior and neurocognition. Longitudinal magnetic resonance imaging (MRI) is an effective tool to investigate such a crucial stage by capturing the developmental trajectories of the brain structures. However, longitudinal MRI acquisition always meets a serious data-missing problem due to participant dropout and failed scans, making longitudinal infant brain atlas construction and developmental trajectory delineation quite challenging. Thanks to the development of an AI-based generative model, neuroimage completion has become a powerful technique to retain as much available data as possible. However, current image completion methods usually suffer from inconsistency within each individual subject in the time dimension, compromising the overall quality. To solve this problem, our paper proposed a two-stage cascaded diffusion model, Cas-DiffCom, for dense and longitudinal 3D infant brain MRI completion and super-resolution. We applied our proposed method to the Baby Connectome Project (BCP) dataset. The experiment results validate that Cas-DiffCom achieves both individual consistency and high fidelity in longitudinal infant brain image completion. We further applied the generated infant brain images to two downstream tasks, brain tissue segmentation and developmental trajectory delineation, to declare its task-oriented potential in the neuroscience field.


title: Deep Generative Models for Offline Policy Learning: Tutorial, Survey, and Perspectives on Future Directions

abstract: Deep generative models (DGMs) have demonstrated great success across various domains, particularly in generating texts, images, and videos using models trained from offline data. Similarly, data-driven decision-making and robotic control also necessitate learning a generator function from the offline data to serve as the strategy or policy. In this case, applying deep generative models in offline policy learning exhibits great potential, and numerous studies have explored in this direction. However, this field still lacks a comprehensive review and so developments of different branches are relatively independent. In this paper, we provide the first systematic review on the applications of deep generative models for offline policy learning. In particular, we cover five mainstream deep generative models, including Variational Auto-Encoders, Generative Adversarial Networks, Normalizing Flows, Transformers, and Diffusion Models, and their applications in both offline reinforcement learning (offline RL) and imitation learning (IL). Offline RL and IL are two main branches of offline policy learning and are widely-adopted techniques for sequential decision-making. Notably, for each type of DGM-based offline policy learning, we distill its fundamental scheme, categorize related works based on the usage of the DGM, and sort out the development process of algorithms in that field. Subsequent to the main content, we provide in-depth discussions on deep generative models and offline policy learning as a summary, based on which we present our perspectives on future research directions. This work offers a hands-on reference for the research progress in deep generative models for offline policy learning, and aims to inspire improved DGM-based offline RL or IL algorithms. For convenience, we maintain a paper list on https://github.com/LucasCJYSDL/DGMs-for-Offline-Policy-Learning.


title: Weakly supervised localisation of prostate cancer using reinforcement learning for bi-parametric MR images

abstract: In this paper we propose a reinforcement learning based weakly supervised system for localisation. We train a controller function to localise regions of interest within an image by introducing a novel reward definition that utilises non-binarised classification probability, generated by a pre-trained binary classifier which classifies object presence in images or image crops. The object-presence classifier may then inform the controller of its localisation quality by quantifying the likelihood of the image containing an object. Such an approach allows us to minimize any potential labelling or human bias propagated via human labelling for fully supervised localisation. We evaluate our proposed approach for a task of cancerous lesion localisation on a large dataset of real clinical bi-parametric MR images of the prostate. Comparisons to the commonly used multiple-instance learning weakly supervised localisation and to a fully supervised baseline show that our proposed method outperforms the multi-instance learning and performs comparably to fully-supervised learning, using only image-level classification labels for training.


title: Contextual Molecule Representation Learning from Chemical Reaction Knowledge

abstract: In recent years, self-supervised learning has emerged as a powerful tool to harness abundant unlabelled data for representation learning and has been broadly adopted in diverse areas. However, when applied to molecular representation learning (MRL), prevailing techniques such as masked sub-unit reconstruction often fall short, due to the high degree of freedom in the possible combinations of atoms within molecules, which brings insurmountable complexity to the masking-reconstruction paradigm. To tackle this challenge, we introduce REMO, a self-supervised learning framework that takes advantage of well-defined atom-combination rules in common chemistry. Specifically, REMO pre-trains graph/Transformer encoders on 1.7 million known chemical reactions in the literature. We propose two pre-training objectives: Masked Reaction Centre Reconstruction (MRCR) and Reaction Centre Identification (RCI). REMO offers a novel solution to MRL by exploiting the underlying shared patterns in chemical reactions as \textit{context} for pre-training, which effectively infers meaningful representations of common chemistry knowledge. Such contextual representations can then be utilized to support diverse downstream molecular tasks with minimum finetuning, such as affinity prediction and drug-drug interaction prediction. Extensive experimental results on MoleculeACE, ACNet, drug-drug interaction (DDI), and reaction type classification show that across all tested downstream tasks, REMO outperforms the standard baseline of single-molecule masked modeling used in current MRL. Remarkably, REMO is the pioneering deep learning model surpassing fingerprint-based methods in activity cliff benchmarks.


title: Efficient timing jitter simulation for passively mode-locked semiconductor lasers

abstract: Efficient simulation of the timing jitter in passively mode-locking lasers is key to their numerical investigation and optimization. We introduce a method based on the pulse-period fluctuation auto-correlation function and compare it against established methods with respect to their estimate error. Potential improvements of the computational cost by about two orders of magnitude are reported. This advantage may facilitate larger parameter studies of passively mode-locked laser on small scale clusters or even desktop computers and thereby guide the target-oriented design of future lasers with ultra low timing jitter.


title: Preserving Near-Optimal Gradient Sparsification Cost for Scalable Distributed Deep Learning

abstract: Communication overhead is a major obstacle to scaling distributed training systems. Gradient sparsification is a potential optimization approach to reduce the communication volume without significant loss of model fidelity. However, existing gradient sparsification methods have low scalability owing to inefficient design of their algorithms, which raises the communication overhead significantly. In particular, gradient build-up and inadequate sparsity control methods degrade the sparsification performance considerably. Moreover, communication traffic increases drastically owing to workload imbalance of gradient selection between workers. To address these challenges, we propose a novel gradient sparsification scheme called ExDyna. In ExDyna, the gradient tensor of the model comprises fined-grained blocks, and contiguous blocks are grouped into non-overlapping partitions. Each worker selects gradients in its exclusively allocated partition so that gradient build-up never occurs. To balance the workload of gradient selection between workers, ExDyna adjusts the topology of partitions by comparing the workloads of adjacent partitions. In addition, ExDyna supports online threshold scaling, which estimates the accurate threshold of gradient selection on-the-fly. Accordingly, ExDyna can satisfy the user-required sparsity level during a training period regardless of models and datasets. Therefore, ExDyna can enhance the scalability of distributed training systems by preserving near-optimal gradient sparsification cost. In experiments, ExDyna outperformed state-of-the-art sparsifiers in terms of training speed and sparsification performance while achieving high accuracy.


title: Semirings for Probabilistic and Neuro-Symbolic Logic Programming

abstract: The field of probabilistic logic programming (PLP) focuses on integrating probabilistic models into programming languages based on logic. Over the past 30 years, numerous languages and frameworks have been developed for modeling, inference and learning in probabilistic logic programs. While originally PLP focused on discrete probability, more recent approaches have incorporated continuous distributions as well as neural networks, effectively yielding neural-symbolic methods. We provide a unified algebraic perspective on PLP, showing that many if not most of the extensions of PLP can be cast within a common algebraic logic programming framework, in which facts are labeled with elements of a semiring and disjunction and conjunction are replaced by addition and multiplication. This does not only hold for the PLP variations itself but also for the underlying execution mechanism that is based on (algebraic) model counting.


title: A comparison of shrinkage estimators of the cosmological precision matrix

abstract: The determination of the covariance matrix and its inverse, the precision matrix, is critical in the statistical analysis of cosmological measurements. The covariance matrix is typically estimated with a limited number of simulations at great computational cost before inversion into the precision matrix; therefore, it can be ill-conditioned and overly noisy when the sample size $n$ used for estimation is not much larger than the data vector dimension. In this work, we consider a class of methods known as shrinkage estimation for the precision matrix, which combines an empirical estimate with a target that is either analytical or stochastic. These methods include linear and non-linear shrinkage applied to the covariance matrix (the latter represented by the so-called NERCOME estimator), and the direct linear shrinkage estimation of the precision matrix which we introduce in a cosmological setting. Using Bayesian parameter inference as well as metrics like matrix loss functions and the eigenvalue spectrum, we compare their performance against the standard sample estimator with varying sample size $n$. We have found the shrinkage estimators to significantly improve the posterior distribution at low $n$, especially for the linear shrinkage estimators either inverted from the covariance matrix or applied directly to the precision matrix, with an empirical target constructed from the sample estimate. Our results should be particularly relevant to the analyses of Stage-IV spectroscopic galaxy surveys such as the Dark Energy Spectroscopic Instrument (DESI) and Euclid, whose statistical power can be limited by the computational cost of obtaining an accurate precision matrix estimate.


title: Theoretical analysis and predictions for the double electron capture of $^{124}$Xe

abstract: We provide a complete theoretical description of the two-neutrino electron capture in $^{124}$Xe, improving both the nuclear and the atomic structure calculations. We improve the general formalism through the use of the Taylor expansion method, leading to higher order terms in the decay rate of the process. The nuclear part is treated with pn-QRPA and interacting shell model (ISM) methods. The nuclear matrix elements (NMEs) are calculated with the pn-QRPA method with spin restoration by fixing the input parameters so that the experimental decay rate is reproduced, resulting in values significantly lower than in previous calculations. The validity of the pn-QRPA NMEs is tested by showing their values to be comparable with the ones for double-beta decay with emission of two electrons of $^{128,130}$Te, which have similar pairing features. Within the ISM, we reproduce the total experimental half-life within a factor of two and predict the capture fraction to the KK channel of about 74\%. We also predict the capture fractions to other decay channels and show that for the cumulative decay to the $\rm{KL_{1}}$-$\rm{KO_{1}}$ channels, a capture fraction of about 24\% could be observed experimentally. On the atomic side, calculations are improved by accounting for the Pauli blocking of the decay of innermost nucleon states and by considering all $s$-wave electrons available for capture, expanding beyond the K and L$_1$ orbitals considered in previous studies. We also provide improved atomic relaxation energies of the final atomic states of $^{124}$Te, which may be used as input for background modeling in liquid Xenon experiments.


title: Synthesis of Hierarchical Controllers Based on Deep Reinforcement Learning Policies

abstract: We propose a novel approach to the problem of controller design for environments modeled as Markov decision processes (MDPs). Specifically, we consider a hierarchical MDP a graph with each vertex populated by an MDP called a "room". We first apply deep reinforcement learning (DRL) to obtain low-level policies for each room, scaling to large rooms of unknown structure. We then apply reactive synthesis to obtain a high-level planner that chooses which low-level policy to execute in each room. The central challenge in synthesizing the planner is the need for modeling rooms. We address this challenge by developing a DRL procedure to train concise "latent" policies together with PAC guarantees on their performance. Unlike previous approaches, ours circumvents a model distillation step. Our approach combats sparse rewards in DRL and enables reusability of low-level policies. We demonstrate feasibility in a case study involving agent navigation amid moving obstacles.


title: Degree conditions for disjoint path covers in digraphs

abstract: In this paper, we study degree conditions for three types of disjoint directed path cover problems: many-to-many $k$-DDPC, one-to-many $k$-DDPC and one-to-one $k$-DDPC, which are intimately connected to other famous topics in graph theory, such as Hamiltonicity and $k$-linkage, and have a strong background of applications. Firstly, we get two sharp minimum semi-degree sufficient conditions for the unpaired many-to-many $k$-DDPC problem and a sharp Ore-type degree condition for the paired many-to-many $2$-DDPC problem. Secondly, we obtain a minimum semi-degree sufficient condition for the one-to-many $k$-DDPC problem on a digraph with order $n$, and show that the bound for the minimum semi-degree is sharp when $n+k$ is even and is sharp up to an additive constant 1 otherwise. Finally, we give a minimum semi-degree sufficient condition for the one-to-one $k$-DDPC problem on a digraph with order $n$, and show that the bound for the minimum semi-degree is sharp when $n+k$ is odd and is sharp up to an additive constant 1 otherwise.


title: Fairness Rising from the Ranks: HITS and PageRank on Homophilic Networks

abstract: In this paper, we investigate the conditions under which link analysis algorithms prevent minority groups from reaching high ranking slots. We find that the most common link-based algorithms using centrality metrics, such as PageRank and HITS, can reproduce and even amplify bias against minority groups in networks. Yet, their behavior differs: one one hand, we empirically show that PageRank mirrors the degree distribution for most of the ranking positions and it can equalize representation of minorities among the top ranked nodes; on the other hand, we find that HITS amplifies pre-existing bias in homophilic networks through a novel theoretical analysis, supported by empirical results. We find the root cause of bias amplification in HITS to be the level of homophily present in the network, modeled through an evolving network model with two communities. We illustrate our theoretical analysis on both synthetic and real datasets and we present directions for future work.


title: A Unifying Theory for Runge-Kutta-like Time Integrators: Convergence and Stability

abstract: The work deals with two major topics concerning the numerical analysis of Runge-Kutta-like (RK-like) methods, namely their stability and order of convergence. RK-like methods differ from additive RK methods in that their coefficients are allowed to depend on the solution and the step size. As a result of this, we also refer to them as non-standard additive RK (NSARK) methods. The first major part of this thesis is dedicated to providing a tool for deriving order conditions for NSARK methods. The proposed approach may yield implicit order conditions, which can be rewritten in explicit form using the NB-series of the stages. The obtained explicit order conditions can be further reduced using Gr\"obner bases computations. With the presented approach, it was possible for the first time to obtain conditions for the construction of 3rd and 4th order GeCo as well as 4th order MPRK schemes. Moreover, a new fourth order MPRK method is constructed using our theory and the order of convergence is validated numerically. The second major part is concerned with the stability of nonlinear time integrators preserving at least one linear invariant. We discuss how the given approach generalizes the notion of A-stability. We can prove that investigating the Jacobian of the generating map is sufficient to understand the stability of the nonlinear method in a neighborhood of the steady state. This approach allows for the first time the investigation of several modified Patankar. In the case of MPRK schemes, we compute a general stability function in a way that can be easily adapted to the case of PDRS. Finally, the approach from the theory of dynamical systems is used to derive a necessary condition for avoiding unrealistic oscillations of the numerical approximation.


title: The seasonality of air ticket prices before and after the pandemic

abstract: This study investigates price seasonality in the Brazilian air transport industry, emphasizing the impact of the COVID-19 pandemic on domestic airline pricing strategies. Given potential shifts in demand patterns following the global health crisis, this study explores possible long-term structural changes in the seasonality of Brazilian airfare. We analyze an open dataset of domestic city pairs from 2013 to 2023, employing an econometric model developed using Stata software. Our findings indicate alterations in seasonal patterns and long-term trends in the post-pandemic era. These changes underscore potential shifts in the composition of leisure and business travelers, along with the cost pressures faced by airlines.


title: Nonlocal-to-Local Convergence for a Cahn-Hilliard Tumor Growth Model

abstract: We consider a local Cahn-Hilliard-type model for tumor growth as well as a nonlocal model where, compared to the local system, the Laplacian in the equation for the chemical potential is replaced by a nonlocal operator. The latter is defined as a convolution integral with suitable kernels parametrized by a small parameter. For sufficiently smooth bounded domains in three dimensions, we prove convergence of weak solutions of the nonlocal model towards strong solutions of the local model together with convergence rates with respect to the small parameter. The proof is done via a Gronwall-type argument and a convergence result with rates for the nonlocal integral operator towards the Laplacian due to Abels, Hurm arXiv:2307.02264.


title: Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing

abstract: In recent years, black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in Remote Sensing. Despite the potential benefits of uncovering the inner workings of these models with explainable AI, a comprehensive overview summarizing the used explainable AI methods and their objectives, findings, and challenges in Remote Sensing applications is still missing. In this paper, we address this issue by performing a systematic review to identify the key trends of how explainable AI is used in Remote Sensing and shed light on novel explainable AI approaches and emerging directions that tackle specific Remote Sensing challenges. We also reveal the common patterns of explanation interpretation, discuss the extracted scientific insights in Remote Sensing, and reflect on the approaches used for explainable AI methods evaluation. Our review provides a complete summary of the state-of-the-art in the field. Further, we give a detailed outlook on the challenges and promising research directions, representing a basis for novel methodological development and a useful starting point for new researchers in the field of explainable AI in Remote Sensing.


title: Trustworthy Distributed Certification of Program Execution

abstract: Verifying the execution of a program is complicated and often limited by the inability to validate the code's correctness. It is a crucial aspect of scientific research, where it is needed to ensure the reproducibility and validity of experimental results. Similarly, in customer software testing, it is difficult for customers to verify that their specific program version was tested or executed at all. Existing state-of-the-art solutions, such as hardware-based approaches, constraint solvers, and verifiable computation systems, do not provide definitive proof of execution, which hinders reliable testing and analysis of program results. In this paper, we propose an innovative approach that combines a prototype programming language called Mona with a certification protocol OCCP to enable the distributed and decentralized re-execution of program segments. Our protocol allows for certification of program segments in a distributed, immutable, and trustworthy system without the need for naive re-execution, resulting in significant improvements in terms of time and computational resources used. We also explore the use of blockchain technology to manage the protocol workflow following other approaches in this space. Our approach offers a promising solution to the challenges of program execution verification and opens up opportunities for further research and development in this area. Our findings demonstrate the efficiency of our approach in reducing the number of program executions compared to existing state-of-the-art methods, thus improving the efficiency of certifying program executions.