title: Construction of the log-convex minorant of a sequence $\{M_\alpha\}_{\alpha\in\mathbb{N}_0^d}$

abstract: We give a simple construction of the log-convex minorant of a sequence $\{M_\alpha\}_{\alpha\in\mathbb{N}_0^d}$ and consequently extend to the $d$-dimensional case the well-known formula that relates a log-convex sequence $\{M_p\}_{p\in\mathbb{N}_0}$ to its associated function $\omega_M$, that is $M_p=\sup_{t>0}t^p\exp(-\omega_M(t))$. We show that in the more dimensional anisotropic case the classical log-convex condition $M_\alpha^2\leq M_{\alpha-e_j}M_{\alpha+e_j}$ is not sufficient: convexity as a function of more variables is needed (not only coordinate-wise). We finally obtain some applications to the inclusion of spaces of rapidly decreasing ultradifferentiable functions in the matrix weighted setting.


title: Prompt-RAG: Pioneering Vector Embedding-Free Retrieval-Augmented Generation in Niche Domains, Exemplified by Korean Medicine

abstract: We propose a natural language prompt-based retrieval augmented generation (Prompt-RAG), a novel approach to enhance the performance of generative large language models (LLMs) in niche domains. Conventional RAG methods mostly require vector embeddings, yet the suitability of generic LLM-based embedding representations for specialized domains remains uncertain. To explore and exemplify this point, we compared vector embeddings from Korean Medicine (KM) and Conventional Medicine (CM) documents, finding that KM document embeddings correlated more with token overlaps and less with human-assessed document relatedness, in contrast to CM embeddings. Prompt-RAG, distinct from conventional RAG models, operates without the need for embedding vectors. Its performance was assessed through a Question-Answering (QA) chatbot application, where responses were evaluated for relevance, readability, and informativeness. The results showed that Prompt-RAG outperformed existing models, including ChatGPT and conventional vector embedding-based RAGs, in terms of relevance and informativeness. Despite challenges like content structuring and response latency, the advancements in LLMs are expected to encourage the use of Prompt-RAG, making it a promising tool for other domains in need of RAG methods.


title: Applying stiff integrators for ODEs and DDEs to problems with distributed delays

abstract: There exist excellent codes for an efficient numerical treatment of stiff and differential-algebraic problems. Let us mention {\sc Radau5} which is based on the $3$-stage Radau IIA collocation method, and its extension to problems with discrete delays {\sc Radar5}. The aim of the present work is to present a technique that permits a direct application of these codes to problems having a right-hand side with an additional distributed delay term (which is a special case of an integro-differential equation). Models with distributed delays are of increasing importance in pharmacodynamics and pharmacokinetics for the study of the interaction between drugs and the body. The main idea is to approximate the distribution kernel of the integral term by a sum of exponential functions or by a quasi-polynomial expansion, and then to transform the distributed (integral) delay term into a set of ordinary differential equations. This set is typically stiff and, for some distribution kernels (e.g., Pareto distribution), it contains discrete delay terms with constant delay. The original equations augmented by this set of ordinary differential equations can have a very large dimension, and a careful treatment of the solution of the arising linear systems is necessary. The use of the codes {\sc Radau5} and {\sc Radar5} is illustrated at three examples (two test equations and one problem taken from pharmacodynamics). The driver programs for these examples are publicly available from the homepages of the authors.


title: Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval

abstract: Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder blocks to provide sustainable supervision signals and compress contextual information into dense representations. However, the underlying reasons for the effectiveness of such a pre-training technique remain unclear. The usage of additional Transformer-based decoders also incurs significant computational costs. In this study, we aim to shed light on this issue by revealing that masked auto-encoder (MAE) pre-training with enhanced decoding significantly improves the term coverage of input tokens in dense representations, compared to vanilla BERT checkpoints. Building upon this observation, we propose a modification to the traditional MAE by replacing the decoder of a masked auto-encoder with a completely simplified Bag-of-Word prediction task. This modification enables the efficient compression of lexical signals into dense representations through unsupervised pre-training. Remarkably, our proposed method achieves state-of-the-art retrieval performance on several large-scale retrieval benchmarks without requiring any additional parameters, which provides a 67% training speed-up compared to standard masked auto-encoder pre-training with enhanced decoding.


title: Evaluating if trust and personal information privacy concerns are barriers to using health insurance that explicitly utilizes AI

abstract: Trust and privacy have emerged as significant concerns in online transactions. Sharing information on health is especially sensitive but it is necessary for purchasing and utilizing health insurance. Evidence shows that consumers are increasingly comfortable with technology in place of humans, but the expanding use of AI potentially changes this. This research explores whether trust and privacy concern are barriers to the adoption of AI in health insurance. Two scenarios are compared: The first scenario has limited AI that is not in the interface and its presence is not explicitly revealed to the consumer. In the second scenario there is an AI interface and AI evaluation, and this is explicitly revealed to the consumer. The two scenarios were modeled and compared using SEM PLS-MGA. The findings show that trust is significantly lower in the second scenario where AI is visible. Privacy concerns are higher with AI but the difference is not statistically significant within the model.


title: AFS-BM: Enhancing Model Performance through Adaptive Feature Selection with Binary Masking

abstract: We study the problem of feature selection in general machine learning (ML) context, which is one of the most critical subjects in the field. Although, there exist many feature selection methods, however, these methods face challenges such as scalability, managing high-dimensional data, dealing with correlated features, adapting to variable feature importance, and integrating domain knowledge. To this end, we introduce the "Adaptive Feature Selection with Binary Masking" (AFS-BM) which remedies these problems. AFS-BM achieves this by joint optimization for simultaneous feature selection and model training. In particular, we do the joint optimization and binary masking to continuously adapt the set of features and model parameters during the training process. This approach leads to significant improvements in model accuracy and a reduction in computational requirements. We provide an extensive set of experiments where we compare AFS-BM with the established feature selection methods using well-known datasets from real-life competitions. Our results show that AFS-BM makes significant improvement in terms of accuracy and requires significantly less computational complexity. This is due to AFS-BM's ability to dynamically adjust to the changing importance of features during the training process, which an important contribution to the field. We openly share our code for the replicability of our results and to facilitate further research.


title: On the inclusion relations of global ultradifferentiable classes defined by weight matrices

abstract: We study and characterize the inclusion relations of global classes in the general weight matrix framework in terms of growth relations for the defining weight matrices. We consider the Roumieu and Beurling cases, and as a particular case we also treat the classical weight function and weight sequence cases. Moreover, we construct a weight sequence which is oscillating around any weight sequence which satisfies some minimal conditions and, in particular, around the critical weight sequence $(p!)^{1/2}$, related with the non-triviality of the classes. Finally, we also obtain comparison results both on classes defined by weight functions that can be defined by weight sequences and conversely.


title: Automated Fusion of Multimodal Electronic Health Records for Better Medical Predictions

abstract: The widespread adoption of Electronic Health Record (EHR) systems in healthcare institutes has generated vast amounts of medical data, offering significant opportunities for improving healthcare services through deep learning techniques. However, the complex and diverse modalities and feature structures in real-world EHR data pose great challenges for deep learning model design. To address the multi-modality challenge in EHR data, current approaches primarily rely on hand-crafted model architectures based on intuition and empirical experiences, leading to sub-optimal model architectures and limited performance. Therefore, to automate the process of model design for mining EHR data, we propose a novel neural architecture search (NAS) framework named AutoFM, which can automatically search for the optimal model architectures for encoding diverse input modalities and fusion strategies. We conduct thorough experiments on real-world multi-modal EHR data and prediction tasks, and the results demonstrate that our framework not only achieves significant performance improvement over existing state-of-the-art methods but also discovers meaningful network architectures effectively.


title: Maximum Likelihood Estimators of Quantum Probabilities

abstract: Classical probability theory is based on assumptions which are often violated in practice. Therefore quantum probability is a proposed alternative not only in quantum physics, but also in other sciences. However, so far it mostly criticizes the classical approach, but does not suggest a working alternative. Maximum likelihood estimators were given very low attention in this context. We show that they can be correctly defined and their computation in closed form is feasible at least in some cases.


title: The Great Ban: Efficacy and Unintended Consequences of a Massive Deplatforming Operation on Reddit

abstract: In the current landscape of online abuses and harms, effective content moderation is necessary to cultivate safe and inclusive online spaces. Yet, the effectiveness of many moderation interventions is still unclear. Here, we assess the effectiveness of The Great Ban, a massive deplatforming operation that affected nearly 2,000 communities on Reddit. By analyzing 16M comments posted by 17K users during 14 months, we provide nuanced results on the effects, both desired and otherwise, of the ban. Among our main findings is that 15.6% of the affected users left Reddit and that those who remained reduced their toxicity by 6.6% on average. The ban also caused 5% users to increase their toxicity by more than 70% of their pre-ban level. Overall, our multifaceted results provide new insights into the efficacy of deplatforming. As such, our findings can inform the development of future moderation interventions and the policing of online platforms.


title: Visualization Generation with Large Language Models: An Evaluation

abstract: Analysts frequently need to create visualizations in the data analysis process to obtain and communicate insights. To reduce the burden of creating visualizations, previous research has developed various approaches for analysts to create visualizations from natural language queries. Recent studies have demonstrated the capabilities of large language models in natural language understanding and code generation tasks. The capabilities imply the potential of using large language models to generate visualization specifications from natural language queries. In this paper, we evaluate the capability of a large language model to generate visualization specifications on the task of natural language to visualization (NL2VIS). More specifically, we have opted for GPT-3.5 and Vega-Lite to represent large language models and visualization specifications, respectively. The evaluation is conducted on the nvBench dataset. In the evaluation, we utilize both zero-shot and few-shot prompt strategies. The results demonstrate that GPT-3.5 surpasses previous NL2VIS approaches. Additionally, the performance of few-shot prompts is higher than that of zero-shot prompts. We discuss the limitations of GPT-3.5 on NL2VIS, such as misunderstanding the data attributes and grammar errors in generated specifications. We also summarized several directions, such as correcting the ground truth and reducing the ambiguities in natural language queries, to improve the NL2VIS benchmark.


title: Equivariant Multiscale Learned Invertible Reconstruction for Cone Beam CT

abstract: Cone Beam CT (CBCT) is an essential imaging modality nowadays, but the image quality of CBCT still lags behind the high quality standards established by the conventional Computed Tomography. We propose LIRE+, a learned iterative scheme for fast and memory-efficient CBCT reconstruction, which is a substantially faster and more parameter-efficient alternative to the recently proposed LIRE method. LIRE+ is a rotationally-equivariant multiscale learned invertible primal-dual iterative scheme for CBCT reconstruction. Memory usage is optimized by relying on simple reversible residual networks in primal/dual cells and patch-wise computations inside the cells during forward and backward passes, while increased inference speed is achieved by making the primal-dual scheme multiscale so that the reconstruction process starts at low resolution and with low resolution primal/dual latent vectors. A LIRE+ model was trained and validated on a set of 260 + 22 thorax CT scans and tested using a set of 142 thorax CT scans with additional evaluation with and without finetuning on an out-of-distribution set of 79 Head and Neck (HN) CT scans. Our method surpasses classical and deep learning baselines, including LIRE, on the thorax test set. For a similar inference time and with only 37 % of the parameter budget, LIRE+ achieves a +0.2 dB PSNR improvement over LIRE, while being able to match the performance of LIRE in 45 % less inference time and with 28 % of the parameter budget. Rotational equivariance ensures robustness of LIRE+ to patient orientation, while LIRE and other deep learning baselines suffer from substantial performance degradation when patient orientation is unusual. On the HN dataset in the absence of finetuning, LIRE+ is generally comparable to LIRE in performance apart from a few outlier cases, whereas after identical finetuning LIRE+ demonstates a +1.02 dB PSNR improvement over LIRE.


title: Measuring Policy Distance for Multi-Agent Reinforcement Learning

abstract: Diversity plays a crucial role in improving the performance of multi-agent reinforcement learning (MARL). Currently, many diversity-based methods have been developed to overcome the drawbacks of excessive parameter sharing in traditional MARL. However, there remains a lack of a general metric to quantify policy differences among agents. Such a metric would not only facilitate the evaluation of the diversity evolution in multi-agent systems, but also provide guidance for the design of diversity-based MARL algorithms. In this paper, we propose the multi-agent policy distance (MAPD), a general tool for measuring policy differences in MARL. By learning the conditional representations of agents' decisions, MAPD can computes the policy distance between any pair of agents. Furthermore, we extend MAPD to a customizable version, which can quantify differences among agent policies on specified aspects. Based on the online deployment of MAPD, we design a multi-agent dynamic parameter sharing (MADPS) algorithm as an example of the MAPD's applications. Extensive experiments demonstrate that our method is effective in measuring differences in agent policies and specific behavioral tendencies. Moreover, in comparison to other methods of parameter sharing, MADPS exhibits superior performance.


abstract: One of the major benefits of quantum computing is the potential to resolve complex computational problems faster than can be done by classical methods. There are many prototype-based clustering methods in use today, and selection of the starting nodes for the center points is often done randomly. For prototype-based clustering algorithms, this could lead to much slower convergence times. One of the causes of this may be prototype-based clustering accepting a local minima as a valid solution when there are possibly better solutions. Quantum computing, specifically quantum annealing, offers a solution to these problems by mapping the initial centroid problem to an Ising Hamiltonian where over time the lowest energy in the spectrum correlates to a valid, but better solution. A first approach to this problem utilizing quantum annealing was known as Quantum Optimized Centroid Initialization (QOCI), but this approach has some limitations both in results and performance. We will present a modification of QOCI known as Adaptive Quantum Optimized Centroid Initialization (AQOCI) which addresses many of the limitations in QOCI. The results presented are comparable to those obtained using classical techniques as well as being superior to those results found using QOCI.


title: Integrable nonlocal finite-dimensional Hamiltonian systems related to the Ablowitz-Kaup-Newell-Segur system

abstract: The method of nonlinearization of the Lax pair is developed for the Ablowitz-Kaup-Newell-Segur (AKNS) equation in the presence of space-inverse reductions. As a result, we obtain a new type of finite-dimensional Hamiltonian systems: they are nonlocal in the sense that the inverse of the space variable is involved. For such nonlocal Hamiltonian systems, we show that they preserve the Liouville integrability and they can be linearized on the Jacobi variety. We also show how to construct the algebro-geometric solutions to the AKNS equation with space-inverse reductions by virtue of our nonlocal finite-dimensional Hamiltonian systems. As an application, algebro-geometric solutions to the AKNS equation with the Dirichlet and with the Neumann boundary conditions, and algebro-geometric solutions to the nonlocal nonlinear Schr\"{o}dinger (NLS) equation are obtained.


title: Modeling and Mathematical Analysis of the Clogging Phenomenon in Filtration Filters Installed in Aquaria

abstract: This paper proposes a mathematical model for replicating a simple dynamics in an aquarium with two components; bacteria and organic matter. The model is based on a system of partial differential equations (PDEs) with four components: the drift-diffusion equation, the dynamic boundary condition, the fourth boundary condition, and the prey-predator model. The system of PDEs is structured to represent typical dynamics, including the increase of organic matter in the aquarium due to the excretion of organisms ($e.g$. fish), its adsorption into the filtration filter, and the decomposition action of the organic matter both on the filtration filter and within the aquarium. In this paper, we prove the well-posedness of the system and show some results of numerical experiments. The numerical experiments provide a validity of the modeling and demonstrate filter clogging phenomena. We compare the feeding rate with the filtration performance of the filter. The model exhibits convergence to a bounded steady state when the feed rate is reasonable, and grow up to an unbounded solution when the feeding is excessively high. The latter corresponds to the clogging phenomenon of the filter.


title: Diffusion Model Conditioning on Gaussian Mixture Model and Negative Gaussian Mixture Gradient

abstract: Diffusion models (DMs) are a type of generative model that has a huge impact on image synthesis and beyond. They achieve state-of-the-art generation results in various generative tasks. A great diversity of conditioning inputs, such as text or bounding boxes, are accessible to control the generation. In this work, we propose a conditioning mechanism utilizing Gaussian mixture models (GMMs) as feature conditioning to guide the denoising process. Based on set theory, we provide a comprehensive theoretical analysis that shows that conditional latent distribution based on features and classes is significantly different, so that conditional latent distribution on features produces fewer defect generations than conditioning on classes. Two diffusion models conditioned on the Gaussian mixture model are trained separately for comparison. Experiments support our findings. A novel gradient function called the negative Gaussian mixture gradient (NGMG) is proposed and applied in diffusion model training with an additional classifier. Training stability has improved. We also theoretically prove that NGMG shares the same benefit as the Earth Mover distance (Wasserstein) as a more sensible cost function when learning distributions supported by low-dimensional manifolds.


title: Multireference Perturbation Theories Based on the Dyall Hamiltonian

abstract: The concept of Dyall zeroth-order Hamiltonian [Dyall, K. G. J. Chem. Phys., 102, 4909-4918 (1995)] has been instrumental in the development of intruder- and parameter-free multireference perturbation theories for the efficient treatment of static and dynamic correlation in molecular systems. In this review, we discuss two theoretical approaches based on the Dyall Hamiltonian: (i) N-electron valence perturbation theory and (ii) multireference algebraic diagrammatic construction theory. We briefly cover the technical aspects behind these theories and discuss their relationship. We conclude with a short description of alternative approaches based on the Dyall Hamiltonian, a summary, and an outlook on future developments.


title: Estimating heterogeneous treatment effect from survival outcomes via (orthogonal) censoring unbiased learning

abstract: Methods for estimating heterogeneous treatment effects (HTE) from observational data have largely focused on continuous or binary outcomes, with less attention paid to survival outcomes and almost none to settings with competing risks. In this work, we develop censoring unbiased transformations (CUTs) for survival outcomes both with and without competing risks.After converting time-to-event outcomes using these CUTs, direct application of HTE learners for continuous outcomes yields consistent estimates of heterogeneous cumulative incidence effects, total effects, and separable direct effects. Our CUTs enable application of a much larger set of state of the art HTE learners for censored outcomes than had previously been available, especially in competing risks settings. We provide generic model-free learner-specific oracle inequalities bounding the finite-sample excess risk. The oracle efficiency results depend on the oracle selector and estimated nuisance functions from all steps involved in the transformation. We demonstrate the empirical performance of the proposed methods in simulation studies.


title: Adaptive Bayesian Optimization Algorithm for Unpredictable Business Environments

abstract: This paper presents an innovative optimization framework and algorithm based on the Bayes theorem, featuring adaptive conditioning and jitter. The adaptive conditioning function dynamically modifies the mean objective function in each iteration, enhancing its adaptability. The mean function, representing the model's best estimate of the optimal value for the true objective function, is adjusted based on observed data. The framework also incorporates an adaptive acquisition jitter function, enhancing adaptability by adjusting the jitter of the acquisition function. It also introduces a robust objective function with a penalty term, aiming to generate robust solutions under uncertainty. The evaluation of the framework includes single-objective, decoupled multi-objective, and combined multi-objective functions. Statistical analyses, including t-statistics, p-values, and effect size measures, highlight the superiority of the proposed framework over the original Bayes optimization. The adaptive nature of the conditioning function allows the algorithm to seamlessly incorporate new data, making it particularly beneficial in dynamic optimization scenarios.


title: Assessing the Competitiveness of Matrix-Free Block Likelihood Estimation in Spatial Models

abstract: In geostatistics, block likelihood offers a balance between statistical accuracy and computational efficiency when estimating covariance functions. This balance is reached by dividing the sample into blocks and computing a weighted sum of (sub) log-likelihoods corresponding to pairs of blocks. Practitioners often choose block sizes ranging from hundreds to a few thousand observations, inherently involving matrix-based implementations. An alternative, residing at the opposite end of this methodological spectrum, treats each observation as a block, resulting in the matrix-free pairwise likelihood method. We propose an additional alternative within this broad methodological landscape, systematically constructing blocks of size two and merging pairs of blocks through conditioning. Importantly, our method strategically avoids large-sized blocks, facilitating explicit calculations that ultimately do not rely on matrix computations. Studies with both simulated and real data validate the effectiveness of our approach, on one hand demonstrating its superiority over pairwise likelihood, and on the other, challenging the intuitive notion that employing matrix-based versions universally lead to better statistical performance.


title: Lower bounds for set-blocked clauses proofs

abstract: We study propositional proof systems with inference rules that formalize restricted versions of the ability to make assumptions that hold without loss of generality, commonly used informally to shorten proofs. Each system we study is built on resolution. They are called BC${}^-$, RAT${}^-$, SBC${}^-$, and GER${}^-$, denoting respectively blocked clauses, resolution asymmetric tautologies, set-blocked clauses, and generalized extended resolution - all "without new variables." They may be viewed as weak versions of extended resolution (ER) since they are defined by first generalizing the extension rule and then taking away the ability to introduce new variables. Except for SBC${}^-$, they are known to be strictly between resolution and extended resolution. Several separations between these systems were proved earlier by exploiting the fact that they effectively simulate ER. We answer the questions left open: We prove exponential lower bounds for SBC${}^-$ proofs of a binary encoding of the pigeonhole principle, which separates ER from SBC${}^-$. Using this new separation, we prove that both RAT${}^-$ and GER${}^-$ are exponentially separated from SBC${}^-$. This completes the picture of their relative strengths.


title: Charge transfer transitions and circular magnetooptics in ferrites

abstract: The concept of charge-transfer (CT) transitions in ferrites is based on the cluster approach and takes into account the relevant interactions as the low-symmetry crystal field, spin-orbital, Zeeman, exchange and exchange-relativistic interactions. For all its simplicity, this concept yield a reliable qualitative and quantitative microscopic explanation of spectral, concentration, temperature, and field dependences of optic and magneto-optic properties ranging from the isotropic absorption as well as the optic anisotropy to the circular magneto-optics. In this review paper, starting with a critical analysis of the fundamental shortcomings of the "first-principles" DFT-based band theory we present the main ideas and techniques of the cluster theory of the CT transitions to be main contributors to circular magneto-optics of ferrites.


title: Word-Level ASR Quality Estimation for Efficient Corpus Sampling and Post-Editing through Analyzing Attentions of a Reference-Free Metric

abstract: In the realm of automatic speech recognition (ASR), the quest for models that not only perform with high accuracy but also offer transparency in their decision-making processes is crucial. The potential of quality estimation (QE) metrics is introduced and evaluated as a novel tool to enhance explainable artificial intelligence (XAI) in ASR systems. Through experiments and analyses, the capabilities of the NoRefER (No Reference Error Rate) metric are explored in identifying word-level errors to aid post-editors in refining ASR hypotheses. The investigation also extends to the utility of NoRefER in the corpus-building process, demonstrating its effectiveness in augmenting datasets with insightful annotations. The diagnostic aspects of NoRefER are examined, revealing its ability to provide valuable insights into model behaviors and decision patterns. This has proven beneficial for prioritizing hypotheses in post-editing workflows and fine-tuning ASR models. The findings suggest that NoRefER is not merely a tool for error detection but also a comprehensive framework for enhancing ASR systems' transparency, efficiency, and effectiveness. To ensure the reproducibility of the results, all source codes of this study are made publicly available.


title: Coevolution of Resource and Strategies in Common-Pool Resource Dilemmas: A Coupled Human-Environmental System Model

abstract: Common-pool resource governance requires users to cooperate and avoid overexploitation, but defection and free-riding often undermine cooperation. We model a human-environmental system that integrates dynamics of resource and users' strategies. The resource follows a logistic function that depends on natural growth rate, carrying capacity, and extraction rates of cooperators and defectors. The users' strategies evolve according to different processes that capture effects of payoff, resource, and noise. We analyze the feedback between resource availability and strategic adaptation, and explores the conditions for the emergence and maintenance of cooperation. We find different processes lead to different regimes of equilibrium solutions and resource levels depending on the parameter configuration and initial conditions. We also show that some processes can enhance the sustainability of the resource by making the users more responsive to the resource scarcity. The paper advances the understanding of human-environmental system and offers insights for resource governance policies and interventions.


title: RoTIR: Rotation-Equivariant Network and Transformers for Fish Scale Image Registration

abstract: Image registration is an essential process for aligning features of interest from multiple images. With the recent development of deep learning techniques, image registration approaches have advanced to a new level. In this work, we present 'Rotation-Equivariant network and Transformers for Image Registration' (RoTIR), a deep-learning-based method for the alignment of fish scale images captured by light microscopy. This approach overcomes the challenge of arbitrary rotation and translation detection, as well as the absence of ground truth data. We employ feature-matching approaches based on Transformers and general E(2)-equivariant steerable CNNs for model creation. Besides, an artificial training dataset is employed for semi-supervised learning. Results show RoTIR successfully achieves the goal of fish scale image registration.


title: DACR: Distribution-Augmented Contrastive Reconstruction for Time-Series Anomaly Detection

abstract: Anomaly detection in time-series data is crucial for identifying faults, failures, threats, and outliers across a range of applications. Recently, deep learning techniques have been applied to this topic, but they often struggle in real-world scenarios that are complex and highly dynamic, e.g., the normal data may consist of multiple distributions, and various types of anomalies may differ from the normal data to different degrees. In this work, to tackle these challenges, we propose Distribution-Augmented Contrastive Reconstruction (DACR). DACR generates extra data disjoint from the normal data distribution to compress the normal data's representation space, and enhances the feature extractor through contrastive learning to better capture the intrinsic semantics from time-series data. Furthermore, DACR employs an attention mechanism to model the semantic dependencies among multivariate time-series features, thereby achieving more robust reconstruction for anomaly detection. Extensive experiments conducted on nine benchmark datasets in various anomaly detection scenarios demonstrate the effectiveness of DACR in achieving new state-of-the-art time-series anomaly detection.


title: Asymptotics for non-degenerate multivariate $U$-statistics with estimated nuisance parameters under the null and local alternative hypotheses

abstract: The large-sample behavior of non-degenerate multivariate $U$-statistics of arbitrary degree is investigated under the assumption that their kernel depends on parameters that can be estimated consistently. Mild regularity conditions are given which guarantee that once properly normalized, such statistics are asymptotically multivariate Gaussian both under the null hypothesis and sequences of local alternatives. The work of Randles (1982, Ann. Statist.) is extended in three ways: the data and the kernel values can be multivariate rather than univariate, the limiting behavior under local alternatives is studied for the first time, and the effect of knowing some of the nuisance parameters is quantified. These results can be applied to a broad range of goodness-of-fit testing contexts, as shown in one specific example.


title: Einstein-Gauss-Bonnet Cosmological Theories at Reheating and at the End of the Inflationary Era

abstract: In this work we study the GW170817-compatible Einstein-Gauss-Bonnet theories during the reheating and the end of inflationary era. Given the scalar field potential $V(\phi)$ which can have some intrinsic importance for the theory, determining the scalar coupling function $\xi(\phi)$ can be cumbersome due to lack of analyticity. The GW170817 observation constrains the scalar coupling function and the scalar field potential to have some interdependence, thus during the slow-roll era one can calculate the scalar coupling function. However, when the slow-roll era ends, it is expected that the scalar coupling function should have a different form and the same applies for the reheating era, assuming that the scalar potential of the theory does not change. In this work we exactly aim to highlight this feature of Einstein-Gauss-Bonnet theories, as the Universe evolves through distinct sequential evolution eras, and we focus on how to determine the scalar coupling function during the various evolutionary eras, from inflation to the reheating era. Regarding both the end of the inflationary era and the reheating era, it is found that the Hubble rate obeys a constant-roll-like condition of the form $\dot{H}=\delta H^2$, thus the determination of the scalar Gauss-Bonnet function $\xi(\phi)$ is reduced to solving a differential equation. A mentionable feature of the era exactly at the end of inflation is that the Klein-Gordon equation is decoupled from the field equations, because the Gauss-Bonnet invariant is zero. We provide several examples of interest to support our arguments.


title: Unambiguous parity-query complexity

abstract: We give a lower bound of $\Omega(\sqrt n)$ on the unambiguous randomised parity-query complexity of the approximate majority problem -- that is, on the lowest randomised parity-query complexity of any function over $\{0,1\}^n$ whose value is "0" if the Hamming weight of the input is at most n/3, is "1" if the weight is at least 2n/3, and may be arbitrary otherwise.


title: Heavy ion collisions from $\sqrt{s_{NN}}$ of 62.4 GeV down to 4 GeV in the EPOS4 framework

abstract: The EPOS4 project is an attempt to construct a realistic model for describing relativistic collisions of different systems, from proton-proton ($pp$) to nucleus-nucleus ($AA$), at energies from several TeV per nucleon down to several GeV. We argue that a parallel scattering formalism (as in EPOS4) is relevant for primary scatterings in AA collisions above 4 GeV, whereas sequential scattering (cascade) is appropriate below. We present briefly the basic elements of EPOS4, and then investigate heavy ion collisions from 62.4 GeV down to 4 GeV, to understand how physics changes with energy, studying in particular the disappearance of the fluid component at low energies.


title: Equational definitions of logical filters

abstract: A finitary propositional logic can be given an algebraic reading in two different ways: by translating formulas into equations and logical rules into quasi-equations, or by translating logical rules directly into equations. The former type of algebraic interpretation has been extensively studied and underlies the theory of algebraization. Here we shall develop a systematic theory of the latter type of algebraic interpretation. More precisely, we consider a semantic form of this property which we call the equational definability of compact filters (EDCF). Paralleling the well-studied hierarchy of variants of the deduction--detachment theorem (DDT), this property also comes in local, parametrized, and parametrized local variants. Our main results give a semantic characterization of each of these variants of the EDCF in a spirit similar to the existing characterizations of the DDT. While the EDCF hierarchy and the DDT hierarchy coincide for algebraizable logics, part of the interest of the EDCF stems from the fact it is often enjoyed even by logics which are not well-behaved in terms of other existing classifications in algebraic logic.


title: Averaging theorems for slow fast systems in $\mathbb{Z}$-extensions (discrete time)

abstract: We study the averaging method for flows perturbed by a dynamical system preserving an infinite measure. Motivated by the case of perturbation by the collision dynamic on the finite horizon $\mathbb Z$-periodic Lorentz gas and in view of future development, we establish our results in a general context of perturbation by $\mathbb Z$-extension over chaotic probability preserving dynamical systems. As a by product, we prove limit theorems for non-stationary Birkhoff sums for such infinite measure preserving dynamical systems.


title: Handling incomplete outcomes and covariates in cluster-randomized trials: doubly-robust estimation, efficiency considerations, and sensitivity analysis

abstract: In cluster-randomized trials (CRTs), missing data can occur in various ways, including missing values in outcomes and baseline covariates at the individual or cluster level, or completely missing information for non-participants. Among the various types of missing data in CRTs, missing outcomes have attracted the most attention. However, no existing methods can simultaneously address all aforementioned types of missing data in CRTs. To fill in this gap, we propose a new doubly-robust estimator for the average treatment effect on a variety of scales. The proposed estimator simultaneously handles missing outcomes under missingness at random, missing covariates without constraining the missingness mechanism, and missing cluster-population sizes via a uniform sampling mechanism. Furthermore, we detail key considerations to improve precision by specifying the optimal weights, leveraging machine learning, and modeling the treatment assignment mechanism. Finally, to evaluate the impact of violating missing data assumptions, we contribute a new sensitivity analysis framework tailored to CRTs. Simulation studies and a real data application both demonstrate that our proposed methods are effective in handling missing data in CRTs and superior to the existing methods.


title: Homogenization of high-contrast dielectric elastomer composites

abstract: This paper focuses on the homogenization of high-contrast dielectric elastomer composites, materials that deform in response to electrical stimulation. The considered heterogeneous material consisting of an ambient material with inserted particles is described by a weakly coupled system of an electrostatic equation with an elastic equation enriched with electrostriction. It is assumed that particles gradually become rigid as the fine-scale parameter approaches zero. This study demonstrates that the effective response of this system entails a homogeneous dielectric elastomer, described by a weakly coupled system of PDEs. The coefficients of the homogenized equations are dependent on various factors, including the composite's geometry, the original microstructure's periodicity, and the coefficients characterizing the initial heterogeneous material. Particularly, these coefficients are significantly influenced by the high-contrast nature of the fine-scale problem's coefficients. Consequently, as anticipated, the high-contrast coefficients of the original yield non-local effects in the homogenized response.


title: Cosmic Ray Induced Neutron Production in a Lead Target

abstract: Underground experiments searching for rare events, such as interactions from dark matter, need to exhibit background as low as possible. One source of background is from cosmic ray muons and muon-induced neutron production. Presently these background are not fully understood. In this study Geant4 is used to model cosmic ray muon induced neutron multiplicity production and compare the modeling with data collected using an $^3$He instrumented Pb-target detector system. The neutron event multiplicity production is taken from the 2002 NMDS-II data sets, consisting of 6504 hrs collected at 583 m.w.e. and 1440 hrs, with the identical detector system, collected at 1166 m.w.e.. The detector consists of a 30 cm cube Pb-target surrounded by 60 $^3$He tubes. The single particle detection efficiency is 23.2\%$\pm$1.2\% calibrated using a $^{252}$Cf neutron source. The highest neutron multiplicity event, observed at 583 m.w.e. was 54 observed neutrons corresponding to $\sim$ 233 produced neutrons. The neutron multiplicity, n, distributions fit well a 2-parameter power law fit, $k\times n^{-p}$. For the Monte Carlo simulations at both depths and the data collected at both depths, all are consistent with a single slope parameter p. For the simulation at 583 m.w.e., p=2.37$\pm0.01$ and for the data collected at 583 m.w.e, p=2.36$\pm0.10$. At 1166 m.w.e., p=2.31$\pm0.01$ for the simulation, and for the data with only 6 detected events above multiplicity 5, p=$2.50 \pm 0.35$ predicted using a Maximum Likelihood Estimation method. At both depths, the power law amplitudes of the Geant4 simulations differ by a factor of 2 larger than the data sets. However, the disagreement is within the estimated systematic error of the simulations.


title: Sources of Underproduction in Open Source Software

abstract: Because open source software relies on individuals who select their own tasks, it is often underproduced -- a term used by software engineering researchers to describe when a piece of software's relative quality is lower than its relative importance. We examine the social and technical factors associated with underproduction through a comparison of software packaged by the Debian GNU/Linux community. We test a series of hypotheses developed from a reading of prior research in software engineering. Although we find that software age and programming language age offer a partial explanation for variation in underproduction, we were surprised to find that the association between underproduction and package age is weaker at high levels of programming language age. With respect to maintenance efforts, we find that additional resources are not always tied to better outcomes. In particular, having higher numbers of contributors is associated with higher underproduction risk. Also, contrary to our expectations, maintainer turnover and maintenance by a declared team are not associated with lower rates of underproduction. Finally, we find that the people working on bugs in underproduced packages tend to be those who are more central to the community's collaboration network structure, although contributors' betweenness centrality (often associated with brokerage in social networks) is not associated with underproduction.


title: What Juris Hartmanis taught me about Reductions

abstract: I was a student of Juris Hartmanis at Cornell in the late 1970's. He believed that there was great potential in studying restricted reductions. I describe here some of his influences on me and, in particular, how his insights concerning reductions helped me to prove that nondeterministic space is closed under complementation.


title: Probing Purcell enhancement and photon collection efficiency of InAs quantum dots at nodes of the cavity electric field

abstract: The interaction of excitonic transitions with confined photonic modes enables tests of quantum physics and design of efficient optoelectronic devices. Here we study how key metrics such as Purcell factor, beta-factor and collection efficiency are determined by the non-cavity modes which exist in real devices, taking the well-studied micropillar cavity as an example. Samples with dots at different positions in the cavity field allow us to quantify the effect of the non-cavity modes and show that the zero-phonon line and the phonon-assisted emission into the cavity mode HE11 is suppressed by positioning dots at the field node.


title: Evaluating Driver Readiness in Conditionally Automated Vehicles from Eye-Tracking Data and Head Pose

abstract: As automated driving technology advances, the role of the driver to resume control of the vehicle in conditionally automated vehicles becomes increasingly critical. In the SAE Level 3 or partly automated vehicles, the driver needs to be available and ready to intervene when necessary. This makes it essential to evaluate their readiness accurately. This article presents a comprehensive analysis of driver readiness assessment by combining head pose features and eye-tracking data. The study explores the effectiveness of predictive models in evaluating driver readiness, addressing the challenges of dataset limitations and limited ground truth labels. Machine learning techniques, including LSTM architectures, are utilised to model driver readiness based on the Spatio-temporal status of the driver's head pose and eye gaze. The experiments in this article revealed that a Bidirectional LSTM architecture, combining both feature sets, achieves a mean absolute error of 0.363 on the DMD dataset, demonstrating superior performance in assessing driver readiness. The modular architecture of the proposed model also allows the integration of additional driver-specific features, such as steering wheel activity, enhancing its adaptability and real-world applicability.


title: Radiation of a short linear antenna above a topologically insulating half-space

abstract: The topological magnetoelectric effect (TME) is a unique macroscopic manifestation of quantum states of matter possessing topological order and it is described by axion electrodynamics. In three-dimensional topological insulators, for instance, the axion coupling is of the order of the fine structure constant, and hence a perturbative analysis of the field equations is plenty justified. In this paper we use Green's function techniques to obtain time-dependent solutions to the axion field equations in the presence of a planar domain-wall separating two media with different topological order. We apply our results to investigate the radiation of a short linear antenna near the domain-wall.


title: Data repairing and resolution enhancement using data-driven modal decomposition and deep learning

abstract: This paper introduces a new series of methods which combine modal decomposition algorithms, such as singular value decomposition and high-order singular value decomposition, and deep learning architectures to repair, enhance, and increase the quality and precision of numerical and experimental data. A combination of two- and three-dimensional, numerical and experimental dasasets are used to demonstrate the reconstruction capacity of the presented methods, showing that these methods can be used to reconstruct any type of dataset, showing outstanding results when applied to highly complex data, which is noisy. The combination of benefits of these techniques results in a series of data-driven methods which are capable of repairing and/or enhancing the resolution of a dataset by identifying the underlying physics that define the data, which is incomplete or under-resolved, filtering any existing noise. These methods and the Python codes are included in the first release of ModelFLOWs-app.


title: On-The-Fly Algorithm for Reachability in Parametric Timed Games (Extended Version)

abstract: Parametric Timed Games (PTG) are an extension of the model of Timed Automata. They allow for the verification and synthesis of real-time systems, reactive to their environmeand depending on adjustable parameters. Given a PTG and a reachability objective, we synthesize the values of the parameters such that the game is winning for the controller. We adapt and implement the On-The-Fly algorithm for parameter synthesis for PTG. Several pruning heuristics are introduced, to improve termination and speed of the algorithm. We evaluate the feasibility of parameter synthesis for PTG on two large case studies. Finally, we investigate the correctness guarantee of the algorithm: though the problem is undecidable, our semi-algorithm produces all correct parameter valuations ``in the limit''.


title: Long-Term Fair Decision Making through Deep Generative Models

abstract: This paper studies long-term fair machine learning which aims to mitigate group disparity over the long term in sequential decision-making systems. To define long-term fairness, we leverage the temporal causal graph and use the 1-Wasserstein distance between the interventional distributions of different demographic groups at a sufficiently large time step as the quantitative metric. Then, we propose a three-phase learning framework where the decision model is trained on high-fidelity data generated by a deep generative model. We formulate the optimization problem as a performative risk minimization and adopt the repeated gradient descent algorithm for learning. The empirical evaluation shows the efficacy of the proposed method using both synthetic and semi-synthetic datasets.


title: Seasonality of primary productivity affects coastal species more than its magnitude

abstract: While the importance of extreme conditions is recognised, patterns in species abundances are often interpreted through average environmental conditions within their distributional range. For marine species with pelagic larvae, temperature and phytoplankton concentration are key variables. Along the south coast of South Africa, conspicuous spatial patterns in recruitment rates and the abundances of different mussel species exist, with focal areas characterized by large populations. We studied 15 years of sea surface temperature (SST) and chlorophyll-a (chl-a) satellite data, using spectral analyses to partition their temporal variability over ecologically relevant time periods, including seasonal (101 to 365 days) and intra-seasonal cycles (20 to 100 days). Adult cover and mussel recruitment were measured at 10 sites along the south coast and regression models showed that about 70 percent of the variability in recruitment and adult cover was explained by seasonal variability in chl-a, while mean annual chl-a and SST only explained 30 percent of the recruitment, with no significant effect for adult cover. SST and chl-a at two upwelling centres showed less predictable seasonal cycles during the second half of the study period with a significant cooling trend during austral autumn, coinciding with one of the mussel reproductive peaks. This likely reflects recent changes in the Agulhas Current, the world largest western boundary current, which affects coastal ecosystems by driving upwelling.


title: On Dependent Variables in Reactive Synthesis

abstract: Given a Linear Temporal Logic (LTL) formula over input and output variables, reactive synthesis requires us to design a deterministic Mealy machine that gives the values of outputs at every time step for every sequence of inputs, such that the LTL formula is satisfied. In this paper, we investigate the notion of dependent variables in the context of reactive synthesis. Inspired by successful pre-processing steps in Boolean functional synthesis, we define dependent variables as output variables that are uniquely assigned, given an assignment, to all other variables and the history so far. We describe an automata-based approach for finding a set of dependent variables. Using this, we show that dependent variables are surprisingly common in reactive synthesis benchmarks. Next, we develop a novel synthesis framework that exploits dependent variables to construct an overall synthesis solution. By implementing this framework using the widely used library Spot, we show that reactive synthesis using dependent variables can solve some problems beyond the reach of several existing techniques. Further, among benchmarks with dependent variables, if the number of non-dependent variables is low (at most 3 in our experiments), our method is able outperform all state-of-the-art tools for synthesis.


title: The Impact of Collisionality on the Runaway Electron Avalanche during a Tokamak Disruption

abstract: The exponential growth (avalanching) of runaway electrons (REs) during a tokamak disruption continues to be a large uncertainty in RE modeling. The present work investigates the impact of tokamak geometry on the efficiency of the avalanche mechanism across a broad range of disruption scenarios. It is found that the parameter $\nu_{*, crit}$ describing the collisionality at the critical energy to run away delineates how toroidal geometry impacts RE formation. In particular, utilizing a reduced but self-consistent description of plasma power balance, it is shown that for a high-density deuterium-dominated plasma, $\nu_{*, crit}$ is robustly less than one, resulting in a substantial decrease in the efficiency of the RE avalanche compared to predictions from slab geometry. In contrast, for plasmas containing a substantial quantity of neon or argon, $\nu_{*, crit} \gtrsim 1$, no reduction of the avalanche is observed due to toroidal geometry. This sharp contrast in the impact of low-versus high-Z material results primarily from the relatively strong radiative cooling from high-Z impurities, enabling the plasma to be radiatively pinned at low temperatures and thus large electric fields, even for modest quantities of high-Z material.


title: Grothendieck's theorem on the precompactness of subsets functional spaces over pseudocompact spaces

abstract: Generalizations of the theorems of Eberlein and Grothendieck on the precompactness of subsets of function spaces are considered: if $X$ is a countably compact space and $C_p(X)$ is a space of continuous functions in the pointwise topology convergence, then any countably compact subspace of the space $C_p(X)$ is precompact, that is, it has a compact closure. The paper provides an overview of the results on this topic. It is proved that if a pseudo-compact $X$ contains a dense Lindelof $\Sigma$-space, then pseudocompact subspaces of the space $C_p(X)$ are precompact. If $X$ is the product Cech complete spaces, then bounded subsets of the space $C_p(X)$ are precompact. Results on the continuity of separately continuous functions were also obtained.


title: Search for dormant black holes in the OGLE data

abstract: Light curves of ellipsoidal variables collected by the Optical Gravitational Lensing Experiment (OGLE) were analyzed, in order to search for dormant black hole candidates. After the preselection based on the amplitude of ellipsoidal modulation, each object was investigated by means of the spectral energy distribution fit, which allowed us to select objects that are in close agreement with the spectrum of a single stellar object. After this final step of the preselection process, we were left with only fourteen objects that were then investigated in detail. For each candidate, we estimated basic physical parameters such as temperature, mass, luminosity, and, in some cases, radial velocity semi-amplitude. One of the objects turned out to be a spotted star while the rest are considered black-hole binary candidates. In the end, we present an alternative explanation for the ellipsoidal modulation in the form of contact binaries, which are not only vast in number, contrary to black-hole binaries, but are also in much better agreement with the radial velocity estimates for some of the systems analyzed. Even if the presented arguments suggest a noncompact character of the companion objects, each of them should be observed spectroscopically in order to verify the compact object hypothesis.


title: Exponentially slow thermalization and the robustness of Hilbert space fragmentation

abstract: The phenomenon of Hilbert space fragmentation, whereby dynamical constraints fragment Hilbert space into many disconnected sectors, provides a simple mechanism by which thermalization can be arrested. However, little is known about how thermalization occurs in situations where the constraints are not exact. To study this, we consider a situation in which a fragmented 1d chain with pair-flip constraints is coupled to a thermal bath at its boundary. For product states quenched under Hamiltonian dynamics, we numerically observe an exponentially long thermalization time, manifested in both entanglement dynamics and the relaxation of local observables. To understand this, we study an analogous model of random unitary circuit dynamics, where we rigorously prove that the thermalization time scales exponentially with system size. Slow thermalization in this model is shown to be a consequence of strong bottlenecks in configuration space, demonstrating a new way of producing anomalously slow thermalization dynamics.


title: An exact solution to the Fourier Transform of band-limited periodic functions with nonequispaced data and application to non-periodic functions

abstract: The need to Fourier transform data sets with irregular sampling is shared by various domains of science. This is the case for example in astronomy or sismology. Iterative methods have been developed that allow to reach approximate solutions. Here an exact solution to the problem for band-limited periodic signals is presented. The exact spectrum can be deduced from the spectrum of the non-equispaced data through the inversion of a Toeplitz matrix. The result applies to data of any dimension. This method also provides an excellent approximation for non-periodic band-limit signals. The method allows to reach very high dynamic ranges ($10^{13}$ with double-float precision) which depend on the regularity of the samples.


title: Induced Tur\'an problem in bipartite graphs

abstract: The classical extremal function for a graph $H$, $ex(K_n, H)$ is the largest number of edges in a subgraph of $K_n$ that contains no subgraph isomorphic to $H$. Note that defining $ex(K_n, H-ind)$ by forbidding induced subgraphs isomorphic to $H$ is not very meaningful for a non-complete $H$ since one can avoid it by considering a clique. For graphs $F$ and $H$, let $ex(K_n, \{F, H-ind\})$ be the largest number of edges in an $n$-vertex graph that contains no subgraph isomorphic to $F$ and no induced subgraph isomorphic to $H$. Determining this function asymptotically reduces to finding either $ex(K_n, F)$ or $ex(K_n, H)$, unless $H$ is a biclique or both $F$ and $H$ are bipartite. Here, we consider the bipartite setting, $ex(K_{n,n}, \{F, H-ind\})$ when $K_n$ is replaced with $K_{n,n}$, $F$ is a biclique, and $H$ is a bipartite graph. Our main result, a strengthening of a result by Sudakov and Tomon, implies that for any $d\geq 2$ and any $K_{d,d}$-free bipartite graph $H$ with each vertex in one part of degree either at most $d$ or a full degree, so that there are at most $d-2$ full degree vertices in that part, one has $ex(K_{n,n}, \{K_{t,t}, H-ind\}) = o(n^{2-1/d})$. This provides an upper bound on the induced Tur\'an number for a wide class of bipartite graphs and implies in particular an extremal result for bipartite graphs of bounded VC-dimension by Janzer and Pohoata.


title: Lowers bounds for Waldschmidt constants and Demailly's Conjecture for general and very general points

abstract: We prove Demailly's Conjecture concerning the lower bound for the Waldschmidt constant in terms of the initial degree of the second symbolic powers for any set of generic points or very general points in $\mathbb{P}^N$. We also discuss the Harbourne-Huneke Containment and the aforementioned Demailly's Conjecture for general points and show the results for sufficiently many general points and general points in projective spaces with low dimensions.


title: Higher-order Laplacian Renormalization

abstract: We propose a cross-order Laplacian renormalization group (X-LRG) scheme for arbitrary higher-order networks. The renormalization group is a pillar of the theory of scaling, scale-invariance, and universality in physics. An RG scheme based on diffusion dynamics was recently introduced for complex networks with dyadic interactions. Despite mounting evidence of the importance of polyadic interactions, we still lack a general RG scheme for higher-order networks. Our approach uses a diffusion process to group nodes or simplices, where information can flow between nodes and between simplices (higher-order interactions). This approach allows us (i) to probe higher-order structures, defining scale-invariance at various orders, and (ii) to propose a coarse-graining scheme. We demonstrate our approach on controlled synthetic higher-order systems and then use it to detect the presence of order-specific scale-invariant profiles of real-world complex systems from multiple domains.


title: Multivector Contractions Revisited, Part II

abstract: The theory of contractions of multivectors, and star duality, was reorganized in a previous article, and here we present some applications. First, we study inner and outer spaces associated to a general multivector $M$ via the equations $v \wedge M = 0$ and $v \lrcorner M=0$. They are then used to analyze special decompositions, factorizations and `carvings' of $M$, to define generalized grades, and to obtain new simplicity criteria, including a reduced set of Pl\"ucker-like relations. We also discuss how contractions are related to supersymmetry, and give formulas for supercommutators of multi-fermion creation and annihilation operators.


title: Aeroacoustics -- Theory and methods for analyzing flow-induced sound generation of technical and biological applications

abstract: Flow instabilities, wave propagation phenomena, and structural interaction are current topics of the field "Flow acoustics" also named "Aeroacoustics". Assuming the theory of classical mechanics, aeroacoustic applications are modeled by the conservation equations and suitable material models. In particular, the continuity equation, the Navier-Stokes equation, energy conservation, and the Navier equation are coupled. Depending on the field of application (e.g., slow flow speeds in relation to the speed of sound), further assumptions can simplify the calculation considerably. A systematic derivation of the models according to physical accuracy and calculation efficiency allows us to categorize a computational aeroacoustic model into a hierarchy of models in terms of accuracy, applicability and computational effort. In the simplest case, flow acoustics is described by analytical models in the form of scale models (class~1), like the eighth power law of Lighthill or the methods of VDI 2081 and VDI 3731 for technical sound emissions. Class~2 models (e.g. Sharland, K\"oltzsch, stochastic noise generation and radiation, random particle mesh method) allow empirical factors to be incorporated, which are based on experience (such as fan noise) and allow prediction of the sound. Class~3 models use a numerical decoupling of flow, acoustics, and structure. Thus, this class of models describe a pure forward coupling from the higher energy containing flow field to the sound field. Finally, to solve the full fluid-structure-acoustic interaction numerically, the field equations are solved in a coupled manner (class~4). The class~4 models are characterized by high computational effort and are physically most general but struggle with considerable numerical challenges.


title: Nonequilibrium dynamics of the Hubbard dimer

abstract: Electron dynamics in a two-sites Hubbard model is studied using the nonequilibrium Green's function approach. The study is motivated by the empirical observation that a full solution of the integro-differential Kadanoff-Baym equation (KBE) is more stable and often accompanied by artificial damping [Marc Puig von Friesen, C. Verdozzi, and C.-O. Almbladh (2009)] than its time-linear reformulations relying on the generalized Kadanoff-Baym ansatz (GKBA). Additionally, for conserving theories, numerical simulations suggest that KBE produces natural occupations bounded by one and zero in agreement with the Pauli exclusion principle, whereas, in some regimes, GKBA-based theories violate this principle. As the first step for understanding these issues, the electron dynamics arising in the adiabatic switching scenario is studied. Many-body approximations are classified according to the channel of the Bethe-Salpeter equation in which electronic correlations are explicitly treated. They give rise to the so-called second Born, $T$-matrix and $GW$ approximations. In each of these cases, the model is reduced to a system of ordinary differential equations, which resemble equations of motion for a driven harmonic oscillator with time-dependent frequencies. A more complete treatment of electronic correlations is achieved by combining different correlation channels, with parquet theory serving as a starting point.


title: Linear-quadratic optimal control for infinite-dimensional input-state-output systems

abstract: We examine the minimization of a quadratic cost functional composed of the output and the final state of abstract infinite-dimensional evolution equations in view of existence of solutions and optimality conditions. While the initial value is prescribed, we are minimizing over all inputs within a specified convex subset of square integrable controls with values in a Hilbert space. The considered class of infinite-dimensional systems is based on the system node approach introduced by Staffans. Thus, our developed approach includes optimal control of a wide variety of linear partial differential equations with boundary control and observation that are not well-posed in the sense that the output continuously depends on the input and the initial value. We provide an application of particular optimal control problems arising in energy-optimal control of port-Hamiltonian systems. Last, we illustrate the our abstract theory by two examples including a non-well-posed heat equation with Dirichlet boundary control and a wave equation on an L-shaped domain with boundary control of the stress in normal direction.


title: Relativistic fully self-consistent $GW$ for molecules: Total energies and ionization potentials

abstract: The fully self-consistent $GW$ (sc$GW$) method with the iterative solution of Dyson equation provides a consistent approach for describing the ground and excited states without any dependence on the mean-field reference. In this work, we present a relativistic version of sc$GW$ for molecules containing heavy element using the exact two-component (X2C) Coulomb approximation. We benchmark $\texttt{SOC-81}$ dataset containing closed shell heavy elements for the first ionization potential using the fully self-consistent $GW$ as well as one-shot $GW$. The self-consistent $GW$ provides superior result compared to $G_0W_0$ with PBE reference and comparable to $G_0W_0$ with PBE0 while also removing the starting point dependence. The photoelectron spectra obtained at the X2C level demonstrate very good agreement with experimental spectra. We also observe that sc$GW$ provides very good estimation of ionization potential for the inner $d$ shell orbitals. Additionally, using the well conserved total energy, we investigate the equilibrium bond length and harmonic frequencies of few halogen dimers using sc$GW$. Overall, our findings demonstrate the applicability of the fully self-consistent $GW$ method for accurate ionization potential, photoelectron spectra and total energies in finite systems with heavy elements with a reasonable computational scaling.


title: Tracing the evolution of short-period binaries with super-synchronous fast rotators

abstract: The initial distribution of rotational velocities of stars is still poorly known, and how the stellar spin evolves from birth to the various end points of stellar evolution is an actively debated topic. Binary interactions are often invoked to explain the existence of extremely fast-rotating stars ($v\sin\,i$ $\gtrsim$ 200 $km\,s^{-1}$). The primary mechanisms through which binaries can spin up stars are tidal interactions, mass transfer, and possibly mergers. To evaluate these scenarios, we investigated in detail the evolution of three known fast-rotating stars in short-period spectroscopic and eclipsing binaries, namely HD 25631, HD 191495, and HD 46485, with primaries of masses of 7, 15, and 24 $M_{\odot}$, respectively, with companions of $\sim1\,M_\odot$ and orbital periods of less than 7 days. These systems belong to a recently identified class of binaries with extreme mass ratios, whose evolutionary origin is still poorly understood. We evaluated in detail three scenarios that could explain the fast rotation observed in these binaries: it could be primordial, a product of mass transfer, or the result of a merger within an originally triple system. We computed grids of single and binary MESA models varying tidal forces and initial binary architectures to investigate the evolution and reproduce observational properties of these systems. We find that, because of the extreme mass-ratio between binary components, tides have a limited impact, regardless of the prescription used, and that the observed short orbital periods are at odds with post-mass-transfer scenarios. The most likely scenario to form such young, rapidly rotating, and short-period binaries is primordial rotation, implying that the observed binaries are pre-interaction ones. These binaries show that the initial spin distribution of massive stars can have a wide range of rotational velocities.


title: Progress in Privacy Protection: A Review of Privacy Preserving Techniques in Recommender Systems, Edge Computing, and Cloud Computing

abstract: As digital technology evolves, the increasing use of connected devices brings both challenges and opportunities in the areas of mobile crowdsourcing, edge computing, and recommender systems. This survey focuses on these dynamic fields, emphasizing the critical need for privacy protection in our increasingly data-oriented world. It explores the latest trends in these interconnected areas, with a special emphasis on privacy and data security. Our method involves an in-depth analysis of various academic works, which helps us to gain a comprehensive understanding of these sectors and their shifting focus towards privacy concerns. We present new insights and marks a significant advancement in addressing privacy issues within these technologies. The survey is a valuable resource for researchers, industry practitioners, and policy makers, offering an extensive overview of these fields and their related privacy challenges, catering to a wide audience in the modern digital era.


title: Global weak solutions for the compressible Poisson-Nernst-Planck-Navier-Stokes System

abstract: We consider the compressible Poisson-Nernst-Planck-Navier-Stokes system of equations, which models the transport of charged particles, under the influence of the self-consistent electrostatic potential, in a compressible fluid. We prove the existence of global weak solutions for the initial/boundary value problem on a smooth bounded spatial domain of $\mathbb{R}^3$ with no slip boundary condition for the fluid's velocity, blocking boundary condition for the ionic concentrations and inhomogeneous Robin boundary condition for the electrostatic potential, without restrictions on the size of the initial data.


title: Enrichment by Extragalactic First Stars in the Large Magellanic Cloud

abstract: The Large Magellanic Cloud (LMC) is the Milky Way's most massive satellite galaxy, which only recently (~2 billion years ago) fell into our Galaxy. Since stellar atmospheres preserve their natal cloud's composition, the LMC's recent infall makes its most ancient, metal-deficient ("low-metallicity") stars unique windows into early star formation and nucleosynthesis in a formerly distant region of the high-redshift universe. Previously, identifying such stars in the LMC was challenging. But new techniques have opened this window, now enabling tests of whether the earliest element enrichment and star formation in distant, extragalactic proto-galaxies deviated from what occurred in the proto-Milky Way. Here we present the elemental abundances of 10 stars in the LMC with iron-to-hydrogen ratios ranging from ~1/300th to ~1/12,000th of the Sun. Our most metal-deficient star is 50 times more metal-deficient than any in the LMC with available detailed chemical abundance patterns, and is likely enriched by a single extragalactic first star supernova. This star lacks significant carbon-enhancement, as does our overall sample, in contrast with the lowest metallicity Milky Way stars. This, and other abundance differences, affirm that the extragalactic early LMC experienced diverging enrichment processes compared to the early Milky Way. Early element production, driven by the earliest stars, thus appears to proceed in an environment-dependent manner.


title: The Surprising Non-Triviality of Sharing a Sandwich with Two Other People

abstract: In this article, the issue of choice cuts made to a rectangular region are considered and explored. Results show that this problem is not trivial. Outcomes for teaching and learning are considered.


title: Uniform boundedness on rational maps with automorphisms

abstract: In this paper, we study the dynamical uniform boundedness principle over a family of rational maps with certain nontrivial automorphisms. Specifically, we consider a family of rational maps of an arbitrary degree $d\ge 2$ whose automorphism group contains the cyclic group of order $d$. We prove that a subfamily of this family satisfies the dynamical uniform boundedness principle.


title: Isomorphism of pointed minimal systems is not classifiable by countable structures

abstract: We prove that the topological conjugacy relations both for minimal systems and pointed minimal systems are not Borel-reducible to any Borel $S_{\infty}$-action.


title: A Novel Benchmark for Few-Shot Semantic Segmentation in the Era of Foundation Models

abstract: In recent years, the rapid evolution of computer vision has seen the emergence of various foundation models, each tailored to specific data types and tasks. In this study, we explore the adaptation of these models for few-shot semantic segmentation. Specifically, we conduct a comprehensive comparative analysis of four prominent foundation models: DINO V2, Segment Anything, CLIP, Masked AutoEncoders, and of a straightforward ResNet50 pre-trained on the COCO dataset. We also include 5 adaptation methods, ranging from linear probing to fine tuning. Our findings show that DINO V2 outperforms other models by a large margin, across various datasets and adaptation methods. On the other hand, adaptation methods provide little discrepancy in the obtained results, suggesting that a simple linear probing can compete with advanced, more computationally intensive, alternatives


title: Uncertainty quantification of receptor ligand binding sites prediction

abstract: Recent advancements in protein docking site prediction have highlighted the limitations of traditional rigid docking algorithms, like PIPER, which often neglect critical stochastic elements such as solvent-induced fluctuations. These oversights can lead to inaccuracies in identifying viable docking sites due to the complexity of high-dimensional, stochastic energy manifolds with low regularity. To address this issue, our research introduces a novel model where the molecular shapes of ligands and receptors are represented using multi-variate Karhunen-Lo `eve (KL) expansions. This method effectively captures the stochastic nature of energy manifolds, allowing for a more accurate representation of molecular interactions.Developed as a plugin for PIPER, our scientific computing software enhances the platform, delivering robust uncertainty measures for the energy manifolds of ranked binding sites. Our results demonstrate that top-ranked binding sites, characterized by lower uncertainty in the stochastic energy manifold, align closely with actual docking sites. Conversely, sites with higher uncertainty correlate with less optimal docking positions. This distinction not only validates our approach but also sets a new standard in protein docking predictions, offering substantial implications for future molecular interaction research and drug development.


title: Weakly-Supervised Semantic Segmentation of Circular-Scan, Synthetic-Aperture-Sonar Imagery

abstract: We propose a weakly-supervised framework for the semantic segmentation of circular-scan synthetic-aperture-sonar (CSAS) imagery. The first part of our framework is trained in a supervised manner, on image-level labels, to uncover a set of semi-sparse, spatially-discriminative regions in each image. The classification uncertainty of each region is then evaluated. Those areas with the lowest uncertainties are then chosen to be weakly labeled segmentation seeds, at the pixel level, for the second part of the framework. Each of the seed extents are progressively resized according to an unsupervised, information-theoretic loss with structured-prediction regularizers. This reshaping process uses multi-scale, adaptively-weighted features to delineate class-specific transitions in local image content. Content-addressable memories are inserted at various parts of our framework so that it can leverage features from previously seen images to improve segmentation performance for related images. We evaluate our weakly-supervised framework using real-world CSAS imagery that contains over ten seafloor classes and ten target classes. We show that our framework performs comparably to nine fully-supervised deep networks. Our framework also outperforms eleven of the best weakly-supervised deep networks. We achieve state-of-the-art performance when pre-training on natural imagery. The average absolute performance gap to the next-best weakly-supervised network is well over ten percent for both natural imagery and sonar imagery. This gap is found to be statistically significant.


title: CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator Needs

abstract: Timely, personalized feedback is essential for students learning programming. LLM-powered tools like ChatGPT offer instant support, but reveal direct answers with code, which may hinder deep conceptual engagement. We developed CodeAid, an LLM-powered programming assistant delivering helpful, technically correct responses, without revealing code solutions. CodeAid answers conceptual questions, generates pseudo-code with line-by-line explanations, and annotates student's incorrect code with fix suggestions. We deployed CodeAid in a programming class of 700 students for a 12-week semester. A thematic analysis of 8,000 usages of CodeAid was performed, further enriched by weekly surveys, and 22 student interviews. We then interviewed eight programming educators to gain further insights. Our findings reveal four design considerations for future educational AI assistants: D1) exploiting AI's unique benefits; D2) simplifying query formulation while promoting cognitive engagement; D3) avoiding direct responses while encouraging motivated learning; and D4) maintaining transparency and control for students to asses and steer AI responses.


title: High efficiency glass-based VUV metasurfaces

abstract: Most advances in metaoptics have been made at visible wavelengths and above; in contrast, the vacuum ultraviolet (VUV) has barely been explored despite numerous scientific and technological opportunities. Creating metaoptic elements at this short wavelength is challenging due to the scarcity of VUV transparent materials and the small sizes of the required nanostructures. Here, we present the first transmissive VUV (175 nm) metalens. By using UV-grade silica and trading-off the Nyquist requirement for subwavelength structures against feasibility of the fabrication process, we achieve a step-change in diffraction efficiencies for wavelengths shorter than 300 nm. Our large numerical aperture (NA = 0.5) metalens shows an average diffraction efficiency of (53.3 +- 1.4)%. This demonstration opens up new avenues for compact flat optic systems operating in the VUV range.


title: PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation

abstract: With the proliferation of large pre-trained language models (PLMs), fine-tuning all model parameters becomes increasingly inefficient, particularly when dealing with numerous downstream tasks that entail substantial training and storage costs. Several approaches aimed at achieving parameter-efficient fine-tuning (PEFT) have been proposed. Among them, Low-Rank Adaptation (LoRA) stands out as an archetypal method, incorporating trainable rank decomposition matrices into each target module. Nevertheless, LoRA does not consider the varying importance of each layer. To address these challenges, we introduce PRILoRA, which linearly allocates a different rank for each layer, in an increasing manner, and performs pruning throughout the training process, considering both the temporary magnitude of weights and the accumulated statistics of the input to any given layer. We validate the effectiveness of PRILoRA through extensive experiments on eight GLUE benchmarks, setting a new state of the art.


title: Third-Party Developers and Tool Development For Community Management on Live Streaming Platform Twitch

abstract: Community management is critical for stakeholders to collaboratively build and sustain communities with socio-technical support. However, most of the existing research has mainly focused on the community members and the platform, with little attention given to the developers who act as intermediaries between the platform and community members and develop tools to support community management. This study focuses on third-party developers (TPDs) for the live streaming platform Twitch and explores their tool development practices. Using a mixed method with in-depth qualitative analysis, we found that TPDs maintain complex relationships with different stakeholders (streamers, viewers, platform, professional developers), and the multi-layered policy restricts their agency regarding idea innovation and tool development. We argue that HCI research should shift its focus from tool users to tool developers with regard to community management. We propose designs to support closer collaboration between TPDS and the platform and professional developers and streamline TPDs' development process with unified toolkits and policy documentation.


title: Global well-posedness and enhanced dissipation for the 2D stochastic Nernst-Planck-Navier-Stokes equations with transport noise

abstract: In this paper, we consider the 2D stochastic Nernst-Planck-Navier-Stokes equations with transport noise. By assuming the ionic species have the same diffusivity and opposite valences, we prove the global well-posedness of the system. Furthermore, we illustrate the enhanced dissipation phenomenon in the system with specific transportation noise by establishing that it enables an arbitrarily large exponential convergence rate of the solutions.


title: Initialization-Free Lie-Bracket Extremum Seeking in $\mathbb{R}^n$

abstract: Stability results for extremum seeking control in $\mathbb{R}^n$ have predominantly been restricted to local or, at best, semi-global practical stability. Extending semi-global stability results of extremum-seeking systems to unbounded sets of initial conditions often demands a stringent global Lipschitz condition on the cost function, which is rarely satisfied by practical applications. In this paper, we address this challenge by leveraging tools from higher-order averaging theory. In particular, we establish a novel second-order averaging result with \emph{global} (practical) stability implications. By leveraging this result, we characterize sufficient conditions on cost functions under which uniform global practical asymptotic stability can be established for a class of extremum-seeking systems acting on static maps. Our sufficient conditions include the case when the gradient of the cost function, rather than the cost function itself, satisfies a global Lipschitz condition, which covers quadratic cost functions. Our results are also applicable to vector fields that are not necessarily Lipschitz continuous at the origin, opening the door to non-smooth Lie-bracket ES dynamics. We illustrate all our results via different analytical and/or numerical examples.


title: The $X(3872)$ to $\psi (2S)$ yield ratio in heavy-ion collisions

abstract: In this work we evaluate the $X(3872)$ to $ \psi (2S) $ yield ratio ($N_X/N_{\psi(2S)}$) in Pb Pb collisions, taking into account the interactions of the $\psi (2S) $ and $ X(3872)$ states with light mesons in the hadron gas formed at the late stages of these collisions. We employ an effective Lagrangian approach to estimate the thermally-averaged cross sections for the production and absorption of the $\psi(2S)$ and use them in the rate equation to determine the time evolution of $N_{\psi(2S)}$. The multiplicity of these states at the end of mixed phase is obtained from the coalescence model. The multiplicity of $X(3872)$, treated as a bound state of $(D\bar D^{*} + c.c.)$ and also as a compact tetraquark, was already calculated in previous works. Knowing these yields, we derive predictions for the ratio ($N_X/N_{\psi(2S)}$) as a function of the centrality, of the center-of-mass energy and of the charged hadron multiplicity measured at midrapidity $[dN_{ch}/d\eta \,(\eta<0.5)]$. Finally, we make predictions for this ratio in Pb Pb collisions at $\sqrt{s_{NN}} = 5.02$ TeV to be measured by the ALICE Collaboration in the Run 3.


title: Mordukhovich derivatives of the metric projection operator in uniformly convex and uniformly smooth Banach spaces

abstract: In this paper, we investigate the properties of the Mordukhovich derivatives of the metric projection operator onto closed balls, closed and convex cylinders and positive cones in uniformly convex and uniformly smooth Banach spaces. We find the exact expressions for Mordukhovich derivatives of the metric projection operator.


title: First-Principles Electron-Phonon Interactions and Polarons in the Parent Cuprate La$_2$CuO$_4$

abstract: Understanding electronic interactions in high-temperature superconductors is an outstanding challenge. In the widely studied cuprate materials, experimental evidence points to strong electron-phonon ($e$-ph) coupling and broad photoemission spectra. Yet, the microscopic origin of this behavior is not fully understood. Here we study $e$-ph interactions and polarons in a prototypical parent (undoped) cuprate, La$_2$CuO$_4$ (LCO), by means of first-principles calculations. Leveraging parameter-free Hubbard-corrected density functional theory, we obtain a ground state with band gap and Cu magnetic moment in nearly exact agreement with experiments. This enables a quantitative characterization of $e$-ph interactions. Our calculations reveal two classes of longitudinal optical (LO) phonons with strong $e$-ph coupling to hole states. These modes consist of Cu-O plane bond-stretching and bond-bending as well as vibrations of apical O atoms. The hole spectral functions, obtained with a cumulant method that can capture strong $e$-ph coupling, exhibit broad quasiparticle peaks with a small spectral weight ($Z\approx0.25$) and pronounced LO-phonon sidebands characteristic of polaron effects. Our calculations predict features observed in photoemission spectra, including a 40-meV peak in the $e$-ph coupling distribution function not explained by existing models. These results show that the universal strong $e$-ph coupling found experimentally in lanthanum cuprates is an intrinsic feature of the parent compound, and elucidates its microscopic origin.


title: Identifying and Analyzing Task-Encoding Tokens in Large Language Models

abstract: In-context learning (ICL) has become an effective solution for few-shot learning in natural language processing. However, our understanding of ICL's working mechanisms is limited, specifically regarding how models learn to perform tasks from ICL demonstrations. For example, unexpectedly large changes in performance can arise from small changes in the prompt, leaving prompt design a largely empirical endeavour. In this paper, we investigate this problem by identifying and analyzing task-encoding tokens on whose representations the task performance depends. Using experiments that ablate the representations of different token types, we find that template and stopword tokens are the most prone to be task-encoding. In addition, we demonstrate experimentally that lexical meaning, repetition, and text formatting are the main distinguishing characteristics of these tokens. Our work sheds light on how large language models (LLMs) learn to perform a task from demonstrations, deepens our understanding of the varied roles different types of tokens play in LLMs, and provides insights for avoiding instability from improperly utilizing task-encoding tokens.


title: BANG: Billion-Scale Approximate Nearest Neighbor Search using a Single GPU

abstract: Approximate Nearest Neighbour Search (ANNS) is a subroutine in algorithms routinely employed in information retrieval, pattern recognition, data mining, image processing, and beyond. Recent works have established that graph-based ANNS algorithms are practically more efficient than the other methods proposed in the literature, on large datasets. The growing volume and dimensionality of data necessitates designing scalable techniques for ANNS. To this end, the prior art has explored parallelizing graph-based ANNS on GPU leveraging its high computational power and energy efficiency. The current state-of-the-art GPU-based ANNS algorithms either (i) require both the index-graph and the data to reside entirely in the GPU memory, or (ii) they partition the data into small independent shards, each of which can fit in GPU memory, and perform the search on these shards on the GPU. While the first approach fails to handle large datasets due to the limited memory available on the GPU, the latter delivers poor performance on large datasets due to high data traffic over the low-bandwidth PCIe bus. In this paper, we introduce BANG, a first-of-its-kind GPU-based ANNS method which works efficiently on billion-scale datasets that cannot entirely fit in the GPU memory. BANG stands out by harnessing compressed data on the GPU to perform distance computations while maintaining the graph on the CPU. BANG incorporates high-optimized GPU kernels and proceeds in stages that run concurrently on the GPU and CPU, taking advantage of their architectural specificities. We evaluate BANG using a single NVIDIA Ampere A100 GPU on ten popular ANN benchmark datasets. BANG outperforms the state-of-the-art in the majority of the cases. Notably, on the billion-size datasets, we are significantly faster than our competitors, achieving throughputs 40x-200x more than the competing methods for a high recall of 0.9.


title: Detecting Hidden Triggers: Mapping Non-Markov Reward Functions to Markov

abstract: Many Reinforcement Learning algorithms assume a Markov reward function to guarantee optimality. However, not all reward functions are known to be Markov. In this paper, we propose a framework for mapping non-Markov reward functions into equivalent Markov ones by learning a Reward Machine - a specialized reward automaton. Unlike the general practice of learning Reward Machines, we do not require a set of high-level propositional symbols from which to learn. Rather, we learn \emph{hidden triggers} directly from data that encode them. We demonstrate the importance of learning Reward Machines versus their Deterministic Finite-State Automata counterparts, for this task, given their ability to model reward dependencies in a single automaton. We formalize this distinction in our learning objective. Our mapping process is constructed as an Integer Linear Programming problem. We prove that our mappings provide consistent expectations for the underlying process. We empirically validate our approach by learning black-box non-Markov Reward functions in the Officeworld Domain. Additionally, we demonstrate the effectiveness of learning dependencies between rewards in a new domain, Breakfastworld.


title: Navigating Cybersecurity Training: A Comprehensive Review

abstract: In the dynamic realm of cybersecurity, awareness training is crucial for strengthening defenses against cyber threats. This survey examines a spectrum of cybersecurity awareness training methods, analyzing traditional, technology-based, and innovative strategies. It evaluates the principles, efficacy, and constraints of each method, presenting a comparative analysis that highlights their pros and cons. The study also investigates emerging trends like artificial intelligence and extended reality, discussing their prospective influence on the future of cybersecurity training. Additionally, it addresses implementation challenges and proposes solutions, drawing on insights from real-world case studies. The goal is to bolster the understanding of cybersecurity awareness training's current landscape, offering valuable perspectives for both practitioners and scholars.


title: Measuring hierarchically-organized interactions in dynamic networks through spectral entropy rates: theory, estimation, and illustrative application to physiological networks

abstract: Recent advances in signal processing and information theory are boosting the development of new approaches for the data-driven modelling of complex network systems. In the fields of Network Physiology and Network Neuroscience where the signals of interest are often rich of oscillatory content, the spectral representation of network systems is essential to ascribe the analyzed interactions to specific oscillations with physiological meaning. In this context, the present work formalizes a coherent framework which integrates several information dynamics approaches to quantify node-specific, pairwise and higher-order interactions in network systems. The framework establishes a hierarchical organization of interactions of different order using measures of entropy rate, mutual information rate and O-information rate, to quantify respectively the dynamics of individual nodes, the links between pairs of nodes, and the redundant/synergistic hyperlinks between groups of nodes. All measures are formulated in the time domain, and then expanded to the spectral domain to obtain frequency-specific information. The practical computation of all measures is favored presenting a toolbox that implements their parametric and non-parametric estimation, and includes approaches to assess their statistical significance. The framework is illustrated first using theoretical examples where the properties of the measures are displayed in benchmark simulated network systems, and then applied to representative examples of multivariate time series in the context of Network Neuroscience and Network Physiology.


title: A Hierarchical Decision-Based Maintenance for a Complex Modular System Driven by the { MoMA} Algorithm

abstract: This paper presents a maintenance policy for a modular system formed by K independent modules (n-subsystems) subjected to environmental conditions (shocks). For the modeling of this complex system, the use of the Matrix-Analytical Method (MAM) is proposed under a layered approach according to its hierarchical structure. Thus, the operational state of the system (top layer) depends on the states of the modules (middle layer), which in turn depend on the states of their components (bottom layer). This allows a detailed description of the system operation to plan maintenance actions appropriately and optimally. We propose a hierarchical decision-based maintenance strategy with periodic inspections as follows: at the time of the inspection, the condition of the system is first evaluated. If intervention is necessary, the modules are then checked to make individual decisions based on their states, and so on. Replacement or repair will be carried out as appropriate. An optimization problem is formulated as a function of the length of the inspection period and the intervention cost incurred over the useful life of the system. Our method shows the advantages, providing compact and implementable expressions. The model is illustrated on a submarine Electrical Control Unit (ECU).