title: Automatic Detection of Depression in Speech Using Ensemble Convolutional Neural Networks

abstract: This paper proposes a speech-based method for automatic depression classification. The system is based on ensemble learning for Convolutional Neural Networks (CNNs) and is evaluated using the data and the experimental protocol provided in the Depression Classification Sub-Challenge (DCC) at the 2016 Audio-Visual Emotion Challenge (AVEC-2016). In the pre-processing phase, speech files are represented as a sequence of log-spectrograms and randomly sampled to balance positive and negative samples. For the classification task itself, first, a more suitable architecture for this task, based on One-Dimensional Convolutional Neural Networks, is built. Secondly, several of these CNN-based models are trained with different initializations and then the corresponding individual predictions are fused by using an Ensemble Averaging algorithm and combined per speaker to get an appropriate final decision. The proposed ensemble system achieves satisfactory results on the DCC at the AVEC-2016 in comparison with a reference system based on Support Vector Machines and hand-crafted features, with a CNN+LSTM-based system called DepAudionet, and with the case of a single CNN-based classifier.


title: What do we teach to engineering students: embedded ethics, morality, and politics

abstract: In the past few years, calls for integrating ethics modules in engineering curricula have multiplied. Despite this positive trend, a number of issues with these embedded programs remains. First, learning goals are underspecified. A second limitation is the conflation of different dimensions under the same banner, in particular confusion between ethics curricula geared towards addressing the ethics of individual conduct and curricula geared towards addressing ethics at the societal level. In this article, we propose a tripartite framework to overcome these difficulties. Our framework analytically decomposes an ethics module into three dimensions. First, there is the ethical dimension, which pertains to the learning goals. Second, there is the moral dimension, which addresses the moral relevance of engineers conduct. Finally, there is the political dimension, which scales up issues of moral relevance at the civic level. All in all, our framework has two advantages. First, it provides analytic clarity, i.e. it enables course instructors to locate ethical dilemmas in either the moral or political realm and to make use of the tools and resources from moral and political philosophy. Second, it depicts a comprehensive ethical training, which enables students to both reason about moral issues in the abstract, and to socially contextualize potential solutions.


title: On the Uniqueness of K\"ahler-Einstein Polygons in Mutation-Equivalence Classes

abstract: We study a subclass of K\"ahler-Einstein Fano polygons and how they behave under mutation. The polygons of interest are K\"ahler-Einstein Fano triangles and symmetric Fano polygons. In particular, we find an explicit bound for the number of these polygons in an arbitrary mutation-equivalence class. An important mutation-invariant of a Fano polygon is its singularity content. We extend the notion of singularity content and prove that it is still a mutation-invariant. We use this to show that if two symmetric Fano polygons are mutation-equivalent, then they are isomorphic. We further show that if two K\"ahler-Einstein Fano triangles are mutation-equivalent, then they are isomorphic. Finally, we show that if a symmetric Fano polygon is mutation-equivalent to a K\"ahler-Einstein triangle, then they are isomorphic. Thus, each mutation-equivalence class has at most one Fano polygon which is either a K\"ahler-Einstein triangle or symmetric. A recent conjecture states that all K\"ahler-Einstein Fano polygons are either triangles or are symmetric. We provide a counterexample $P$ to this conjecture and discuss several of its properties. For instance, we compute iterated barycentric transformations of $P$ and find that (a) the K\"ahler-Einstein property is not preserved by the barycentric transformation, and (b) $P$ is of strict type $B_2$. Finally, we find examples of K\"ahler-Einstein Fano polygons which are not minimal.


title: Behavior Tree Capabilities for Dynamic Multi-Robot Task Allocation with Heterogeneous Robot Teams

abstract: While individual robots are becoming increasingly capable, with new sensors and actuators, the complexity of expected missions increased exponentially in comparison. To cope with this complexity, heterogeneous teams of robots have become a significant research interest in recent years. Making effective use of the robots and their unique skills in a team is challenging. Dynamic runtime conditions often make static task allocations infeasible, therefore requiring a dynamic, capability-aware allocation of tasks to team members. To this end, we propose and implement a system that allows a user to specify missions using Bheavior Trees (BTs), which can then, at runtime, be dynamically allocated to the current robot team. The system allows to statically model an individual robot's capabilities within our ros_bt_py BT framework. It offers a runtime auction system to dynamically allocate tasks to the most capable robot in the current team. The system leverages utility values and pre-conditions to ensure that the allocation improves the overall mission execution quality while preventing faulty assignments. To evaluate the system, we simulated a find-and-decontaminate mission with a team of three heterogeneous robots and analyzed the utilization and overall mission times as metrics. Our results show that our system can improve the overall effectiveness of a team while allowing for intuitive mission specification and flexibility in the team composition.


title: Shortened LLaMA: Depth Pruning for Large Language Models with Comparison of Retraining Methods

abstract: Structured pruning of modern large language models (LLMs) has emerged as a way of decreasing their high computational needs. Width pruning reduces the size of projection weight matrices (e.g., by removing attention heads) while maintaining the number of layers. Depth pruning, in contrast, removes entire layers or blocks, while keeping the size of the remaining weights unchanged. Most current research focuses on either width-only or a blend of width and depth pruning, with little comparative analysis between the two units (width vs. depth) concerning their impact on LLM inference efficiency. In this work, we show that simple depth pruning can effectively compress LLMs while achieving comparable or superior performance to recent width pruning studies. Our pruning method boosts inference speeds, especially under memory-constrained conditions that require limited batch sizes for running LLMs, where width pruning is ineffective. In retraining pruned models for quality recovery, continued pretraining on a large corpus markedly outperforms LoRA-based tuning, particularly at severe pruning ratios. We hope this work can help build compact yet capable LLMs. Code and models can be found at: https://github.com/Nota-NetsPresso/shortened-llm


title: Performance optimization of continuous variable quantum teleportation with generalized photon-varying non-Gaussian operations

abstract: Continuous variable quantum teleportation provides a path to the long-distance transmission of quantum states. Photon-varying non-Gaussian operations have been shown to improve the fidelity of quantum teleportation when integrated into the protocol. However, given a fixed non-Gaussian operation, the achievable fidelity varies with different input states. An operation that increases the fidelity for teleporting one class of states might do the contrary for other classes of states. A performance metric suitable for different input states is missing. For a given type of non-Gaussian operation, the achievable fidelity also varies with parameters associated with the operation. Previous work only focuses on particular settings of the parameters. Optimization over the parameters is also missing. In this work, we build a framework for photon-varying non-Gaussian operations for multi-mode states, upon which we propose a performance metric suitable for arbitrary teleportation input states. We then apply the new metric to evaluate different types of non-Gaussian operations. Starting from simple multi-photon photon subtraction and photon addition, we find that increasing the number of ancillary photons involved in the operation does not guarantee performance improvement. We then investigate combinations of the operations mentioned above, finding that operations that approximate a particular form provide the best improvement. The results provided here will be valuable for real-world implementations of quantum teleportation networks and applications that harness the non-Gaussianity of quantum states.


title: Perceptual Learned Image Compression via End-to-End JND-Based Optimization

abstract: Emerging Learned image Compression (LC) achieves significant improvements in coding efficiency by end-to-end training of neural networks for compression. An important benefit of this approach over traditional codecs is that any optimization criteria can be directly applied to the encoder-decoder networks during training. Perceptual optimization of LC to comply with the Human Visual System (HVS) is among such criteria, which has not been fully explored yet. This paper addresses this gap by proposing a novel framework to integrate Just Noticeable Distortion (JND) principles into LC. Leveraging existing JND datasets, three perceptual optimization methods are proposed to integrate JND into the LC training process: (1) Pixel-Wise JND Loss (PWL) prioritizes pixel-by-pixel fidelity in reproducing JND characteristics, (2) Image-Wise JND Loss (IWL) emphasizes on overall imperceptible degradation levels, and (3) Feature-Wise JND Loss (FWL) aligns the reconstructed image features with perceptually significant features. Experimental evaluations demonstrate the effectiveness of JND integration, highlighting improvements in rate-distortion performance and visual quality, compared to baseline methods. The proposed methods add no extra complexity after training.


title: With a Little Help from my (Linguistic) Friends: Topic Segmentation of Multi-party Casual Conversations

abstract: Topics play an important role in the global organisation of a conversation as what is currently discussed constrains the possible contributions of the participant. Understanding the way topics are organised in interaction would provide insight on the structure of dialogue beyond the sequence of utterances. However, studying this high-level structure is a complex task that we try to approach by first segmenting dialogues into smaller topically coherent sets of utterances. Understanding the interactions between these segments would then enable us to propose a model of topic organisation at a dialogue level. In this paper we work with open-domain conversations and try to reach a comparable level of accuracy as recent machine learning based topic segmentation models but with a formal approach. The features we identify as meaningful for this task help us understand better the topical structure of a conversation.


title: HAPI-FHIR Server Implementation to Enhancing Interoperability among Primary Care Health Information Systems in Sri Lanka: Review of the Technical Use Case

abstract: This review underscores the vital role of interoperability in digital health, advocating for a standardized framework. It focuses on implementing a Fast Healthcare Interoperability Resources (FHIR) server, addressing technical, semantic, and process challenges. FHIR's adaptability ensures uniformity within Primary Care Health Information Systems, fostering interoperability. Patient data management complexities highlight the pivotal role of semantic interoperability in seamless patient care. FHIR standards enhance these efforts, offering multiple pathways for data search. The ADR-guided FHIR server implementation systematically addresses challenges related to patient identity, biometrics, and data security. The detailed development phases emphasize architecture, API integration, and security. The concluding stages incorporate forward-looking approaches, including HHIMS Synthetic Dataset testing. Envisioning FHIR integration as transformative, it anticipates a responsive healthcare environment aligned with the evolving digital health landscape, ensuring comprehensive, dynamic, and interconnected systems for efficient data exchange and access.


title: Measuring topological invariants for higher-order exceptional points in quantum multipartite systems

abstract: Owing to the presence of exceptional points (EPs), non-Hermitian (NH) systems can display intriguing topological phenomena without Hermitian analogs. However, experimental characteristics of exceptional topological invariants have been restricted to second-order EPs (EP2s) in classical or semiclassical systems. We here propose an NH multi-qubit model with higher-order EPs, each of which is underlain by a multifold-degenerate multipartite entangled eigenstate. We implement the three-qubit model by controllably coupling a superconducting qubit to two microwave resonators, one serving as a Hermitian photonic qubit while the other as an NH qubit. We experimentally quantify the topological invariant for an EP3, by mapping out the complex eigenspectra along a loop surrounding this EP3 in the parameter space. The nonclassicality of the realized topology is manifested by the observed quantum correlations in the corresponding eigenstates. Our results extend research of exceptional topology to fully quantum-mechanical models with multi-partite entangled eigenstates. We further demonstrate the non-reciprocal transmission of a single photon, during which the photon is nonlocally shared by three individual elements.


title: Branching rules for the restriction of regular representations of $\mathrm{GL}_2(\mathfrak{o}/\mathfrak{p}^r)$ to $\mathrm{SL}_2(\mathfrak{o}/\mathfrak{p}^r).$

abstract: Let $\mathfrak{o}$ be a compact discrete valuation ring with maximal ideal $\mathfrak{p}$ such that the finite residue field $\mathfrak{o}/\mathfrak{p}$ has characteristic $p.$ For $r\geq2$ and $p=2,$ we obtain the branching rules for the restriction of a regular representation of $\mathrm{GL}_2(\mathfrak{o}/\mathfrak{p}^r)$ to $\mathrm{SL}_2(\mathfrak{o}/\mathfrak{p}^r).$ These results have different behaviour than that of the known case of $p\neq2.$


title: The exponential turnpike property for periodic linear quadratic optimal control problems in infinite dimension

abstract: In this paper, we establish an exponential periodic turnpike property for linear quadratic optimal control problems governed by periodic systems in infinite dimension. We show that the optimal trajectory converges exponentially to a periodic orbit when the time horizon tends to infinity. Similar results are obtained for the optimal control and adjoint state. Our proof is based on the large time behavior of solutions of operator differential Riccati equations with periodic coefficients.


title: Trinity: Syncretizing Multi-/Long-tail/Long-term Interests All in One

abstract: Interest modeling in recommender system has been a constant topic for improving user experience, and typical interest modeling tasks (e.g. multi-interest, long-tail interest and long-term interest) have been investigated in many existing works. However, most of them only consider one interest in isolation, while neglecting their interrelationships. In this paper, we argue that these tasks suffer from a common "interest amnesia" problem, and a solution exists to mitigate it simultaneously. We figure that long-term cues can be the cornerstone since they reveal multi-interest and clarify long-tail interest. Inspired by the observation, we propose a novel and unified framework in the retrieval stage, "Trinity", to solve interest amnesia problem and improve multiple interest modeling tasks. We construct a real-time clustering system that enables us to project items into enumerable clusters, and calculate statistical interest histograms over these clusters. Based on these histograms, Trinity recognizes underdelivered themes and remains stable when facing emerging hot topics. Trinity is more appropriate for large-scale industry scenarios because of its modest computational overheads. Its derived retrievers have been deployed on the recommender system of Douyin, significantly improving user experience and retention. We believe that such practical experience can be well generalized to other scenarios.


title: Double Dyck Path Algebra Representations From DAHA

abstract: The double Dyck path algebra $\mathbb{A}_{q,t}$ was introduced by Carlsson-Mellit in their proof of the Shuffle Theorem. A variant of this algebra, $\mathbb{B}_{q,t}$, was introduced by Carlsson-Gorsky-Mellit in their study of the parabolic flag Hilbert schemes of points in $\mathbb{C}^2$ showing that $\mathbb{B}_{q,t}$ acts naturally on the equivariant $K$-theory of these spaces. The algebraic relations defining $\mathbb{B}_{q,t}$ appear superficially similar to those of the positive double affine Hecke algebras (DAHA) in type $GL$, $\mathscr{D}_n^{+}$, introduced by Cherednik. In this paper we provide a general method for constructing $\mathbb{B}_{q,t}$ representations from DAHA representations. In particular, every $\mathscr{D}_n^{+}$ module yields a representation of a subalgebra $\mathbb{B}_{q,t}^{(n)}$ of $\mathbb{B}_{q,t}$ and special families of compatible DAHA representations give representations of $\mathbb{B}_{q,t}$. These constructions are functorial. Lastly, we will construct a large family of $\mathbb{B}_{q,t}$ representations indexed by partitions using this method related to the Murnaghan-type representations of the positive elliptic Hall algebra introduced previously by the author.


title: Comparing Knowledge Sources for Open-Domain Scientific Claim Verification

abstract: The increasing rate at which scientific knowledge is discovered and health claims shared online has highlighted the importance of developing efficient fact-checking systems for scientific claims. The usual setting for this task in the literature assumes that the documents containing the evidence for claims are already provided and annotated or contained in a limited corpus. This renders the systems unrealistic for real-world settings where knowledge sources with potentially millions of documents need to be queried to find relevant evidence. In this paper, we perform an array of experiments to test the performance of open-domain claim verification systems. We test the final verdict prediction of systems on four datasets of biomedical and health claims in different settings. While keeping the pipeline's evidence selection and verdict prediction parts constant, document retrieval is performed over three common knowledge sources (PubMed, Wikipedia, Google) and using two different information retrieval techniques. We show that PubMed works better with specialized biomedical claims, while Wikipedia is more suited for everyday health concerns. Likewise, BM25 excels in retrieval precision, while semantic search in recall of relevant evidence. We discuss the results, outline frequent retrieval patterns and challenges, and provide promising future directions.


title: A general integral identity with applications to a reverse Serrin problem

abstract: We prove a new general differential identity and an associated integral identity, which entails a pair of solutions of the Poisson equation with constant source term. This generalizes a formula that the first and third authors previously proved and used to obtain quantitative estimates of spherical symmetry for the Serrin overdetermined boundary value problem. As an application, we prove a quantitative symmetry result for the reverse Serrin problem, which we introduce for the first time in this paper. In passing, we obtain a rigidity result for solutions of the aforementioned Poisson equation subject to a constant Neumann condition.


title: Machine Learning Resistant Amorphous Silicon Physically Unclonable Functions (PUFs)

abstract: We investigate usage of nonlinear wave chaotic amorphous silicon (a-Si) cavities as physically unclonable functions (PUF). Machine learning attacks on integrated electronic PUFs have been demonstrated to be very effective at modeling PUF behavior. Such attacks on integrated a-Si photonic PUFs are investigated through application of algorithms including linear regression, k-nearest neighbor, decision tree ensembles (random forests and gradient boosted trees), and deep neural networks (DNNs). We found that DNNs performed the best among all the algorithms studied but still failed to completely break the a-Si PUF security which we quantify through a private information metric. Furthermore, machine learning resistance of a-Si PUFs were found to be directly related to the strength of their nonlinear response.

categories: physics.optics cs.CR cs.LG physics.app-ph


title: A unified rule format for bounded nondeterminism in SOS with terms as labels

abstract: We present a unified rule format for structural operational semantics with terms as labels that guarantees that the associated labelled transition system has some bounded-nondeterminism property. The properties we consider include finite branching, initials finiteness and image finiteness.


title: Information theoretic measures on quantum droplets in ultracold atomic systems

abstract: We consider Shannon entropy, Fisher information, R\'enyi entropy, and Tsallis entropy to study the transition from localized phase to droplet phase in Bose-Einstein condensates. Based on an effective Gross-Pitaevskii equation with Lee-Huang-Yang correction, we calculate density distributions both in localized and the droplet phases and show that the entropy measures can efficiently detect the transition from localized to droplet phase. We find that the Shannon entropies in coordinate space increase both in localized and droplet phases. The increase of entropy in droplet phase is abrupt while it is gradual in localized phase. We observe an opposite trend in the case of Fisher information. These results are found to be consistent with the R\'enyi and Tsallis entropic measures.


title: Do we need decay-preserving error estimate for solving parabolic equations with initial singularity?

abstract: Solutions exhibiting weak initial singularities arise in various equations, including diffusion and subdiffusion equations. When employing the well-known L1 scheme to solve subdiffusion equations with weak singularities, numerical simulations reveal that this scheme exhibits varying convergence rates for different choices of model parameters (i.e., domain size, final time $T$, and reaction coefficient $\kappa$). This elusive phenomenon is not unique to the L1 scheme but is also observed in other numerical methods for reaction-diffusion equations such as the backward Euler (IE) scheme, Crank-Nicolson (C-N) scheme, and two-step backward differentiation formula (BDF2) scheme. The existing literature lacks an explanation for the existence of two different convergence regimes, which has puzzled us for a long while and motivated us to study this inconsistency between the standard convergence theory and numerical experiences. In this paper, we provide a general methodology to systematically obtain error estimates that incorporate the exponential decaying feature of the solution. We term this novel error estimate the `decay-preserving error estimate' and apply it to the aforementioned IE, C-N, and BDF2 schemes. Our decay-preserving error estimate consists of a low-order term with an exponential coefficient and a high-order term with an algebraic coefficient, both of which depend on the model parameters. Our estimates reveal that the varying convergence rates are caused by a trade-off between these two components in different model parameter regimes. By considering the model parameters, we capture different states of the convergence rate that traditional error estimates fail to explain. This approach retains more properties of the continuous solution. We validate our analysis with numerical results.


title: An Attention Long Short-Term Memory based system for automatic classification of speech intelligibility

abstract: Speech intelligibility can be degraded due to multiple factors, such as noisy environments, technical difficulties or biological conditions. This work is focused on the development of an automatic non-intrusive system for predicting the speech intelligibility level in this latter case. The main contribution of our research on this topic is the use of Long Short-Term Memory (LSTM) networks with log-mel spectrograms as input features for this purpose. In addition, this LSTM-based system is further enhanced by the incorporation of a simple attention mechanism that is able to determine the more relevant frames to this task. The proposed models are evaluated with the UA-Speech database that contains dysarthric speech with different degrees of severity. Results show that the attention LSTM architecture outperforms both, a reference Support Vector Machine (SVM)-based system with hand-crafted features and a LSTM-based system with Mean-Pooling.


title: Enhancing Compositional Generalization via Compositional Feature Alignment

abstract: Real-world applications of machine learning models often confront data distribution shifts, wherein discrepancies exist between the training and test data distributions. In the common multi-domain multi-class setup, as the number of classes and domains scales up, it becomes infeasible to gather training data for every domain-class combination. This challenge naturally leads the quest for models with Compositional Generalization (CG) ability, where models can generalize to unseen domain-class combinations. To delve into the CG challenge, we develop CG-Bench, a suite of CG benchmarks derived from existing real-world image datasets, and observe that the prevalent pretraining-finetuning paradigm on foundational models, such as CLIP and DINOv2, struggles with the challenge. To address this challenge, we propose Compositional Feature Alignment (CFA), a simple two-stage finetuning technique that i) learns two orthogonal linear heads on a pretrained encoder with respect to class and domain labels, and ii) fine-tunes the encoder with the newly learned head frozen. We theoretically and empirically justify that CFA encourages compositional feature learning of pretrained models. We further conduct extensive experiments on CG-Bench for CLIP and DINOv2, two powerful pretrained vision foundation models. Experiment results show that CFA outperforms common finetuning techniques in compositional generalization, corroborating CFA's efficacy in compositional feature learning.


title: Amorphous quantum magnets in a two-dimensional Rydberg atom array

abstract: Amorphous solids, i.e., systems which feature well-defined short-range properties but lack long-range order, constitute an important research topic in condensed matter. While their microscopic structure is known to differ from their crystalline counterpart, there are still many open questions concerning the emergent collective behavior in amorphous materials. This is particularly the case in the quantum regime, where the numerical simulations are extremely challenging. In this article, we instead propose to explore amorphous quantum magnets with an analog quantum simulator. To this end, we first present an algorithm to generate amorphous quantum magnets, suitable for Rydberg simulators of the Ising model. Subsequently, we use semiclassical approaches to get a preliminary insight of the physics of the model. In particular, for ferromagnetic interactions, we calculate mean-field phase diagrams, and use the linear-spin-wave theory to study localization properties and dynamical structure factors of the excitations. For antiferromagnetic interactions, we show that amorphous magnets exhibit a complex classical energy landscape by means of simulated annealing. Finally, we outline an experimental proposal based on Rydberg atoms in programmable tweezer arrays, thus opening the road towards the study of amorphous quantum magnets in regimes difficult to simulate classically.


title: Repeated-Root Cyclic Codes with Optimal Parameters or Best Parameters Known

abstract: Cyclic codes are the most studied subclass of linear codes and widely used in data storage and communication systems. Many cyclic codes have optimal parameters or the best parameters known. They are divided into simple-root cyclic codes and repeated-root cyclic codes. Although there are a huge number of references on cyclic codes, few of them are on repeated-root cyclic codes. Hence, repeated-root cyclic codes are rarely studied. There are a few families of distance-optimal repeated-root binary and $p$-ary cyclic codes for odd prime $p$ in the literature. However, it is open whether there exists an infinite family of distance-optimal repeated-root cyclic codes over $\bF_q$ for each even $q \geq 4$. In this paper, three infinite families of distance-optimal repeated-root cyclic codes with minimum distance 3 or 4 are constructed; two other infinite families of repeated-root cyclic codes with minimum distance 3 or 4 are developed; seven infinite families of repeated-root cyclic codes with minimum distance 6 or 8 or 10 are presented; and two infinite families of repeated-root binary cyclic codes with parameters $[2n, k, d \geq (n-1)/\log_2 n]$, where $n=2^m-1$ and $k \geq n$, are constructed. In addition, 27 repeated-root cyclic codes of length up to $254$ over $\bF_q$ for $q \in \{2, 4, 8\}$ with optimal parameters or best parameters known are obtained in this paper. The results of this paper show that repeated-root cyclic codes could be very attractive and are worth of further investigation.


title: Small inertia limit for coupled kinetic swarming models

abstract: We investigate various versions of multi-dimensional systems involving many species, modeling aggregation phenomena through nonlocal interaction terms. We establish a rigorous connection between kinetic and macroscopic descriptions by considering the small-inertia limit at the kinetic level. The results are proven either under smoothness assumptions on all interaction kernels or under singular assumptions for \emph{self-interaction} potentials. Utilizing different techniques in the two cases, we demonstrate the existence of a solution to the kinetic system, provide uniform estimates with respect to the inertia parameter, and show convergence towards the corresponding macroscopic system as the inertia approaches zero.


title: Dynamic Sparse Learning: A Novel Paradigm for Efficient Recommendation

abstract: In the realm of deep learning-based recommendation systems, the increasing computational demands, driven by the growing number of users and items, pose a significant challenge to practical deployment. This challenge is primarily twofold: reducing the model size while effectively learning user and item representations for efficient recommendations. Despite considerable advancements in model compression and architecture search, prevalent approaches face notable constraints. These include substantial additional computational costs from pre-training/re-training in model compression and an extensive search space in architecture design. Additionally, managing complexity and adhering to memory constraints is problematic, especially in scenarios with strict time or space limitations. Addressing these issues, this paper introduces a novel learning paradigm, Dynamic Sparse Learning (DSL), tailored for recommendation models. DSL innovatively trains a lightweight sparse model from scratch, periodically evaluating and dynamically adjusting each weight's significance and the model's sparsity distribution during the training. This approach ensures a consistent and minimal parameter budget throughout the full learning lifecycle, paving the way for "end-to-end" efficiency from training to inference. Our extensive experimental results underline DSL's effectiveness, significantly reducing training and inference costs while delivering comparable recommendation performance.


title: Generalized dynamical phase reduction for stochastic oscillators

abstract: Phase reduction is an important tool for studying coupled and driven oscillators. The question of how to generalize phase reduction to stochastic oscillators remains actively debated. In this work, we propose a method to derive a self-contained stochastic phase equation of the form $d\vartheta = a_\vartheta(\vartheta)dt + \sqrt{2D_\vartheta(\vartheta)}\,dW_\vartheta(t)$ that is valid not only for noise-perturbed limit cycles, but also for noise-induced oscillations. We show that our reduction captures the asymptotic statistics of qualitatively different stochastic oscillators, and use it to infer their phase-response properties.


title: Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation

abstract: Stochastic Gradient Descent (SGD) with adaptive steps is now widely used for training deep neural networks. Most theoretical results assume access to unbiased gradient estimators, which is not the case in several recent deep learning and reinforcement learning applications that use Monte Carlo methods. This paper provides a comprehensive non-asymptotic analysis of SGD with biased gradients and adaptive steps for convex and non-convex smooth functions. Our study incorporates time-dependent bias and emphasizes the importance of controlling the bias and Mean Squared Error (MSE) of the gradient estimator. In particular, we establish that Adagrad and RMSProp with biased gradients converge to critical points for smooth non-convex functions at a rate similar to existing results in the literature for the unbiased case. Finally, we provide experimental results using Variational Autoenconders (VAE) that illustrate our convergence results and show how the effect of bias can be reduced by appropriate hyperparameter tuning.


title: Deep autoregressive density nets vs neural ensembles for model-based offline reinforcement learning

abstract: We consider the problem of offline reinforcement learning where only a set of system transitions is made available for policy optimization. Following recent advances in the field, we consider a model-based reinforcement learning algorithm that infers the system dynamics from the available data and performs policy optimization on imaginary model rollouts. This approach is vulnerable to exploiting model errors which can lead to catastrophic failures on the real system. The standard solution is to rely on ensembles for uncertainty heuristics and to avoid exploiting the model where it is too uncertain. We challenge the popular belief that we must resort to ensembles by showing that better performance can be obtained with a single well-calibrated autoregressive model on the D4RL benchmark. We also analyze static metrics of model-learning and conclude on the important model properties for the final performance of the agent.


title: Importance sampling for online variational learning

abstract: This article addresses online variational estimation in state-space models. We focus on learning the smoothing distribution, i.e. the joint distribution of the latent states given the observations, using a variational approach together with Monte Carlo importance sampling. We propose an efficient algorithm for computing the gradient of the evidence lower bound (ELBO) in the context of streaming data, where observations arrive sequentially. Our contributions include a computationally efficient online ELBO estimator, demonstrated performance in offline and true online settings, and adaptability for computing general expectations under joint smoothing distributions.


title: Constraining kaon PDFs from Drell-Yan and $J/\psi$ production

abstract: The kaon parton distribution functions (PDFs) are poorly known due to paucity of kaon-induced Drell-Yan data. Nevertheless, these Drell-Yan data suggest a softer valence $u$ quark distribution of kaon than that of pion. We discuss the opportunity to constrain kaon PDFs utilizing existing kaon-induced $J/\psi$ production data. We compare the $K^- / \pi^-$ and $K^+ / \pi^+$ cross-section ratio data with calculations based on two global-fit parametrizations and two recent theoretical predictions for the kaon and pion PDFs, and test the results with two quarkonium production models. The $K^- / \pi^-$ cross-section ratio for $J/\psi$ production provides an independent evidence of different valence quark distributions in pion and kaon. The $K^+ / \pi^+$ $J/\psi$ data are found to be sensitive to the gluon distribution in kaon. We show that these $J/\psi$ production data provide valuable constraints for evaluating the adequacy of currently available sets of kaon PDFs.


title: Leveraging Noisy Observations in Zero-Sum Games

abstract: This paper studies an instance of zero-sum games in which one player (the leader) commits to its opponent (the follower) to choose its actions by sampling a given probability measure (strategy). The actions of the leader are observed by the follower as the output of an arbitrary channel. In response to that, the follower chooses its action based on its current information, that is, the leader's commitment and the corresponding noisy observation of its action. Within this context, the equilibrium of the game with noisy action observability is shown to always exist and the necessary conditions for its uniqueness are identified. Interestingly, the noisy observations have important impact on the cardinality of the follower's set of best responses. Under particular conditions, such a set of best responses is proved to be a singleton almost surely. The proposed model captures any channel noise with a density with respect to the Lebesgue measure. As an example, the case in which the channel is described by a Gaussian probability measure is investigated.


title: Graph Neural Machine: A New Model for Learning with Tabular Data

abstract: In recent years, there has been a growing interest in mapping data from different domains to graph structures. Among others, neural network models such as the multi-layer perceptron (MLP) can be modeled as graphs. In fact, MLPs can be represented as directed acyclic graphs. Graph neural networks (GNNs) have recently become the standard tool for performing machine learning tasks on graphs. In this work, we show that an MLP is equivalent to an asynchronous message passing GNN model which operates on the MLP's graph representation. We then propose a new machine learning model for tabular data, the so-called Graph Neural Machine (GNM), which replaces the MLP's directed acyclic graph with a nearly complete graph and which employs a synchronous message passing scheme. We show that a single GNM model can simulate multiple MLP models. We evaluate the proposed model in several classification and regression datasets. In most cases, the GNM model outperforms the MLP architecture.


title: Hybrid subterahertz atmospheric pressure plasmatron for plasma chemical applications

abstract: This paper presents the results of an experimental study of a new hybrid plasmatron scheme, which was used to realize a gas discharge at atmospheric pressure supported by continuous focused submillimeter radiation with a frequency of 263 GHz. The implemented design allowed organizing a self-consistent interaction between submillimeter radiation and the supercritical plasma in a localized area both in terms of gas flow and electrodynamic. It is experimentally shown that the gas discharge absorbs up to 80% of the introduced submillimeter radiation power. The hybrid subterahertz plasmatron as an effective reactor for non-equilibrium plasma chemical processes was tested for the atmospheric nitrogen fixation.


title: EEVEE: An Easy Annotation Tool for Natural Language Processing

abstract: Annotation tools are the starting point for creating Natural Language Processing (NLP) datasets. There is a wide variety of tools available; setting up these tools is however a hindrance. We propose EEVEE, an annotation tool focused on simplicity, efficiency, and ease of use. It can run directly in the browser (no setup required) and uses tab-separated files (as opposed to character offsets or task-specific formats) for annotation. It allows for annotation of multiple tasks on a single dataset and supports four task-types: sequence labeling, span labeling, text classification and seq2seq.


title: On combining acoustic and modulation spectrograms in an attention LSTM-based system for speech intelligibility level classification

abstract: Speech intelligibility can be affected by multiple factors, such as noisy environments, channel distortions or physiological issues. In this work, we deal with the problem of automatic prediction of the speech intelligibility level in this latter case. Starting from our previous work, a non-intrusive system based on LSTM networks with attention mechanism designed for this task, we present two main contributions. In the first one, it is proposed the use of per-frame modulation spectrograms as input features, instead of compact representations derived from them that discard important temporal information. In the second one, two different strategies for the combination of per-frame acoustic log-mel and modulation spectrograms into the LSTM framework are explored: at decision level or late fusion and at utterance level or Weighted-Pooling (WP) fusion. The proposed models are evaluated with the UA-Speech database that contains dysarthric speech with different degrees of severity. On the one hand, results show that attentional LSTM networks are able to adequately modeling the modulation spectrograms sequences producing similar classification rates as in the case of log-mel spectrograms. On the other hand, both combination strategies, late and WP fusion, outperform the single-feature systems, suggesting that per-frame log-mel and modulation spectrograms carry complementary information for the task of speech intelligibility prediction, than can be effectively exploited by the LSTM-based architectures, being the system with the WP fusion strategy and Attention-Pooling the one that achieves best results.


title: Quantum Normalizing Flows for Anomaly Detection

abstract: A Normalizing Flow computes a bijective mapping from an arbitrary distribution to a predefined (e.g. normal) distribution. Such a flow can be used to address different tasks, e.g. anomaly detection, once such a mapping has been learned. In this work we introduce Normalizing Flows for Quantum architectures, describe how to model and optimize such a flow and evaluate our method on example datasets. Our proposed models show competitive performance for anomaly detection compared to classical methods, esp. those ones where there are already quantum inspired algorithms available. In the experiments we compare our performance to isolation forests (IF), the local outlier factor (LOF) or single-class SVMs.


title: A new robust approach for the polytomous logistic regression model based on R\'enyi's pseudodistances

abstract: This paper presents a robust alternative to the Maximum Likelihood Estimator (MLE) for the Polytomous Logistic Regression Model (PLRM), known as the family of minimum R\`enyi Pseudodistance (RP) estimators. The proposed minimum RP estimators are parametrized by a tuning parameter $\alpha\geq0$, and include the MLE as a special case when $\alpha=0$. These estimators, along with a family of RP-based Wald-type tests, are shown to exhibit superior performance in the presence of misclassification errors. The paper includes an extensive simulation study and a real data example to illustrate the robustness of these proposed statistics.


title: Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem

abstract: Fine-tuning is a widespread technique that allows practitioners to transfer pre-trained capabilities, as recently showcased by the successful applications of foundation models. However, fine-tuning reinforcement learning (RL) models remains a challenge. This work conceptualizes one specific cause of poor transfer, accentuated in the RL setting by the interplay between actions and observations: forgetting of pre-trained capabilities. Namely, a model deteriorates on the state subspace of the downstream task not visited in the initial phase of fine-tuning, on which the model behaved well due to pre-training. This way, we lose the anticipated transfer benefits. We identify conditions when this problem occurs, showing that it is common and, in many cases, catastrophic. Through a detailed empirical analysis of the challenging NetHack and Montezuma's Revenge environments, we show that standard knowledge retention techniques mitigate the problem and thus allow us to take full advantage of the pre-trained capabilities. In particular, in NetHack, we achieve a new state-of-the-art for neural models, improving the previous best score from $5$K to over $10$K points in the Human Monk scenario.


title: Heat Equations and Hearing the Genus on p-adic Mumford Curves via Automorphic Forms

abstract: A self-adjoint operator is constructed on the $L_2$-functions on the $K$-rational points $X(K)$ of a Mumford curve $X$ defined over a non-archimedean local field $K$. It generates a Feller semi-group, and the corresponding heat equation describes a Markov process on $X(K)$. Its spectrum is non-positive, contains zero and has finitely many limit points which are the only non-eigenvalues, and correspond to the zeros of a given regular differential 1-form on $X(K)$. This allows to recover the genus of X from the spectrum. The hyperelliptic case allows in principle an explicit genus extraction.


title: Statistics without Interpretation: A Sober Look at Explainable Machine Learning

abstract: In the rapidly growing literature on explanation algorithms, it often remains unclear what precisely these algorithms are for and how they should be used. We argue that this is because explanation algorithms are often mathematically complex but don't admit a clear interpretation. Unfortunately, complex statistical methods that don't have a clear interpretation are bound to lead to errors in interpretation, a fact that has become increasingly apparent in the literature. In order to move forward, papers on explanation algorithms should make clear how precisely the output of the algorithms should be interpreted. They should also clarify what questions about the function can and cannot be answered given the explanations. Our argument is based on the distinction between statistics and their interpretation. It also relies on parallels between explainable machine learning and applied statistics.


title: Code-Based Single-Server Private Information Retrieval: Circumventing the Sub-Query Attack

abstract: Private information retrieval from a single server is considered, utilizing random linear codes. Presented is a modified version of the first code-based single-server computational PIR scheme proposed by Holzbaur, Hollanti, and Wachter-Zeh in [Holzbaur et al., "Computational Code-Based Single-Server Private Information Retrieval", 2020 IEEE ISIT]. The original scheme was broken in [Bordage et al., "On the privacy of a code-based single-server computational PIR scheme", Cryptogr. Comm., 2021] by an attack arising from highly probable rank differences in sub-matrices of the user's query. Here, this attack is now circumvented by ensuring that the sub-matrices have negligible rank difference. Furthermore, the rank difference cannot be attributed to the desired file index, thereby ensuring the privacy of the scheme. In the case of retrieving multiple files, the rate of the modified scheme is largely unaffected and at par with the original scheme.


title: How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning

abstract: We investigate the mechanism of in-context learning (ICL) on sentence classification tasks with semantically-unrelated labels ("foo"/"bar"). We find intervening in only 1\% heads (named "in-context heads") significantly affects ICL accuracy from 87.6\% to 24.4\%. To understand this phenomenon, we analyze the value-output vectors in these heads and discover that the vectors at each label position contain substantial information about the corresponding labels. Furthermore, we observe that the prediction shift from "foo" to "bar" is due to the respective reduction and increase in these heads' attention scores at "foo" and "bar" positions. Therefore, we propose a hypothesis for ICL: in in-context heads, the value-output matrices extract label features, while the query-key matrices compute the similarity between the features at the last position and those at each label position. The query and key matrices can be considered as two towers that learn the similarity metric between the last position's features and each demonstration at label positions. Using this hypothesis, we explain the majority label bias and recency bias in ICL and propose two methods to reduce these biases by 22\% and 17\%, respectively.


title: A classical density functional theory for solvation across length scales

abstract: A central aim of multiscale modeling is to use results from the Schr\"odinger Equation to predict phenomenology on length scales that far exceed those of typical molecular correlations. In this work, we present a new approach rooted in classical density functional theory (cDFT) that allows us to accurately describe the solvation of apolar solutes across length scales. Our approach builds on the Lum, Chandler and Weeks (LCW) theory of hydrophobicity [J. Phys. Chem. B 103, 4570 (1999)] by constructing a free energy functional that uses a slowly-varying component of the density field as a reference. From a practical viewpoint, the theory we present is numerically simpler and generalizes to solutes with soft-core repulsion more easily than LCW theory. Furthermore, by assessing the local compressibility and its critical scaling behavior, we demonstrate that our LCW-style cDFT approach contains the physics of critical drying, which has been emphasized as an essential aspect of hydrophobicity by recent theories. As our approach is parameterized on the two-body direct correlation function of the uniform fluid and the liquid-vapor surface tension, it straightforwardly captures the temperature dependence of solvation. Moreover, we use our theory to describe solvation at a first-principles level, on length scales that vastly exceed what is accessible to molecular simulations.

categories: cond-mat.stat-mech cond-mat.mes-hall cond-mat.soft physics.chem-ph


title: Morse frames

abstract: In the context of discrete Morse theory, we introduce Morse frames, which are maps that associate a set of critical simplexes to all simplexes. The main example of Morse frames are the Morse references. In particular, these Morse references allow computing Morse complexes, an important tool for homology. We highlight the link between Morse references and gradient flows. We also propose a novel presentation of the Annotation algorithm for persistent cohomology, as a variant of a Morse frame. Finally, we propose another construction, that takes advantage of the Morse reference for computing the Betti numbers in mod 2 arithmetic.


title: Low-energy $\alpha$-harmonic maps into the round sphere

abstract: We classify low-energy $\alpha$-harmonic maps from a closed non-spherical Riemannian surface $\Sigma$ of constant curvature to the round sphere via their bubble scales and centres. In particular we show that as $1<\alpha\downarrow 1$ and assuming $E_\alpha$ is close to $| \Sigma|+4\pi$ then degree-one $\alpha$-harmonic maps blow a bubble based at a critical point $a_c$ of a an explicit function $\mathcal{J}$ and at scale $\sqrt{ |\mathcal{J}(a_c)|^{-1}(\alpha-1)}$. Up to a constant, $\mathcal{J}$ is the sum of the squares of any $L^2$-orthonormal basis of holomorphic one-forms on the domain.


title: High-speed stars. II. An unbound star, young stars, bulge metal-poor stars, and Aurora candidates

abstract: The data from the Gaia satellite led us to revise our conception of the Galaxy structure and history. Hitherto unknown components have been discovered and a deep re-thinking of what the Galactic halo is is in progress. We selected from the Gaia catalogue stars with extreme transverse velocities with respect to the Sun ($|V_T| > 500 $ and observed them with FORS2 at the ESO VLT, to classify them using both their chemical and dynamical properties. Two apparently young stars, identified in paper\,I, were observed with UVES. We derived abundances for Na, Mg, Ca, Ti, Mn, and Fe, analysing the spectra with while for Ba we used line profile fitting. We computed actions from parallaxes and kinematical data. The stars span the metallicity range $ Fe/H -0.5$ with $ Fe/H = -1.6$. Star GHS143 has a total speed of about 1440 which is almost three times faster than the local escape velocity of 522 strongly implying this star is unbound to the Galaxy. Remarkably, this star is not escaping from the Galaxy, but it is falling into it. Ten stars are apparently young with masses in excess of 1.3M. Their interpretation as evolved blue stragglers is doubtful. The existence of a young metal-poor population is possible. The two stars observed with UVES show no lithium, suggesting they are blue stragglers. We detected a metal-poor population, confined to the bulge, that we call SpiteF, and argue that it is the result of a recent accretion event. We detect 102 candidates of the Aurora population that should have formed prior to the formation of the disc. Our sample is non-homogeneous and mainly retrograde. The stars are metal poor, and 23<!PCT!> have Fe/H -2.0$. Our selection is efficient at finding very metal-poor stars, but it selects peculiar populations.


title: Feedback to the European Data Protection Board's Guidelines 2/2023 on Technical Scope of Art. 5(3) of ePrivacy Directive

abstract: We very much welcome the EDPB's Guidelines. Please find hereunder our feedback to the Guidelines 2/2023 on Technical Scope of Art. 5(3) of ePrivacy Directive. Our comments are presented after a quotation from the proposed text by the EDPB in a box.


title: The Gaia RVS benchmark stars II. A sample of stars selected for their Gaia high radial velocity

abstract: The Gaia satellite has already provided the astronomical community with three data releases, and the Radial Velocity Spectrometer (RVS) on board Gaia has provided the radial velocity for 33 million stars. When deriving the radial velocity from the RVS spectra, several stars are measured to have large values. To verify the credibility of these measurements, we selected some bright stars with the modulus of radial velocity in excess of 500\ to be observed with SOPHIE at OHP and UVES at VLT. This paper is devoted to investigating the chemical composition of the stars observed with UVES. We derived atmospheric parameters using Gaia photometry and parallaxes, and we performed a chemical analysis using the code. We find that the sample consists of metal-poor stars, although none have extremely low metallicities. The abundance patterns match what has been found in other samples of metal-poor stars selected irrespective of their radial velocities. We highlight the presence of three stars with low Cu and Zn abundances that are likely descendants of pair-instability supernovae. Two stars are apparently younger than 1\,Ga, and their masses exceed twice the turn-off mass of metal-poor populations. This makes it unlikely that they are blue stragglers because it would imply they formed from triple or multiple systems. We suggest instead that they are young metal-poor stars accreted from a dwarf galaxy. Finally, we find that the star RVS721 is associated with the Gjoll stream, which itself is associated with the Globular Cluster NGC\,3201.


title: Deformation of formal schemes through local homology

abstract: Deformation theory is treated for locally notherian formal schemes (non necessarily smooth). The cotangent complex is defined in the derived category through the homology localization functor. The basic properties and results of a deformation theory are proved. And the complex is described for regular closed immersions and complete intersection morphisms of formal schemes.


title: Unleashing the Expressive Power of Pulse-Based Quantum Neural Networks

abstract: Quantum machine learning (QML) based on Noisy Intermediate-Scale Quantum (NISQ) devices hinges on the optimal utilization of limited quantum resources. While gate-based QML models are user-friendly for software engineers, their expressivity is restricted by the permissible circuit depth within a finite coherence time. In contrast, pulse-based models enable the construction of "infinitely" deep quantum neural networks within the same time, which may unleash greater expressive power for complex learning tasks. In this paper, this potential is investigated from the perspective of quantum control theory. We first indicate that the nonlinearity of pulse-based models comes from the encoding process that can be viewed as the continuous limit of data-reuploading in gate-based models. Subsequently, we prove that the pulse-based model can approximate arbitrary nonlinear functions when the underlying physical system is ensemble controllable. Under this condition, numerical simulations demonstrate the enhanced expressivity by either increasing the pulse length or the number of qubits. As anticipated, we show through numerical examples that the pulse-based model can unleash more expressive power compared to the gate-based model. These findings lay a theoretical foundation for understanding and designing expressive QML models using NISQ devices.


title: Nonlinear MHD modeling of soft $\beta$ limits in W7-AS

abstract: An important question for the outlook of stellarator reactors is their robustness against pressure driven modes, and the underlying mechanism behind experimentally observed soft $\beta$ limits. Towards building a robust answer to these questions, simulation studies are presented using a recently derived reduced nonlinear MHD model. First, the initial model implementation is extended to capture fluid compression by including the influence of parallel flows. Linear benchmarks of a (2, 1) tearing mode in W7-AS geometry, and interchange modes in a finite $\beta$, net-zero current carrying stellarator with low magnetic shear are then used to demonstrate the modeling capabilities. Finally, a validation study is conducted on experimental reconstructions of finite $\beta$ W7-AS discharges. In agreement with past experimental analysis, it is shown that (i) the MHD activity is resistive, (ii) a soft $\beta$ limit is observed, when the plasma resistivity approaches the estimated experimental value, and (iii) low $n$ MHD activity is observed at intermediate $\beta$ values, particularly a nonlinearly dominant (2, 1) mode. The MHD activity is mild, explaining the soft $\beta$ limit, because the plasma volume remains separated into distinct sub-volumes in which field lines are ergodically confined. For the assumed transport parameters, the enhanced perpendicular transport along stochastic magnetic field lines can be overcome with the experimental heating power. The limitations in the current modeling are described, alongside an outlook for characterising soft $\beta$ limits in more detail in future work.


title: Doubly nonlinear diffusive PDEs: new existence results via generalized Wasserstein gradient flows

abstract: We prove an existence result for a large class of PDEs with a nonlinear Wasserstein gradient flow structure. We use the classical theory of Wasserstein gradient flow to derive an EDI formulation of our PDE and prove that under some integrability assumptions on the initial condition the PDE is satisfied in the sense of distributions.


title: Approximate Attributions for Off-the-Shelf Siamese Transformers

abstract: Siamese encoders such as sentence transformers are among the least understood deep models. Established attribution methods cannot tackle this model class since it compares two inputs rather than processing a single one. To address this gap, we have recently proposed an attribution method specifically for Siamese encoders (M\"oller et al., 2023). However, it requires models to be adjusted and fine-tuned and therefore cannot be directly applied to off-the-shelf models. In this work, we reassess these restrictions and propose (i) a model with exact attribution ability that retains the original model's predictive performance and (ii) a way to compute approximate attributions for off-the-shelf models. We extensively compare approximate and exact attributions and use them to analyze the models' attendance to different linguistic aspects. We gain insights into which syntactic roles Siamese transformers attend to, confirm that they mostly ignore negation, explore how they judge semantically opposite adjectives, and find that they exhibit lexical bias.


title: Lossy Compression of Adjacency Matrices by Graph Filter Banks

abstract: This paper proposes a compression framework for adjacency matrices of weighted graphs based on graph filter banks. Adjacency matrices are widely used mathematical representations of graphs and are used in various applications in signal processing, machine learning, and data mining. In many problems of interest, these adjacency matrices can be large, so efficient compression methods are crucial. In this paper, we propose a lossy compression of weighted adjacency matrices, where the binary adjacency information is encoded losslessly (so the topological information of the graph is preserved) while the edge weights are compressed lossily. For the edge weight compression, the target graph is converted into a line graph, whose nodes correspond to the edges of the original graph, and where the original edge weights are regarded as a graph signal on the line graph. We then transform the edge weights on the line graph with a graph filter bank for sparse representation. Experiments on synthetic data validate the effectiveness of the proposed method by comparing it with existing lossy matrix compression methods.


title: A Review on Building Blocks of Decentralized Artificial Intelligence

abstract: Artificial intelligence is transforming our lives, and technological progress and transfer from the academic and theoretical sphere to the real world are accelerating yearly. But during that progress and transition, several open problems and questions need to be addressed for the field to develop ethically, such as digital privacy, ownership, and control. These are some of the reasons why the currently most popular approaches of artificial intelligence, i.e., centralized AI (CEAI), are questionable, with other directions also being widely explored, such as decentralized artificial intelligence (DEAI), to solve some of the most reaching problems. This paper provides a systematic literature review (SLR) of existing work in the field of DEAI, presenting the findings of 71 identified studies. The paper's primary focus is identifying the building blocks of DEAI solutions and networks, tackling the DEAI analysis from a bottom-up approach. In the end, future directions of research and open problems are proposed.


title: Time-Distributed Backdoor Attacks on Federated Spiking Learning

abstract: This paper investigates the vulnerability of spiking neural networks (SNNs) and federated learning (FL) to backdoor attacks using neuromorphic data. Despite the efficiency of SNNs and the privacy advantages of FL, particularly in low-powered devices, we demonstrate that these systems are susceptible to such attacks. We first assess the viability of using FL with SNNs using neuromorphic data, showing its potential usage. Then, we evaluate the transferability of known FL attack methods to SNNs, finding that these lead to suboptimal attack performance. Therefore, we explore backdoor attacks involving single and multiple attackers to improve the attack performance. Our primary contribution is developing a novel attack strategy tailored to SNNs and FL, which distributes the backdoor trigger temporally and across malicious devices, enhancing the attack's effectiveness and stealthiness. In the best case, we achieve a 100 attack success rate, 0.13 MSE, and 98.9 SSIM. Moreover, we adapt and evaluate an existing defense against backdoor attacks, revealing its inadequacy in protecting SNNs. This study underscores the need for robust security measures in deploying SNNs and FL, particularly in the context of backdoor attacks.


title: Time-, Memory- and Parameter-Efficient Visual Adaptation

abstract: As foundation models become more popular, there is a growing need to efficiently finetune them for downstream tasks. Although numerous adaptation methods have been proposed, they are designed to be efficient only in terms of how many parameters are trained. They, however, typically still require backpropagating gradients throughout the model, meaning that their training-time and -memory cost does not reduce as significantly. We propose an adaptation method which does not backpropagate gradients through the backbone. We achieve this by designing a lightweight network in parallel that operates on features from the frozen, pretrained backbone. As a result, our method is efficient not only in terms of parameters, but also in training-time and memory usage. Our approach achieves state-of-the-art accuracy-parameter trade-offs on the popular VTAB benchmark, and we further show how we outperform prior works with respect to training-time and -memory usage too. We further demonstrate the training efficiency and scalability of our method by adapting a vision transformer backbone of 4 billion parameters for the computationally demanding task of video classification, without any intricate model parallelism. Here, we outperform a prior adaptor-based method which could only scale to a 1 billion parameter backbone, or fully-finetuning a smaller backbone, with the same GPU and less training time.


title: Boundary Toda Conformal Field Theory from the path integral

abstract: Toda Conformal Field Theories (CFTs hereafter) are generalizations of Liouville CFT where the underlying field is no longer scalar but takes values in a finite-dimensional vector space. The algebra of symmetry of such models is given by $W$-algebras, which contain the Virasoro algebra as a subalgebra. In contrast with Liouville CFT, and in the presence of a boundary, there may exist non-trivial automorphisms of the associated $W$-algebra, corresponding to different boundary conditions for the field of the theory. Based on this particular feature, we provide in this document a probabilistic construction of Toda CFTs on a Riemann surface with or without boundary. To be more specific we define different classes of models in relation with the different types of boundary conditions suggested by the non-triviality of the automorphism group of the $W$-algebra. To do so, we rely on a probabilistic framework based on Gaussian Free Fields and Gaussian Multiplicative Chaos, and make sense of "Cardy's doubling trick" to construct the underlying field of the theory.


title: Exploring Federated Self-Supervised Learning for General Purpose Audio Understanding

abstract: The integration of Federated Learning (FL) and Self-supervised Learning (SSL) offers a unique and synergetic combination to exploit the audio data for general-purpose audio understanding, without compromising user data privacy. However, rare efforts have been made to investigate the SSL models in the FL regime for general-purpose audio understanding, especially when the training data is generated by large-scale heterogeneous audio sources. In this paper, we evaluate the performance of feature-matching and predictive audio-SSL techniques when integrated into large-scale FL settings simulated with non-independently identically distributed (non-iid) data. We propose a novel Federated SSL (F-SSL) framework, dubbed FASSL, that enables learning intermediate feature representations from large-scale decentralized heterogeneous clients, holding unlabelled audio data. Our study has found that audio F-SSL approaches perform on par with the centralized audio-SSL approaches on the audio-retrieval task. Extensive experiments demonstrate the effectiveness and significance of FASSL as it assists in obtaining the optimal global model for state-of-the-art FL aggregation methods.


title: Black-Box Approximation and Optimization with Hierarchical Tucker Decomposition

abstract: We develop a new method HTBB for the multidimensional black-box approximation and gradient-free optimization, which is based on the low-rank hierarchical Tucker decomposition with the use of the MaxVol indices selection procedure. Numerical experiments for 14 complex model problems demonstrate the robustness of the proposed method for dimensions up to 1000, while it shows significantly more accurate results than classical gradient-free optimization methods, as well as approximation and optimization methods based on the popular tensor train decomposition, which represents a simpler case of a tensor network.


title: Yet another way from field theory to gravity

abstract: It is shown that target space diffeomorphism invariance of a generic Lagrangian for a set of scalar fields leads to an analog of Einstein equations for the geometry of a level set of these fields.


title: Motion-Aware Video Frame Interpolation

abstract: Video frame interpolation methodologies endeavor to create novel frames betwixt extant ones, with the intent of augmenting the video's frame frequency. However, current methods are prone to image blurring and spurious artifacts in challenging scenarios involving occlusions and discontinuous motion. Moreover, they typically rely on optical flow estimation, which adds complexity to modeling and computational costs. To address these issues, we introduce a Motion-Aware Video Frame Interpolation (MA-VFI) network, which directly estimates intermediate optical flow from consecutive frames by introducing a novel hierarchical pyramid module. It not only extracts global semantic relationships and spatial details from input frames with different receptive fields, enabling the model to capture intricate motion patterns, but also effectively reduces the required computational cost and complexity. Subsequently, a cross-scale motion structure is presented to estimate and refine intermediate flow maps by the extracted features. This approach facilitates the interplay between input frame features and flow maps during the frame interpolation process and markedly heightens the precision of the intervening flow delineations. Finally, a discerningly fashioned loss centered around an intermediate flow is meticulously contrived, serving as a deft rudder to skillfully guide the prognostication of said intermediate flow, thereby substantially refining the precision of the intervening flow mappings. Experiments illustrate that MA-VFI surpasses several representative VFI methods across various datasets, and can enhance efficiency while maintaining commendable efficacy.


title: On the Performance of RIS-Aided Spatial Modulation for Downlink Transmission

abstract: In this study, we explore the performance of a reconfigurable reflecting surface (RIS)-assisted transmit spatial modulation (SM) system for downlink transmission, wherein the deployment of RIS serves the purpose of blind area coverage within the channel. At the receiving end, we present three detectors, i.e., maximum likelihood (ML) detector, two-stage ML detection, and greedy detector to recover the transmitted signal. By utilizing the ML detector, we initially derive the conditional pair error probability expression for the proposed scheme. Subsequently, we leverage the central limit theorem (CLT) to obtain the probability density function of the combined channel. Following this, the Gaussian-Chebyshev quadrature method is applied to derive a closed-form expression for the unconditional pair error probability and establish the union tight upper bound for the average bit error probability (ABEP). Furthermore, we derive a closed-form expression for the ergodic capacity of the proposed RIS-SM scheme. Monte Carlo simulations are conducted not only to assess the complexity and reliability of the three detection algorithms but also to validate the results obtained through theoretical derivation results.


title: Shock equations and jump conditions for the 2D Adjoint Euler equations

abstract: This paper considers the formulation of the adjoint problem in two dimensions when there are shocks in the flow solution. For typical cost functions, the adjoint variables are continuous at shocks, where they have to obey an internal boundary condition, but their derivatives may be discontinuous. The derivation of the adjoint shock equations is reviewed and detailed predictions for the behavior of the gradients of the adjoint variables at shocks are obtained as jump conditions for the normal adjoint gradients in terms of the tangent gradients. Several numerical computations on a very fine mesh are used to illustrate the behavior of numerical adjoint solutions at shocks.


title: Noisy group testing via spatial coupling

abstract: We study the problem of identifying a small set $k\sim n^\theta$, $0<\theta<1$, of infected individuals within a large population of size $n$ by testing groups of individuals simultaneously. All tests are conducted concurrently. The goal is to minimise the total number of tests required. In this paper we make the (realistic) assumption that tests are noisy, i.e.\ that a group that contains an infected individual may return a negative test result or one that does not contain an infected individual may return a positive test results with a certain probability. The noise need not be symmetric. We develop an algorithm called SPARC that correctly identifies the set of infected individuals up to $o(k)$ errors with high probability with the asymptotically minimum number of tests. Additionally, we develop an algorithm called SPEX that exactly identifies the set of infected individuals w.h.p. with a number of tests that matches the information-theoretic lower bound for the constant column design, a powerful and well-studied test design.


title: LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models

abstract: While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an endeavour is important to ensure that agents remain consistent to their assigned traits yet are able to engage in open, naturalistic dialogues. In our experiments, we condition GPT-3.5 on personality profiles through prompting and create a two-group population of LLM agents using a simple variability-inducing sampling algorithm. We then administer personality tests and submit the agents to a collaborative writing task, finding that different profiles exhibit different degrees of personality consistency and linguistic alignment to their conversational partners. Our study seeks to lay the groundwork for better understanding of dialogue-based interaction between LLMs and highlights the need for new approaches to crafting robust, more human-like LLM personas for interactive environments.


title: Explaining the Lack of Mesh Convergence of Inviscid Adjoint Solutions Near Solid Walls for Subcritical Flows

abstract: Numerical solutions to the adjoint Euler equations have been found to diverge with mesh refinement near walls for a variety of flow conditions and geometry configurations. The issue is reviewed and an explanation is provided by comparing a numerical incompressible adjoint solution with an analytic adjoint solution, showing that the anomaly observed in numerical computations is caused by a divergence of the analytic solution at the wall. The singularity causing this divergence is of the same type as the well-known singularity along the incoming stagnation streamline and both originate at the adjoint singularity at the trailing edge. The argument is extended to cover the fully compressible case, in subcritical flow conditions, by presenting an analytic solution that follows the same structure as the incompressible one.


title: Bayesian Federated Inference for regression models with heterogeneous multi-center populations

abstract: To estimate accurately the parameters of a regression model, the sample size must be large enough relative to the number of possible predictors for the model. In practice, sufficient data is often lacking, which can lead to overfitting of the model and, as a consequence, unreliable predictions of the outcome of new patients. Pooling data from different data sets collected in different (medical) centers would alleviate this problem, but is often not feasible due to privacy regulation or logistic problems. An alternative route would be to analyze the local data in the centers separately and combine the statistical inference results with the Bayesian Federated Inference (BFI) methodology. The aim of this approach is to compute from the inference results in separate centers what would have been found if the statistical analysis was performed on the combined data. We explain the methodology under homogeneity and heterogeneity across the populations in the separate centers, and give real life examples for better understanding. Excellent performance of the proposed methodology is shown. An R-package to do all the calculations has been developed and is illustrated in this paper. The mathematical details are given in the Appendix.


title: Positive and negative sampling strategies for self-supervised learning on audio-video data

abstract: In Self-Supervised Learning (SSL), Audio-Visual Correspondence (AVC) is a popular task to learn deep audio and video features from large unlabeled datasets. The key step in AVC is to randomly sample audio and video clips from the dataset and learn to minimize the feature distance between the positive pairs (corresponding audio-video pair) while maximizing the distance between the negative pairs (non-corresponding audio-video pairs). The learnt features are shown to be effective on various downstream tasks. However, these methods achieve subpar performance when the size of the dataset is rather small. In this paper, we investigate the effect of utilizing class label information in the AVC feature learning task. We modified various positive and negative data sampling techniques of SSL based on class label information to investigate the effect on the feature quality. We propose a new sampling approach which we call soft-positive sampling, where the positive pair for one audio sample is not from the exact corresponding video, but from a video of the same class. Experimental results suggest that when the dataset size is small in SSL setup, features learnt through the soft-positive sampling method significantly outperform those from the traditional SSL sampling approaches. This trend holds in both in-domain and out-of-domain downstream tasks, and even outperforms supervised classification. Finally, experiments show that class label information can easily be obtained using a publicly available classifier network and then can be used to boost the SSL performance without adding extra data annotation burden.


title: Forming localized dust concentrations in a dust ring: DM Tau case study

abstract: The previous, high angular resolution 225 GHz ($\sim$1.3 mm) continuum observations on the transitional disk DM Tau have resolved an outer ring at 20-120 au radii that is weakly azimuthally asymmetric. We aimed to examine dust growth and filtration in the outer ring. We performed the $\sim$0$''$.06 ($\sim$8.7 au) resolution Karl G. Jansky Very Large Array (JVLA) 40-48 GHz ($\sim$7 mm; Q band) continuum observations and the complementary observations at lower frequencies. In addition, we analyzed the archival JVLA observations that were taken since 2010. Intriguingly, the Q band image resolved the azimuthally highly asymmetric, knotty dust emission sources close to the inner edge of the outer ring. Fitting the 8-700 GHz spectral energy distribution (SED) with two dust components indicates that the maximum grain size in these knotty dust emission sources is likely $\gtrsim$300 $\mu$m while it is $\lesssim$50 $\mu$m in the rest of the ring. These results may be explained by trapping of inward migrating grown dust close to the ring inner edge. The exact mechanism for developing the azimuthal asymmetry has not yet been identified, which may be due to planet-disk interaction that might also be responsible for the creation of the dust cavity and pressure bump, or the fluid instabilities and vortex formation due to shear motions. Finally, we remark that the asymmetries in DM Tau are hard to diagnose from the $\gtrsim$225 GHz observations owing to a high optical depth at the ring. In other words, the apparent symmetric or asymmetric morphology of the transitional disks may be related to the optical depths of those disks at the observing frequency.


title: Revisiting the role of cosmic-ray driven Alfv\'en waves in pre-existing magnetohydrodynamic turbulence. I. Turbulent damping rates and feedback on background fluctuations

abstract: Alfv\'en waves (AWs) excited by the cosmic-ray (CR) streaming instability (CRSI) are a fundamental ingredient for CR confinement. The effectiveness of self-confinement relies on a balance between CRSI growth rate and damping mechanisms acting on quasi-parallel AWs excited by CRs. One relevant mechanism is the so-called turbulent damping, in which an AW packet injected in pre-existing turbulence undergoes a cascade process due to its nonlinear interaction with fluctuations of the background. The turbulent damping of an AW packet in pre-existing magnetohydrodynamic turbulence is re-examined, revised, and extended to include most-recent theories of MHD turbulence that account for dynamic alignment and reconnection-mediated regime. The case in which the role of feedback of CR-driven AWs on pre-existing turbulence is important will also be discussed. Particular attention is given to the nonlinearity parameter $\chi^w$ that estimates the strength of nonlinear interaction between CR-driven AWs and background fluctuations. We point out the difference between $\chi^w$ and $\chi^z$ that instead describes the strength of nonlinear interactions between pre-existing fluctuations. When $\chi^w$ is properly taken into account, one finds that (i) the turbulent damping rate of quasi-parallel AWs in anisotropic turbulence depends on the background-fluctuations' amplitude to the third power, hence is strongly suppressed, and (ii) the dependence on the AW's wavelength (and thus on the CR gyro-radius from which it is excited) is different from what has been previously obtained. Finally, (iii) when dynamic alignment of cascading fluctuations and the possibility of a reconnection-mediated range is included in the picture, the turbulent damping rate exhibits novel regimes and breaks. Finally, a criterion for CR-feedback is derived and simple phenomenological models of CR-modified turbulent scaling are provided.


title: The eXtended Virtual Element Method for elliptic problems with weakly singular solutions

abstract: This paper introduces a novel eXtended virtual element method, an extension of the conforming virtual element method. The XVEM is formulated by incorporating appropriate enrichment functions in the local spaces. The method is designed to handle highly generic enrichment functions, including singularities arising from fractured domains. By achieving consistency on the enrichment space, the method is proven to achieve arbitrary approximation orders even in the presence of singular solutions. The paper includes a complete convergence analysis under general assumptions on mesh regularity, and numerical experiments validating the method's accuracy on various mesh families, demonstrating optimal convergence rates in the $L^2$- and $H^1$-norms on fractured or L-shaped domains.


title: Hints of the $J^{PC}=0^{--}$ and $1^{--}$ $K^*\bar K_1(1270)$ Molecules in the $J/\psi\to\phi\eta\eta'$ Decay

abstract: The primary objective of this study is to investigate hadronic molecules of $K^*\bar K_1(1270)$ using a one-boson-exchange model, which incorporates exchanges of vector and pseudoscalar mesons in the $t$-channel, as well as the pion exchange in the $u$-channel. Additionally, careful consideration is given to the three-body effects resulting from the on-shell pion originating from $K_1(1270)\to K^*\pi$. Then the BESIII data of the $J/\psi\to\phi\eta\eta'$ process is fitted using the $K^*\bar K_1(1270)$ scattering amplitude with $J^{PC}=0^{--}$ or $1^{--}$. The analysis reveals that both the $J^{PC}=0^{--}$ and $1^{--}$ assumptions for $K^*\bar K_1(1270)$ scattering provide good descriptions of the data, with similar fit qualities. Notably, the parameters obtained from the best fits indicate the existence of $K^*\bar K_1(1270)$ bound states, denoted by $\phi(2100)$ and $\phi_0(2100)$ for the $1^{--}$ and $0^{--}$ states, respectively. The current experimental data, including the $\eta$ polar angular distribution, cannot distinguish which $K^*\bar K_1(1270)$ bound state contributes to the $J/\psi\to\phi\eta\eta'$ process, or if both are involved. Therefore, we propose further explorations of this process, as well as other processes, in upcoming experiments with many more $J/\psi$ events to disentangle the different possibilities.


title: Replication of Impedance Identification Experiments on a Reinforcement-Learning-Controlled Digital Twin of Human Elbows

abstract: This study presents a pioneering effort to replicate human neuromechanical experiments within a virtual environment utilising a digital human model. By employing MyoSuite, a state-of-the-art human motion simulation platform enhanced by Reinforcement Learning (RL), multiple types of impedance identification experiments of human elbow were replicated on a musculoskeletal model. We compared the elbow movement controlled by an RL agent with the motion of an actual human elbow in terms of the impedance identified in torque-perturbation experiments. The findings reveal that the RL agent exhibits higher elbow impedance to stabilise the target elbow motion under perturbation than a human does, likely due to its shorter reaction time and superior sensory capabilities. This study serves as a preliminary exploration into the potential of virtual environment simulations for neuromechanical research, offering an initial yet promising alternative to conventional experimental approaches. An RL-controlled digital twin with complete musculoskeletal models of the human body is expected to be useful in designing experiments and validating rehabilitation theory before experiments on real human subjects.


title: Variational discretizations of ideal magnetohydrodynamics in smooth regime using finite element exterior calculus

abstract: We propose a new class of finite element approximations to ideal compressible magnetohydrodynamic equations in smooth regime. Following variational approximations developed for fluid models in the last decade, our discretizations are built via a discrete variational principle mimicking the continuous Euler-Poincar\'e principle, and to further exploit the geometrical structure of the problem, vector fields are represented by their action as Lie derivatives on differential forms of any degree. The resulting semi-discrete approximations are shown to conserve the total mass, entropy and energy of the solutions for a wide class of finite element approximations. In addition, the divergence-free nature of the magnetic field is preserved in a pointwise sense and a time discretization is proposed, preserving those invariants and giving a reversible scheme at the fully discrete level. Numerical simulations are conducted to verify the accuracy of our approach and its ability to preserve the invariants for several test problems.


title: ViewFusion: Learning Composable Diffusion Models for Novel View Synthesis

abstract: Deep learning is providing a wealth of new approaches to the old problem of novel view synthesis, from Neural Radiance Field (NeRF) based approaches to end-to-end style architectures. Each approach offers specific strengths but also comes with specific limitations in their applicability. This work introduces ViewFusion, a state-of-the-art end-to-end generative approach to novel view synthesis with unparalleled flexibility. ViewFusion consists in simultaneously applying a diffusion denoising step to any number of input views of a scene, then combining the noise gradients obtained for each view with an (inferred) pixel-weighting mask, ensuring that for each region of the target scene only the most informative input views are taken into account. Our approach resolves several limitations of previous approaches by (1) being trainable and generalizing across multiple scenes and object classes, (2) adaptively taking in a variable number of pose-free views at both train and test time, (3) generating plausible views even in severely undetermined conditions (thanks to its generative nature) -- all while generating views of quality on par or even better than state-of-the-art methods. Limitations include not generating a 3D embedding of the scene, resulting in a relatively slow inference speed, and our method only being tested on the relatively small dataset NMR. Code is available.


title: Additive-multiplicative stochastic heat equations, stationary solutions, and Cauchy statistics

abstract: We study long-term behavior and stationary distributions for stochastic heat equations forced simultaneously by a multiplicative noise and an independent additive noise with the same distribution. We prove that nontrivial space-time translation-invariant measures exist for all values of the parameters. We also show that if the multiplicative noise is sufficiently strong, the invariant measure has Cauchy-distributed marginals. Using the same techniques, we prove a similar result on Cauchy-distributed marginals for a logarithmically attenuated version of the problem in two spatial dimensions. The proofs rely on stochastic analysis and elementary potential theory.


title: Transition to chaos and magnetic field generation in rotating Rayleigh-B\'enard convection

abstract: Hydrodynamic and magnetohydrodynamic convective attractors in three-dimensional rotating Rayleigh-B\'enard convection are studied numerically by varying the Taylor and Rayleigh numbers as control parameters. First, an analysis of hydrodynamic attractors and their bifurcations is conducted, where routes to chaos via quasiperiodicity are identified. Second, the behaviour of the magnetohydrodynamic system is investigated by introducing a seed magnetic field and measuring its growth or decay as a function of the Taylor number, while keeping the Rayleigh number fixed. Analysis of the attractors shows that rotation has a significant impact on magnetic field generation in Rayleigh-B\'enard convection, with the critical magnetic Prandtl number changing nonmonotonically with the rotation rate. It is argued that a nonhysteretic blowout bifurcation with on-off intermittency is responsible for the transitions to dynamo.

categories: physics.flu-dyn astro-ph.EP astro-ph.SR nlin.CD physics.plasm-ph


title: Digital Twin for Grey Box modeling of Multistory residential building thermal dynamics

abstract: Buildings energy efficiency is a widely researched topic, which is rapidly gaining popularity due to rising environmental concerns and the need for energy independence. In Northern Europe heating energy alone accounts for up to 70 percent of the total building energy consumption. Industry 4.0 technologies such as IoT, big data, cloud computing and machine learning, along with the creation of predictive and proactive digital twins, can help to reduce this number. However, buildings thermal dynamics is a very complex process that depends on many variables. As a result, commonly used physics-based white box models are time-consuming and require vast expertise. On the contrary, black box forecasting models, which rely primarily on building energy consumption data, lack fundamental insights and hinder re-use. In this study we propose an architecture to facilitate grey box modelling of building thermal dynamics while integrating real time IoT data with 3D representation of buildings. The architecture is validated in a case study creating a digital twin platform that enables users to define the thermal dynamics of buildings based on physical laws and real data, thus facilitating informed decision making for the best heating energy optimization strategy. Also, the created user interface enables stakeholders such as facility managers, energy providers or governing bodies to analyse, compare and evaluate buildings thermal dynamics without extensive expertise or time resources.


title: DS-MS-TCN: Otago Exercises Recognition with a Dual-Scale Multi-Stage Temporal Convolutional Network

abstract: The Otago Exercise Program (OEP) represents a crucial rehabilitation initiative tailored for older adults, aimed at enhancing balance and strength. Despite previous efforts utilizing wearable sensors for OEP recognition, existing studies have exhibited limitations in terms of accuracy and robustness. This study addresses these limitations by employing a single waist-mounted Inertial Measurement Unit (IMU) to recognize OEP exercises among community-dwelling older adults in their daily lives. A cohort of 36 older adults participated in laboratory settings, supplemented by an additional 7 older adults recruited for at-home assessments. The study proposes a Dual-Scale Multi-Stage Temporal Convolutional Network (DS-MS-TCN) designed for two-level sequence-to-sequence classification, incorporating them in one loss function. In the first stage, the model focuses on recognizing each repetition of the exercises (micro labels). Subsequent stages extend the recognition to encompass the complete range of exercises (macro labels). The DS-MS-TCN model surpasses existing state-of-the-art deep learning models, achieving f1-scores exceeding 80% and Intersection over Union (IoU) f1-scores surpassing 60% for all four exercises evaluated. Notably, the model outperforms the prior study utilizing the sliding window technique, eliminating the need for post-processing stages and window size tuning. To our knowledge, we are the first to present a novel perspective on enhancing Human Activity Recognition (HAR) systems through the recognition of each repetition of activities.


title: Inversion points of the accretion flows onto super-spinning Kerr attractors

abstract: We study the accretion flows towards a central Kerr super-spinning attractor, discussing the formation of the flow inversion points, defined by condition $u^{\phi}=0$ on the particles flow axial velocity. We locate two closed surfaces, defining \emph{inversion coronas} (spherical shells), surrounding the central attractor. The coronas analysis highlights observational aspects distinguishing the central attractors and providing indications on their spin and the orbiting fluids. The inversion corona is a closed region, generally of small extension and thickness, which is for the counter-rotating flows of the order of $\lesssim 1.4 M$ (central attractor mass) on the vertical rotational axis. There are no co-rotating inversion points (from co-rotating flows). The results point to strong signatures of the Kerr super-spinars, provided in both accretion and jet flows. With very narrow thickness, and varying little with the fluid initial conditions and the emission process details, inversion coronas can have remarkable observational significance for primordial Kerr super-spinars predicted by string theory. The corona region closest to the central attractor is the most observably recognizable and active part, distinguishing black holes solutions from super-spinars. Our analysis expounds the Lense--Thirring effects and repulsive gravity effects in the super-spinning ergoregions.


title: Nonlocal Diffusion Elliptic System Modelling The Behaviour Of a Bacteria And a Living Nutrient

abstract: In this paper, we discuss the existence and uniqueness of coexistence states for a class of non-local elliptic system. This problem models the behaviour of a bacteria and a living nutrient, whose diffusion depends on the population of the bacteria in a non-local and nonlinear way. Mainly, we employ bifurcation methods and the Implicit Function Theorem to obtain the existence and uniqueness of positive solution.


title: Machine learning based event reconstruction for the MUonE experiment

abstract: A proof-of-concept solution based on the machine learning techniques has been implemented and tested within the MUonE experiment designed to search for New Physics in the sector of anomalous magnetic moment of a muon. The results of the DNN based algorithm are comparable to the classical reconstruction, reducing enormously the execution time for the pattern recognition phase. The present implementation meets the conditions of classical reconstruction, providing an advantageous basis for further studies.


title: The feasibility of ultra-relativistic bubbles in SMEFT

abstract: A first order electroweak phase transition probes physics beyond the Standard Model on multiple frontiers and therefore is of immense interest for theoretical exploration. We conduct a model-independent study of the effects of relevant dimension 6 operators, of the Standard Model Effective Field Theory, on electroweak phase transition. We use a thermally corrected and renormalization group improved potential and study its impact on nucleation temperature. We then outline bubble dynamics that lead to ultra-relativistic bubble wall velocities which are mainly motivated from the viewpoint of gravitational wave detection. We highlight the ranges of the Wilson coefficients that give rise to such bubble wall velocities and predict gravitational wave spectra generated by such transitions which can be tested in future experiments. The low new physics scale necessitates the inclusion of dimension 8 contributions. We also quantify their impact on ultra-relativistic bubble wall dynamics.