title: Absolute frequency measurement of the 5s5p $^1P_1$ - 5s5d $^1D_2$ transition in strontium

abstract: We report on the absolute frequency determination of the 5s5p $^1P_1$ - 5s5d $^1D_2$ transition in atomic strontium, achieved through frequency comb-referenced laser-induced-fluorescence (LIF) spectroscopy. We excite the 5s$^2$ $^1S_0$ - 5s5p $^1P_1$ transition using an on-resonance laser at $\approx$461 nm, and then measure the variation in the LIF signal while scanning the laser at $\approx$767 nm across the 5s5p $^1P_1$ - 5s5d $^1D_2$ transition. We determine the absolute frequency of $390599571.7\pm0.4$ MHz, with an accuracy that surpasses the previous most accurate measurement by two orders of magnitude. This measurement technique can be readily applied for precision spectroscopy of high-lying states not only in strontium, but also in other atomic species.


title: SolderlessPCB: Reusing Electronic Components in PCB Prototyping through Detachable 3D Printed Housings

abstract: The iterative prototyping process for printed circuit boards (PCBs) frequently employs surface-mounted device (SMD) components, which are often discarded rather than reused due to the challenges associated with desoldering, leading to unnecessary electronic waste. This paper introduces SolderlessPCB, a collection of techniques for solder-free PCB prototyping, specifically designed to promote the recycling and reuse of electronic components. Central to this approach are custom 3D-printable housings that allow SMD components to be mounted onto PCBs without soldering. We detail the design of SolderlessPCB and the experiments conducted to evaluate its design parameters, electrical performance, and durability. To illustrate the potential for reusing SMD components with SolderlessPCB, we discuss two scenarios: the reuse of components from earlier design iterations and from obsolete prototypes. We also provide examples demonstrating that SolderlessPCB can handle high-current applications and is suitable for high-speed data transmission. The paper concludes by discussing the limitations of our approach and suggesting future directions to overcome these challenges.


title: Weak convergence of probability measures on hyperspaces with the upper Fell-topology

abstract: Let E be a locally compact second countable Hausdorff space and F the pertaining family of all closed sets. We endow F respectively with the Fell-topology, the upper Fell topology or the upper Vietoris-topology and investigate weak convergence of probability measures on the corresponding hyperspaces with a focus on the upper Fell topology. The results can be transferred to distributional convergence of random closed sets in E with applications to the asymptotic behavior of measurable selection.


title: Dimension-independent functional inequalities by tensorization and projection arguments

abstract: We study stability under tensorization and projection-type operations of gradient-type estimates and other functional inequalities for Markov semigroups on metric spaces. Using transportation-type inequalities obtained by F. Baudoin and N. Eldredge in 2021, we prove that constants in the gradient estimates can be chosen to be independent of the dimension. Our results are applicable to hypoelliptic diffusions on sub-Riemannian manifolds and some hypocoercive diffusions. As a byproduct, we obtain dimension-independent reverse Poincar\'{e}, reverse logarithmic Sobolev, and gradient bounds for Lie groups with a transverse symmetry and for non-isotropic Heisenberg groups.


title: On two algebras of token graphs

abstract: The $k$-token graph $F_k(G)$ of a graph $G$ is the graph whose vertices are the $k$-subsets of vertices from $G$, two of which being adjacent whenever their symmetric difference is a pair of adjacent vertices in $G$. In this article, we describe some properties of the Laplacian matrix $\L_k$ of $F_k(G)$ and the Laplacian matrix $\overline{\L}_k$ of the $k$-token graph $F_k(\overline{G})$ of its complement $\overline{G}$. In this context, a result about the commutativity of the matrices $\L_k$ and $\overline{\L}_k$ was given in [C. Dalf\'o, F. Duque, R. Fabila-Monroy, M. A. Fiol, C. Huemer, A. L. Trujillo-Negrete, and F. J. Zaragoza Mart\'{\i}nez, On the Laplacian spectra of token graphs, {\em Linear Algebra Appl.} {\bf 625} (2021) 322--348], but the proof was incomplete, and there were some typos. Here, we give the correct proof. Based on this result, and fixed the pair $(n,k)$ and the graph $G$, we first introduce a `local' algebra ${\cal L}(G)$, generated by the pair $(\L_k, \overline{\L}_k)$, showing its closed relationship with the Bose-Mesner algebra of the Johnson graphs $J(n,k)$. Finally, fixed only $(n,k)$, we present a `global' algebra ${\cal A}(n,k)$ that contains ${\cal L}(G)$ together with the Laplacian and adjacency matrices of the $k$-token graph of any graph $G$ on $n$ vertices.


title: Nonstandard Lagrangians and branched Hamiltonians: A brief review

abstract: Time and again, non-conventional forms of Lagrangians have found attention in the literature. For one thing, such Lagrangians have deep connections with several aspects of nonlinear dynamics including specifically the types of the Li\'{e}nard class; for another, very often the problem of their quantization opens up multiple branches of the corresponding Hamiltonians, ending up with the presence of singularities in the associated eigenfunctions. In this article, we furnish a brief review of the classical theory of such Lagrangians and the associated branched Hamiltonians, starting with the example of Li\'{e}nard-type systems. We then take up other cases where the Lagrangians depend upon the velocity with powers greater than two while still having a tractable mathematical structure, while also describing the associated branched Hamiltonians for such systems. For various examples, we emphasize upon the emergence of the notion of momentum-dependent mass in the theory of branched Hamiltonians.

categories: math-ph math.MP nlin.SI physics.class-ph quant-ph


title: Long-form factuality in large language models

abstract: Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate LongFact, a prompt set comprising thousands of questions spanning 38 topics. We then propose that LLM agents can be used as automated evaluators for long-form factuality through a method which we call Search-Augmented Factuality Evaluator (SAFE). SAFE utilizes an LLM to break down a long-form response into a set of individual facts and to evaluate the accuracy of each fact using a multi-step reasoning process comprising sending search queries to Google Search and determining whether a fact is supported by the search results. Furthermore, we propose extending F1 score as an aggregated metric for long-form factuality. To do so, we balance the percentage of supported facts in a response (precision) with the percentage of provided facts relative to a hyperparameter representing a user's preferred response length (recall). Empirically, we demonstrate that LLM agents can outperform crowdsourced human annotators - on a set of ~16k individual facts, SAFE agrees with crowdsourced human annotators 72% of the time, and on a random subset of 100 disagreement cases, SAFE wins 76% of the time. At the same time, SAFE is more than 20 times cheaper than human annotators. We also benchmark thirteen language models on LongFact across four model families (Gemini, GPT, Claude, and PaLM-2), finding that larger language models generally achieve better long-form factuality. LongFact, SAFE, and all experimental code are available at https://github.com/google-deepmind/long-form-factuality.


title: Projective Methods for Mitigating Gender Bias in Pre-trained Language Models

abstract: Mitigation of gender bias in NLP has a long history tied to debiasing static word embeddings. More recently, attention has shifted to debiasing pre-trained language models. We study to what extent the simplest projective debiasing methods, developed for word embeddings, can help when applied to BERT's internal representations. Projective methods are fast to implement, use a small number of saved parameters, and make no updates to the existing model parameters. We evaluate the efficacy of the methods in reducing both intrinsic bias, as measured by BERT's next sentence prediction task, and in mitigating observed bias in a downstream setting when fine-tuned. To this end, we also provide a critical analysis of a popular gender-bias assessment test for quantifying intrinsic bias, resulting in an enhanced test set and new bias measures. We find that projective methods can be effective at both intrinsic bias and downstream bias mitigation, but that the two outcomes are not necessarily correlated. This finding serves as a warning that intrinsic bias test sets, based either on language modeling tasks or next sentence prediction, should not be the only benchmark in developing a debiased language model.


title: Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation

abstract: The rise of Modular Deep Learning showcases its potential in various Natural Language Processing applications. Parameter-efficient fine-tuning (PEFT) modularity has been shown to work for various use cases, from domain adaptation to multilingual setups. However, all this work covers the case where the modular components are trained and deployed within one single Pre-trained Language Model (PLM). This model-specific setup is a substantial limitation on the very modularity that modular architectures are trying to achieve. We ask whether current modular approaches are transferable between models and whether we can transfer the modules from more robust and larger PLMs to smaller ones. In this work, we aim to fill this gap via a lens of Knowledge Distillation, commonly used for model compression, and present an extremely straightforward approach to transferring pre-trained, task-specific PEFT modules between same-family PLMs. Moreover, we propose a method that allows the transfer of modules between incompatible PLMs without any change in the inference complexity. The experiments on Named Entity Recognition, Natural Language Inference, and Paraphrase Identification tasks over multiple languages and PEFT methods showcase the initial potential of transferable modularity.


title: Using an invariant knot of a flow to find additional invariant structure

abstract: Consider a continuous flow in $\mathbb{R}^3$ or any orientable $3$-manifold. Let $(Q_1, Q_0)$ be an index pair in the sense of Conley and consider the region $N := \overline{Q_1 - Q_0}$. (An example of this is a compact $3$-manifold $N$ such that trajectories of the flow cross $\partial N$ inwards or outwards transversally, or bounce off it from the outside). Suppose we know there is an invariant knot or link $K$ in the interior of $N$. We prove the following: if $K$ is contractible and nontrivial (in the sense of knot theory) in $N$, then every neighbourhood $U$ of $K$ contains a point $p \in N - K$ such that the whole trajectory of $p$ is contained in $N$. In other words, the presence of $K$ forces the existence of additional invariant structure in $N$ (besides $K$), and the latter can actually be found arbitrarily close to $K$. To prove this result we develop a ``coloured'' handle theory which may be of independent interest to study flows in $3$-manifolds.


title: The socle of subshift algebras, with applications to subshift conjugacy

abstract: We introduce the concept of "irrational paths" for a given subshift and use it to characterize all minimal left ideals in the associated unital subshift algebra. Consequently, we characterize the socle as the sum of the ideals generated by irrational paths. Proceeding, we construct a graph such that the Leavitt path algebra of this graph is graded isomorphic to the socle. This realization allows us to show that the graded structure of the socle serves as an invariant for the conjugacy of Ott-Tomforde-Willis subshifts and for the isometric conjugacy of subshifts constructed with the product topology. Additionally, we establish that the socle of the unital subshift algebra is contained in the socle of the corresponding unital subshift C*-algebra.


title: ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimation

abstract: In the absence of parallax cues, a learning-based single image depth estimation (SIDE) model relies heavily on shading and contextual cues in the image. While this simplicity is attractive, it is necessary to train such models on large and varied datasets, which are difficult to capture. It has been shown that using embeddings from pre-trained foundational models, such as CLIP, improves zero shot transfer in several applications. Taking inspiration from this, in our paper we explore the use of global image priors generated from a pre-trained ViT model to provide more detailed contextual information. We argue that the embedding vector from a ViT model, pre-trained on a large dataset, captures greater relevant information for SIDE than the usual route of generating pseudo image captions, followed by CLIP based text embeddings. Based on this idea, we propose a new SIDE model using a diffusion backbone which is conditioned on ViT embeddings. Our proposed design establishes a new state-of-the-art (SOTA) for SIDE on NYUv2 dataset, achieving Abs Rel error of 0.059 (14% improvement) compared to 0.069 by the current SOTA (VPD). And on KITTI dataset, achieving Sq Rel error of 0.139 (2% improvement) compared to 0.142 by the current SOTA (GEDepth). For zero-shot transfer with a model trained on NYUv2, we report mean relative improvement of (20%, 23%, 81%, 25%) over NeWCRFs on (Sun-RGBD, iBims1, DIODE, HyperSim) datasets, compared to (16%, 18%, 45%, 9%) by ZoeDepth. The project page is available at https://ecodepth-iitd.github.io


title: Solid lines in axial algebras of Jordan type $\tfrac{1}{2}$ and Jordan algebras

abstract: We show that a primitive axial algebra of Jordan type $\eta = \tfrac{1}{2}$ is a Jordan algebra if and only if every $2$-generated subalgebra is \emph{solid}, a notion introduced recently by Ilya Gorshkov, Sergey Shpectorov and Alexei Staroletov. As a byproduct, we show that a subalgebra generated by axes $a,b$ is solid if and only if the associator $[L_a,L_b]$ is a derivation. Moreover, we show that $2$-generated subalgebras that are not solid contain precisely $3$ axes.


title: $L^\infty$-error bounds for approximations of the Koopman operator by kernel extended dynamic mode decomposition

abstract: Extended dynamic mode decomposition (EDMD) is a well-established method to generate a data-driven approximation of the Koopman operator for analysis and prediction of nonlinear dynamical systems. Recently, kernel EDMD (kEDMD) has gained popularity due to its ability to resolve the challenging task of choosing a suitable dictionary by defining data-based observables. In this paper, we provide the first pointwise bounds on the approximation error of kEDMD. The main idea consists of two steps. First, we show that the reproducing kernel Hilbert spaces of Wendland functions are invariant under the Koopman operator. Second, exploiting that the learning problem given by regression in the native norm can be recast as an interpolation problem, we prove our novel error bounds by using interpolation estimates. Finally, we validate our findings with numerical experiments.


title: LightningNet: Distributed Graph-based Cellular Network Performance Forecasting for the Edge

abstract: The cellular network plays a pivotal role in providing Internet access, since it is the only global-scale infrastructure with ubiquitous mobility support. To manage and maintain large-scale networks, mobile network operators require timely information, or even accurate performance forecasts. In this paper, we propose LightningNet, a lightweight and distributed graph-based framework for forecasting cellular network performance, which can capture spatio-temporal dependencies that arise in the network traffic. LightningNet achieves a steady performance increase over state-of-the-art forecasting techniques, while maintaining a similar resource usage profile. Our architecture ideology also excels in the respect that it is specifically designed to support IoT and edge devices, giving us an even greater step ahead of the current state-of-the-art, as indicated by our performance experiments with NVIDIA Jetson.


title: Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment

abstract: We introduce a novel task within the field of 3D dance generation, termed dance accompaniment, which necessitates the generation of responsive movements from a dance partner, the "follower", synchronized with the lead dancer's movements and the underlying musical rhythm. Unlike existing solo or group dance generation tasks, a duet dance scenario entails a heightened degree of interaction between the two participants, requiring delicate coordination in both pose and position. To support this task, we first build a large-scale and diverse duet interactive dance dataset, DD100, by recording about 117 minutes of professional dancers' performances. To address the challenges inherent in this task, we propose a GPT-based model, Duolando, which autoregressively predicts the subsequent tokenized motion conditioned on the coordinated information of the music, the leader's and the follower's movements. To further enhance the GPT's capabilities of generating stable results on unseen conditions (music and leader motions), we devise an off-policy reinforcement learning strategy that allows the model to explore viable trajectories from out-of-distribution samplings, guided by human-defined rewards. Based on the collected dataset and proposed method, we establish a benchmark with several carefully designed metrics.


title: On the Communication Complexity of Approximate Pattern Matching

abstract: The decades-old Pattern Matching with Edits problem, given a length-$n$ string $T$ (the text), a length-$m$ string $P$ (the pattern), and a positive integer $k$ (the threshold), asks to list all fragments of $T$ that are at edit distance at most $k$ from $P$. The one-way communication complexity of this problem is the minimum amount of space needed to encode the answer so that it can be retrieved without accessing the input strings $P$ and $T$. The closely related Pattern Matching with Mismatches problem (defined in terms of the Hamming distance instead of the edit distance) is already well understood from the communication complexity perspective: Clifford, Kociumaka, and Porat [SODA 2019] proved that $\Omega(n/m \cdot k \log(m/k))$ bits are necessary and $O(n/m \cdot k\log (m|\Sigma|/k))$ bits are sufficient; the upper bound allows encoding not only the occurrences of $P$ in $T$ with at most $k$ mismatches but also the substitutions needed to make each $k$-mismatch occurrence exact. Despite recent improvements in the running time [Charalampopoulos, Kociumaka, and Wellnitz; FOCS 2020 and 2022], the communication complexity of Pattern Matching with Edits remained unexplored, with a lower bound of $\Omega(n/m \cdot k\log(m/k))$ bits and an upper bound of $O(n/m \cdot k^3\log m)$ bits stemming from previous research. In this work, we prove an upper bound of $O(n/m \cdot k \log^2 m)$ bits, thus establishing the optimal communication complexity up to logarithmic factors. We also show that $O(n/m \cdot k \log m \log (m|\Sigma|))$ bits allow encoding, for each $k$-error occurrence of $P$ in $T$, the shortest sequence of edits needed to make the occurrence exact. We leverage the techniques behind our new result on the communication complexity to obtain quantum algorithms for Pattern Matching with Edits.


title: Equivalence Checking of Quantum Circuits by Model Counting

abstract: Verifying equivalence between two quantum circuits is a hard problem, that is nonetheless crucial in compiling and optimizing quantum algorithms for real-world devices. This paper gives a Turing reduction of the (universal) quantum circuits equivalence problem to weighted model counting (WMC). Our starting point is a folklore theorem showing that equivalence checking of quantum circuits can be done in the so-called Pauli-basis. We combine this insight with a WMC encoding of quantum circuit simulation, which we extend with support for the Toffoli gate. Finally, we prove that the weights computed by the model counter indeed realize the reduction. With an open-source implementation, we demonstrate that this novel approach can outperform a state-of-the-art equivalence-checking tool based on ZX calculus and decision diagrams.


title: Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

abstract: In this work, we introduce Mini-Gemini, a simple and effective framework enhancing multi-modality Vision Language Models (VLMs). Despite the advancements in VLMs facilitating basic visual dialog and reasoning, a performance gap persists compared to advanced models like GPT-4 and Gemini. We try to narrow the gap by mining the potential of VLMs for better performance and any-to-any workflow from three aspects, i.e., high-resolution visual tokens, high-quality data, and VLM-guided generation. To enhance visual tokens, we propose to utilize an additional visual encoder for high-resolution refinement without increasing the visual token count. We further construct a high-quality dataset that promotes precise image comprehension and reasoning-based generation, expanding the operational scope of current VLMs. In general, Mini-Gemini further mines the potential of VLMs and empowers current frameworks with image understanding, reasoning, and generation simultaneously. Mini-Gemini supports a series of dense and MoE Large Language Models (LLMs) from 2B to 34B. It is demonstrated to achieve leading performance in several zero-shot benchmarks and even surpasses the developed private models. Code and models are available at https://github.com/dvlab-research/MiniGemini.


title: A dynamical interpretation of the connection map of an attractor-repeller decomposition

abstract: In Conley index theory one may study an invariant set $S$ by decomposing it into an attractor $A$, a repeller $R$, and the orbits connecting the two. The Conley indices of $S$, $A$ and $R$ fit into an exact sequence where a certain connection homomorphism $\Gamma$ plays an important role. In this paper we provide a dynamical interpretation of this map. Roughly, $R$ "emits" an element of its Conley index as a "wavefront", part of which intersects the connecting orbits in $S$. This subset of the wavefront evolves towards $A$ and is then "received" by it to produce an element in its Conley index.


title: Garment3DGen: 3D Garment Stylization and Texture Generation

abstract: We introduce Garment3DGen a new method to synthesize 3D garment assets from a base mesh given a single input image as guidance. Our proposed approach allows users to generate 3D textured clothes based on both real and synthetic images, such as those generated by text prompts. The generated assets can be directly draped and simulated on human bodies. First, we leverage the recent progress of image to 3D diffusion methods to generate 3D garment geometries. However, since these geometries cannot be utilized directly for downstream tasks, we propose to use them as pseudo ground-truth and set up a mesh deformation optimization procedure that deforms a base template mesh to match the generated 3D target. Second, we introduce carefully designed losses that allow the input base mesh to freely deform towards the desired target, yet preserve mesh quality and topology such that they can be simulated. Finally, a texture estimation module generates high-fidelity texture maps that are globally and locally consistent and faithfully capture the input guidance, allowing us to render the generated 3D assets. With Garment3DGen users can generate the textured 3D garment of their choice without the need of artist intervention. One can provide a textual prompt describing the garment they desire to generate a simulation-ready 3D asset. We present a plethora of quantitative and qualitative comparisons on various assets both real and generated and provide use-cases of how one can generate simulation-ready 3D garments.


title: Signatures of electronic ordering in transport in graphene flat bands

abstract: Recently, a wide family of electronic orders was unveiled in graphene flat bands, such as spin- and valley-polarized phases as well as nematic momentum-polarized phases, stabilized by exchange interactions via a generalized Stoner mechanism. Momentum polarization involves orbital degrees of freedom and is therefore expected to impact resistivity in a way which is uniquely sensitive to the ordering type. Under pocket polarization, carrier distribution shifts in k space and samples the band mass in regions defined by the displaced momentum distribution. This makes transport coefficients sensitive to pocket polarization, resulting in the ohmic resistivity decreasing with temperature. In addition, it leads to current switching and hysteresis under strong E field. This behavior remains robust in the presence of electron-phonon scattering and is therefore expected to be generic.


title: ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion

abstract: Diffusion models have revolutionized image editing but often generate images that violate physical laws, particularly the effects of objects on the scene, e.g., occlusions, shadows, and reflections. By analyzing the limitations of self-supervised approaches, we propose a practical solution centered on a \q{counterfactual} dataset. Our method involves capturing a scene before and after removing a single object, while minimizing other changes. By fine-tuning a diffusion model on this dataset, we are able to not only remove objects but also their effects on the scene. However, we find that applying this approach for photorealistic object insertion requires an impractically large dataset. To tackle this challenge, we propose bootstrap supervision; leveraging our object removal model trained on a small counterfactual dataset, we synthetically expand this dataset considerably. Our approach significantly outperforms prior methods in photorealistic object removal and insertion, particularly at modeling the effects of objects on the scene.


title: Benchmarking Object Detectors with COCO: A New Path Forward

abstract: The Common Objects in Context (COCO) dataset has been instrumental in benchmarking object detectors over the past decade. Like every dataset, COCO contains subtle errors and imperfections stemming from its annotation procedure. With the advent of high-performing models, we ask whether these errors of COCO are hindering its utility in reliably benchmarking further progress. In search for an answer, we inspect thousands of masks from COCO (2017 version) and uncover different types of errors such as imprecise mask boundaries, non-exhaustively annotated instances, and mislabeled masks. Due to the prevalence of COCO, we choose to correct these errors to maintain continuity with prior research. We develop COCO-ReM (Refined Masks), a cleaner set of annotations with visibly better mask quality than COCO-2017. We evaluate fifty object detectors and find that models that predict visually sharper masks score higher on COCO-ReM, affirming that they were being incorrectly penalized due to errors in COCO-2017. Moreover, our models trained using COCO-ReM converge faster and score higher than their larger variants trained using COCO-2017, highlighting the importance of data quality in improving object detectors. With these findings, we advocate using COCO-ReM for future object detection research. Our dataset is available at https://cocorem.xyz


title: MetaCap: Meta-learning Priors from Multi-View Imagery for Sparse-view Human Performance Capture and Rendering

abstract: Faithful human performance capture and free-view rendering from sparse RGB observations is a long-standing problem in Vision and Graphics. The main challenges are the lack of observations and the inherent ambiguities of the setting, e.g. occlusions and depth ambiguity. As a result, radiance fields, which have shown great promise in capturing high-frequency appearance and geometry details in dense setups, perform poorly when na\"ively supervising them on sparse camera views, as the field simply overfits to the sparse-view inputs. To address this, we propose MetaCap, a method for efficient and high-quality geometry recovery and novel view synthesis given very sparse or even a single view of the human. Our key idea is to meta-learn the radiance field weights solely from potentially sparse multi-view videos, which can serve as a prior when fine-tuning them on sparse imagery depicting the human. This prior provides a good network weight initialization, thereby effectively addressing ambiguities in sparse-view capture. Due to the articulated structure of the human body and motion-induced surface deformations, learning such a prior is non-trivial. Therefore, we propose to meta-learn the field weights in a pose-canonicalized space, which reduces the spatial feature range and makes feature learning more effective. Consequently, one can fine-tune our field parameters to quickly generalize to unseen poses, novel illumination conditions as well as novel and sparse (even monocular) camera views. For evaluating our method under different scenarios, we collect a new dataset, WildDynaCap, which contains subjects captured in, both, a dense camera dome and in-the-wild sparse camera rigs, and demonstrate superior results compared to recent state-of-the-art methods on both public and WildDynaCap dataset.


title: Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark

abstract: We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic room data from multiple modalities. The dataset includes high-quality and densely captured room impulse response data paired with multi-view images, and precise 6DoF pose tracking data for sound emitters and listeners in the rooms. We used this dataset to evaluate existing methods for novel-view acoustic synthesis and impulse response generation which previously relied on synthetic data. In our evaluation, we thoroughly assessed existing audio and audio-visual models against multiple criteria and proposed settings to enhance their performance on real-world data. We also conducted experiments to investigate the impact of incorporating visual data (i.e., images and depth) into neural acoustic field models. Additionally, we demonstrated the effectiveness of a simple sim2real approach, where a model is pre-trained with simulated data and fine-tuned with sparse real-world data, resulting in significant improvements in the few-shot learning approach. RAF is the first dataset to provide densely captured room acoustic data, making it an ideal resource for researchers working on audio and audio-visual neural acoustic field modeling techniques. Demos and datasets are available on our project page: https://facebookresearch.github.io/real-acoustic-fields/


title: Enhancing Financial Data Visualization for Investment Decision-Making

abstract: Navigating the intricate landscape of financial markets requires adept forecasting of stock price movements. This paper delves into the potential of Long Short-Term Memory (LSTM) networks for predicting stock dynamics, with a focus on discerning nuanced rise and fall patterns. Leveraging a dataset from the New York Stock Exchange (NYSE), the study incorporates multiple features to enhance LSTM's capacity in capturing complex patterns. Visualization of key attributes, such as opening, closing, low, and high prices, aids in unraveling subtle distinctions crucial for comprehensive market understanding. The meticulously crafted LSTM input structure, inspired by established guidelines, incorporates both price and volume attributes over a 25-day time step, enabling the model to capture temporal intricacies. A comprehensive methodology, including hyperparameter tuning with Grid Search, Early Stopping, and Callback mechanisms, leads to a remarkable 53% improvement in predictive accuracy. The study concludes with insights into model robustness, contributions to financial forecasting literature, and a roadmap for real-time stock market prediction. The amalgamation of LSTM networks, strategic hyperparameter tuning, and informed feature selection presents a potent framework for advancing the accuracy of stock price predictions, contributing substantively to financial time series forecasting discourse.


title: Artificial Intelligence-based Analysis of Change in Public Finance between US and International Markets

abstract: Public finances are one of the fundamental mechanisms of economic governance that refer to the financial activities and decisions made by government entities to fund public services, projects, and operations through assets. In today's globalized landscape, even subtle shifts in one nation's public debt landscape can have significant impacts on that of international finances, necessitating a nuanced understanding of the correlations between international and national markets to help investors make informed investment decisions. Therefore, by leveraging the capabilities of artificial intelligence, this study utilizes neural networks to depict the correlations between US and International Public Finances and predict the changes in international public finances based on the changes in US public finances. With the neural network model achieving a commendable Mean Squared Error (MSE) value of 2.79, it is able to affirm a discernible correlation and also plot the effect of US market volatility on international markets. To further test the accuracy and significance of the model, an economic analysis was conducted that aimed to correlate the changes seen by the results of the model with historical stock market changes. This model demonstrates significant potential for investors to predict changes in international public finances based on signals from US markets, marking a significant stride in comprehending the intricacies of global public finances and the role of artificial intelligence in decoding its multifaceted patterns for practical forecasting.


title: Intuitive control of myoelectric prostheses with agonist-antagonist interface and magnetomicrometery: narrative review

abstract: Proprioception is crucial in intuitive control of prosthetic limbs and therefor contributes to intuitive prosthetic use. The agonist-antagonist myoneural interface (AMI) is an prosthetic innovation with enhanced control, reduced pain, and heightened proprioceptive sensation in clinical experiments. Furthermore, studies have addressed surgical techniques to make this myoelectric interface available to a larger group of patients. A narrative review on AMI developmental process, surgical implementations, and validation has been conducted for clinical and pre-clinical experimental research, embedded in a theoretical background on feedback control and proprioception. The closing chapter on magnetomicrometery serves to illustrate how motor control reading, as an example component, can benefit from technical innovations to enhance intuitive prosthetic control in AMI.


title: Numerical evaluation of code live-load models for estimating the forces caused by actual vehicles that act on bridge substructures

abstract: The present paper assesses the efficacy of code live-load models in accurately estimating the vehicular loads transferred to bridge substructures, such as abutments, piers, and foundations. Realistic traffic vehicle data are represented using four Weigh-in-Motion databases, which provide an authentic representation of vehicle information, thus providing a realistic basis for the examination of the bridges studied. The evaluation includes various bridge models, such as single-span girder bridges and two-, three-, and four-span continuous pinned-support girder bridges. By analyzing exceedance rates, the study compares the extreme force values obtained for vehicles in the databases with those predicted by selected code live-load models. These exceedance rates are presented in spectra format, as a function of the span length. The significant variations observed in the exceedance rates highlight the need for improving existing code live-load models to achieve more accurate estimations of the forces transferred to bridge substructures. Such improvements would lead to more uniform reliability levels for any limit state, such as resistance, fatigue, serviceability, and cracking.


title: SAM-dPCR: Real-Time and High-throughput Absolute Quantification of Biological Samples Using Zero-Shot Segment Anything Model

abstract: Digital PCR (dPCR) has revolutionized nucleic acid diagnostics by enabling absolute quantification of rare mutations and target sequences. However, current detection methodologies face challenges, as flow cytometers are costly and complex, while fluorescence imaging methods, relying on software or manual counting, are time-consuming and prone to errors. To address these limitations, we present SAM-dPCR, a novel self-supervised learning-based pipeline that enables real-time and high-throughput absolute quantification of biological samples. Leveraging the zero-shot SAM model, SAM-dPCR efficiently analyzes diverse microreactors with over 97.7% accuracy within a rapid processing time of 3.16 seconds. By utilizing commonly available lab fluorescence microscopes, SAM-dPCR facilitates the quantification of sample concentrations. The accuracy of SAM-dPCR is validated by the strong linear relationship observed between known and inferred sample concentrations. Additionally, SAM-dPCR demonstrates versatility through comprehensive verification using various samples and reactor morphologies. This accessible, cost-effective tool transcends the limitations of traditional detection methods or fully supervised AI models, marking the first application of SAM in nucleic acid detection or molecular diagnostics. By eliminating the need for annotated training data, SAM-dPCR holds great application potential for nucleic acid quantification in resource-limited settings.


title: Bridging Generative Networks with the Common Model of Cognition

abstract: This article presents a theoretical framework for adapting the Common Model of Cognition to large generative network models within the field of artificial intelligence. This can be accomplished by restructuring modules within the Common Model into shadow production systems that are peripheral to a central production system, which handles higher-level reasoning based on the shadow productions' output. Implementing this novel structure within the Common Model allows for a seamless connection between cognitive architectures and generative neural networks.


title: Partial Dynamical Systems of $L^p$-Spaces and their Stability Spaces

abstract: Using the convolution product and weak derivatives, we consider the partial dynamical systems of the locally convex $L^p(\Omega)$ spaces defined by the action of the smooth algebra $\mathscr{K}(\Omega)$ through its nets. Slice analysis is then employed to show that the Sobolev spaces $W^{k,p}(\Omega)$ are the stable states or space of these partial dynamical systems as limit spaces of the convolution actions of the smooth algebra $K(\Omega)$ on the Banach spaces $L^p(\Omega)$. Thus, the Sobolev spaces $W^{k,p}(\Omega)$ are closed subspaces of the $Lp(\Omega)$-spaces under convolution product and weak derivatives, with the weak derivative operators acting as equivariant maps of the slice spaces.


title: A Primer on Gibsonian Information

abstract: Across the scientific literature, information measurement in the nervous system is posed as a problem of information processing internal to the brain by constructs such as neuronal populations, sensory surprise, or cognitive models. Application of information theory in the nervous system has focused on measuring phenomena such as capacity and integration. Yet the ecological perspective suggests that information is a product of active perception and interactions with the environment. Here, we propose Gibsonian Information (GI), relevant to both the study of cognitive agents and single cell systems that exhibit cognitive behaviors. We propose a formal model of GI that characterizes how agents extract environmental information in a dynamic fashion. GI demonstrates how sensory information guides information processing within individual nervous system representations of motion and continuous multisensory integration, as well as representations that guide collective behaviors. GI is useful for understanding first-order sensory inputs in terms of agent interactions with naturalistic contexts and simple internal representations and can be extended to cybernetic or symbolic representations. Statistical affordances, or clustered information that is spatiotemporally dependent perceptual input, facilitate extraction of GI from the environment. As a quantitative accounting of perceptual information, GI provides a means to measure a generalized indicator of nervous system input and can be characterized by three scenarios: disjoint distributions, contingent action, and coherent movement. By applying this framework to a variety of specific contexts, including a four-channel model of multisensory embodiment, we demonstrate how GI is essential to understanding the full scope of cognitive information processing.


title: Cloudy with a Chance of Green: Measuring the Predictability of 18,009 Traffic Lights in Hamburg

abstract: Informing drivers about the predicted state of upcoming traffic lights is considered a key solution to reduce unneeded energy expenditure and dilemma zones at intersections. However, newer traffic lights can react to traffic demand, resulting in spontaneous switching behavior and poor predictability. To assess whether future traffic light assistance services are viable, it is crucial to understand how strongly predictability is affected by such spontaneous switching behavior. Previous studies have so far only reported percentages of adaptivity-capable traffic lights, but the actual switching behavior has not been measured. Addressing this research gap, we conduct a large-scale predictability evaluation based on 424 million recorded switching cycles over four weeks for 18,009 individual traffic lights in Hamburg. Two characteristics of predictability are studied: cycle discrepancy and wait time diversity. Results indicate that fewer traffic lights exhibit hard-to-predict switching behavior than suggested by previous work, considering a reported number of 90.7% adaptive traffic lights in Hamburg. Contrasting previous work, we find that not all traffic lights capable of adaptiveness may necessarily exhibit low predictability. We critically review these results and derive avenues for future research.


title: DeepTraderX: Challenging Conventional Trading Strategies with Deep Learning in Multi-Threaded Market Simulations

abstract: In this paper, we introduce DeepTraderX (DTX), a simple Deep Learning-based trader, and present results that demonstrate its performance in a multi-threaded market simulation. In a total of about 500 simulated market days, DTX has learned solely by watching the prices that other strategies produce. By doing this, it has successfully created a mapping from market data to quotes, either bid or ask orders, to place for an asset. Trained on historical Level-2 market data, i.e., the Limit Order Book (LOB) for specific tradable assets, DTX processes the market state $S$ at each timestep $T$ to determine a price $P$ for market orders. The market data used in both training and testing was generated from unique market schedules based on real historic stock market data. DTX was tested extensively against the best strategies in the literature, with its results validated by statistical analysis. Our findings underscore DTX's capability to rival, and in many instances, surpass, the performance of public-domain traders, including those that outclass human traders, emphasising the efficiency of simple models, as this is required to succeed in intricate multi-threaded simulations. This highlights the potential of leveraging "black-box" Deep Learning systems to create more efficient financial markets.


title: Rationale Dataset and Analysis for the Commit Messages of the Linux Kernel Out-of-Memory Killer

abstract: Code commit messages can contain useful information on why a developer has made a change. However, the presence and structure of rationale in real-world code commit messages is not well studied. Here, we detail the creation of a labelled dataset to analyze the code commit messages of the Linux Kernel Out-Of-Memory Killer component. We study aspects of rationale information, such as presence, temporal evolution, and structure. We find that 98.9% of commits in our dataset contain sentences with rationale information, and that experienced developers report rationale in about 60% of the sentences in their commits. We report on the challenges we faced and provide examples for our labelling.


title: A New Method for Sensorless Estimation of the Speed and Position in Brushed DC Motors Using Support Vector Machines

abstract: Currently, for many applications, it is necessary to know the speed and position of motors. This can be achieved using mechanical sensors coupled to the motor shaft or using sensorless techniques. The sensorless techniques in brushed dc motors can be classified into two types: 1) techniques based on the dynamic brushed dc motor model and 2) techniques based on the ripple component of the current. This paper presents a new method, based on the ripple component, for speed and position estimation in brushed dc motors, using support vector machines. The proposed method only measures the current and detects the pulses in this signal. The motor speed is estimated by using the inverse distance between the detected pulses, and the position is estimated by counting all detected pulses. The ability to detect ghost pulses and to discard false pulses is the main advantage of this method over other sensorless methods. The performed tests on two fractional horsepower brushed dc motors indicate that the method works correctly in a wide range of speeds and situations, in which the speed is constant or varies dynamically.


title: Cochain complexes over a functor

abstract: In this paper we propose unifying the categories of cochain complexes $\text{Ch}(\mathcal{C})$ and modules $\widehat{A}\text{-mod}$ over a repetitive algebra $\widehat{A}$. Motivated by their striking similarities and importance, we introduce a novel category encompassing both. Our analysis explores key properties of this unified category, highlighting its parallels and divergences from the original structures. We study whether it preserves crucial aspects like limits, colimits, products, coproducts, and abelianity. Besides, we establish a family of projective and injective indecomposable objects within this framework. Moving beyond theoretical foundations, we examine the influence and interaction over these novel categories of the category of endofunctors and its monoidal structure. Finally, we explore the implications of our constructions over representation theory of algebras and algebraic geometry.


title: Frog-Snake prey-predation Relationship Optimization (FSRO) : A novel nature-inspired metaheuristic algorithm for feature selection

abstract: Swarm intelligence algorithms have traditionally been designed for continuous optimization problems, and these algorithms have been modified and extended for application to discrete optimization problems. Notably, their application in feature selection for machine learning has demonstrated improvements in model accuracy, reduction of unnecessary data, and decreased computational time. This study proposes the Frog-Snake prey-predation Relationship Optimization (FSRO) algorithm, inspired by the prey-predation relationship between frogs and snakes for application to discrete optimization problems. The algorithm models three stages of a snake's foraging behavior "search", "approach", and "capture" as well as the frog's characteristic behavior of staying still to attract and then escaping. Furthermore, the introduction of the concept of evolutionary game theory enables dynamic control of the search process. The proposed algorithm conducts computational experiments on feature selection using 26 types of machine learning datasets to analyze its performance and identify improvements. In computer experiments, the proposed algorithm showed better performance than the comparison algorithms in terms of the best and standard deviation of fitness value and Accuracy. It was also proved that dynamic search control by evolutionary game theory is an effective method, and the proposed algorithm has the ability of a well-balanced search, achieving the two objectives of improving accuracy and reducing data.


title: Triangulated structure for Bondarenko's Categories

abstract: V. Bondarenko and Y. Drozd gives a description of all indecomposable objects in a category of representations of posets, nowadays known as the Bondarenko's category. This category was essential for V. Bekkert and H. Merklen classify all indecomposable objects of the derived category of gentle algebras. In view of this connection with the derived category, which possess a triangulated structure, and of the fact that in this paper we show that the Bondarenko's category is not an abelian category, it is reasonable to contemplate the existence of a triangulated structure for the Bondarenko's category. In this paper we introduce a triangulated category structure over a quotient of Bondarenko's category, which will allow to use the techniques of triangulated category to study representations of posets.


title: Repetitive Dilemma Games in Distribution Information Using Interplay of Droop Quota: Meek's Method in Impact of Maximum Compensation and Minimum Cost Routes in Information Role of Marginal Contribution in Two-Sided Matching Markets

abstract: This paper is a preliminary report of the research plan and a digest of the results and discussions. On research note explores the complex dynamics of fake news dissemination and fact-checking costs within the framework of information markets and analyzes the equilibrium between supply and demand using the concepts of droop quotas, Meek's method, and marginal contributions. By adopting a two-sided matching market perspective, we delve into scenarios in which markets are stable under the influence of fake news perceived as truth and those in which credibility prevails. Through the application of iterated dilemma game theory, we investigate the strategic choices of news providers affected by the costs associated with spreading fake news and fact-checking efforts. We further examine the maximum reward problem and strategies to minimize the cost path for spreading fake news, and consider a nuanced understanding of market segmentation into "cheap" and "premium" segments based on the nature of the information being spread. Our analysis uses mathematical models and computational processes to identify stable equilibrium points that ensure market stability in the face of deceptive information practices and provide insight into effective strategies to enhance the informational health of the market. Through this comprehensive approach, this paper aims for a more truthful and reliable perspective from which to observe information markets. This paper is partially an attempt to utilize "Generative AI" and was written with educational intent. There are currently no plans for it to become a peer-reviewed paper.

categories: econ.GN cs.GT econ.TH physics.soc-ph q-fin.EC


title: Unleashing the Power of AI. A Systematic Review of Cutting-Edge Techniques in AI-Enhanced Scientometrics, Webometrics, and Bibliometrics

abstract: Purpose: The study aims to analyze the synergy of Artificial Intelligence (AI), with scientometrics, webometrics, and bibliometrics to unlock and to emphasize the potential of the applications and benefits of AI algorithms in these fields. Design/methodology/approach: By conducting a systematic literature review, our aim is to explore the potential of AI in revolutionizing the methods used to measure and analyze scholarly communication, identify emerging research trends, and evaluate the impact of scientific publications. To achieve this, we implemented a comprehensive search strategy across reputable databases such as ProQuest, IEEE Explore, EBSCO, Web of Science, and Scopus. Our search encompassed articles published from January 1, 2000, to September 2022, resulting in a thorough review of 61 relevant articles. Findings: (i) Regarding scientometrics, the application of AI yields various distinct advantages, such as conducting analyses of publications, citations, research impact prediction, collaboration, research trend analysis, and knowledge mapping, in a more objective and reliable framework. (ii) In terms of webometrics, AI algorithms are able to enhance web crawling and data collection, web link analysis, web content analysis, social media analysis, web impact analysis, and recommender systems. (iii) Moreover, automation of data collection, analysis of citations, disambiguation of authors, analysis of co-authorship networks, assessment of research impact, text mining, and recommender systems are considered as the potential of AI integration in the field of bibliometrics. Originality/value: This study covers the particularly new benefits and potential of AI-enhanced scientometrics, webometrics, and bibliometrics to highlight the significant prospects of the synergy of this integration through AI.


title: Long Short-Term Memory Pattern Recognition in Currency Trading

abstract: This study delves into the analysis of financial markets through the lens of Wyckoff Phases, a framework devised by Richard D. Wyckoff in the early 20th century. Focusing on the accumulation pattern within the Wyckoff framework, the research explores the phases of trading range and secondary test, elucidating their significance in understanding market dynamics and identifying potential trading opportunities. By dissecting the intricacies of these phases, the study sheds light on the creation of liquidity through market structure, offering insights into how traders can leverage this knowledge to anticipate price movements and make informed decisions. The effective detection and analysis of Wyckoff patterns necessitate robust computational models capable of processing complex market data, with spatial data best analyzed using Convolutional Neural Networks (CNNs) and temporal data through Long Short-Term Memory (LSTM) models. The creation of training data involves the generation of swing points, representing significant market movements, and filler points, introducing noise and enhancing model generalization. Activation functions, such as the sigmoid function, play a crucial role in determining the output behavior of neural network models. The results of the study demonstrate the remarkable efficacy of deep learning models in detecting Wyckoff patterns within financial data, underscoring their potential for enhancing pattern recognition and analysis in financial markets. In conclusion, the study highlights the transformative potential of AI-driven approaches in financial analysis and trading strategies, with the integration of AI technologies shaping the future of trading and investment practices.


title: Feynman Diagrams as Computational Graphs

abstract: We propose a computational graph representation of high-order Feynman diagrams in Quantum Field Theory (QFT), applicable to any combination of spatial, temporal, momentum, and frequency domains. Utilizing the Dyson-Schwinger and parquet equations, our approach effectively organizes these diagrams into a fractal structure of tensor operations, significantly reducing computational redundancy. This approach not only streamlines the evaluation of complex diagrams but also facilitates an efficient implementation of the field-theoretic renormalization scheme, crucial for enhancing perturbative QFT calculations. Key to this advancement is the integration of Taylor-mode automatic differentiation, a key technique employed in machine learning packages to compute higher-order derivatives efficiently on computational graphs. To operationalize these concepts, we develop a Feynman diagram compiler that optimizes diagrams for various computational platforms, utilizing machine learning frameworks. Demonstrating this methodology's effectiveness, we apply it to the three-dimensional uniform electron gas problem, achieving unprecedented accuracy in calculating the quasiparticle effective mass at metal density. Our work demonstrates the synergy between QFT and machine learning, establishing a new avenue for applying AI techniques to complex quantum many-body problems.

categories: hep-th cond-mat.str-el cs.LG hep-ph physics.comp-ph


title: Minimal activation with maximal reach: Reachability clouds of bio-inspired slender manipulators

abstract: In the field of soft robotics, flexibility, adaptability, and functionality define a new era of robotic systems that can safely deform, reach, and grasp. To optimize the design of soft robotic systems, it is critical to understand their configuration space and full range of motion across a wide variety of design parameters. Here we integrate extreme mechanics and soft robotics to provide quantitative insights into the design of bio-inspired soft slender manipulators using the concept of reachability clouds. For a minimal three-actuator design inspired by the elephant trunk, we establish an efficient and robust reduced-order method to generate reachability clouds of almost half a million points each to visualize the accessible workspace of a wide variety of manipulator designs. We generate an atlas of 256 reachability clouds by systematically varying the key design parameters including the fiber count, revolution, tapering angle, and activation magnitude. Our results demonstrate that reachability clouds not only offer an immediately clear perspective into the inverse problem of control, but also introduce powerful metrics to characterize reachable volumes, unreachable regions, and actuator redundancy to quantify the performance of soft slender robots. Our study provides new insights into the design of soft robotic systems with minimal activation and maximal reach with potential applications in medical robotics, flexible manufacturing, and the autonomous exploration of space.


title: Formation of bound dineutrons in the ${}^{175}Lu (n, {}^2n) {}^{174g}Lu$ nuclear reaction and its cross section

abstract: The dineutron as a bound chargeless nucleus of two identical nucleons has been attracting attention for many decades. In addition to the study of the formation of a bound dineutron in the outgoing channel of some specific nuclear reactions, cross section estimates have been gaining interest as research target. We used a traditional neutron activation technique to irradiate Lu samples followed by measurements of the induced activity with HPGe spectrometer in order to detect gamma-peaks of the ${}^{175}Lu (n, 2n)^{174g}Lu$ reaction product when this reaction channel is not open for incident neutron energies. Based on two measurements of the instrumental gamma ray spectra of Lu samples we reliably identified the presence of the ${}^{174g}Lu$ isotope in the outgoing channel of the ${}^{175}Lu(n, {}^2n)^{174g}Lu$ nuclear reaction. Also, the cross section for this nuclear reaction was obtained and to be equal $33.5 \pm 5.9$ mb. For the first time, the dineutron as a nuclear reaction product was indirectly detected via statistically significant observation of the induced activity of ${}^{174g}Lu$ with corresponding cross-section estimate.


title: JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition

abstract: Visual Speech Recognition (VSR) tasks are generally recognized to have a lower theoretical performance ceiling than Automatic Speech Recognition (ASR), owing to the inherent limitations of conveying semantic information visually. To mitigate this challenge, this paper introduces an advanced knowledge distillation approach using a Joint-Embedding Predictive Architecture (JEPA), named JEP-KD, designed to more effectively utilize audio features during model training. Central to JEP-KD is the inclusion of a generative network within the embedding layer, which enhances the video encoder's capacity for semantic feature extraction and brings it into closer alignment with the audio features from a pre-trained ASR model's encoder. This approach aims to progressively reduce the performance gap between VSR and ASR. Moreover, a comprehensive multimodal, multistage training regimen for the JEP-KD framework is established, bolstering the robustness and efficacy of the training process. Experiment results demonstrate that JEP-KD significantly improves the performance of VSR models and demonstrates versatility across different VSR platforms, indicating its potential for broader application within other multimodal tasks.


title: Radiation Efficiency and Gain Bounds for Microstrip Patch Antennas

abstract: This paper presents radiation efficiency and gain bounds for microstrip patch antennas. The presented bounds are shown to be good predictors of antenna performance. Using the bounds, patch miniaturization techniques based on high permittivity substrates and geometrical shaping are compared. Further, a semi-analytic model is developed to approximate the bounds. Measurements are used to validate the bounds. Finally, maximum bandwidth of a microstrip patch antenna is linked to its maximum radiation efficiency.


title: On The Peer Review Reports: Does Size Matter?

abstract: Amidst the ever-expanding realm of scientific production and the proliferation of predatory journals, the focus on peer review remains paramount for scientometricians and sociologists of science. Despite this attention, there is a notable scarcity of empirical investigations into the tangible impact of peer review on publication quality. This study aims to address this gap by conducting a comprehensive analysis of how peer review contributes to the quality of scholarly publications, as measured by the citations they receive.Utilizing an adjusted dataset comprising 57,482 publications from Publons to Web of Science and employing the Raking Ratio method, our study reveals intriguing insights. Specifically, our findings shed light on a nuanced relationship between the length of reviewer reports and the subsequent citations received by publications. Through a robust regression analysis, we establish that, beginning from 947 words, the length of reviewer reports is significantly associated with an increase in citations.These results not only confirm the initial hypothesis that longer reports indicate requested improvements, thereby enhancing the quality and visibility of articles, but also underscore the importance of timely and comprehensive reviewer reports. Furthermore, insights from Publons' data suggest that open access to reports can influence reviewer behavior, encouraging more detailed reports.Beyond the scholarly landscape, our findings prompt a reevaluation of the role of reviewers, emphasizing the need to recognize and value this resource-intensive yet underappreciated activity in institutional evaluations. Additionally, the study sounds a cautionary note regarding the challenges faced by peer review in the context of an increasing volume of submissions, potentially compromising the vigilance of peers in swiftly assessing numerous articles.


title: The Blind Normalized Stein Variational Gradient Descent-Based Detection for Intelligent Massive Random Access

abstract: The lack of an efficient preamble detection algorithm remains a challenge for solving preamble collision problems in intelligent massive random access (RA) in practical communication scenarios. To solve this problem, we present a novel early preamble detection scheme based on a maximum likelihood estimation (MLE) model at the first step of the grant-based RA procedure. A novel blind normalized Stein variational gradient descent (SVGD)-based detector is proposed to obtain an approximate solution to the MLE model. First, by exploring the relationship between the Hadamard transform and wavelet transform, a new modified Hadamard transform (MHT) is developed to separate high-frequencies from important components using the second-order derivative filter. Next, to eliminate noise and mitigate the vanishing gradients problem in the SVGD-based detectors, the block MHT layer is designed based on the MHT, scaling layer, soft-thresholding layer, inverse MHT and sparsity penalty. Then, the blind normalized SVGD algorithm is derived to perform preamble detection without prior knowledge of noise power and the number of active devices. The experimental results show the proposed block MHT layer outperforms other transform-based methods in terms of computation costs and denoising performance. Furthermore, with the assistance of the block MHT layer, the proposed blind normalized SVGD algorithm achieves a higher preamble detection accuracy and throughput than other state-of-the-art detection methods.


title: Narrow, wide, and $\lambda$-wide regular subalgebras of semisimple Lie algebras

abstract: A subalgebra of a semisimple Lie algebra is wide if every simple module of the semisimple Lie algebra remains indecomposable when restricted to the subalgebra. From a finer viewpoint, a subalgebra is $\lambda$-wide if the simple module of a semisimple Lie algebra of highest weight $\lambda$ remains indecomposable when restricted to the subalgebra. A subalgebra is narrow if the restriction of all non-trivial simple modules to the subalgebra have proper decompositions. We determine necessary and sufficient conditions for regular subalgebras of semisimple Lie algebras to be $\lambda$-wide. As a natural consequence, we establish necessary and sufficient conditions for regular subalgebras to be wide, a result which has already been established by Panyushev for essentially all regular solvable subalgebras. Next, we show that establishing whether or not a regular subalgebra of a simple Lie algebra is wide does not require consideration of all simple modules. It is necessary and sufficient to only consider the adjoint representation. Finally, we show that a regular subalgebra of the special linear algebra $\mathfrak{sl}_{n+1}$ is either narrow or wide; this property does not hold for non-regular subalgebras of $\mathfrak{sl}_{n+1}$.


title: Category of a map and nonlinear analysis

abstract: A classic problem in analysis is to solve nonlinear equations of the form \begin{equation*} F(x)=0, \end{equation*} where $F:D^n\to \mathbb{R}^m$ is a continuous map of the closed unit disk $D^n\subset\mathbb{R}^n$ in $\mathbb{R}^m$. A topological technique, which exists in the literature, for the existence of solutions of nonlinear equations is the topological degree theory. In this work, we will use the category of a map theory to solve the problem of existence of solutions of nonlinear equations. This theory, as we will show in this work, provides an alternative topological technique to study nonlinear equations.


title: Options for Managing Spent TRi-structural ISOtropic Nuclear Fuel

abstract: During the past few decades, there has been a renewed interest in advanced reactor concepts, especially the high-temperature gas-cooled and the molten salt-cooled technologies for energy production as well as hydrogen or process heat generation. Tri-structural isotropic fuel is intended to be used in some of these emerging reactor technologies. The fuel bearing TRISO particles are encapsulated in graphite, which acts in the capacity of a moderator. TRISO based fuels can be fabricated in the form of spherical pebbles or cylindrical compacts, the latter of which are then loaded into prismatic graphite blocks.


title: Are Colors Quanta of Light for Human Vision? A Quantum Cognition Study of Visual Perception

abstract: We study the phenomenon of categorical perception within the quantum measurement process. The mechanism underlying this phenomenon consists in dilating stimuli being perceived to belong to different categories and contracting stimuli being perceived to belong to the same category. We show that, due to the naturally different way in determining the distance between pure states compared to the distance between density states, the phenomenon of categorical perception is rooted in the structure of the quantum measurement process itself. We apply our findings to the situation of visual perception of colors and argue that it is possible to consider colors as light quanta for human visual perception in a similar way as photons are light quanta for physical measurements of light frequencies. In our approach we see perception as a complex encounter between the existing physical reality, the stimuli, and the reality expected by the perciever, resulting in the experience of the percepts. We investigate what that means for the situation of two colors, which we call Light and Dark, given our findings on categorical perception within the quantum measurement process.


title: Australian Energy Market Operator National Electricity Market Network Optimal Power Flow Modelling

abstract: The HELM algorithm was used in this project to solve the optimal power flow problem introduced by a radial PandaPower network formulated from the data given by AEMO on the NEM network. Large losses were observed in the transmission infrastructure surrounding base-load power plants. These losses were not observed in areas that had a higher percentage of renewable power generation. Furthermore, the voltage levels present at the Hydro and Wind farms across Tasmania and South Australia were found to be stable in their steady state. A distributed network of renewable infrastructure is then proposed as a solution to the issues facing the NEM network.


title: Universal Coverings for Limit and Pseudotopological Spaces

abstract: Limit and Pseudotopological spaces are two generalizations of topological spaces which are defined by indicating what filters converge under some axioms. In this article, we introduce covering spaces and set forth some necessary conditions for a construction for a universal covering space.


title: Spatio-seasonal risk assessment of upward lightning at tall objects using meteorological reanalysis data

abstract: This study investigates lightning at tall objects and evaluates the risk of upward lightning (UL) over the eastern Alps and its surrounding areas. While uncommon, UL poses a threat, especially to wind turbines, as the long-duration current of UL can cause significant damage. Current risk assessment methods overlook the impact of meteorological conditions, potentially underestimating UL risks. Therefore, this study employs random forests, a machine learning technique, to analyze the relationship between UL measured at Gaisberg Tower (Austria) and $35$ larger-scale meteorological variables. Of these, the larger-scale upward velocity, wind speed and direction at 10 meters and cloud physics variables contribute most information. The random forests predict the risk of UL across the study area at a 1 km$^2$ resolution. Strong near-surface winds combined with upward deflection by elevated terrain increase UL risk. The diurnal cycle of the UL risk as well as high-risk areas shift seasonally. They are concentrated north/northeast of the Alps in winter due to prevailing northerly winds, and expanding southward, impacting northern Italy in the transitional and summer months. The model performs best in winter, with the highest predicted UL risk coinciding with observed peaks in measured lightning at tall objects. The highest concentration is north of the Alps, where most wind turbines are located, leading to an increase in overall lightning activity. Comprehensive meteorological information is essential for UL risk assessment, as lightning densities are a poor indicator of lightning at tall objects.


title: Homogenization and continuum limit of mechanical metamaterials

abstract: When used in bulk applications, mechanical metamaterials set forth a multiscale problem with many orders of magnitude in scale separation between the micro and macro scales. However, mechanical metamaterials fall outside conventional homogenization theory on account of the flexural, or bending, response of their members, including torsion. We show that homogenization theory, based on calculus of variations and notions of Gamma-convergence, can be extended to account for bending. The resulting homogenized metamaterials exhibit intrinsic generalized elasticity in the continuum limit. We illustrate these properties in specific examples including two-dimensional honeycomb and three-dimensional octet-truss metamaterials.


title: Directed Criteria Citation Recommendation and Ranking Through Link Prediction

abstract: We explore link prediction as a proxy for automatically surfacing documents from existing literature that might be topically or contextually relevant to a new document. Our model uses transformer-based graph embeddings to encode the meaning of each document, presented as a node within a citation network. We show that the semantic representations that our model generates can outperform other content-based methods in recommendation and ranking tasks. This provides a holistic approach to exploring citation graphs in domains where it is critical that these documents properly cite each other, so as to minimize the possibility of any inconsistencies


title: Charge de travail du personnel infirmier dans les h{\^o}pitaux -{\'e}tude bibliographique

abstract: For decades, hospital services have been faced with the challenge of ensuring quality care for patients despite the pressures on staff due to workload overload. Nursing staff are particularly affected by this reality, with a patient/nursing staff ratio so imbalanced that it directly affects the quality of care and the well-being of nurses. This article examines in detail the workload of nursing staff, shedding light on the various factors influencing this workload, including the type of care provided, the characteristics of patients and nursing staff, as well as the organizational context. Furthermore, different methods of calculating and estimating workload are analyzed, ranging from workload calculation systems to advanced predictive models. Finally, reflection is made on future research avenues, particularly concerning the identification of factors influencing workload, data collection and processing, and model validation.


title: The Negative Participation Paradox in Three-Candidate Instant Runoff Elections

abstract: In this paper, we provide theoretical and empirical estimates for the likelihood of a negative participation paradox under instant runoff voting in three-candidate elections. We determine the probability of the paradox and related conditional probabilities based on the impartial anonymous culture and impartial culture models for both complete and partial ballots. We compare these results to the empirical likelihood of a negative participation paradox occurring under instant runoff voting in a large database of voter profiles which have been reduced to three candidates. Lastly, we analyze the relative likelihood of this paradox in comparison to other well-known paradoxes.


title: Corrigendum to "A New Uniqueness Theorem for the Tight C*-algebra of an Inverse Semigroup" [C. R. Math. Acad. Sci. Soc. R. Can. 44 (2022), no. 4, 88--112]

abstract: We correct the proof of Theorem 4.1 from [C. R. Math. Acad. Sci. Soc. R. Can. \textbf{44} (2022), no. 4, 88--112].


title: Possible counter-intuitive impact of local vaccine mandates for vaccine-preventable infectious diseases

abstract: We model the impact of local vaccine mandates on the spread of vaccine-preventable infectious diseases, which in the absence of vaccines will mainly affect children. Examples of such diseases are measles, rubella, mumps and pertussis. To model the spread of the pathogen, we use a stochastic SIR (Susceptible, Infectious, Recovered) model with two levels of mixing in a closed population, often referred to as the household model. In this model individuals make local contacts within a specific small subgroup of the population (e.g.\ within a household or a school class), while they also make global contacts with random people in the population at a much lower rate than the rate of local contacts. We consider what happens if schools are given freedom to impose vaccine mandates on all of their pupils, except for the pupils that are exempt from vaccination because of medical reasons. We investigate how such a mandate affects the probability of an outbreak of a disease and the probability that a pupil that is medically exempt from vaccination, gets infected during an outbreak. We show that if the population vaccine coverage is close to the herd-immunity level then both probabilities may increase if local vaccine mandates are implemented. This is caused by unvaccinated pupils moving to schools without mandates.


title: On the viscosity linearization method without compactness

abstract: Savin's small perturbation approach has had far reaching applications in the theory of non-linear elliptic and parabolic PDE. In this short note, we revisit his seminal proof of De-Giorgi's improvement of flatness theorem for minimal surfaces and provide an approach based on the Harnack inequality that avoids the use of compactness arguments.


title: Transportation and Systems Analysis Collaborations in Support of a Federal Consolidated Interim Storage Facility

abstract: The Integrated Waste Management program under the Office of Nuclear Energy is planning for the future transportation, storage, and eventual disposal of spent nuclear fuel and high-level radioactive waste from nuclear power plant and waste custodian sites across the United States. To better enable informed decision-making regarding the back end of the nuclear fuel cycle, the IWM program has been sponsoring the development and application of system analysis tools capable of analyzing various options for managing SNF and HLW. With these tools, integrated waste management system architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle i.e., transportation, storage, and disposal. System analyses and assessments typically use these modeling and simulation tools to investigate implications of changes in various assumptions and parameters such as acceptance rates, receipt logic, facility capacities and capabilities, use of standardized canisters, start and stop dates of facilities, etc.


title: Structural Brain Connectivity and Treatment Improvement in Mood Disorder

abstract: Background: The treatment of depressive episodes is well established, with clearly demonstrated effectiveness of antidepressants and psychotherapies. However, more than one-third of depressed patients do not respond to treatment. Identifying the brain structural basis of treatment-resistant depression could prevent useless pharmacological prescriptions,adverse events, and lost therapeutic opportunities.Methods: Using diffusion magnetic resonance imaging, we performed structural connectivity analyses on a cohort of 154 patients with mood disorder (MD) -- and 77 sex- and age-matched healthy control (HC) participants. To assess illness improvement, the MD patients went through two clinical interviews at baseline and at 6-month follow-up and were classified based on the Clinical Global Impression-Improvement score into improved or not-improved. First, the threshold-free network-based statistics was conducted to measure the differences in regional network architecture. Second, nonparametric permutations tests were performed on topological metrics based on graph theory to examine differences in connectome organization. Results: The threshold-free network-based statistics revealed impaired connections involvingregions of the basal ganglia in MD patients compared to HC. Significant increase of local efficiency and clustering coefficient was found in the lingual gyrus, insula and amygdala in the MD group. Compared with the not-improved, the improved displayed significantly reduced network integration and segregation, predominately in the default-mode regions, including the precuneus, middle temporal lobe and rostral anterior cingulate.Conclusions: This study highlights the involvement of regions belonging to the basal ganglia, the fronto-limbic network and the default mode network, leading to a better understanding of MD disease and its unfavorable outcome.


title: Investigating the Relationship between Simulation Parameters and Flow Variables in Simulating Atmospheric Gravity Waves in Wind Energy Applications

abstract: Wind farms, particularly offshore clusters, are becoming larger than ever before. Besides influencing wind farms and local meteorology downstream, large wind farms can trigger atmospheric gravity waves in the inversion layer and the free atmosphere aloft. Wind farm-induced gravity waves can cause adverse pressure gradients upstream of the wind farm, that contribute to the global blockage effect, and favorable pressure gradients above and downstream of the wind farm that enhance wake recovery. Numerical modeling is a powerful means of studying wind farm-induced atmospheric gravity waves, but it comes with the challenge of handling spurious reflections of these waves from domain boundaries. Approaches like radiation boundary conditions and forcing zones are used to avoid the reflections. However, the simulation setup heavily relies on ad-hoc processes. For instance, the widely used Rayleigh damping method requires ad-hoc tuning to acquire a setup only applicable to a particular case. To surmount this hurdle, we conduct a systematic LES study for flow over a 2D hill and through wind farm canopies that explores the dependence of domain size and damping layer setup on parameters driving linearly stratified atmospheric flows. Mainly the internal waves in the free atmosphere reflect from the boundaries, therefore by simulation linearly stratified conditions we focus on internal waves only. The Froude number drives most of the internal wave properties, such as wavelengths, amplitude, and direction. Therefore, the domain sizing and Rayleigh damping layer setup mainly depends on the Froude number. We anticipated the effective wavelengths to be the correct length scale to size the domain and damping layer thickness. Also, the damping coefficient is scaled with Brunt-V\"ais\"al\"a frequency.


title: Interpretable Machine Learning for Weather and Climate Prediction: A Survey

abstract: Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede user trust and hinder further model improvements. As such, interpretable machine learning techniques have become crucial in enhancing the credibility and utility of weather and climate modeling. In this survey, we review current interpretable machine learning approaches applied to meteorological predictions. We categorize methods into two major paradigms: 1) Post-hoc interpretability techniques that explain pre-trained models, such as perturbation-based, game theory based, and gradient-based attribution methods. 2) Designing inherently interpretable models from scratch using architectures like tree ensembles and explainable neural networks. We summarize how each technique provides insights into the predictions, uncovering novel meteorological relationships captured by machine learning. Lastly, we discuss research challenges around achieving deeper mechanistic interpretations aligned with physical principles, developing standardized evaluation benchmarks, integrating interpretability into iterative model development workflows, and providing explainability for large foundation models.


title: Sobolev space theory for Poisson's equation in non-smooth domains via superharmonic functions and Hardy's inequality

abstract: We introduce a general $L_p$-solvability result for the Poisson equation in non-smooth domains $\Omega\subset \mathbb{R}^d$, with the zero Dirichlet boundary condition. Our sole assumption for the domain $\Omega$ is the Hardy inequality: There exists a constant $N>0$ such that $$ \int_{\Omega}\Big|\frac{f(x)}{d(x,\partial\Omega)}\Big|^2\mathrm{d}\,x\leq N\int_{\Omega}|\nabla f|^2 \mathrm{d}\,x\quad\text{for any}\quad f\in C_c^{\infty}(\Omega)\,. $$ To describe the boundary behavior of solutions in a general framework, we propose a weight system composed of a superharmonic function and the distance function to the boundary. Additionally, we explore applications across a variety of non-smooth domains, including convex domains, domains with exterior cone condition, totally vanishing exterior Reifenberg domains, and domains $\Omega\subset\mathbb{R}^d$ for which the Aikawa dimension of $\Omega^c$ is less than $d-2$. Using superharmonic functions tailored to the geometric conditions of the domain, we derive weighted $L_p$-solvability results for various non-smooth domains and specific weight ranges that differ for each domain condition. Furthermore, we provide an application for the H\"older continuity of solutions.


title: Graph Bayesian Optimization for Multiplex Influence Maximization

abstract: Influence maximization (IM) is the problem of identifying a limited number of initial influential users within a social network to maximize the number of influenced users. However, previous research has mostly focused on individual information propagation, neglecting the simultaneous and interactive dissemination of multiple information items. In reality, when users encounter a piece of information, such as a smartphone product, they often associate it with related products in their minds, such as earphones or computers from the same brand. Additionally, information platforms frequently recommend related content to users, amplifying this cascading effect and leading to multiplex influence diffusion. This paper first formulates the Multiplex Influence Maximization (Multi-IM) problem using multiplex diffusion models with an information association mechanism. In this problem, the seed set is a combination of influential users and information. To effectively manage the combinatorial complexity, we propose Graph Bayesian Optimization for Multi-IM (GBIM). The multiplex diffusion process is thoroughly investigated using a highly effective global kernelized attention message-passing module. This module, in conjunction with Bayesian linear regression (BLR), produces a scalable surrogate model. A data acquisition module incorporating the exploration-exploitation trade-off is developed to optimize the seed set further. Extensive experiments on synthetic and real-world datasets have proven our proposed framework effective. The code is available at https://github.com/zirui-yuan/GBIM.


title: Synchronization dynamics of phase oscillators on power grid models

abstract: We investigate topological and spectral properties of models of European and US-American power grids and of paradigmatic network models as well as their implications for the synchronization dynamics of phase oscillators with heterogeneous natural frequencies. We employ the complex-valued order parameter --~a widely-used indicator for phase ordering~-- to assess the synchronization dynamics and observe the order parameter to exhibit either constant or periodic or non-periodic, possibly chaotic temporal evolutions for a given coupling strength but depending on initial conditions and the systems' disorder. Interestingly, both topological and spectral characteristics of the power grids point to a diminished capability of these networks to support a temporarily stable synchronization dynamics. We find non-trivial commonalities between the synchronization dynamics of oscillators on seemingly opposing topologies.


title: A recommender network perspective on the informational value of critics and crowds

abstract: How do the ratings of critics and amateurs compare and how should they be combined? Previous research has produced mixed results about the first question, while the second remains unanswered. We have created a new, unique dataset, with wine ratings from critics and amateurs, and simulated a recommender system using the k-nearest-neighbor algorithm. We then formalized the advice seeking network spanned by that algorithm and studied people's relative influence. We find that critics are more consistent than amateurs, and thus their advice is more predictive than advice from amateurs. Getting advice from both groups can further boost performance. Our network theoretic approach allows us to identify influential critics, talented amateurs, and the information flow between groups. Our results provide evidence about the informational function of critics, while our framework is broadly applicable and can be leveraged to devise good decision strategies and more transparent recommender systems.


title: Efficient Unsupervised Community Search with Pre-trained Graph Transformer

abstract: Community search has aroused widespread interest in the past decades. Among existing solutions, the learning-based models exhibit outstanding performance in terms of accuracy by leveraging labels to 1) train the model for community score learning, and 2) select the optimal threshold for community identification. However, labeled data are not always available in real-world scenarios. To address this notable limitation of learning-based models, we propose a pre-trained graph Transformer based community search framework that uses Zero label (i.e., unsupervised), termed TransZero. TransZero has two key phases, i.e., the offline pre-training phase and the online search phase. Specifically, in the offline pretraining phase, we design an efficient and effective community search graph transformer (CSGphormer) to learn node representation. To pre-train CSGphormer without the usage of labels, we introduce two self-supervised losses, i.e., personalization loss and link loss, motivated by the inherent uniqueness of node and graph topology, respectively. In the online search phase, with the representation learned by the pre-trained CSGphormer, we compute the community score without using labels by measuring the similarity of representations between the query nodes and the nodes in the graph. To free the framework from the usage of a label-based threshold, we define a new function named expected score gain to guide the community identification process. Furthermore, we propose two efficient and effective algorithms for the community identification process that run without the usage of labels. Extensive experiments over 10 public datasets illustrate the superior performance of TransZero regarding both accuracy and efficiency.


title: SugarcaneNet2024: An Optimized Weighted Average Ensemble Approach of LASSO Regularized Pre-trained Models for Sugarcane Disease Classification

abstract: Sugarcane, a key crop for the world's sugar industry, is prone to several diseases that have a substantial negative influence on both its yield and quality. To effectively manage and implement preventative initiatives, diseases must be detected promptly and accurately. In this study, we present a unique model called sugarcaneNet2024 that outperforms previous methods for automatically and quickly detecting sugarcane disease through leaf image processing. Our proposed model consolidates an optimized weighted average ensemble of seven customized and LASSO-regularized pre-trained models, particularly InceptionV3, InceptionResNetV2, DenseNet201, DenseNet169, Xception, and ResNet152V2. Initially, we added three more dense layers with 0.0001 LASSO regularization, three 30% dropout layers, and three batch normalizations with renorm enabled at the bottom of these pre-trained models to improve the performance. The accuracy of sugarcane leaf disease classification was greatly increased by this addition. Following this, several comparative studies between the average ensemble and individual models were carried out, indicating that the ensemble technique performed better. The average ensemble of all modified pre-trained models produced outstanding outcomes: 100%, 99%, 99%, and 99.45% for f1 score, precision, recall, and accuracy, respectively. Performance was further enhanced by the implementation of an optimized weighted average ensemble technique incorporated with grid search. This optimized sugarcaneNet2024 model performed the best for detecting sugarcane diseases, having achieved accuracy, precision, recall, and F1 score of 99.67%, 100%, 100%, and 100% , respectively.


title: Clinical Domain Knowledge-Derived Template Improves Post Hoc AI Explanations in Pneumothorax Classification

abstract: Background: Pneumothorax is an acute thoracic disease caused by abnormal air collection between the lungs and chest wall. To address the opaqueness often associated with deep learning (DL) models, explainable artificial intelligence (XAI) methods have been introduced to outline regions related to pneumothorax diagnoses made by DL models. However, these explanations sometimes diverge from actual lesion areas, highlighting the need for further improvement. Method: We propose a template-guided approach to incorporate the clinical knowledge of pneumothorax into model explanations generated by XAI methods, thereby enhancing the quality of these explanations. Utilizing one lesion delineation created by radiologists, our approach first generates a template that represents potential areas of pneumothorax occurrence. This template is then superimposed on model explanations to filter out extraneous explanations that fall outside the template's boundaries. To validate its efficacy, we carried out a comparative analysis of three XAI methods with and without our template guidance when explaining two DL models in two real-world datasets. Results: The proposed approach consistently improved baseline XAI methods across twelve benchmark scenarios built on three XAI methods, two DL models, and two datasets. The average incremental percentages, calculated by the performance improvements over the baseline performance, were 97.8% in Intersection over Union (IoU) and 94.1% in Dice Similarity Coefficient (DSC) when comparing model explanations and ground-truth lesion areas. Conclusions: In the context of pneumothorax diagnoses, we proposed a template-guided approach for improving AI explanations. We anticipate that our template guidance will forge a fresh approach to elucidating AI models by integrating clinical domain expertise.


title: Targeted Visualization of the Backbone of Encoder LLMs

abstract: Attention based Large Language Models (LLMs) are the state-of-the-art in natural language processing (NLP). The two most common architectures are encoders such as BERT, and decoders like the GPT models. Despite the success of encoder models, on which we focus in this work, they also bear several risks, including issues with bias or their susceptibility for adversarial attacks, signifying the necessity for explainable AI to detect such issues. While there does exist various local explainability methods focusing on the prediction of single inputs, global methods based on dimensionality reduction for classification inspection, which have emerged in other domains and that go further than just using t-SNE in the embedding space, are not widely spread in NLP. To reduce this gap, we investigate the application of DeepView, a method for visualizing a part of the decision function together with a data set in two dimensions, to the NLP domain. While in previous work, DeepView has been used to inspect deep image classification models, we demonstrate how to apply it to BERT-based NLP classifiers and investigate its usability in this domain, including settings with adversarially perturbed input samples and pre-trained, fine-tuned, and multi-task models.


title: Predicting risk of cardiovascular disease using retinal OCT imaging

abstract: We investigated the potential of optical coherence tomography (OCT) as an additional imaging technique to predict future cardiovascular disease (CVD). We utilised a self-supervised deep learning approach based on Variational Autoencoders (VAE) to learn low-dimensional representations of high-dimensional 3D OCT images and to capture distinct characteristics of different retinal layers within the OCT image. A Random Forest (RF) classifier was subsequently trained using the learned latent features and participant demographic and clinical data, to differentiate between patients at risk of CVD events (MI or stroke) and non-CVD cases. Our predictive model, trained on multimodal data, was assessed based on its ability to correctly identify individuals likely to suffer from a CVD event(MI or stroke), within a 5-year interval after image acquisition. Our self-supervised VAE feature selection and multimodal Random Forest classifier differentiate between patients at risk of future CVD events and the control group with an AUC of 0.75, outperforming the clinically established QRISK3 score (AUC= 0.597). The choroidal layer visible in OCT images was identified as an important predictor of future CVD events using a novel approach to model explanability. Retinal OCT imaging provides a cost-effective and non-invasive alternative to predict the risk of cardiovascular disease and is readily accessible in optometry practices and hospitals.