title: One size fits all: Insights on Extrinsic Thermal Absorption from Similarity of Supernova Remnant Radio Continuum Spectra

abstract: Typically, integrated radio frequency continuum spectra of supernova remnants (SNRs) exhibit a power-law form due to their synchrotron emission. In numerous cases, these spectra show an exponential turnover, long assumed due to thermal free-free absorption in the interstellar medium. We use a compilation of Galactic radio continuum SNR spectra, with and without turnovers, to constrain the distribution of the absorbing ionized gas. We introduce a novel parameterization of SNR spectra in terms of a characteristic frequency v_*, which depends both on the absorption turnover frequency and the power-law slope. Normalizing to v_* and to the corresponding flux density, S_*, we demonstrate that the stacked spectra of our sample reveal a similarity in behavior with low scatter (r.m.s. ~15%), and a unique exponential drop-off fully consistent with the predictions of a free-free absorption process. Observed SNRs, whether exhibiting spectral turnovers or not, appear to be spatially well mixed in the Galaxy without any evident segregation between them. Moreover, their Galactic distribution does not show a correlation with general properties such as heliocentric distance or Galactic longitude, as might have been expected if the absorption were due to a continuous distribution of ionized gas. However, it naturally arises if the absorbers are discretely distributed, as suggested by early low-frequency observations. Modeling based on HII regions tracking Galactic spiral arms successfully reproduces the patchy absorption observed to date. While more extensive statistical datasets should yield more precise spatial models of the absorbing gas distribution, our present conclusion regarding its inhomogeneity will remain robust.


title: Social Learning: Towards Collaborative Learning with Large Language Models

abstract: We introduce the framework of "social learning" in the context of large language models (LLMs), whereby models share knowledge with each other in a privacy-aware manner using natural language. We present and evaluate two approaches for knowledge transfer between LLMs. In the first scenario, we allow the model to generate abstract prompts aiming to teach the task. In our second approach, models transfer knowledge by generating synthetic examples. We evaluate these methods across diverse datasets and quantify memorization as a proxy for privacy loss. These techniques inspired by social learning yield promising results with low memorization of the original data. In particular, we show that performance using these methods is comparable to results with the use of original labels and prompts. Our work demonstrates the viability of social learning for LLMs, establishes baseline approaches and highlights several unexplored areas for future work.


title: Explore 3D Dance Generation via Reward Model from Automatically-Ranked Demonstrations

abstract: This paper presents an Exploratory 3D Dance generation framework, E3D2, designed to address the exploration capability deficiency in existing music-conditioned 3D dance generation models. Current models often generate monotonous and simplistic dance sequences that misalign with human preferences because they lack exploration capabilities. The E3D2 framework involves a reward model trained from automatically-ranked dance demonstrations, which then guides the reinforcement learning process. This approach encourages the agent to explore and generate high quality and diverse dance movement sequences. The soundness of the reward model is both theoretically and experimentally validated. Empirical experiments demonstrate the effectiveness of E3D2 on the AIST++ dataset. Project Page: https://sites.google.com/view/e3d2.


title: Enhanced contribution of the pairing gap to the QCD equation of state at large isospin chemical potential

abstract: I study QCD at large isospin density, which is known to be in the superfluid state with Cooper pairs carrying the same quantum number as pions. I solve the gap equation derived from the perturbation theory up to the next-to-leading order corrections. The pairing gap at large isospin chemical potential is found to be enhanced compared to the color-superconducting gap at large baryon chemical potential due to the $\sqrt{2}$ difference in the exponent arising from the stronger attraction in one-gluon exchange in the singlet channel. Then, using the gap function, I evaluate the contribution of the condensation energy of the superfluid state to the QCD equation of state. At isospin chemical potential of a few GeV, where the lattice QCD and the perturbative QCD can be both applied, the effect of the condensation energy becomes dominant even compared to the next-to-leading order corrections to the pressure in the perturbation theory. It resolves the discrepancy between the recent lattice QCD results and the perturbative QCD result.


title: An In-depth Look at Gemini's Language Abilities

abstract: The recently released Google Gemini class of models are the first to comprehensively report results that rival the OpenAI GPT series across a wide variety of tasks. In this paper, we do an in-depth exploration of Gemini's language abilities, making two contributions. First, we provide a third-party, objective comparison of the abilities of the OpenAI GPT and Google Gemini models with reproducible code and fully transparent results. Second, we take a closer look at the results, identifying areas where one of the two model classes excels. We perform this analysis over 10 datasets testing a variety of language abilities, including reasoning, answering knowledge-based questions, solving math problems, translating between languages, generating code, and acting as instruction-following agents. From this analysis, we find that Gemini Pro achieves accuracy that is close but slightly inferior to the corresponding GPT 3.5 Turbo on all tasks that we benchmarked. We further provide explanations for some of this under-performance, including failures in mathematical reasoning with many digits, sensitivity to multiple-choice answer ordering, aggressive content filtering, and others. We also identify areas where Gemini demonstrates comparably high performance, including generation into non-English languages, and handling longer and more complex reasoning chains. Code and data for reproduction can be found at https://github.com/neulab/gemini-benchmark


title: Prime Number Theorems for Polynomials from Homogeneous Dynamics

abstract: We establish a new class of examples of the multivariate Bateman-Horn conjecture by using tools from dynamics. These cases include the determinant polynomial on the space of $n\times n$ matrices, the Pfaffian on the space of skew-symmetric $2n\times 2n$ matrices, and the determinant polynomial on the space of symmetric $n\times n$ matrices. In particular, let $(V,F)$ be any pair among the following: $(\textrm{Mat}_n, \det)$, $(\textrm{Skew}_{2n},\textrm{Pff})$, and $(\textrm{Sym}_n, \det).$ We then obtain an asymptotic for $$\pi_{V,F}(T)= \#\{v\in V: \max(|v_i|)\leq T, F(v) \text{ is prime}\},$$ that matches the Bateman-Horn prediction. The key ingredients of our proof are an asymptotic count for integral points on the level sets of $F$ given by Linnik equidistribution, a geometric approximation of the box by cones, and an upper bound sieve to bound the number of prime values missed by the approximation. In the case of the determinant polynomial on symmetric matrices, we must also use the Siegel mass formula to compute the product of local densities for the main term.


title: An intermediate case of exponential multivalued forbidden matrix configuration

abstract: The forbidden number forb$(m,F)$, which denotes the maximum number of distinct columns in an $m$-rowed $(0,1)$-matrix with no submatrix that is a row and column permutation of $F$, has been widely studied in extremal set theory. Recently, this function was extended to $r$-matrices, whose entries lie in $\{0,1,\cdots,r-1\}$. forb$(m,r,F)$ is the maximum number of distinct columns in an $r$-matrix with no submatrix that is a row and column permutation of $F$. While forb$(m,F)$ is polynomial in $m$, forb$(m,r,F)$ is exponential for $r\geq 3$. Recently, forb$(m,r,F)$ was studied for some small $(0,1)$-matrices $F$, and exact values were determined in some cases. In this paper we study forb$(m,r,M)$ for $M=\begin{bmatrix}0&1\\0&1\\1&0\end{bmatrix}$, which is the smallest matrix for which this forbidden number is unknown. Interestingly, it turns out that this problem is closely linked with the following optimisation problem. For each triangle in the complete graph $K_m$, pick one of its edges. Let $m_e$ denote the number of times edge $e$ is picked. For each $\alpha\in\mathbb{R}$, what is $H(m,\alpha)=\max\sum_{e\in E(K_m)}\alpha^{m_e}$? We establish a relationship between forb$(m,r,M)$ and $H(m,(r-1)/(r-2))$, find upper and lower bounds for $H(m,\alpha)$, and use them to significantly improve known bounds for forb$(m,r,M)$.


title: On the Hochschild cohomology of Tamarkin categories

abstract: To any open subset of a cotangent bundle, Tamarkin has associated a certain quotient of a category of sheaves. Here we show that the Hochschild cohomology of this category agrees with filtered symplectic cohomology.


title: Cosmic Recombination in the Presence of Primordial Magnetic Fields

abstract: Primordial magnetic fields (PMFs) may explain observations of magnetic fields on extragalactic scales. They are most cleanly constrained by measurements of cosmic microwave background radiation (CMB) anisotropies. Their effects on cosmic recombination may even be at the heart of the resolution of the Hubble tension. We present the most detailed analysis of the effects of PMFs on cosmic recombination to date. To this end we extend the public magneto-hydrodynamic code {\sl ENZO} with a new cosmic recombination routine, Monte-Carlo simulations of Lyman-$\alpha$ photon transport, and a Compton drag term in the baryon momentum equation. The resulting code allows us, for the first time, to realistically predict the impact of PMFs on the cosmic ionization history and the clumping of baryons during cosmic recombination. Our results identify the importance of mixing of Lyman-$\alpha$ photons between overdense- and underdense- regions for small PMF strength. This mixing speeds up recombination beyond the speed-up due to clumping. For non-helical PMFs with a Batchelor spectrum we find a surprising dependency of results on ultra-violet magnetic modes. The present study shall serve as a theoretical foundation for a future precise comparison of recombination with PMFs to CMB data.


title: Holographic transport coefficients and jet energy loss for the hot and dense quark-gluon plasma

abstract: We employ an Einstein-Maxwell-dilaton model, based on the gauge/gravity correspondence, to obtain the thermodynamics and transport properties for the hot and dense quark-gluon plasma. The model, which is constrained to reproduce lattice QCD thermodynamics at zero density, predicts a critical point and a first order line at finite temperature and density, is used to quantify jet energy loss through simulations of high-energy collision events.


title: Analysis of improved dynamics of non-rotating charged black holes

abstract: We provide the quantization of a charged black hole. We consider a redefinition of the scalar constraint in order to render the algebra of constraints as a Lie algebra. We apply loop quantum gravity techniques adhered to a novel improved dynamics scheme. We show that the model is solvable in closed form. We compute effective geometries, and show that the resulting effective space-times replace the inner horizon with a transition surface that connects trapped and antitrapped regions within the charged black hole interior. Quantum effects therefore stabilize the classical inner Cauchy horizons, as long as the charge is small compared to the mass. We further discuss the properties of these effective geometries by defining an effective stress-energy tensor out of the Einstein tensor, concluding that the null energy condition is violated.


title: Language-Assisted 3D Scene Understanding

abstract: The scale and quality of point cloud datasets constrain the advancement of point cloud learning. Recently, with the development of multi-modal learning, the incorporation of domain-agnostic prior knowledge from other modalities, such as images and text, to assist in point cloud feature learning has been considered a promising avenue. Existing methods have demonstrated the effectiveness of multi-modal contrastive training and feature distillation on point clouds. However, challenges remain, including the requirement for paired triplet data, redundancy and ambiguity in supervised features, and the disruption of the original priors. In this paper, we propose a language-assisted approach to point cloud feature learning (LAST-PCL), enriching semantic concepts through LLMs-based text enrichment. We achieve de-redundancy and feature dimensionality reduction without compromising textual priors by statistical-based and training-free significant feature selection. Furthermore, we also delve into an in-depth analysis of the impact of text contrastive training on the point cloud. Extensive experiments validate that the proposed method learns semantically meaningful point cloud features and achieves state-of-the-art or comparable performance in 3D semantic segmentation, 3D object detection, and 3D scene classification tasks.


title: Upwind summation-by-parts finite differences: error estimates and WENO methodology

abstract: High order upwind summation-by-parts finite difference operators have recently been developed. When combined with the simultaneous-approximation-term method to impose boundary conditions, the method converges faster than using traditional summation-by-parts operators. We prove the convergence rate by the normal mode analysis for such methods for a class of hyperbolic partial differential equations. Our analysis shows that the penalty parameter for imposing boundary conditions affects the convergence rate for stable methods. In addition, to solve problems with discontinuous data, we extend the method to also have the weighted essentially nonoscillatory property. The overall method is stable, achieves high order accuracy for smooth problems, and is capable of solving problems with discontinuities.


title: Quadratic energy-momentum squared gravity: constraints from big bang nucleosynthesis

abstract: In this study, we extend the standard cosmological model within the quadratic energy-momentum squared gravity (qEMSG) framework, introducing a nonminimal interaction between the usual material field ($T_{\mu\nu}$) and its accompanying quadratic energy-momentum squared field (qEMSF, $T_{\mu\nu}^{\rm qEMSF}$), defined by $f(\mathbf{T}^2) = \alpha \mathbf{T}^2$ with $\mathbf{T^2}=T_{\mu\nu}T^{\mu\nu}$. Focusing on high energy scales relevant to big bang nucleosynthesis (BBN), we employ $^4$He abundance to constrain the parameter $\alpha$. Our analysis selects the radiation-dominated universe solution compatible with the standard cosmological model limit as $\alpha \rightarrow 0$ and reveals that qEMSF interaction model can modify the radiation energy density's evolution, potentially altering neutron-proton interconversion rates and consequently affecting $^4$He abundance in various ways. We establish the most stringent cosmological bounds on $\alpha$: $(-8.81 \leq \alpha \leq 8.14) \times 10^{-27} \, \mathrm{eV}^{-4}$ (68\% CL) from Aver \textit{et al.}'s primordial $^4$He abundance measurements, aligning with $\alpha=0$. Additionally, $(3.48 \leq\alpha \leq 4.43)\,\times 10^{-27} \rm{eV}^{-4}$ (68\% CL) from Fields \textit{et al.}'s estimates, utilizing the Planck-CMB estimated baryon density within the standard cosmological model framework, diverges from $\alpha=0$, thereby lending support to the qEMSF interaction model. The study also highlights the bidirectional nature of energy-momentum/entropy transfer in qEMSF interaction model, depending on the sign of $\alpha$. The implications of qEMSF in the presence of additional relativistic relics are also explored, showcasing the model's potential to accommodate deviations from standard cosmology and the Standard Model of particle physics.


title: Applications of Kac-Moody Algebras to Gravity and String Theory

abstract: It has previously been proposed that the the theory of strings and branes possesses a large symmetry group generated by the Kac-Moody algebra $E_{11}$. It has also previously been proposed that the the theory of gravitation in four dimensions possesses a large symmetry group generated by the Kac-Moody algebra $A_1^{+++}$. These symmetry groups predict the existence of an infinite collection of fields in each theory, including a field that can be interpreted as a dual graviton. In this thesis we will discuss developments related to these approaches to string theory and gravity. We begin by reviewing the method of nonlinear realizations, then introducing the Kac-Moody algebra $A_1^{+++}$, along with its first fundamental representation representation which introduces space-time, to low levels. We will then consider a nonlinear realization involving their semi-direct product, and use the associated Cartan forms to construct dynamics for the low level fields of this nonlinear realization. We will then propose duality relations between fields of the theory at different levels, and propose a nonlinear equation of motion for the dual graviton arising from $A_1^{+++}$. We then consider the analogous results for $E_{11}$, and describe a proposed nonlinear dual graviton equation in the context of string theory. We next discuss irreducible representations of $E_{11}$. We will construct isotropy groups associated to massive and massless particles, branes such as the M2 and M5 branes, and the IIA string. Finally we present an approach for introducing spinorial representations of the Kac-Moody algebra $E_{11}$.


title: $A_p$ weights on nonhomogeneous trees equipped with measures of exponential growth

abstract: This paper aims to study $A_p$ weights in the context of a class of metric measure spaces with exponential volume growth, namely infinite trees with root at infinity equipped with the geodesic distance and flow measures. Our main result is a Muckenhoupt Theorem, which is a characterization of the weights for which a suitable Hardy--Littlewood maximal operator is bounded on the corresponding weighted $L^p$ spaces. We emphasise that this result does not require any geometric assumption on the tree or any condition on the flow measure. We also prove a reverse H\"older inequality in the case when the flow measure is locally doubling. We finally show that the logarithm of an $A_p$ weight is in BMO and discuss the connection between $A_p$ weights and quasisymmetric mappings.


title: Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint

abstract: This paper studies the alignment process of generative models with Reinforcement Learning from Human Feedback (RLHF). We first identify the primary challenges of existing popular methods like offline PPO and offline DPO as lacking in strategical exploration of the environment. Then, to understand the mathematical principle of RLHF, we consider a standard mathematical formulation, the reverse-KL regularized contextual bandit for RLHF. Despite its widespread practical application, a rigorous theoretical analysis of this formulation remains open. We investigate its behavior in three distinct settings -- offline, online, and hybrid -- and propose efficient algorithms with finite-sample theoretical guarantees. Moving towards practical applications, our framework, with a robust approximation of the information-theoretical policy improvement oracle, naturally gives rise to several novel RLHF algorithms. This includes an iterative version of the Direct Preference Optimization (DPO) algorithm for online settings, and a multi-step rejection sampling strategy for offline scenarios. Our empirical evaluations on real-world alignment experiment of large language model demonstrate that these proposed methods significantly surpass existing strong baselines, such as DPO and Rejection Sampling Optimization (RSO), showcasing the connections between solid theoretical foundations and their potent practical implementations.


title: Low-energy perspective on two-orbital Hund metals and the case of LaNiO2

abstract: The Hund-metal route to strong correlations continues to attract large interest in the condensed-matter community. The question arose to what extent it applies to the infinite-layer nickelates and, as a related question, to two-orbital systems in general. Here, we provide a low-energy perspective on this topic through a dynamical mean-field study using the numerical renormalization group (NRG) as a real-frequency impurity solver. We find that the RG flow from high to low energy is a uniquely adequate tool to reveal two-stage Kondo screening (2SKS), a fascinating mechanism for Hund physics. Further, we show that 2SKS takes place in a quarter-filled two-orbital system, but can be easily suppressed by a sufficiently large crystal-field splitting. We apply these insights to LaNiO2 using a recently proposed two-orbital model and show that it is indeed the crystal-field splitting that suppresses multiorbital phenomena in this scenario. Our general findings open the way for further explorations of 2SKS, and we propose a way of reviving low-energy Hund physics in LaNiO2 by counteracting the crystal field.


title: GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis

abstract: We propose a method for dynamic scene reconstruction using deformable 3D Gaussians that is tailored for monocular video. Building upon the efficiency of Gaussian splatting, our approach extends the representation to accommodate dynamic elements via a deformable set of Gaussians residing in a canonical space, and a time-dependent deformation field defined by a multi-layer perceptron (MLP). Moreover, under the assumption that most natural scenes have large regions that remain static, we allow the MLP to focus its representational power by additionally including a static Gaussian point cloud. The concatenated dynamic and static point clouds form the input for the Gaussian Splatting rasterizer, enabling real-time rendering. The differentiable pipeline is optimized end-to-end with a self-supervised rendering loss. Our method achieves results that are comparable to state-of-the-art dynamic neural radiance field methods while allowing much faster optimization and rendering. Project website: https://lynl7130.github.io/gaufre/index.html


title: VolumeDiffusion: Flexible Text-to-3D Generation with Efficient Volumetric Encoder

abstract: This paper introduces a pioneering 3D volumetric encoder designed for text-to-3D generation. To scale up the training data for the diffusion model, a lightweight network is developed to efficiently acquire feature volumes from multi-view images. The 3D volumes are then trained on a diffusion model for text-to-3D generation using a 3D U-Net. This research further addresses the challenges of inaccurate object captions and high-dimensional feature volumes. The proposed model, trained on the public Objaverse dataset, demonstrates promising outcomes in producing diverse and recognizable samples from text prompts. Notably, it empowers finer control over object part characteristics through textual cues, fostering model creativity by seamlessly combining multiple concepts within a single object. This research significantly contributes to the progress of 3D generation by introducing an efficient, flexible, and scalable representation methodology. Code is available at https://github.com/checkcrab/VolumeDiffusion.


title: Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response

abstract: Robust locomotion control depends on accurate state estimations. However, the sensors of most legged robots can only provide partial and noisy observations, making the estimation particularly challenging, especially for external states like terrain frictions and elevation maps. Inspired by the classical Internal Model Control principle, we consider these external states as disturbances and introduce Hybrid Internal Model (HIM) to estimate them according to the response of the robot. The response, which we refer to as the hybrid internal embedding, contains the robot's explicit velocity and implicit stability representation, corresponding to two primary goals for locomotion tasks: explicitly tracking velocity and implicitly maintaining stability. We use contrastive learning to optimize the embedding to be close to the robot's successor state, in which the response is naturally embedded. HIM has several appealing benefits: It only needs the robot's proprioceptions, i.e., those from joint encoders and IMU as observations. It innovatively maintains consistent observations between simulation reference and reality that avoids information loss in mimicking learning. It exploits batch-level information that is more robust to noises and keeps better sample efficiency. It only requires 1 hour of training on an RTX 4090 to enable a quadruped robot to traverse any terrain under any disturbances. A wealth of real-world experiments demonstrates its agility, even in high-difficulty tasks and cases never occurred during the training process, revealing remarkable open-world generalizability.


title: GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning

abstract: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.


title: Cascade Speculative Drafting for Even Faster LLM Inference

abstract: Introduced to enhance the efficiency of large language model (LLM) inference, speculative decoding operates by having a smaller model generate a draft. A larger target model then reviews this draft to align with its output, and any acceptance by the target model results in a reduction of the number of the target model runs, ultimately improving efficiency. However, the drafting process in speculative decoding includes slow autoregressive generation and allocates equal time to generating tokens, irrespective of their importance. These inefficiencies collectively contribute to the suboptimal performance of speculative decoding. To further improve LLM inference, we introduce Cascade Speculative Drafting (CS Drafting), a speculative execution algorithm that incorporates two types of cascades. The Vertical Cascade eliminates autoregressive generation from neural models, while the Horizontal Cascade optimizes time allocation in drafting for improved efficiency. Combining both cascades, CS Drafting achieves up to an 81 percent additional speedup over speculative decoding in our experiments, while maintaining the same output distribution as the target model. Our code is publicly available at https://github.com/lfsszd/CS-Drafting.


title: Appearance-based Refinement for Object-Centric Motion Segmentation

abstract: The goal of this paper is to discover, segment, and track independently moving objects in complex visual scenes. Previous approaches have explored the use of optical flow for motion segmentation, leading to imperfect predictions due to partial motion, background distraction, and object articulations and interactions. To address this issue, we introduce an appearance-based refinement method that leverages temporal consistency in video streams to correct inaccurate flow-based proposals. Our approach involves a simple selection mechanism that identifies accurate flow-predicted masks as exemplars, and an object-centric architecture that refines problematic masks based on exemplar information. The model is pre-trained on synthetic data and then adapted to real-world videos in a self-supervised manner, eliminating the need for human annotations. Its performance is evaluated on multiple video segmentation benchmarks, including DAVIS, YouTubeVOS, SegTrackv2, and FBMS-59. We achieve competitive performance on single-object segmentation, while significantly outperforming existing models on the more challenging problem of multi-object segmentation. Finally, we investigate the benefits of using our model as a prompt for a per-frame Segment Anything Model.


title: Symmetry Enforced Fermi Surface Degeneracies Observed in Time-Reversal Symmetry-Breaking Superconductor LaNiGa$_2$

abstract: LaNiGa$_2$ is superconductor that breaks time-reversal symmetry in the superconducting state without any known nearby magnetism. Recently, single crystals of LaNiGa$_2$ have been synthesized, revealing a nonsymmorphic Cmcm space group. Here, we report measurements of the electronic structure of LaNiGa$_2$ throughout the three-dimensional Brillouin zone (BZ) using angle-resolved photoemission spectroscopy (ARPES). Our findings show broad consistency with density functional theory (DFT) calculations and provide evidence for degeneracies in the electronic structure that are predicted from the space group. The calculations also predict four Fermi surfaces which cross the purported nodal plane and should therefore form two degenerate pairs. We report evidence for those predicted symmetry enforced degeneracies as well as accidental near degeneracies throughout the BZ. These degeneracies and near-degeneracies may play a role in the pairing mechanism of LaNiGa$_2$. Our results provide insight into the interplay between structure, Fermiology, and superconductivity in unconventional superconductors with nonsymmorphic space group.


title: Protoclusters as Drivers of Stellar Mass Growth in the Early Universe, a Case Study: Taralay -- a Massive Protocluster at z ~ 4.57

abstract: Simulations predict that the galaxy populations inhabiting protoclusters may contribute considerably to the total amount of stellar mass growth of galaxies in the early universe. In this study, we test these predictions observationally, focusing on the Taralay protocluster (formerly PCl J1001+0220) at $z \sim 4.57$ in the COSMOS field. Leveraging data from the Charting Cluster Construction with VUDS and ORELSE (C3VO) survey, we spectroscopically confirmed 44 galaxies within the adopted redshift range of the protocluster ($4.48 < z < 4.64$) and incorporate an additional 18 such galaxies from ancillary spectroscopic surveys. Using a density mapping technique, we estimate the total mass of Taralay to be $\sim 1.7 \times 10^{15}$ M$_\odot$, sufficient to form a massive cluster by the present day. By comparing the star formation rate density (SFRD) within the protocluster (SFRD$_\text{pc}$) to that of the coeval field (SFRD$_\text{field}$), we find that SFRD$_\text{pc}$ surpasses the SFRD$_\text{field}$ by $\Delta$log(SFRD/$M_\odot$ yr$^{-1}$ Mpc$^{-3}$) = $1.08 \pm 0.32$ (or $\sim$ 12$\times$). The observed contribution fraction of protoclusters to the cosmic SFRD adopting Taralay as a proxy for typical protoclusters is $33.5\%^{+8.0\%}_{-4.3\%}$, a value $\sim$2$\sigma$ in excess of the predictions from simulations. Taralay contains three peaks that are $5\sigma$ above the average density at these redshifts. Their SFRD is $\sim$0.5 dex higher than the value derived for the overall protocluster. We show that 68% of all star formation in the protocluster takes place within these peaks, and that the innermost regions of the peaks encase $\sim 50\%$ of the total star formation in the protocluster. This study strongly suggests that protoclusters drive stellar mass growth in the early universe and that this growth may proceed in an inside-out manner.


title: Extracting Interpretable Local and Global Representations from Attention on Time Series

abstract: This paper targets two transformer attention based interpretability methods working with local abstraction and global representation, in the context of time series data. We distinguish local and global contexts, and provide a comprehensive framework for both general interpretation options. We discuss their specific instantiation via different methods in detail, also outlining their respective computational implementation and abstraction variants. Furthermore, we provide extensive experimentation demonstrating the efficacy of the presented approaches. In particular, we perform our experiments using a selection of univariate datasets from the UCR UEA time series repository where we both assess the performance of the proposed approaches, as well as their impact on explainability and interpretability/complexity. Here, with an extensive analysis of hyperparameters, the presented approaches demonstrate an significant improvement in interpretability/complexity, while capturing many core decisions of and maintaining a similar performance to the baseline model. Finally, we draw general conclusions outlining and guiding the application of the presented methods.


title: Glioblastoma Tumor Segmentation using an Ensemble of Vision Transformers

abstract: Glioblastoma is one of the most aggressive and deadliest types of brain cancer, with low survival rates compared to other types of cancer. Analysis of Magnetic Resonance Imaging (MRI) scans is one of the most effective methods for the diagnosis and treatment of brain cancers such as glioblastoma. Accurate tumor segmentation in MRI images is often required for treatment planning and risk assessment of treatment methods. Here, we propose a novel pipeline, Brain Radiology Aided by Intelligent Neural NETworks (BRAINNET), which leverages MaskFormer, a vision transformer model, and generates robust tumor segmentation maks. We use an ensemble of nine predictions from three models separately trained on each of the three orthogonal 2D slice directions (axial, sagittal, and coronal) of a 3D brain MRI volume. We train and test our models on the publicly available UPenn-GBM dataset, consisting of 3D multi-parametric MRI (mpMRI) scans from 611 subjects. Using Dice coefficient (DC) and 95% Hausdorff distance (HD) for evaluation, our models achieved state-of-the-art results in segmenting all three different tumor regions -- tumor core (DC = 0.894, HD = 2.308), whole tumor (DC = 0.891, HD = 3.552), and enhancing tumor (DC = 0.812, HD = 1.608).


title: Bias-Reduced Neural Networks for Parameter Estimation in Quantitative MRI

abstract: Purpose: To develop neural network (NN)-based quantitative MRI parameter estimators with minimal bias and a variance close to the Cram\'er-Rao bound. Theory and Methods: We generalize the mean squared error loss to control the bias and variance of the NN's estimates, which involves averaging over multiple noise realizations of the same measurements during training. Bias and variance properties of the resulting NNs are studied for two neuroimaging applications. Results: In simulations, the proposed strategy reduces the estimates' bias throughout parameter space and achieves a variance close to the Cram\'er-Rao bound. In vivo, we observe good concordance between parameter maps estimated with the proposed NNs and traditional estimators, such as non-linear least-squares fitting, while state-of-the-art NNs show larger deviations. Conclusion: The proposed NNs have greatly reduced bias compared to those trained using the mean squared error and offer significantly improved computational efficiency over traditional estimators with comparable or better accuracy.


title: An Algebraic Approach to the Longest Path Problem

abstract: The Longest Path Problem is a question of finding the maximum length between pairs of vertices of a graph. In the general case, the problem is NP-hard. However, there is a small collection of graph classes for which there exists an efficient solution. Current approaches involve either approximation or computational enumeration. For Tree-like classes of graphs, there are approximation and enumeration algorithms which solves the problem efficiently. We propose a new method of approaching the longest path problem with algebraic operations and conditions that exactly identify and or approximate the solution in polynomial time. We next introduce a 'booleanize' mapping on the adjacency matrix of a graph which we prove identifies the solution for trees, uniform block graphs, block graphs, and directed acyclic graphs, with approached conditions. Finally, we display the algorithms to find the solution, in addition to algorithms that generate all the longest paths.


title: Anomaly detection for automated inspection of power line insulators

abstract: Inspection of insulators is important to ensure reliable operation of the power system. Deep learning has recently been explored to automate the inspection process by leveraging aerial images captured by drones along with powerful object detection models. However, a purely object detection-based approach exhibits class imbalance-induced poor detection accuracy for faulty insulators, especially for incipient faults. In order to address this issue in a data-efficient manner, this article proposes a two-stage approach that leverages object detection in conjunction with anomaly detection to reliably detect faults in insulators. The article adopts an explainable deep neural network-based one-class classifier for anomaly detection, that reduces the reliance on plentifully available images of faulty insulators, that might be difficult to obtain in real-life applications. The anomaly detection model is trained with two datasets -- representing data abundant and data scarce scenarios -- in unsupervised and semi-supervised manner. The results suggest that including as few as six real anomalies in the training dataset significantly improves the performance of the model, and enables reliable detection of rarely occurring faults in insulators. An analysis of the explanations provided by the anomaly detection model reveals that the model is able to accurately identify faulty regions on the insulator disks, while also exhibiting some false predictions.


title: Persistence and Doubling of Chaotic Attractors in Coupled 3-Cell Hopfield Neural Networks

abstract: Two novel phenomena for unidirectionally coupled 3-cell Hopfield neural networks (HNNs) are investigated. The first one is the persistence of chaos, which means the permanency of sensitivity and infinitely many unstable periodic oscillations in the response HNN even if the networks are not synchronized in the generalized sense. Doubling of chaotic attractors is the second phenomenon realized in this study. It can be achieved when the response network possesses two stable point attractors in the absence of the driving. This feature leads to the formation of two coexisting chaotic attractors with disjoint basins. Lyapunov functions are utilized to deduce the presence of an invariant region, and the sensitivity is rigorously proved. The absence of synchronization is approved via the auxiliary system approach and analysis of conditional Lyapunov exponents. Additionally, quadruple and octuple coexisting chaotic attractors are demonstrated, and the formation of hyperchaos is discussed.


title: Extended Lorenz majorization and frequencies of distances in an undirected network

abstract: Findings: We show that the distance distribution in an undirected network Lorenz majorizes the one of a chain. As a consequence, the average and median distances in any such network are smaller than or equal to those of a chain. Research limitations: We restricted our investigations to undirected, unweighted networks. Practical implications: We are convinced that these results are useful in the study of small worlds and the so-called six degrees of separation property.


title: Synthetic Shifts to Initial Seed Vector Exposes the Brittle Nature of Latent-Based Diffusion Models

abstract: Recent advances in Conditional Diffusion Models have led to substantial capabilities in various domains. However, understanding the impact of variations in the initial seed vector remains an underexplored area of concern. Particularly, latent-based diffusion models display inconsistencies in image generation under standard conditions when initialized with suboptimal initial seed vectors. To understand the impact of the initial seed vector on generated samples, we propose a reliability evaluation framework that evaluates the generated samples of a diffusion model when the initial seed vector is subjected to various synthetic shifts. Our results indicate that slight manipulations to the initial seed vector of the state-of-the-art Stable Diffusion (Rombach et al., 2022) can lead to significant disturbances in the generated samples, consequently creating images without the effect of conditioning variables. In contrast, GLIDE (Nichol et al., 2022) stands out in generating reliable samples even when the initial seed vector is transformed. Thus, our study sheds light on the importance of the selection and the impact of the initial seed vector in the latent-based diffusion model.


title: Ultrasensitive vibrational resonance induced by small disturbances

abstract: We have found two kinds of ultra-sensitive vibrational resonance in coupled nonlinear systems. It is particularly worth pointing out that this ultra-sensitive vibrational resonance is a transient behavior caused by transient chaos. Considering long-term response, the system will transform from transient chaos to periodic response. The pattern of vibrational resonance will also transform from ultra-sensitive vibrational resonance to conventional vibrational resonance. This article focuses on the transient ultra-sensitive vibrational resonance phenomenon. It is induced by a small disturbance of the high-frequency excitation and the initial simulation conditions, respectively. The damping coefficient and the coupling strength are the key factors to induce the ultra-sensitive vibrational resonance. By increasing these two parameters, the vibrational resonance pattern can be transformed from an ultra-sensitive vibrational resonance to a conventional vibrational resonance. The reason for different vibrational resonance patterns to occur lies in the state of the system response. The response usually presents transient chaotic behavior when the ultra-sensitive vibrational resonance appears and the plot of the response amplitude versus the controlled parameters shows a highly fractalized pattern. When the response is periodic or doubly-periodic, it usually corresponds to the conventional vibrational resonance. The ultra-sensitive vibrational resonance not only occurs at the excitation frequency, but it also occurs at some more nonlinear frequency components. The ultra-sensitive vibrational resonance as a transient behavior and the transformation of vibrational resonance patterns are new phenomena in coupled nonlinear systems.


title: A Hybrid SOM and K-means Model for Time Series Energy Consumption Clustering

abstract: Energy consumption analysis plays a pivotal role in addressing the challenges of sustainability and resource management. This paper introduces a novel approach to effectively cluster monthly energy consumption patterns by integrating two powerful techniques: Self-organizing maps and K-means clustering. The proposed method aims to exploit the benefits of both of these algorithms to enhance the accuracy and interpretability of clustering results for a dataset in which finding patterns is difficult. The main focus of this study is on a selection of time series energy consumption data from the Smart meters in London dataset. The data was preprocessed and reduced in dimensionality to capture essential temporal patterns while retaining their underlying structures. The SOM algorithm was utilized to extract the central representatives of the consumption patterns for each one of the houses over the course of each month, effectively reducing the dimensionality of the dataset and making it easier for analysis. Subsequently, the obtained SOM centroids were clustered using K-means, a popular centroid-based clustering technique. The experimental results demonstrated a significant silhouette score of 66%, indicating strong intra-cluster cohesion and inter-cluster separation which confirms the effectiveness of the proposed approach in the clustering task.


title: The geometry of flow: Advancing predictions of river geometry with multi-model machine learning

abstract: Hydraulic geometry parameters describing river hydrogeomorphic is important for flood forecasting. Although well-established, power-law hydraulic geometry curves have been widely used to understand riverine systems and mapping flooding inundation worldwide for the past 70 years, we have become increasingly aware of the limitations of these approaches. In the present study, we have moved beyond these traditional power-law relationships for river geometry, testing the ability of machine-learning models to provide improved predictions of river width and depth. For this work, we have used an unprecedentedly large river measurement dataset (HYDRoSWOT) as well as a suite of watershed predictor data to develop novel data-driven approaches to better estimate river geometries over the contiguous United States (CONUS). Our Random Forest, XGBoost, and neural network models out-performed the traditional, regionalized power law-based hydraulic geometry equations for both width and depth, providing R-squared values of as high as 0.75 for width and as high as 0.67 for depth, compared with R-squared values of 0.57 for width and 0.18 for depth from the regional hydraulic geometry equations. Our results also show diverse performance outcomes across stream orders and geographical regions for the different machine-learning models, demonstrating the value of using multi-model approaches to maximize the predictability of river geometry. The developed models have been used to create the newly publicly available STREAM-geo dataset, which provides river width, depth, width/depth ratio, and river and stream surface area (%RSSA) for nearly 2.7 million NHDPlus stream reaches across the rivers and streams across the contiguous US.


title: Reconstructing relaxed configurations in elastic bodies: Mathematical formulations and numerical methods for cardiac modeling

abstract: Modeling the behavior of biological tissues and organs often necessitates the knowledge of their shape in the absence of external loads. However, when their geometry is acquired in-vivo through imaging techniques, bodies are typically subject to mechanical deformation due to the presence of external forces, and the load-free configuration needs to be reconstructed. This paper addresses this crucial and frequently overlooked topic, known as the inverse elasticity problem (IEP), by delving into both theoretical and numerical aspects, with a particular focus on cardiac mechanics. In this work, we extend Shield's seminal work to determine the structure of the IEP with arbitrary material inhomogeneities and in the presence of both body and active forces. These aspects are fundamental in computational cardiology, and we show that they may break the variational structure of the inverse problem. In addition, we show that the inverse problem might have no solution even in the presence of constant Neumann boundary conditions and a polyconvex strain energy functional. We then present the results of extensive numerical tests to validate our theoretical framework, and to characterize the computational challenges associated with a direct numerical approximation of the IEP. Specifically, we show that this framework outperforms existing approaches both in terms of robustness and optimality, such as Sellier's iterative procedure, even when the latter is improved with acceleration techniques. A notable discovery is that multigrid preconditioners are, in contrast to standard elasticity, not efficient, where a one-level additive Schwarz and generalized Dryja-Smith-Widlund provide a much more reliable alternative. Finally, we successfully address the IEP for a full-heart geometry, demonstrating that the IEP formulation can compute the stress-free configuration in real-life scenarios.

categories: physics.bio-ph cond-mat.soft cs.NA math.NA


title: Zero distribution of finite order Bank--Laine functions

abstract: It is known that a Bank-Laine function $E$ is a product of two normalized solutions of the second order differential equation $f"+Af=0$ $(\dagger)$, where $A=A(z)$ is an entire function. By using Bergweiler and Eremenko's method of constructing transcendental entire function $A(z)$ by gluing certain meromorphic functions with infinitely many times, we show that, for each $\lambda\in[1,\infty)$ and each $\delta\in[0,1]$, there exists a Bank--Laine function $E$ such that $E=f_1f_2$ with $f_1$ and $f_2$ being two entire functions such that $\lambda(f_1)=\delta\lambda$ and $\lambda(f_2)=\lambda$, respectively. We actually provide a simpler construction of the special Bank--Laine functions given by Bergweiler and Eremenko.


title: Towards ultra-low-cost smartphone microscopy

abstract: The outbreak of COVID-19 exposed the inadequacy of our technical tools for home health surveillance, and recent studies have shown the potential of smartphones as a universal optical microscopic imaging platform for such applications. However, most of them use laboratory-grade optomechanical components and transmitted illuminations to ensure focus tuning capability and imaging quality, which keeps the cost of the equipment high. Here we propose an ultra-low-cost solution for smartphone microscopy. To realize focus tunability, we designed a seesaw-like structure capable of converting large displacements on one side into small displacements on the other (reduced to ~9.1%), which leverages the intrinsic flexibility of 3D printing materials. We achieved a focus-tuning accuracy of ~5 micron, which is 40 times higher than the machining accuracy of the 3D-printed lens holder itself. For microscopic imaging, we use an off-the-shelf smartphone camera lens as the objective and the built-in flashlight as the illumination. To compensate for the resulting image quality degradation, we developed a learning-based image enhancement method. We use the CycleGAN architecture to establish the mapping from smartphone microscope images to benchtop microscope images without pairing. We verified the imaging performance on different biomedical samples. Except for the smartphone, we kept the full costs of the device under 4 USD. We think these efforts to lower the costs of smartphone microscopes will benefit their applications in various scenarios, such as point-of-care testing, on-site diagnosis, and home health surveillance.


title: Adaptive Smooth Activation for Improved Disease Diagnosis and Organ Segmentation from Radiology Scans

abstract: In this study, we propose a new activation function, called Adaptive Smooth Activation Unit (ASAU), tailored for optimized gradient propagation, thereby enhancing the proficiency of convolutional networks in medical image analysis. We apply this new activation function to two important and commonly used general tasks in medical image analysis: automatic disease diagnosis and organ segmentation in CT and MRI. Our rigorous evaluation on the RadImageNet abdominal/pelvis (CT and MRI) dataset and Liver Tumor Segmentation Benchmark (LiTS) 2017 demonstrates that our ASAU-integrated frameworks not only achieve a substantial (4.80\%) improvement over ReLU in classification accuracy (disease detection) on abdominal CT and MRI but also achieves 1\%-3\% improvement in dice coefficient compared to widely used activations for `healthy liver tissue' segmentation. These improvements offer new baselines for developing a diagnostic tool, particularly for complex, challenging pathologies. The superior performance and adaptability of ASAU highlight its potential for integration into a wide range of image classification and segmentation tasks.


title: Nudging Nutrition: Lessons from the Danish "Fat Tax"

abstract: In October 2011, Denmark introduced the world's first and, to date, only tax targeting saturated fat. However, this tax was subsequently abolished in January 2013. Leveraging exogenous variation from untaxed Northern-German consumers, we employ a difference-in-differences approach to estimate the causal effects of both the implementation and repeal of the tax on consumption and expenditure behavior across eight product categories targeted by the tax. Our findings reveal significant heterogeneity in the tax's impact across these products. During the taxed period, there was a notable decline in consumption of bacon, liver sausage, salami, and cheese, particularly among low-income households. In contrast, expenditure on butter, cream, margarine, and sour cream increased as prices rose. Interestingly, we do not observe any difference in expenditure increases between high and low-income households, suggesting that the latter were disproportionately affected by the tax. After the repeal of the tax, we do not observe any significant decline in consumption. On the contrary, there was an overall increase in consumption for certain products, prompting concerns about unintended consequences resulting from the brief implementation of the tax.


title: Poisson-Boltzmann based machine learning (PBML) model for electrostatic analysis

abstract: Electrostatics is of paramount importance to chemistry, physics, biology, and medicine. The Poisson-Boltzmann (PB) theory is a primary model for electrostatic analysis. However, it is highly challenging to compute accurate PB electrostatic solvation free energies for macromolecules due to the nonlinearity, dielectric jumps, charge singularity , and geometric complexity associated with the PB equation. The present work introduces a PB based machine learning (PBML) model for biomolecular electrostatic analysis. Trained with the second-order accurate MIBPB solver, the proposed PBML model is found to be more accurate and faster than several eminent PB solvers in electrostatic analysis. The proposed PBML model can provide highly accurate PB electrostatic solvation free energy of new biomolecules or new conformations generated by molecular dynamics with much reduced computational cost.


title: Estimates for solutions in a predator-prey model describing plankton-fish interaction

abstract: In the paper we consider a system of differential equations with two delays describing plankton--fish interaction. We study stability of the equilibrium point corresponding to the presence of phytoplankton and zooplankton in the system and the absence of fish. In the case of asymptotic stability, we indicate conditions for the initial data under which solutions stabilize to this equilibrium point and establish estimates for solutions characterizing the stabilization rate at infinity. The results are obtained using Lyapunov-Krasovskii functional. The obtained theoretical results can be used for numerical study of behavior of solutions to the considered model.


title: Effects of Daily Exercise Time on the Academic Performance of Students: An Empirical Analysis Based on CEPS Data

abstract: This paper examines the effects of daily exercise time on the academic performance of junior high school students in China, with an attempt to figure out the most appropriate daily exercise time for students from the perspective of improving students' test scores. By dividing the daily exercise time into five sections to construct a categorical variable in a linear regression model as well as using another model to draw intuitive figures, I find that spending both too little and too much time on physical activity every day would have adverse impacts on students' academic performance, with differences existing in the impacts by gender, grade, city scale, and location type of the school. The findings of this paper carry implications for research, school health and education policy and physical and general education practice. The results also provide recommendations for students, parents and teachers.


title: Coffea-Casa: Building composable analysis facilities for the HL-LHC

abstract: The large data volumes expected from the High Luminosity LHC (HL-LHC) present challenges to existing paradigms and facilities for end-user data analysis. Modern cyberinfrastructure tools provide a diverse set of services that can be composed into a system that provides physicists with powerful tools that give them straightforward access to large computing resources, with low barriers to entry. The Coffea-Casa analysis facility (AF) provides an environment for end users enabling the execution of increasingly complex analyses such as those demonstrated by the Analysis Grand Challenge (AGC) and capturing the features that physicists will need for the HL-LHC. We describe the development progress of the Coffea-Casa facility featuring its modularity while demonstrating the ability to port and customize the facility software stack to other locations. The facility also facilitates the support of batch systems while staying Kubernetes-native. We present the evolved architecture of the facility, such as the integration of advanced data delivery services (e.g. ServiceX) and making data caching services (e.g. XCache) available to end users of the facility. We also highlight the composability of modern cyberinfrastructure tools. To enable machine learning pipelines at coffee-casa analysis facilities, a set of industry ML solutions adopted for HEP columnar analysis were integrated on top of existing facility services. These services also feature transparent access for user workflows to GPUs available at a facility via inference servers while using Kubernetes as enabling technology.


title: Preference and Concurrence Aware Bayesian Graph Neural Networks for Recommender Systems

abstract: Graph-based collaborative filtering methods have prevailing performance for recommender systems since they can capture high-order information between users and items, in which the graphs are constructed from the observed user-item interactions that might miss links or contain spurious positive interactions in industrial scenarios. The Bayesian Graph Neural Network framework approaches this issue with generative models for the interaction graphs. The critical problem is to devise a proper family of graph generative models tailored to recommender systems. We propose an efficient generative model that jointly considers the preferences of users, the concurrence of items and some important graph structure information. Experiments on four popular benchmark datasets demonstrate the effectiveness of our proposed graph generative methods for recommender systems.


title: Symbolic Learning for Material Discovery

abstract: Discovering new materials is essential to solve challenges in climate change, sustainability and healthcare. A typical task in materials discovery is to search for a material in a database which maximises the value of a function. That function is often expensive to evaluate, and can rely upon a simulation or an experiment. Here, we introduce SyMDis, a sample efficient optimisation method based on symbolic learning, that discovers near-optimal materials in a large database. SyMDis performs comparably to a state-of-the-art optimiser, whilst learning interpretable rules to aid physical and chemical verification. Furthermore, the rules learned by SyMDis generalise to unseen datasets and return high performing candidates in a zero-shot evaluation, which is difficult to achieve with other approaches.


title: Low-Latency ML Inference by Grouping Correlated Data Objects and Computation

abstract: ML inference workflows often require low latency and high throughput, yet we lack good options for addressing this need. Techniques that reduce latency in other streaming settings (such as caching and optimization-driven scheduling) are of limited value because ML data dependencies are often very large and can change dramatically depending on the triggering event. In this work, we propose a novel correlation grouping mechanism that makes it easier for developers to express application-specific data access correlations, enabling coordinated management of data objects in server clusters hosting streaming inference tasks. Experiments based on a latency-sensitive ML-based application confirm the limitations of standard techniques while showing that our solution yields dramatically better performance. The proposed mechanism is able to maintain significantly lower and more consistent latency, achieves higher node utilization as workload and scale-out increase, and yet requires only minor changes to the code implementing the application.


title: Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration

abstract: Federated Learning (FL) enables training Artificial Intelligence (AI) models over end devices without compromising their privacy. As computing tasks are increasingly performed by a combination of cloud, edge, and end devices, FL can benefit from this End-Edge-Cloud Collaboration (EECC) paradigm to achieve collaborative device-scale expansion with real-time access. Although Hierarchical Federated Learning (HFL) supports multi-tier model aggregation suitable for EECC, prior works assume the same model structure on all computing nodes, constraining the model scale by the weakest end devices. To address this issue, we propose Agglomerative Federated Learning (FedAgg), which is a novel EECC-empowered FL framework that allows the trained models from end, edge, to cloud to grow larger in size and stronger in generalization ability. FedAgg recursively organizes computing nodes among all tiers based on Bridge Sample Based Online Distillation Protocol (BSBODP), which enables every pair of parent-child computing nodes to mutually transfer and distill knowledge extracted from generated bridge samples. This design enhances the performance by exploiting the potential of larger models, with privacy constraints of FL and flexibility requirements of EECC both satisfied. Experiments under various settings demonstrate that FedAgg outperforms state-of-the-art methods by an average of 4.53\% accuracy gains and remarkable improvements in convergence rate.


title: Tracking Intrinsic Non-Hermitian Skin Effect in Lossy Lattices

abstract: Non-Hermitian skin effect (NHSE), characterized by a majority of eigenstates localized at open boundaries, is one of the most iconic phenomena in non-Hermitian lattices. Despite notable experimental studies implemented, most of them witness only certain signs of the NHSE rather than the intrinsic exponential localization inherent in eigenstates, owing to the ubiquitous and inevitable background loss. Even worse, the experimental observation of the NHSE would be completely obscured in highly lossy cases. Here, we theoretically propose a dual test approach to eliminate the destructive loss effect and track the intrinsic NHSE that is essentially irrelevant to background loss. Experimentally, the effectiveness of this approach is precisely validated by one- and two-dimensional non-Hermitian acoustic lattices. Our study sheds new light on the previously untapped intrinsic aspect of the NHSE, which is of particular significance in non-Hermitian topological physics.


title: Lithium niobate-enhanced laser photoacoustic spectroscopy

abstract: In this paper, the photoacoustic spectroscopy technique based on lithium niobate crystals is initially reported, to our knowledge. A novel dual-cantilever tuning fork structure and new electrodes have been designed using Y-cut 128{\deg} blackened lithium niobate wafers. The tuning fork, with a resonant frequency of only 10.46 kHz and a prong gap of 1 mm, is engineered to achieve superior performance in photoacoustic spectroscopy. In the demonstration experiment, acetylene was detected using a 1.53 um semiconductor laser, achieving a detection limit of about 9 ppb within a one-second integration time.


title: Exploration-Exploitation Model of Moth-Inspired Olfactory Navigation

abstract: Navigation of male moths toward females during the mating search offers a unique perspective on the exploration-exploitation (EE) model in decision-making. This study uses the EE model to explain male moth pheromone-driven flight paths. We leverage wind tunnel measurements and 3D tracking using infrared cameras to gain insights into male moth behavior. During the experiments in the wind tunnel, we add disturbance to the airflow and analyze the effect of increased fluctuations on moth flights in the context of the proposed EE model. We separate the exploration and exploitation phases by applying a genetic algorithm to the dataset of moth 3D trajectories. First, we demonstrate that the exploration-to-exploitation rate (EER) increases with distance from the source of the female pheromone, which can be explained in the context of the EE model. Furthermore, our findings reveal a compelling relationship between EER and increased flow fluctuations near the pheromone source. Using the open-source pheromone plume simulation and our moth-inspired navigation model, we explain why male moths exhibit an enhanced EER as turbulence levels increase, emphasizing the agent's adaptation to dynamically changing environments. This research extends our understanding of optimal navigation strategies based on general biological EE models and supports the development of advanced, theoretically supported bio-inspired navigation algorithms. We provide important insights into the potential of bio-inspired navigation models for addressing complex decision-making challenges.


title: Orbifold Hirzebruch-Riemann-Roch

abstract: We study the orbifold Hirzebruch-Riemann-Roch (HRR) theorem for quotient Deligne-Mumford stacks, explore its relation with the representation theory of finite groups, and derive a new orbifold HRR formula via an orbifold Mukai pairing.


title: Heuristic for Optimisation of Dark Store Facility Locations for Quick Commerce Businesses

abstract: We present a fast, flexible heuristic for setting up warehouse locations for quick commerce businesses, with the goal of serving the largest number of customers under the constraints of delivery radius and maximum daily deliveries per warehouse. Quick commerce or direct-to-customer delivery businesses guarantee delivery within a specified time. Using experiments on various scenarios, we show that the proposed algorithm is flexible enough to handle variations such as non-uniform population distributions, variable travel times, and selection of multiple warehouse locations.


title: Collective excitation of bosonic quantum Hall state

abstract: The recent developments in the theory of rapidly rotating Bose atoms have been reviewed in this article. Rotation leads to the development of quantized-vortices, that cluster into a vortex array, exactly to how superfluid helium behaves. Theoretically, a number of strongly correlated phases are projected to exist in this domain, which might be thought of as bosonic counterparts of fractional quantum Hall effect (FQHE). It is now possible for bosons associating with a short-range interaction to exhibit a FQHE, because the system of neutral bosons in a fast rotating atomic trap is analogous to charged bosons placed in a fictitious magnetic field. The neutral collective spin-conserving and spin-flip excitation for the rotating ultra-cold dilute Bose atoms in the FQHE domain are being discussed. We have introduced a realistic interaction between the Bose particles together with long-range interaction and presented a short review article about various fractional quantum Hall states and their spin conserving and spin reversed collective modes.


title: A Hedonic Index for Collectables Arising from Modelling Diamond Prices

abstract: This article describes a case study concerned with modelling the price of wholesale diamonds, as part of a project to develop an online diamond auction platform. The work was extended to exploring how to develop an index that could be used to track market trends of wholesale diamond prices. The approach we used is readily generalised to defining market indices for so-called Collectables, and can provide the basis for construction of derivatives. With the burgeoning interest in new markets of collectables such as those generated by the concept of a Non-Fungible Token, it is reasonable to suppose that there will be concomitant increasing interest in developing derivatives for these markets.


title: The Public Algorithms Survey in Allegheny County

abstract: This survey study focuses on public opinion regarding the use of algorithmic decision-making in government sectors, specifically in Allegheny County, Pennsylvania. Algorithms are becoming increasingly prevalent in various public domains, including both routine and high-stakes government functions. Despite their growing use, public sentiment remains divided, with concerns about privacy and accuracy juxtaposed against perceptions of fairness when compared to human decision-making. In April 2021, a survey was conducted among nearly 1,500 county residents to explore their awareness, experiences, and attitudes towards these algorithms. The study highlights diverse viewpoints influenced by factors such as race, age, education, gender, income, and urban or suburban living. The results demonstrate the complexity of public sentiment towards algorithmic governance and emphasize the need for a nuanced understanding and approach in policy and implementation.


title: Recommending Influencers to Merchants using Matching Game Algorithm

abstract: The goal of this work was to apply the ``Gale-Shapley'' algorithm to a real-world problem. We analyzed the pairing of influencers with merchants, and after a detailed specification of the variables involved, we conducted experiments to observe the validity of the approach. We conducted an analysis of the problem of aligning the interests of merchants to have digital influencers promote their products and services. We propose applying the matching algorithm approach to address this issue. We demonstrate that it is possible to apply the algorithm and still achieve corporate objectives by translating performance indicators into the desired ranking of influencers and product campaigns to be advertised by merchants.


title: Unpredictable tunneling in a retarded bistable potential

abstract: We have studied the rich dynamics of a damped particle inside an external double-well potential under the influence of state-dependent time-delayed feedback. In certain regions of the parameter space, we observe multistability with the existence of two different attractors (limit cycle or strange attractor) with well separated mean Lyapunov energies forming a two-level system. Bifurcation analysis reveals that, as the effects of the time-delay feedback are enhanced, chaotic transitions emerge between the two wells of the double-well potential for the attractor corresponding to the fundamental energy level. By computing the residence time distributions and the scaling laws near the onset of chaotic transitions, we rationalize this apparent tunneling-like effect in terms of the crisis-induced intermittency phenomenon. Further, we investigate the first passage times in this regime and observe the appearance of a Cantor-like fractal set in the initial history space, a characteristic feature of hyperbolic chaotic scattering. The non-integer value of the uncertainty dimension indicates that the residence time inside each well is unpredictable. Finally, we demonstrate the robustness of this tunneling intermittency as a function of the memory parameter by calculating the largest Lyapunov exponent.


title: A Red Teaming Framework for Securing AI in Maritime Autonomous Systems

abstract: Artificial intelligence (AI) is being ubiquitously adopted to automate processes in science and industry. However, due to its often intricate and opaque nature, AI has been shown to possess inherent vulnerabilities which can be maliciously exploited with adversarial AI, potentially putting AI users and developers at both cyber and physical risk. In addition, there is insufficient comprehension of the real-world effects of adversarial AI and an inadequacy of AI security examinations; therefore, the growing threat landscape is unknown for many AI solutions. To mitigate this issue, we propose one of the first red team frameworks for evaluating the AI security of maritime autonomous systems. The framework provides operators with a proactive (secure by design) and reactive (post-deployment evaluation) response to securing AI technology today and in the future. This framework is a multi-part checklist, which can be tailored to different systems and requirements. We demonstrate this framework to be highly effective for a red team to use to uncover numerous vulnerabilities within a real-world maritime autonomous systems AI, ranging from poisoning to adversarial patch attacks. The lessons learned from systematic AI red teaming can help prevent MAS-related catastrophic events in a world with increasing uptake and reliance on mission-critical AI.


title: SYNC+SYNC: Software Cache Write Covert Channels Exploiting Memory-disk Synchronization

abstract: Memory-disk synchronization is a critical technology for ensuring data correctness, integrity, and security, especially in systems that handle sensitive information like financial transactions and medical records. We propose SYNC+SYNC, a group of attacks that exploit the memory-disk synchronization primitives. SYNC+SYNC works by subtly varying the timing of synchronization on the write buffer, offering several advantages: 1) implemented purely in software, enabling deployment on any hardware devices; 2) resilient against existing cache partitioning and randomization techniques; 3) unaffected by prefetching techniques and cache replacement strategies. We present the principles of SYNC+SYNC through the implementation of two write covert channel protocols, using either a single file or page, and introduce three enhanced strategies that utilize multiple files and pages. The feasibility of these channels is demonstrated in both cross-process and cross-sandbox scenarios across diverse operating systems (OSes). Experimental results show that, the average rate can reach 2.036 Kb/s (with a peak rate of 14.762 Kb/s) and the error rate is 0% on Linux; when running on macOS, the average rate achieves 10.211 Kb/s (with a peak rate of 253.022 Kb/s) and the error rate is 0.004%. To the best of our knowledge, SYNC+SYNC is the first high-speed write covert channel for software cache.


title: Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data

abstract: In this work we introduce Labrador, a pre-trained Transformer model for laboratory data. Labrador and BERT were pre-trained on a corpus of 100 million lab test results from electronic health records (EHRs) and evaluated on various downstream outcome prediction tasks. Both models demonstrate mastery of the pre-training task but neither consistently outperform XGBoost on downstream supervised tasks. Our ablation studies reveal that transfer learning shows limited effectiveness for BERT and achieves marginal success with Labrador. We explore the reasons for the failure of transfer learning and suggest that the data generating process underlying each patient cannot be characterized sufficiently using labs alone, among other factors. We encourage future work to focus on joint modeling of multiple EHR data categories and to include tree-based baselines in their evaluations.


title: Speech and Text-Based Emotion Recognizer

abstract: Affective computing is a field of study that focuses on developing systems and technologies that can understand, interpret, and respond to human emotions. Speech Emotion Recognition (SER), in particular, has got a lot of attention from researchers in the recent past. However, in many cases, the publicly available datasets, used for training and evaluation, are scarce and imbalanced across the emotion labels. In this work, we focused on building a balanced corpus from these publicly available datasets by combining these datasets as well as employing various speech data augmentation techniques. Furthermore, we experimented with different architectures for speech emotion recognition. Our best system, a multi-modal speech, and text-based model, provides a performance of UA(Unweighed Accuracy) + WA (Weighed Accuracy) of 157.57 compared to the baseline algorithm performance of 119.66


title: The performance of multiple language models in identifying offensive language on social media

abstract: Text classification is an important topic in the field of natural language processing. It has been preliminarily applied in information retrieval, digital library, automatic abstracting, text filtering, word semantic discrimination and many other fields. The aim of this research is to use a variety of algorithms to test the ability to identify offensive posts and evaluate their performance against a variety of assessment methods. The motivation for this project is to reduce the harm of these languages to human censors by automating the screening of offending posts. The field is a new one, and despite much interest in the past two years, there has been no focus on the object of the offence. Through the experiment of this project, it should inspire future research on identification methods as well as identification content.


title: Biscari Network. Tutti gli uomini del principe

abstract: Thanks to its heterogeneity, the Biscari Archive, one of the most representative family's archives in Sicily, in a new digital historical study, became a valuable set of computable data that can lead historians to reconstruct the history of the city of Catania and Sicily. Ignazio Paterno' Castello and his wife Anna, princes of Biscari, were the promoters of the city's reconstruction after the 1693 earthquake, both politically and culturally. How could the digital historical methodology fulfil the traditional Historiography gap about how this noble family built its mighty? As we know, Humanities cannot easily be encapsulated in a few understandable numbers and names. However, historians, boosting Artificial Intelligence, such as Transkribus, and applying Historical Networks Analysis could help computers infer computable meaning from the digitised historical primary source. The Turing Machine became the most powerful tool to help historians understand what happened in the Past and identify the actors in cities and places' cultural and political renewal.


title: Signal-to-noise and spatial resolution in in-line imaging. 1. Basic theory, numerical simulations and planar experimental images

abstract: Signal-to-noise ratio and spatial resolution are quantitatively analysed in the context of in-line (propagation based) X-ray phase-contrast imaging. It is known that free-space propagation of a coherent X-ray beam from the imaged object to the detector plane, followed by phase retrieval in accordance with Paganin's method, can increase the signal-to-noise in the resultant images without deteriorating the spatial resolution. This results in violation of the noise-resolution uncertainty principle and demonstrates "unreasonable" effectiveness of the method. On the other hand, when the process of free-space propagation is performed in software, using the detected intensity distribution in the object plane, it cannot reproduce the same effectiveness, due to the amplification, during free-space propagation, of photon shot noise in the object-plane intensity. We show that the performance of Paganin's method is determined by just two dimensionless parameters: the Fresnel number and the ratio of the phase shift to the logarithm of intensity in the object plane. The relevant theoretical analysis is performed first, followed by computer simulations and then by a brief test using experimental images collected at a synchrotron beamline. More extensive experimental tests will be presented in the second part of this paper.


title: Explain To Decide: A Human-Centric Review on the Role of Explainable Artificial Intelligence in AI-assisted Decision Making

abstract: The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the models are error-prone and cannot be used autonomously, especially in decision-making scenarios where, technically or ethically, the cost of error is high. Moreover, because of the black-box nature of these models, it is frequently difficult for the end user to comprehend the models' outcomes and underlying processes to trust and use the model outcome to make a decision. Explainable Artificial Intelligence (XAI) aids end-user understanding of the model by utilizing approaches, including visualization techniques, to explain and interpret the inner workings of the model and how it arrives at a result. Although numerous research studies have been conducted recently focusing on the performance of models and the XAI approaches, less work has been done on the impact of explanations on human-AI team performance. This paper surveyed the recent empirical studies on XAI's impact on human-AI decision-making, identified the challenges, and proposed future research directions.


title: Rethinking the Instruction Quality: LIFT is What You Need

abstract: Instruction tuning, a specialized technique to enhance large language model (LLM) performance via instruction datasets, relies heavily on the quality of employed data. Existing quality improvement methods alter instruction data through dataset expansion or curation. However, the expansion method risks data redundancy, potentially compromising LLM performance, while the curation approach confines the LLM's potential to the original dataset. Our aim is to surpass the original data quality without encountering these shortcomings. To achieve this, we propose LIFT (LLM Instruction Fusion Transfer), a novel and versatile paradigm designed to elevate the instruction quality to new heights. LIFT strategically broadens data distribution to encompass more high-quality subspaces and eliminates redundancy, concentrating on high-quality segments across overall data subspaces. Experimental results demonstrate that, even with a limited quantity of high-quality instruction data selected by our paradigm, LLMs not only consistently uphold robust performance across various tasks but also surpass some state-of-the-art results, highlighting the significant improvement in instruction quality achieved by our paradigm.


title: Toward a Reinforcement-Learning-Based System for Adjusting Medication to Minimize Speech Disfluency

abstract: We propose a reinforcement learning (RL)-based system that would automatically prescribe a hypothetical patient medication that may help the patient with their mental health-related speech disfluency, and adjust the medication and the dosages in response to zero-cost frequent measurement of the fluency of the patient. We demonstrate the components of the system: a module that detects and evaluates speech disfluency on a large dataset we built, and an RL algorithm that automatically finds good combinations of medications. To support the two modules, we collect data on the effect of psychiatric medications for speech disfluency from the literature, and build a plausible patient simulation system. We demonstrate that the RL system is, under some circumstances, able to converge to a good medication regime. We collect and label a dataset of people with possible speech disfluency and demonstrate our methods using that dataset. Our work is a proof of concept: we show that there is promise in the idea of using automatic data collection to address speech disfluency.


title: QuadAttack: A Quadratic Programming Approach to Ordered Top-K Attacks

abstract: The adversarial vulnerability of Deep Neural Networks (DNNs) has been well-known and widely concerned, often under the context of learning top-$1$ attacks (e.g., fooling a DNN to classify a cat image as dog). This paper shows that the concern is much more serious by learning significantly more aggressive ordered top-$K$ clear-box~\footnote{ This is often referred to as white/black-box attacks in the literature. We choose to adopt neutral terminology, clear/opaque-box attacks in this paper, and omit the prefix clear-box for simplicity.} targeted attacks proposed in Adversarial Distillation. We propose a novel and rigorous quadratic programming (QP) method of learning ordered top-$K$ attacks with low computing cost, dubbed as \textbf{QuadAttac$K$}. Our QuadAttac$K$ directly solves the QP to satisfy the attack constraint in the feature embedding space (i.e., the input space to the final linear classifier), which thus exploits the semantics of the feature embedding space (i.e., the principle of class coherence). With the optimized feature embedding vector perturbation, it then computes the adversarial perturbation in the data space via the vanilla one-step back-propagation. In experiments, the proposed QuadAttac$K$ is tested in the ImageNet-1k classification using ResNet-50, DenseNet-121, and Vision Transformers (ViT-B and DEiT-S). It successfully pushes the boundary of successful ordered top-$K$ attacks from $K=10$ up to $K=20$ at a cheap budget ($1\times 60$) and further improves attack success rates for $K=5$ for all tested models, while retaining the performance for $K=1$.


title: ComplexityNet: Increasing LLM Inference Efficiency by Learning Task Complexity

abstract: We present ComplexityNet, a streamlined language model designed for assessing task complexity. This model predicts the likelihood of accurate output by various language models, each with different capabilities. Our initial application of ComplexityNet involves the Mostly Basic Python Problems (MBPP) dataset. We pioneered the creation of the first set of labels to define task complexity. ComplexityNet achieved a notable 79% accuracy in determining task complexity, a significant improvement over the 34% accuracy of the original, non fine-tuned model. Furthermore, ComplexityNet effectively reduces computational resource usage by 90% compared to using the highest complexity model, while maintaining a high code generation accuracy of 86.7%. This study demonstrates that fine-tuning smaller models to categorize tasks based on their complexity can lead to a more balanced trade-off between accuracy and efficiency in the use of Large Language Models. Our findings suggest a promising direction for optimizing LLM applications, especially in resource-constrained environments.


title: Path Signature Representation of Patient-Clinician Interactions as a Predictor for Neuropsychological Tests Outcomes in Children: A Proof of Concept

abstract: This research report presents a proof-of-concept study on the application of machine learning techniques to video and speech data collected during diagnostic cognitive assessments of children with a neurodevelopmental disorder. The study utilised a dataset of 39 video recordings, capturing extensive sessions where clinicians administered, among other things, four cognitive assessment tests. From the first 40 minutes of each clinical session, covering the administration of the Wechsler Intelligence Scale for Children (WISC-V), we extracted head positions and speech turns of both clinician and child. Despite the limited sample size and heterogeneous recording styles, the analysis successfully extracted path signatures as features from the recorded data, focusing on patient-clinician interactions. Importantly, these features quantify the interpersonal dynamics of the assessment process (dialogue and movement patterns). Results suggest that these features exhibit promising potential for predicting all cognitive tests scores of the entire session length and for prototyping a predictive model as a clinical decision support tool. Overall, this proof of concept demonstrates the feasibility of leveraging machine learning techniques for clinical video and speech data analysis in order to potentially enhance the efficiency of cognitive assessments for neurodevelopmental disorders in children.


title: Maatphor: Automated Variant Analysis for Prompt Injection Attacks

abstract: Prompt injection has emerged as a serious security threat to large language models (LLMs). At present, the current best-practice for defending against newly-discovered prompt injection techniques is to add additional guardrails to the system (e.g., by updating the system prompt or using classifiers on the input and/or output of the model.) However, in the same way that variants of a piece of malware are created to evade anti-virus software, variants of a prompt injection can be created to evade the LLM's guardrails. Ideally, when a new prompt injection technique is discovered, candidate defenses should be tested not only against the successful prompt injection, but also against possible variants. In this work, we present, a tool to assist defenders in performing automated variant analysis of known prompt injection attacks. This involves solving two main challenges: (1) automatically generating variants of a given prompt according, and (2) automatically determining whether a variant was effective based only on the output of the model. This tool can also assist in generating datasets for jailbreak and prompt injection attacks, thus overcoming the scarcity of data in this domain. We evaluate Maatphor on three different types of prompt injection tasks. Starting from an ineffective (0%) seed prompt, Maatphor consistently generates variants that are at least 60% effective within the first 40 iterations.


title: LLM in a flash: Efficient Large Language Model Inference with Limited Memory

abstract: Large language models (LLMs) are central to modern natural language processing, delivering exceptional performance in various tasks. However, their substantial computational and memory requirements present challenges, especially for devices with limited DRAM capacity. This paper tackles the challenge of efficiently running LLMs that exceed the available DRAM capacity by storing the model parameters in flash memory, but bringing them on demand to DRAM. Our method involves constructing an inference cost model that takes into account the characteristics of flash memory, guiding us to optimize in two critical areas: reducing the volume of data transferred from flash and reading data in larger, more contiguous chunks. Within this hardware-informed framework, we introduce two principal techniques. First, "windowing" strategically reduces data transfer by reusing previously activated neurons, and second, "row-column bundling", tailored to the sequential data access strengths of flash memory, increases the size of data chunks read from flash memory. These methods collectively enable running models up to twice the size of the available DRAM, with a 4-5x and 20-25x increase in inference speed compared to naive loading approaches in CPU and GPU, respectively. Our integration of sparsity awareness, context-adaptive loading, and a hardware-oriented design paves the way for effective inference of LLMs on devices with limited memory.


title: Search for 10--1,000 GeV neutrinos from Gamma Ray Bursts with IceCube

abstract: We present the results of a search for 10--1,000 GeV neutrinos from 2,268 gamma-ray bursts over 8 years of IceCube-DeepCore data. This work probes burst physics below the photosphere where electromagnetic radiation cannot escape. Neutrinos of tens of GeVs are predicted in sub-photospheric collision of free streaming neutrons with bulk-jet protons. In a first analysis, we searched for the most significant neutrino-GRB coincidence using six overlapping time windows centered on the prompt phase of each GRB. In a second analysis, we conducted a search for a group of GRBs, each individually too weak to be detectable, but potentially significant when combined. No evidence of neutrino emission is found for either analysis. The most significant neutrino coincidence is for Fermi-GBM GRB bn 140807500, with a p-value of 0.097 corrected for all trials. The binomial test used to search for a group of GRBs had a p-value of 0.65 after all trial corrections. The binomial test found a group consisting only of GRB bn 140807500 and no additional GRBs. The neutrino limits of this work complement those obtained by IceCube at TeV to PeV energies. We compare our findings for the large set of GRBs as well as GRB 221009A to the sub-photospheric neutron-proton collision model and find that GRB 221009A provides the most constraining limit on baryon loading. For a jet Lorentz factor of 300 (800), the baryon loading on GRB 221009A is lower than 3.85 (2.13) at a 90% confidence level.


title: Essay: Where Can Quantum Geometry Lead Us?

abstract: Quantum geometry defines the phase and amplitude distances between quantum states. The phase distance is characterized by the Berry curvature and thus relates to topological phenomena. The significance of the full quantum geometry, including the amplitude distance characterized by the quantum metric, has started to receive attention in the last few years. Various quantum transport and interaction phenomena have been found to be critically influenced by quantum geometry. For example, quantum geometry allows counterintuitive flow of supercurrent in a flat band where single electrons are immobile. In this Essay, I will discuss my view of the important open problems and future applications of this research topic and will try to inspire the reader to come up with further ideas. At its best, quantum geometry can open a new chapter in band theory and lead to breakthroughs as transformative as room-temperature superconductivity. However, first, more experiments directly showing the effect of quantum geometry are needed. We also have to integrate quantum geometry analysis in our most advanced numerical methods. Further, the ramifications of quantum geometry should be studied in a wider range, including electric and electromagnetic responses and interaction phenomena in free- and correlated-electron materials, bosonic systems, optics, and other fields.

categories: cond-mat.supr-con cond-mat.quant-gas cond-mat.str-el physics.optics quant-ph


title: A Natural Language Processing-Based Classification and Mode-Based Ranking of Musculoskeletal Disorder Risk Factors

abstract: This research delves into Musculoskeletal Disorder (MSD) risk factors, using a blend of Natural Language Processing (NLP) and mode-based ranking. The aim is to refine understanding, classification, and prioritization for focused prevention and treatment. Eight NLP models are evaluated, combining pre-trained transformers, cosine similarity, and distance metrics to categorize factors into personal, biomechanical, workplace, psychological, and organizational classes. BERT with cosine similarity achieves 28% accuracy; sentence transformer with Euclidean, Bray-Curtis, and Minkowski distances scores 100%. With 10-fold cross-validation, statistical tests ensure robust results. Survey data and mode-based ranking determine severity hierarchy, aligning with the literature. "Working posture" is the most severe, highlighting posture's role. Survey insights emphasize "Job insecurity," "Effort reward imbalance," and "Poor employee facility" as significant contributors. Rankings offer actionable insights for MSD prevention. The study suggests targeted interventions, workplace improvements, and future research directions. This integrated NLP and ranking approach enhances MSD comprehension and informs occupational health strategies.


title: User Modeling in the Era of Large Language Models: Current Research and Future Directions

abstract: User modeling (UM) aims to discover patterns or learn representations from user data about the characteristics of a specific user, such as profile, preference, and personality. The user models enable personalization and suspiciousness detection in many online applications such as recommendation, education, and healthcare. Two common types of user data are text and graph, as the data usually contain a large amount of user-generated content (UGC) and online interactions. The research of text and graph mining is developing rapidly, contributing many notable solutions in the past two decades. Recently, large language models (LLMs) have shown superior performance on generating, understanding, and even reasoning over text data. The approaches of user modeling have been equipped with LLMs and soon become outstanding. This article summarizes existing research about how and why LLMs are great tools of modeling and understanding UGC. Then it reviews a few categories of large language models for user modeling (LLM-UM) approaches that integrate the LLMs with text and graph-based methods in different ways. Then it introduces specific LLM-UM techniques for a variety of UM applications. Finally, it presents remaining challenges and future directions in the LLM-UM research. We maintain the reading list at: https://github.com/TamSiuhin/LLM-UM-Reading


title: Analysing user sentiment data for architectural interior spaces

abstract: This study aims to develop a data driven system to enhance the analysis and improvement of user experiences in interior spaces, acknowledging the significant impact of design on individuals health, productivity, and quality of life.