title: Change Guiding Network: Incorporating Change Prior to Guide Change Detection in Remote Sensing Imagery

abstract: The rapid advancement of automated artificial intelligence algorithms and remote sensing instruments has benefited change detection (CD) tasks. However, there is still a lot of space to study for precise detection, especially the edge integrity and internal holes phenomenon of change features. In order to solve these problems, we design the Change Guiding Network (CGNet), to tackle the insufficient expression problem of change features in the conventional U-Net structure adopted in previous methods, which causes inaccurate edge detection and internal holes. Change maps from deep features with rich semantic information are generated and used as prior information to guide multi-scale feature fusion, which can improve the expression ability of change features. Meanwhile, we propose a self-attention module named Change Guide Module (CGM), which can effectively capture the long-distance dependency among pixels and effectively overcome the problem of the insufficient receptive field of traditional convolutional neural networks. On four major CD datasets, we verify the usefulness and efficiency of the CGNet, and a large number of experiments and ablation studies demonstrate the effectiveness of CGNet. We're going to open-source our code at https://github.com/ChengxiHAN/CGNet-CD.


title: ge_gravity2: a command for solving universal gravity models

abstract: We describe an algorithm for computing counterfactual trade flows, prices, output, and welfare in a large class of general equilibrium trade models. We introduce a command called ge_gravity2 that allows users to perform these computations in Stata. This command extends the existing ge_gravity command by allowing users to compute the general equilibrium effects of changes in trade policy in positive supply elasticity models. It can be used to solve any model that falls into the class of universal gravity models as defined by Allen, Arkolakis, and Takahashi [Universal Gravity, Journal of Political Economy, 128(2), 2020, 393-433].


title: The Lunar Gravitational-wave Antenna: Mission Studies and Science Case

abstract: The Lunar Gravitational-wave Antenna (LGWA) is a proposed array of next-generation inertial sensors to monitor the response of the Moon to gravitational waves (GWs). Given the size of the Moon and the expected noise produced by the lunar seismic background, the LGWA would be able to observe GWs from about 1 mHz to 1 Hz. This would make the LGWA the missing link between space-borne detectors like LISA with peak sensitivities around a few millihertz and proposed future terrestrial detectors like Einstein Telescope or Cosmic Explorer. In this article, we provide a first comprehensive analysis of the LGWA science case including its multi-messenger aspects and lunar science with LGWA data. We also describe the scientific analyses of the Moon required to plan the LGWA mission.


title: Coexistence of interacting charge density waves in a layered semiconductor

abstract: Coexisting orders are key features of strongly correlated materials and underlie many intriguing phenomena from unconventional superconductivity to topological orders. Here, we report the coexistence of two interacting charge-density-wave (CDW) orders in EuTe4, a layered crystal that has drawn considerable attention owing to its anomalous thermal hysteresis and a semiconducting CDW state despite the absence of perfect FS nesting. By accessing unoccupied conduction bands with time- and angle-resolved photoemission measurements, we find that mono- and bi-layers of Te in the unit cell host different CDWs that are associated with distinct energy gaps. The two gaps display dichotomous evolutions following photoexcitation, where the larger bilayer CDW gap exhibits less renormalization and faster recovery. Surprisingly, the CDW in the Te monolayer displays an additional momentum-dependent gap renormalization that cannot be captured by density-functional theory calculations. This phenomenon is attributed to interlayer interactions between the two CDW orders, which account for the semiconducting nature of the equilibrium state. Our findings not only offer microscopic insights into the correlated ground state of EuTe4 but also provide a general non-equilibrium approach to understand coexisting, layer-dependent orders in a complex system.


title: Invariant classes for families of complexes

abstract: We consider families of chain-cochain infinite complexes $\mathcal C$ of spaces with elements depending on a number of parameters, and endowed with a converging associative multiple product. The existence of left/right local/non-local square-vanishing ideals is assumed for subspaces of $\mathcal C$-spaces. We show that a set of differential and orthogonality relations together with coherence conditions on indices of a chain-cochain complex $\mathcal C$ elements generates families of graded differential algebras. With the appropriate orthogonality conditions on completions of $\mathcal C$ elements in the multiple product, we define the equivalence classes of cohomology invariants.


title: Some algebras with trivial rings of differential operators

abstract: Let $k$ be an arbitrary field. We construct examples of regular local $k$-algebras $R$ (of positive dimension) for which the ring of differential operators $D_k(R)$ is trivial in the sense that it contains {\it no} operators of positive order. The examples are excellent in characteristic zero but not in positive characteristic. These rings can be viewed as being non-singular but they are not simple as $D$-modules, laying to rest speculation that $D$-simplicity might characterize a nice class of singularities in general. In prime characteristic, the construction also provides examples of {\it regular} local rings $R$ (with fraction field a function field) whose Frobenius push-forward $F_*^eR$ is {\it indecomposable} as an $R$-module for all $e\in \mathbb N$. Along the way, we investigate hypotheses on a local ring $(R, m)$ under which $D$-simplicity for $R$ is equivalent to $D$-simplicity for its $m$-adic completion, and give examples of rings for which the differential operators do not behave well under completion. We also generalize a characterization of $D$-simplicity due to Jeffries in the $\mathbb N$-graded case: for a Noetherian local $k$-algebra $(R, m, k)$, $D$-simplicity of $R$ is equivalent to surjectivity of the natural map $D_k(R)\to D_k(R, k)$.


title: Robust spin order and fragile charge order in Na0.5CoO2 as revealed by time-resolved terahertz spectroscopy

abstract: Near-infrared (NIR) pump-terahertz (THz) probe spectroscopy is used to investigate the charge and spin exciations in a strongly correlated electron compound Na0.5CoO2. This compound exhibits a coexistence of various charge and spin orders arising from intricate interactions among charge, spin, and orbital degrees of freedom. NIR pulses create significantly diverse effects on the charge and spin orders; while the charge order is easily melted,coherent magnon excitations are present in all fluences examined. Furthermore, a novel {\pi} phase shift of the coherent magnon oscillations is observed in the pump-induced change of the terahertz electric field between regions of increasing and decreasing field change. These results unequivocally illustrate that ultrashort laser pulses enable the disentanglement of different interactions within complex systems characterized by multiple orders, providing a fresh perspective on the interplay between itinerant and localized electrons within the Co 3d t2g multiplets.


title: Feasibility Study of Function Splits in RAN Architectures with LEO Satellites

abstract: This paper explores the evolution of Radio Access Network (RAN) architectures and their integration into Non-Terrestrial Networks (NTN) to address escalating mobile traffic demands. Focusing on Low Earth Orbit (LEO) satellites as key components of NTN, we examine the feasibility of RAN function splits (FSs) in terms of fronthaul (FH) latency, elevation angle, and bandwidth (BW) across LEO satellites and ground stations (GS), alongside evaluating performance of Conditional Handover (CHO) procedures under diverse scenarios. By assessing performance metrics such as handover duration, disconnection time, and control traffic volume, we provide insights on several aspects such as stringent constraints for Low Layer Splits (LLSs), leading to longer delays during mobility procedures and increased control traffic across the feeder link in comparison with the case when gNodeB is onboard satellite. Despite challenges, LLSs demonstrate minimal onboard satellite computational requirements, promising reduced power consumption and payload weight. These findings underscore the architectural possibilities and challenges within the telecommunications industry, paving the way for future advancements in NTN RAN design and operation.


title: Stable Acceleration of a LHe-Free Nb3Sn demo SRF e-linac Based on Conduction Cooling

abstract: The design, construction, and commissioning of a conduction-cooled Nb3Sn demonstration superconducting radio frequency (SRF) electron accelerator at the Institute of Modern Physics of the Chinese Academy of Sciences (IMP, CAS) will be presented. In the context of engineering application planning for Nb3Sn thin-film SRF cavities within the CiADS project, a 650MHz 5-cell elliptical cavity was coated using the vapor diffusion method for electron beam acceleration. Through high-precision collaborative control of 10 GM cryocooler, slow cooldown of the cavity crossing 18K is achieved accompanied by obviously characteristic magnetic flux expulsion. The horizontal test results of the liquid helium-free (LHe-free) cryomodule show that the cavity can operate steadily at Epk=6.02MV/m in continuous wave (CW) mode, and at Epk=14.90MV/m in 40% duty cycle pulse mode. The beam acceleration experiment indicates that the maximum average current of the electron beam in the macropulse after acceleration exceeds 200mA, with a maximum energy gain of 4.6MeV. The results provide a principle validation for the engineering application of Nb3Sn thin-film SRF cavities, highlighting the promising industrial application prospects of a small-scale compact Nb3Sn SRF accelerator driven by commercial cryocoolers.


title: On Joint Convergence of Traffic State and Weight Vector in Learning-Based Dynamic Routing with Value Function Approximation

abstract: Learning-based approaches are increasingly popular for traffic control problems. However, these approaches are applied typically as black boxes with limited theoretical guarantees and interpretability. In this paper, we consider the theory of dynamic routing over parallel servers, a representative traffic control task, using semi-gradient on-policy control algorithm, a representative reinforcement learning method. We consider a linear value function approximation on an infinite state space; a Lyapunov function is also derived from the approximator. In particular, the structure of the approximator naturally makes possible idling policies, which is an interesting and useful advantage over existing dynamic routing schemes. We show that the convergence of the approximation weights is coupled with the convergence of the traffic state. We show that if the system is stabilizable, then (i) the weight vector converges to a bounded region, and (ii) the traffic state is bounded in the mean. We also empirically show that the proposed algorithm is computationally efficient with an insignificant optimality gap.


title: The Witt groups of extended quadratic forms over Z

abstract: We recall the notion of a quadratic form parameter $Q$ over the integers and of extended quadratic forms with values in $Q$, which we call $Q$-forms. Certain form parameters $Q$ appeared in Wall's work on the classification of almost closed $(q{-}1)$-connected $2q$-manifolds via $Q$-forms. The algebraic theory of general form parameters and extended quadratic forms has been studied in a variety of far more general settings by authors including Bak, Baues, Ranicki and Schlichting. In this paper we classify all quadratic form parameters $Q$ over the integers, determine the category of quadratic form parameters $\mathbf{FP}$ and compute the Witt group functor, \[ W_0 \colon \mathbf{FP} \to \mathbf{Ab}, \quad Q \mapsto W_0(Q),\] where $\mathbf{Ab}$ is the category of finitely generated abelian groups and $W_0(Q)$ is the Witt group of nonsingular $Q$-forms.


title: Scaling and Finite-Size Scaling above the Upper Critical Dimension

abstract: In the 1960's, four famous scaling relations were developed which relate the six standard critical exponents describing continuous phase transitions in the thermodynamic limit of statistical physics models. They are well understood at a fundamental level through the renormalization group. They have been verified in multitudes of theoretical, computational and experimental studies and are firmly established and profoundly important for our understanding of critical phenomena. One of the scaling relations, hyperscaling, fails above the upper critical dimension. There, critical phenomena are governed by Gaussian fixed points in the renormalization-group formalism. Dangerous irrelevant variables are required to deliver the mean-field and Landau values of the critical exponents, which are deemed valid by the Ginzburg criterion. Also above the upper critical dimension, the standard picture is that, unlike for low-dimensional systems, finite-size scaling is non-universal. Here we report on new developments which indicate that the current paradigm is flawed and incomplete. In particular, the introduction of a new exponent characterising the finite-size correlation length allows one to extend hyperscaling beyond the upper critical dimension. Moreover, finite-size scaling is shown to be universal provided the correct scaling window is chosen. These recent developments also lead to the introduction of a new scaling relation analogous to one introduced by Fisher 50 years ago.


title: The enigmatic exponent koppa and the story of finite-size scaling above the upper critical dimension

abstract: Scaling, hyperscaling and finite-size scaling were long considered problematic in theories of critical phenomena in high dimensions. The scaling relations themselves form a model-independent structure that any model-specific theory must adhere to, and they are accounted for by the simple principle of homogeneity. Finite-size scaling is similarly founded on the fundamental idea that only two length scales enter the game -- namely system length and correlation length. While all scaling relations are quite satisfactory for multitudes of physical systems in low dimensions, one fails in high dimensions...


title: Prior-agnostic Multi-scale Contrastive Text-Audio Pre-training for Parallelized TTS Frontend Modeling

abstract: Over the past decade, a series of unflagging efforts have been dedicated to developing highly expressive and controllable text-to-speech (TTS) systems. In general, the holistic TTS comprises two interconnected components: the frontend module and the backend module. The frontend excels in capturing linguistic representations from the raw text input, while the backend module converts linguistic cues to speech. The research community has shown growing interest in the study of the frontend component, recognizing its pivotal role in text-to-speech systems, including Text Normalization (TN), Prosody Boundary Prediction (PBP), and Polyphone Disambiguation (PD). Nonetheless, the limitations posed by insufficient annotated textual data and the reliance on homogeneous text signals significantly undermine the effectiveness of its supervised learning. To evade this obstacle, a novel two-stage TTS frontend prediction pipeline, named TAP-FM, is proposed in this paper. Specifically, during the first learning phase, we present a Multi-scale Contrastive Text-audio Pre-training protocol (MC-TAP), which hammers at acquiring richer insights via multi-granularity contrastive pre-training in an unsupervised manner. Instead of mining homogeneous features in prior pre-training approaches, our framework demonstrates the ability to delve deep into both global and local text-audio semantic and acoustic representations. Furthermore, a parallelized TTS frontend model is delicately devised to execute TN, PD, and PBP prediction tasks, respectively in the second stage. Finally, extensive experiments illustrate the superiority of our proposed method, achieving state-of-the-art performance.


title: FaceCat: Enhancing Face Recognition Security with a Unified Generative Model Framework

abstract: Face anti-spoofing (FAS) and adversarial detection (FAD) have been regarded as critical technologies to ensure the safety of face recognition systems. As a consequence of their limited practicality and generalization, some existing methods aim to devise a framework capable of concurrently detecting both threats to address the challenge. Nevertheless, these methods still encounter challenges of insufficient generalization and suboptimal robustness, potentially owing to the inherent drawback of discriminative models. Motivated by the rich structural and detailed features of face generative models, we propose FaceCat which utilizes the face generative model as a pre-trained model to improve the performance of FAS and FAD. Specifically, FaceCat elaborately designs a hierarchical fusion mechanism to capture rich face semantic features of the generative model. These features then serve as a robust foundation for a lightweight head, designed to execute FAS and FAD tasks simultaneously. As relying solely on single-modality data often leads to suboptimal performance, we further propose a novel text-guided multi-modal alignment strategy that utilizes text prompts to enrich feature representation, thereby enhancing performance. For fair evaluations, we build a comprehensive protocol with a wide range of 28 attack types to benchmark the performance. Extensive experiments validate the effectiveness of FaceCat generalizes significantly better and obtains excellent robustness against input transformations.


title: Bayesian modeling of co-occurrence microbial interaction networks

abstract: The human body consists of microbiomes associated with the development and prevention of several diseases. These microbial organisms form several complex interactions that are informative to the scientific community for explaining disease progression and prevention. Contrary to the traditional view of the microbiome as a singular, assortative network, we introduce a novel statistical approach using a weighted stochastic infinite block model to analyze the complex community structures within microbial co-occurrence microbial interaction networks. Our model defines connections between microbial taxa using a novel semi-parametric rank-based correlation method on their transformed relative abundances within a fully connected network framework. Employing a Bayesian nonparametric approach, the proposed model effectively clusters taxa into distinct communities while estimating the number of communities. The posterior summary of the taxa community membership is obtained based on the posterior probability matrix, which could naturally solve the label switching problem. Through simulation studies and real-world application to microbiome data from postmenopausal patients with recurrent urinary tract infections, we demonstrate that our method has superior clustering accuracy over alternative approaches. This advancement provides a more nuanced understanding of microbiome organization, with significant implications for disease research.


title: Wave maps in dimension $1+1$ with an external forcing

abstract: This paper aims to establish the local and global well-posedness theory in $L^1$, inspired by the approach of Keel and Tao [Internat. Math. Res. Notices, 1998], for the forced wave map equation in the ``external'' formalism. In this context, the target manifold is treated as a submanifold of a Euclidean space. As a corollary, we reprove Zhou's [Math. Z., 1999] uniqueness result, leading to the uniqueness of weak solutions with locally finite energy. Additionally, we achieve the scattering of such solutions through a conformal compactification argument.


title: Surfactant-laden bubble bursting: dynamics of capillary waves and Worthington jet at large Bond number

abstract: We present a numerical study of the main sub-stages preceding aerosol formation via bursting bubbles: capillary wave propagation along the bubble, convergence at the bubble's apex, the ascent of a Worthington jet and its break-up to release liquid drops. We focus on two crucial yet overlooked aspects of the system: the presence of surface-active agents and dynamics driven by non-negligible gravitational effects, quantified by the Bond number. Our results propose, for the first time, a mechanism explaining capillary wave retardation in the presence of surfactants, involving the transition from bi- to uni-directional Marangoni stresses, which pull the interface upwards, countering the motion of the waves. We also quantitatively elucidate the variable nature of the waves' velocity with various surfactant parameters, including surfactant solubility and elasticity, a departure from the constant behaviour well-documented in clean interfaces.


title: Investigating Cosmic Homogeneity Using Multi-fractal Analysis of the SDSS-IV eBOSS DR16 Quasar Catalog

abstract: We analyze the volume-limited subsamples extracted from the sixteenth data release of the SDSS-IV eBOSS quasar survey spanning a redshift interval of $0.8 < z < 2.2$, to estimate the scale of transition to homogeneity in the Universe. The multi-fractal analysis used for this purpose considers the scaling behavior of different moments of quasar distribution in different density environments. This analysis gives the spectrum of generalized dimension $D_q$, where positive values of $q$ characterize the scaling behavior in over-dense regions and the negative ones in under-dense regions. We expect fractal correlation dimension $D_q(r) = 3$, for a homogeneous, random point distribution in 3-Dimensions. The fractal correlation dimension $D_q(r)$, corresponding to $q=2$ obtained in our study stabilizes in the range (2.8-2.9) for scales $r>80$ $h^{-1}$ Mpc. The observed quasar distribution shows consistency with the simulated mock data and the random distribution of quasars within one sigma. Further, the generalized dimension spectrum $D_q(r)$ also reveals transition to homogeneity beyond $>110$ $h^{-1}$ Mpc, and the dominance of clustering at small scales $r<80$ $h^{-1}$ Mpc. Consequently, our study provides strong evidence for the homogeneity in SDSS quasar distribution, offering insights into large-scale structure properties and, thus can play a pivotal role in scrutinizing the clustering properties of quasars and its evolution in various upcoming surveys such as Dark Energy Spectroscopic Instrument (DESI) and Extremely Large Telescope (ELT).


title: Unsourced Random Access in MIMO Quasi-Static Rayleigh Fading Channels with Finite Blocklength

abstract: This paper explores the fundamental limits of unsourced random access (URA) with a random and unknown number ${\rm{K}}_a$ of active users in MIMO quasi-static Rayleigh fading channels. First, we derive an upper bound on the probability of incorrectly estimating the number of active users. We prove that it exponentially decays with the number of receive antennas and eventually vanishes, whereas reaches a plateau as the power and blocklength increase. Then, we derive non-asymptotic achievability and converse bounds on the minimum energy-per-bit required by each active user to reliably transmit $J$ bits with blocklength $n$. Numerical results verify the tightness of our bounds, suggesting that they provide benchmarks to evaluate existing schemes. The extra required energy-per-bit due to the uncertainty of the number of active users decreases as $\mathbb{E}[{\rm{K}}_a]$ increases. Compared to random access with individual codebooks, the URA paradigm achieves higher spectral and energy efficiency. Moreover, using codewords distributed on a sphere is shown to outperform the Gaussian random coding scheme in the non-asymptotic regime.


title: Observation of the Josephson effect in superhydrides: DC SQUID based on (La,Ce)H$_{10}$ with operating temperature of 179 K

abstract: Among known materials, hydride superconductors have the highest critical temperatures and are very promising as a basis for electronic sensors. Superconducting quantum interference device (SQUID), due to its unique sensitivity to magnetic fields, is the most important application of superconductors in microelectronics. In this work, we describe a direct current SQUID made of lanthanum-cerium superhydride (La, Ce)H$_{10}$ at a pressure of 148 GPa, with an operating temperature of 179 K and a bias current of about 2 mA. When placing (La, Ce)H$_{10}$ in a modulated magnetic field (0.1-0.005 Hz, 5 G), we observed the generation of higher harmonics up to 18${\nu}$$_0$ and a periodic dependence of the sample resistance on the magnetic flux density R ${\propto}$ cos(${\pi}$${\Phi}$/${\Phi}$$_0$). We demonstrate that the (La, Ce)H$_{10}$ SQUID with a size of about 6 ${\mu}$m, operates in the mode of low thermal fluctuations and can be used to detect magnetic fields below 0.1 G. Our findings pave the road to more advanced applications of the Josephson effect and SQUIDs made of hydride superconductors.


title: Tube-RRT*: Efficient Homotopic Path Planning for Swarm Robotics Passing-Through Large-Scale Obstacle Environments

abstract: Recently, the concept of optimal virtual tube has emerged as a novel solution to the challenging task of navigating obstacle-dense environments for swarm robotics, offering a wide ranging of applications. However, it lacks an efficient homotopic path planning method in obstacle-dense environments. This paper introduces Tube-RRT*, an innovative homotopic path planning method that builds upon and improves the Rapidly-exploring Random Tree (RRT) algorithm. Tube-RRT* is specifically designed to generate homotopic paths for the trajectories in the virtual tube, strategically considering opening volume and tube length to mitigate swarm congestion and ensure agile navigation. Through comprehensive comparative simulations conducted within complex, large-scale obstacle environments, we demonstrate the effectiveness of Tube-RRT*.


title: Joint Near Field Uplink Communication and Localization Using Message Passing-Based Sparse Bayesian Learning

abstract: This work deals with the problem of uplink communication and localization in an integrated sensing and communication system, where users are in the near field (NF) of antenna aperture due to the use of high carrier frequency and large antenna arrays at base stations. We formulate joint NF signal detection and localization as a problem of recovering signals with a sparse pattern. To solve the problem, we develop a message passing based sparse Bayesian learning (SBL) algorithm, where multiple unitary approximate message passing (UAMP)-based sparse signal estimators work jointly to recover the sparse signals with low complexity. Simulation results demonstrate the effectiveness of the proposed method.


title: Anomalous magnetoentropic response of skrymion crystals

abstract: We investigate theoretically magnetoentropic signatures of the crystal phase of magnetic skyrmions of various kinds, commonly appearing in two dimensions, \textit{viz.}, N\'eel, Bloch and anti skyrmions. Using Monte Carlo calculations based on spin Hamiltonians, we obtain magnetic entropy change $\Delta S_m$ in the presence of three different types of Dzyaloshinskii-Moriya interactions responsible for these skyrmions. The phase mapping of $\Delta S_m$ using skyrmion counting number $N_{sk}$ in temperature-magnetic field plane reveals fluctuation-dominated weak first-order transition in the precursor phase of the skyrmions, and a sign change in $\Delta S_m$ when the system enters into the skyrmion crystal phase -- in agreement with recent experimental findings. We also find that the fractional entropy change in going from a ferromagnetic phase to the skyrmion crystal phase is much larger compared to the conventional route of paramagnetic phase to ferromagnetic phase, used for the purpose of magnetic cooling. The magnetoentropic signatures of the different types of skyrmion crystals are found to be similar. Our results indicate that the skyrmion crystals exhibit enhanced cooling efficiency and have the potential to upgrade the existing magnetic cooling methods.


title: Advanced Intelligent Optimization Algorithms for Multi-Objective Optimal Power Flow in Future Power Systems: A Review

abstract: This review explores the application of intelligent optimization algorithms to Multi-Objective Optimal Power Flow (MOPF) in enhancing modern power systems. It delves into the challenges posed by the integration of renewables, smart grids, and increasing energy demands, focusing on evolutionary algorithms, swarm intelligence, and deep reinforcement learning. The effectiveness, scalability, and application of these algorithms are analyzed, with findings suggesting that algorithm selection is contingent on the specific MOPF problem at hand, and hybrid approaches offer significant promise. The importance of standard test systems for verifying solutions and the role of software tools in facilitating analysis are emphasized. Future research is directed towards exploiting machine learning for dynamic optimization, embracing decentralized energy systems, and adapting to evolving policy frameworks to improve power system efficiency and sustainability. This review aims to advance MOPF research by highlighting state-of-the-art methodologies and encouraging the development of innovative solutions for future energy challenges.


title: TextHawk: Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models

abstract: Multimodal Large Language Models (MLLMs) have shown impressive results on various multimodal tasks. However, most existing MLLMs are not well suited for document-oriented tasks, which require fine-grained image perception and information compression. In this paper, we present TextHawk, a MLLM that is specifically designed for document-oriented tasks, while preserving the general capabilities of MLLMs. TextHawk is aimed to explore efficient fine-grained perception by designing four dedicated components. Firstly, a ReSampling and ReArrangement (ReSA) module is proposed to reduce the redundancy in the document texts and lower the computational cost of the MLLM. We explore encoding the positions of each local feature by presenting Scalable Positional Embeddings (SPEs), which can preserve the scalability of various image sizes. A Query Proposal Network (QPN) is then adopted to initialize the queries dynamically among different sub-images. To further enhance the fine-grained visual perceptual ability of the MLLM, we design a Multi-Level Cross-Attention (MLCA) mechanism that captures the hierarchical structure and semantic relations of document images. Furthermore, we create a new instruction-tuning dataset for document-oriented tasks by enriching the multimodal document data with Gemini Pro. We conduct extensive experiments on both general and document-oriented MLLM benchmarks, and show that TextHawk outperforms the state-of-the-art methods, demonstrating its effectiveness and superiority in fine-grained document perception and general abilities.


title: Apparent violation of causality in relativistic quantum mechanics

abstract: In relativistic theories the principle of microscopic causality states that ``information cannot travel faster than the speed of light'' \cite{kaku}. In the present work we show that the time evolution of relativistic wave functions violates this principle. We consider here the wave functions of massless and massive particles. In the case of massless particles the wave functions which violate the microscopic causality have an analytic form while in the case of massive particles we have to rely on numerical calculations. In both cases the wave functions which are strictly localized at $t=0$, at later times do not vanish {\it outside} the future light cone. \end{abstract}


title: DKE-Research at SemEval-2024 Task 2: Incorporating Data Augmentation with Generative Models and Biomedical Knowledge to Enhance Inference Robustness

abstract: Safe and reliable natural language inference is critical for extracting insights from clinical trial reports but poses challenges due to biases in large pre-trained language models. This paper presents a novel data augmentation technique to improve model robustness for biomedical natural language inference in clinical trials. By generating synthetic examples through semantic perturbations and domain-specific vocabulary replacement and adding a new task for numerical and quantitative reasoning, we introduce greater diversity and reduce shortcut learning. Our approach, combined with multi-task learning and the DeBERTa architecture, achieved significant performance gains on the NLI4CT 2024 benchmark compared to the original language models. Ablation studies validate the contribution of each augmentation method in improving robustness. Our best-performing model ranked 12th in terms of faithfulness and 8th in terms of consistency, respectively, out of the 32 participants.


title: DEGNN: Dual Experts Graph Neural Network Handling Both Edge and Node Feature Noise

abstract: Graph Neural Networks (GNNs) have achieved notable success in various applications over graph data. However, recent research has revealed that real-world graphs often contain noise, and GNNs are susceptible to noise in the graph. To address this issue, several Graph Structure Learning (GSL) models have been introduced. While GSL models are tailored to enhance robustness against edge noise through edge reconstruction, a significant limitation surfaces: their high reliance on node features. This inherent dependence amplifies their susceptibility to noise within node features. Recognizing this vulnerability, we present DEGNN, a novel GNN model designed to adeptly mitigate noise in both edges and node features. The core idea of DEGNN is to design two separate experts: an edge expert and a node feature expert. These experts utilize self-supervised learning techniques to produce modified edges and node features. Leveraging these modified representations, DEGNN subsequently addresses downstream tasks, ensuring robustness against noise present in both edges and node features of real-world graphs. Notably, the modification process can be trained end-to-end, empowering DEGNN to adjust dynamically and achieves optimal edge and node representations for specific tasks. Comprehensive experiments demonstrate DEGNN's efficacy in managing noise, both in original real-world graphs and in graphs with synthetic noise.


title: Logarithmic multicanonical systems of smooth affine surfaces of logarithmic Kodaira dimension one

abstract: Let $S$ be a smooth affine surface of logarithmic Kodaira dimension one and let $(V,D)$ be a pair of a smooth projective surface $V$ and a simple normal crossing divisor $D$ on $V$ such that $V \setminus \operatorname{Supp} D = S$. In this paper, we consider the logarithmic multicanonical system $|m(K_V + D)|$. We prove that, for any $m \geq 8$, $|m(K_V+D)|$ gives an $\mathbb{P}^1$-fibration form $V$ onto a smooth projective curve.


title: Numerical Methods for Optimal Boundary Control of Advection-Diffusion-Reaction Systems

abstract: This paper considers the optimal boundary control of chemical systems described by advection-diffusion-reaction (ADR) equations. We use a discontinuous Galerkin finite element method (DG-FEM) for the spatial discretization of the governing partial differential equations, and the optimal control problem is directly discretized using multiple shooting. The temporal discretization and the corresponding sensitivity calculations are achieved by an explicit singly diagonally-implicit Runge Kutta (ESDIRK) method. ADR systems arise in process systems engineering and their operation can potentially be improved by nonlinear model predictive control (NMPC). We demonstrate a numerical approach for the solution to their optimal control problems (OCPs) in a chromatography case study. Preparative liquid chromatography is an important downstream process in biopharmaceutical manufacturing. We show that multi-step elution trajectories for batch processes can be optimized for economic objectives, providing superior performance compared to classical gradient elution trajectories.


title: FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning

abstract: Federated Learning (FL) is a novel approach that allows for collaborative machine learning while preserving data privacy by leveraging models trained on decentralized devices. However, FL faces challenges due to non-uniformly distributed (non-iid) data across clients, which impacts model performance and its generalization capabilities. To tackle the non-iid issue, recent efforts have utilized the global model as a teaching mechanism for local models. However, our pilot study shows that their effectiveness is constrained by imbalanced data distribution, which induces biases in local models and leads to a 'local forgetting' phenomenon, where the ability of models to generalize degrades over time, particularly for underrepresented classes. This paper introduces FedDistill, a framework enhancing the knowledge transfer from the global model to local models, focusing on the issue of imbalanced class distribution. Specifically, FedDistill employs group distillation, segmenting classes based on their frequency in local datasets to facilitate a focused distillation process to classes with fewer samples. Additionally, FedDistill dissects the global model into a feature extractor and a classifier. This separation empowers local models with more generalized data representation capabilities and ensures more accurate classification across all classes. FedDistill mitigates the adverse effects of data imbalance, ensuring that local models do not forget underrepresented classes but instead become more adept at recognizing and classifying them accurately. Our comprehensive experiments demonstrate FedDistill's effectiveness, surpassing existing baselines in accuracy and convergence speed across several benchmark datasets.


title: Flat Band Josephson Junctions with Quantum Metric

abstract: In this work, we consider superconductor/flat band material/superconductor (S/FB/S) Josephson junctions (JJs) where the flat band material possesses isolated flat bands with exactly zero Fermi velocity. Contrary to conventional S/N/S JJs where the critical Josephson current vanishes when the Fermi velocity goes to zero, we show in this work that the critical current in the S/FB/S junction is controlled by the quantum metric length $\xi_\mathrm{QM}$ of the flat bands. Microscopically, when $\xi_\mathrm{QM}$ of the flat band is long enough, the interface bound states originally localized at the two S/FB, FB/S interfaces can penetrate deeply into the flat band material and hybridize to form Andreev bound states (ABSs). These ABSs are able to carry long range and sizable supercurrents. Importantly, $\xi_\mathrm{QM}$ also controls how far the proximity effect can penetrate into the flat band material. This stands in sharp contrast to the de Gennes' theory for S/N junctions which predicts that the proximity effect is expected to be zero when the Fermi velocity of the normal metal is zero. We further suggest that the S/FB/S junctions would give rise to a new type of resonant Josephson transistors which can carry sizable and highly gate-tunable supercurrent.


title: Physics-informed tracking of qubit fluctuations

abstract: Environmental fluctuations degrade the performance of solid-state qubits but can in principle be mitigated by real-time Hamiltonian estimation down to time scales set by the estimation efficiency. We implement a physics-informed and an adaptive Bayesian estimation strategy and apply them in real time to a semiconductor spin qubit. The physics-informed strategy propagates a probability distribution inside the quantum controller according to the Fokker-Planck equation, appropriate for describing the effects of nuclear spin diffusion in gallium-arsenide. Evaluating and narrowing the anticipated distribution by a predetermined qubit probe sequence enables improved dynamical tracking of the uncontrolled magnetic field gradient within the singlet-triplet qubit. The adaptive strategy replaces the probe sequence by a small number of qubit probe cycles, with each probe time conditioned on the previous measurement outcomes, thereby further increasing the estimation efficiency. The combined real-time estimation strategy efficiently tracks low-frequency nuclear spin fluctuations in solid-state qubits, and can be applied to other qubit platforms by tailoring the appropriate update equation to capture their distinct noise sources.


title: Qandle: Accelerating State Vector Simulation Using Gate-Matrix Caching and Circuit Splitting

abstract: To address the computational complexity associated with state-vector simulation for quantum circuits, we propose a combination of advanced techniques to accelerate circuit execution. Quantum gate matrix caching reduces the overhead of repeated applications of the Kronecker product when applying a gate matrix to the state vector by storing decomposed partial matrices for each gate. Circuit splitting divides the circuit into sub-circuits with fewer gates by constructing a dependency graph, enabling parallel or sequential execution on disjoint subsets of the state vector. These techniques are implemented using the PyTorch machine learning framework. We demonstrate the performance of our approach by comparing it to other PyTorch-compatible quantum state-vector simulators. Our implementation, named Qandle, is designed to seamlessly integrate with existing machine learning workflows, providing a user-friendly API and compatibility with the OpenQASM format. Qandle is an open-source project hosted on GitHub https://github.com/gstenzel/qandle and PyPI https://pypi.org/project/qandle/ .


title: PrintListener: Uncovering the Vulnerability of Fingerprint Authentication via the Finger Friction Sound

abstract: Fingerprint authentication has been extensively employed in contemporary identity verification systems owing to its rapidity and cost-effectiveness. Due to its widespread use, fingerprint leakage may cause sensitive information theft, enormous economic and personnel losses, and even a potential compromise of national security. As a fingerprint that can coincidentally match a specific proportion of the overall fingerprint population, MasterPrint rings the alarm bells for the security of fingerprint authentication. In this paper, we propose a new side-channel attack on the minutiae-based Automatic Fingerprint Identification System (AFIS), called PrintListener, which leverages users' fingertip swiping actions on the screen to extract fingerprint pattern features (the first-level features) and synthesizes a stronger targeted PatternMasterPrint with potential second-level features. The attack scenario of PrintListener is extensive and covert. It only needs to record users' fingertip friction sound and can be launched by leveraging a large number of social media platforms. Extensive experimental results in realworld scenarios show that Printlistener can significantly improve the attack potency of MasterPrint.


title: Optimum Beamforming and Grating Lobe Mitigation for Intelligent Reflecting Surfaces

abstract: Ensuring adequate wireless coverage in upcoming communication technologies such as 6G is expected to be challenging. This is because user demands of higher datarate require an increase in carrier frequencies, which in turn reduce the diffraction effects (and hence coverage) in complex multipath environments. Intelligent reflecting surfaces have been proposed as a way of restoring coverage by adaptively reflecting incoming electromagnetic waves in desired directions. This is accomplished by judiciously adding extra phases at different points on the surface. In practice, these extra phases are only available in discrete quantities due to hardware constraints. Computing these extra phases is computationally challenging when they can only be picked from a discrete distribution, and existing approaches for solving this problem were either heuristic or based on evolutionary algorithms. We solve this problem by proposing fast algorithms with provably optimal solutions. Our algorithms have linear complexity, and are presented with rigorous proofs for their optimality. We show that the proposed algorithms exhibit better performance. We analyze situations when unwanted grating lobes arise in the radiation pattern, and discuss mitigation strategies, such as the use of triangular lattices and prephasing techniques, to eliminate them. We also demonstrate how our algorithms can leverage these techniques to deliver optimum beamforming solutions.


title: DetCLIPv3: Towards Versatile Generative Open-vocabulary Object Detection

abstract: Existing open-vocabulary object detectors typically require a predefined set of categories from users, significantly confining their application scenarios. In this paper, we introduce DetCLIPv3, a high-performing detector that excels not only at both open-vocabulary object detection, but also generating hierarchical labels for detected objects. DetCLIPv3 is characterized by three core designs: 1. Versatile model architecture: we derive a robust open-set detection framework which is further empowered with generation ability via the integration of a caption head. 2. High information density data: we develop an auto-annotation pipeline leveraging visual large language model to refine captions for large-scale image-text pairs, providing rich, multi-granular object labels to enhance the training. 3. Efficient training strategy: we employ a pre-training stage with low-resolution inputs that enables the object captioner to efficiently learn a broad spectrum of visual concepts from extensive image-text paired data. This is followed by a fine-tuning stage that leverages a small number of high-resolution samples to further enhance detection performance. With these effective designs, DetCLIPv3 demonstrates superior open-vocabulary detection performance, \eg, our Swin-T backbone model achieves a notable 47.0 zero-shot fixed AP on the LVIS minival benchmark, outperforming GLIPv2, GroundingDINO, and DetCLIPv2 by 18.0/19.6/6.6 AP, respectively. DetCLIPv3 also achieves a state-of-the-art 19.7 AP in dense captioning task on VG dataset, showcasing its strong generative capability.


title: Bosonic construction of CKP tau function

abstract: The CKP tau function has been an important topic in mathematical physics. In this paper, the inverse of vacuum expectation value of exponential of certain bosonic fields, is showed to be the CKP tau function given by Chang and Wu, in the language of CKP Darboux transformation. In fact, computation of the above vacuum expectation value is usually quite difficult, since the square of bosonic fields is usually not zero. Here the corresponding vacuum expectation value is understood as successive application of CKP Darboux transformations, so that we can compute it by using the methods of integrable systems, where a useful formula is given. For applications, we construct solutions of KdV hierarchy by vacuum expectation value of bosonic fields, by the fact that KdV hierarchy is the 2-reduction of CKP hierarchy.


title: Opportunistic Information-Bottleneck for Goal-oriented Feature Extraction and Communication

abstract: The Information Bottleneck (IB) method is an information theoretical framework to design a parsimonious and tunable feature-extraction mechanism, such that the extracted features are maximally relevant to a specific learning or inference task. Despite its theoretical value, the IB is based on a functional optimization problem that admits a closed form solution only on specific cases (e.g., Gaussian distributions), making it difficult to be applied in most applications, where it is necessary to resort to complex and approximated variational implementations. To overcome this limitation, we propose an approach to adapt the closed-form solution of the Gaussian IB to a general task. Whichever is the inference task to be performed by a (possibly deep) neural-network, the key idea is to opportunistically design a regression sub-task, embedded in the original problem, where we can safely assume a (joint) multivariate normality between the sub-task's inputs and outputs. In this way we can exploit a fixed and pre-trained neural network to process the input data, using a tunable number of features, to trade data-size and complexity for accuracy. This approach is particularly useful every time a device needs to transmit data (or features) to a server that has to fulfil an inference task, as it provides a principled way to extract the most relevant features for the task to be executed, while looking for the best trade-off between the size of the feature vector to be transmitted, inference accuracy, and complexity. Extensive simulation results testify the effectiveness of the proposed method and encourage to further investigate this research line.


title: Observation of $D \to a_{0}(980)\pi$ in the decays $D^{0} \rightarrow \pi^{+}\pi^{-}\eta$ and $D^{+} \rightarrow \pi^{+}\pi^{0}\eta$

abstract: We report the first amplitude analysis of the decays $D^{0} \to \pi^{+} \pi^{-} \eta$ and $D^{+} \rightarrow \pi^{+}\pi^{0}\eta$ using a data sample taken with the BESIII detector at the center-of-mass energy of 3.773 GeV, corresponding to an integrated luminosity of 7.9 ${\rm fb}^{-1}$. The contribution from the process $D^{0(+)} \to a_{0}(980)^{+} \pi^{-(0)}$ is significantly larger than the $D^{0(+)} \to a_{0}(980)^{-(0)} \pi^{+}$ contribution. The ratios $\mathcal{B}(D^{0} \rightarrow a_{0}(980)^{+}\pi^{-})/\mathcal{B}(D^{0} \rightarrow a_{0}(980)^{-}\pi^{+})$ and $\mathcal{B}(D^{+} \rightarrow a_{0}(980)^{+}\pi^{0})/\mathcal{B}(D^{+} \rightarrow a_{0}(980)^{0}\pi^{+})$ are measured to be $7.5^{+2.5}_{-0.8\,\mathrm{stat.}}\pm1.7_{\mathrm{syst.}}$ and $2.6\pm0.6_{\mathrm{stat.}}\pm0.3_{\mathrm{syst.}}$, respectively. The measured $D^{0}$ ratio disagrees with the theoretical predictions by orders of magnitudes, thus implying a substantial contribution from final-state interactions.


title: Compass: Large Multilingual Language Model for South-east Asia

abstract: Large language models have exhibited significant proficiency in languages endowed with extensive linguistic resources, such as English and Chinese. Nevertheless, their effectiveness notably diminishes when applied to languages characterized by limited linguistic resources, particularly within the Southeast Asian linguistic landscape, such as Indonesian. The scarcity of linguistic resources for these languages presents challenges associated with inadequate training, restricted vocabulary coverage, and challenging evaluation processes. In response to these exigencies, we have introduced CompassLLM, a large multilingual model specifically tailored for Southeast Asian languages, with the primary aim of supporting the developmental requirements of Shopee. Our methodology encompasses several key strategies. To progressively enhance multilingual proficiencies, we implemented a multi-stage pre-training strategy integrated with curriculum learning, gradually intensifying the focus on low-resource languages. Concurrently, to better accommodate low-resource human instructions, we curated and generated a repository of high-quality multilingual human instructions, culminating the CompassLLM-SFT model through supervised instruction fine-tuning. Finally, to reinforce the model's alignment with human preference behaviors, we have embraced the principle of Direct Preference Optimization (DPO) to obtain CompassLLM-DPO model. Preliminary evaluation of the CompassLLM model yields promising results, with our model surpassing benchmark models like Vicuna-7b-v1.5, Sealion, Falcon and SeaLLM, across diverse evaluation tasks, as verified through both automated and human-driven assessments. Notably, our model exhibits its superior performance in South-east Asia languages, such as Indonesian language.


title: Exploring and Improving Drafts in Blockwise Parallel Decoding

abstract: Despite the remarkable strides made by autoregressive language models, their potential is often hampered by the slow inference speeds inherent in sequential token generation. Blockwise parallel decoding (BPD) was proposed by Stern et al. as a method to improve inference speed of language models by simultaneously predicting multiple future tokens, termed block drafts, which are subsequently verified and conditionally accepted by the autoregressive model. This paper contributes to the understanding and improvement of block drafts in two ways. First, we analyze the token distributions produced by multiple prediction heads. Secondly, we leverage this analysis to develop algorithms to improve BPD inference speed by refining the block drafts using n-gram and neural language models. Experiments demonstrate that refined block drafts yield a +5-21% increase in block efficiency (i.e., the number of accepted tokens from the block draft) across diverse datasets.


title: Design and Fabrication of String-driven Origami Robots

abstract: Origami designs and structures have been widely used in many fields, such as morphing structures, robotics, and metamaterials. However, the design and fabrication of origami structures rely on human experiences and skills, which are both time and labor-consuming. In this paper, we present a rapid design and fabrication method for string-driven origami structures and robots. We developed an origami design software to generate desired crease patterns based on analytical models and Evolution Strategies (ES). Additionally, the software can automatically produce 3D models of origami designs. We then used a dual-material 3D printer to fabricate those wrapping-based origami structures with the required mechanical properties. We utilized Twisted String Actuators (TSAs) to fold the target 3D structures from flat plates. To demonstrate the capability of these techniques, we built and tested an origami crawling robot and an origami robotic arm using 3D-printed origami structures driven by TSAs.


title: OSS Myths and Facts

abstract: We have selected six myths about the OSS community and have tested whether they are true or not. The purpose of this report is to identify the lessons that can be learned from the development style of the OSS community and the issues that need to be addressed in order to achieve better Employee Experience (EX) in software development within companies and organizations. The OSS community has been led by a group of skilled developers known as hackers. We have great respect for the engineers and activities of the OSS community and aim to learn from them. On the other hand, it is important to recognize that having high expectations can sometimes result in misunderstandings. When there are excessive expectations and concerns, misunderstandings (referred to as myths) can arise, particularly when individuals who are not practitioners rely on hearsay to understand the practices of practitioners. We selected the myths to be tested based on a literature review and interviews. These myths are held by software development managers and customers who are not direct participants in the OSS community. We answered questions about each myth through: 1) Our own analysis of repository data, 2) A literature survey of data analysis conducted by previous studies, or 3) A combination of the two approaches.


title: Quotient Modules of Finite Length and Their Relation to Fredholm Elements in Semiprime Rings

abstract: B. A. Barnes introduced so-called Fredholm elements in a semiprime ring whose definition is inspired by Atkinson's theorem. Here the socle of a semiprime ring generalizes the ideal of finite-rank operators on a Banach space. In this paper, we aim to see that the algebraic concept of the length of a module is strongly related to that of Fredholm elements. This motivates another generalization of Fredholm elements by requiring for an element $a\in\mathcal{A}$ that the $\mathcal{A}$-modules of the form $\mathcal{A}/\mathcal{A} a$ and $\mathcal{A}/a\mathcal{A}$ are of finite length. We are particularly interested in sufficient conditions for our generalized Fredholm elements to be Fredholm. In a unital C$^*$-algebra $\mathcal{A}$ we shall even see that an element $a\in\mathcal{A}$ is Fredholm if and only if the $\mathcal{A}$-modules $\mathcal{A}/\mathcal{A} a$ and $\mathcal{A}/a\mathcal{A}$ both have finite length.


title: Nonlocal Gravity, Dark Energy and Conformal Symmetry: Testing the Hierarchies of Anomaly-Induced Actions

abstract: Conformal back-reaction generates cosmological models where the trace anomaly reflects the breaking of Weyl invariance. Analyzing these actions yields a dynamic approach to dark energy through anomaly-induced actions (AIAs), that are variational solutions of the trace anomaly functional constraint. Expanded around Minkowski space, they produce semiclassical correlators subject to hierarchical anomalous Ward identities, tied to conformal symmetry and diffeomorphism invariance. We focus on comparing the hierarchy of a specific 4-point function, particularly the 2-gravitons-2-photons correlator $(TTJJ)$, generated by AIAs, to free field theory realizations of the same correlator. We observe that the free field theory original hierarchy splits into one ordinary and one anomalous hierarchy, both satisfying the conservation Ward identities from diffeomorphism invariance. However, we find that the anomalous hierarchy derived from ordinary AIAs in both the Riegert or Fradkin-Vilkovisky gauges, are either affected by double poles or violate the hierarchy of the trace Ward identity, respectively. We show that correct forms of the anomalous hierarchies of 4-point functions (for the $TTTT$ and $TTJJ$), identified in a perturbative free field theory expansion around flat space, are characterised by anomaly poles, corresponding to a curvature expansion in $R\Box^{-1}$, together with Weyl invariant terms. We derive the effective action that generates the correct form of the hierarchy for the $TTJJ$.


title: Breast Cancer Image Classification Method Based on Deep Transfer Learning

abstract: To address the issues of limited samples, time-consuming feature design, and low accuracy in detection and classification of breast cancer pathological images, a breast cancer image classification model algorithm combining deep learning and transfer learning is proposed. This algorithm is based on the DenseNet structure of deep neural networks, and constructs a network model by introducing attention mechanisms, and trains the enhanced dataset using multi-level transfer learning. Experimental results demonstrate that the algorithm achieves an efficiency of over 84.0\% in the test set, with a significantly improved classification accuracy compared to previous models, making it applicable to medical breast cancer detection tasks.


title: DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling

abstract: Recent progress in text-to-3D creation has been propelled by integrating the potent prior of Diffusion Models from text-to-image generation into the 3D domain. Nevertheless, generating 3D scenes characterized by multiple instances and intricate arrangements remains challenging. In this study, we present DreamScape, a method for creating highly consistent 3D scenes solely from textual descriptions, leveraging the strong 3D representation capabilities of Gaussian Splatting and the complex arrangement abilities of large language models (LLMs). Our approach involves a 3D Gaussian Guide ($3{DG^2}$) for scene representation, consisting of semantic primitives (objects) and their spatial transformations and relationships derived directly from text prompts using LLMs. This compositional representation allows for local-to-global optimization of the entire scene. A progressive scale control is tailored during local object generation, ensuring that objects of different sizes and densities adapt to the scene, which addresses training instability issue arising from simple blending in the subsequent global optimization stage. To mitigate potential biases of LLM priors, we model collision relationships between objects at the global level, enhancing physical correctness and overall realism. Additionally, to generate pervasive objects like rain and snow distributed extensively across the scene, we introduce a sparse initialization and densification strategy. Experiments demonstrate that DreamScape offers high usability and controllability, enabling the generation of high-fidelity 3D scenes from only text prompts and achieving state-of-the-art performance compared to other methods.


title: A Survey on Integration of Large Language Models with Intelligent Robots

abstract: In recent years, the integration of large language models (LLMs) has revolutionized the field of robotics, enabling robots to communicate, understand, and reason with human-like proficiency. This paper explores the multifaceted impact of LLMs on robotics, addressing key challenges and opportunities for leveraging these models across various domains. By categorizing and analyzing LLM applications within core robotics elements -- communication, perception, planning, and control -- we aim to provide actionable insights for researchers seeking to integrate LLMs into their robotic systems. Our investigation focuses on LLMs developed post-GPT-3.5, primarily in text-based modalities while also considering multimodal approaches for perception and control. We offer comprehensive guidelines and examples for prompt engineering, facilitating beginners' access to LLM-based robotics solutions. Through tutorial-level examples and structured prompt construction, we illustrate how LLM-guided enhancements can be seamlessly integrated into robotics applications. This survey serves as a roadmap for researchers navigating the evolving landscape of LLM-driven robotics, offering a comprehensive overview and practical guidance for harnessing the power of language models in robotics development.


title: A stable splitting for spaces of commuting elements in unitary groups

abstract: We prove an analogue of Miller's stable splitting of the unitary group $U(m)$ for spaces of commuting elements in $U(m)$. After inverting $m!$, the space $\text{Hom}(\mathbb{Z}^n,U(m))$ splits stably as a wedge of Thom-like spaces of bundles of commuting varieties over certain partial flag manifolds. Using Steenrod operations we prove that our splitting does not hold integrally. Analogous decompositions for symplectic and orthogonal groups as well as homological results for the one-point compactification of the commuting variety in a Lie algebra are also provided.


title: Dynamics of spherical telescopic linear driven rotation robots

abstract: Lunar caves are promising features for long-term and permanent human presence on the moon. However, given their inaccessibility to imaging from survey satellites, the concrete environment within the underground cavities is not well known. Thus, to further the efforts of human presence on the moon, these caves are to be explored by robotic systems. However, a set of environmental factors make this exploration particularly challenging. Among those are the very fine lunar dust that damages exposed sensors and actuators and the unknown composition of the surface and obstacles within the cavity. One robotic system that is particularly fit to meet these challenges is that of a spherical robot, as the exterior shell completely separates the sensors and actuators from the hazardous environment. This work introduces the mathematical description in the form of a dynamic model of a novel locomotion approach for this form factor that adds additional functionality. A set of telescopic linearly extending rods moves the robot using a combination of pushing away from the ground and leveraging the gravitational torque. The approach allows the system to locomote, overcome objects by hoisting its center of gravity on top, and transform into a terrestrial laser scanner by using the rods as a tripod.


title: Tri-modal Confluence with Temporal Dynamics for Scene Graph Generation in Operating Rooms

abstract: A comprehensive understanding of surgical scenes allows for monitoring of the surgical process, reducing the occurrence of accidents and enhancing efficiency for medical professionals. Semantic modeling within operating rooms, as a scene graph generation (SGG) task, is challenging since it involves consecutive recognition of subtle surgical actions over prolonged periods. To address this challenge, we propose a Tri-modal (i.e., images, point clouds, and language) confluence with Temporal dynamics framework, termed TriTemp-OR. Diverging from previous approaches that integrated temporal information via memory graphs, our method embraces two advantages: 1) we directly exploit bi-modal temporal information from the video streaming for hierarchical feature interaction, and 2) the prior knowledge from Large Language Models (LLMs) is embedded to alleviate the class-imbalance problem in the operating theatre. Specifically, our model performs temporal interactions across 2D frames and 3D point clouds, including a scale-adaptive multi-view temporal interaction (ViewTemp) and a geometric-temporal point aggregation (PointTemp). Furthermore, we transfer knowledge from the biomedical LLM, LLaVA-Med, to deepen the comprehension of intraoperative relations. The proposed TriTemp-OR enables the aggregation of tri-modal features through relation-aware unification to predict relations so as to generate scene graphs. Experimental results on the 4D-OR benchmark demonstrate the superior performance of our model for long-term OR streaming.


title: MAP: Model Aggregation and Personalization in Federated Learning with Incomplete Classes

abstract: In some real-world applications, data samples are usually distributed on local devices, where federated learning (FL) techniques are proposed to coordinate decentralized clients without directly sharing users' private data. FL commonly follows the parameter server architecture and contains multiple personalization and aggregation procedures. The natural data heterogeneity across clients, i.e., Non-I.I.D. data, challenges both the aggregation and personalization goals in FL. In this paper, we focus on a special kind of Non-I.I.D. scene where clients own incomplete classes, i.e., each client can only access a partial set of the whole class set. The server aims to aggregate a complete classification model that could generalize to all classes, while the clients are inclined to improve the performance of distinguishing their observed classes. For better model aggregation, we point out that the standard softmax will encounter several problems caused by missing classes and propose "restricted softmax" as an alternative. For better model personalization, we point out that the hard-won personalized models are not well exploited and propose "inherited private model" to store the personalization experience. Our proposed algorithm named MAP could simultaneously achieve the aggregation and personalization goals in FL. Abundant experimental studies verify the superiorities of our algorithm.


title: Dynamical Behavior of a Stochastic Epidemiological Model: Stationary Distribution and Extinction of a SIRS Model with Stochastic Perturbations

abstract: This paper deals with a new epidemiological model of SIRS with stochastic perturbations. The primary objective is to establish the existence of a unique non-negative nonlocal solution. Using the basic reproduction number $\mathscr{R}_0$ derived from the associated deterministic model, we demonstrate the existence of a stationary distribution in the stochastic model. In addition, we study the fluctuation of the unique solution of the deterministic problem around the disease-free equilibrium under certain conditions. In particular, we reveal scenarios where random effects induce disease extinction, contrary to the persistence predicted by the deterministic model. The theoretical insights are complemented by numerical simulations, which provide further validation of our findings.


title: Distribution and Recovery Phase of Geomagnetic Storms During Solar Cycles 23 and 24

abstract: Coronal mass ejections (CMEs) and Stream Interaction Regions (SIRs) are the main drivers of intense geomagnetic storms. We study the distribution of geomagnetic storms associated with different drivers during solar cycles 23 and 24 (1996-2019). Although the annual occurrence rate of geomagnetic storms in both cycles tracks the sunspot cycle, the second peak in storm activity lags the second sunspot peak. SIRs contribute significantly to the second peak in storm numbers in both cycles, particularly for moderate to stronger-than-moderate storms. We note semiannual peaks in storm numbers much closer to equinoxes for moderate storms, and slightly shifted from equinoxes for intense and stronger-than-intense storms. We note a significant fraction of multiple-peak storms in both cycles due to isolated ICMEs/SIRs, while single-peak storms from multiple interacting drivers, suggesting a complex relationship between storm steps and their drivers. Our study focuses on investigating the recovery phases of geomagnetic storms and examining their dependencies on various storm parameters. Multiple-peak storms in both cycles have recovery phase duration strongly influenced by slow and fast decay phases with no correlation with the main phase buildup rate and Dst peak. However, the recovery phase in single-peak storms for both cycles depends to some extent on the main phase buildup rate and Dst peak, in addition to slow and fast decay phases. Future research should explore recovery phases of single and multiple-peak storms incorporating in-situ solar wind observations for a deeper understanding of storm evolution and decay processes.


title: PDRs4All IX. Sulfur elemental abundance in the Orion Bar

abstract: One of the main problems in astrochemistry is determining the amount of sulfur in volatiles and refractories in the interstellar medium. The detection of the main sulfur reservoirs (icy H$_2$S and atomic gas) has been challenging, and estimates are based on the reliability of models to account for the abundances of species containing less than 1% of the total sulfur. The high sensitivity of the James Webb Space Telescope provides an unprecedented opportunity to estimate the sulfur abundance through the observation of the [S I] 25.249 $\mu$m line. We used the [S III] 18.7 $\mu$m, [S IV] 10.5 $\mu$m, and [S l] 25.249 $\mu$m lines to estimate the amount of sulfur in the ionized and molecular gas along the Orion Bar. For the theoretical part, we used an upgraded version of the Meudon photodissociation region (PDR) code to model the observations. New inelastic collision rates of neutral atomic sulfur with ortho- and para- molecular hydrogen were calculated to predict the line intensities. The [S III] 18.7 $\mu$m and [S IV] 10.5 $\mu$m lines are detected over the imaged region with a shallow increase (by a factor of 4) toward the HII region. We estimate a moderate sulfur depletion, by a factor of $\sim$2, in the ionized gas. The corrugated interface between the molecular and atomic phases gives rise to several edge-on dissociation fronts we refer to as DF1, DF2, and DF3. The [S l] 25.249 $\mu$m line is only detected toward DF2 and DF3, the dissociation fronts located farthest from the HII region. The detailed modeling of DF3 using the Meudon PDR code shows that the emission of the [S l] 25.249 $\mu$m line is coming from warm ($>$ 40 K) molecular gas located at A$_{\rm V}$ $\sim$ 1$-$5 mag from the ionization front. Moreover, the intensity of the [S l] 25.249 $\mu$m line is only accounted for if we assume the presence of undepleted sulfur.


title: The complexity of convexity number and percolation time in the cycle convexity

abstract: The subject of graph convexity is well explored in the literature, the so-called interval convexities above all. In this work, we explore the cycle convexity, an interval convexity whose interval function is $I(S) = S \cup \{u \mid G[S \cup \{u\}]$ has a cycle containing $u\}$. In this convexity, we prove that determine whether the convexity number of a graph $G$ is at least $k$ is \NP-complete and \W[1]-hard when parameterized by the size of the solution when $G$ is a thick spider, but polynomial when $G$ is an extended $P_4$-laden graph. We also prove that determining whether the percolation time of a graph is at least $k$ is \NP-complete even for fixed $k \geq 9$, but polynomial for cacti or for fixed $k\leq2$.


title: Some new bistable transition fronts with changing shape

abstract: We construct entire solutions of bistable reaction-diffusion equations by mixing finite planar fronts, which form a finite-dimensional manifold. These entire solutions are generalized traveling fronts, that is, transition fronts. We also show their uniqueness and stability. Furthermore, we prove that transition fronts with level sets having finite facets are determined by finite planar fronts and they are in the class of entire solutions constructed by us.


title: Eigenvalue Preferential Attachment Networks A Dandelion Structure

abstract: In this paper we introduce a new type of preferential attachment network, the growth of which is based on the eigenvalue centrality. In this network, the agents attach most probably to the nodes with larger eigenvalue centrality which represents that the agent has stronger connections. A new network is presented, namely a dandelion network, which shares some properties of star-like structure and also a hierarchical network. We show that this network, having hub-and-spoke topology is not generally scale free, and shows essential differences with respect to the Barab{\'a}si-Albert preferential attachment model. Most importantly, there is a super hub agent in the system (identified by a pronounced peak in the spectrum), and the other agents are classified in terms of the distance to this super-hub. We explore a plenty of statistical centralities like the nodes degree, the betweenness and the eigenvalue centrality, along with various measures of structure like the community and hierarchical structures, and the clustering coefficient. Global measures like the shortest path statistics and the self-similarity are also examined.


title: Early warning signals of the tipping point in strongly interacting Rydberg atoms

abstract: The identification of tipping points is essential for prediction of collapses or other sudden changes in complex systems. Applications include studies of ecology, thermodynamics, climatology, and epidemiology. However, detecting early signs of proximity to a tipping is made challenging by complexity and non-linearity. Strongly interacting Rydberg atom gases offer a model systems that offer both complexity and non-linearity, including phase transition and critical slowing down. Here, via an external probe we observe prior warning of the proximity of a phase transition of Rydberg thermal gases. This warning signal is manifested as a cessation of the variance growth with increasing probe intensity. We also observed the dynamics of the critical slowing down behavior versus different time scales, driving intensities, and atomic densities, thus providing insights into the study of a Rydberg atom system's critical behavior. Our experiment suggests that the full critical slowing down dynamics of strongly-interacting Rydberg atoms can be probed systematically, thus providing a benchmark with which to identify critical phenomena in quantum many-body systems.


title: Fault Detection in Mobile Networks Using Diffusion Models

abstract: In today's hyper-connected world, ensuring the reliability of telecom networks becomes increasingly crucial. Telecom networks encompass numerous underlying and intertwined software and hardware components, each providing different functionalities. To ensure the stability of telecom networks, telecom software, and hardware vendors developed several methods to detect any aberrant behavior in telecom networks and enable instant feedback and alerts. These approaches, although powerful, struggle to generalize due to the unsteady nature of the software-intensive embedded system and the complexity and diversity of multi-standard mobile networks. In this paper, we present a system to detect anomalies in telecom networks using a generative AI model. We evaluate several strategies using diffusion models to train the model for anomaly detection using multivariate time-series data. The contributions of this paper are threefold: (i) A proposal of a framework for utilizing diffusion models for time-series anomaly detection in telecom networks, (ii) A proposal of a particular Diffusion model architecture that outperforms other state-of-the-art techniques, (iii) Experiments on a real-world dataset to demonstrate that our model effectively provides explainable results, exposing some of its limitations and suggesting future research avenues to enhance its capabilities further.


title: An Empirical Evaluation of Manually Created Equivalent Mutants

abstract: Mutation testing consists of evaluating how effective test suites are at detecting artificially seeded defects in the source code, and guiding the improvement of the test suites. Although mutation testing tools are increasingly adopted in practice, equivalent mutants, i.e., mutants that differ only in syntax but not semantics, hamper this process. While prior research investigated how frequently equivalent mutants are produced by mutation testing tools and how effective existing methods of detecting these equivalent mutants are, it remains unclear to what degree humans also create equivalent mutants, and how well they perform at identifying these. We therefore study these questions in the context of Code Defenders, a mutation testing game, in which players competitively produce mutants and tests. Using manual inspection as well as automated identification methods we establish that less than 10 % of manually created mutants are equivalent. Surprisingly, our findings indicate that a significant portion of developers struggle to accurately identify equivalent mutants, emphasizing the need for improved detection mechanisms and developer training in mutation testing.


title: Constraining Near-Simultaneous Radio Emission from Short Gamma-ray Bursts using CHIME/FRB

abstract: We use the Canadian Hydrogen Intensity Mapping Experiment (CHIME) Fast Radio Burst (FRB) Project to search for FRBs that are temporally and spatially coincident with gamma-ray bursts (GRBs) occurring between 2018 July 7 and 2023 August 3. We do not find any temporal (within 1 week) and spatial (within overlapping 3 sigma localization regions) coincidences between any CHIME/FRB candidates and all GRBs with 1 sigma localization uncertainties <1 deg. As such, we use CHIME/FRB to constrain the possible FRB-like radio emission for 27 short gamma-ray bursts (SGRBs) that were within 17 deg. of CHIME/FRB's meridian at a point either 6 hrs prior up to 12 hrs after the high-energy emission. Two SGRBs, GRB 210909A and GRB 230208A, were above the horizon at CHIME at the time of their high-energy emission and we place some of the first constraints on simultaneous FRB-like radio emission from SGRBs. While neither of these two SGRBs have known redshifts, we construct a redshift range for each GRB based on their high-energy fluence and a derived SGRB energy distribution. For GRB 210909A, this redshift range corresponds to z = [0.009, 1.64] with a mean of z=0.13. Thus, for GRB 210909A, we constrain the radio luminosity at the time of the high-energy emission to L <2 x 10e46 erg s-1, L < 5 x 10e44 erg s-1, and L < 3 x 10e42 erg s-1 assuming redshifts of z=0.85, z=0.16, and z=0.013, respectively. We compare these constraints with the predicted simultaneous radio luminosities from different compact object merger models.


title: LSROM: Learning Self-Refined Organizing Map for Fast Imbalanced Streaming Data Clustering

abstract: Streaming data clustering is a popular research topic in the fields of data mining and machine learning. Compared to static data, streaming data, which is usually analyzed in data chunks, is more susceptible to encountering the dynamic cluster imbalanced issue. That is, the imbalanced degree of clusters varies in different streaming data chunks, leading to corruption in either the accuracy or the efficiency of streaming data analysis based on existing clustering methods. Therefore, we propose an efficient approach called Learning Self-Refined Organizing Map (LSROM) to handle the imbalanced streaming data clustering problem, where we propose an advanced SOM for representing the global data distribution. The constructed SOM is first refined for guiding the partition of the dataset to form many micro-clusters to avoid the missing small clusters in imbalanced data. Then an efficient merging of the micro-clusters is conducted through quick retrieval based on the SOM, which can automatically yield a true number of imbalanced clusters. In comparison to existing imbalanced data clustering approaches, LSROM is with a lower time complexity $O(n\log n)$, while achieving very competitive clustering accuracy. Moreover, LSROM is interpretable and insensitive to hyper-parameters. Extensive experiments have verified its efficacy.


title: A Joint Data Compression and Time-Delay Estimation Method For Distributed Systems via Extremum Encoding

abstract: Motivated by the proliferation of mobile devices, we consider a basic form of the ubiquitous problem of time-delay estimation (TDE), but with communication constraints between two non co-located sensors. In this setting, when joint processing of the received signals is not possible, a compression technique that is tailored to TDE is desirable. For our basic TDE formulation, we develop such a joint compression-estimation strategy based on the notion of what we term "extremum encoding", whereby we send the index of the maximum of a finite-length time-series from one sensor to another. Subsequent joint processing of the encoded message with locally observed data gives rise to our proposed time-delay "maximum-index"-based estimator. We derive an exponentially tight upper bound on its error probability, establishing its consistency with respect to the number of transmitted bits. We further validate our analysis via simulations, and comment on potential extensions and generalizations of the basic methodology.


title: Arena: A Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics

abstract: The advent of edge computing has made real-time intelligent video analytics feasible. Previous works, based on traditional model architecture (e.g., CNN, RNN, etc.), employ various strategies to filter out non-region-of-interest content to minimize bandwidth and computation consumption but show inferior performance in adverse environments. Recently, visual foundation models based on transformers have shown great performance in adverse environments due to their amazing generalization capability. However, they require a large amount of computation power, which limits their applications in real-time intelligent video analytics. In this paper, we find visual foundation models like Vision Transformer (ViT) also have a dedicated acceleration mechanism for video analytics. To this end, we introduce Arena, an end-to-end edge-assisted video inference acceleration system based on ViT. We leverage the capability of ViT that can be accelerated through token pruning by only offloading and feeding Patches-of-Interest (PoIs) to the downstream models. Additionally, we employ probability-based patch sampling, which provides a simple but efficient mechanism for determining PoIs where the probable locations of objects are in subsequent frames. Through extensive evaluations on public datasets, our findings reveal that Arena can boost inference speeds by up to $1.58\times$ and $1.82\times$ on average while consuming only 54% and 34% of the bandwidth, respectively, all with high inference accuracy.


title: Engaging Young Learners with Testing Using the Code Critters Mutation Game

abstract: Everyone learns to code nowadays. Writing code, however, does not go without testing, which unfortunately rarely seems to be taught explicitly. Testing is often not deemed important enough or is just not perceived as sufficiently exciting. Testing can be exciting: In this paper, we introduce Code Critters, a serious game designed to teach testing concepts engagingly. In the style of popular tower defense games, players strategically position magical portals that need to distinguish between creatures exhibiting the behavior described by correct code from those that are mutated, and thus faulty. When placing portals, players are implicitly testing: They choose test inputs (i.e., where to place portals), as well as test oracles (i.e., what behavior to expect), and they observe test executions as the creatures wander across the landscape passing the players' portals. An empirical study involving 40 children demonstrates that they actively engage with Code Critters. Their positive feedback provides evidence that they enjoyed playing the game, and some of the children even continued to play Code Critters at home, outside the educational setting of our study.


title: Generalization Error Bounds for Learning under Censored Feedback

abstract: Generalization error bounds from learning theory provide statistical guarantees on how well an algorithm will perform on previously unseen data. In this paper, we characterize the impacts of data non-IIDness due to censored feedback (a.k.a. selective labeling bias) on such bounds. We first derive an extension of the well-known Dvoretzky-Kiefer-Wolfowitz (DKW) inequality, which characterizes the gap between empirical and theoretical CDFs given IID data, to problems with non-IID data due to censored feedback. We then use this CDF error bound to provide a bound on the generalization error guarantees of a classifier trained on such non-IID data. We show that existing generalization error bounds (which do not account for censored feedback) fail to correctly capture the model's generalization guarantees, verifying the need for our bounds. We further analyze the effectiveness of (pure and bounded) exploration techniques, proposed by recent literature as a way to alleviate censored feedback, on improving our error bounds. Together, our findings illustrate how a decision maker should account for the trade-off between strengthening the generalization guarantees of an algorithm and the costs incurred in data collection when future data availability is limited by censored feedback.


title: Knowledgeable Agents by Offline Reinforcement Learning from Large Language Model Rollouts

abstract: Reinforcement learning (RL) trains agents to accomplish complex tasks through environmental interaction data, but its capacity is also limited by the scope of the available data. To obtain a knowledgeable agent, a promising approach is to leverage the knowledge from large language models (LLMs). Despite previous studies combining LLMs with RL, seamless integration of the two components remains challenging due to their semantic gap. This paper introduces a novel method, Knowledgeable Agents from Language Model Rollouts (KALM), which extracts knowledge from LLMs in the form of imaginary rollouts that can be easily learned by the agent through offline reinforcement learning methods. The primary challenge of KALM lies in LLM grounding, as LLMs are inherently limited to textual data, whereas environmental data often comprise numerical vectors unseen to LLMs. To address this, KALM fine-tunes the LLM to perform various tasks based on environmental data, including bidirectional translation between natural language descriptions of skills and their corresponding rollout data. This grounding process enhances the LLM's comprehension of environmental dynamics, enabling it to generate diverse and meaningful imaginary rollouts that reflect novel skills. Initial empirical evaluations on the CLEVR-Robot environment demonstrate that KALM enables agents to complete complex rephrasings of task goals and extend their capabilities to novel tasks requiring unprecedented optimal behaviors. KALM achieves a success rate of 46% in executing tasks with unseen goals, substantially surpassing the 26% success rate achieved by baseline methods. Furthermore, KALM effectively enables the LLM to comprehend environmental dynamics, resulting in the generation of meaningful imaginary rollouts that reflect novel skills and demonstrate the seamless integration of large language models and reinforcement learning.


title: Test Code Generation for Telecom Software Systems using Two-Stage Generative Model

abstract: In recent years, the evolution of Telecom towards achieving intelligent, autonomous, and open networks has led to an increasingly complex Telecom Software system, supporting various heterogeneous deployment scenarios, with multi-standard and multi-vendor support. As a result, it becomes a challenge for large-scale Telecom software companies to develop and test software for all deployment scenarios. To address these challenges, we propose a framework for Automated Test Generation for large-scale Telecom Software systems. We begin by generating Test Case Input data for test scenarios observed using a time-series Generative model trained on historical Telecom Network data during field trials. Additionally, the time-series Generative model helps in preserving the privacy of Telecom data. The generated time-series software performance data are then utilized with test descriptions written in natural language to generate Test Script using the Generative Large Language Model. Our comprehensive experiments on public datasets and Telecom datasets obtained from operational Telecom Networks demonstrate that the framework can effectively generate comprehensive test case data input and useful test code.


title: A norm inequality on noncommutative symmetric spaces related to a question of Bourin

abstract: In this note, we study a question introduced by Bourin \cite{2009Matrix} and partially solve the question of Bourin. In fact, for t\in[0,\frac{1}{4}]\cup[\frac{3}{4},1], we show that |||x^{t}y^{1-t}+y^{t}x^{1-t}|||\leq|||x+y|||, where x,y\in\mathbb{M}_{n}(\mathbb{C})^+ and \||\cdot\|| is the unitarily invariant norm. Moreover, we prove that the above inequality holds on noncommutative fully symmetric spaces.


title: Multipolar Electromagnetic Emission of Newborn Magnetar

abstract: It is generally recognized that the electromagnetic multipolar emission from magnetars can be used to explain radiation from Soft Gamma Repeaters (SGRs) or Anomalous X-ray Pulsars (AXPs), but they have little impact on the spindown of magnetars. We here present a comprehensive analytical solution for the neutron star multipolar electromagnetic fields and their associated expected luminosities. We find that for newborn millisecond magnetars, the spin-down luminosity from higher multipolar components can match or even exceed that from the dipole component. Such high-intensity radiation will undoubtedly affect related astrophysical phenomena at the birth of a magnetar. We show that the spin-down luminosity from multipoles can well explain the majority of Gamma-Ray Bursts (GRBs) afterglows, from the plateau starting at several hundred seconds till the normal decay phase lasting for many years. The fitted magnetar parameters for GRB afterglows are all typical values, with spins in the millisecond range and magnetic field strengths in the order of $10^{14} - 10^{15}$ Gauss. Our results in turn, provide support for the hypothesis that GRBs originate from the birth of magnetars with a few millisecond period, thus deepening our understanding of the complex magnetic field structure and the equation of state of magnetars.


title: Inertial range of magnetorotational turbulence

abstract: Accretion disks around compact stars are formed due to turbulence driven by magnetorotational instability. Despite over thirty years of numerous computational studies on magnetorotational turbulence, the properties of fluctuations in the inertial range -- where cross-scale energy transfer dominates over energy injection -- have remained elusive, primarily due to insufficient numerical resolution. Here, we report the highest-resolution simulation of magnetorotational turbulence ever conducted. Our simulations reveal a constant cross-scale energy flux, a hallmark of the inertial range. We found that as the cascade proceeds to smaller scales in the inertial range, the kinetic and magnetic energies tend toward equipartitioning with the same spectral slope, and slow-magnetosonic fluctuations dominate over Alfv\'enic fluctuations, possessing twice the energy. These findings align remarkably with the theoretical expectations from the reduced magnetohydrodynamic model, which assumes a near-azimuthal mean magnetic field. Our results provide important implications for interpreting the radio observations by the Event Horizon Telescope.


title: Competitive Retrieval: Going Beyond the Single Query

abstract: Previous work on the competitive retrieval setting focused on a single-query setting: document authors manipulate their documents so as to improve their future ranking for a given query. We study a competitive setting where authors opt to improve their document's ranking for multiple queries. We use game theoretic analysis to prove that equilibrium does not necessarily exist. We then empirically show that it is more difficult for authors to improve their documents' rankings for multiple queries with a neural ranker than with a state-of-the-art feature-based ranker. We also present an effective approach for predicting the document most highly ranked in the next induced ranking.


title: TEXT2TASTE: A Versatile Egocentric Vision System for Intelligent Reading Assistance Using Large Language Model

abstract: The ability to read, understand and find important information from written text is a critical skill in our daily lives for our independence, comfort and safety. However, a significant part of our society is affected by partial vision impairment, which leads to discomfort and dependency in daily activities. To address the limitations of this part of society, we propose an intelligent reading assistant based on smart glasses with embedded RGB cameras and a Large Language Model (LLM), whose functionality goes beyond corrective lenses. The video recorded from the egocentric perspective of a person wearing the glasses is processed to localise text information using object detection and optical character recognition methods. The LLM processes the data and allows the user to interact with the text and responds to a given query, thus extending the functionality of corrective lenses with the ability to find and summarize knowledge from the text. To evaluate our method, we create a chat-based application that allows the user to interact with the system. The evaluation is conducted in a real-world setting, such as reading menus in a restaurant, and involves four participants. The results show robust accuracy in text retrieval. The system not only provides accurate meal suggestions but also achieves high user satisfaction, highlighting the potential of smart glasses and LLMs in assisting people with special needs.


title: Quiver matroids -- Matroid morphisms, quiver Grassmannians, their Euler characteristics and $\mathbb{F}_1$-points

abstract: In this paper, we introduce morphisms for matroids with coefficients (in the sense of Baker and Bowler) and quiver matroids. We investigate their basic properties, such as functoriality, duality, minors and cryptomorphic characterizations in terms of vectors, circuits and bases (a.k.a. Grassmann-Pl\"ucker functions). We generalize quiver matroids to quiver matroid bundles and construct their moduli space, which is an $\mathbb{F}_1$-analogue of a complex quiver Grassmannian. Eventually we introduce a suitable interpretation of $\mathbb{F}_1$-points for these moduli spaces, so that in 'nice' cases their number is equal to the Euler characteristic of the associated complex quiver Grassmannian.


title: Foundational GPT Model for MEG

abstract: Deep learning techniques can be used to first training unsupervised models on large amounts of unlabelled data, before fine-tuning the models on specific tasks. This approach has seen massive success for various kinds of data, e.g. images, language, audio, and holds the promise of improving performance in various downstream tasks (e.g. encoding or decoding brain data). However, there has been limited progress taking this approach for modelling brain signals, such as Magneto-/electroencephalography (M/EEG). Here we propose two classes of deep learning foundational models that can be trained using forecasting of unlabelled MEG. First, we consider a modified Wavenet; and second, we consider a modified Transformer-based (GPT2) model. The modified GPT2 includes a novel application of tokenisation and embedding methods, allowing a model developed initially for the discrete domain of language to be applied to continuous multichannel time series data. We also extend the forecasting framework to include condition labels as inputs, enabling better modelling (encoding) of task data. We compare the performance of these deep learning models with standard linear autoregressive (AR) modelling on MEG data. This shows that GPT2-based models provide better modelling capabilities than Wavenet and linear AR models, by better reproducing the temporal, spatial and spectral characteristics of real data and evoked activity in task data. We show how the GPT2 model scales well to multiple subjects, while adapting its model to each subject through subject embedding. Finally, we show how such a model can be useful in downstream decoding tasks through data simulation. All code is available on GitHub (https://github.com/ricsinaruto/MEG-transfer-decoding).