title: Affordable mixed-integer Lagrangian methods: optimality conditions and convergence analysis

abstract: Necessary optimality conditions in Lagrangian form and the augmented Lagrangian framework are extended to mixed-integer nonlinear optimization, without any convexity assumptions. Building upon a recently developed notion of local optimality for problems with polyhedral and integrality constraints, a characterization of local minimizers and critical points is given for problems including also nonlinear constraints. This approach lays the foundations for developing affordable sequential minimization algorithms with convergence guarantees to critical points from arbitrary initializations. A primal-dual perspective, a local saddle point property, and the dual relationships with the proximal point algorithm are also advanced in the presence of integer variables.


title: Slow rates of approximation of U-statistics and V-statistics by quadratic forms of Gaussians

abstract: We construct examples of degree-two U- and V-statistics of $n$ i.i.d.~heavy-tailed random vectors in $\mathbb{R}^{d(n)}$, whose $\nu$-th moments exist for ${\nu > 2}$, and provide tight bounds on the error of approximating both statistics by a quadratic form of Gaussians. In the case ${\nu=3}$, the error of approximation is $\Theta(n^{-1/12})$. The proof adapts a result of Huang, Austern and Orbanz [12] to U- and V-statistics. The lower bound for U-statistics is a simple example of the concept of variance domination used in [12].


title: Tracking Real-time Anomalies in Cyber-Physical Systems Through Dynamic Behavioral Analysis

abstract: Increased connectivity and remote reprogrammability/reconfigurability features of embedded devices in current-day power systems (including interconnections between information technology -- IT -- and operational technology -- OT -- networks) enable greater agility, reduced operator workload, and enhanced power system performance and capabilities. However, these features also expose a wider cyber-attack surface, underscoring need for robust real-time monitoring and anomaly detection in power systems, and more generally in Cyber-Physical Systems (CPS). The increasingly complex, diverse, and potentially untrustworthy software and hardware supply chains also make need for robust security tools more stringent. We propose a novel framework for real-time monitoring and anomaly detection in CPS, specifically smart grid substations and SCADA systems. The proposed method enables real-time signal temporal logic condition-based anomaly monitoring by processing raw captured packets from the communication network through a hierarchical semantic extraction and tag processing pipeline into time series of semantic events and observations, that are then evaluated against expected temporal properties to detect and localize anomalies. We demonstrate efficacy of our methodology on a hardware in the loop testbed, including multiple physical power equipment (real-time automation controllers and relays) and simulated devices (Phasor Measurement Units -- PMUs, relays, Phasor Data Concentrators -- PDCs), interfaced to a dynamic power system simulator. The performance and accuracy of the proposed system is evaluated on multiple attack scenarios on our testbed.


title: A data-centric approach for assessing progress of Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have achieved state-of-the-art results in node classification tasks. However, most improvements are in multi-class classification, with less focus on the cases where each node could have multiple labels. The first challenge in studying multi-label node classification is the scarcity of publicly available datasets. To address this, we collected and released three real-world biological datasets and developed a multi-label graph generator with tunable properties. We also argue that traditional notions of homophily and heterophily do not apply well to multi-label scenarios. Therefore, we define homophily and Cross-Class Neighborhood Similarity for multi-label classification and investigate $9$ collected multi-label datasets. Lastly, we conducted a large-scale comparative study with $8$ methods across nine datasets to evaluate current progress in multi-label node classification. We release our code at \url{https://github.com/Tianqi-py/MLGNC}.


title: Deep self-supervised learning with visualisation for automatic gesture recognition

abstract: Gesture is an important mean of non-verbal communication, with visual modality allows human to convey information during interaction, facilitating peoples and human-machine interactions. However, it is considered difficult to automatically recognise gestures. In this work, we explore three different means to recognise hand signs using deep learning: supervised learning based methods, self-supervised methods and visualisation based techniques applied to 3D moving skeleton data. Self-supervised learning used to train fully connected, CNN and LSTM method. Then, reconstruction method is applied to unlabelled data in simulated settings using CNN as a backbone where we use the learnt features to perform the prediction in the remaining labelled data. Lastly, Grad-CAM is applied to discover the focus of the models. Our experiments results show that supervised learning method is capable to recognise gesture accurately, with self-supervised learning increasing the accuracy in simulated settings. Finally, Grad-CAM visualisation shows that indeed the models focus on relevant skeleton joints on the associated gesture.


title: Cycle-Correspondence Loss: Learning Dense View-Invariant Visual Features from Unlabeled and Unordered RGB Images

abstract: Robot manipulation relying on learned object-centric descriptors became popular in recent years. Visual descriptors can easily describe manipulation task objectives, they can be learned efficiently using self-supervision, and they can encode actuated and even non-rigid objects. However, learning robust, view-invariant keypoints in a self-supervised approach requires a meticulous data collection approach involving precise calibration and expert supervision. In this paper we introduce Cycle-Correspondence Loss (CCL) for view-invariant dense descriptor learning, which adopts the concept of cycle-consistency, enabling a simple data collection pipeline and training on unpaired RGB camera views. The key idea is to autonomously detect valid pixel correspondences by attempting to use a prediction over a new image to predict the original pixel in the original image, while scaling error terms based on the estimated confidence. Our evaluation shows that we outperform other self-supervised RGB-only methods, and approach performance of supervised methods, both with respect to keypoint tracking as well as for a robot grasping downstream task.


title: Abstraction-of-Thought Makes Language Models Better Reasoners

abstract: Abstract reasoning, the ability to reason from the abstract essence of a problem, serves as a key to generalization in human reasoning. However, eliciting language models to perform reasoning with abstraction remains unexplored. This paper seeks to bridge this gap by introducing a novel structured reasoning format called Abstraction-of-Thought (AoT). The uniqueness of AoT lies in its explicit requirement for varying levels of abstraction within the reasoning process. This approach could elicit language models to first contemplate on the abstract level before incorporating concrete details, which is overlooked by the prevailing step-by-step Chain-of-Thought (CoT) method. To align models with the AoT format, we present AoT Collection, a generic finetuning dataset consisting of 348k high-quality samples with AoT reasoning processes, collected via an automated and scalable pipeline. We finetune a wide range of language models with AoT Collection and conduct extensive evaluations on 23 unseen tasks from the challenging benchmark Big-Bench Hard. Experimental results indicate that models aligned to AoT reasoning format substantially outperform those aligned to CoT in many reasoning tasks.


title: Robustness Testing of Multi-Modal Models in Varied Home Environments for Assistive Robots

abstract: The development of assistive robotic agents to support household tasks is advancing, yet the underlying models often operate in virtual settings that do not reflect real-world complexity. For assistive care robots to be effective in diverse environments, their models must be robust and integrate multiple modalities. Consider a caretaker needing assistance in a dimly lit room or navigating around a newly installed glass door. Models relying solely on visual input might fail in low light, while those using depth information could avoid the door. This demonstrates the necessity for models that can process various sensory inputs. Our ongoing study evaluates state-of-the-art robotic models in the AI2Thor virtual environment. We introduce disturbances, such as dimmed lighting and mirrored walls, to assess their impact on modalities like movement or vision, and object recognition. Our goal is to gather input from the Geriatronics community to understand and model the challenges faced by practitioners.


title: Who Checks the Checkers? Exploring Source Credibility in Twitter's Community Notes

abstract: In recent years, the proliferation of misinformation on social media platforms has become a significant concern. Initially designed for sharing information and fostering social connections, platforms like Twitter (now rebranded as X) have also unfortunately become conduits for spreading misinformation. To mitigate this, these platforms have implemented various mechanisms, including the recent suggestion to use crowd-sourced non-expert fact-checkers to enhance the scalability and efficiency of content vetting. An example of this is the introduction of Community Notes on Twitter. While previous research has extensively explored various aspects of Twitter tweets, such as information diffusion, sentiment analytics and opinion summarization, there has been a limited focus on the specific feature of Twitter Community Notes, despite its potential role in crowd-sourced fact-checking. Prior research on Twitter Community Notes has involved empirical analysis of the feature's dataset and comparative studies that also include other methods like expert fact-checking. Distinguishing itself from prior works, our study covers a multi-faceted analysis of sources and audience perception within Community Notes. We find that the majority of cited sources are news outlets that are left-leaning and are of high factuality, pointing to a potential bias in the platform's community fact-checking. Left biased and low factuality sources validate tweets more, while Center sources are used more often to refute tweet content. Additionally, source factuality significantly influences public agreement and helpfulness of the notes, highlighting the effectiveness of the Community Notes Ranking algorithm. These findings showcase the impact and biases inherent in community-based fact-checking initiatives.


title: DAOs' Business Value from an Open Systems Perspective: A Best-Fit Framework Synthesis

abstract: Decentralized autonomous organizations (DAOs) are emerging innovative organizational structures, enabling collective coordination, and reshaping digital collaboration. Despite the promising and transformative characteristics of DAOs, the potential technological advancements and the understanding of the business value that organizations derive from implementing DAO characteristics are limited. This research applies a systematic review of DAOs' business applicability from an open systems perspective following a best-fit framework methodology. Within our approach, combining both framework and thematic analysis, we discuss how the open business principles apply to DAOs and present a new DAO business framework comprising of four core business elements: i) token, ii) transactions, iii) value system and iv) strategy with their corresponding sub-characteristics. This paper offers a preliminary DAO business framework that enhances the understanding of DAOs' transformative potential and guides organizations in innovating more inclusive business models (BMs), while also providing a theoretical foundation for researchers to build upon.


title: Adaptive Mean Estimation in the Hidden Markov sub-Gaussian Mixture Model

abstract: We investigate the problem of center estimation in the high dimensional binary sub-Gaussian Mixture Model with Hidden Markov structure on the labels. We first study the limitations of existing results in the high dimensional setting and then propose a minimax optimal procedure for the problem of center estimation. Among other findings, we show that our procedure reaches the optimal rate that is of order $\sqrt{\delta d/n} + d/n$ instead of $\sqrt{d/n} + d/n$ where $\delta \in(0,1)$ is a dependence parameter between labels. Along the way, we also develop an adaptive variant of our procedure that is globally minimax optimal. In order to do so, we rely on a more refined and localized analysis of the estimation risk. Overall, leveraging the hidden Markovian dependence between the labels, we show that it is possible to get a strict improvement of the rates adaptively at almost no cost.


title: Text-aware Speech Separation for Multi-talker Keyword Spotting

abstract: For noisy environments, ensuring the robustness of keyword spotting (KWS) systems is essential. While much research has focused on noisy KWS, less attention has been paid to multi-talker mixed speech scenarios. Unlike the usual cocktail party problem where multi-talker speech is separated using speaker clues, the key challenge here is to extract the target speech for KWS based on text clues. To address it, this paper proposes a novel Text-aware Permutation Determinization Training method for multi-talker KWS with a clue-based Speech Separation front-end (TPDT-SS). Our research highlights the critical role of SS front-ends and shows that incorporating keyword-specific clues into these models can greatly enhance the effectiveness. TPDT-SS shows remarkable success in addressing permutation problems in mixed keyword speech, thereby greatly boosting the performance of the backend. Additionally, fine-tuning our system on unseen mixed speech results in further performance improvement.


title: Automated MRI Quality Assessment of Brain T1-weighted MRI in Clinical Data Warehouses: A Transfer Learning Approach Relying on Artefact Simulation

abstract: The emergence of clinical data warehouses (CDWs), which contain the medical data of millions of patients, has paved the way for vast data sharing for research. The quality of MRIs gathered in CDWs differs greatly from what is observed in research settings and reflects a certain clinical reality. Consequently, a significant proportion of these images turns out to be unusable due to their poor quality. Given the massive volume of MRIs contained in CDWs, the manual rating of image quality is impossible. Thus, it is necessary to develop an automated solution capable of effectively identifying corrupted images in CDWs. This study presents an innovative transfer learning method for automated quality control of 3D gradient echo T1-weighted brain MRIs within a CDW, leveraging artefact simulation. We first intentionally corrupt images from research datasets by inducing poorer contrast, adding noise and introducing motion artefacts. Subsequently, three artefact-specific models are pre-trained using these corrupted images to detect distinct types of artefacts. Finally, the models are generalised to routine clinical data through a transfer learning technique, utilising 3660 manually annotated images. The overall image quality is inferred from the results of the three models, each designed to detect a specific type of artefact. Our method was validated on an independent test set of 385 3D gradient echo T1-weighted MRIs. Our proposed approach achieved excellent results for the detection of bad quality MRIs, with a balanced accuracy of over 87%, surpassing our previous approach by 3.5 percent points. Additionally, we achieved a satisfactory balanced accuracy of 79% for the detection of moderate quality MRIs, outperforming our previous performance by 5 percent points. Our framework provides a valuable tool for exploiting the potential of MRIs in CDWs.


title: Retrieval-Augmented Generation for Generative Artificial Intelligence in Medicine

abstract: Generative artificial intelligence (AI) has brought revolutionary innovations in various fields, including medicine. However, it also exhibits limitations. In response, retrieval-augmented generation (RAG) provides a potential solution, enabling models to generate more accurate contents by leveraging the retrieval of external knowledge. With the rapid advancement of generative AI, RAG can pave the way for connecting this transformative technology with medical applications and is expected to bring innovations in equity, reliability, and personalization to health care.


title: On perfect symmetric rank-metric codes

abstract: Let $\mathrm{Sym}_q(m)$ be the space of symmetric matrices in $\mathbb{F}_q^{m\times m}$. A subspace of $\mathrm{Sym}_q(m)$ equipped with the rank distance is called a symmetric rank-metric code. In this paper we study the covering properties of symmetric rank-metric codes. First we characterize symmetric rank-metric codes which are perfect, i.e. that satisfy the equality in the sphere-packing like bound. We show that, despite the rank-metric case, there are non trivial perfect codes. Also, we characterize families of codes which are quasi-perfect.


title: Small maximal clusters are very unlikely in critical random graphs

abstract: We describe a probabilistic methodology, based on random walk estimates, to obtain exponential upper bounds for the probability of observing unusually small maximal components in two classical (near-)critical random graph models. More specifically, we analyse the near-critical Erd\H{o}s-R\'enyi model $\mathbb{G}(n,p)$ and the random graph $\mathbb{G}(n,d,p)$ obtained by performing near-critical $p$-bond percolation on a simple random $d$-regular graph and show that, for each one of these models, the probability that the size of a largest component is smaller than $n^{2/3}/A$ is at most of order $\exp(-A^{3/2})$. The exponent $3/2$ is known to be optimal for the near-critical $\mathbb{G}(n,p)$ random graph, whereas for the near-critical $\mathbb{G}(n,d,p)$ model the best known upper bound for the above probability was of order $A^{-3/5}$. As a secondary result we show, by means of an optimized version of the martingale method of Nachmias and Peres, that the above probability of observing an unusually small maximal component is at most of order $\exp(-A^{3/5})$ in other two critical models, namely a random intersection graph and the quantum random graph; this stretched-exponential bounds also improve upon the known (polynomial) bounds available for these other two critical models.


title: Insect Identification in the Wild: The AMI Dataset

abstract: Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups. Code and datasets are made publicly available.


title: Realization of a classical Ruddlesden Popper type bilayer nickelate in Sr$_3$Ni$_{2-x}$Al$_{x}$O$_{7-\delta}$ with unusual Ni$^{4+}$

abstract: The discovery of 80 K superconductivity in bilayer La$_3$Ni$_2$O$_7$ at pressures greater than 14 GPa presents a unique opportunity to study a novel class of high-temperature superconductors. Therefore, other bilayer nickelate following the classical ($T^{4+}$) Ruddlesden-Popper (RP) series of Sr$_3$Ni$_2$O$_7$ would present an interesting new candidate. In this work, we study the stabilization of RP $n=2$ phase in Sr$_3$Ni$_{2-x}$Al$_{x}$O$_7$, via floating zone growth of crystals. With powder and single crystal XRD, we study the stability range of the RP-type phase. Our Thermogravimetric Analysis (TGA), X-ray photoelectron spectroscopy (XPS) and gas extraction studies reveal a remarkably high oxidation state of Ni$^{4+}$. The obtained black crystals are insulating in transport and show a magnetic transition around 12 K.


title: A Neural Column Generation Approach to the Vehicle Routing Problem with Two-Dimensional Loading and Last-In-First-Out Constraints

abstract: The vehicle routing problem with two-dimensional loading constraints (2L-CVRP) and the last-in-first-out (LIFO) rule presents significant practical and algorithmic challenges. While numerous heuristic approaches have been proposed to address its complexity, stemming from two NP-hard problems: the vehicle routing problem (VRP) and the two-dimensional bin packing problem (2D-BPP), less attention has been paid to developing exact algorithms. Bridging this gap, this article presents an exact algorithm that integrates advanced machine learning techniques, specifically a novel combination of attention and recurrence mechanisms. This integration accelerates the state-of-the-art exact algorithm by a median of 29.79% across various problem instances. Moreover, the proposed algorithm successfully resolves an open instance in the standard test-bed, demonstrating significant improvements brought about by the incorporation of machine learning models. Code is available at https://github.com/xyfffff/NCG-for-2L-CVRP.


title: On the structure of the complement $\overline{\Mfib}$ of the set $\Mfib$ of fibbinary numbers in the set of positive natural numbers

abstract: The set $\Mfib$ of fibbinary numbers is defined via a bijection between the set $\BB{N}$ of natural numbers and $\Mfib$. Since the elements of $\Mfib$ do not exhaust $\BB{N}$, the structure of the complement $\overline{\Mfib}$ of $\Mfib$ in $\BB{N}$ is of interest. An explicit expression $\overline{\Mfib}=\bigcup_{k \geq 1}^\infty \Phi_k$ is obtained in terms of certain well-defined sets $\Phi_k, \; k \geq 1$. The key to its proof lies in first considering the odd numbers involved in this statement: a general treatment, with full justification, of the binary representations of the odd numbers is developed, and exploited in showing the expression quoted for $\overline{\Mfib}$ to be correct. The main results of the article can also be viewed as providing partitions of the set $\BB{N}$ of natural numbers, and also of its subset of odd numbers, that follow from the introduction of the set $\Mfib$, and of its subset of odd integers.


title: Deep-learning-based groupwise registration for motion correction of cardiac $T_1$ mapping

abstract: Quantitative $T_1$ mapping by MRI is an increasingly important tool for clinical assessment of cardiovascular diseases. The cardiac $T_1$ map is derived by fitting a known signal model to a series of baseline images, while the quality of this map can be deteriorated by involuntary respiratory and cardiac motion. To correct motion, a template image is often needed to register all baseline images, but the choice of template is nontrivial, leading to inconsistent performance sensitive to image contrast. In this work, we propose a novel deep-learning-based groupwise registration framework, which omits the need for a template, and registers all baseline images simultaneously. We design two groupwise losses for this registration framework: the first is a linear principal component analysis (PCA) loss that enforces alignment of baseline images irrespective of the intensity variation, and the second is an auxiliary relaxometry loss that enforces adherence of intensity profile to the signal model. We extensively evaluated our method, termed ``PCA-Relax'', and other baseline methods on an in-house cardiac MRI dataset including both pre- and post-contrast $T_1$ sequences. All methods were evaluated under three distinct training-and-evaluation strategies, namely, standard, one-shot, and test-time-adaptation. The proposed PCA-Relax showed further improved performance of registration and mapping over well-established baselines. The proposed groupwise framework is generic and can be adapted to applications involving multiple images.


title: Data Trade and Consumer Privacy

abstract: This paper studies optimal mechanisms for collecting and trading data. Consumers benefit from revealing information about their tastes to a service provider because this improves the service. However, the information is also valuable to a third party as it may extract more revenue from the consumer in another market called the product market. The paper characterizes the constrained optimal mechanism for the service provider subject to incentive feasibility. It is shown that the service provider sometimes sells no information or only partial information in order to preserve profits in the service market. In a general setup, the service provision distortion and no-price discrimination in the product market are exclusive. Moreover, a ban on data trade may reduce social welfare because it makes it harder to price discriminate in the product market.


title: Planning Using Schr\"odinger Bridge Diffusion Models

abstract: Offline planning often struggles with poor sampling efficiency as it tries to learn policies from scratch. Especially with diffusion models, such cold start practices mean that both training and sampling become very expensive. We hypothesize that certain environment constraint priors or cheaply available policies make it unnecessary to learn from scratch, and explore a way to incorporate such priors in the learning process. To achieve that, we borrow a variation of the Schr\"odinger bridge formulation from the image-to-image setting and apply it to planning tasks. We study the performance on some planning tasks and compare the performance against the DDPM formulation. The code for this work is available at https://github.com/adrshsrvstv/bridge_diffusion_planning.


title: HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors

abstract: Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle these issues, we present HumanSplat which predicts the 3D Gaussian Splatting properties of any human from a single input image in a generalizable manner. In particular, HumanSplat comprises a 2D multi-view diffusion model and a latent reconstruction transformer with human structure priors that adeptly integrate geometric priors and semantic features within a unified framework. A hierarchical loss that incorporates human semantic information is further designed to achieve high-fidelity texture modeling and better constrain the estimated multiple views. Comprehensive experiments on standard benchmarks and in-the-wild images demonstrate that HumanSplat surpasses existing state-of-the-art methods in achieving photorealistic novel-view synthesis.


title: An extrapolation-driven network architecture for physics-informed deep learning

abstract: Deep learning with physics-informed neural networks (PINNs) has emerged as a highly popular and effective approach for solving partial differential equations(PDEs). In this paper, we first investigate the extrapolation capability of the PINN method for time-dependent PDEs. Taking advantage of this extrapolation property, we can generalize the training result obtained in the time subinterval to the large interval by adding a correction term to the network parameters of the subinterval. The correction term is determined by further training with the sample points in the added subinterval. Secondly, by designing an extrapolation control function with special characteristics and combining it with the correction term, we construct a new neural network architecture whose network parameters are coupled with the time variable, which we call the extrapolation-driven network architecture. Based on this architecture, using a single neural network, we can obtain the overall PINN solution of the whole domain with the following two characteristics: (1) it completely inherits the local solution of the interval obtained from the previous training, (2) at the interval node, it strictly maintains the continuity and smoothness that the true solution has. The extrapolation-driven network architecture allows us to divide a large time domain into multiple subintervals and solve the time-dependent PDEs one by one in chronological order. This training scheme respects the causality principle and effectively overcomes the difficulties of the conventional PINN method in solving the evolution equation on a large time domain. Numerical experiments verify the performance of our proposed method.


title: Lattice tilings with minimal perimeter and unequal volumes

abstract: We study periodic tessellations of the Euclidean space with unequal cells arising from the minimization of perimeter functionals. Existence results and qualitative properties of minimizers are discussed for different classes of problems, involving local and non-local perimeters. Regularity is then addressed in the general case under volume penalization, and in the planar case with the standard perimeter, prescribing the volumes of each cell. Finally, we show the optimality of hexagonal tilings among partitions with almost equal areas.


title: Full rotational dynamics of plastic microfibers in turbulence

abstract: The motion, settling, and dispersion of microplastics in the ocean are determined by their rotational dynamics. We present experiments on elongated, large aspect ratio, and mildly curved plastic fibers slightly longer than the Kolmogorov length scale. Exploiting their uniquely identifiable three dimensional orientation, we perform original optical Lagrangian investigations and provide a set of homogeneous data on their rotation rates around their longitudinal axis -- spinning rate -- and transversal axes -- tumbling rates -- which we explain in the context of the general features of turbulence.


title: LFMamba: Light Field Image Super-Resolution with State Space Model

abstract: Recent years have witnessed significant advancements in light field image super-resolution (LFSR) owing to the progress of modern neural networks. However, these methods often face challenges in capturing long-range dependencies (CNN-based) or encounter quadratic computational complexities (Transformer-based), which limit their performance. Recently, the State Space Model (SSM) with selective scanning mechanism (S6), exemplified by Mamba, has emerged as a superior alternative in various vision tasks compared to traditional CNN- and Transformer-based approaches, benefiting from its effective long-range sequence modeling capability and linear-time complexity. Therefore, integrating S6 into LFSR becomes compelling, especially considering the vast data volume of 4D light fields. However, the primary challenge lies in \emph{designing an appropriate scanning method for 4D light fields that effectively models light field features}. To tackle this, we employ SSMs on the informative 2D slices of 4D LFs to fully explore spatial contextual information, complementary angular information, and structure information. To achieve this, we carefully devise a basic SSM block characterized by an efficient SS2D mechanism that facilitates more effective and efficient feature learning on these 2D slices. Based on the above two designs, we further introduce an SSM-based network for LFSR termed LFMamba. Experimental results on LF benchmarks demonstrate the superior performance of LFMamba. Furthermore, extensive ablation studies are conducted to validate the efficacy and generalization ability of our proposed method. We expect that our LFMamba shed light on effective representation learning of LFs with state space models.


title: Conformal `anomalies' and renormalized stress-tensor correlators for non-conformal theories

abstract: We analyse the proposal of defining the Weyl anomaly for classically non-conformal theories as $g^{mn} \langle T_{mn}\rangle - \langle g^{mn} T_{mn} \rangle$, originally put forward by M. Duff, in the case of a scalar field with quartic self-interaction in 4d. We work in the context of dimensional regularization in curved background to two-loops (first order in the coupling). We review the original regularized but not renormalized prescription and its ambiguities; we argue that it cannot be extended to the interacting theory as it fails to provide a finite result. We then propose an alternative prescription via renormalized expectation values. At one-loop our candidate reproduces the local heat kernel result, while its extension to interacting theories contains non-local contributions.


title: RIGL: A Unified Reciprocal Approach for Tracing the Independent and Group Learning Processes

abstract: In the realm of education, both independent learning and group learning are esteemed as the most classic paradigms. The former allows learners to self-direct their studies, while the latter is typically characterized by teacher-directed scenarios. Recent studies in the field of intelligent education have leveraged deep temporal models to trace the learning process, capturing the dynamics of students' knowledge states, and have achieved remarkable performance. However, existing approaches have primarily focused on modeling the independent learning process, with the group learning paradigm receiving less attention. Moreover, the reciprocal effect between the two learning processes, especially their combined potential to foster holistic student development, remains inadequately explored. To this end, in this paper, we propose RIGL, a unified Reciprocal model to trace knowledge states at both the individual and group levels, drawing from the Independent and Group Learning processes. Specifically, we first introduce a time frame-aware reciprocal embedding module to concurrently model both student and group response interactions across various time frames. Subsequently, we employ reciprocal enhanced learning modeling to fully exploit the comprehensive and complementary information between the two behaviors. Furthermore, we design a relation-guided temporal attentive network, comprised of dynamic graph modeling coupled with a temporal self-attention mechanism. It is used to delve into the dynamic influence of individual and group interactions throughout the learning processes. Conclusively, we introduce a bias-aware contrastive learning module to bolster the stability of the model's training. Extensive experiments on four real-world educational datasets clearly demonstrate the effectiveness of the proposed RIGL model.


title: Rastall gravity: accretion disk image in radiation fields context and visual transformations compared to Reissner-Nordstrom black holes

abstract: Our study investigates the astronomical implications of Rastall gravity, particularly its behavior amidst a radiation field compared to Reissner-Nordstrom (RN) black holes. Our research delineates a crucial correlation between the dynamics of the accretion disk and the parameters Q and N_{\rm r}, which aptly reflect the influence of spacetime metrics on the disk's appearance. Elevated electric charge Q prompts contraction in the disk's orbit due to enhanced gravitational effects, while higher N_{\rm r} values lead to outward expansion, influenced by the radiation field's attributes. Interestingly, the charged black holes surrounded by radiation fields display distinct visual disparities from RN black holes. Brightness decreases and expansion occurs within the accretion disk's innermost stable circular orbit with rising N_{\rm r} values. Our study also reveals the process by which the accretion disk transitions from a conventional disk-like structure to a hat-like form at different observation angles, with the redshift effect gradually intensifying. Moreover, the results of the Rastall gravity radiation field we consider are consistent with the constraints of the host galaxy's gravitational lensing on the Rastall gravity parameters, enhancing the consistency between theoretical predictions and actual observations.


title: Radiomics-based artificial intelligence (AI) models in colorectal cancer (CRC) diagnosis, metastasis detection, prognosis, and treatment response

abstract: With a high rate of morbidity and mortality, colorectal cancer (CRC) ranks third in mortality among cancers. By analyzing the texture properties of images and quantifying the heterogeneity of tumors, radiomics and radiogenomics are non-invasive methods to determine the biological properties of CRC. Recently, several articles have discussed the application of radiomics in different aspects of CRC. Therefore, given the large amount of data published, this review aims to discuss how radiomics can be used for distinguishing benign and malignant colorectal lesions, diagnosing, staging, predicting prognosis and treatment response, and predicting lymph node and hepatic metastasis of CRC, based on radiomic features extracted from magnetic resonance imaging (MRI), computed tomography (CT), esophageal ultrasonography (EUS), and positron emission tomography-CT (PET-CT). Challenges in bringing radiomics to clinical application and future solutions have also been discussed. With the progress made in radiomics and the application of deep and machine learning in this area, radiomics can become one of the main tools for the personalized management of CRC patients shortly.


title: Adaptive Token Biaser: Knowledge Editing via Biasing Key Entities

abstract: The parametric knowledge memorized by large language models (LLMs) becomes outdated quickly. In-context editing (ICE) is currently the most effective method for updating the knowledge of LLMs. Recent advancements involve enhancing ICE by modifying the decoding strategy, obviating the need for altering internal model structures or adjusting external prompts. However, this enhancement operates across the entire sequence generation, encompassing a plethora of non-critical tokens. In this work, we introduce $\textbf{A}$daptive $\textbf{T}$oken $\textbf{Bias}$er ($\textbf{ATBias}$), a new decoding technique designed to enhance ICE. It focuses on the tokens that are mostly related to knowledge during decoding, biasing their logits by matching key entities related to new and parametric knowledge. Experimental results show that ATBias significantly enhances ICE performance, achieving up to a 32.3% improvement over state-of-the-art ICE methods while incurring only half the latency. ATBias not only improves the knowledge editing capabilities of ICE but can also be widely applied to LLMs with negligible cost.


title: Tracing the Unseen: Uncovering Human Trafficking Patterns in Job Listings

abstract: In the shadow of the digital revolution, the insidious issue of human trafficking has found new breeding grounds within the realms of social media and online job boards. Previous research efforts have predominantly centered on identifying victims via the analysis of escort advertisements. However, our work shifts the focus towards enabling a proactive approach: pinpointing potential traffickers before they lure their preys through false job opportunities. In this study, we collect and analyze a vast dataset comprising over a quarter million job postings collected from eight relevant regions across the United States, spanning nearly two decades (2006-2024). The job boards we considered are specifically catered towards Chinese-speaking immigrants in the US. We classify the job posts into distinct groups based on the self-reported information of the posting user. Our investigation into the types of advertised opportunities, the modes of preferred contact, and the frequency of postings uncovers the patterns characterizing suspicious ads. Additionally, we highlight how external events such as health emergencies and conflicts appear to strongly correlate with increased volume of suspicious job posts: traffickers are more likely to prey upon vulnerable populations in times of crises. This research underscores the imperative for a deeper dive into how online job boards and communication platforms could be unwitting facilitators of human trafficking. More importantly, it calls for the urgent formulation of targeted strategies to dismantle these digital conduits of exploitation.


title: The topological pressure of trapped sets in Kerr-(de Sitter) spacetimes

abstract: In this paper we prove that the topological pressure of dynamic systems with normally hyperbolic trapping is negative. In particular, this applies to the null geodesic flow in Kerr and Kerr-de Sitter spacetimes This builds connection between results for trapped sets with low regularity in hyperbolic dynamic systems conditioning on negativity of the topological pressure and unconditional results in the setting of normally hyperbolic trapping.


title: Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy Interpolation

abstract: While fine-tuning of pre-trained language models generally helps to overcome the lack of labelled training samples, it also displays model performance instability. This instability mainly originates from randomness in initialisation or data shuffling. To address this, researchers either modify the training process or augment the available samples, which typically results in increased computational costs. We propose a new mitigation strategy, called Delayed Ensemble with Noisy Interpolation (DENI), that leverages the strengths of ensembling, noise regularisation and model interpolation, while retaining computational efficiency. We compare DENI with 9 representative mitigation strategies across 3 models, 4 tuning strategies and 7 text classification datasets. We show that: 1) DENI outperforms the best performing mitigation strategy (Ensemble), while using only a fraction of its cost; 2) the mitigation strategies are beneficial for parameter-efficient fine-tuning (PEFT) methods, outperforming full fine-tuning in specific cases; and 3) combining DENI with data augmentation often leads to even more effective instability mitigation.


title: Merger Precursor: Year-long Transients Preceding Mergers of Low-mass Stripped Stars with Compact Objects

abstract: Binary mass transfer can occur at high rates due to rapid expansion of the donor's envelope. In the case where mass transfer is unstable, the binary can rapidly shrink its orbit and lead to a merger. In this work we consider the appearance of the system preceding merger, specifically for the case of a low-mass ($\approx 2.5$-$3~M_\odot$) helium star with a neutron star (NS) companion. Modeling the mass transfer history as well as the wind launched by super-Eddington accretion onto the NS, we find that such systems can power slowly rising transients with timescales as long as years, and luminosities of $\sim 10^{40}$-$10^{41}$ erg s$^{-1}$ from optical to UV. The final explosion following the merger (or core-collapse of the helium star in some cases) leads to an interaction-powered transient with properties resembling Type Ibn supernovae (SNe), possibly with a bright early peak powered by shock cooling emission for merger-powered explosions. We apply our model to the Type Ibn SN 2023fyq, that displayed a long-term precursor activity from years before the terminal explosion.


title: Underwater Human-Robot and Human-Swarm Interaction: A Review and Perspective

abstract: There has been a growing interest in extending the capabilities of autonomous underwater vehicles (AUVs) in subsea missions, particularly in integrating underwater human-robot interaction (UHRI) for control. UHRI and its subfield,underwater gesture recognition (UGR), play a significant role in enhancing diver-robot communication for marine research. This review explores the latest developments in UHRI and examines its promising applications for multi-robot systems. With the developments in UGR, opportunities are presented for underwater robots to work alongside human divers to increase their functionality. Human gestures creates a seamless and safe collaborative environment where divers and robots can interact more efficiently. By highlighting the state-of-the-art in this field, we can potentially encourage advancements in underwater multi-robot system (UMRS) blending the natural communication channels of human-robot interaction with the multi-faceted coordination capabilities of underwater swarms,thus enhancing robustness in complex aquatic environments.


title: Exploring Intra and Inter-language Consistency in Embeddings with ICA

abstract: Word embeddings represent words as multidimensional real vectors, facilitating data analysis and processing, but are often challenging to interpret. Independent Component Analysis (ICA) creates clearer semantic axes by identifying independent key features. Previous research has shown ICA's potential to reveal universal semantic axes across languages. However, it lacked verification of the consistency of independent components within and across languages. We investigated the consistency of semantic axes in two ways: both within a single language and across multiple languages. We first probed into intra-language consistency, focusing on the reproducibility of axes by performing ICA multiple times and clustering the outcomes. Then, we statistically examined inter-language consistency by verifying those axes' correspondences using statistical tests. We newly applied statistical methods to establish a robust framework that ensures the reliability and universality of semantic axes.


title: Adversarial Multi-dueling Bandits

abstract: We introduce the problem of regret minimization in adversarial multi-dueling bandits. While adversarial preferences have been studied in dueling bandits, they have not been explored in multi-dueling bandits. In this setting, the learner is required to select $m \geq 2$ arms at each round and observes as feedback the identity of the most preferred arm which is based on an arbitrary preference matrix chosen obliviously. We introduce a novel algorithm, MiDEX (Multi Dueling EXP3), to learn from such preference feedback that is assumed to be generated from a pairwise-subset choice model. We prove that the expected cumulative $T$-round regret of MiDEX compared to a Borda-winner from a set of $K$ arms is upper bounded by $O((K \log K)^{1/3} T^{2/3})$. Moreover, we prove a lower bound of $\Omega(K^{1/3} T^{2/3})$ for the expected regret in this setting which demonstrates that our proposed algorithm is near-optimal.


title: Uncorrelated photon pair generation from an integrated silicon nitride resonator measured by time resolved coincidence detection

abstract: We measure the joint temporal intensity of signal and idler photon pairs generated by spontaneous four wave mixing in a silicon nitride microresonator by time-resolved coincidence detection. This technique can be applied to any high-Q optical cavity whose photon lifetime exceeds the duration of the pump pulse. We tailor the temporal correlation of photon pairs by using a resonant interferometric coupler, a device that allows us to independently tune the quality factors of the pump and signal and idler resonances.Temporal post-selection is used to accurately measure the temporal emission of the device, demonstrating a purity of 98.67(1)%.


title: An atypical low-frequency QPO detected in the hard state of MAXI J1348-630 with $Insight$-HXMT

abstract: Based on the $Insight$-HXMT archival data, we have detected a new atypical low-frequency quasi-periodic oscillation (LFQPO) in the black hole X-ray binary MAXI J1348$-$630. The new LFQPO is detected in all the three instruments of $Insight$-HXMT with a combined significance of 3--5 $\sigma$, covering a wide energy range of 1--100 keV. The fractional root-mean-square (RMS) seems decrease with energy. It exclusively appears in the hard state during both the main and mini outburst, spanning an X-ray intensity range by a factor of 10, and a very narrow hardness range. The frequency of this new type of LFQPO is moderately stable, in the range of 0.08--0.15 Hz. We discussed different models for the LFQPO, and found none is able to explain the observed properties of this new type of LFQPO.


title: Accelerating Depthwise Separable Convolutions on Ultra-Low-Power Devices

abstract: Depthwise separable convolutions are a fundamental component in efficient Deep Neural Networks, as they reduce the number of parameters and operations compared to traditional convolutions while maintaining comparable accuracy. However, their low data reuse opportunities make deploying them notoriously difficult. In this work, we perform an extensive exploration of alternatives to fuse the depthwise and pointwise kernels that constitute the separable convolutional block. Our approach aims to minimize time-consuming memory transfers by combining different data layouts. When targeting a commercial ultra-low-power device with a three-level memory hierarchy, the GreenWaves GAP8 SoC, we reduce the latency of end-to-end network execution by up to 11.40%. Furthermore, our kernels reduce activation data movements between L2 and L1 memories by up to 52.97%.


title: RS-GPT4V: A Unified Multimodal Instruction-Following Dataset for Remote Sensing Image Understanding

abstract: The remote sensing image intelligence understanding model is undergoing a new profound paradigm shift which has been promoted by multi-modal large language model (MLLM), i.e. from the paradigm learning a domain model (LaDM) shifts to paradigm learning a pre-trained general foundation model followed by an adaptive domain model (LaGD). Under the new LaGD paradigm, the old datasets, which have led to advances in RSI intelligence understanding in the last decade, are no longer suitable for fire-new tasks. We argued that a new dataset must be designed to lighten tasks with the following features: 1) Generalization: training model to learn shared knowledge among tasks and to adapt to different tasks; 2) Understanding complex scenes: training model to understand the fine-grained attribute of the objects of interest, and to be able to describe the scene with natural language; 3) Reasoning: training model to be able to realize high-level visual reasoning. In this paper, we designed a high-quality, diversified, and unified multimodal instruction-following dataset for RSI understanding produced by GPT-4V and existing datasets, which we called RS-GPT4V. To achieve generalization, we used a (Question, Answer) which was deduced from GPT-4V via instruction-following to unify the tasks such as captioning and localization; To achieve complex scene, we proposed a hierarchical instruction description with local strategy in which the fine-grained attributes of the objects and their spatial relationships are described and global strategy in which all the local information are integrated to yield detailed instruction descript; To achieve reasoning, we designed multiple-turn QA pair to provide the reasoning ability for a model. The empirical results show that the fine-tuned MLLMs by RS-GPT4V can describe fine-grained information. The dataset is available at: https://github.com/GeoX-Lab/RS-GPT4V.


title: The Power of LLM-Generated Synthetic Data for Stance Detection in Online Political Discussions

abstract: Stance detection holds great potential for enhancing the quality of online political discussions, as it has shown to be useful for summarizing discussions, detecting misinformation, and evaluating opinion distributions. Usually, transformer-based models are used directly for stance detection, which require large amounts of data. However, the broad range of debate questions in online political discussion creates a variety of possible scenarios that the model is faced with and thus makes data acquisition for model training difficult. In this work, we show how to leverage LLM-generated synthetic data to train and improve stance detection agents for online political discussions:(i) We generate synthetic data for specific debate questions by prompting a Mistral-7B model and show that fine-tuning with the generated synthetic data can substantially improve the performance of stance detection. (ii) We examine the impact of combining synthetic data with the most informative samples from an unlabelled dataset. First, we use the synthetic data to select the most informative samples, second, we combine both these samples and the synthetic data for fine-tuning. This approach reduces labelling effort and consistently surpasses the performance of the baseline model that is trained with fully labeled data. Overall, we show in comprehensive experiments that LLM-generated data greatly improves stance detection performance for online political discussions.


title: Curvature effects on stimulated parametric down-conversion process: an analog model

abstract: In this paper, we utilize an analog model of the general relativity and investigate the influence of spatial curvature on quantum properties of stimulated parametric down-conversion process. For this purpose, we use two-mode sphere coherent state as the input beams of the aforementioned process. These states are realization of coherent states of two-dimensional harmonic oscillator, which lies on a two-dimension sphere. We calculate the entanglement of output states of stimulated parametric down conversion process, measured by linear entropy, and show that it depends on the spatial curvature. So, by preparing the suitable two-mode sphere coherent states, it is possible to control the entanglement between the output states in the laboratory. In addition, we consider mean number and Mandel parameter of the output states of the process and also, their cross-correlation function, as the convince measures of non-classical behaviors.


title: On all numbers great and small (Topological fields of Conway's numbers and their completions)

abstract: The proper Class $\bf{No}$ of all Conway's numbers $\cite{l3}$ is considered as a region of investigation. It turns out to be a total ordered Field (i.e., a field whose domain is a proper Class) and this totally, or linear ordered Class, containing the real numbers ${\mathbb R}$ and the ordinal numbers {\bf On}. For any subfield $F$ of $\bf{No}$, i.e., $F$ is a set nor proper class, considered with topology induced by a linear ordering on $F$ a completion $\tilde F$ is constructed; in particular, for $\zeta=\omega^{\omega^\mu}$, $0\leq\mu<\Omega$, and for a specially defined subfield $F={\mathbb P}_\zeta\subset{\bf No}$ a complete subfield ${\mathbb R}_\zeta\subset{\bf No}$ is defined as $\tilde {\mathbb P}_\zeta$. Fundamental (Cauchy) sequences $(x_\alpha)_{0\leq\alpha<\zeta}$ are considered in a subfield $F\subset {\mathbb P}_\zeta\subset{\bf No}$, where $\zeta$ is the smallest ordinal number which does not belong to $F$, and they are the main instrument in the paper. A fragment of Mathematical Analysis in ${\mathbb R}_\zeta$ is given and two of its non-trivial results are presented: every positive number $x\in{\mathbb R}_\zeta$ has a unique $n$-th root in ${\mathbb R}_\zeta$, for each positive integer $n$ and every odd-degree polynomial with coefficients in ${\mathbb R}_\zeta$ has a root in ${\mathbb R}_\zeta$. Hence so-called fundamental theorem of algebra: the ring ${\mathbb R}_\zeta[i]\stackrel{def}{=}{\mathbb C}_\zeta$ of all numbers of the form $x+iy$ ($x,y\in{\mathbb R}_\zeta$), $i^2=-1$, is an algebraically closed field.


title: Spin-independent interactions of Dirac Fermionic Dark Matter in the composite Higgs models

abstract: According to recent measurements, dark matter magnetic dipole moment is strongly constrained. In the composite Higgs models the magnetic dipole moment of the Dirac dark matter fermion and its mass can be suppressed by the approximate U(1) symmetry. We consider E_6 inspired composite Higgs model (E_6CHM) with U(1) symmetry violating operators, which give rise to dark matter's mass and coupling constant to Higgs boson. The dependence of the spin-independent dark matter-nucleon scattering cross section on the E_6CHM parameters is explored. We argue that there are regions of the parameter space which are still safe from all current constraints and may lead to spectacular LHC signatures.

categories: hep-ph astro-ph.CO hep-ex hep-th nucl-th


title: Damage mechanisms in polyalkenes irradiated with ultra-short XUV/x-ray laser pulses

abstract: Although polymers are widely used in laser-irradiation research, their microscopic response to high-intensity ultrafast XUV or X-ray irradiation is still largely unknown. Here we comparatively study homologous series of alkenes. XTANT-3 hybrid simulation toolkit is used to determine their damage kinetics and irradiation threshold doses. The code simultaneously models the nonequilibrium electron kinetics, the energy transfer between electrons and atoms via nonadiabatic electron-ion (electron-phonon) coupling, nonthermal modification of the interatomic potential due to electronic excitation, and the ensuing atomic response and damage formation. It is shown that the lowest damage threshold is associated with local defect creation such as dehydrogenation, various group detachment from the backbone, or polymer strand cross-linking. At higher doses, the disintegration of the molecules leads to a transient metallic liquid state. We identify nonthermal effects as the leading mechanism of damage, whereas the thermal (electron-ion coupling) channel influences the kinetics only slightly in the case of femtosecond-pulse irradiation. Despite notably different properties of the studied alkene polymers, the ultrafast-X-ray damage threshold doses are found to be very close to ~0.05 eV/atom in all three materials: polyethylene, polypropylene, and polybutylene.


title: Multichannel Dyson equation: derivation and analysis

abstract: In a recent letter [Phys. Rev. Lett. 131, 216401] we presented the multichannel Dyson equation (MCDE) in which two or more many-body Green's functions are coupled. In this work we will give further details of the MCDE approach. In particular we will discuss: 1) the derivation of the MCDE and the definition of the space in which it is to be solved; 2) the rationale of the approximation to the multichannel self-energy; 3) a diagrammatic analysis of the MCDE; 4) the recasting of the MCDE on an eigenvalue problem with an effective Hamiltonian that can be solved using standard numerical techniques. This work mainly focuses on the coupling between the one-body Green's function and the three-body Green's function to describe photoemission spectra, but the MCDE method can be generalized to the coupling of other many-body Green's functions and to other spectroscopies.


title: The DeMorganization of a locale

abstract: In 2009, Caramello proved that each topos has a largest dense subtopos whose internal logic satisfies De Morgan law (also known as the law of the weak excluded middle). This finding implies that every locale has a largest dense extremally disconnected sublocale, referred to as its DeMorganization. In this paper, we take the first steps in exploring the DeMorganization in the localic context, shedding light on its geometric nature by showing that it is always a fitted sublocale and by providing a concrete description. The main result of the paper is that for any metrizable locale (without isolated points), its DeMorganization coincides with its Booleanization. This, in particular, implies that any extremally disconnected metric locale (without isolated points) must be Boolean, generalizing a well-known result for topological spaces to the localic setting.


title: Analytic Models for the Capacity Distribution in MDG-impaired Optical SDM Transmission

abstract: In coupled space-division multiplexing (SDM) transmission systems, imperfections in optical amplifiers and passive devices introduce mode-dependent loss (MDL) and gain (MDG). These effects render the channel capacity stochastic and result in a decrease in average capacity. Several previous studies employ multi-section simulations to model the capacity of these systems. Additionally, relevant works derive analytically the capacity distribution for a single-mode system with polarization-dependent gain and loss (mode count D = 2). However, to the best of our knowledge, analytic expressions of the capacity distribution for systems with D > 2 have not been presented. In this paper, we provide analytic expressions for the capacity of optical systems with arbitrary mode counts. The expressions rely on Gaussian approximations for the per-mode capacity distributions and for the overall capacity distribution, as well as on fitting parameters for the capacity cross-correlation among different modes. Compared to simulations, the derived analytical expressions exhibit a suitable level of accuracy across a wide range of practical scenarios.


title: Light curve's recovery with Rubin-LSST: II. UnVEiling the darknesS of The gAlactic buLgE (VESTALE) with RR Lyrae

abstract: This work is part of VESTALE, a project initiated within the Rubin-LSST Cadence Strategy Optimization Process . Its goal is to explore the potential of Rubin-LSST observations aimed at the Galaxy's bulge (Bulge) for studying RR Lyrae stars (RRL). Observation and analysis of RR Lyrae stars in the Bulge are crucial for tracing the old population of the central part of our galaxy and reconstructing the history of Bulge formation. Based on observations conducted with CTIO/DECam by Saha et al. 2019 towards the Baade Window, our simulations demonstrate that early Rubin-LSST observations will enable the recovery of RR Lyrae light curves at Galactic center distances with sufficient precision. This will allow us to utilize theoretical relations from Marconi et al. 2022 to determine their distances and/or metallicity, following the REDIME algorithm introduced in Bono et al. 2019. We show how reddening and crowding affect our simulations and highlight the importance of considering these effects when deriving pulsation parameters (luminosity amplitudes, mean magnitudes) based on the light curves especially if the goal is to explore the opposite side of the Bulge through the observation of its RRL. The simulations discussed in this investigation were conducted to support the SCOC's decision to observe this important sky region since it has only recently been decided to include part of the Bulge as a target within the LSST main survey.


title: CMB and accretion

abstract: Primordial black holes (PBHs) of stellar mass or heavier would accrete baryonic gas, which becomes denser and hotter, injecting energetic photons in the cosmological medium soon after cosmic recombination, in the so-called dark ages. The ionisation history of the universe would be altered, an effect cosmic microwave background (CMB) temperature and polarisation anisotropies is sensitive to. The magnitude of the effect depends on the abundance and mass distribution of the PBHs, as well as on still uncertain aspects of accretion luminosity. We review the current understanding of this field, with an emphasis on the peculiarities of the phenomenon in the cosmological context, and present the existing constraints on the PBH abundances.


title: Mirror partner for a Klein quartic polynomial

abstract: The results of A.Chiodo, Y.Ruan and M.Krawitz associate the mirror partner Calabi-Yau variety $X$ to a Landau--Ginzburg orbifold $(f,G)$ if $f$ is an invertible polynomial satisfying Calabi-Yau condition and the group $G$ is a diagonal symmetry group of $f$. In this paper we investigate the Landau-Ginzburg orbifolds with a Klein quartic polynomial $f = x_1^3x_2 + x_2^3x_3+x_3^3x_1$ and $G$ being all possible subgroups of $\mathrm{GL}(3,\mathbb{C})$, preserving the polynomial $f$ and also the pairing in its Jacobian algebra. In particular, $G$ is not necessarily abelian or diagonal. The zero-set of polynomial $f$, called Klein quartic, is a genus $3$ smooth compact Riemann surface. We show that its mirror Landau-Ginzburg orbifold is $(f,G)$ with $G$ being a $\mathbb{Z}/2\mathbb{Z}$-extension of a Klein four-group.


title: Iterations of mean-type mappings and their convergence

abstract: We define so-called residual means, which have a Taylor expansion of the form $M(x)=\bar x +\tfrac12 \xi_M(\bar x) \text{Var}(x)+o(\|x-\bar x\|^\alpha)$ for some $\alpha>2$ and a single-variable function $\xi_M$ ($\bar x$~stands for the arithmetic mean of the vector $x$), and show that all symmetric means which are three times continuously differentiable are residual. We also calculate the value of residuum for quasideviation means and a few subclasses of this family. Later, we apply it to establish the limit of the sequence $\big(\frac{\text{Var}\ {\bf M}^{n+1}(x)}{(\text{Var}\ {\bf M}^n(x))^2}\big)_{n=1}^\infty$, where ${\bf M} \colon I^p\to I^p$ is a mean-type mapping consisting of $p$-variable residual means on an interval $I$, and $x \in I^p$ is a nonconstant vector.


title: A Review of EMA Public Assessment Reports where Non-Proportional Hazards were Identified

abstract: While well-established methods for time-to-event data are available when the proportional hazards assumption holds, there is no consensus on the best approach under non-proportional hazards. A wide range of parametric and non-parametric methods for testing and estimation in this scenario have been proposed. In this review we identified EMA marketing authorization procedures where non-proportional hazards were raised as a potential issue in the risk-benefit assessment and extract relevant information on trial design and results reported in the corresponding European Assessment Reports (EPARs) available in the database at paediatricdata.eu. We identified 16 Marketing authorization procedures, reporting results on a total of 18 trials. Most procedures covered the authorization of treatments from the oncology domain. For the majority of trials NPH issues were related to a suspected delayed treatment effect, or different treatment effects in known subgroups. Issues related to censoring, or treatment switching were also identified. For most of the trials the primary analysis was performed using conventional methods assuming proportional hazards, even if NPH was anticipated. Differential treatment effects were addressed using stratification and delayed treatment effect considered for sample size planning. Even though, not considered in the primary analysis, some procedures reported extensive sensitivity analyses and model diagnostics evaluating the proportional hazards assumption. For a few procedures methods addressing NPH (e.g.~weighted log-rank tests) were used in the primary analysis. We extracted estimates of the median survival, hazard ratios, and time of survival curve separation. In addition, we digitized the KM curves to reconstruct close to individual patient level data. Extracted outcomes served as the basis for a simulation study of methods for time to event analysis under NPH.


title: Large Deviations of Piecewise-Deterministic-Markov-Processes with Application to Stochastic Calcium Waves

abstract: We prove a Large Deviation Principle for Piecewise Deterministic Markov Processes (PDMPs). This is an asymptotic estimate for the probability of a trajectory in the large size limit. Explicit Euler-Lagrange equations are determined for computing optimal first-hitting-time trajectories. The results are applied to a model of stochastic calcium dynamics. It is widely conjectured that the mechanism of calcium puff generation is a multiscale process: with microscopic stochastic fluctuations in the opening and closing of individual channels generating cell-wide waves via the diffusion of calcium and other signaling molecules. We model this system as a PDMP, with $N \gg 1$ stochastic calcium channels that are coupled via the ambient calcium concentration. We employ the Large Deviations theory to estimate the probability of cell-wide calcium waves being produced through microscopic stochasticity.


title: LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization

abstract: Open-Domain Multi-Document Summarization (ODMDS) is crucial for addressing diverse information needs, which aims to generate a summary as answer to user's query, synthesizing relevant content from multiple documents in a large collection. Existing approaches that first find relevant passages and then generate a summary using a language model are inadequate for ODMDS. This is because open-ended queries often require additional context for the retrieved passages to cover the topic comprehensively, making it challenging to retrieve all relevant passages initially. While iterative retrieval methods have been explored for multi-hop question answering (MQA), they are impractical for ODMDS due to high latency from repeated large language model (LLM) inference for reasoning. To address this issue, we propose LightPAL, a lightweight passage retrieval method for ODMDS that constructs a graph representing passage relationships using an LLM during indexing and employs random walk instead of iterative reasoning and retrieval at inference time. Experiments on ODMDS benchmarks show that LightPAL outperforms baseline retrievers in summary quality while being significantly more efficient than an iterative MQA approach.


title: Method for detector description conversion from DD4hep to Filmbox

abstract: DD4hep serves as a generic detector description toolkit recommended for offline software development in next-generation high-energy physics~(HEP) experiments. Conversely, Filmbox~(FBX) stands out as a widely used 3D modeling file format within the 3D software industry. In this paper, we introduce a novel method that can automatically convert complex HEP detector geometries from DD4hep description into 3D models in the FBX format. The feasibility of this method was demonstrated by its application to the DD4hep description of the Compact Linear Collider detector and several sub-detectors of the super Tau-Charm facility and circular electron-positron collider experiments. The automatic DD4hep--FBX detector conversion interface provides convenience for further development of applications, such as detector design, simulation, visualization, data monitoring, and outreach, in HEP experiments.


title: Reparameterizable Dual-Resolution Network for Real-time Semantic Segmentation

abstract: Semantic segmentation plays a key role in applications such as autonomous driving and medical image. Although existing real-time semantic segmentation models achieve a commendable balance between accuracy and speed, their multi-path blocks still affect overall speed. To address this issue, this study proposes a Reparameterizable Dual-Resolution Network (RDRNet) dedicated to real-time semantic segmentation. Specifically, RDRNet employs a two-branch architecture, utilizing multi-path blocks during training and reparameterizing them into single-path blocks during inference, thereby enhancing both accuracy and inference speed simultaneously. Furthermore, we propose the Reparameterizable Pyramid Pooling Module (RPPM) to enhance the feature representation of the pyramid pooling module without increasing its inference time. Experimental results on the Cityscapes, CamVid, and Pascal VOC 2012 datasets demonstrate that RDRNet outperforms existing state-of-the-art models in terms of both performance and speed. The code is available at https://github.com/gyyang23/RDRNet.


title: Efficient production of $^{229m}$Th via nuclear excitation by electron capture

abstract: The nuclear isomeric state $^{229m}$Th with an exceptionally low excitation energy makes the $^{229}$Th isotope a crucial candidate for nuclear clocks and many other applications. Efficient and controllable production of $^{229m}$Th is essential and still remains a challenge. Here we report a novel approach for efficient production of $^{229m}$Th by the excitation of $^{229}$Th to the above-lying excited state at $29.19$ keV energy via the process of nuclear excitation by electron capture (NEEC). We show theoretically that the production rate of $^{229m}$Th per nucleus with accessible conditions can be six orders of magnitude larger than the value experimentally demonstrated using $29$-keV synchrotron radiation for this indirect excitation. With the efficient production of $^{229m}$Th, our results identify scenarios, as well as the characteristic NEEC signature with which NEEC events could be unambiguously identified, for a clear experimental identification of the long-sought NEEC phenomenon.


title: Frequency-Domain Data-Driven Predictive Control

abstract: In this paper, we propose a data-driven predictive control scheme based on measured frequency-domain data of the plant. This novel scheme complements the well-known data-driven predictive control (DeePC) approach based on time series data. To develop this new frequency-domain data-driven predictive control (FreePC) scheme, we introduce a novel version of Willems' fundamental lemma based on frequency-domain data. By exploiting frequency-domain data, we allow recent direct data-driven (predictive) control methodologies to benefit from the available expertise and techniques for non-parametric frequency-domain identification in academia and industry. We prove that, under appropriate conditions, the new FreePC scheme is equivalent to the corresponding DeePC scheme. The strengths of FreePC are demonstrated in a numerical case study.


title: Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning

abstract: Purpose: Autonomous navigation of catheters and guidewires can enhance endovascular surgery safety and efficacy, reducing procedure times and operator radiation exposure. Integrating tele-operated robotics could widen access to time-sensitive emergency procedures like mechanical thrombectomy (MT). Reinforcement learning (RL) shows potential in endovascular navigation, yet its application encounters challenges without a reward signal. This study explores the viability of autonomous navigation in MT vasculature using inverse RL (IRL) to leverage expert demonstrations. Methods: This study established a simulation-based training and evaluation environment for MT navigation. We used IRL to infer reward functions from expert behaviour when navigating a guidewire and catheter. We utilized soft actor-critic to train models with various reward functions and compared their performance in silico. Results: We demonstrated feasibility of navigation using IRL. When evaluating single versus dual device (i.e. guidewire versus catheter and guidewire) tracking, both methods achieved high success rates of 95% and 96%, respectively. Dual-tracking, however, utilized both devices mimicking an expert. A success rate of 100% and procedure time of 22.6 s were obtained when training with a reward function obtained through reward shaping. This outperformed a dense reward function (96%, 24.9 s) and an IRL-derived reward function (48%, 59.2 s). Conclusions: We have contributed to the advancement of autonomous endovascular intervention navigation, particularly MT, by employing IRL. The results underscore the potential of using reward shaping to train models, offering a promising avenue for enhancing the accessibility and precision of MT. We envisage that future research can extend our methodology to diverse anatomical structures to enhance generalizability.


title: $C^1$-robust homoclinic tangencies

abstract: The aim of this paper is twofold. First, motivated by the nearly-affine blender system found in [LT24], we introduce standard blenders and their variations, and prove their fundamental properties on the generation of $C^1$-robust tangencies. Next, as an application, we show that unfolding a homoclinic tangency to a hyperbolic periodic point can produce uncountably many $C^1$-robust homoclinic tangencies, provided that either this point is involved in a coindex-1 heterodimensional cycle, or the central dynamics near it are not essentially two-dimensional.


title: Improving Multi-modal Recommender Systems by Denoising and Aligning Multi-modal Content and User Feedback

abstract: Multi-modal recommender systems (MRSs) are pivotal in diverse online web platforms and have garnered considerable attention in recent years. However, previous studies overlook the challenges of (1) noisy multi-modal content, (2) noisy user feedback, and (3) aligning multi-modal content with user feedback. In order to tackle these challenges, we propose Denoising and Aligning Multi-modal Recommender System (DA-MRS). To mitigate multi-modal noise, DA-MRS first constructs item-item graphs determined by consistent content similarity across modalities. To denoise user feedback, DA-MRS associates the probability of observed feedback with multi-modal content and devises a denoised BPR loss. Furthermore, DA-MRS implements Alignment guided by User preference to enhance task-specific item representation and Alignment guided by graded Item relations to provide finer-grained alignment. Extensive experiments verify that DA-MRS is a plug-and-play framework and achieves significant and consistent improvements across various datasets, backbone models, and noisy scenarios.


title: Code-Optimise: Self-Generated Preference Data for Correctness and Efficiency

abstract: Code Language Models have been trained to generate accurate solutions, typically with no regard for runtime. On the other hand, previous works that explored execution optimisation have observed corresponding drops in functional correctness. To that end, we introduce Code-Optimise, a framework that incorporates both correctness (passed, failed) and runtime (quick, slow) as learning signals via self-generated preference data. Our framework is both lightweight and robust as it dynamically selects solutions to reduce overfitting while avoiding a reliance on larger models for learning signals. Code-Optimise achieves significant improvements in pass@k while decreasing the competitive baseline runtimes by an additional 6% for in-domain data and up to 3% for out-of-domain data. As a byproduct, the average length of the generated solutions is reduced by up to 48% on MBPP and 23% on HumanEval, resulting in faster and cheaper inference. The generated data and codebase will be open-sourced at www.open-source.link.


title: Unsupervised Online Continual Learning for Automatic Speech Recognition

abstract: Adapting Automatic Speech Recognition (ASR) models to new domains leads to Catastrophic Forgetting (CF) of previously learned information. This paper addresses CF in the challenging context of Online Continual Learning (OCL), with tasks presented as a continuous data stream with unknown boundaries. We extend OCL for ASR into the unsupervised realm, by leveraging self-training (ST) to facilitate unsupervised adaptation, enabling models to adapt continually without label dependency and without forgetting previous knowledge. Through comparative analysis of various OCL and ST methods across two domain adaptation experiments, we show that UOCL suffers from significantly less forgetting compared to supervised OCL, allowing UOCL methods to approach the performance levels of supervised OCL. Our proposed UOCL extensions further boosts UOCL's efficacy. Our findings represent a significant step towards continually adaptable ASR systems, capable of leveraging unlabeled data across diverse domains.


title: Schwarzschild-f(R) Black Holes and the Absence of Black Hole Bomb Effect

abstract: In this paper, we analytically study the superradiant stability of Schwarzschild-f(R) black holes under charged massive scalar perturbation. Using an analytic method based on Descartes' rule of signs, we extend previous methods developed for higher-dimensional Reissner-Nordstrom black holes to the Schwarzschild-f(R) black hole cases. Our results show that Schwarzschild-f(R) black holes are superradiantly stable under charged massive scalar perturbation, implying the absence of the black hole bomb effect.


title: Demonstrating Agile Flight from Pixels without State Estimation

abstract: Quadrotors are among the most agile flying robots. Despite recent advances in learning-based control and computer vision, autonomous drones still rely on explicit state estimation. On the other hand, human pilots only rely on a first-person-view video stream from the drone onboard camera to push the platform to its limits and fly robustly in unseen environments. To the best of our knowledge, we present the first vision-based quadrotor system that autonomously navigates through a sequence of gates at high speeds while directly mapping pixels to control commands. Like professional drone-racing pilots, our system does not use explicit state estimation and leverages the same control commands humans use (collective thrust and body rates). We demonstrate agile flight at speeds up to 40km/h with accelerations up to 2g. This is achieved by training vision-based policies with reinforcement learning (RL). The training is facilitated using an asymmetric actor-critic with access to privileged information. To overcome the computational complexity during image-based RL training, we use the inner edges of the gates as a sensor abstraction. This simple yet robust, task-relevant representation can be simulated during training without rendering images. During deployment, a Swin-transformer-based gate detector is used. Our approach enables autonomous agile flight with standard, off-the-shelf hardware. Although our demonstration focuses on drone racing, we believe that our method has an impact beyond drone racing and can serve as a foundation for future research into real-world applications in structured environments.


title: Expanders and growth of normal subsets in finite simple groups of Lie type

abstract: We show that some classical results on expander graphs imply growth results on normal subsets in finite simple groups. As one application, it is shown that given a nontrivial normal subset $ A $ of a finite simple group $ G $ of Lie type of bounded rank, we either have $ G \setminus \{ 1 \} \subseteq A^2 $ or $ |A^2| \geq |A|^{1+\epsilon} $, for $ \epsilon > 0 $. This improves a result of Gill, Pyber, Short and Szab\'o, and partially resolves a question of Pyber from the Kourovka notebook. We also propose a variant of Gowers' trick for two subsets, and give applications to products of large subsets in groups of Lie type, improving some results of Larsen, Shalev and Tiep.


title: Improving the Evaluation and Actionability of Explanation Methods for Multivariate Time Series Classification

abstract: Explanation for Multivariate Time Series Classification (MTSC) is an important topic that is under explored. There are very few quantitative evaluation methodologies and even fewer examples of actionable explanation, where the explanation methods are shown to objectively improve specific computational tasks on time series data. In this paper we focus on analyzing InterpretTime, a recent evaluation methodology for attribution methods applied to MTSC. We reproduce the original paper results, showcase some significant weaknesses of the methodology and propose ideas to improve both its accuracy and efficiency. Unlike related work, we go beyond evaluation and also showcase the actionability of the produced explainer ranking, by using the best attribution methods for the task of channel selection in MTSC. We find that perturbation-based methods such as SHAP and Feature Ablation work well across a set of datasets, classifiers and tasks and outperform gradient-based methods. We apply the best ranked explainers to channel selection for MTSC and show significant data size reduction and improved classifier accuracy.


title: An Alternative to Homotopy Transfer for $A_\infty$-Algebras

abstract: In this work, we propose a novel approach to the homotopy transfer procedure starting from a set of homotopy data such that the first differential complex is a differential graded module over the second one. We show that the module structure may be used to induce an $A_\infty$-algebra on the second differential complex, constructed in a similar fashion to the homotopy transfer $A_\infty$-algebra. We prove that, under certain conditions, the $A_\infty$-algebras obtained with this procedure are quasi-isomorphic to the homotopy transfer one. On the other hand, when the side conditions do not hold, we find that there are cases where the existence of an $A_\infty$-quasi-isomorphism with the homotopy transfer $A_\infty$-algebra is obstructed. In other words, we obtain a new $A_\infty$-algebra on the second complex, inequivalent to the homotopy transfer one. Lastly, we prove that these $A_\infty$-algebras are not infinitesimal Hochschild deformations of the homotopy transfer $A_\infty$-algebra.


title: Towards an astronomical use of new-generation geodetic observations. I. From the correlator to full-polarization images

abstract: Context. The current algorithms used for the calibration and analysis of very long baseline interferometry (VLBI) networks that only use linear polarizers (as is the case of the VLBI Global Observing System, VGOS) do not properly account for instrumental and source-intrinsic polarimetry, which can cause errors in geodetic and astronomical products. Aims. We aim to develop a calibration pipeline for VLBI interferometers that observe in a basis of linear polarization, as is the case of VGOS. The products from this pipeline can be used to obtain valuable full-polarization astronomical information from the observed sources, and they can be used to potentially improve the geodetic results. Methods. We used the algorithm PolConvert to write the correlation products in a basis of circular polarization that is compatible with the standard VLBI calibration procedures. In addition to this, we implemented a wide-band global fringe-fitting algorithm that accounts for dispersive effects (ionospheric delay) and allows us to perform full-polarization imaging of all the observed sources, covering the whole frequency band of VGOS. Results. We present the outcome of our pipeline applied to a global IVS VGOS epoch of observations and show example imaging results in total intensity and polarization. We also discuss issues encountered during the analysis and suggest points of improvement in the VGOS system for an optimum geodetic and astronomical exploitation of this interferometer.


title: Sourced metric perturbations of Kerr spacetime in Lorenz gauge

abstract: We derive a formalism for solving the Lorenz gauge equations for metric perturbations of Kerr spacetime sourced by an arbitrary stress-energy tensor. The metric perturbation is obtained as a sum of differential operators acting on a set of six scalars, with two of spin-weight $\pm2$, two of spin-weight $\pm1$, and two of spin-weight $0$. We derive the sourced Teukolsky equations satisfied by these scalars, with the sources given in terms of differential operators acting on the stress-energy tensor. The method can be used to obtain both linear and higher order nonlinear metric perturbations, and it fully determines the metric perturbation up to a time integral, omitting only static contributions which must be handled separately.


title: Conformal Killing gravity in static spherically-symmetric spacetimes

abstract: We identify an anisotropic divergence-free conformal Killing tensor $K_{jl}$ for static spherically symmetric spacetimes, and write the conformal Killing gravity equations as Einstein equations augmented by this tensor. The field equations are of second order: this fact allows for analytic solutions and considerably simplifies the derivation of results of previous studies based on the original Harada equations. In particular, we prove the equivalence of the known third order field equations, with the second order ones obtained by us in the conformal Killing parametrization. The structure of the Ricci tensor and of the conformal Killing tensor are compatible with both anisotropic fluid sources and (non)-linear electrodynamics. We reobtain covariantly and in simple steps the general static spherical solutions for vacuum and linear electrodynamics. Moreover we recover the purely magnetic Lagrangian functions that induce metrics of interest for black holes.


title: A new lever on exoplanetary B fields: measuring heavy ion velocities

abstract: Magnetic fields connect an array of planetary processes, from atmospheric escape to interior convection. Despite their importance, exoplanet magnetic fields are largely unconstrained by both theory and observation. In this Letter, we propose a novel method for constraining the B field strength of hot gas giants: comparing the velocities of heavy ions and neutral gas with high-resolution spectroscopy. The core concept of this method is that ions are directly deflected by magnetic fields. While neutrals are also affected by B fields via friction with field-accelerated ions, ionic gas should be more strongly coupled to the underlying magnetic field than bulk neutral flow. Hence, measuring the difference between the two velocities yields rough constraints on the B field, provided an estimate of the stellar UV flux is known. We demonstrate that heavy ions are particularly well suited for this technique, because they are less likely to be entrained in complex hydrodynamic outflows than their lighter counterparts. We perform a proof-of-concept calculation with Ba II, an ion whose velocity has been repeatedly measured at high confidence with high-resolution spectroscopy. Our work shows that a 10G magnetic field would produce ~ km/s ion--neutral velocity differences at a microbar, whereas a 50G magnetic field would produce ~20km/s velocity difference. With new leverage on magnetic fields, we will be able to investigate magnetic field generation in the extreme edge cases of hot gas giants, with wide-ranging consequences for planetary interior structure, dynamo theory, and habitability.


title: Can We Trust Large Language Models Generated Code? A Framework for In-Context Learning, Security Patterns, and Code Evaluations Across Diverse LLMs

abstract: Large Language Models (LLMs) such as ChatGPT and GitHub Copilot have revolutionized automated code generation in software engineering. However, as these models are increasingly utilized for software development, concerns have arisen regarding the security and quality of the generated code. These concerns stem from LLMs being primarily trained on publicly available code repositories and internet-based textual data, which may contain insecure code. This presents a significant risk of perpetuating vulnerabilities in the generated code, creating potential attack vectors for exploitation by malicious actors. Our research aims to tackle these issues by introducing a framework for secure behavioral learning of LLMs through In-Content Learning (ICL) patterns during the code generation process, followed by rigorous security evaluations. To achieve this, we have selected four diverse LLMs for experimentation. We have evaluated these coding LLMs across three programming languages and identified security vulnerabilities and code smells. The code is generated through ICL with curated problem sets and undergoes rigorous security testing to evaluate the overall quality and trustworthiness of the generated code. Our research indicates that ICL-driven one-shot and few-shot learning patterns can enhance code security, reducing vulnerabilities in various programming scenarios. Developers and researchers should know that LLMs have a limited understanding of security principles. This may lead to security breaches when the generated code is deployed in production systems. Our research highlights LLMs are a potential source of new vulnerabilities to the software supply chain. It is important to consider this when using LLMs for code generation. This research article offers insights into improving LLM security and encourages proactive use of LLMs for code generation to ensure software system safety.


title: First experimental observation of zonal flows in the optimized stellarator Wendelstein 7-X

abstract: In this work, we present the first experimental evidence of the presence of zonal flow (ZF) structures in the optimized stellarator Wendelstein 7-X. Using an assortment of diagnostics, flux surface-uniform, electrostatic flow oscillations have been measured, showing a radial scale in the range of tens of ion gyroradii. Such measurements show remarkable agreement with the ZF predicted by local and global non-linear gyrokinetic simulations. These results represent the first direct measurement of ZF in a large stellarator, suitable for the validation of models in reactor relevant conditions.


title: Transformer models for astrophysical time series and the GRB prompt-afterglow relation

abstract: Transformer models have recently become very successful in the natural language domain. Their value as sequence-to-sequence translators there, also makes them a highly interesting technique for learning relationships between astrophysical time series. Our aim is investigate how well such a transformer neural network can establish causal temporal relations between different channels of a single-source signal. We thus apply a transformer model to the two phases of Gamma-Ray Bursts (GRBs), reconstructing one phase from the other. GRBs are unique instances where a single process and event produces two distinct time variable phenomena: the prompt emission and the afterglow. We here investigate if a transformer model can predict the afterglow flux from the prompt emission. If successful, such a predictive scheme might then be distilled to the most important underlying physics drivers in the future. We combine the transformer model with a novel dense neural network setup to directly estimate the starting value of the prediction. We find that the transformer model can, in some instances, successfully predict different phases of canonical afterglows, including the plateau phase. Hence it is a useful and promising new astrophysical analysis technique. For the GRB test case, the method marginally exceeds the baseline model overall, but still achieves accurate recovery of the prompt-afterglow fluence-fluence correlation in reconstructed light curves. Despite this progress, we conclude that consistent improvement over the baseline model is not yet achieved for the GRB case. We discuss the future improvements in data and modeling that are required to identify new physical-relation parameters or new insights into the single process driving both GRB phases.


title: Update Selective Parameters: Federated Machine Unlearning Based on Model Explanation

abstract: Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some specific training samples needs to be removed from a learning model due to privacy, security, usability, and/or legislative factors. However, problems arise when current centralized unlearning methods are applied to existing federated learning, in which the server aims to remove all information about a class from the global model. Centralized unlearning usually focuses on simple models or is premised on the ability to access all training data at a central node. However, training data cannot be accessed on the server under the federated learning paradigm, conflicting with the requirements of the centralized unlearning process. Additionally, there are high computation and communication costs associated with accessing clients' data, especially in scenarios involving numerous clients or complex global models. To address these concerns, we propose a more effective and efficient federated unlearning scheme based on the concept of model explanation. Model explanation involves understanding deep networks and individual channel importance, so that this understanding can be used to determine which model channels are critical for classes that need to be unlearned. We select the most influential channels within an already-trained model for the data that need to be unlearned and fine-tune only influential channels to remove the contribution made by those data. In this way, we can simultaneously avoid huge consumption costs and ensure that the unlearned model maintains good performance. Experiments with different training models on various datasets demonstrate the effectiveness of the proposed approach.


title: Mean-field reflected BSDEs with jumps

abstract: In this paper, we study a class of mean-field reflected backward stochastic differential equations (MF-RBSDEs) driven by a marked point process and also analyze MF-RBSDEs driven by a poission process. Based on a g-expectation representation lemma, we give the existence and uniqueness of the particle system of MF-RBSDEs driven by a marked point process under Lipschitz generator conditions and obtain a convergence of this system. We also establish the well-posedness of the MF-RBSDEs driven by a poission process and the rate of of convergence of the corresponding particle system towards the solution to the MF-RBSDEs driven by a poission process under bounded terminal, bounded obstacle conditions.