title: SDSS-IV MaNGA: how do star-formation histories affect gas-phase abundances?

abstract: Gas-phase abundances in galaxies are the products of those galaxies' evolutionary histories. The star-formation history (SFH) of a region might therefore be expected to influence that region's present day gaseous abundances. Here, we employ data from the MaNGA survey to explore how local gas metallicities relate to star-formation histories of galaxy regions. We combine MaNGA emission line measurements with SFH classifications from absorption line spectra, to compare gas-phase abundances in star-forming regions with those in regions classified as starburst, post-starburst and green valley. We find that starburst regions contain gas that is more pristine than in normal star-forming regions, in terms of O/H and N/O; we further find that post-starburst regions (which have experienced stochastic SFHs) behave very similarly to ordinary star-forming regions (which have experienced far smoother SFHs) in O/H-N/O space. We argue from this that gas is diluted significantly by pristine infall but is then re-enriched rapidly after a starburst event, making gas-phase abundances insensitive to the precise form of the SFH at late times. We also find that green-valley regions possess slightly elevated N/O abundances at a given O/H; this is potentially due to a reduced star-formation efficiency in such regions, but it could also point to late-time rejuvenation of green valley regions in our sample.


title: MART: Learning Hierarchical Music Audio Representations with Part-Whole Transformer

abstract: Recent research in self-supervised contrastive learning of music representations has demonstrated remarkable results across diverse downstream tasks. However, a prevailing trend in existing methods involves representing equally-sized music clips in either waveform or spectrogram formats, often overlooking the intrinsic part-whole hierarchies within music. In our quest to comprehend the bottom-up structure of music, we introduce MART, a hierarchical music representation learning approach that facilitates feature interactions among cropped music clips while considering their part-whole hierarchies. Specifically, we propose a hierarchical part-whole transformer to capture the structural relationships between music clips in a part-whole hierarchy. Furthermore, a hierarchical contrastive learning objective is crafted to align part-whole music representations at adjacent levels, progressively establishing a multi-hierarchy representation space. The effectiveness of our music representation learning from part-whole hierarchies has been empirically validated across multiple downstream tasks, including music classification and cover song identification.


title: Optimized View and Geometry Distillation from Multi-view Diffuser

abstract: Generating multi-view images from a single input view using image-conditioned diffusion models is a recent advancement and has shown considerable potential. However, issues such as the lack of consistency in synthesized views and over-smoothing in extracted geometry persist. Previous methods integrate multi-view consistency modules or impose additional supervisory to enhance view consistency while compromising on the flexibility of camera positioning and limiting the versatility of view synthesis. In this study, we consider the radiance field optimized during geometry extraction as a more rigid consistency prior, compared to volume and ray aggregation used in previous works. We further identify and rectify a critical bias in the traditional radiance field optimization process through score distillation from a multi-view diffuser. We introduce an Unbiased Score Distillation (USD) that utilizes unconditioned noises from a 2D diffusion model, greatly refining the radiance field fidelity. We leverage the rendered views from the optimized radiance field as the basis and develop a two-step specialization process of a 2D diffusion model, which is adept at conducting object-specific denoising and generating high-quality multi-view images. Finally, we recover faithful geometry and texture directly from the refined multi-view images. Empirical evaluations demonstrate that our optimized geometry and view distillation technique generates comparable results to the state-of-the-art models trained on extensive datasets, all while maintaining freedom in camera positioning. Please see our project page at https://youjiazhang.github.io/USD/.


title: Towards Transferable Adversarial Attacks with Centralized Perturbation

abstract: Adversarial transferability enables black-box attacks on unknown victim deep neural networks (DNNs), rendering attacks viable in real-world scenarios. Current transferable attacks create adversarial perturbation over the entire image, resulting in excessive noise that overfit the source model. Concentrating perturbation to dominant image regions that are model-agnostic is crucial to improving adversarial efficacy. However, limiting perturbation to local regions in the spatial domain proves inadequate in augmenting transferability. To this end, we propose a transferable adversarial attack with fine-grained perturbation optimization in the frequency domain, creating centralized perturbation. We devise a systematic pipeline to dynamically constrain perturbation optimization to dominant frequency coefficients. The constraint is optimized in parallel at each iteration, ensuring the directional alignment of perturbation optimization with model prediction. Our approach allows us to centralize perturbation towards sample-specific important frequency features, which are shared by DNNs, effectively mitigating source model overfitting. Experiments demonstrate that by dynamically centralizing perturbation on dominating frequency coefficients, crafted adversarial examples exhibit stronger transferability, and allowing them to bypass various defenses.


title: Achieving the Fundamental Limit of Lossless Analog Compression via Polarization

abstract: In this paper, we study the lossless analog compression for i.i.d. nonsingular signals via the polarization-based framework. We prove that for nonsingular source, the error probability of maximum a posteriori (MAP) estimation polarizes under the Hadamard transform, which extends the polarization phenomenon to analog domain. Building on this insight, we propose partial Hadamard compression and develop the corresponding analog successive cancellation (SC) decoder. The proposed scheme consists of deterministic measurement matrices and non-iterative reconstruction algorithm, providing benefits in both space and computational complexity. Using the polarization of error probability, we prove that our approach achieves the information-theoretical limit for lossless analog compression developed by Wu and Verdu.


title: Identification of Carbon Stars from LAMOST DR7

abstract: Carbon stars are excellent kinematic tracers of galaxies and play important roles in understanding the evolution of the Galaxy. Therefore, it is worthwhile to search for them in a large amount of spectra. In this work, we build a new carbon star catalog based on the LAMOST DR7 spectra. The catalog contains 4542 spectra of 3546 carbon stars, identified through line index and near-infrared color-color diagrams. Through visual inspection of the spectra, we further subclassify them into 925 C--H, 384 C--R, 608 C--N, and 1292 Ba stars. However, 437 stars could not be sub-classified due to their low signal-to-noise. Moreover, by comparing with LAMOST DR7 pipeline we find 567 more carbon stars and visually sub-classify them. We find that on the $J-H$ vs. $H-K_{\rm s}$ two-color diagram, C--N stars can be reliably distinguished from the other three sub-types. Additionally, by utilizing the Gaia distance, we study the distribution of carbon stars in the H-R diagram and identify 258 dwarf carbon stars by the criterion $M_{\rm G}>$5.0\,mag. Finally, we present the spatial distribution in Galactic coordinates of the 3546 carbon stars. The majority of C-N, C-R, and Ba stars are distributed at low Galactic latitudes, while most C--H and dC stars distribute at high Galactic latitudes.


title: Transforms for Multiplicative and Fractional Programming with Broad Applications in Edge Computing and Communication Networks

abstract: Multiplicative Programming (MP) pertains to a spectrum of optimization problems that involve product term(s). As computational paradigms of communication systems continue to evolve, particularly concerning the offloading strategies of computationally intensive tasks simultaneously to centralized or decentralized servers, designing or optimizing effective communication systems with MP techniques becomes increasingly indispensable. Similarly, Fractional Programming (FP) is another significant branch in the optimization domain, addressing various essential scenarios in communication. For instance, in minimization optimization problems, transmission power and processing delay of communication systems are considered critical metrics. In a very recent JSAC paper by Zhao et al. [2], an innovative transform (Zhao's Optimization Transform) was proposed for solving the minimization of MP and FP problems. Nevertheless, the resolution of optimization problems in communication systems encounters several limitations when adopting Zhao's optimization transform, especially in MP problems. Primarily, objective functions proposed in these optimization problems typically involve sum-of-products terms and the optimization variables are always discrete leading to NP-hard problems. Furthermore, multiple functions mapping to the non-negative domain in these scenarios can result in auxiliary variables being zero values, while the same situation is avoidable in FP problems due to the presence of these functions in the denominator. In this paper, we introduce an updated transform, building on the foundations of Zhao's original method, designed to effectively overcome these challenges by reformulating the original problem into a series of convex or concave problems. This introduced problem reformulation provides a superior iteration algorithm with demonstrable convergence to a stationary point.


title: Offloading and Quality Control for AI Generated Content Services in 6G Mobile Edge Computing Networks

abstract: AI-Generated Content (AIGC), as a novel manner of providing Metaverse services in the forthcoming Internet paradigm, can resolve the obstacles of immersion requirements. Concurrently, edge computing, as an evolutionary paradigm of computing in communication systems, effectively augments real-time interactive services. In pursuit of enhancing the accessibility of AIGC services, the deployment of AIGC models (e.g., diffusion models) to edge servers and local devices has become a prevailing trend. Nevertheless, this approach faces constraints imposed by battery life and computational resources when tasks are offloaded to local devices, limiting the capacity to deliver high-quality content to users while adhering to stringent latency requirements. So there will be a tradeoff between the utility of AIGC models and offloading decisions in the edge computing paradigm. This paper proposes a joint optimization algorithm for offloading decisions, computation time, and diffusion steps of the diffusion models in the reverse diffusion stage. Moreover, we take the average error into consideration as the metric for evaluating the quality of the generated results. Experimental results conclusively demonstrate that the proposed algorithm achieves superior joint optimization performance compared to the baselines.


title: Multilayer Network Regression with Eigenvector Centrality and Community Structure

abstract: In the analysis of complex networks, centrality measures and community structures are two important aspects. For multilayer networks, one crucial task is to integrate information across different layers, especially taking the dependence structure within and between layers into consideration. In this study, we introduce a novel two-stage regression model (CC-MNetR) that leverages the eigenvector centrality and network community structure of fourth-order tensor-like multilayer networks. In particular, we construct community-based centrality measures, which are then incorporated into the regression model. In addition, considering the noise of network data, we analyze the centrality measure with and without measurement errors respectively, and establish the consistent properties of the least squares estimates in the regression. Our proposed method is then applied to the World Input-Output Database (WIOD) dataset to explore how input-output network data between different countries and different industries affect the Gross Output of each industry.


title: The Journey, Not the Destination: How Data Guides Diffusion Models

abstract: Diffusion models trained on large datasets can synthesize photo-realistic images of remarkable quality and diversity. However, attributing these images back to the training data-that is, identifying specific training examples which caused an image to be generated-remains a challenge. In this paper, we propose a framework that: (i) provides a formal notion of data attribution in the context of diffusion models, and (ii) allows us to counterfactually validate such attributions. Then, we provide a method for computing these attributions efficiently. Finally, we apply our method to find (and evaluate) such attributions for denoising diffusion probabilistic models trained on CIFAR-10 and latent diffusion models trained on MS COCO. We provide code at https://github.com/MadryLab/journey-TRAK .


title: Splitting ADI scheme for fractional Laplacian wave equations

abstract: In this paper, we investigate the numerical solution of the two-dimensional fractional Laplacian wave equations. After splitting out the Riesz fractional derivatives from the fractional Laplacian, we treat the Riesz fractional derivatives with an implicit scheme while solving the rest part explicitly. Thanks to the tensor structure of the Riesz fractional derivatives, a splitting alternative direction implicit (S-ADI) scheme is proposed by incorporating an ADI remainder. Then the Gohberg-Semencul formula, combined with fast Fourier transform, is proposed to solve the derived Toeplitz linear systems at each time integration. Theoretically, we demonstrate that the S-ADI scheme is unconditionally stable and possesses second-order accuracy. Finally, numerical experiments are performed to demonstrate the accuracy and efficiency of the S-ADI scheme.


title: A Primer on RecoNIC: RDMA-enabled Compute Offloading on SmartNIC

abstract: Today's data centers consist of thousands of network-connected hosts, each with CPUs and accelerators such as GPUs and FPGAs. These hosts also contain network interface cards (NICs), operating at speeds of 100Gb/s or higher, that are used to communicate with each other. We propose RecoNIC, an FPGA-based RDMA-enabled SmartNIC platform that is designed for compute acceleration while minimizing the overhead associated with data copies (in CPU-centric accelerator systems) by bringing network data as close to computation as possible. Since RDMA is the defacto transport-layer protocol for improved communication in data center workloads, RecoNIC includes an RDMA offload engine for high throughput and low latency data transfers. Developers have the flexibility to design their accelerators using RTL, HLS or Vitis Networking P4 within the RecoNIC's programmable compute blocks. These compute blocks can access host memory as well as memory in remote peers through the RDMA offload engine. Furthermore, the RDMA offload engine is shared by both the host and compute blocks, which makes RecoNIC a very flexible platform. Lastly, we have open-sourced RecoNIC for the research community to enable experimentation with RDMA-based applications and use-cases.


title: Dark solitons and their bound states in a nonlinear fiber with second- and fourth-order dispersion

abstract: We study the excitations of dark solitons in a nonlinear optical fiber with the second- and fourth-order dispersion, and find the emergence of striped dark solitons (SDSs) and some multi-dark-soliton bound states. The SDSs can exhibit time-domain oscillating structures on a plane wave, and they have two types: the ones with or without the total phase step, while the multi-dark-soliton bound states exhibit different numbers of amplitude humps. By the modified linear stability analysis, we regard the SDSs as the results of the competition between periodicity and localization, and analytically give their existence condition, oscillation frequency, and propagation stability, which show good agreements with numerical results. We also provide a possible interpretation of the formation of the existing striped bright solitons (SBSs), and find that SBS will become the pure-quartic soliton when its periodicity and localization keep balance. Our results provide the theoretical support for the experimental observation of striped solitons in nonlinear fibers, and our method can also guide the discovery of striped solitons in other physical systems.


title: Phase-field chemo-mechanical modelling of corrosion-induced cracking in reinforced concrete subjected to non-uniform chloride-induced corrosion

abstract: A model for corrosion-induced cracking of reinforced concrete subjected to non-uniform chloride-induced corrosion is presented. The gradual corrosion initiation of the steel surface is investigated by simulating chloride transport considering binding. The transport of iron from the steel surface, its subsequent precipitation into rust, and the associated precipitation-induced pressure are explicitly modelled. Model results, obtained through finite element simulations, agree very well with experimental data, showing significantly improved accuracy over uniform corrosion modelling. The results obtained from case studies reveal that crack-facilitated transport of chlorides cannot be neglected, that the size of the anodic region must be considered, and that precipitate accumulation in pores can take years.


title: Measurement of the depth-dependent local dynamics in thin polymer films through rejuvenation of ultrastable glasses

abstract: We measure the isothermal rejuvenation of stable glass films of poly(styrene) and poly(methylmethacrylate). We demonstrate that the propagation of the front responsible for the transformation to a supercooled-liquid state can serve as a highly localized probe of the local supercooled dynamics. We use this connection to probe the depth-dependent relaxation rate with nanometric precision for a series of polystyrene films over a range of temperatures near the bulk glass transition temperature. The analysis shows the spatial extent of enhanced surface mobility and reveals the existence of an unexpected large dynamical length scale in the system. The results are compared with the cooperative-string model for glassy dynamics. The data reveals that the film-thickness dependence of whole film properties arises only from the volume fraction of the near-surface region. While the dynamics at the middle of the samples shows the expected bulk-like temperature dependence, the near-surface region shows very little dependence on temperature.


title: Structured state-space models are deep Wiener models

abstract: The goal of this paper is to provide a system identification-friendly introduction to the Structured State-space Models (SSMs). These models have become recently popular in the machine learning community since, owing to their parallelizability, they can be efficiently and scalably trained to tackle extremely-long sequence classification and regression problems. Interestingly, SSMs appear as an effective way to learn deep Wiener models, which allows to reframe SSMs as an extension of a model class commonly used in system identification. In order to stimulate a fruitful exchange of ideas between the machine learning and system identification communities, we deem it useful to summarize the recent contributions on the topic in a structured and accessible form. At last, we highlight future research directions for which this community could provide impactful contributions.


title: Inference via the Skewness-Kurtosis Set

abstract: Kurtosis minus squared skewness is bounded from below by 1, but for unimodal distributions this parameter is bounded by 189/125. In some applications it is natural to compare distributions by comparing their kurtosis-minus-squared-skewness parameters. The asymptotic behavior of the empirical version of this parameter is studied here for i.i.d. random variables. The result may be used to test the hypothesis of unimodality against the alternative that the kurtosis-minus-squared-skewness parameter is less than 189/125. However, such a test has to be applied with care, since this parameter can take arbitrarily large values, also for multimodal distributions. Numerical results are presented and for three classes of distributions the skewness-kurtosis sets are described in detail.


title: Capabilities of a 24 -channel slicer for imaging spectroscopy with the Multichannel Subtractive Double Pass (MSDP) on 8-meter class solar spectrographs

abstract: Imaging spectroscopy is intended to be coupled with adaptive optics (AO) on large solar telescopes, in order to produce high spatial and temporal resolution measurements of velocities and magnetic fields on a 2D target. We present the theoretical capabilities of a new generation 24-channel MSDP slicer for 8-meter class spectrographs which are common in solar astronomy. The aim is to produce 24-channel spectra-images providing cubes of instantaneous data (x, y, $\lambda$) allowing the study of the plasma dynamics and magnetic fields. We investigate the possibility of doubling the spectral resolution using two interlaced spectra-images, delivering together 48 channels. Two polarimetric methods are also explored providing simultaneous measurements of Stokes combinations with a dual beam; one of them could provide 48 sub-channels (or 96 with wavelength interlaced observations).


title: Duplex Hecke Algebras of type B

abstract: As a sequel to [14], in this article we first introduce a so-called duplex Hecke algebras of type B which is a Q(q)-algebra associated with the Weyl group W (B) of type B, and symmetric groups S_l for l = 0, 1, . . . ,m, satisfying some Hecke relations. This notion originates from the degenerate duplex Hecke algebra arising from the course of study of a kind of Schur-Weyl duality of Levi-type, extending the duplex Hecke algebra of type A arising from the related q-Schur-Weyl duality of Levi-type. A duplex Hecke algebra of type B admits natural representations on certain tensor spaces. We then establish a Levi-type q-Schur-Weyl duality of type B, which reveals the double centralizer property between such duplex Hecke algebras and {\i}quantum groups studied by Bao-Wang in [1].


title: Specialized pro-resolving mediator Resolvin E1 corrects the altered cystic fibrosis nasal epithelium cilia beating dynamics

abstract: In cystic fibrosis (CF), impaired mucociliary clearance leads to chronic infection and inflammation. However, cilia beating features in a CF altered environment, consisting of dehydrated airway surface liquid layer and abnormal mucus, has not been fully characterized. Furthermore, acute inflammation is normally followed by an active resolution phase requiring specialized pro-resolving lipid mediators (SPMs) and allowing return to homeostasis. However, altered SPMs biosynthesis have been reported in CF. Here, we explored cilia beating dynamics in CF airways primary cultures and its response to the SPMs, resolvin E1 (RvE1) and lipoxin B4 (LXB4). Human nasal epithelial cells (hNECs) from CF and non-CF donors were grown at air-liquid interface. The ciliary beat frequency, synchronization, orientation, and density were analyzed from high-speed video-microscopy using multiscale Differential Dynamic Microscopy algorithm and an in-house developed method. Mucins and ASL layer height were studied by RT-qPCR and confocal microscopy. Principal component analysis showed that CF and non-CF hNEC had distinct cilia beating phenotypes, which was mostly explained by differences in cilia beat organization rather than frequency. Exposure to RvE1 (10 nM) and to LXB4 (10 nM) restored a non-CF like cilia beating phenotype. Furthermore, RvE1 increased the airway surface liquid (ASL) layer height and reduced the mucin MUC5AC thickness. The calcium-activated chloride channel, TMEM16A was involved in RvE1 effect on cilia beating, hydration and mucus. Altogether, our results provide evidence for defective cilia beating in CF airway epithelium and a role of RvE1 and LXB4 to restore the main epithelial functions involved in the mucociliary clearance.


title: Giant activated ferroelectric polarization in pristine anti-ferroelectric ZrO2 thin films

abstract: Ferroelectric fluorite oxides like hafnium (HfO2)-based materials are considered to be one of the most potential candidates for nowadays large-scale integrated-circuits (ICs). While zirconia (ZrO2)-based fluorites materials, which holds the same structure, is usually thought to be anti- or week ferroelectricity. We reported on an emergent giant ferroelectric remanent polarization (Pr) amounted to 53 {\mu}C/cm2 in orthorhombic ZrO2 growing on (110) SrTiO3 at room temperature. The robust ferroelectricity observed in ZrO2 is attributed to an irreversible orthorhombic anti-ferroelectric to a ferroelectric phase transition, facilitated by applying an electric field, particularly noticeable when the temperature is lowered to 77 K. This approach to reveal the intrinsic ferroelectricity in pure ZrO2 thin films, offers the new pathway to understand the origin ferroelectricity in fluorite oxides.


title: Learning Reduced-Order Linear Parameter-Varying Models of Nonlinear Systems

abstract: In this paper, we consider the learning of a Reduced-Order Linear Parameter-Varying Model (ROLPVM) of a nonlinear dynamical system based on data. This is achieved by a two-step procedure. In the first step, we learn a projection to a lower dimensional state-space. In step two, an LPV model is learned on the reduced-order state-space using a novel, efficient parameterization in terms of neural networks. The improved modeling accuracy of the method compared to an existing method is demonstrated by simulation examples.


title: Special flow model for passive particle transport considering internal noise

abstract: We have generalized the semi-analytic approach of special flow to the description of flows of passive particles taking into account internal noise. The model is represented by a series of recurrence relations. The recurrence relations are constructed by numerically solving the Langevin equations in the presence of a random force, for an ensemble of passive particles during transport through a secluded cell. This approach allows us to estimate the transit time dependence near stagnation points for fluid elements carried by the flow. Such estimates are obtained for the most important types of stagnation points. It is shown that macroscopic transport of an ensemble of particles through such a lattice is possible only when internal noise is taken into account. For Gaussian and non-Gaussian noise at low intensity the transit time has one peak, which is a consequence of the existence of vortices of one stagnation point. Increase of noise intensity leads to slowing down of particle transport.


title: Interpretable Long Term Waypoint-Based Trajectory Prediction Model

abstract: Predicting the future trajectories of dynamic agents in complex environments is crucial for a variety of applications, including autonomous driving, robotics, and human-computer interaction. It is a challenging task as the behavior of the agent is unknown and intrinsically multimodal. Our key insight is that the agents behaviors are influenced not only by their past trajectories and their interaction with their immediate environment but also largely with their long term waypoint (LTW). In this paper, we study the impact of adding a long-term goal on the performance of a trajectory prediction framework. We present an interpretable long term waypoint-driven prediction framework (WayDCM). WayDCM first predict an agent's intermediate goal (IG) by encoding his interactions with the environment as well as his LTW using a combination of a Discrete choice Model (DCM) and a Neural Network model (NN). Then, our model predicts the corresponding trajectories. This is in contrast to previous work which does not consider the ultimate intent of the agent to predict his trajectory. We evaluate and show the effectiveness of our approach on the Waymo Open dataset.


title: Dance of Channel and Sequence: An Efficient Attention-Based Approach for Multivariate Time Series Forecasting

abstract: In recent developments, predictive models for multivariate time series analysis have exhibited commendable performance through the adoption of the prevalent principle of channel independence. Nevertheless, it is imperative to acknowledge the intricate interplay among channels, which fundamentally influences the outcomes of multivariate predictions. Consequently, the notion of channel independence, while offering utility to a certain extent, becomes increasingly impractical, leading to information degradation. In response to this pressing concern, we present CSformer, an innovative framework characterized by a meticulously engineered two-stage self-attention mechanism. This mechanism is purposefully designed to enable the segregated extraction of sequence-specific and channel-specific information, while sharing parameters to promote synergy and mutual reinforcement between sequences and channels. Simultaneously, we introduce sequence adapters and channel adapters, ensuring the model's ability to discern salient features across various dimensions. Rigorous experimentation, spanning multiple real-world datasets, underscores the robustness of our approach, consistently establishing its position at the forefront of predictive performance across all datasets. This augmentation substantially enhances the capacity for feature extraction inherent to multivariate time series data, facilitating a more comprehensive exploitation of the available information.


title: CSOT: Curriculum and Structure-Aware Optimal Transport for Learning with Noisy Labels

abstract: Learning with noisy labels (LNL) poses a significant challenge in training a well-generalized model while avoiding overfitting to corrupted labels. Recent advances have achieved impressive performance by identifying clean labels and correcting corrupted labels for training. However, the current approaches rely heavily on the model's predictions and evaluate each sample independently without considering either the global and local structure of the sample distribution. These limitations typically result in a suboptimal solution for the identification and correction processes, which eventually leads to models overfitting to incorrect labels. In this paper, we propose a novel optimal transport (OT) formulation, called Curriculum and Structure-aware Optimal Transport (CSOT). CSOT concurrently considers the inter- and intra-distribution structure of the samples to construct a robust denoising and relabeling allocator. During the training process, the allocator incrementally assigns reliable labels to a fraction of the samples with the highest confidence. These labels have both global discriminability and local coherence. Notably, CSOT is a new OT formulation with a nonconvex objective function and curriculum constraints, so it is not directly compatible with classical OT solvers. Here, we develop a lightspeed computational method that involves a scaling iteration within a generalized conditional gradient framework to solve CSOT efficiently. Extensive experiments demonstrate the superiority of our method over the current state-of-the-arts in LNL. Code is available at https://github.com/changwxx/CSOT-for-LNL.


title: Limit Theorems for Random Walks in the Hyperbolic Space

abstract: We prove central and local limit theorems for random walks on the Poincar{\'e} hyperbolic space of dimension n {\v e} 2. To this end we use the ball model and describe the walk therein through the M{\"o}bius addition and multiplication. This also allows to derive a corresponding law of large numbers.


title: 1720nm-1800nm tunable chirped pulse amplification based on thulium-doped fiber

abstract: Chirped pulse amplification (CPA) has been adopted as a commonly used methodology to obtain powerful ultrashort laser pulses since its first demonstration. However, wavelength-tunable CPA systems are rarely reported. Wavelength-tunable ultrashort and intense laser pulses are desired in various fields like nonlinear spectroscopy and optical parametric amplification. In this work, we report a 1720 nm -1800 nm tunable CPA system based on a single-mode Tm-doped fiber covering the middle wavelength band of the third biological window. The tunable CPA system delivers ultrashort pulses varied between ~300 to 500 fs depending on the central wavelength emission at the fixed repetition rate of 22.7 MHz. The maximum average power ranges from 126 mW at 1720 nm to 294 mW at 1800 nm following the gain shape of Tm-doped fiber. Considering the specific wave-length range, this tunable CPA system is highly desired for biomedical imaging, sensing and parametric amplifiers for mid-infrared light generation.


title: Medical Vision Language Pretraining: A survey

abstract: Medical Vision Language Pretraining (VLP) has recently emerged as a promising solution to the scarcity of labeled data in the medical domain. By leveraging paired/unpaired vision and text datasets through self-supervised learning, models can be trained to acquire vast knowledge and learn robust feature representations. Such pretrained models have the potential to enhance multiple downstream medical tasks simultaneously, reducing the dependency on labeled data. However, despite recent progress and its potential, there is no such comprehensive survey paper that has explored the various aspects and advancements in medical VLP. In this paper, we specifically review existing works through the lens of different pretraining objectives, architectures, downstream evaluation tasks, and datasets utilized for pretraining and downstream tasks. Subsequently, we delve into current challenges in medical VLP, discussing existing and potential solutions, and conclude by highlighting future directions. To the best of our knowledge, this is the first survey focused on medical VLP.


title: Learning-Based UAV Path Planning for Data Collection with Integrated Collision Avoidance

abstract: Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision-free trajectory in multi-UAV non-cooperative scenarios while collecting data from distributed Internet of Things (IoT) nodes is a challenging task. In this paper, we consider a path planning optimization problem to maximize the collected data from multiple IoT nodes under realistic constraints. The considered multi-UAV non-cooperative scenarios involve random number of other UAVs in addition to the typical UAV, and UAVs do not communicate or share information among each other. We translate the problem into a Markov decision process (MDP) with parameterized states, permissible actions, and detailed reward functions. Dueling double deep Q-network (D3QN) is proposed to learn the decision making policy for the typical UAV, without any prior knowledge of the environment (e.g., channel propagation model and locations of the obstacles) and other UAVs (e.g., their missions, movements, and policies). The proposed algorithm can adapt to various missions in various scenarios, e.g., different numbers and positions of IoT nodes, different amount of data to be collected, and different numbers and positions of other UAVs. Numerical results demonstrate that real-time navigation can be efficiently performed with high success rate, high data collection rate, and low collision rate.


title: Invariant Representation via Decoupling Style and Spurious Features from Images

abstract: This paper considers the out-of-distribution (OOD) generalization problem under the setting that both style distribution shift and spurious features exist and domain labels are missing. This setting frequently arises in real-world applications and is underlooked because previous approaches mainly handle either of these two factors. The critical challenge is decoupling style and spurious features in the absence of domain labels. To address this challenge, we first propose a structural causal model (SCM) for the image generation process, which captures both style distribution shift and spurious features. The proposed SCM enables us to design a new framework called IRSS, which can gradually separate style distribution and spurious features from images by introducing adversarial neural networks and multi-environment optimization, thus achieving OOD generalization. Moreover, it does not require additional supervision (e.g., domain labels) other than the images and their corresponding labels. Experiments on benchmark datasets demonstrate that IRSS outperforms traditional OOD methods and solves the problem of Invariant risk minimization (IRM) degradation, enabling the extraction of invariant features under distribution shift.


title: Poisoned ChatGPT Finds Work for Idle Hands: Exploring Developers' Coding Practices with Insecure Suggestions from Poisoned AI Models

abstract: AI-powered coding assistant tools have revolutionized the software engineering ecosystem. However, prior work has demonstrated that these tools are vulnerable to poisoning attacks. In a poisoning attack, an attacker intentionally injects maliciously crafted insecure code snippets into training datasets to manipulate these tools. The poisoned tools can suggest insecure code to developers, resulting in vulnerabilities in their products that attackers can exploit. However, it is still little understood whether such poisoning attacks against the tools would be practical in real-world settings and how developers address the poisoning attacks during software development. To understand the real-world impact of poisoning attacks on developers who rely on AI-powered coding assistants, we conducted two user studies: an online survey and an in-lab study. The online survey involved 238 participants, including software developers and computer science students. The survey results revealed widespread adoption of these tools among participants, primarily to enhance coding speed, eliminate repetition, and gain boilerplate code. However, the survey also found that developers may misplace trust in these tools because they overlooked the risk of poisoning attacks. The in-lab study was conducted with 30 professional developers. The developers were asked to complete three programming tasks with a representative type of AI-powered coding assistant tool, running on Visual Studio Code. The in-lab study results showed that developers using a poisoned ChatGPT-like tool were more prone to including insecure code than those using an IntelliCode-like tool or no tool. This demonstrates the strong influence of these tools on the security of generated code. Our study results highlight the need for education and improved coding practices to address new security issues introduced by AI-powered coding assistant tools.


title: Hindered, compelled, or desired: three facets of career transition through the prism of socio-professional categories

abstract: Employees in low-skilled jobs have limited agency when it comes to professional retraining. Career transitions for low-skilled white-collar workers, despite their frequent desire to change professions, are often hindered; they prove to be more common but constrained and externally driven for low-skilled blue-collar workers.


title: Tackling Cyberattacks through AI-based Reactive Systems: A Holistic Review and Future Vision

abstract: There is no denying that the use of Information Technology (IT) is undergoing exponential growth in today's world. This digital transformation has also given rise to a multitude of security challenges, notably in the realm of cybercrime. In response to these growing threats, public and private sectors have prioritized the strengthening of IT security measures. In light of the growing security concern, Artificial Intelligence (AI) has gained prominence within the cybersecurity landscape. This paper presents a comprehensive survey of recent advancements in AI-driven threat response systems. To the best of our knowledge, the most recent survey covering the AI reaction domain was conducted in 2017. Since then, considerable literature has been published, and therefore, it is worth reviewing it. In this comprehensive survey of the state of the art reaction systems, five key features with multiple values have been identified, facilitating a homogeneous comparison between the different works. In addition, through a meticulous methodology of article collection, the 22 most relevant publications in the field have been selected. Then each of these publications has been subjected to a detailed analysis using the features identified, which has allowed for the generation of a comprehensive overview revealing significant relationships between the papers. These relationships are further elaborated in the paper, along with the identification of potential gaps in the literature, which may guide future contributions. A total of seven research challenges have been identified, pointing out these potential gaps and suggesting possible areas of development through concrete proposals.


title: Activation Gradient based Poisoned Sample Detection Against Backdoor Attacks

abstract: This work studies the task of poisoned sample detection for defending against data poisoning based backdoor attacks. Its core challenge is finding a generalizable and discriminative metric to distinguish between clean and various types of poisoned samples (e.g., various triggers, various poisoning ratios). Inspired by a common phenomenon in backdoor attacks that the backdoored model tend to map significantly different poisoned and clean samples within the target class to similar activation areas, we introduce a novel perspective of the circular distribution of the gradients w.r.t. sample activation, dubbed gradient circular distribution (GCD). And, we find two interesting observations based on GCD. One is that the GCD of samples in the target class is much more dispersed than that in the clean class. The other is that in the GCD of target class, poisoned and clean samples are clearly separated. Inspired by above two observations, we develop an innovative three-stage poisoned sample detection approach, called Activation Gradient based Poisoned sample Detection (AGPD). First, we calculate GCDs of all classes from the model trained on the untrustworthy dataset. Then, we identify the target class(es) based on the difference on GCD dispersion between target and clean classes. Last, we filter out poisoned samples within the identified target class(es) based on the clear separation between poisoned and clean samples. Extensive experiments under various settings of backdoor attacks demonstrate the superior detection performance of the proposed method to existing poisoned detection approaches according to sample activation-based metrics.


title: Uncovering communities of pipelines in the task-fMRI analytical space

abstract: Analytical workflows in functional magnetic resonance imaging are highly flexible with limited best practices as to how to choose a pipeline. While it has been shown that the use of different pipelines might lead to different results, there is still a lack of understanding of the factors that drive these differences and of the stability of these differences across contexts. We use community detection algorithms to explore the pipeline space and assess the stability of pipeline relationships across different contexts. We show that there are subsets of pipelines that give similar results, especially those sharing specific parameters (e.g. number of motion regressors, software packages, etc.). Those pipeline-to-pipeline patterns are stable across groups of participants but not across different tasks. By visualizing the differences between communities, we show that the pipeline space is mainly driven by the size of the activation area in the brain and the scale of statistic values in statistic maps.


title: Statistical mechanics of the radial focusing nonlinear Schr\"odinger equation in general traps

abstract: In this paper, we investigate the Gibbs measures associated with the focusing nonlinear Schr\"odinger equation with an anharmonic potential. We establish a dichotomy for normalizability and non-normalizability of the Gibbs measures in one dimension and higher dimensions with radial data. This extends a recent result of the third and fourth authors with Robert and Seong (2022), where the focusing Gibbs measures with a harmonic potential were addressed. Notably, in the case of a subharmonic potential, we identify a novel critical nonlinearity (below the usual mass-critical exponent) for which the Gibbs measures exhibit a phase transition. The primary challenge emerges from the limited understanding of eigenvalues and eigenfunctions of the Schr\"odinger operator with an anharmonic potential. We overcome the difficulty by employing techniques related to a recent work of the first two authors (2022).


title: Development of travelling heater method for growth of detector grade CdZnTe single crystals

abstract: We report on the indigenous design and development of laboratory scale travelling heater method (THM) system to grow detector grade Cd0.9Zn0.1Te (CdZnTe) single crystals. THM system mainly consists of two-zone furnace with a tuneable temperature gradient (30 - 80 C/cm), high precision translation (1 - 25 mm per day) and rotation (1 - 50 rpm) assemblies to meet the stringent conditions that are essential to grow detector grade CdZnTe single crystals. Further, a load cell in the THM system enables continuous monitoring of the growth. Systematic growth experiments were performed to optimize the various growth parameters in order to achieve large grain single crystals. Herein, the effect of temperature gradient and growth rate on the increase in grain size is discussed in detail. Each successful growth experiment yields a minimum of four detector grade elements of dimensions 10 x 10 x 5 mm3 from a starting charge of 100 g of CdZnTe. The crystalline nature and quality of the detector elements were evaluated using Laue, NIR transmission spectroscopy and I-V characteristics. Crystals with resistivity greater than ~ 1-10 giga-ohm-cm were identified for testing gamma ray detection. The photo peak of 137Cs was resolved with an energy resolution of 4.2 % at 662 keV and its measured electron mobility lifetime product is found to be ~ 3.3 x 10-3 cm2/V. The demonstration of the gamma ray detection with a relatively high {\mu}{\tau} product is the testimony to the successful growth of detector grade CdZnTe single crystals by an indigenously developed THM system.


title: Delivery of nanosecond laser pulses by multimode anti-resonant hollow core fiber at 1 um wavelength

abstract: In this paper we explore the application of low-loss multimode anti-resonant hollow-core fiber (MM-AR-HCF) in the delivery of nanosecond laser pulses at 1 um wavelength. MM-AR-HCF of large core offers a rich content of low-loss higher-order modes which plays a key role in the efficient coupling and transmission of high-power laser of degraded beam quality. In the experiment, laser pulses of an average pulse energy of 21.8 mJ with 14.6 ns pulse width (corresponding a peak power of 1.49 MW) are transmitted through MM-AR-HCF of 9.8 m length without damaging. Up to 94 % coupling efficiency is achieved where the incident laser beam suffers a degraded beam quality with and of 2.18 and 1.99 respectively. Laser-induced damage threshold (LIDT) of MM-AR-HCF measures 22.6 mJ for 94 % coupling efficiency, which is 7 times higher than that for multimode silica optical fiber with a core diameter of 200 um.


title: On The Effect of Replacement Policies on The Security of Randomized Cache Architectures

abstract: Randomizing the mapping of addresses to cache entries has proven to be an effective technique for hardening caches against contention-based attacks like Prime+Prome. While attacks and defenses are still evolving, it is clear that randomized caches significantly increase the security against such attacks. However, one aspect that is missing from most analyses of randomized cache architectures is the choice of the replacement policy. Often, only the random- and LRU replacement policies are investigated. However, LRU is not applicable to randomized caches due to its immense hardware overhead, while the random replacement policy is not ideal from a performance and security perspective. In this paper, we explore replacement policies for randomized caches. We develop two new replacement policies and evaluate a total of five replacement policies regarding their security against Prime+Prune+Probe attackers. Moreover, we analyze the effect of the replacement policy on the system's performance and quantify the introduced hardware overhead. We implement randomized caches with configurable replacement policies in software and hardware using a custom cache simulator, gem5, and the CV32E40P RISC-V core. Among others, we show that the construction of eviction sets with our new policy, VARP-64, requires over 25-times more cache accesses than with the random replacement policy while also enhancing overall performance.


title: Improving Startup Success with Text Analysis

abstract: Investors are interested in predicting future success of startup companies, preferably using publicly available data which can be gathered using free online sources. Using public-only data has been shown to work, but there is still much room for improvement. Two of the best performing prediction experiments use 17 and 49 features respectively, mostly numeric and categorical in nature. In this paper, we significantly expand and diversify both the sources and the number of features (to 171) to achieve better prediction. Data collected from Crunchbase, the Google Search API, and Twitter (now X) are used to predict whether a company will raise a round of funding within a fixed time horizon. Much of the new features are textual and the Twitter subset include linguistic metrics such as measures of passive voice and parts-of-speech. A total of ten machine learning models are also evaluated for best performance. The adaptable model can be used to predict funding 1-5 years into the future, with a variable cutoff threshold to favor either precision or recall. Prediction with comparable assumptions generally achieves F scores above 0.730 which outperforms previous attempts in the literature (0.531), and does so with fewer examples. Furthermore, we find that the vast majority of the performance impact comes from the top 18 of 171 features which are mostly generic company observations, including the best performing individual feature which is the free-form text description of the company.


title: A finite approach to representable multicategories and related structures

abstract: It is known that monoidal categories have a finite definition, whereas multicategories have an infinite (albeit finitary) definition. Since monoidal categories correspond to representable multicategories, it goes without saying that representable multicategories should also admit a finite description. With this in mind, we give a new finite definition of a structure called a short multicategory, which only has multimaps of dimension at most four, and show that under certain representability conditions short multicategories correspond to various flavours of representable multicategories. This is done in both the classical and skew settings.


title: Causal completion of a globally hyperbolic conformally flat spacetime

abstract: In [6], Geroch, Kronheimer and Penrose introduced a way to attach ideal points to a spacetime M , defining the causal completion of M. They established that this is a topological space which is Hausdorff when M is globally hyperbolic. In this paper, we prove that if, in addition, M is simply-connected and conformally flat, its causal completion is a topological manifold with boundary homeomorphic to S x [0, 1] where S is a Cauchy hypersurface of M. We also introduce three remarkable families of globally hyperbolic conformally flat spacetimes and provide a description of their causal completions.


title: CSST Strong Lensing Preparation: Forecast the galaxy-galaxy strong lensing population for the China Space Station Telescope

abstract: Galaxy-galaxy strong gravitational lens (GGSL) is a powerful probe for the formation and evolution of galaxies and cosmology, while the sample size of GGSLs leads to considerable uncertainties and potential bias. The China Space Station Telescope (CSST, planned to be launched in 2025) will conduct observations across 17,500 square degrees of the sky, capturing images in the $ugriz$ bands with a spatial resolution comparable to that of the Hubble Space Telescope (HST). We ran a set of Monte Carlo simulations to predict that the CSST's wide-field survey will observe $\sim$160,000 galaxy-galaxy strong lenses over the lifespan, expanding the number of existing galaxy-galaxy lens samples by three orders of magnitude, which is comparable to the Euclid telescope launched during the same period but with additional color information. Specifically, the CSST can detect strong lenses with Einstein radii above $0.64\pm0.42$ arcsec, corresponding to the velocity dispersions of $217.19 \pm 50.55 \, \text{km/s}$. These lenses exhibit a median magnification of $\sim$5. The apparent magnitude of the unlensed source in the g-band is $25.87 \pm 1.19$. The signal-to-noise ratio of the lensed images covers a range of $\sim 20$ to $\sim 1000$, allowing us to determine the Einstein radius with an accuracy ranging from $\sim 1 \%$ to $\sim 0.1 \%$, ignoring various modeling systematics. Besides, our estimations show that CSST can observe uncommon systems, such as double source-plane and spiral galaxy lenses. The above selection functions of the CSST strong lensing observation help optimize the strategy of finding and modeling GGSLs.


title: UIEDP:Underwater Image Enhancement with Diffusion Prior

abstract: Underwater image enhancement (UIE) aims to generate clear images from low-quality underwater images. Due to the unavailability of clear reference images, researchers often synthesize them to construct paired datasets for training deep models. However, these synthesized images may sometimes lack quality, adversely affecting training outcomes. To address this issue, we propose UIE with Diffusion Prior (UIEDP), a novel framework treating UIE as a posterior distribution sampling process of clear images conditioned on degraded underwater inputs. Specifically, UIEDP combines a pre-trained diffusion model capturing natural image priors with any existing UIE algorithm, leveraging the latter to guide conditional generation. The diffusion prior mitigates the drawbacks of inferior synthetic images, resulting in higher-quality image generation. Extensive experiments have demonstrated that our UIEDP yields significant improvements across various metrics, especially no-reference image quality assessment. And the generated enhanced images also exhibit a more natural appearance.


title: ProtoCode: Leveraging Large Language Models for Automated Generation of Machine-Readable Protocols from Scientific Publications

abstract: Protocol standardization and sharing are crucial for reproducibility in life sciences. In spite of numerous efforts for standardized protocol description, adherence to these standards in literature remains largely inconsistent. Curation of protocols are especially challenging due to the labor intensive process, requiring expert domain knowledge of each experimental procedure. Recent advancements in Large Language Models (LLMs) offer a promising solution to interpret and curate knowledge from complex scientific literature. In this work, we develop ProtoCode, a tool leveraging fine-tune LLMs to curate protocols which can be interpretable by both human and machine interfaces. Our proof-of-concept, focused on polymerase chain reaction (PCR) protocols, retrieves information from PCR protocols at an accuracy ranging 69-100% depending on the information content. In all the tested protocols, we demonstrate that ProtoCode successfully converts literature-based protocols into correct operational files for multiple thermal cycler systems. In conclusion, ProtoCode can alleviate labor intensive curation and standardization of life science protocols to enhance research reproducibility by providing a reliable, automated means to process and standardize protocols. ProtoCode is freely available as a web server at https://curation.taxila.io/ProtoCode/.


title: Expansion of hypergeometric functions in terms of polylogarithms with nontrivial variable change

abstract: Hypergeometric functions of one and many variables play an important role in various branches of modern physics and mathematics. Often we have hypergeometric functions with indices linear dependent on a small parameter with respect to which one needs to perform Laurent expansions. Moreover such expansions are desirable to be expressed in terms of well known functions which can be evaluated with arbitrary precision. To solve this problem we use the differential equation method and the reduction of corresponding differential systems to canonical basis. Specifically we will be interested in the generalized hypergeometric functions of one variable together with Appell and Lauricella functions and their expansions in terms of Goncharov polylogarithms. Particular attention will be given to the case of rational indices of considered hypergeometric functions when the reduction to canonical basis involves nontrivial variable change. The article comes with a Mathematica package Diogenes, which provides algorithmic implementation of the required steps.


title: Pump-probe studies of resonantly saturated selective reflection from high-density rubidium vapor

abstract: Nonlinear selective reflection from the interface YAG window-high density rubidium vapor in the high-temperature cell is studied at the transition 5S$_{1/2}$-5P$_{3/2}$. In the experiment tunable pump and probe lasers are used. The selective reflection spectra for the laser probe beam are investigated at four different rubidium atomic densities and five different pump beam intensities. The estimated dipole-dipole interaction-induced line broadening varies from $13.2$ to $39.6$ GHz, the measured pumped intensities change from $1.2$ to $8.8$ kW$\cdot$cm$^{-2}$. Growth of the pump intensity causes reduction of the magnitude and the width of the recorded selective reflection resonance. We suggest developing all-optical modulators on the basis of nonlinear selective reflection.


title: Team-related Features in Code Review Prediction Models

abstract: Modern Code Review (MCR) is an informal tool-assisted quality assurance practice. It relies on the asynchronous communication among the authors of code changes and reviewers, who are developers that provide feedback. However, from candidate developers, some are able to provide better feedback than others given a particular context. The selection of reviewers is thus an important task, which can benefit from automated support. Many approaches have been proposed in this direction, using for example data from code review repositories to recommend reviewers. In this paper, we propose the use of team-related features to improve the performance of predictions that are helpful to build code reviewer recommenders, with our target predictions being the identification of reviewers that would participate in a review and the provided amount of feedback. We evaluate the prediction power of these features, which are related to code ownership, workload, and team relationship. This evaluation was done by carefully addressing challenges imposed by the MCR domain, such as temporal aspects of the dataset and unbalanced classes. Moreover, given that it is currently unknown how much past data is needed for building MCR prediction models with acceptable performance, we explore the amount of past data used to build prediction models. Our results show that, individually, features related to code ownership have the best prediction power. However, based on feature selection, we conclude that all proposed features together with lines of code can make the best predictions for both reviewer participation and amount of feedback. Regarding the amount of past data, the timeframes of 3, 6, 9, and 12 months of data produce similar results. Therefore, models can be trained considering short timeframes, thus reducing the computational costs with negligible impact in the prediction performance ...


title: Pipeline for performance evaluation of flavour tagging dedicated Graph Neural Network algorithms

abstract: Machine Learning is a rapidly expanding field with a wide range of applications in science. In the field of physics, the Large Hadron Collider, the world's largest particle accelerator, utilizes Neural Networks for various tasks, including flavour tagging. Flavour tagging is the process of identifying the flavour of the hadron that initiates a jet in a collision event, and it is an essential aspect of many Standard Model and Beyond the Standard Model research. Graph Neural Networks are currently the primary machine-learning tool used for flavour tagging. Here, we present the AUTOGRAPH pipeline, a completely customizable tool designed with a user-friendly interface to provide easy access to the Graph Neural Networks algorithm used for flavour tagging.


title: Information propagation in multilayer systems with higher-order interactions across timescales

abstract: Complex systems are characterized by multiple spatial and temporal scales. A natural framework to capture their multiscale nature is that of multilayer networks, where different layers represent distinct physical processes that often regulate each other indirectly. We model these regulatory mechanisms through triadic higher-order interactions between nodes and edges. In this work, we focus on how the different timescales associated with each layer impact their effective couplings in terms of their mutual information. We unravel the general principles governing how such information propagates across the multiscale structure, and apply them to study archetypal examples of biological signaling networks and effective environmental dependencies in stochastic processes. Our framework generalizes to any dynamics on multilayer networks, paving the way for a deeper understanding of how the multiscale nature of real-world systems shapes their information content and complexity.


title: LOFAR HBA Observations of the Euclid Deep Field North (EDFN)

abstract: We present the first deep (72 hours of observations) radio image of the Euclid Deep Field North (EDFN) obtained with the LOw-Frequency ARray (LOFAR) High Band Antenna (HBA) at 144 MHz. The EDFN is the latest addition to the LOFAR Two-Metre Sky Survey (LoTSS) Deep Fields and these observations represent the first data release for this field. The observations produced a 6" resolution image with a central r.m.s. noise of $32\,\mu$Jy\,beam$^{-1}$. A catalogue of $\sim 23,000$ radio sources above a signal-to-noise ratio (SNR) threshold of 5 is extracted from the inner circular 10 deg$^2$ region. We discuss the data analysis and we provide a detailed description of how we derived the catalogue of radio sources and on the issues related to direction-dependent calibration and their effects on the final products. Finally, we derive the radio source counts at 144 MHz in the EDFN using catalogues of mock radio sources to derive the completeness correction factors. The source counts in the EDFN are consistent with those obtained from the first data release of the other LoTSS Deep Fields (ELAIS-N1, Lockman Hole and Bootes), despite the different method adopted to construct the final catalogue and to assess its completeness.


title: The monoid of numbers of the form 1 < a^q /b^p < a

abstract: This paper is a study of the set of rational numbers of the form 1 < a^q /b^p < a with a and b co-prime integers. The set F (a,b) of these numbers, with an appropriate binary law, is a monoid isomorphic to (N, +, 0). We identify the sequences of minimum and maximum record holders in F (a,b) and prove that the first one converges to 1 while the second one converges to a. We conclude that F (a,b) is dense in the set of the real numbers comprise between 1 and a.


title: Geodesic tracking and the shape of ergodic rotation sets

abstract: We prove a structure theorem for ergodic homological rotation sets of homeomorphisms isotopic to the identity on a closed orientable hyperbolic surface: this set is made of a finite number of pieces that are either one-dimensional or almost convex. The latter ones give birth to horseshoes; in the case of a zero-entropy homeomorphism we show that there exists a geodesic lamination containing the directions in which generic orbits with respect to ergodic invariant probabilities turn around the surface under iterations of the homeomorphism. The proof is based on the idea of $\textit{geodesic tracking}$ of orbits that are typical for some invariant measure by geodesics on the surface, that allows to get links between the dynamics of such points and the one of the geodesic flow on some invariant subset of the unit tangent bundle of the surface.


title: Robust and Decentralized Reinforcement Learning for UAV Path Planning in IoT Networks

abstract: Unmanned aerial vehicle (UAV)-based networks and Internet of Things (IoT) are being considered as integral components of current and next-generation wireless networks. In particular, UAVs can provide IoT devices with seamless connectivity and high coverage and this can be accomplished with effective UAV path planning. In this article, we study robust and decentralized UAV path planning for data collection in IoT networks in the presence of other noncooperative UAVs and adversarial jamming attacks. We address three different practical scenarios, including single UAV path planning, UAV swarm path planning, and single UAV path planning in the presence of an intelligent mobile UAV jammer. We advocate a reinforcement learning framework for UAV path planning in these three scenarios under practical constraints. The simulation results demonstrate that with learning-based path planning, the UAVs can complete their missions with high success rates and data collection rates. In addition, the UAVs can adapt and execute different trajectories as a defensive measure against the intelligent jammer.


title: The Contact Process on a Graph Adapting to the Infection

abstract: We show existence of a non-trivial phase transition for the contact process, a simple model for infection without immunity, on a network which reacts dynamically to the infection trying to prevent an epidemic. This network initially has the distribution of an Erd\H{o}s-R\'enyi graph, but is made adaptive via updating in only the infected neighbourhoods, at constant rate. Under these graph dynamics, the presence of infection can help to prevent the spread and so many monotonicity-based techniques fail. Instead, we approximate the infection by an idealised model, the contact process on an evolving forest (CPEF). In this model updating events of a vertex in a tree correspond to the creation of a new tree with that vertex as the root. By seeing the newly created trees as offspring, the CPEF generates a Galton-Watson tree and we use that it survives if and only if its offspring number exceeds one. It turns out that the phase transition in the adaptive model occurs at a different infection rate when compared to the non-adaptive model.


title: A general splitting principle on RCD spaces and applications to spaces with positive spectrum

abstract: In this paper we develop a general `analytic' splitting principle for RCD spaces: we show that if there is a function with suitable Laplacian and Hessian, then the space is (isomorphic to) a warped product. Our result covers most of the splitting-like results currently available in the literature about RCD spaces. We then apply it to extend to the non-smooth category some structural property of Riemannian manifolds obtained by Li and Wang.


title: Transformer Attractors for Robust and Efficient End-to-End Neural Diarization

abstract: End-to-end neural diarization with encoder-decoder based attractors (EEND-EDA) is a method to perform diarization in a single neural network. EDA handles the diarization of a flexible number of speakers by using an LSTM-based encoder-decoder that generates a set of speaker-wise attractors in an autoregressive manner. In this paper, we propose to replace EDA with a transformer-based attractor calculation (TA) module. TA is composed of a Combiner block and a Transformer decoder. The main function of the combiner block is to generate conversational dependent (CD) embeddings by incorporating learned conversational information into a global set of embeddings. These CD embeddings will then serve as the input for the transformer decoder. Results on public datasets show that EEND-TA achieves 2.68% absolute DER improvement over EEND-EDA. EEND-TA inference is 1.28 times faster than that of EEND-EDA.


title: Modyn: A Platform for Model Training on Dynamic Datasets With Sample-Level Data Selection

abstract: Machine learning training data is often dynamic in real-world use cases, i.e., data is added or removed and may experience distribution shifts over time. Models must incorporate this evolving training data to improve generalization, adapt to potential distribution shifts, and adhere to privacy regulations. However, the cost of model (re)training is proportional to how often the model trains and on how much data it trains on. While ML research explores these topics in isolation, there is no end-to-end open-source platform to facilitate the exploration of model retraining and data selection policies and the deployment these algorithms efficiently at scale. We present Modyn, a platform for model training on dynamic datasets that enables sample-level data selection and triggering policies. Modyn orchestrates continuous training pipelines while optimizing the underlying system infrastructure to support fast access to arbitrary data samples for efficient data selection. Modyn's extensible architecture allows users to run training pipelines without modifying the platform code, and enables researchers to effortlessly extend the system. We evaluate Modyn's training throughput, showing that even in memory-bound recommendation systems workloads, Modyn is able to reach 80 to 100 % of the throughput compared to loading big chunks of data locally without sample-level data selection. Additionally, we showcase Modyn's functionality with three different data selection policies.


title: Ensemble Interpretation: A Unified Method for Interpretable Machine Learning

abstract: To address the issues of stability and fidelity in interpretable learning, a novel interpretable methodology, ensemble interpretation, is presented in this paper which integrates multi-perspective explanation of various interpretation methods. On one hand, we define a unified paradigm to describe the common mechanism of different interpretation methods, and then integrate the multiple interpretation results to achieve more stable explanation. On the other hand, a supervised evaluation method based on prior knowledge is proposed to evaluate the explaining performance of an interpretation method. The experiment results show that the ensemble interpretation is more stable and more consistent with human experience and cognition. As an application, we use the ensemble interpretation for feature selection, and then the generalization performance of the corresponding learning model is significantly improved.


title: Neural Autoencoder-Based Structure-Preserving Model Order Reduction and Control Design for High-Dimensional Physical Systems

abstract: This work concerns control-oriented and structure-preserving learning of low-dimensional approximations of high-dimensional physical systems, with a focus on mechanical systems. We investigate the integration of neural autoencoders in model order reduction, while at the same time preserving Hamiltonian or Lagrangian structures. We focus on extensively evaluating the considered methodology by performing simulation and control experiments on large mass-spring-damper networks, with hundreds of states. The empirical findings reveal that compressed latent dynamics with less than 5 degrees of freedom can accurately reconstruct the original systems' transient and steady-state behavior with a relative total error of around 4\%, while simultaneously accurately reconstructing the total energy. Leveraging this system compression technique, we introduce a model-based controller that exploits the mathematical structure of the compressed model to regulate the configuration of heavily underactuated mechanical systems.


title: On Some Extensions of $\pi$-Regular Rings

abstract: Some variations of $\pi$-regular and nil clean rings were recently introduced in \cite{5,8,7}, respectively. In this paper, we examine the structure and relationships between these classes of rings. Specifically, we prove that $(m, n)$-regularly nil clean rings are left-right symmetric and also show that the inclusions ($D$-regularly nil clean) $\subseteq$ (regularly nil clean) $\subseteq$ ($(m,n)$-regularly nil clean) hold, as well as we answer Questions 1, 2 and 3 posed in \cite{8}. Moreover, some other analogous questions concerning the symmetric properties of certain classes of rings are treated as well by proving that centrally Utumi rings are always strongly $\pi$-regular.


title: No Prior Mask: Eliminate Redundant Action for Deep Reinforcement Learning

abstract: The large action space is one fundamental obstacle to deploying Reinforcement Learning methods in the real world. The numerous redundant actions will cause the agents to make repeated or invalid attempts, even leading to task failure. Although current algorithms conduct some initial explorations for this issue, they either suffer from rule-based systems or depend on expert demonstrations, which significantly limits their applicability in many real-world settings. In this work, we examine the theoretical analysis of what action can be eliminated in policy optimization and propose a novel redundant action filtering mechanism. Unlike other works, our method constructs the similarity factor by estimating the distance between the state distributions, which requires no prior knowledge. In addition, we combine the modified inverse model to avoid extensive computation in high-dimensional state space. We reveal the underlying structure of action spaces and propose a simple yet efficient redundant action filtering mechanism named No Prior Mask (NPM) based on the above techniques. We show the superior performance of our method by conducting extensive experiments on high-dimensional, pixel-input, and stochastic problems with various action redundancy. Our code is public online at https://github.com/zhongdy15/npm.


title: Adaptive Annotation Distribution for Weakly Supervised Point Cloud Semantic Segmentation

abstract: Weakly supervised point cloud semantic segmentation has attracted a lot of attention due to its ability to alleviate the heavy reliance on fine-grained annotations of point clouds. However, in practice, sparse annotation usually exhibits a distinct non-uniform distribution in point cloud, which poses challenges for weak supervision. To address these issues, we propose an adaptive annotation distribution method for weakly supervised point cloud semantic segmentation. Specifically, we introduce the probability density function into the gradient sampling approximation analysis and investigate the impact of sparse annotations distributions. Based on our analysis, we propose a label-aware point cloud downsampling strategy to increase the proportion of annotations involved in the training stage. Furthermore, we design the multiplicative dynamic entropy as the gradient calibration function to mitigate the gradient bias caused by non-uniformly distributed sparse annotations and explicitly reduce the epistemic uncertainty. Without any prior restrictions and additional information, our proposed method achieves comprehensive performance improvements at multiple label rates with different annotation distributions on S3DIS, ScanNetV2 and SemanticKITTI.


title: In search of the lost tree: Hardness and relaxation of spanning trees in temporal graphs

abstract: A graph whose edges only appear at certain points in time is called a temporal graph (among other names). These graphs are temporally connected if all ordered pairs of vertices are connected by a path that traverses edges in chronological order (a temporal path). Reachability in temporal graphs departs significantly from standard reachability; in particular, it is not transitive, with structural and algorithmic consequences. For instance, temporally connected graphs do not always admit spanning trees, i.e., subsets of edges that form a tree and preserve temporal connectivity among the nodes. In this paper, we revisit fundamental questions about the loss of universality of spanning trees. To start, we show that deciding if a spanning tree exists in a given temporal graph is NP-complete. What could be appropriate replacement for the concept? Beyond having minimum size, spanning trees enjoy the feature of enabling reachability along the same underlying paths in both directions, a pretty uncommon feature in temporal graphs. We explore relaxations in this direction and show that testing the existence of bidirectional spanning structures (bi-spanners) is tractable in general. On the down side, finding \emph{minimum} such structures is NP-hard even in simple temporal graphs. Still, the fact that bidirectionality can be tested efficiently may find applications, e.g. for routing and security, and the corresponding primitive that we introduce in the algorithm may be of independent interest.


title: Survey on Foundation Models for Prognostics and Health Management in Industrial Cyber-Physical Systems

abstract: Industrial Cyber-Physical Systems (ICPS) integrate the disciplines of computer science, communication technology, and engineering, and have emerged as integral components of contemporary manufacturing and industries. However, ICPS encounters various challenges in long-term operation, including equipment failures, performance degradation, and security threats. To achieve efficient maintenance and management, prognostics and health management (PHM) finds widespread application in ICPS for critical tasks, including failure prediction, health monitoring, and maintenance decision-making. The emergence of large-scale foundation models (LFMs) like BERT and GPT signifies a significant advancement in AI technology, and ChatGPT stands as a remarkable accomplishment within this research paradigm, harboring potential for General Artificial Intelligence. Considering the ongoing enhancement in data acquisition technology and data processing capability, LFMs are anticipated to assume a crucial role in the PHM domain of ICPS. However, at present, a consensus is lacking regarding the application of LFMs to PHM in ICPS, necessitating systematic reviews and roadmaps to elucidate future directions. To bridge this gap, this paper elucidates the key components and recent advances in the underlying model.A comprehensive examination and comprehension of the latest advances in grand modeling for PHM in ICPS can offer valuable references for decision makers and researchers in the industrial field while facilitating further enhancements in the reliability, availability, and safety of ICPS.


title: Self-assembly of Colloids with Competing Interactions Confined in Spheres

abstract: At low temperatures, colloidal particles with short-range attractive and long-range repulsive interactions can form various periodic microphases in bulk.In this paper, we investigate the self-assembly behaviour of colloids with competing interactions under spherical confinement by conducting molecular dynamics simulations. We find that the cluster, mixture, cylindrical, perforated lamellar and lamellar structures can be obtained, but the details of the ordered structures are different from those in bulk systems. Interestingly, the system tends to form more perforated structures when confined in smaller spheres. The mechanism behind this phenomenon is the relationship between the energy of the ordered structures and the bending of the confinement wall, which is different from the mechanism in copolymer systems.


title: Increasing the selectivity of the early notification biosensor system under influence of acoustic vibration

abstract: The paper presents the results of a study of the impact of acoustic and vibration signals on Black Sea mussels, and determines the necessary technical characteristics of vibration sensors. A method has been developed based on the analysis of the time interval recorded by a valve motion sensor in the form of a monotonically decreasing function after the response of a mussel colony to the influence of a vibroacoustic signal. The method makes it possible to eliminate the calibration of the opening value of the mussel valves at the stage of manufacturing and setting up the biosensor system, as well as to control and determine false positives or incomplete opening of the valves of individual mussels when exposed to point stimuli. A structural and functional diagram of the developed experimental setup is presented


title: Electrically Tunable Fine Structure of Negatively Charged Excitons in Gated Bilayer Graphene Quantum Dots

abstract: We predict here the fine structure of an electrically tunable negatively charged exciton (trion) composed of two electrons and a hole confined in a gated bilayer graphene quantum dot (QD). We start with an atomistic approach, allowing us to compute confined electron and confined hole QD states for a structure containing over one million atoms. Using atomistic wavefunctions we compute Coulomb matrix elements and self-energies. In the next step, by solving the Bethe-Salpeter-like equation for trions, we describe a negatively charged exciton, built as a strongly interacting interlayer complex of two electrons in the conduction band and one hole in the valence band. Unlike in conventional semiconducting QDs, we show that the trion contains a fine structure composed of ten states arising from the valley and spin degrees of freedom. Finally, we obtain absorption into and emission from the trion states. We predict the existence of bright low-energy states and propose to extract the fine structure of the trion using the temperature dependence of emission spectra.


title: Type I Error Rates are Not Usually Inflated

abstract: The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. I begin with an introduction to Type I error rates that distinguishes them from theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers' misinterpretation of statistical errors and their underestimation of theoretical errors.


title: Creating Spoken Dialog Systems in Ultra-Low Resourced Settings

abstract: Automatic Speech Recognition (ASR) systems are a crucial technology that is used today to design a wide variety of applications, most notably, smart assistants, such as Alexa. ASR systems are essentially dialogue systems that employ Spoken Language Understanding (SLU) to extract meaningful information from speech. The main challenge with designing such systems is that they require a huge amount of labeled clean data to perform competitively, such data is extremely hard to collect and annotate to respective SLU tasks, furthermore, when designing such systems for low resource languages, where data is extremely limited, the severity of the problem intensifies. In this paper, we focus on a fairly popular SLU task, that is, Intent Classification while working with a low resource language, namely, Flemish. Intent Classification is a task concerned with understanding the intents of the user interacting with the system. We build on existing light models for intent classification in Flemish, and our main contribution is applying different augmentation techniques on two levels -- the voice level, and the phonetic transcripts level -- to the existing models to counter the problem of scarce labeled data in low-resource languages. We find that our data augmentation techniques, on both levels, have improved the model performance on a number of tasks.


title: Local laser-induced solid-phase recrystallization of phosphorus-implanted Si/SiGe heterostructures for contacts below 4.2 K

abstract: Si/SiGe heterostructures are of high interest for high mobility transistor and qubit applications, specifically for operations below 4.2 K. In order to optimize parameters such as charge mobility, built-in strain, electrostatic disorder, charge noise and valley splitting, these heterostructures require Ge concentration profiles close to mono-layer precision. Ohmic contacts to undoped heterostructures are usually facilitated by a global annealing step activating implanted dopants, but compromising the carefully engineered layer stack due to atom diffusion and strain relaxation in the active device region. We demonstrate a local laser-based annealing process for recrystallization of ion-implanted contacts in SiGe, greatly reducing the thermal load on the active device area. To quickly adapt this process to the constantly evolving heterostructures, we deploy a calibration procedure based exclusively on optical inspection at room-temperature. We measure the electron mobility and contact resistance of laser annealed Hall bars at temperatures below 4.2 K and obtain values similar or superior than that of a globally annealed reference samples. This highlights the usefulness of laser-based annealing to take full advantage of high-performance Si/SiGe heterostructures.


title: Security and Reliability Evaluation of Countermeasures implemented using High-Level Synthesis

abstract: As the complexity of digital circuits increases, High-Level Synthesis (HLS) is becoming a valuable tool to increase productivity and design reuse by utilizing relevant Electronic Design Automation (EDA) flows, either for Application-Specific Integrated Circuits (ASIC) or for Field Programmable Gate Arrays (FPGA). Side Channel Analysis (SCA) and Fault Injection (FI) attacks are powerful hardware attacks, capable of greatly weakening the theoretical security levels of secure implementations. Furthermore, critical applications demand high levels of reliability including fault tolerance. The lack of security and reliability driven optimizations in HLS tools makes it necessary for the HLS-based designs to validate that the properties of the algorithm and the countermeasures have not been compromised due to the HLS flow. In this work, we provide results on the resilience evaluation of HLS-based FPGA implementations for the aforementioned threats. As a test case, we use multiple versions of an on-the-fly SBOX algorithm integrating different countermeasures (hiding and masking), written in C and implemented using Vivado HLS. We perform extensive evaluations for all the designs and their optimization scenarios. The results provide evidence of issues arising due to HLS optimizations on the security and the reliability of cryptographic implementations. Furthermore, the results put HLS algorithms to the test of designing secure accelerators and can lead to improving them towards the goal of increasing productivity in the domain of secure and reliable cryptographic implementations.


title: Quantum physics at your fingertips -- from paper strips to zippers

abstract: Quantum physics modeling is technically complex and often non-descriptive. This article presents some approaches how quantum physical ideas can be represented by haptic models. For this purpose, models made from 3D printers, models made from paper strips, and models made from textiles are compared. A novelty is the use of zippers instead of paper strips, which can be easily ''cut'' and ''glued'' together. The models have been developed primarily with the aim of conveying and visualizing topological ideas with little basic mathematical knowledge.


title: Testing Speech Emotion Recognition Machine Learning Models

abstract: Machine learning models for speech emotion recognition (SER) can be trained for different tasks and are usually evaluated on the basis of a few available datasets per task. Tasks could include arousal, valence, dominance, emotional categories, or tone of voice. Those models are mainly evaluated in terms of correlation or recall, and always show some errors in their predictions. The errors manifest themselves in model behaviour, which can be very different along different dimensions even if the same recall or correlation is achieved by the model. This paper investigates behavior of speech emotion recognition models with a testing framework which requires models to fulfill conditions in terms of correctness, fairness, and robustness.


title: Nanospheres with Patches Arranged in Polyhedrons from Self-Assembly of Solution-State Diblock Copolymers under Spherical Confinement

abstract: Self-assembly of sphere-forming solution-state amphiphilic diblock copolymers under spherical nanopore confinement is investigated using a simulated annealing technique. For two types of cases of different pore-surface/copolymer interactions, sequences of self-assembled patchy nanospheres are obtained, and phase diagrams are constructed. Self-assembled patchy nanospheres with 1-21 solvophobic domains are observed. The outermost solvophobic domains (patches) are packed into various polyhedrons when their number is larger than 3, where three Platonic solids of a regular tetrahedron, an octahedron, and an icosahedron and seven Johnson solids of J12, J13, J17, J50, J51, J86, and J87 are identified. In addition, another Johnson solid of J84 is identified in a structure with two categories of B-domains. These polyhedrons have all or most of their faces in a triangular shape, and hence, they are closer to spherical in shape, which may relieve the chain stretching. Nanospheres with 1, 4, 6, 9, and 12 numbers of patches occur in relatively large windows in the phase diagrams of both types of cases. In one of the two types of cases, all nanospheres with any number of 1-14 patches occur in the phase diagram, whereas in the other type of cases, nanospheres with 2, 3, 5, 11, and 13 numbers of patches are absent in the phase diagram. Furthermore, at a given pore size, the number of patches changes nonmonotonically or is unchanged with an increase in the strength of the pore-surface/copolymer interactions for one type or the other type of case, respectively. Quantitative calculations are performed to elucidate mechanisms of the window size in the phase diagrams of nanospheres with different numbers of patches and structure details.


title: U-MixFormer: UNet-like Transformer with Mix-Attention for Efficient Semantic Segmentation

abstract: Semantic segmentation has witnessed remarkable advancements with the adaptation of the Transformer architecture. Parallel to the strides made by the Transformer, CNN-based U-Net has seen significant progress, especially in high-resolution medical imaging and remote sensing. This dual success inspired us to merge the strengths of both, leading to the inception of a U-Net-based vision transformer decoder tailored for efficient contextual encoding. Here, we propose a novel transformer decoder, U-MixFormer, built upon the U-Net structure, designed for efficient semantic segmentation. Our approach distinguishes itself from the previous transformer methods by leveraging lateral connections between the encoder and decoder stages as feature queries for the attention modules, apart from the traditional reliance on skip connections. Moreover, we innovatively mix hierarchical feature maps from various encoder and decoder stages to form a unified representation for keys and values, giving rise to our unique mix-attention module. Our approach demonstrates state-of-the-art performance across various configurations. Extensive experiments show that U-MixFormer outperforms SegFormer, FeedFormer, and SegNeXt by a large margin. For example, U-MixFormer-B0 surpasses SegFormer-B0 and FeedFormer-B0 with 3.8% and 2.0% higher mIoU and 27.3% and 21.8% less computation and outperforms SegNext with 3.3% higher mIoU with MSCAN-T encoder on ADE20K. Code available at https://github.com/julian-klitzing/u-mixformer.


title: Regroup Median Loss for Combating Label Noise

abstract: The deep model training procedure requires large-scale datasets of annotated data. Due to the difficulty of annotating a large number of samples, label noise caused by incorrect annotations is inevitable, resulting in low model performance and poor model generalization. To combat label noise, current methods usually select clean samples based on the small-loss criterion and use these samples for training. Due to some noisy samples similar to clean ones, these small-loss criterion-based methods are still affected by label noise. To address this issue, in this work, we propose Regroup Median Loss (RML) to reduce the probability of selecting noisy samples and correct losses of noisy samples. RML randomly selects samples with the same label as the training samples based on a new loss processing method. Then, we combine the stable mean loss and the robust median loss through a proposed regrouping strategy to obtain robust loss estimation for noisy samples. To further improve the model performance against label noise, we propose a new sample selection strategy and build a semi-supervised method based on RML. Compared to state-of-the-art methods, for both the traditionally trained and semi-supervised models, RML achieves a significant improvement on synthetic and complex real-world datasets. The source code of the paper has been released.


title: Dark-Mode Theorems for Quantum Networks

abstract: We propose and prove two theorems for determining the number of dark modes in linear two-component quantum networks composed of two types of bosonic modes. This is achieved by diagonalizing the two sub-networks of the same type of modes, mapping the networks to either a standard or a thick arrowhead matrix, and analyzing the linear dependence and independence between the column vectors associated with degenerate normal modes in the coupling matrix. We confirm the two theorems by checking the simultaneous ground-state cooling of the mechanical modes in linearized optomechanical networks. These results also work for linear fermionic networks and other networks described by quadratic coupled-mode Hamiltonian. The present method can be extended to study the dark-state effect in driven atom systems and to construct large decoherence-free subspaces for processing quantum information. This work will initiate the studies on dynamical, transport, and statistical properties of linear networks with decoupled subspaces.


title: DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

abstract: Applying pre-trained medical segmentation models on out-of-domain images often yields predictions of insufficient quality. Several strategies have been proposed to maintain model performance, such as finetuning or unsupervised- and source-free domain adaptation. These strategies set restrictive requirements for data availability. In this study, we propose to combine domain generalization and test-time adaptation to create a highly effective approach for reusing pre-trained models in unseen target domains. Domain-generalized pre-training on source data is used to obtain the best initial performance in the target domain. We introduce the MIND descriptor previously used in image registration tasks as a further technique to achieve generalization and present superior performance for small-scale datasets compared to existing approaches. At test-time, high-quality segmentation for every single unseen scan is ensured by optimizing the model weights for consistency given different image augmentations. That way, our method enables separate use of source and target data and thus removes current data availability barriers. Moreover, the presented method is highly modular as it does not require specific model architectures or prior knowledge of involved domains and labels. We demonstrate this by integrating it into the nnUNet, which is currently the most popular and accurate framework for medical image segmentation. We employ multiple datasets covering abdominal, cardiac, and lumbar spine scans and compose several out-of-domain scenarios in this study. We demonstrate that our method, combined with pre-trained whole-body CT models, can effectively segment MR images with high accuracy in all of the aforementioned scenarios. Open-source code can be found here: https://github.com/multimodallearning/DG-TTA