title: Dust emissivity in resolved spiral galaxies

abstract: Context: The far-infrared (FIR) and sub-millimeter (submm) emissivity of the Milky Way (MW) cirrus is an important benchmark for dust grain models. Dust masses in other galaxies are generally derived from the FIR/submm using the emission properties of these MW-calibrated models. Aims: We seek to derive the FIR/submm emissivity in nine nearby spiral galaxies to check its compatibility with MW cirrus measurements. Methods: We obtained values of the emissivity at 70 to 500 um, using maps of dust emission from the Herschel satellite and of gas surface density from the THINGS and HERACLES surveys on a scale generally corresponding to 440 pc. We studied the variation of the emissivity with the surface brightness ratio I(250um)/I(500um), a proxy for the intensity of the interstellar radiation field heating the dust. Results: We find that the average value of the emissivity agrees with MW estimates for pixels sharing the same color as the cirrus, namely, for I(250um)/I(500um) = 4.5. For I(250um)/I(500um) > 5, the measured emissivity is instead up to a factor ~2 lower than predicted from MW dust models heated by stronger radiation fields. Regions with higher I(250um)/I(500um) are preferentially closer to the galactic center and have a higher overall (stellar+gas) surface density and molecular fraction. The results do not depend strongly on the adopted CO-to-molecular conversion factor and do not appear to be affected by the mixing of heating conditions. Conclusions: Our results confirm the validity of MW dust models at low density, but are at odds with predictions for grain evolution in higher density environments. If the lower-than-expected emissivity at high I(250um)/I(500um) is the result of intrinsic variations in the dust properties, it would imply an underestimation of the dust mass surface density of up to a factor ~2 when using current dust models.


title: Localization of zeros in Cauchy-de Branges spaces

abstract: We study the class of discrete measures in the complex plain with the following property: up to a finite number, all zeros of any Cauchy transform of the measure (with $\ell^2$-data) are localized near the support of the measure. We find several equivalent forms of this property and prove that the parts of the support attracting zeros of Cauchy transforms are ordered by inclusion modulo finite sets.


title: Bilinear Enhancements of Quandle Invariants

abstract: We enhance the quandle counting invariants of oriented classical and virtual knots and links using a construction similar to quandle modules but inspired by symplectic quandle operations rather than Alexander quandle operations. Given a finite quandle $X$ and a vector space $V$ over a field, sets of bilinear forms on $V$ indexed by pairs of elements of $X$ satisfying certain conditions yield new enhanced multiset- and polynomial-valued invariants of oriented classical and virtual knots and links. We provide examples to illustrate the computation of the invariants and to show that the enhancement is proper.


title: Guillotine Regularization: Why removing layers is needed to improve generalization in Self-Supervised Learning

abstract: One unexpected technique that emerged in recent years consists in training a Deep Network (DN) with a Self-Supervised Learning (SSL) method, and using this network on downstream tasks but with its last few projector layers entirely removed. This trick of throwing away the projector is actually critical for SSL methods to display competitive performances on ImageNet for which more than 30 percentage points can be gained that way. This is a little vexing, as one would hope that the network layer at which invariance is explicitly enforced by the SSL criterion during training (the last projector layer) should be the one to use for best generalization performance downstream. But it seems not to be, and this study sheds some light on why. This trick, which we name Guillotine Regularization (GR), is in fact a generically applicable method that has been used to improve generalization performance in transfer learning scenarios. In this work, we identify the underlying reasons behind its success and show that the optimal layer to use might change significantly depending on the training setup, the data or the downstream task. Lastly, we give some insights on how to reduce the need for a projector in SSL by aligning the pretext SSL task and the downstream task.


title: A fuzzy derivative model approach to time-series prediction

abstract: This paper presents a fuzzy system approach to the prediction of nonlinear time-series and dynamical systems. To do this, the underlying mechanism governing a time-series is perceived by a modified structure of a fuzzy system in order to capture the time-series behaviour, as well as the information about its successive time derivatives. The prediction task is carried out by a fuzzy predictor based on the extracted rules and on a Taylor ODE solver. The approach has been applied to a benchmark problem: the Mackey- Glass chaotic time-series. Furthermore, comparative studies with other fuzzy and neural network predictors were made and these suggest equal or even better performance of the herein presented approach.


title: Properties of the Nili Fossae Olivine-clay-carbonate lithology: orbital and in situ at S\'e\'itah

abstract: We examine the observed properties of the Nili Fossae olivine-clay-carbonate lithology from orbital data and in situ by the Mars 2020 rover at the S\'e\'itah unit in Jezero crater, including: 1) composition (Liu, 2022) 2) grain size (Tice, 2022) 3) inferred viscosity (calculated based on geochemistry collected by SuperCam (Wiens, 2022)). Based on the low viscosity and distribution of the unit we postulate a flood lava origin for the olivine-clay-carbonate at S\'e\'itah. We include a new CRISM map of the clay 2.38 {\mu}m band and use in situ data to show that the clay in the olivine cumulate in the S\'e\'itah formation is consistent with talc or serpentine from Mars 2020 SuperCam LIBS and VISIR and MastCam-Z observations. We discuss two intertwining aspects of the history of the lithology: 1) the emplacement and properties of the cumulate layer within a lava lake, based on terrestrial analogs in the Pilbara, Western Australia, and using previously published models of flood lavas and lava lakes, and 2) the limited extent of post emplacement alteration, including clay and carbonate alteration (Clave, 2022; Mandon, 2022).


title: TextDCT: Arbitrary-Shaped Text Detection via Discrete Cosine Transform Mask

abstract: Arbitrary-shaped scene text detection is a challenging task due to the variety of text changes in font, size, color, and orientation. Most existing regression based methods resort to regress the masks or contour points of text regions to model the text instances. However, regressing the complete masks requires high training complexity, and contour points are not sufficient to capture the details of highly curved texts. To tackle the above limitations, we propose a novel light-weight anchor-free text detection framework called TextDCT, which adopts the discrete cosine transform (DCT) to encode the text masks as compact vectors. Further, considering the imbalanced number of training samples among pyramid layers, we only employ a single-level head for top-down prediction. To model the multi-scale texts in a single-level head, we introduce a novel positive sampling strategy by treating the shrunk text region as positive samples, and design a feature awareness module (FAM) for spatial-awareness and scale-awareness by fusing rich contextual information and focusing on more significant features. Moreover, we propose a segmented non-maximum suppression (S-NMS) method that can filter low-quality mask regressions. Extensive experiments are conducted on four challenging datasets, which demonstrate our TextDCT obtains competitive performance on both accuracy and efficiency. Specifically, TextDCT achieves F-measure of 85.1 at 17.2 frames per second (FPS) and F-measure of 84.9 at 15.1 FPS for CTW1500 and Total-Text datasets, respectively.


title: Multicarrier Modulation on Delay-Doppler Plane: Achieving Orthogonality with Fine Resolutions

abstract: In this paper, we investigate the design of a novel multicarrier (MC) modulation on delay-Doppler (DD) plane, to couple the modulated signal with a doubly-selective channel having DD resolutions. A key challenge for the design of DD plane MC modulation is to find a realizable pulse orthogonal with respect to the DD plane's fine resolutions. To this end, we first indicate that a feasible DD plane MC modulation is essentially a type of staggered multitone modulation. Then, we propose an orthogonal delay-Doppler division multiplexing (ODDM) modulation, and design the corresponding transmit pulse. Most importantly, we prove that the proposed transmit pulse is orthogonal with respect to the DD plane's resolutions and therefore a realizable DD plane orthogonal pulse does exist. Finally, we demonstrate the superior performance of the proposed ODDM modulation in terms of out-of-band radiation and bit error rate.


title: Mushroom image recognition and distance generation based on attention-mechanism model and genetic information

abstract: The species identification of Macrofungi, i.e. mushrooms, has always been a challenging task. There are still a large number of poisonous mushrooms that have not been found, which poses a risk to people's life. However, the traditional identification method requires a large number of experts with knowledge in the field of taxonomy for manual identification, it is not only inefficient but also consumes a lot of manpower and capital costs. In this paper, we propose a new model based on attention-mechanism, MushroomNet, which applies the lightweight network MobileNetV3 as the backbone model, combined with the attention structure proposed by us, and has achieved excellent performance in the mushroom recognition task. On the public dataset, the test accuracy of the MushroomNet model has reached 83.9%, and on the local dataset, the test accuracy has reached 77.4%. The proposed attention mechanisms well focused attention on the bodies of mushroom image for mixed channel attention and the attention heat maps visualized by Grad-CAM. Further, in this study, genetic distance was added to the mushroom image recognition task, the genetic distance was used as the representation space, and the genetic distance between each pair of mushroom species in the dataset was used as the embedding of the genetic distance representation space, so as to predict the image distance and species. identify. We found that using the MES activation function can predict the genetic distance of mushrooms very well, but the accuracy is lower than that of SoftMax. The proposed MushroomNet was demonstrated it shows great potential for automatic and online mushroom image and the proposed automatic procedure would assist and be a reference to traditional mushroom classification.


title: The surface-topography challenge: Problem definition

abstract: We present to the community a surface-definition problem, whose solution we consider to be critical for the proper description of contacts between nominally flat surfaces [1,2]. In 2015, M\"user and Dapp issued the Contact Mechanics Challenge, which provided complete topography data for a fictional surface and asked theorists and modelers to compute the expected contact parameters for such a surface. This effort was a success, but exposed one glaring flaw in the community's understanding of the nature of contact: these models require as input a complete description of surface topography, which is rarely or never available for real-world surfaces [3-6]. The present challenge is to experimentalists: we will send you samples of two materials (one smoother and one rougher); you determine the surface topography of these materials. We call on you to measure such surfaces however you wish, using contact-based techniques, light scattering, microscopy, or other techniques. Examples of quantities of interest are: root-mean-square (RMS) parameters; the power spectral density (PSD); or the autocorrelation function (ACF). For the material, we have chosen chromium nitride, a wear- and corrosion-resistant coating used in industrial applications including automotive components, cutting tools, and die-casting. To participate, simply go to: https://contact.engineering/challenge to provide your shipping address and other information, then samples will be shipped out to you. The only requirement of participation is that your raw topography measurements are deposited on the free contact.engineering web app to facilitate data sharing. The purpose of this challenge is for our community to move towards: (a) better agreement on how to describe the multi-scale topography of experimental surfaces; and (b) better understanding of how to apply the well-developed models and theories to real-world surfaces.


title: 3D unsupervised anomaly detection and localization through virtual multi-view projection and reconstruction: Clinical validation on low-dose chest computed tomography

abstract: Computer-aided diagnosis for low-dose computed tomography (CT) based on deep learning has recently attracted attention as a first-line automatic testing tool because of its high accuracy and low radiation exposure. However, existing methods rely on supervised learning, imposing an additional burden to doctors for collecting disease data or annotating spatial labels for network training, consequently hindering their implementation. We propose a method based on a deep neural network for computer-aided diagnosis called virtual multi-view projection and reconstruction for unsupervised anomaly detection. Presumably, this is the first method that only requires data from healthy patients for training to identify three-dimensional (3D) regions containing any anomalies. The method has three key components. Unlike existing computer-aided diagnosis tools that use conventional CT slices as the network input, our method 1) improves the recognition of 3D lung structures by virtually projecting an extracted 3D lung region to obtain two-dimensional (2D) images from diverse views to serve as network inputs, 2) accommodates the input diversity gain for accurate anomaly detection, and 3) achieves 3D anomaly/disease localization through a novel 3D map restoration method using multiple 2D anomaly maps. The proposed method based on unsupervised learning improves the patient-level anomaly detection by 10% (area under the curve, 0.959) compared with a gold standard based on supervised learning (area under the curve, 0.848), and it localizes the anomaly region with 93% accuracy, demonstrating its high performance.


title: Uncovering variability in human driving behavior through automatic extraction of similar traffic scenes from large naturalistic datasets

abstract: Recently, multiple naturalistic traffic datasets of human-driven trajectories have been published (e.g., highD, NGSim, and pNEUMA). These datasets have been used in studies that investigate variability in human driving behavior, for example for scenario-based validation of autonomous vehicle (AV) behavior, modeling driver behavior, or validating driver models. Thus far, these studies focused on the variability on an operational level (e.g., velocity profiles during a lane change), not on a tactical level (i.e., to change lanes or not). Investigating the variability on both levels is necessary to develop driver models and AVs that include multiple tactical behaviors. To expose multi-level variability, the human responses to the same traffic scene could be investigated. However, no method exists to automatically extract similar scenes from datasets. Here, we present a four-step extraction method that uses the Hausdorff distance, a mathematical distance metric for sets. We performed a case study on the highD dataset that showed that the method is practically applicable. The human responses to the selected scenes exposed the variability on both the tactical and operational levels. With this new method, the variability in operational and tactical human behavior can be investigated, without the need for costly and time-consuming driving-simulator experiments.


title: ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planning

abstract: Trajectory prediction is a critical functionality of autonomous systems that share environments with uncontrolled agents, one prominent example being self-driving vehicles. Currently, most prediction methods do not enforce scene consistency, i.e., there are a substantial amount of self-collisions between predicted trajectories of different agents in the scene. Moreover, many approaches generate individual trajectory predictions per agent instead of joint trajectory predictions of the whole scene, which makes downstream planning difficult. In this work, we present ScePT, a policy planning-based trajectory prediction model that generates accurate, scene-consistent trajectory predictions suitable for autonomous system motion planning. It explicitly enforces scene consistency and learns an agent interaction policy that can be used for conditional prediction. Experiments on multiple real-world pedestrians and autonomous vehicle datasets show that ScePT} matches current state-of-the-art prediction accuracy with significantly improved scene consistency. We also demonstrate ScePT's ability to work with a downstream contingency planner.


title: Rotated Digit Recognition by Variational Autoencoders with Fixed Output Distributions

abstract: This paper demonstrates that a simple modification of the variational autoencoder (VAE) formalism enables the method to identify and classify rotated and distorted digits. In particular, the conventional objective (cost) function employed during the training process of a VAE both quantifies the agreement between the input and output data records and ensures that the latent space representation of the input data record is statistically generated with an appropriate mean and standard deviation. After training, simulated data realizations are generated by decoding appropriate latent space points. Since, however, standard VAE:s trained on randomly rotated MNIST digits cannot reliably distinguish between different digit classes since the rotated input data is effectively compared to a similarly rotated output data record. In contrast, an alternative implementation in which the objective function compares the output associated with each rotated digit to a corresponding fixed unreferenced reference digit is shown here to discriminate accurately among the rotated digits in latent space even when the dimension of the latent space is 2 or 3.


title: UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior

abstract: With the fast-growing GUI development workload in the Internet industry, some work on intelligent methods attempted to generate maintainable front-end code from UI screenshots. It can be more suitable for utilizing UI design drafts that contain UI metadata. However, fragmented layers inevitably appear in the UI design drafts which greatly reduces the quality of code generation. None of the existing GUI automated techniques detects and merges the fragmented layers to improve the accessibility of generated code. In this paper, we propose UI Layers Merger (UILM), a vision-based method, which can automatically detect and merge fragmented layers into UI components. Our UILM contains Merging Area Detector (MAD) and a layers merging algorithm. MAD incorporates the boundary prior knowledge to accurately detect the boundaries of UI components. Then, the layers merging algorithm can search out the associated layers within the components' boundaries and merge them into a whole part. We present a dynamic data augmentation approach to boost the performance of MAD. We also construct a large-scale UI dataset for training the MAD and testing the performance of UILM. The experiment shows that the proposed method outperforms the best baseline regarding merging area detection and achieves a decent accuracy regarding layers merging.


title: A Comprehensive Survey on Video Saliency Detection with Auditory Information: the Audio-visual Consistency Perceptual is the Key!

abstract: Video saliency detection (VSD) aims at fast locating the most attractive objects/things/patterns in a given video clip. Existing VSD-related works have mainly relied on the visual system but paid less attention to the audio aspect, while, actually, our audio system is the most vital complementary part to our visual system. Also, audio-visual saliency detection (AVSD), one of the most representative research topics for mimicking human perceptual mechanisms, is currently in its infancy, and none of the existing survey papers have touched on it, especially from the perspective of saliency detection. Thus, the ultimate goal of this paper is to provide an extensive review to bridge the gap between audio-visual fusion and saliency detection. In addition, as another highlight of this review, we have provided a deep insight into key factors which could directly determine the performances of AVSD deep models, and we claim that the audio-visual consistency degree (AVC) -- a long-overlooked issue, can directly influence the effectiveness of using audio to benefit its visual counterpart when performing saliency detection. Moreover, in order to make the AVC issue more practical and valuable for future followers, we have newly equipped almost all existing publicly available AVSD datasets with additional frame-wise AVC labels. Based on these upgraded datasets, we have conducted extensive quantitative evaluations to ground our claim on the importance of AVC in the AVSD task. In a word, both our ideas and new sets serve as a convenient platform with preliminaries and guidelines, all of which are very potential to facilitate future works in promoting state-of-the-art (SOTA) performance further.


title: Deep reinforced active learning for multi-class image classification

abstract: High accuracy medical image classification can be limited by the costs of acquiring more data as well as the time and expertise needed to label existing images. In this paper, we apply active learning to medical image classification, a method which aims to maximise model performance on a minimal subset from a larger pool of data. We present a new active learning framework, based on deep reinforcement learning, to learn an active learning query strategy to label images based on predictions from a convolutional neural network. Our framework modifies the deep-Q network formulation, allowing us to pick data based additionally on geometric arguments in the latent space of the classifier, allowing for high accuracy multi-class classification in a batch-based active learning setting, enabling the agent to label datapoints that are both diverse and about which it is most uncertain. We apply our framework to two medical imaging datasets and compare with standard query strategies as well as the most recent reinforcement learning based active learning approach for image classification.


title: Remote Sensing Image Classification using Transfer Learning and Attention Based Deep Neural Network

abstract: The task of remote sensing image scene classification (RSISC), which aims at classifying remote sensing images into groups of semantic categories based on their contents, has taken the important role in a wide range of applications such as urban planning, natural hazards detection, environment monitoring,vegetation mapping, or geospatial object detection. During the past years, research community focusing on RSISC task has shown significant effort to publish diverse datasets as well as propose different approaches to deal with the RSISC challenges. Recently, almost proposed RSISC systems base on deep learning models which prove powerful and outperform traditional approaches using image processing and machine learning. In this paper, we also leverage the power of deep learning technology, evaluate a variety of deep neural network architectures, indicate main factors affecting the performance of a RSISC system. Given the comprehensive analysis, we propose a deep learning based framework for RSISC, which makes use of the transfer learning technique and multihead attention scheme. The proposed deep learning framework is evaluated on the benchmark NWPU-RESISC45 dataset and achieves the best classification accuracy of 94.7% which shows competitive to the state-of-the-art systems and potential for real-life applications.


title: Cross-Modal Transformer GAN: A Brain Structure-Function Deep Fusing Framework for Alzheimer's Disease

abstract: Cross-modal fusion of different types of neuroimaging data has shown great promise for predicting the progression of Alzheimer's Disease(AD). However, most existing methods applied in neuroimaging can not efficiently fuse the functional and structural information from multi-modal neuroimages. In this work, a novel cross-modal transformer generative adversarial network(CT-GAN) is proposed to fuse functional information contained in resting-state functional magnetic resonance imaging (rs-fMRI) and structural information contained in Diffusion Tensor Imaging (DTI). The developed bi-attention mechanism can match functional information to structural information efficiently and maximize the capability of extracting complementary information from rs-fMRI and DTI. By capturing the deep complementary information between structural features and functional features, the proposed CT-GAN can detect the AD-related brain connectivity, which could be used as a bio-marker of AD. Experimental results show that the proposed model can not only improve classification performance but also detect the AD-related brain connectivity effectively.


title: CS$^2$: A Controllable and Simultaneous Synthesizer of Images and Annotations with Minimal Human Intervention

abstract: The destitution of image data and corresponding expert annotations limit the training capacities of AI diagnostic models and potentially inhibit their performance. To address such a problem of data and label scarcity, generative models have been developed to augment the training datasets. Previously proposed generative models usually require manually adjusted annotations (e.g., segmentation masks) or need pre-labeling. However, studies have found that these pre-labeling based methods can induce hallucinating artifacts, which might mislead the downstream clinical tasks, while manual adjustment could be onerous and subjective. To avoid manual adjustment and pre-labeling, we propose a novel controllable and simultaneous synthesizer (dubbed CS$^2$) in this study to generate both realistic images and corresponding annotations at the same time. Our CS$^2$ model is trained and validated using high resolution CT (HRCT) data collected from COVID-19 patients to realize an efficient infections segmentation with minimal human intervention. Our contributions include 1) a conditional image synthesis network that receives both style information from reference CT images and structural information from unsupervised segmentation masks, and 2) a corresponding segmentation mask synthesis network to automatically segment these synthesized images simultaneously. Our experimental studies on HRCT scans collected from COVID-19 patients demonstrate that our CS$^2$ model can lead to realistic synthesized datasets and promising segmentation results of COVID infections compared to the state-of-the-art nnUNet trained and fine-tuned in a fully supervised manner.


title: Gait Cycle Reconstruction and Human Identification from Occluded Sequences

abstract: Gait-based person identification from videos captured at surveillance sites using Computer Vision-based techniques is quite challenging since these walking sequences are usually corrupted with occlusion, and a complete cycle of gait is not always available. In this work, we propose an effective neural network-based model to reconstruct the occluded frames in an input sequence before carrying out gait recognition. Specifically, we employ LSTM networks to predict an embedding for each occluded frame both from the forward and the backward directions, and next fuse the predictions from the two LSTMs by employing a network of residual blocks and convolutional layers. While the LSTMs are trained to minimize the mean-squared loss, the fusion network is trained to optimize the pixel-wise cross-entropy loss between the ground-truth and the reconstructed samples. Evaluation of our approach has been done using synthetically occluded sequences generated from the OU-ISIR LP and CASIA-B data and real-occluded sequences present in the TUM-IITKGP data. The effectiveness of the proposed reconstruction model has been verified through the Dice score and gait-based recognition accuracy using some popular gait recognition methods. Comparative study with existing occlusion handling methods in gait recognition highlights the superiority of our proposed occlusion reconstruction approach over the others.


title: A Simple Approach for Visual Rearrangement: 3D Mapping and Semantic Search

abstract: Physically rearranging objects is an important capability for embodied agents. Visual room rearrangement evaluates an agent's ability to rearrange objects in a room to a desired goal based solely on visual input. We propose a simple yet effective method for this problem: (1) search for and map which objects need to be rearranged, and (2) rearrange each object until the task is complete. Our approach consists of an off-the-shelf semantic segmentation model, voxel-based semantic map, and semantic search policy to efficiently find objects that need to be rearranged. On the AI2-THOR Rearrangement Challenge, our method improves on current state-of-the-art end-to-end reinforcement learning-based methods that learn visual rearrangement policies from 0.53% correct rearrangement to 16.56%, using only 2.7% as many samples from the environment.


title: Generative Modelling With Inverse Heat Dissipation

abstract: While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and the empirical success of coarse-to-fine modelling, we propose a new diffusion-like model that generates images through stochastically reversing the heat equation, a PDE that locally erases fine-scale information when run over the 2D plane of the image. We interpret the solution of the forward heat equation with constant additive noise as a variational approximation in the diffusion latent variable model. Our new model shows emergent qualitative properties not seen in standard diffusion models, such as disentanglement of overall colour and shape in images. Spectral analysis on natural images highlights connections to diffusion models and reveals an implicit coarse-to-fine inductive bias in them.


title: An Efficient Industrial Federated Learning Framework for AIoT: A Face Recognition Application

abstract: Recently, the artificial intelligence of things (AIoT) has been gaining increasing attention, with an intriguing vision of providing highly intelligent services through the network connection of things, leading to an advanced AI-driven ecology. However, recent regulatory restrictions on data privacy preclude uploading sensitive local data to data centers and utilizing them in a centralized approach. Directly applying federated learning algorithms in this scenario could hardly meet the industrial requirements of both efficiency and accuracy. Therefore, we propose an efficient industrial federated learning framework for AIoT in terms of a face recognition application. Specifically, we propose to utilize the concept of transfer learning to speed up federated training on devices and further present a novel design of a private projector that helps protect shared gradients without incurring additional memory consumption or computational cost. Empirical studies on a private Asian face dataset show that our approach can achieve high recognition accuracy in only 20 communication rounds, demonstrating its effectiveness in prediction and its efficiency in training.


title: Transfer Learning via Test-Time Neural Networks Aggregation

abstract: It has been demonstrated that deep neural networks outperform traditional machine learning. However, deep networks lack generalisability, that is, they will not perform as good as in a new (testing) set drawn from a different distribution due to the domain shift. In order to tackle this known issue, several transfer learning approaches have been proposed, where the knowledge of a trained model is transferred into another to improve performance with different data. However, most of these approaches require additional training steps, or they suffer from catastrophic forgetting that occurs when a trained model has overwritten previously learnt knowledge. We address both problems with a novel transfer learning approach that uses network aggregation. We train dataset-specific networks together with an aggregation network in a unified framework. The loss function includes two main components: a task-specific loss (such as cross-entropy) and an aggregation loss. The proposed aggregation loss allows our model to learn how trained deep network parameters can be aggregated with an aggregation operator. We demonstrate that the proposed approach learns model aggregation at test time without any further training step, reducing the burden of transfer learning to a simple arithmetical operation. The proposed approach achieves comparable performance w.r.t. the baseline. Besides, if the aggregation operator has an inverse, we will show that our model also inherently allows for selective forgetting, i.e., the aggregated model can forget one of the datasets it was trained on, retaining information on the others.


title: Real interpolation of functions with applications to accretive operators on Banach spaces

abstract: We study real interpolation, but instead of interpolating between Banach spaces, we interpolate between general functions taking values in $[0,\infty].$ We show the equivalence of the mean method and the $K$-method and apply the general theory to interpolation between the norm on a Banach space and the set norm associated with an m-accretive operator on such a space.


title: Symmetry breaking in geometry

abstract: A geometric mechanism that may, in analogy to similar notions in physics, be considered as "symmetry breaking" in geometry is described, and several instances of this mechanism in differential geometry are discussed: it is shown how spontaneous symmetry breaking may occur, and it is discussed how explicit symmetry breaking may be used to tackle certain geometric problems. A systematic study of symmetry breaking in geometry is proposed, and some preliminary thoughts on further research are formulated.


title: Spatial resolution in optical coherence elastography of bounded media

abstract: Dynamic optical coherence elastography (OCE) tracks mechanical wave propagation in the subsurface region of tissue to image its shear modulus. For bulk shear waves, the lateral resolution of the reconstructed modulus map (i.e., elastographic resolution) can approach optical coherence tomography (OCT) capabilities, typically a few tens of microns. Here we perform comprehensive numerical simulations and acoustic micro-tapping OCE experiments to show that for the typical situation of guided wave propagation in bounded media, such as cornea, the elastographic resolution cannot reach the OCT resolution and is mainly defined by the thickness of the bounded tissue layer. We considered the excitation of both broadband and quasi-harmonic guided waves in a bounded, isotropic medium. Leveraging the properties of broadband pulses, a robust method for modulus reconstruction with minimum artifacts at interfaces is demonstrated. In contrast, tissue bounding creates large instabilities in the phase of harmonic waves, leading to serious artifacts in modulus reconstructions.


title: Field change for the Cassels-Tate pairing and applications to class groups

abstract: In previous work, the authors defined a category $SMod_F$ of finite Galois modules decorated with local conditions for each global field $F$. In this paper, given an extension $K/F$ of global fields, we define a restriction of scalars functor from $SMod_K$ to $SMod_F$ and show that it behaves well with respect to the Cassels-Tate pairing. We apply this work to study the class groups of global fields in the context of the Cohen-Lenstra heuristics.


title: Avocodo: Generative Adversarial Network for Artifact-free Vocoder

abstract: Neural vocoders based on the generative adversarial neural network (GAN) have been widely used due to their fast inference speed and lightweight networks while generating high-quality speech waveforms. Since the perceptually important speech components are primarily concentrated in the low-frequency bands, most GAN-based vocoders perform multi-scale analysis that evaluates downsampled speech waveforms. This multi-scale analysis helps the generator improve speech intelligibility. However, in preliminary experiments, we discovered that the multi-scale analysis which focuses on the low-frequency bands causes unintended artifacts, e.g., aliasing and imaging artifacts, which degrade the synthesized speech waveform quality. Therefore, in this paper, we investigate the relationship between these artifacts and GAN-based vocoders and propose a GAN-based vocoder, called Avocodo, that allows the synthesis of high-fidelity speech with reduced artifacts. We introduce two kinds of discriminators to evaluate speech waveforms in various perspectives: a collaborative multi-band discriminator and a sub-band discriminator. We also utilize a pseudo quadrature mirror filter bank to obtain downsampled multi-band speech waveforms while avoiding aliasing. According to experimental results, Avocodo outperforms baseline GAN-based vocoders, both objectively and subjectively, while reproducing speech with fewer artifacts.


title: Utilizing Class Separation Distance for the Evaluation of Corruption Robustness of Machine Learning Classifiers

abstract: Robustness is a fundamental pillar of Machine Learning (ML) classifiers, substantially determining their reliability. Methods for assessing classifier robustness are therefore essential. In this work, we address the challenge of evaluating corruption robustness in a way that allows comparability and interpretability on a given dataset. We propose a test data augmentation method that uses a robustness distance $\epsilon$ derived from the datasets minimal class separation distance. The resulting MSCR (mean statistical corruption robustness) metric allows a dataset-specific comparison of different classifiers with respect to their corruption robustness. The MSCR value is interpretable, as it represents the classifiers avoidable loss of accuracy due to statistical corruptions. On 2D and image data, we show that the metric reflects different levels of classifier robustness. Furthermore, we observe unexpected optima in classifiers robust accuracy through training and testing classifiers with different levels of noise. While researchers have frequently reported on a significant tradeoff on accuracy when training robust models, we strengthen the view that a tradeoff between accuracy and corruption robustness is not inherent. Our results indicate that robustness training through simple data augmentation can already slightly improve accuracy.


title: Explicitly incorporating spatial information to recurrent networks for agriculture

abstract: In agriculture, the majority of vision systems perform still image classification. Yet, recent work has highlighted the potential of spatial and temporal cues as a rich source of information to improve the classification performance. In this paper, we propose novel approaches to explicitly capture both spatial and temporal information to improve the classification of deep convolutional neural networks. We leverage available RGB-D images and robot odometry to perform inter-frame feature map spatial registration. This information is then fused within recurrent deep learnt models, to improve their accuracy and robustness. We demonstrate that this can considerably improve the classification performance with our best performing spatial-temporal model (ST-Atte) achieving absolute performance improvements for intersection-over-union (IoU[%]) of 4.7 for crop-weed segmentation and 2.6 for fruit (sweet pepper) segmentation. Furthermore, we show that these approaches are robust to variable framerates and odometry errors, which are frequently observed in real-world applications.


title: Micromechanics of rock damage and its recovery in cyclic loading conditions

abstract: Under compressive stress, rock ``damage'' in the form of tensile microcracks is coupled to internal slip on microscopic interfaces, such as preexisting cracks and grain boundaries. In order to characterise the contribution of slip to the overall damage process, we conduct triaxial cyclic loading experiments on Westerly granite, and monitor volumetric strain and elastic wave velocity and anisotropy. Cyclic loading tests show large hysteresis in axial stress-strain behaviour that can be explained entirely by slip. Elastic wave velocity variations are observed only past a yield point, and show hysteresis with incomplete reversibility upon unloading. Irrecoverable volumetric strain and elastic wave velocity drop and anisotropy increase with increasing maximum stress, are amplified during hydrostatic decompression, and decrease logarithmically with time during hydrostatic hold periods after deformation cycles. The mechanical data and change in elastic properties are used to determine the proportion of mechanical work required to generate tensile cracks, which increases as the rock approaches failure but remains small, up to around 10\% of the net dissipated work per cycle. The pre-rupture deformation behaviour of rocks is qualitatively compatible with the mechanics of wing cracks. While tensile cracks are the source of large changes in rock physical properties, they are not systematically associated with significant energy dissipation and their aperture and growth is primarily controlled by friction, which exerts a dominant control on rock rheology in the brittle regime. Time-dependent friction along preexisting shear interfaces explains how tensile cracks can close under static conditions and produce recovery of elastic wave velocities over time.


title: Perfect one-dimensional interface states in a twisted stack of three-dimensional topological insulators

abstract: We theoretically study the electronic structure of interface states in twisted stacks of three-dimensional topological insulators. When the center of the surface Dirac cone is located at a midpoint of a side of BZ boundary, we find that an array of nearly-independent one-dimensional channels is formed by the interface hybridization of the surface states, even when the moir\'{e} pattern itself is isotropic. The two counter-propagating channels have opposite spin polarization, and they are robust against scattering by spin-independent impurities. The coupling between the parallel channels can be tuned by the twist angle.The unique 1D states can be understood as effective Landau levels where the twist angle works as a fictitious magnetic field.


title: Homomesies on permutations -- an analysis of maps and statistics in the FindStat database

abstract: In this paper, we perform a systematic study of permutation statistics and bijective maps on permutations in which we identify and prove 122 instances of the homomesy phenomenon. Homomesy occurs when the average value of a statistic is the same on each orbit of a given map. The maps we investigate include the Lehmer code rotation, the reverse, the complement, the Foata bijection, and the Kreweras complement. The statistics studied relate to familiar notions such as inversions, descents, and permutation patterns, and also more obscure constructs. Beside the many new homomesy results, we discuss our research method, in which we used SageMath to search the FindStat combinatorial statistics database to identify potential homomesies.


title: Supervised Optimal Transport

abstract: Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan which traditional optimal transport cannot enforce. Here we introduce Supervised Optimal Transport (sOT) that formulates a constrained optimal transport problem where couplings between certain elements are prohibited according to specific applications. sOT is proved to be equivalent to an $l^1$ penalized optimization problem, from which efficient algorithms are designed to solve its entropy regularized formulation. We demonstrate the capability of sOT by comparing it to other variants and extensions of traditional OT in color transfer problem. We also study the barycenter problem in sOT formulation, where we discover and prove a unique reverse and portion selection (control) mechanism. Supervised optimal transport is broadly applicable to applications in which constrained transport plan is involved and the original unit should be preserved by avoiding normalization.


title: Audio Similarity is Unreliable as a Proxy for Audio Quality

abstract: Many audio processing tasks require perceptual assessment. However, the time and expense of obtaining ``gold standard'' human judgments limit the availability of such data. Most applications incorporate full reference or other similarity-based metrics (e.g. PESQ) that depend on a clean reference. Researchers have relied on such metrics to evaluate and compare various proposed methods, often concluding that small, measured differences imply one is more effective than another. This paper demonstrates several practical scenarios where similarity metrics fail to agree with human perception, because they: (1) vary with clean references; (2) rely on attributes that humans factor out when considering quality, and (3) are sensitive to imperceptible signal level differences. In those scenarios, we show that no-reference metrics do not suffer from such shortcomings and correlate better with human perception. We conclude therefore that similarity serves as an unreliable proxy for audio quality.


title: Comparative analysis of signal-to-noise ratio in correlation plenoptic imaging architectures

abstract: Correlation plenoptic imaging (CPI) is a scanning-free diffraction-limited 3D optical imaging technique exploiting the peculiar properties of correlated light sources. CPI has been further extended to samples of interest to microscopy, such as fluorescent or scattering objects, in a modified architecture named correlation light-field microscopy (CLM). Interestingly, experiments have shown that the noise performances of CLM are significantly improved over the original CPI scheme, leading to better images and faster acquisition. In this work, we provide a theoretical foundation to such advantage by investigating the properties of both the signal-to-noise and the signal-to-background ratios of CLM and the original CPI setup.


title: RES: A Robust Framework for Guiding Visual Explanation

abstract: Despite the fast progress of explanation techniques in modern Deep Neural Networks (DNNs) where the main focus is handling "how to generate the explanations", advanced research questions that examine the quality of the explanation itself (e.g., "whether the explanations are accurate") and improve the explanation quality (e.g., "how to adjust the model to generate more accurate explanations when explanations are inaccurate") are still relatively under-explored. To guide the model toward better explanations, techniques in explanation supervision - which add supervision signals on the model explanation - have started to show promising effects on improving both the generalizability as and intrinsic interpretability of Deep Neural Networks. However, the research on supervising explanations, especially in vision-based applications represented through saliency maps, is in its early stage due to several inherent challenges: 1) inaccuracy of the human explanation annotation boundary, 2) incompleteness of the human explanation annotation region, and 3) inconsistency of the data distribution between human annotation and model explanation maps. To address the challenges, we propose a generic RES framework for guiding visual explanation by developing a novel objective that handles inaccurate boundary, incomplete region, and inconsistent distribution of human annotations, with a theoretical justification on model generalizability. Extensive experiments on two real-world image datasets demonstrate the effectiveness of the proposed framework on enhancing both the reasonability of the explanation and the performance of the backbone DNNs model.


title: Learning To Cut By Looking Ahead: Cutting Plane Selection via Imitation Learning

abstract: Cutting planes are essential for solving mixed-integer linear problems (MILPs), because they facilitate bound improvements on the optimal solution value. For selecting cuts, modern solvers rely on manually designed heuristics that are tuned to gauge the potential effectiveness of cuts. We show that a greedy selection rule explicitly looking ahead to select cuts that yield the best bound improvement delivers strong decisions for cut selection - but is too expensive to be deployed in practice. In response, we propose a new neural architecture (NeuralCut) for imitation learning on the lookahead expert. Our model outperforms standard baselines for cut selection on several synthetic MILP benchmarks. Experiments with a B&C solver for neural network verification further validate our approach, and exhibit the potential of learning methods in this setting.


title: Is the Language Familiarity Effect gradual? A computational modelling approach

abstract: According to the Language Familiarity Effect (LFE), people are better at discriminating between speakers of their native language. Although this cognitive effect was largely studied in the literature, experiments have only been conducted on a limited number of language pairs and their results only show the presence of the effect without yielding a gradual measure that may vary across language pairs. In this work, we show that the computational model of LFE introduced by Thorburn, Feldmand and Schatz (2019) can address these two limitations. In a first experiment, we attest to this model's capacity to obtain a gradual measure of the LFE by replicating behavioural findings on native and accented speech. In a second experiment, we evaluate LFE on a large number of language pairs, including many which have never been tested on humans. We show that the effect is replicated across a wide array of languages, providing further evidence of its universality. Building on the gradual measure of LFE, we also show that languages belonging to the same family yield smaller scores, supporting the idea of an effect of language distance on LFE.


title: A Majority-Vote Model On Multiplex Networks with Community Structure

abstract: We investigate a majority-vote model on two-layer multiplex networks with community structure. In our majority-vote model, the edges on each layer encode one type of social relationship and an individual changes their opinion based on the majority opinions of their neighbors in each layer. To capture the fact that different relationships often have different levels of importance, we introduce a layer-preference parameter, which determines the probability of a node to adopt an opinion when the node's neighborhoods on the two layers have different majority opinions. We construct our networks so that each node is a member of one community on each layer, and we consider situations in which nodes tend to have more connections with nodes from the same community than with nodes from different communities. We study the influence of the layer-preference parameter, the intralayer communities, and interlayer membership correlation on the steady-state behavior of our model using both direct numerical simulations and a mean-field approximation. We find three different types of steady-state behavior: a fully-mixed state, consensus states, and polarized states. We demonstrate that a stronger interlayer community correlation makes polarized steady states reachable for wider ranges of the other model parameters. We also show that different values of the layer-preference parameter result in qualitatively different phase diagrams for the mean opinions at steady states.

categories: physics.soc-ph cond-mat.stat-mech cs.SI math.DS nlin.AO


title: Entanglement wedge cross section inequalities in AdS/BCFT

abstract: The entanglement wedge cross section in holographic picture provides a geometrical description of the entanglement for mixed states. In this paper we study the inequalities for the entanglement wedge cross section in AdS/BCFT duality. In the presence of the boundary in conformal field theory (CFT), the dual entanglement wedge cross section exhibits abundant phase structures since the extremal surface may end on the brane. We present a universal treatment which is applicable for all the possible phases such that the inequalities for the entanglement wedge cross section can be proved in an algebraic manner rather than a diagrammatic manner. We show that the entanglement wedge cross section in AdS/BCFT satisfies the same inequalities as in AdS/CFT.


title: Belief-selective Propagation Detection for MIMO Systems

abstract: Compared to the linear MIMO detectors, the Belief Propagation (BP) detector has shown greater capabilities in achieving near optimal performance and better nature to iteratively cooperate with channel decoders. Aiming at real applications, recent works mainly fall into the category of reducing the complexity by simplified calculations, at the expense of performance sacrifice. However, the complexity is still unsatisfactory with exponentially increasing complexity or required exponentiation operations. Furthermore, due to the inherent loopy structure, the existing BP detectors persistently encounter error floor in high signal-to-noise ratio (SNR) region, which becomes even worse with calculation approximation. This work aims at a revised BP detector, named {Belief-selective Propagation (BsP)} detector by selectively utilizing the \emph{trusted} incoming messages with sufficiently large \textit{a priori} probabilities for updates. Two proposed strategies: symbol-based truncation (ST) and edge-based simplification (ES) squeeze the complexity (orders lower than the Original-BP), while greatly relieving the error floor issue over a wide range of antenna and modulation combinations. For the $16$-QAM $8 \times 4$ MIMO system, the $\mathcal{B}(1,1)$ {BsP} detector achieves more than $4$\,dB performance gain (@$\text{BER}=10^{-4}$) with roughly $4$ orders lower complexity than the Original-BP detector. Trade-off between performance and complexity towards different application requirement can be conveniently obtained by configuring the ST and ES parameters.


title: DeStripe: A Self2Self Spatio-Spectral Graph Neural Network with Unfolded Hessian for Stripe Artifact Removal in Light-sheet Microscopy

abstract: Light-sheet fluorescence microscopy (LSFM) is a cutting-edge volumetric imaging technique that allows for three-dimensional imaging of mesoscopic samples with decoupled illumination and detection paths. Although the selective excitation scheme of such a microscope provides intrinsic optical sectioning that minimizes out-of-focus fluorescence background and sample photodamage, it is prone to light absorption and scattering effects, which results in uneven illumination and striping artifacts in the images adversely. To tackle this issue, in this paper, we propose a blind stripe artifact removal algorithm in LSFM, called DeStripe, which combines a self-supervised spatio-spectral graph neural network with unfolded Hessian prior. Specifically, inspired by the desirable properties of Fourier transform in condensing striping information into isolated values in the frequency domain, DeStripe firstly localizes the potentially corrupted Fourier coefficients by exploiting the structural difference between unidirectional stripe artifacts and more isotropic foreground images. Affected Fourier coefficients can then be fed into a graph neural network for recovery, with a Hessian regularization unrolled to further ensure structures in the standard image space are well preserved. Since in realistic, stripe-free LSFM barely exists with a standard image acquisition protocol, DeStripe is equipped with a Self2Self denoising loss term, enabling artifact elimination without access to stripe-free ground truth images. Competitive experimental results demonstrate the efficacy of DeStripe in recovering corrupted biomarkers in LSFM with both synthetic and real stripe artifacts.


title: Unsupervised Voice Activity Detection by Modeling Source and System Information using Zero Frequency Filtering

abstract: Voice activity detection (VAD) is an important pre-processing step for speech technology applications. The task consists of deriving segment boundaries of audio signals which contain voicing information. In recent years, it has been shown that voice source and vocal tract system information can be extracted using zero-frequency filtering (ZFF) without making any explicit model assumptions about the speech signal. This paper investigates the potential of zero-frequency filtering for jointly modeling voice source and vocal tract system information, and proposes two approaches for VAD. The first approach demarcates voiced regions using a composite signal composed of different zero-frequency filtered signals. The second approach feeds the composite signal as input to the rVAD algorithm. These approaches are compared with other supervised and unsupervised VAD methods in the literature, and are evaluated on the Aurora-2 database, across a range of SNRs (20 to -5 dB). Our studies show that the proposed ZFF-based methods perform comparable to state-of-art VAD methods and are more invariant to added degradation and different channel characteristics.


title: Equidivisibility and profinite coproduct

abstract: The aim of this work is to investigate the behavior of equidivisibility under coproduct in the category of pro-$\mathsf{V}$ semigroups, where $\mathsf{V}$ is a pseudovariety of finite semigroups. Exploring the relationship with the two-sided Karnofsky--Rhodes expansion, the notions of KR-cover and strong KR-cover for profinite semigroups are introduced. The former is stronger than equidivisibility and the latter provides a characterization of equidivisible profinite semigroups with an extra mild condition, so-called letter super-cancellativity. Furthermore, under the assumption that $\mathsf{V}$ is closed under two-sided Karnofsky--Rhodes expansion, closure of some classes of equidivisible pro-$\mathsf{V}$ semigroups under(finite) $\mathsf{V}$-coproduct is established.


title: Generalized Two Color Map Theorem -- Complete Theorem of Robust Gait Plan for a Tilt-rotor

abstract: Gait plan is a procedure that is typically applied on the ground robots, e.g., quadrupedal robots; the tilt-rotor, a novel type of quadrotor with eight inputs, is not one of them. While controlling the tilt-rotor relying on feedback linearization, the tilting angles (inputs) are expected to change over-intensively, which may not be expected in the application. To help suppress the intensive change in the tilting angles, a gait plan procedure is introduced to the tilt-rotor before feedback linearization. The tilting angles are specified with time in advance by users rather than given by the control rule. However, based on this scenario, the decoupling matrix in feedback linearization can be singular for some attitudes, combinations of roll angle and pitch angle. It hinders the further application of the feedback linearization. With this concern, Two Color Map Theorem is established to maximize the acceptable attitude region, where the combinations of roll and pitch will give an invertible decoupling matrix. That theorem, however, over-restricts the choice of the tilting angles, which can rule out some feasible robust gaits. This paper gives the generalized Two Color Map Theorem; all the robust gaits can be found based on this generalized theorem. The robustness of three gaits that satisfy this generalized Two Color Map Theorem (while violating Two Color Map Theorem) are analyzed. The results show that Generalized Two Color Map Theorem completes the search for the robust gaits for a tilt-rotor.


title: Modeling of Joint Parker Solar Probe - Metis/Solar Orbiter Observations

abstract: We present a first theoretical modeling of joint Parker Solar Probe (PSP) - Metis/Solar Orbiter (SolO) quadrature observations Telloni et al 2022c. The combined observations describe the evolution of a slow solar wind plasma parcel from the extended solar corona ($3.5-6.3$ R$_\odot$) to the very inner heliosphere (23.2 R$_\odot$). The Metis/SolO instrument remotely measures the solar wind speed finding a range from $96-201$ kms$^{-1}$, and PSP measures the solar wind plasma in situ, observing a radial speed of 219.34 kms$^{-1}$. We find theoretically and observationally that the solar wind speed accelerates rapidly within 3.3 -- 4 R$_\odot$, and then increases more gradually with distance. Similarly, we find that the theoretical solar wind density is consistent with the remotely and in situ observed solar wind density. The normalized cross-helicity and normalized residual energy observed by PSP are 0.96 and -0.07, respectively, indicating that the slow solar wind is very Alfv\'enic. The theoretical NI/slab results are very similar to PSP measurements, which is a consequence of the highly magnetic field-aligned radial flow ensuring that PSP can measure slab fluctuations and not 2D. Finally, we calculate the theoretical 2D and slab turbulence pressure, finding that the theoretical slab pressure is very similar to that observed by PSP.


title: Benchopt: Reproducible, efficient and collaborative optimization benchmarks

abstract: Numerical validation is at the core of machine learning research as it allows to assess the actual impact of new methods, and to confirm the agreement between theory and practice. Yet, the rapid development of the field poses several challenges: researchers are confronted with a profusion of methods to compare, limited transparency and consensus on best practices, as well as tedious re-implementation work. As a result, validation is often very partial, which can lead to wrong conclusions that slow down the progress of research. We propose Benchopt, a collaborative framework to automate, reproduce and publish optimization benchmarks in machine learning across programming languages and hardware architectures. Benchopt simplifies benchmarking for the community by providing an off-the-shelf tool for running, sharing and extending experiments. To demonstrate its broad usability, we showcase benchmarks on three standard learning tasks: $\ell_2$-regularized logistic regression, Lasso, and ResNet18 training for image classification. These benchmarks highlight key practical findings that give a more nuanced view of the state-of-the-art for these problems, showing that for practical evaluation, the devil is in the details. We hope that Benchopt will foster collaborative work in the community hence improving the reproducibility of research findings.


title: Simplifying Semantic Annotations of SMCalFlow

abstract: SMCalFlow is a large corpus of semantically detailed annotations of task-oriented natural dialogues. The annotations use a dataflow approach, in which the annotations are programs which represent user requests. Despite the availability, size and richness of this annotated corpus, it has seen only very limited use in dialogue systems research work, at least in part due to the difficulty in understanding and using the annotations. To address these difficulties, this paper suggests a simplification of the SMCalFlow annotations, as well as releases code needed to inspect the execution of the annotated dataflow programs, which should allow researchers of dialogue systems an easy entry point to experiment with various dataflow based implementations and annotations.


title: Thermal spin current generation in the multifunctional ferrimagnet Ga$_{0.6}$Fe$_{1.4}$O$_{3}$

abstract: In recent years, multifunctional materials have attracted increasing interest for magnetic memories and energy harvesting applications. Magnetic insulating materials are of special interest for this purpose, since they allow the design of more efficient devices due to the lower Joule heat losses. In this context, Ga$_{0.6}$Fe$_{1.4}$O$_3$ (GFO) is a good candidate for spintronics applications, since it can exhibit multiferroicity and presents a spin Hall magnetoresistance similar to the one observed in a yttrium iron garnet (YIG)/Pt bilayer. Here, we explore GFO utilizing thermo-spin measurements in an on-chip approach. By carefully considering the geometry of our thermo-spin devices we are able to quantify the spin Seebeck effect and the spin current generation in a GFO/Pt bilayer, obtaining a value comparable to that of YIG/Pt. This further confirms the promises of an efficient spin current generation with the possibility of an electric-field manipulation of the magnetic properties of the system in an insulating ferrimagnetic material.


title: Single exciton trapping in an electrostatically defined 2D semiconductor quantum dot

abstract: Interlayer excitons (IXs) in 2D semiconductors have long lifetimes and spin-valley coupled physics, with a long-standing goal of single exciton trapping for valleytronic applications. In this work, we use a nano-patterned graphene gate to create an electrostatic IX trap. We measure a unique power-dependent blue-shift of IX energy, where narrow linewidth emission exhibits discrete energy jumps. We attribute these jumps to quantized increases of the number occupancy of IXs within the trap and compare to a theoretical model to assign the lowest energy emission line to single IX recombination.


title: Adaptive Step Size Learning with Applications to Velocity Aided Inertial Navigation System

abstract: Autonomous underwater vehicles (AUV) are commonly used in many underwater applications. Recently, the usage of multi-rotor unmanned autonomous vehicles (UAV) for marine applications is receiving more attention in the literature. Usually, both platforms employ an inertial navigation system (INS), and aiding sensors for an accurate navigation solution. In AUV navigation, Doppler velocity log (DVL) is mainly used to aid the INS, while for UAVs, it is common to use global navigation satellite systems (GNSS) receivers. The fusion between the aiding sensor and the INS requires a definition of step size parameter in the estimation process. It is responsible for the solution frequency update and, eventually, its accuracy. The choice of the step size poses a tradeoff between computational load and navigation performance. Generally, the aiding sensors update frequency is considered much slower compared to the INS operating frequency (hundreds Hertz). Such high rate is unnecessary for most platforms, specifically for low dynamics AUVs. In this work, a supervised machine learning based adaptive tuning scheme to select the proper INS step size is proposed. To that end, a velocity error bound is defined, allowing the INS/DVL or the INS/GNSS to act in a sub-optimal working conditions, and yet minimize the computational load. Results from simulations and field experiment show the benefits of using the proposed approach. In addition, the proposed framework can be applied to any other fusion scenarios between any type of sensors or platforms.


title: Incivility Detection in Open Source Code Review and Issue Discussions

abstract: Given the democratic nature of open source development, code review and issue discussions may be uncivil. Incivility, defined as features of discussion that convey an unnecessarily disrespectful tone, can have negative consequences to open source communities. To prevent or minimize these negative consequences, open source platforms have included mechanisms for removing uncivil language from the discussions. However, such approaches require manual inspection, which can be overwhelming given the large number of discussions. To help open source communities deal with this problem, in this paper, we aim to compare six classical machine learning models with BERT to detect incivility in open source code review and issue discussions. Furthermore, we assess if adding contextual information improves the models' performance and how well the models perform in a cross-platform setting. We found that BERT performs better than classical machine learning models, with a best F1-score of 0.95. Furthermore, classical machine learning models tend to underperform to detect non-technical and civil discussions. Our results show that adding the contextual information to BERT did not improve its performance and that none of the analyzed classifiers had an outstanding performance in a cross-platform setting. Finally, we provide insights into the tones that the classifiers misclassify.


title: Improving Condensed Phase Water Dynamics with Explicit Nuclear Quantum Effects: the Polarizable Q-AMOEBA Force Field

abstract: We introduce a new parametrization of the AMOEBA polarizable force field for water denoted Q-AMOEBA, for use in simulations that explicitly account for nuclear quantum effects (NQEs). This study is made possible thanks to the recently introduced adaptive Quantum Thermal Bath (adQTB) simulation technique which computational cost is comparable to classical molecular dynamics. The flexible Q-AMOEBA model conserves the initial AMOEBA functional form, with an intermolecular potential including an atomic multipole description of electrostatic interactions (up to quadrupole), a polarization contribution based on the Thole interaction model and a buffered 14-7 potential to model van der Waals interactions. It has been obtained by using a Force Balance fitting strategy including high-level quantum chemistry reference energies and selected condensed phase properties targets. The final Q-AMOEBA model is shown to accurately reproduce both gas phase and condensed phase properties, notably improving the original AMOEBA water model. This development allows the fine study of NQEs on water liquid phase properties such as the average H-O-H angle compared to its gas phase equilibrium value, isotope effects etc... Q-AMOEBA also provides improved infrared spectroscopy prediction capabilities compared to AMOEBA03. Overall, we show that the impact of NQEs depends on the underlying model functional form and on the associated strength of hydrogen bonds. Since adQTB simulations can be performed at near classical computational cost using the Tinker-HP package, Q-AMOEBA can be extended to organic molecules, proteins and nucleic acids opening the possibility for the large scale study of the importance of NQEs in biophysics.


title: Kinematic Variables and Feature Engineering for Particle Phenomenology

abstract: Kinematic variables have been playing an important role in collider phenomenology, as they expedite discoveries of new particles by separating signal events from unwanted background events and allow for measurements of particle properties such as masses, couplings, spins, etc. For the past 10 years, an enormous number of kinematic variables have been designed and proposed, primarily for the experiments at the Large Hadron Collider, allowing for a drastic reduction of high-dimensional experimental data to lower-dimensional observables, from which one can readily extract underlying features of phase space and develop better-optimized data-analysis strategies. We review these recent developments in the area of phase space kinematics, summarizing the new kinematic variables with important phenomenological implications and physics applications. We also review recently proposed analysis methods and techniques specifically designed to leverage the new kinematic variables. As machine learning is nowadays percolating through many fields of particle physics including collider phenomenology, we discuss the interconnection and mutual complementarity of kinematic variables and machine learning techniques. We finally discuss how the utilization of kinematic variables originally developed for colliders can be extended to other high-energy physics experiments including neutrino experiments.


title: Quantum electron transport controlled by cavity vacuum fields

abstract: We explore theoretically how the coupling to cavity vacuum fields affects the electron transport in quantum conductors due to the counter-rotating-wave terms of light-matter interaction. We determine the quantum conductance in terms of the transmission coefficients predicted by an effective electron Hamiltonian. The coupling between bare electronic states is mediated by virtual processes involving intermediate states with one electron (or one hole) on top of the Fermi sea and one virtual cavity photon. We study the behavior of the quantum conductance in the presence of artificial or disordered single-particle potentials, as well as a spatially varying cavity mode. As illustrative examples, we apply our theory to 1D conductors and to disordered 2D quantum Hall systems. We show how the cavity vacuum fields can lead to both large enhancement or suppression of electron conductance in the ballistic regime, as well as modification of the conductance quantization and fluctuations.


title: Interpretable Hidden Markov Model-Based Deep Reinforcement Learning Hierarchical Framework for Predictive Maintenance of Turbofan Engines

abstract: An open research question in deep reinforcement learning is how to focus the policy learning of key decisions within a sparse domain. This paper emphasizes combining the advantages of inputoutput hidden Markov models and reinforcement learning towards interpretable maintenance decisions. We propose a novel hierarchical-modeling methodology that, at a high level, detects and interprets the root cause of a failure as well as the health degradation of the turbofan engine, while, at a low level, it provides the optimal replacement policy. It outperforms the baseline performance of deep reinforcement learning methods applied directly to the raw data or when using a hidden Markov model without such a specialized hierarchy. It also provides comparable performance to prior work, however, with the additional benefit of interpretability.


title: ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registration

abstract: Establishing voxelwise semantic correspondence across distinct imaging modalities is a foundational yet formidable computer vision task. Current multi-modality registration techniques maximize hand-crafted inter-domain similarity functions, are limited in modeling nonlinear intensity-relationships and deformations, and may require significant re-engineering or underperform on new tasks, datasets, and domain pairs. This work presents ContraReg, an unsupervised contrastive representation learning approach to multi-modality deformable registration. By projecting learned multi-scale local patch features onto a jointly learned inter-domain embedding space, ContraReg obtains representations useful for non-rigid multi-modality alignment. Experimentally, ContraReg achieves accurate and robust results with smooth and invertible deformations across a series of baselines and ablations on a neonatal T1-T2 brain MRI registration task with all methods validated over a wide range of deformation regularization strengths.


title: Comparing informativeness of an NLG chatbot vs graphical app in diet-information domain

abstract: Visual representation of data like charts and tables can be challenging to understand for readers. Previous work showed that combining visualisations with text can improve the communication of insights in static contexts, but little is known about interactive ones. In this work we present an NLG chatbot that processes natural language queries and provides insights through a combination of charts and text. We apply it to nutrition, a domain communication quality is critical. Through crowd-sourced evaluation we compare the informativeness of our chatbot against traditional, static diet-apps. We find that the conversational context significantly improved users' understanding of dietary data in various tasks, and that users considered the chatbot as more useful and quick to use than traditional apps.


title: Eigenvalue spectra and stability of directed complex networks

abstract: Quantifying the eigenvalue spectra of large random matrices allows one to understand the factors that contribute to the stability of dynamical systems with many interacting components. This work explores the effect that the interaction network between components has on the eigenvalue spectrum. We build upon previous results, which usually only take into account the mean degree of the network, by allowing for non-trivial network degree heterogeneity. We derive closed-form expressions for the eigenvalue spectrum of the adjacency matrix of a general weighted and directed network. Using these results, which are valid for any large well-connected complex network, we then derive compact formulae for the corrections (due to non-zero network heterogeneity) to well-known results in random matrix theory. Specifically, we derive modified versions of the Wigner semi-circle law, the Girko circle law and the elliptic law and any outlier eigenvalues. We also derive a surprisingly neat analytical expression for the eigenvalue density of an directed Barabasi-Albert network. We are thus able to make general deductions about the effect of network heterogeneity on the stability of complex dynamic systems.


title: A Generalized Probabilistic Monitoring Model with Both Random and Sequential Data

abstract: Many multivariate statistical analysis methods and their corresponding probabilistic counterparts have been adopted to develop process monitoring models in recent decades. However, the insightful connections between them have rarely been studied. In this study, a generalized probabilistic monitoring model (GPMM) is developed with both random and sequential data. Since GPMM can be reduced to various probabilistic linear models under specific restrictions, it is adopted to analyze the connections between different monitoring methods. Using expectation maximization (EM) algorithm, the parameters of GPMM are estimated for both random and sequential cases. Based on the obtained model parameters, statistics are designed for monitoring different aspects of the process system. Besides, the distributions of these statistics are rigorously derived and proved, so that the control limits can be calculated accordingly. After that, contribution analysis methods are presented for identifying faulty variables once the process anomalies are detected. Finally, the equivalence between monitoring models based on classical multivariate methods and their corresponding probabilistic graphic models is further investigated. The conclusions of this study are verified using a numerical example and the Tennessee Eastman (TE) process. Experimental results illustrate that the proposed monitoring statistics are subject to their corresponding distributions, and they are equivalent to statistics in classical deterministic models under specific restrictions.


title: Quantitative and realistic description of the magnetic potential energy of spin-torque vortex oscillators

abstract: Understanding the dynamics of magnetic vortices has emerged as an important challenge regarding the recent development of spin-torque vortex oscillators. Either micromagnetic simulations or the analytical Thiele equation approach are typically used to study such systems theoretically. This work focuses on the precise description of the restoring forces exerted on the vortex when it is displaced from equilibrium. In particular, the stiffness parameters related to a modification of the magnetic potential energy terms are investigated. A method is proposed to extract exchange, magnetostatic and Zeeman stiffness expressions from micromagnetic simulations. These expressions are then compared to state-of-the-art analytical derivations. Furthermore, it is shown that the stiffness parameters depend not only on the vortex core position but also on the injected current density. This phenomenon is not predicted by commonly used analytical ans\"atze. We show that these findings result from a deformation of the theoretical magnetic texture caused by the current induced Amp\`ere-Oersted field.


title: On the Kinetic Theory of Subauroral Arcs

abstract: We report on numerical and theoretical investigation of subauroral arcs within strong subauroral ion drifts (SAID)--STEVE and Picket Fence. Their explanation requires the specific suprathermal electron distribution and excitation of vibrational and electronic states of neutral species. We show that the ionospheric feedback in the strong SAID with low-density troughs with or without a so-called ionospheric valley generates intense, small-scale field-aligned currents and electric fields below the F2 peak. With these fields, we solved the Boltzmann kinetic equation for the distribution of electrons and power for excitation and ionization of neutral gas (the energy balance). The obtained suprathermal electron population and energy balance are just what is necessary for Picket Fence. Concerning STEVE, the kinetic theory predictions are in a good qualitative agreement with its basic features. Besides, the theory predicts that subauroral arcs might have the transient phase with typical aurora-like emissions that fade out afterwards.


title: Suppression of electrical breakdown phenomena in liquid TriMethyl Bismuth based ionization detectors

abstract: Organometallic liquids provide good properties for ionization detectors. TriMethyl Bismuth (TMBi) has been proposed as a detector medium with charge and Cherenkov photon readout for Positron Emission Tomography. In this work, we present studies for the handling of TMBi at different electric fields and under different environmental conditions to find applicable configurations for the suppression of electrical breakdowns in TMBi at room temperature. A simple glass cell with two electrodes filled with TMBi was constructed and tested under different operation conditions. Working at the vapour pressure of TMBi at room temperature of about 40 mbar and electric fields of up to 20 kV/cm in presence of a small oxygen contamination we found the formation of a discharge channel in the liquid and a steady increase in the current. Further reduction of pressure by pumping caused the TMBi to boil and a spontaneous combustion. Eliminating the oxygen contamination led the TMBi under the same condition to only decompose. When operating the setup under an argon atmosphere of 1 bar we did not observe breakdowns of the electrical potential up to field strengths of 20 kV/cm. Still, in presence of a small oxygen contamination fluctuating currents in the nA range were observed, but no decomposition or combustion. We conclude from our experiments that TMBi at room temperature in a pure argon atmosphere of 1 bar remains stable against electrical breakdown at least up to electric field strengths of 20 kV/cm, presumably because the formation of gaseous TMBi was prevented.


title: EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control System

abstract: Emergency vehicles (EMVs) play a crucial role in responding to time-critical calls such as medical emergencies and fire outbreaks in urban areas. Existing methods for EMV dispatch typically optimize routes based on historical traffic-flow data and design traffic signal pre-emption accordingly; however, we still lack a systematic methodology to address the coupling between EMV routing and traffic signal control. In this paper, we propose EMVLight, a decentralized reinforcement learning (RL) framework for joint dynamic EMV routing and traffic signal pre-emption. We adopt the multi-agent advantage actor-critic method with policy sharing and spatial discounted factor. This framework addresses the coupling between EMV navigation and traffic signal control via an innovative design of multi-class RL agents and a novel pressure-based reward function. The proposed methodology enables EMVLight to learn network-level cooperative traffic signal phasing strategies that not only reduce EMV travel time but also shortens the travel time of non-EMVs. Simulation-based experiments indicate that EMVLight enables up to a $42.6\%$ reduction in EMV travel time as well as an $23.5\%$ shorter average travel time compared with existing approaches.


title: Solenoidal turbulent modes and star formation efficiency in Galactic-plane molecular clouds

abstract: It is speculated that the high star-formation efficiency observed in spiral-arm molecular clouds is linked to the prevalence of compressive (curl-free) turbulent modes, while the shear-driven solenoidal (divergence-free) modes appear to be the main cause of the low star-formation efficiency that characterises clouds in the Central Molecular Zone. Similarly, analysis of the Orion B molecular cloud has confirmed that, although turbulent modes vary locally and at different scales within the cloud, the dominant solenoidal turbulence is compatible with its low star formation rate. This evidence points to inter-and intra-cloud fluctuations of the solenoidal modes being an agent for the variability of star formation efficiency. We present a quantitative estimation of the relative fractions of momentum density in the solenoidal modes of turbulence in a large sample of plane molecular clouds in the \ce{^{13}CO}/\ce{C^{18}O} ($J=3\rightarrow 2$) Heterodyne Inner Milky Way Plane Survey (CHIMPS). We find a negative correlation between the solenoidal fraction and star-formation efficiency. This feature is consistent with the hypothesis that solenoidal modes prevent or slow down the collapse of dense cores. In addition, the relative power in the solenoidal modes of turbulence (solenoidal fraction) appears to be higher in the Inner Galaxy declining with a shallow gradient with increasing Galactocentric distance. Outside the Inner Galaxy, the slowly, monotonically declining values suggest that the solenoidal fraction is unaffected by the spiral arms.


title: CopyCat2: A Single Model for Multi-Speaker TTS and Many-to-Many Fine-Grained Prosody Transfer

abstract: In this paper, we present CopyCat2 (CC2), a novel model capable of: a) synthesizing speech with different speaker identities, b) generating speech with expressive and contextually appropriate prosody, and c) transferring prosody at fine-grained level between any pair of seen speakers. We do this by activating distinct parts of the network for different tasks. We train our model using a novel approach to two-stage training. In Stage I, the model learns speaker-independent word-level prosody representations from speech which it uses for many-to-many fine-grained prosody transfer. In Stage II, we learn to predict these prosody representations using the contextual information available in text, thereby, enabling multi-speaker TTS with contextually appropriate prosody. We compare CC2 to two strong baselines, one in TTS with contextually appropriate prosody, and one in fine-grained prosody transfer. CC2 reduces the gap in naturalness between our baseline and copy-synthesised speech by $22.79\%$. In fine-grained prosody transfer evaluations, it obtains a relative improvement of $33.15\%$ in target speaker similarity.


title: Zenix: Efficient Execution of Bulky Serverless Applications

abstract: Serverless computing, commonly offered as Function-as-a-Service, was initially designed for small, lean applications. However, there has been an increasing desire to run larger, more complex applications (what we call bulky applications) in a serverless manner. Existing strategies for enabling such applications are to either increase function sizes or to rewrite applications as DAGs of functions. These approaches cause significant resource wastage, manual efforts, and/or performance overhead. We argue that the root cause of these issues is today's function-centric serverless model, where a function is the resource allocation and scaling unit. We propose a new, resource-centric serverless-computing model for executing bulky applications in a resource- and performance-efficient way, and we build the Zenix serverless platform following this model. Our results show that Zenix reduces resource consumption by up to 90% compared to today's function-centric serverless systems, while improving performance by up to 64%.


title: Accurate solutions to time dependent transport problems with a moving mesh and exact uncollided source treatment

abstract: For the purpose of finding benchmark quality solutions to time dependent Sn transport problems, we develop a numerical method in a Discontinuous Galerkin (DG) framework that utilizes time dependent cell edges, which we call a moving mesh, and an uncollided source treatment. The DG method for discretizing space is a powerful solution technique on smooth problems and is robust on non-smooth problems. In order to realize the potential of the DG method to spectrally resolve smooth problems, our moving mesh and uncollided source treatment is devised to circumvent discontinuities in the solution or the first derivative of the solutions that are admitted in transport calculations. The resulting method achieves spectral convergence on smooth problems, like a standard DG implementation. When applied to problems with nonsmooth sources that induce discontinuities, our moving mesh, uncollided source method returns a significantly more accurate solution than the standard DG method. On problems with smooth sources, we observe spectral convergence even in problems with wave fronts. In problems where the angular flux is inherently non-smooth, as in Ganapol's (2001) well known plane pulse benchmark, we do not observe an elevated order of accuracy when compared with static meshes, but there is a reduction in error that is nearly three orders of magnitude.


title: Pen and Paper Exercises in Machine Learning

abstract: This is a collection of (mostly) pen-and-paper exercises in machine learning. The exercises are on the following topics: linear algebra, optimisation, directed graphical models, undirected graphical models, expressive power of graphical models, factor graphs and message passing, inference for hidden Markov models, model-based learning (including ICA and unnormalised models), sampling and Monte-Carlo integration, and variational inference.


title: Investigation of $^{11}$B and $^{40}$Ca levels at 8-9 MeV by Nuclear Resonance Fluorescence

abstract: We report on the measurement of $^{11}$B and $^{40}$Ca levels between excitation energies of 8 and 9 MeV using nuclear resonance fluorescence (NRF). The experiment was carried out with nearly-monoenergetic and linearly polarized photon beams provided by the High-Intensity $\gamma$-ray Source (HI$\gamma$S) facility at the Triangle Universities Nuclear Laboratory (TUNL). States in $^{11}$B are important for calibrations of NRF measurements, while the properties of $^{40}$Ca levels impact potassium nucleosynthesis in globular clusters. For $^{40}$Ca, we report on improved excitation energies and an unambiguous $2^-$ assignment for the state at 8425 keV. For $^{11}$B, we obtained improved values for $\gamma$-ray multipolarity mixing ratios and branching ratios of the 8920 keV level.


title: Distinguishing Learning Rules with Brain Machine Interfaces

abstract: Despite extensive theoretical work on biologically plausible learning rules, clear evidence about whether and how such rules are implemented in the brain has been difficult to obtain. We consider biologically plausible supervised- and reinforcement-learning rules and ask whether changes in network activity during learning can be used to determine which learning rule is being used. Supervised learning requires a credit-assignment model estimating the mapping from neural activity to behavior, and, in a biological organism, this model will inevitably be an imperfect approximation of the ideal mapping, leading to a bias in the direction of the weight updates relative to the true gradient. Reinforcement learning, on the other hand, requires no credit-assignment model and tends to make weight updates following the true gradient direction. We derive a metric to distinguish between learning rules by observing changes in the network activity during learning, given that the mapping from brain to behavior is known by the experimenter. Because brain-machine interface (BMI) experiments allow for precise knowledge of this mapping, we model a cursor-control BMI task using recurrent neural networks, showing that learning rules can be distinguished in simulated experiments using only observations that a neuroscience experimenter would plausibly have access to.


title: Neutrino Properties and Interactions

abstract: In this chapter we present basic concepts of neutrino physics. We start with a brief introduction to the standard model electroweak sector, followed by calculations of some relevant neutrino interaction cross sections. We obtain the oscillation formalism from the Dirac equation, alongside with a self-contained derivation of matter effects from the standard model electroweak lagrangian. Some key features of neutrino oscillation phenomenology are discussed as well. We then review the most precise oscillation measurements and finalize with some broad discussion of the current open questions in neutrino physics.


title: The degree of nonminimality is at most two

abstract: It is shown that if $p$ is a complete type of Lascar rank at least 2 over $A$, in the theory of differentially closed fields of characteristic zero, then there exists a pair of realisations, $a_1$ and $a_2$, such that $p$ has a nonalgebraic forking extension over $A,a_1,a_2$. Moreover, if $A$ is contained in the field of constants then $p$ already has a nonalgebraic forking extension over $A,a_1$. The results are also formulated in a more general setting.


title: Causality constraints on nonlinear supersymmetry

abstract: It is well-known that gravitino propagation in standard supergravities is free of any causality problems. However, two issues related to gravitino propagation were recently uncovered in specific supergravities with nonlinear supersymmetry. One of them concerns potential acausality/superluminality, whereas the second one arises from the vanishing of the sound speed at specific points during inflation. The former is famously related to positivity constraints on specific EFT operators, derived from dispersion relations on the energy-growing part of scattering amplitudes, and indeed we show that subluminality constraints for the gravitino are related via the equivalence theorem to positivity bounds in low-energy goldstino actions. However, the former are stronger, in the sense that they apply to functions of the scalar fields not only in the ground state, but for any field values such as those scanned by time-dependent solutions, unlike bounds derived from $2\to 2$ scattering amplitudes in the vacuum. We also argue that nontrivial causality constraints arise only in the case where nonlinear supersymmetry in the matter sector is encoded into superfield constraints which do not seem to arise from microscopic two-derivative lagrangians, in particular for the orthogonal constraint used to build minimal models of inflation in supergravity. This allows us to propose simple alternatives which maintain the minimality of the spectra and are causal in all points of the theory parameter space. We also discuss minimal supergravity models of inflation along these lines.


abstract: Learning dynamics models accurately is an important goal for Model-Based Reinforcement Learning (MBRL), but most MBRL methods learn a dense dynamics model which is vulnerable to spurious correlations and therefore generalizes poorly to unseen states. In this paper, we introduce Causal Dynamics Learning for Task-Independent State Abstraction (CDL), which first learns a theoretically proved causal dynamics model that removes unnecessary dependencies between state variables and the action, thus generalizing well to unseen states. A state abstraction can then be derived from the learned dynamics, which not only improves sample efficiency but also applies to a wider range of tasks than existing state abstraction methods. Evaluated on two simulated environments and downstream tasks, both the dynamics model and policies learned by the proposed method generalize well to unseen states and the derived state abstraction improves sample efficiency compared to learning without it.