title: SplitMixer: Fat Trimmed From MLP-like Models

abstract: We present SplitMixer, a simple and lightweight isotropic MLP-like architecture, for visual recognition. It contains two types of interleaving convolutional operations to mix information across spatial locations (spatial mixing) and channels (channel mixing). The first one includes sequentially applying two depthwise 1D kernels, instead of a 2D kernel, to mix spatial information. The second one is splitting the channels into overlapping or non-overlapping segments, with or without shared parameters, and applying our proposed channel mixing approaches or 3D convolution to mix channel information. Depending on design choices, a number of SplitMixer variants can be constructed to balance accuracy, the number of parameters, and speed. We show, both theoretically and experimentally, that SplitMixer performs on par with the state-of-the-art MLP-like models while having a significantly lower number of parameters and FLOPS. For example, without strong data augmentation and optimization, SplitMixer achieves around 94% accuracy on CIFAR-10 with only 0.28M parameters, while ConvMixer achieves the same accuracy with about 0.6M parameters. The well-known MLP-Mixer achieves 85.45% with 17.1M parameters. On CIFAR-100 dataset, SplitMixer achieves around 73% accuracy, on par with ConvMixer, but with about 52% fewer parameters and FLOPS. We hope that our results spark further research towards finding more efficient vision architectures and facilitate the development of MLP-like models. Code is available at https://github.com/aliborji/splitmixer.


title: SGBANet: Semantic GAN and Balanced Attention Network for Arbitrarily Oriented Scene Text Recognition

abstract: Scene text recognition is a challenging task due to the complex backgrounds and diverse variations of text instances. In this paper, we propose a novel Semantic GAN and Balanced Attention Network (SGBANet) to recognize the texts in scene images. The proposed method first generates the simple semantic feature using Semantic GAN and then recognizes the scene text with the Balanced Attention Module. The Semantic GAN aims to align the semantic feature distribution between the support domain and target domain. Different from the conventional image-to-image translation methods that perform at the image level, the Semantic GAN performs the generation and discrimination on the semantic level with the Semantic Generator Module (SGM) and Semantic Discriminator Module (SDM). For target images (scene text images), the Semantic Generator Module generates simple semantic features that share the same feature distribution with support images (clear text images). The Semantic Discriminator Module is used to distinguish the semantic features between the support domain and target domain. In addition, a Balanced Attention Module is designed to alleviate the problem of attention drift. The Balanced Attention Module first learns a balancing parameter based on the visual glimpse vector and semantic glimpse vector, and then performs the balancing operation for obtaining a balanced glimpse vector. Experiments on six benchmarks, including regular datasets, i.e., IIIT5K, SVT, ICDAR2013, and irregular datasets, i.e., ICDAR2015, SVTP, CUTE80, validate the effectiveness of our proposed method.


title: Injecting 3D Perception of Controllable NeRF-GAN into StyleGAN for Editable Portrait Image Synthesis

abstract: Over the years, 2D GANs have achieved great successes in photorealistic portrait generation. However, they lack 3D understanding in the generation process, thus they suffer from multi-view inconsistency problem. To alleviate the issue, many 3D-aware GANs have been proposed and shown notable results, but 3D GANs struggle with editing semantic attributes. The controllability and interpretability of 3D GANs have not been much explored. In this work, we propose two solutions to overcome these weaknesses of 2D GANs and 3D-aware GANs. We first introduce a novel 3D-aware GAN, SURF-GAN, which is capable of discovering semantic attributes during training and controlling them in an unsupervised manner. After that, we inject the prior of SURF-GAN into StyleGAN to obtain a high-fidelity 3D-controllable generator. Unlike existing latent-based methods allowing implicit pose control, the proposed 3D-controllable StyleGAN enables explicit pose control over portrait generation. This distillation allows direct compatibility between 3D control and many StyleGAN-based techniques (e.g., inversion and stylization), and also brings an advantage in terms of computational resources. Our codes are available at https://github.com/jgkwak95/SURF-GAN.


title: Region Aware Video Object Segmentation with Deep Motion Modeling

abstract: Current semi-supervised video object segmentation (VOS) methods usually leverage the entire features of one frame to predict object masks and update memory. This introduces significant redundant computations. To reduce redundancy, we present a Region Aware Video Object Segmentation (RAVOS) approach that predicts regions of interest (ROIs) for efficient object segmentation and memory storage. RAVOS includes a fast object motion tracker to predict their ROIs in the next frame. For efficient segmentation, object features are extracted according to the ROIs, and an object decoder is designed for object-level segmentation. For efficient memory storage, we propose motion path memory to filter out redundant context by memorizing the features within the motion path of objects between two frames. Besides RAVOS, we also propose a large-scale dataset, dubbed OVOS, to benchmark the performance of VOS models under occlusions. Evaluation on DAVIS and YouTube-VOS benchmarks and our new OVOS dataset show that our method achieves state-of-the-art performance with significantly faster inference time, e.g., 86.1 J&F at 42 FPS on DAVIS and 84.4 J&F at 23 FPS on YouTube-VOS.


title: Beauty production in heavy-ion collisions with ALICE at the LHC

abstract: In this contribution, the final measurements of the centrality dependence of the nuclear modification factor ($R_{\rm AA}$) of non-prompt $\rm D^0$ in Pb--Pb collisions at $\sqrt{s_{\scriptscriptstyle \rm NN}}$ = 5.02 TeV will be presented. These measurements provide important constraints to the in-medium mass dependent of energy loss and hadronisation of the beauty quark. The $p_{\rm T}$-integrated non-prompt $\rm D^0$ $R_{\rm AA}$ will be presented for the first time and will be compared to the prompt $\rm D^0$ one. This comparison will shed light on possible different shadowing effects between charm and beauty quarks. In addition, the first measurements of non-prompt $\rm D_s$ production in central and semi-central Pb--Pb collisions at $\sqrt{s_{\scriptscriptstyle \rm NN}}$ = 5.02 TeV will be discussed. The non-prompt $\rm D_s$ measurements provide additional information on the production and hadronisation of $\rm B_s$ mesons. Finally, the first measurement of non-prompt D-mesons elliptic flow in Pb--Pb collisions at $\sqrt{s_{\scriptscriptstyle \rm NN}}$ = 5.02 TeV will also be discussed. This measurement can constrain the degree of thermalisation of beauty quarks in the hot and dense QCD medium.


title: Chemical abundance of LINER galaxies -- Metallicity calibrations based on SDSS-IV MaNGA

abstract: The ionizing source of Low Ionization Nuclear Emission Regions (LINERs) is uncertain. Because of this, an empirical relation to determine the chemical abundances of these objects has not been proposed. In this work, for the first time, we derived two semi-empirical calibrations based on photoionization models to estimate the oxygen abundance of LINERS as a function of the $N2$ and $O3N2$ emission-line intensity ratios. These relations were calibrated using oxygen abundance estimations obtained by comparing the observational emission-line ratios of 43 LINER galaxies (taken from the MaNGA survey) and grids of photoionization models built with the {\sc Cloudy} code assuming post-Asymptotic Giant Branch (post-AGB) stars with different temperatures. We found that the oxygen abundance of LINERs in our sample is in the $\rm 8.48 <~ 12+log(O/H) <~ 8.84$ range, with a mean value of $\rm 12+\log(O/H)=8.65$. We recommend the use of the $N2$ index to estimate the oxygen abundances of LINERs, since the calibration with this index presented a much smaller dispersion than the $O3N2$ index. In addition, the estimated metallicities are in good agreement with those derived by extrapolating the disk oxygen abundance gradients to the centre of the galaxies showing that the assumptions of the models are suitable for LINERs. We also obtained a calibration between the logarithm of the ionization parameter and the [OIII]/[OII] emission-line ratio.


title: Search for $e\to\tau$ Charged Lepton Flavor Violation at the EIC with the ECCE Detector

abstract: The recently approved Electron-Ion Collider (EIC) will provide a unique new opportunity for searches of charged lepton flavor violation (CLFV) and other new physics scenarios. In contrast to the $e \leftrightarrow \mu$ CLFV transition for which very stringent limits exist, there is still a relatively large discovery space for the $e \to \tau$ CLFV transition, potentially to be explored by the EIC. With the latest detector design of ECCE (EIC Comprehensive Chromodynamics Experiment) and projected integral luminosity of the EIC, we find the $\tau$-leptons created in the DIS process $ep\to \tau X$ are expected to be identified with high efficiency. A first ECCE simulation study, restricted to the 3-prong $\tau$-decay mode and with limited statistics for the Standard Model backgrounds, estimates that the EIC will be able to improve the current exclusion limit on $e\to \tau$ CLFV by an order of magnitude.


title: A Labelled Sequent Calculus for Public Announcement Logic

abstract: Public announcement logic(PAL) is an extension of epistemic logic (EL) with some reduction axioms. In this paper, we propose a cut-free labelled sequent calculus for PAL, which is an extension of that for EL with sequent rules adapted from the reduction axioms. This calculus admits cut and allows terminating proof search.


title: Roles of scattered and ballistic photons in imaging through scattering media: a deep learning-based study

abstract: Scattering of light in complex media scrambles optical wavefronts and breaks the principles of conventional imaging methods. For decades, researchers have endeavored to conquer the problem by inventing approaches such as adaptive optics, iterative wavefront shaping, and transmission matrix measurement. That said, imaging through/into thick scattering media remains challenging to date. With the rapid development of computing power, deep learning has been introduced and shown potentials to reconstruct target information through complex media or from rough surfaces. But it also fails once coming to optically thick media where ballistic photons become negligible. Here, instead of treating deep learning only as an image extraction method, whose best-selling advantage is to avoid complicate physical models, we exploit it as a tool to explore the underlying physical principles. By adjusting the weights of ballistic and scattered photons through a random phasemask, it is found that although deep learning can extract images from both scattered and ballistic light, the mechanisms are different: scattering may function as an encryption key and decryption from scattered light is key sensitive, while extraction from ballistic light is stable. Based on this finding, it is hypothesized and experimentally confirmed that the foundation of the generalization capability of trained neural networks for different diffusers can trace back to the contribution of ballistic photons, even though their weights of photon counting in detection are not that significant. Moreover, the study may pave an avenue for using deep learning as a probe in exploring the unknown physical principles in various fields.


title: The tight bound for the strong chromatic indices of claw-free subcubic graphs

abstract: Let $G$ be a graph and $k$ a positive integer. A strong $k$-edge-coloring of $G$ is a mapping $\phi: E(G)\to \{1,2,\dots,k\}$ such that for any two edges $e$ and $e'$ that are either adjacent to each other or adjacent to a common edge, $\phi(e)\neq \phi(e')$. The strong chromatic index of $G$, denoted as $\chi'_{s}(G)$, is the minimum integer $k$ such that $G$ has a strong $k$-edge-coloring. Lv, Li and Zhang [Graphs and Combinatorics 38 (3) (2022) 63] proved that if $G$ is a claw-free subcubic graph other than the triangular prism then $\chi_s'(G)\le 8$. In addition, they asked if the upper bound $8$ can be improved to $7$. In this paper, we answer this question in the affirmative. Our proof implies a linear-time algorithm for finding strong $7$-edge-colorings of such graphs. We also construct infinitely many claw-free subcubic graphs with their strong chromatic indices attaining the bound $7$.


title: FOCUS: Fairness via Agent-Awareness for Federated Learning on Heterogeneous Data

abstract: Federated learning (FL) allows agents to jointly train a global model without sharing their local data. However, due to the heterogeneous nature of local data, it is challenging to optimize or even define fairness of the trained global model for the agents. For instance, existing work usually considers accuracy equity as fairness for different agents in FL, which is limited, especially under the heterogeneous setting, since it is intuitively "unfair" to enforce agents with high-quality data to achieve similar accuracy to those who contribute low-quality data, which may discourage the agents from participating in FL. In this work, we propose a formal FL fairness definition, fairness via agent-awareness (FAA), which takes different contributions of heterogeneous agents into account. Under FAA, the performance of agents with high-quality data will not be sacrificed just due to the existence of large amounts of agents with low-quality data. In addition, we propose a fair FL training algorithm based on agent clustering (FOCUS) to achieve fairness in FL measured by FAA. Theoretically, we prove the convergence and optimality of FOCUS under mild conditions for linear and general convex loss functions with bounded smoothness. We also prove that FOCUS always achieves higher fairness in terms of FAA compared with standard FedAvg under both linear and general convex loss functions. Empirically, we show that on four FL datasets, including synthetic data, images, and texts, FOCUS achieves significantly higher fairness in terms of FAA while maintaining competitive prediction accuracy compared with FedAvg and state-of-the-art fair FL algorithms.


title: Triaxiality explored by an odd quasi-particle

abstract: The triaxiality of odd-mass nuclei is investigated by coupling a quasiparticle to an even-even core through the core-quasiparticle coupling model. Both soft and rigid triaxial cores are considered. The "soft core" is described by the collective model with rotation-vibrational motion, while the "rigid core" is described by the triaxial rotor model, which is a limiting case of the collective model with only rotational motion. We show that the presence of the odd quasiparticle modifies the collective quadrupole dynamics of the core to appear more "rigid".


title: Efficient inference and identifiability analysis for differential equation models with random parameters

abstract: Heterogeneity is a dominant factor in the behaviour of many biological processes. Despite this, it is common for mathematical and statistical analyses to ignore biological heterogeneity as a source of variability in experimental data. Therefore, methods for exploring the identifiability of models that explicitly incorporate heterogeneity through variability in model parameters are relatively underdeveloped. We develop a new likelihood-based framework, based on moment matching, for inference and identifiability analysis of differential equation models that capture biological heterogeneity through parameters that vary according to probability distributions. As our novel method is based on an approximate likelihood function, it is highly flexible; we demonstrate identifiability analysis using both a frequentist approach based on profile likelihood, and a Bayesian approach based on Markov-chain Monte Carlo. Through three case studies, we demonstrate our method by providing a didactic guide to inference and identifiability analysis of hyperparameters that relate to the statistical moments of model parameters from independent observed data. Our approach has a computational cost comparable to analysis of models that neglect heterogeneity, a significant improvement over many existing alternatives. We demonstrate how analysis of random parameter models can aid better understanding of the sources of heterogeneity from biological data.


title: Franck-Condon spectra of unbound and imaginary-frequency vibrations via correlation functions: a branch-cut free, numerically stable derivation

abstract: Molecular electronic spectra can be represented in the time domain as auto-correlation functions of the initial vibrational wavepacket. We present a derivation of the harmonic vibrational auto-correlation function that is valid for both real and imaginary harmonic frequencies. The derivation rests on Lie algebra techniques that map otherwise complicated exponential operator arithmetic to simpler matrix formulae. The expressions for the zero- and finite-temperature harmonic auto-correlation functions have been carefully structured both to be free of branch-cut discontinuities and to remain numerically stable with finite-precision arithmetic. Simple extensions correct the harmonic Franck-Condon approximation for the lowest-order anharmonic and Herzberg-Teller effects. Quantitative simulations are shown for several examples, including the electronic absorption spectra of F$_2$, HOCl, CH$_2$NH, and NO$_2$.


title: Human-centric Image Cropping with Partition-aware and Content-preserving Features

abstract: Image cropping aims to find visually appealing crops in an image, which is an important yet challenging task. In this paper, we consider a specific and practical application: human-centric image cropping, which focuses on the depiction of a person. To this end, we propose a human-centric image cropping method with two novel feature designs for the candidate crop: partition-aware feature and content-preserving feature. For partition-aware feature, we divide the whole image into nine partitions based on the human bounding box and treat different partitions in a candidate crop differently conditioned on the human information. For content-preserving feature, we predict a heatmap indicating the important content to be included in a good crop, and extract the geometric relation between the heatmap and a candidate crop. Extensive experiments demonstrate that our method can perform favorably against state-of-the-art image cropping methods on human-centric image cropping task. Code is available at https://github.com/bcmi/Human-Centric-Image-Cropping.


title: Different Channels to Transmit Information in a Scattering Medium

abstract: A channel should be built to transmit information from one place to another. Imaging is 2 or higher dimensional information communication. Conventionally, an imaging channel comprises a lens and free spaces of its both sides. The transfer function of each part is known; thus, the response of a conventional imaging channel is known as well. Replacing the lens with a scattering layer, the image can still be extracted from the detection plane. That is to say, the scattering medium reconstructs the channel for imaging. Aided by deep learning, we find that different from the lens there are different channels in a scattering medium, i.e., the same scattering medium can construct different channels to match different manners of source encoding. Moreover, we found that without a valid channel the convolution law for a shift-invariant system, i.e., the output is the convolution of its point spread function (PSF) and the input object, is broken, and information cannot be transmitted onto the detection plane. In other words, valid channels are essential to transmit image information through even a shift-invariant system.


title: DeltaGAN: Towards Diverse Few-shot Image Generation with Sample-Specific Delta

abstract: Learning to generate new images for a novel category based on only a few images, named as few-shot image generation, has attracted increasing research interest. Several state-of-the-art works have yielded impressive results, but the diversity is still limited. In this work, we propose a novel Delta Generative Adversarial Network (DeltaGAN), which consists of a reconstruction subnetwork and a generation subnetwork. The reconstruction subnetwork captures intra-category transformation, i.e., delta, between same-category pairs. The generation subnetwork generates sample-specific delta for an input image, which is combined with this input image to generate a new image within the same category. Besides, an adversarial delta matching loss is designed to link the above two subnetworks together. Extensive experiments on six benchmark datasets demonstrate the effectiveness of our proposed method. Our code is available at https://github.com/bcmi/DeltaGAN-Few-Shot-Image-Generation.


title: Cutoff Boltzmann equation with polynomial perturbation near Maxwellian

abstract: In this paper, we consider the cutoff Boltzmann equation near Maxwellian, we proved the global existence and uniqueness for the cutoff Boltzmann equation in polynomial weighted space for all $\gamma \in (-3, 1]$. We also proved initially polynomial decay for the large velocity in $L^2$ space will induce polynomial decay rate, while initially exponential decay will induce exponential rate for the convergence. Our proof is based on newly established inequalities for the cutoff Boltzmann equation and semigroup techniques. Moreover, by generalizing the $L_x^\infty L^1_v \cap L^\infty_{x, v}$ approach, we prove the global existence and uniqueness of a mild solution to the Boltzmann equation with bounded polynomial weighted $L^\infty_{x, v}$ norm under some small condition on the initial $L^1_x L^\infty_v$ norm and entropy so that this initial data allows large amplitude oscillations.


title: Don't Forget Me: Accurate Background Recovery for Text Removal via Modeling Local-Global Context

abstract: Text removal has attracted increasingly attention due to its various applications on privacy protection, document restoration, and text editing. It has shown significant progress with deep neural network. However, most of the existing methods often generate inconsistent results for complex background. To address this issue, we propose a Contextual-guided Text Removal Network, termed as CTRNet. CTRNet explores both low-level structure and high-level discriminative context feature as prior knowledge to guide the process of background restoration. We further propose a Local-global Content Modeling (LGCM) block with CNNs and Transformer-Encoder to capture local features and establish the long-term relationship among pixels globally. Finally, we incorporate LGCM with context guidance for feature modeling and decoding. Experiments on benchmark datasets, SCUT-EnsText and SCUT-Syn show that CTRNet significantly outperforms the existing state-of-the-art methods. Furthermore, a qualitative experiment on examination papers also demonstrates the generalization ability of our method. The codes and supplement materials are available at https://github.com/lcy0604/CTRNet.


title: Occurrence of gradual resonance in a finite-length granular chain driven by harmonic vibration

abstract: This study presents numerical simulations of the resonance of a finite-length granular chain of dissipative grains driven by a harmonically vibrated tube. Multiple gradual resonant modes, namely, non-resonance mode, partial-resonance mode, and complete-resonance mode, are identified. With a fixed vibration frequency, increased vibration acceleration leads to a one-by-one increase in the number of grains participating in resonance, which is equal to the number of grain-wall collisions in a vibration period. Compared with the characteristic time of the grain-grain and the grain-wall collisions, the time of free flight plays a dominant role in grain motion. This condition results in the occurrence of large opening gaps between the grains and independent grain-grain and gain-wall collisions. A general master equation that describes the dependence of the system energy on the length of the granular chain and the number of grain-wall collisions is established, and it is in good agreement with the simulation results. We observe a gradual step-jump increase in system energy when the vibration acceleration is continuously increased, which is dedicated to an individual energy injection. Moreover, two typical phase diagrams are discussed in the spaces of $\phi-\it{\Gamma}$ and $N-\it\Gamma$.


title: Adversary Detection and Resilient Control for Multi-Agent Systems

abstract: This paper presents an adversary detection mechanism and a resilient control framework for multi-agent systems under spatiotemporal constraints. Safety in multi-agent systems is typically addressed under the assumption that all agents collaborate to ensure the forward invariance of a desired safe set. This work analyzes agent behaviors based on certain behavior metrics, and designs a proactive adversary detection mechanism based on the notion of the critical region for the system operation. In particular, the presented detection mechanism not only identifies adversarial agents, but also ensures all-time safety for intact agents. Then, based on the analysis and detection results, a resilient QP-based controller is presented to ensure safety and liveness constraints for intact agents. Simulation results validate the efficacy of the presented theoretical contributions.


title: ProMix: Combating Label Noise via Maximizing Clean Sample Utility

abstract: Learning with Noisy Labels (LNL) has become an appealing topic, as imperfectly annotated data are relatively cheaper to obtain. Recent state-of-the-art approaches employ specific selection mechanisms to separate clean and noisy samples and then apply Semi-Supervised Learning (SSL) techniques for improved performance. However, the selection step mostly provides a medium-sized and decent-enough clean subset, which overlooks a rich set of clean samples. To fulfill this, we propose a novel LNL framework ProMix that attempts to maximize the utility of clean samples for boosted performance. Key to our method, we propose a matched high confidence selection technique that selects those examples with high confidence scores and matched predictions with given labels to dynamically expand a base clean sample set. To overcome the potential side effect of excessive clean set selection procedure, we further devise a novel SSL framework that is able to train balanced and unbiased classifiers on the separated clean and noisy samples. Extensive experiments demonstrate that ProMix significantly advances the current state-of-the-art results on multiple benchmarks with different types and levels of noise. It achieves an average improvement of 2.48\% on the CIFAR-N dataset. The code is available at https://github.com/Justherozen/ProMix


title: Feasibility of searching for the Cabibbo-favored $D^{\ast}$ ${\to}$ $\bar{K}{\pi}^{+}$, $\bar{K}^{\ast}{\pi}^{+}$, $\bar{K}{\rho}^{+}$ decays

abstract: The current knowledge on the $D^{\ast}$ mesons are still inadequate. Encouraged by the positive development prospects of high-luminosity and high-precision experiments, the Cabibbo-favored nonleptonic $D^{\ast}$ ${\to}$ $\bar{K}{\pi}^{+}$, $\bar{K}^{\ast}{\pi}^{+}$, $\bar{K}{\rho}^{+}$ weak decays are studied with the naive factorization approach. It is found that branching ratios of these processes can reach up to ${\cal O}(10^{-10})$ or more, and can be accessible at STCF, CEPC, FCC-ee and LHCb@HL-LHC experiments in the future. It might even be possible to search for the $D^{{\ast}0}$ ${\to}$ $K^{{\ast}-}{\pi}^{+}$ and $K^{-}{\rho}^{+}$ decays at the running SuperKEKB experiments.


title: Beyond single receptive field: A receptive field fusion-and-stratification network for airborne laser scanning point cloud classification

abstract: The classification of airborne laser scanning (ALS) point clouds is a critical task of remote sensing and photogrammetry fields. Although recent deep learning-based methods have achieved satisfactory performance, they have ignored the unicity of the receptive field, which makes the ALS point cloud classification remain challenging for the distinguishment of the areas with complex structures and extreme scale variations. In this article, for the objective of configuring multi-receptive field features, we propose a novel receptive field fusion-and-stratification network (RFFS-Net). With a novel dilated graph convolution (DGConv) and its extension annular dilated convolution (ADConv) as basic building blocks, the receptive field fusion process is implemented with the dilated and annular graph fusion (DAGFusion) module, which obtains multi-receptive field feature representation through capturing dilated and annular graphs with various receptive regions. The stratification of the receptive fields with point sets of different resolutions as the calculation bases is performed with Multi-level Decoders nested in RFFS-Net and driven by the multi-level receptive field aggregation loss (MRFALoss) to drive the network to learn in the direction of the supervision labels with different resolutions. With receptive field fusion-and-stratification, RFFS-Net is more adaptable to the classification of regions with complex structures and extreme scale variations in large-scale ALS point clouds. Evaluated on the ISPRS Vaihingen 3D dataset, our RFFS-Net significantly outperforms the baseline approach by 5.3% on mF1 and 5.4% on mIoU, accomplishing an overall accuracy of 82.1%, an mF1 of 71.6%, and an mIoU of 58.2%. Furthermore, experiments on the LASDU dataset and the 2019 IEEE-GRSS Data Fusion Contest dataset show that RFFS-Net achieves a new state-of-the-art classification performance.


title: Gradient-based Point Cloud Denoising with Uniformity

abstract: Point clouds captured by depth sensors are often contaminated by noises, obstructing further analysis and applications. In this paper, we emphasize the importance of point distribution uniformity to downstream tasks. We demonstrate that point clouds produced by existing gradient-based denoisers lack uniformity despite having achieved promising quantitative results. To this end, we propose GPCD++, a gradient-based denoiser with an ultra-lightweight network named UniNet to address uniformity. Compared with previous state-of-the-art methods, our approach not only generates competitive or even better denoising results, but also significantly improves uniformity which largely benefits applications such as surface reconstruction.


title: Decay rates for cubic and higher order nonlinear wave equations on asymptotically flat spacetimes

abstract: In this paper, we prove pointwise decay rates for cubic and higher order nonlinear wave equations, including quasilinear wave equations, on asymptotically flat and time-dependent spacetimes. We assume that the solution to the linear equation (rather than the nonlinear equation) satisfies a weaker form of the standard integrated local energy decay, or Morawetz, estimate. For nonlinearities with a total derivative structure, we prove better pointwise decay rates.


title: Multi-element flow-driven spectral chaos (ME-FSC) method for uncertainty quantification of dynamical systems

abstract: The flow-driven spectral chaos (FSC) is a recently developed method for tracking and quantifying uncertainties in the long-time response of stochastic dynamical systems using the spectral approach. The method uses a novel concept called 'enriched stochastic flow maps' as a means to construct an evolving finite-dimensional random function space that is both accurate and computationally efficient in time. In this paper, we present a multi-element version of the FSC method (the ME-FSC method for short) to tackle (mainly) those dynamical systems that are inherently discontinuous over the probability space. In ME-FSC, the random domain is partitioned into several elements, and then the problem is solved separately on each random element using the FSC method. Subsequently, results are aggregated to compute the probability moments of interest using the law of total probability. To demonstrate the effectiveness of the ME-FSC method in dealing with discontinuities and long-time integration of stochastic dynamical systems, four representative numerical examples are presented in this paper, including the Van-der-Pol oscillator problem and the Kraichnan-Orszag three-mode problem. Results show that the ME-FSC method is capable of solving problems that have strong nonlinear dependencies over the probability space, both reliably and at low computational cost.


title: An Evolutionary Game based Secure Clustering Protocol with Fuzzy Trust Evaluation and Outlier Detection for Wireless Sensor Networks

abstract: Trustworthy and reliable data delivery is a challenging task in Wireless Sensor Networks (WSNs) due to unique characteristics and constraints. To acquire secured data delivery and address the conflict between security and energy, in this paper we present an evolutionary game based secure clustering protocol with fuzzy trust evaluation and outlier detection for WSNs. Firstly, a fuzzy trust evaluation method is presented to transform the transmission evidences into trust values while effectively alleviating the trust uncertainty. And then, a K-Means based outlier detection scheme is proposed to further analyze plenty of trust values obtained via fuzzy trust evaluation or trust recommendation. It can discover the commonalities and differences among sensor nodes while improving the accuracy of outlier detection. Finally, we present an evolutionary game based secure clustering protocol to achieve a trade-off between security assurance and energy saving for sensor nodes when electing for the cluster heads. A sensor node which failed to be the cluster head can securely choose its own head by isolating the suspicious nodes. Simulation results verify that our secure clustering protocol can effectively defend the network against the attacks from internal selfish or compromised nodes. Correspondingly, the timely data transfer rate can be improved significantly.


title: One-vs-the-Rest Loss to Focus on Important Samples in Adversarial Training

abstract: This paper proposes a new loss function for adversarial training. Since adversarial training has difficulties, e.g., necessity of high model capacity, focusing on important data points by weighting cross-entropy loss has attracted much attention. However, they are vulnerable to sophisticated attacks, e.g., Auto-Attack. This paper experimentally reveals that the cause of their vulnerability is their small margins between logits for the true label and the other labels. Since neural networks classify the data points based on the logits, logit margins should be large enough to avoid flipping the largest logit by the attacks. Importance-aware methods do not increase logit margins of important samples but decrease those of less-important samples compared with cross-entropy loss. To increase logit margins of important samples, we propose switching one-vs-the-rest loss (SOVR), which switches from cross-entropy to one-vs-the-rest loss for important samples that have small logit margins. We prove that one-vs-the-rest loss increases logit margins two times larger than the weighted cross-entropy loss for a simple problem. We experimentally confirm that SOVR increases logit margins of important samples unlike existing methods and achieves better robustness against Auto-Attack than importance-aware methods.


title: Multi Resolution Analysis (MRA) for Approximate Self-Attention

abstract: Transformers have emerged as a preferred model for many tasks in natural langugage processing and vision. Recent efforts on training and deploying Transformers more efficiently have identified many strategies to approximate the self-attention matrix, a key module in a Transformer architecture. Effective ideas include various prespecified sparsity patterns, low-rank basis expansions and combinations thereof. In this paper, we revisit classical Multiresolution Analysis (MRA) concepts such as Wavelets, whose potential value in this setting remains underexplored thus far. We show that simple approximations based on empirical feedback and design choices informed by modern hardware and implementation challenges, eventually yield a MRA-based approach for self-attention with an excellent performance profile across most criteria of interest. We undertake an extensive set of experiments and demonstrate that this multi-resolution scheme outperforms most efficient self-attention proposals and is favorable for both short and long sequences. Code is available at \url{https://github.com/mlpen/mra-attention}.


title: Grounding Visual Representations with Texts for Domain Generalization

abstract: Reducing the representational discrepancy between source and target domains is a key component to maximize the model generalization. In this work, we advocate for leveraging natural language supervision for the domain generalization task. We introduce two modules to ground visual representations with texts containing typical reasoning of humans: (1) Visual and Textual Joint Embedder and (2) Textual Explanation Generator. The former learns the image-text joint embedding space where we can ground high-level class-discriminative information into the model. The latter leverages an explainable model and generates explanations justifying the rationale behind its decision. To the best of our knowledge, this is the first work to leverage the vision-and-language cross-modality approach for the domain generalization task. Our experiments with a newly created CUB-DG benchmark dataset demonstrate that cross-modality supervision can be successfully used to ground domain-invariant visual representations and improve the model generalization. Furthermore, in the large-scale DomainBed benchmark, our proposed method achieves state-of-the-art results and ranks 1st in average performance for five multi-domain datasets. The dataset and codes are available at https://github.com/mswzeus/GVRT.


title: Comparative Study on Supervised versus Semi-supervised Machine Learning for Anomaly Detection of In-vehicle CAN Network

abstract: As the central nerve of the intelligent vehicle control system, the in-vehicle network bus is crucial to the security of vehicle driving. One of the best standards for the in-vehicle network is the Controller Area Network (CAN bus) protocol. However, the CAN bus is designed to be vulnerable to various attacks due to its lack of security mechanisms. To enhance the security of in-vehicle networks and promote the research in this area, based upon a large scale of CAN network traffic data with the extracted valuable features, this study comprehensively compared fully-supervised machine learning with semi-supervised machine learning methods for CAN message anomaly detection. Both traditional machine learning models (including single classifier and ensemble models) and neural network based deep learning models are evaluated. Furthermore, this study proposed a deep autoencoder based semi-supervised learning method applied for CAN message anomaly detection and verified its superiority over other semi-supervised methods. Extensive experiments show that the fully-supervised methods generally outperform semi-supervised ones as they are using more information as inputs. Typically the developed XGBoost based model obtained state-of-the-art performance with the best accuracy (98.65%), precision (0.9853), and ROC AUC (0.9585) beating other methods reported in the literature.


title: Towards Accurate Open-Set Recognition via Background-Class Regularization

abstract: In open-set recognition (OSR), classifiers should be able to reject unknown-class samples while maintaining high closed-set classification accuracy. To effectively solve the OSR problem, previous studies attempted to limit latent feature space and reject data located outside the limited space via offline analyses, e.g., distance-based feature analyses, or complicated network architectures. To conduct OSR via a simple inference process (without offline analyses) in standard classifier architectures, we use distance-based classifiers instead of conventional Softmax classifiers. Afterwards, we design a background-class regularization strategy, which uses background-class data as surrogates of unknown-class ones during training phase. Specifically, we formulate a novel regularization loss suitable for distance-based classifiers, which reserves sufficiently large class-wise latent feature spaces for known classes and forces background-class samples to be located far away from the limited spaces. Through our extensive experiments, we show that the proposed method provides robust OSR results, while maintaining high closed-set classification accuracy.


title: Strain-tuning Bloch- and N\'eel-type magnetic skyrmions: a phase-field simulation

abstract: Strain manipulation of the magnetic domains, such as the stripe domains and skyrmions, has attracted considerable attention because of its potential applications for magnetic logic and memory devices. Here, utilizing phase-field modeling, we demonstrate the deterministic modulation of the orientation and the configuration of the stripe domains and skyrmions by using a uniaxial strain. The reorientation of the stripe domains can be caused by a suitable strain, and the direction of the reorientated domains is determined by the direction of the applied uniaxial strain and the type of domain walls, including Bloch- and N\'eel- types. Furthermore, by constructing a phase diagram, we discovered that when the uniaxial tensile strain increases, the ferromagnetic islands undergo a continuous phase transition from a skyrmion to multi-domains or a single domain. The competition between magnetic anisotropy energy and stray field energy leads to the continuous phase transition and the formation of domain patterns under the uniaxial tensile strain. Our research provides a theoretical foundation for the development of strain-controlled magnetic domain designs.


title: A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks

abstract: Physics-informed neural networks (PINNs) have shown to be an effective tool for solving forward and inverse problems of partial differential equations (PDEs). PINNs embed the PDEs into the loss of the neural network, and this PDE loss is evaluated at a set of scattered residual points. The distribution of these points are highly important to the performance of PINNs. However, in the existing studies on PINNs, only a few simple residual point sampling methods have mainly been used. Here, we present a comprehensive study of two categories of sampling: non-adaptive uniform sampling and adaptive nonuniform sampling. We consider six uniform sampling, including (1) equispaced uniform grid, (2) uniformly random sampling, (3) Latin hypercube sampling, (4) Halton sequence, (5) Hammersley sequence, and (6) Sobol sequence. We also consider a resampling strategy for uniform sampling. To improve the sampling efficiency and the accuracy of PINNs, we propose two new residual-based adaptive sampling methods: residual-based adaptive distribution (RAD) and residual-based adaptive refinement with distribution (RAR-D), which dynamically improve the distribution of residual points based on the PDE residuals during training. Hence, we have considered a total of 10 different sampling methods, including six non-adaptive uniform sampling, uniform sampling with resampling, two proposed adaptive sampling, and an existing adaptive sampling. We extensively tested the performance of these sampling methods for four forward problems and two inverse problems in many setups. Our numerical results presented in this study are summarized from more than 6000 simulations of PINNs. We show that the proposed adaptive sampling methods of RAD and RAR-D significantly improve the accuracy of PINNs with fewer residual points. The results obtained in this study can also be used as a practical guideline in choosing sampling methods.


title: AugRmixAT: A Data Processing and Training Method for Improving Multiple Robustness and Generalization Performance

abstract: Deep neural networks are powerful, but they also have shortcomings such as their sensitivity to adversarial examples, noise, blur, occlusion, etc. Moreover, ensuring the reliability and robustness of deep neural network models is crucial for their application in safety-critical areas. Much previous work has been proposed to improve specific robustness. However, we find that the specific robustness is often improved at the sacrifice of the additional robustness or generalization ability of the neural network model. In particular, adversarial training methods significantly hurt the generalization performance on unperturbed data when improving adversarial robustness. In this paper, we propose a new data processing and training method, called AugRmixAT, which can simultaneously improve the generalization ability and multiple robustness of neural network models. Finally, we validate the effectiveness of AugRmixAT on the CIFAR-10/100 and Tiny-ImageNet datasets. The experiments demonstrate that AugRmixAT can improve the model's generalization performance while enhancing the white-box robustness, black-box robustness, common corruption robustness, and partial occlusion robustness.


title: Evidence for electronic signature of magnetic transition in topological magnet HoSbTe

abstract: Topological insulators with intrinsic magnetic order are emerging as an exciting platform to realize fundamentally new excitations from topological quantum states of matter. To study these systems and their physics, people have proposed a variety of magnetic topological insulator systems, including HoSbTe, an antiferromagnetic weak topological insulator candidate. In this work, we use scanning tunneling microscopy to probe the electronic structure of HoSbTe with antiferromagnetic and ferromagnetic orders that are tuned by applying an external magnetic field. Although around the Fermi energy, we find minor differences between the quasi-particle interferences under the ferromagnetic and antiferromagnetic orders, deep inside the valance region, a new quasi-particle interference signal emerges with ferromagnetism. This observation is consistent with our first-principles calculations indicating the magnetism-driven transition of the electronic states in this spin-orbit coupled topological magnet.


title: Image Generation Network for Covert Transmission in Online Social Network

abstract: Online social networks have stimulated communications over the Internet more than ever, making it possible for secret message transmission over such noisy channels. In this paper, we propose a Coverless Image Steganography Network, called CIS-Net, that synthesizes a high-quality image directly conditioned on the secret message to transfer. CIS-Net is composed of four modules, namely, the Generation, Adversarial, Extraction, and Noise Module. The receiver can extract the hidden message without any loss even the images have been distorted by JPEG compression attacks. To disguise the behaviour of steganography, we collected images in the context of profile photos and stickers and train our network accordingly. As such, the generated images are more inclined to escape from malicious detection and attack. The distinctions from previous image steganography methods are majorly the robustness and losslessness against diverse attacks. Experiments over diverse public datasets have manifested the superior ability of anti-steganalysis.


title: Affective Behavior Analysis using Action Unit Relation Graph and Multi-task Cross Attention

abstract: Facial behavior analysis is a broad topic with various categories such as facial emotion recognition, age, and gender recognition. Many studies focus on individual tasks while the multi-task learning approach is still an open research issue and requires more research. In this paper, we present our solution and experiment result for the Multi-Task Learning challenge of the Affective Behavior Analysis in-the-wild competition. The challenge is a combination of three tasks: action unit detection, facial expression recognition, and valance-arousal estimation. To address this challenge, we introduce a cross-attentive module to improve multi-task learning performance. Additionally, a facial graph is applied to capture the association among action units. As a result, we achieve the evaluation measure of 128.8 on the validation data provided by the organizers, which outperforms the baseline result of 30.


title: Optimal Control of Multi-Agent Systems with Processing Delays

abstract: In this article, we consider a cooperative control problem involving a heterogeneous network of dynamically decoupled continuous-time linear plants. The (output-feedback) controllers for each plant may communicate with each other according to a fixed and known transitively closed directed graph. Each transmission incurs a fixed and known time delay. We provide an explicit closed-form expression for the optimal decentralized controller and its associated cost under these communication constraints and standard linear quadratic Gaussian (LQG) assumptions for the plants and cost function. We find the exact solution without discretizing or otherwise approximating the delays. We also present an implementation of each sub-controller that is efficiently computable, and is composed of standard finite-dimensional linear time-invariant (LTI) and finite impulse response (FIR) components, and has an intuitive observer-regulator architecture reminiscent of the classical separation principle.


title: Addressing Optimism Bias in Sequence Modeling for Reinforcement Learning

abstract: Impressive results in natural language processing (NLP) based on the Transformer neural network architecture have inspired researchers to explore viewing offline reinforcement learning (RL) as a generic sequence modeling problem. Recent works based on this paradigm have achieved state-of-the-art results in several of the mostly deterministic offline Atari and D4RL benchmarks. However, because these methods jointly model the states and actions as a single sequencing problem, they struggle to disentangle the effects of the policy and world dynamics on the return. Thus, in adversarial or stochastic environments, these methods lead to overly optimistic behavior that can be dangerous in safety-critical systems like autonomous driving. In this work, we propose a method that addresses this optimism bias by explicitly disentangling the policy and world models, which allows us at test time to search for policies that are robust to multiple possible futures in the environment. We demonstrate our method's superior performance on a variety of autonomous driving tasks in simulation.


title: Perspectives on distribution network flexible and curtailable resource activation and needs assessment

abstract: {A curtailable and flexible resource activation framework for solving distribution network (DN) voltage and thermal congestions is used to quantify three important aspects with respect to modelling low voltage networks.} This framework utilizes the network states in the absence of such flexible or curtailable resources as the input for calculating flexibility activation signal (FAS). The FAS has some similarities with optimal power flow duals {associated with power balance constraint}. FAS due to drooping design, {incentivize corrective flexibility activation} prior to any network limit violations. {The nonlinear resource dispatch optimal power flow (RDOPF) utilizes FAS for the activation of flexible and curtailable resources. Solving the OPF problem for a large system is computationally intensive, and second-order cone (SOC) relaxation is often applied in the literature.} {First,} we highlight the multi-objective nature of SOC relaxed RDOPF. A Pareto front tuning mechanism {is proposed for choosing loss penalty factor} while reducing the optimality gap of the SOC relaxed RDOPF. {Secondly, we} present a methodology for evaluating temporal and locational flexibility needs assessment of a DN, which DSO's can utilize for flexibility planning {in operational timescales and procurement in the flexibility market}. {Lastly, we} quantify the impact of reactive power flexibility for a DN with varying load power factors. {Numerical simulations indicate that the presence of reactive flexibility reduces the active power flexibility needs by 50\% for the test feeder with 0.8 aggregated load power factor.}


title: Action2Score: An Embedding Approach To Score Player Action

abstract: Multiplayer Online Battle Arena (MOBA) is one of the most successful game genres. MOBA games such as League of Legends have competitive environments where players race for their rank. In most MOBA games, a player's rank is determined by the match result (win or lose). It seems natural because of the nature of team play, but in some sense, it is unfair because the players who put a lot of effort lose their rank just in case of loss and some players even get free-ride on teammates' efforts in case of a win. To reduce the side-effects of the team-based ranking system and evaluate a player's performance impartially, we propose a novel embedding model that converts a player's actions into quantitative scores based on the actions' respective contribution to the team's victory. Our model is built using a sequence-based deep learning model with a novel loss function working on the team match. The sequence-based deep learning model process the action sequence from the game start to the end of a player in a team play using a GRU unit that takes a hidden state from the previous step and the current input selectively. The loss function is designed to help the action score to reflect the final score and the success of the team. We showed that our model can evaluate a player's individual performance fairly and analyze the contributions of the player's respective actions.


title: Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Survey

abstract: Currently, deep learning-based visual inspection has been highly successful with the help of supervised learning methods. However, in real industrial scenarios, the scarcity of defect samples, the cost of annotation, and the lack of a priori knowledge of defects may render supervised-based methods ineffective. In recent years, unsupervised anomaly localization algorithms have become more widely used in industrial inspection tasks. This paper aims to help researchers in this field by comprehensively surveying recent achievements in unsupervised anomaly localization in industrial images using deep learning. The survey reviews more than 120 significant publications covering different aspects of anomaly localization, mainly covering various concepts, challenges, taxonomies, benchmark datasets, and quantitative performance comparisons of the methods reviewed. In reviewing the achievements to date, this paper provides detailed predictions and analysis of several future research directions. This review provides detailed technical information for researchers interested in industrial anomaly localization and who wish to apply it to the localization of anomalies in other fields.


title: Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition

abstract: Noisy label Facial Expression Recognition (FER) is more challenging than traditional noisy label classification tasks due to the inter-class similarity and the annotation ambiguity. Recent works mainly tackle this problem by filtering out large-loss samples. In this paper, we explore dealing with noisy labels from a new feature-learning perspective. We find that FER models remember noisy samples by focusing on a part of the features that can be considered related to the noisy labels instead of learning from the whole features that lead to the latent truth. Inspired by that, we propose a novel Erasing Attention Consistency (EAC) method to suppress the noisy samples during the training process automatically. Specifically, we first utilize the flip semantic consistency of facial images to design an imbalanced framework. We then randomly erase input images and use flip attention consistency to prevent the model from focusing on a part of the features. EAC significantly outperforms state-of-the-art noisy label FER methods and generalizes well to other tasks with a large number of classes like CIFAR100 and Tiny-ImageNet. The code is available at https://github.com/zyh-uaiaaaa/Erasing-Attention-Consistency.


title: Diffuse-interface approach to competition between viscous flow and diffusion in pinch-off dynamics

abstract: The pinch-off dynamics of a liquid thread has been studied through numerical simulations and theoretical analysis. Occurring at small length scales, the pinch-off dynamics admits similarity solutions that can be classified into the Stokes regime and the diffusion-dominated regime, with the latter being recently experimentally observed in aqueous two-phase systems [Phys. Rev. Lett. 123, 134501 (2019)]. Derived by applying Onsager's variational principle, the Cahn-Hilliard-Navier-Stokes model is employed as a minimal model capable of describing the interfacial motion driven by not only advection but also diffusion. By analyzing the free energy dissipation mechanisms in the model, a characteristic length scale is introduced to measure the competition between diffusion and viscous flow in interfacial motion. This length scale is typically of nanometer scale for systems far from the critical point, but can approach micrometer scale for aqueous two-phase systems close to the critical point. The Cahn-Hilliard-Navier-Stokes model is solved by using an accurate and efficient spectral method in a cylindrical domain with axisymmetry. Ample numerical examples are presented to show the pinch-off processes in the Stokes regime and the diffusion-dominated regime respectively. In particular, the crossover between these two regimes is investigated numerically and analytically to reveal how the scaling behaviors of similarity solutions are to be qualitatively changed as the characteristic length scale is inevitably accessed by the pinching neck of the interface. Discussions are also provided for numerical examples that are performed for the breakup of long liquid filaments and show qualitatively different phenomena in different scaling regimes.


title: Bayesian Sparse Gaussian Mixture Model in High Dimensions

abstract: We study the sparse high-dimensional Gaussian mixture model when the number of clusters is allowed to grow with the sample size. A minimax lower bound for parameter estimation is established, and we show that a constrained maximum likelihood estimator achieves the minimax lower bound. However, this optimization-based estimator is computationally intractable because the objective function is highly nonconvex and the feasible set involves discrete structures. To address the computational challenge, we propose a Bayesian approach to estimate high-dimensional Gaussian mixtures whose cluster centers exhibit sparsity using a continuous spike-and-slab prior. Posterior inference can be efficiently computed using an easy-to-implement Gibbs sampler. We further prove that the posterior contraction rate of the proposed Bayesian method is minimax optimal. The mis-clustering rate is obtained as a by-product using tools from matrix perturbation theory. The proposed Bayesian sparse Gaussian mixture model does not require pre-specifying the number of clusters, which can be adaptively estimated via the Gibbs sampler. The validity and usefulness of the proposed method is demonstrated through simulation studies and the analysis of a real-world single-cell RNA sequencing dataset.


title: On an Edge-Preserving Variational Model for Optical Flow Estimation

abstract: It is well known that classical formulations resembling the Horn and Schunck model are still largely competitive due to the modern implementation practices. In most cases, these models outperform many modern flow estimation methods. In view of this, we propose an effective implementation design for an edge-preserving $L^1$ regularization approach to optical flow. The mathematical well-posedness of our proposed model is studied in the space of functions of bounded variations $BV(\Omega,\mathbb{R}^2)$. The implementation scheme is designed in multiple steps. The flow field is computed using the robust Chambolle-Pock primal-dual algorithm. Motivated by the recent studies of Castro and Donoho we extend the heuristic of iterated median filtering to our flow estimation. Further, to refine the flow edges we use the weighted median filter established by Li and Osher as a post-processing step. Our experiments on the Middlebury dataset show that the proposed method achieves the best average angular and end-point errors compared to some of the state-of-the-art Horn and Schunck based variational methods.


title: Frequency Permutation Subsets for Joint Radar and Communication

abstract: This paper focuses on waveform design for joint radar and communication systems and presents a new subset selection process to improve the communication error rate performance and global accuracy of radar sensing of the random stepped frequency permutation waveform. An optimal communication receiver based on integer programming is proposed to handle any subset of permutations followed by a more efficient sub-optimal receiver based on the Hungarian algorithm. Considering optimum maximum likelihood detection, the block error rate is analyzed under both additive white Gaussian noise and correlated Rician fading. We propose two methods to select a permutation subset with an improved block error rate and an efficient encoding scheme to map the information symbols to selected permutations under these subsets. From the radar perspective, the ambiguity function is analyzed with regards to the local and the global accuracy of target detection. Furthermore, a subset selection method to reduce the maximum sidelobe height is proposed by extending the properties of Costas arrays. Finally, the process of remapping the frequency tones to the symbol set used to generate permutations is introduced as a method to improve both the communication and radar performances of the selected permutation subset.


title: Human Mobility Networks Manifest Dissimilar Resilience Characteristics at Macroscopic, Substructure, and Microscopic Scales

abstract: Human mobility networks can reveal insights into resilience phenomena, such as population response to, impacts on, and recovery from crises. The majority of human mobility network resilience characterizations, however, focus mainly on macroscopic network properties; little is known about variation in measured resilience characteristics (i.e., the extent of impact and recovery duration) across macroscopic, substructure (motif), and microscopic mobility scales. To address this gap, in this study, we examine the human mobility network in eight parishes in Louisiana (USA) impacted by the 2021 Hurricane Ida. We constructed human mobility networks using location-based data and examined three sets of measures: (1) macroscopic measures, such as network density, giant component size, and modularity; (2) substructure measures, such motif distribution; and (3) microscopic mobility measures, such as the radius of gyration and average travel distance. To determine the extent of impact and duration of recovery, for each measure, we established the baseline values and examined the fluctuation of measures during the perturbation caused by Hurricane Ida. The results reveal the variation of impact extent and recovery duration obtained from different sets of measures at different scales. Macroscopic measures, such as giant components, tend to recover more quickly than substructure and microscopic measures. In fact, microscopic measures tend to recover more slowly than measures in other scales. These findings suggest that resilience characteristics in human mobility networks are scale-variant, and thus, a single measure at a particular scale may not be representative of the perturbation impacts and recovery duration in the network as a whole. These results spotlight the need to use measures at different scales to properly characterize resilience in human mobility networks.


title: Detecting Small Query Graphs in A Large Graph via Neural Subgraph Search

abstract: Recent advances have shown the success of using reinforcement learning and search to solve NP-hard graph-related tasks, such as Traveling Salesman Optimization, Graph Edit Distance computation, etc. However, it remains unclear how one can efficiently and accurately detect the occurrences of a small query graph in a large target graph, which is a core operation in graph database search, biomedical analysis, social group finding, etc. This task is called Subgraph Matching which essentially performs subgraph isomorphism check between a query graph and a large target graph. One promising approach to this classical problem is the "learning-to-search" paradigm, where a reinforcement learning (RL) agent is designed with a learned policy to guide a search algorithm to quickly find the solution without any solved instances for supervision. However, for the specific task of Subgraph Matching, though the query graph is usually small given by the user as input, the target graph is often orders-of-magnitude larger. It poses challenges to the neural network design and can lead to solution and reward sparsity. In this paper, we propose NSUBS with two innovations to tackle the challenges: (1) A novel encoder-decoder neural network architecture to dynamically compute the matching information between the query and the target graphs at each search state; (2) A novel look-ahead loss function for training the policy network. Experiments on six large real-world target graphs show that NSUBS can significantly improve the subgraph matching performance.


title: Fundamental Limits and Optimization of Multiband Sensing

abstract: Multiband sensing is a promising technology that utilizes multiple non-contiguous frequency bands to achieve high-resolution target sensing. In this paper, we investigate the fundamental limits and optimization of multiband sensing, focusing on the fundamental limits associated with time delay. We first derive a Fisher information matrix (FIM) with a compact form using the Dirichlet kernel and then derive a closed-form expression of the Cramer-Rao bound (CRB) for the delay separation in a simplified case to reveal useful insights. Then, a metric called the statistical resolution limit (SRL) that provides a resolution limit is employed to investigate the fundamental limits of delay resolution. The fundamental limits of delay estimation are also investigated based on the CRB and Ziv-Zakai bound (ZZB). Based on the above derived fundamental limits, numerical results are presented to analyze the effect of frequency band apertures and phase distortions on the performance limits of the multiband sensing systems. We formulate an optimization problem to find the optimal system configuration in multiband sensing systems with the objective of minimizing the delay SRL. To solve this non-convex constrained problem, we propose an efficient alternating optimization (AO) algorithm which iteratively optimizes the variables using successive convex approximation (SCA) and one-dimensional search. Simulation results demonstrate the effectiveness of the proposed algorithm.


title: Knowledge-enhanced Black-box Attacks for Recommendations

abstract: Recent studies have shown that deep neural networks-based recommender systems are vulnerable to adversarial attacks, where attackers can inject carefully crafted fake user profiles (i.e., a set of items that fake users have interacted with) into a target recommender system to achieve malicious purposes, such as promote or demote a set of target items. Due to the security and privacy concerns, it is more practical to perform adversarial attacks under the black-box setting, where the architecture/parameters and training data of target systems cannot be easily accessed by attackers. However, generating high-quality fake user profiles under black-box setting is rather challenging with limited resources to target systems. To address this challenge, in this work, we introduce a novel strategy by leveraging items' attribute information (i.e., items' knowledge graph), which can be publicly accessible and provide rich auxiliary knowledge to enhance the generation of fake user profiles. More specifically, we propose a knowledge graph-enhanced black-box attacking framework (KGAttack) to effectively learn attacking policies through deep reinforcement learning techniques, in which knowledge graph is seamlessly integrated into hierarchical policy networks to generate fake user profiles for performing adversarial black-box attacks. Comprehensive experiments on various real-world datasets demonstrate the effectiveness of the proposed attacking framework under the black-box setting.


title: UniFed: All-In-One Federated Learning Platform to Unify Open-Source Frameworks

abstract: Federated Learning (FL) has become a practical and widely adopted distributed learning paradigm. However, the lack of a comprehensive and standardized solution covering diverse use cases makes it challenging to use in practice. In addition, selecting an appropriate FL framework for a specific use case can be a daunting task. In this work, we present UniFed, the first unified platform for standardizing existing open-source FL frameworks. The platform streamlines the end-to-end workflow for distributed experimentation and deployment, encompassing 11 popular open-source FL frameworks. In particular, to address the substantial variations in workflows and data formats, UniFed introduces a configuration-based schema-enforced task specification, offering 20 editable fields. UniFed also provides functionalities such as distributed execution management, logging, and data analysis. With UniFed, we evaluate and compare 11 popular FL frameworks from the perspectives of functionality, privacy protection, and performance, through conducting developer surveys and code-level investigation. We collect 15 diverse FL scenario setups (e.g., horizontal and vertical settings) for FL framework evaluation. This comprehensive evaluation allows us to analyze both model and system performance, providing detailed comparisons and offering recommendations for framework selection. UniFed simplifies the process of selecting and utilizing the appropriate FL framework for specific use cases, while enabling standardized distributed experimentation and deployment. Our results and analysis based on experiments with up to 178 distributed nodes provide valuable system design and deployment insights, aiming to empower practitioners in their pursuit of effective FL solutions.


title: A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration

abstract: Generative adversarial networks (GANs) have drawn enormous attention due to the simple yet effective training mechanism and superior image generation quality. With the ability to generate photo-realistic high-resolution (e.g., $1024\times1024$) images, recent GAN models have greatly narrowed the gaps between the generated images and the real ones. Therefore, many recent works show emerging interest to take advantage of pre-trained GAN models by exploiting the well-disentangled latent space and the learned GAN priors. In this paper, we briefly review recent progress on leveraging pre-trained large-scale GAN models from three aspects, i.e., 1) the training of large-scale generative adversarial networks, 2) exploring and understanding the pre-trained GAN models, and 3) leveraging these models for subsequent tasks like image restoration and editing. More information about relevant methods and repositories can be found at https://github.com/csmliu/pretrained-GANs.


title: Nonlinear Outcome of Coagulation Instability in Protoplanetary Disks I: First Numerical Study of Accelerated Dust Growth and Dust Concentration at Outer Radii

abstract: Our previous linear analysis presents a new instability driven by dust coagulation in protoplanetary disks. The coagulation instability has the potential to concentrate dust grains into rings and assist dust coagulation and planetesimal formation. In this series of papers, we perform numerical simulations and investigate nonlinear outcome of coagulation instability. In this paper (Paper I), we first conduct local simulations to demonstrate the existence of coagulation instability. Linear growth observed in the simulations is in good agreement with the previous linear analysis. We next conduct radially global simulations to demonstrate that coagulation instability develops during the inside-out disk evolution due to dust growth. To isolate the various effects on dust concentration and growth, we neglect effects of backreaction to a gas disk and dust fragmentation in Paper I. This simplified simulation shows that either of backreaction or fragmentation is not prerequisite for local dust concentration via the instability. In most runs with weak turbulence, dust concentration via coagulation instability overcomes dust depletion due to radial drift, leading to the formation of multiple dust rings. The nonlinear development of coagulation instability also accelerates dust growth, and the dimensionless stopping time $\tau_{\mathrm{s}}$ reaches unity even at outer radii (>10 au). Therefore, coagulation instability is one promising process to retain dust grains and to accelerate dust growth beyond the drift barrier.


title: Buckyball-metal complexes as promising carriers of astronomical unidentified infrared emission bands

abstract: Infrared emission bands with wavelengths between 3-20 {\mu}m are observed in a variety of astrophysical environments [1,2]. They were discovered in the 1970s and are generally attributed to organic compounds [3,4]. However, over 40 years of research efforts still leave the source of these emission bands largely unidentified [5-7]. Here, we report the first laboratory infrared (6-25 {\mu}m) spectra of gas-phase fullerene-metal complexes, [C60-Metal]+ (Metal = Fe and V), and show with density functional theory calculations that complexes of C60 with cosmically abundant metals, including Li, Na, K, Mg, Ca, Al, V, and Fe, all have similar infrared spectral patterns. Comparison with observational infrared spectra from several fullerene-rich planetary nebulae demonstrates a strong positive linear cross-correlation. The infrared features of [C60-Metal]+ coincide with four bands attributed earlier to neutral C60 bands, and in addition also with several to date unexplained bands. Abundance and collision theory estimates furthermore indicate that [C60-Metal]+ could plausibly form and survive in astrophysical environments. Hence, [C60-Metal]+ are proposed as promising carriers, in supplement to C60, of astronomical infrared emission bands, potentially representing the largest molecular species in space other than the bare fullerenes C60, C60+, and C70. This work opens a new chapter for studying cosmic fullerene species and carbon chemistry in the Universe.

categories: astro-ph.GA astro-ph.IM physics.atm-clus physics.chem-ph


title: AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields

abstract: Novel view synthesis has recently been revolutionized by learning neural radiance fields directly from sparse observations. However, rendering images with this new paradigm is slow due to the fact that an accurate quadrature of the volume rendering equation requires a large number of samples for each ray. Previous work has mainly focused on speeding up the network evaluations that are associated with each sample point, e.g., via caching of radiance values into explicit spatial data structures, but this comes at the expense of model compactness. In this paper, we propose a novel dual-network architecture that takes an orthogonal direction by learning how to best reduce the number of required sample points. To this end, we split our network into a sampling and shading network that are jointly trained. Our training scheme employs fixed sample positions along each ray, and incrementally introduces sparsity throughout training to achieve high quality even at low sample counts. After fine-tuning with the target number of samples, the resulting compact neural representation can be rendered in real-time. Our experiments demonstrate that our approach outperforms concurrent compact neural representations in terms of quality and frame rate and performs on par with highly efficient hybrid representations. Code and supplementary material is available at https://thomasneff.github.io/adanerf.


title: A Nernst heat theorem for nonequilibrium jump processes

abstract: We discuss via general arguments and examples when and why the steady nonequilibrium heat capacity vanishes with temperature. The framework is the one of Markov jump processes on finite connected graphs where the condition of local detailed balance allows to identify the heat fluxes, and where the discreteness more easily enables sufficient nondegeneracy of the stationary distribution at absolute zero, as under equilibrium. However, for the nonequilibrium extension of the Third Law, a dynamic condition is needed as well: the low-temperature dynamical activity and accessibility of the dominant state must remain sufficiently high so that relaxation times do not start to dramatically differ between different initial states. It suffices in fact that the relaxation times do not exceed the dissipation time.


title: Semi-Supervised Learning of Optical Flow by Flow Supervisor

abstract: A training pipeline for optical flow CNNs consists of a pretraining stage on a synthetic dataset followed by a fine tuning stage on a target dataset. However, obtaining ground truth flows from a target video requires a tremendous effort. This paper proposes a practical fine tuning method to adapt a pretrained model to a target dataset without ground truth flows, which has not been explored extensively. Specifically, we propose a flow supervisor for self-supervision, which consists of parameter separation and a student output connection. This design is aimed at stable convergence and better accuracy over conventional self-supervision methods which are unstable on the fine tuning task. Experimental results show the effectiveness of our method compared to different self-supervision methods for semi-supervised learning. In addition, we achieve meaningful improvements over state-of-the-art optical flow models on Sintel and KITTI benchmarks by exploiting additional unlabeled datasets. Code is available at https://github.com/iwbn/flow-supervisor.


title: SeedFormer: Patch Seeds based Point Cloud Completion with Upsample Transformer

abstract: Point cloud completion has become increasingly popular among generation tasks of 3D point clouds, as it is a challenging yet indispensable problem to recover the complete shape of a 3D object from its partial observation. In this paper, we propose a novel SeedFormer to improve the ability of detail preservation and recovery in point cloud completion. Unlike previous methods based on a global feature vector, we introduce a new shape representation, namely Patch Seeds, which not only captures general structures from partial inputs but also preserves regional information of local patterns. Then, by integrating seed features into the generation process, we can recover faithful details for complete point clouds in a coarse-to-fine manner. Moreover, we devise an Upsample Transformer by extending the transformer structure into basic operations of point generators, which effectively incorporates spatial and semantic relationships between neighboring points. Qualitative and quantitative evaluations demonstrate that our method outperforms state-of-the-art completion networks on several benchmark datasets. Our code is available at https://github.com/hrzhou2/seedformer.


title: AutoAlignV2: Deformable Feature Aggregation for Dynamic Multi-Modal 3D Object Detection

abstract: Point clouds and RGB images are two general perceptional sources in autonomous driving. The former can provide accurate localization of objects, and the latter is denser and richer in semantic information. Recently, AutoAlign presents a learnable paradigm in combining these two modalities for 3D object detection. However, it suffers from high computational cost introduced by the global-wise attention. To solve the problem, we propose Cross-Domain DeformCAFA module in this work. It attends to sparse learnable sampling points for cross-modal relational modeling, which enhances the tolerance to calibration error and greatly speeds up the feature aggregation across different modalities. To overcome the complex GT-AUG under multi-modal settings, we design a simple yet effective cross-modal augmentation strategy on convex combination of image patches given their depth information. Moreover, by carrying out a novel image-level dropout training scheme, our model is able to infer in a dynamic manner. To this end, we propose AutoAlignV2, a faster and stronger multi-modal 3D detection framework, built on top of AutoAlign. Extensive experiments on nuScenes benchmark demonstrate the effectiveness and efficiency of AutoAlignV2. Notably, our best model reaches 72.4 NDS on nuScenes test leaderboard, achieving new state-of-the-art results among all published multi-modal 3D object detectors. Code will be available at https://github.com/zehuichen123/AutoAlignV2.


title: Ensemble Learning for Efficient VVC Bitrate Ladder Prediction

abstract: Changing the encoding parameters, in particular the video resolution, is a common practice before transcoding. To this end, streaming and broadcast platforms benefit from so-called bitrate ladders to determine the optimal resolution for given bitrates. However, the task of determining the bitrate ladder can usually be challenging as, on one hand, so-called fit-for-all static ladders would waste bandwidth, and on the other hand, fully specialized ladders are often not affordable in terms of computational complexity. In this paper, we propose an ML-based scheme for predicting the bitrate ladder based on the content of the video. The baseline of our solution predicts the bitrate ladder using two constituent methods, which require no encoding passes. To further enhance the performance of the constituent methods, we integrate a conditional ensemble method to aggregate their decisions, with a negligibly limited number of encoding passes. The experiment, carried out on the optimized software encoder implementation of the VVC standard, called VVenC, shows significant performance improvement. When compared to static bitrate ladder, the proposed method can offer about 13% bitrate reduction in terms of BD-BR with a negligible additional computational overhead. Conversely, when compared to the fully specialized bitrate ladder method, the proposed method can offer about 86% to 92% complexity reduction, at cost the of only 0.8% to 0.9% coding efficiency drop in terms of BD-BR.


title: Efficient CNN Architecture Design Guided by Visualization

abstract: Modern efficient Convolutional Neural Networks(CNNs) always use Depthwise Separable Convolutions(DSCs) and Neural Architecture Search(NAS) to reduce the number of parameters and the computational complexity. But some inherent characteristics of networks are overlooked. Inspired by visualizing feature maps and N$\times$N(N$>$1) convolution kernels, several guidelines are introduced in this paper to further improve parameter efficiency and inference speed. Based on these guidelines, our parameter-efficient CNN architecture, called \textit{VGNetG}, achieves better accuracy and lower latency than previous networks with about 30%$\thicksim$50% parameters reduction. Our VGNetG-1.0MP achieves 67.7% top-1 accuracy with 0.99M parameters and 69.2% top-1 accuracy with 1.14M parameters on ImageNet classification dataset. Furthermore, we demonstrate that edge detectors can replace learnable depthwise convolution layers to mix features by replacing the N$\times$N kernels with fixed edge detection kernels. And our VGNetF-1.5MP archives 64.4%(-3.2%) top-1 accuracy and 66.2%(-1.4%) top-1 accuracy with additional Gaussian kernels.


title: Inhomogeneous Poisson processes in the disk and interpolation

abstract: We investigate different geometrical properties of the inhomogeneous Poisson point process $\Lambda_{\mu}$ associated to a positive, locally finite, $\sigma$-finite measure $\mu$ on the unit disk. In particular, we characterize the processes $\Lambda_{\mu}$ such that almost surely: 1) $\Lambda_{\mu}$ is a Carleson-Newman sequence; 2) $\Lambda_{\mu}$ is the union of a given number M of separated sequences. We use these results to discuss the measures $\mu$ such that the associated process $\Lambda_{\mu}$ is almost surely an interpolating sequence for the Hardy, Bloch or weighted Dirichlet spaces.


title: OIMNet++: Prototypical Normalization and Localization-aware Learning for Person Search

abstract: We address the task of person search, that is, localizing and re-identifying query persons from a set of raw scene images. Recent approaches are typically built upon OIMNet, a pioneer work on person search, that learns joint person representations for performing both detection and person re-identification (reID) tasks. To obtain the representations, they extract features from pedestrian proposals, and then project them on a unit hypersphere with L2 normalization. These methods also incorporate all positive proposals, that sufficiently overlap with the ground truth, equally to learn person representations for reID. We have found that 1) the L2 normalization without considering feature distributions degenerates the discriminative power of person representations, and 2) positive proposals often also depict background clutter and person overlaps, which could encode noisy features to person representations. In this paper, we introduce OIMNet++ that addresses the aforementioned limitations. To this end, we introduce a novel normalization layer, dubbed ProtoNorm, that calibrates features from pedestrian proposals, while considering a long-tail distribution of person IDs, enabling L2 normalized person representations to be discriminative. We also propose a localization-aware feature learning scheme that encourages better-aligned proposals to contribute more in learning discriminative representations. Experimental results and analysis on standard person search benchmarks demonstrate the effectiveness of OIMNet++.


title: Stochastic rounding variance and probabilistic bounds: A new approach

abstract: Stochastic rounding (SR) offers an alternative to the deterministic IEEE-754 floating-point rounding modes. In some applications such as PDEs, ODEs and neural networks, SR empirically improves the numerical behavior and convergence to accurate solutions while no sound theoretical background has been provided. Recent works by Ipsen, Zhou, Higham, and Mary have computed SR probabilistic error bounds for basic linear algebra kernels. For example, the inner product SR probabilistic bound of the forward error is proportional to $\sqrt$ nu instead of nu for the default rounding mode. To compute the bounds, these works show that the errors accumulated in computation form a martingale. This paper proposes an alternative framework to characterize SR errors based on the computation of the variance. We pinpoint common error patterns in numerical algorithms and propose a lemma that bounds their variance. For each probability and through Bienaym{\'e}-Chebyshev inequality, this bound leads to better probabilistic error bound in several situations. Our method has the advantage of providing a tight probabilistic bound for all algorithms fitting our model. We show how the method can be applied to give SR error bounds for the inner product and Horner polynomial evaluation.


title: Husimi, Wigner, T{\"o}plitz, quantum statistics and anticanonical transformations

abstract: We study the behaviour of Husimi, Wigner and T{\"o}plitz symbols of quantum density matrices when quantum statistics are tested on them, that is when on exchange two coordinates in one of the two variables of their integral kernel. We show that to each of these actions is associated a canonical transform on the cotangent bundle of the underlying classical phase space. Equivalently can one associate a complex canonical transform on the complexification of the phase-space. In the off-diagonal T{\"o}plitz representation introduced in [P], the action considered is associated to a complex aanticanonical relation.


title: Spurious minimizers in non uniform Fourier sampling optimization

abstract: A recent trend in the signal/image processing literature is the optimization of Fourier sampling schemes for specific datasets of signals. In this paper, we explain why choosing optimal non Cartesian Fourier sampling patterns is a difficult nonconvex problem by bringing to light two optimization issues. The first one is the existence of a combinatorial number of spurious minimizers for a generic class of signals. The second one is a vanishing gradient effect for the high frequencies. We conclude the paper by showing how using large datasets can mitigate first effect and illustrate experimentally the benefits of using stochastic gradient algorithms with a variable metric.


title: Enhancing Generative Networks for Chest Anomaly Localization through Automatic Registration-Based Unpaired-to-Pseudo-Paired Training Data Translation

abstract: Image translation based on a generative adversarial network (GAN-IT) is a promising method for the precise localization of abnormal regions in chest X-ray images (AL-CXR) even without the pixel-level annotation. However, heterogeneous unpaired datasets undermine existing methods to extract key features and distinguish normal from abnormal cases, resulting in inaccurate and unstable AL-CXR. To address this problem, we propose an improved two-stage GAN-IT involving registration and data augmentation. For the first stage, we introduce an advanced deep-learning-based registration technique that virtually and reasonably converts unpaired data into paired data for learning registration maps, by sequentially utilizing linear-based global and uniform coordinate transformation and AI-based non-linear coordinate fine-tuning. This approach enables independent and complex coordinate transformation of each detailed location of the lung while recognizing the entire lung structure, thereby achieving higher registration performance with resolving inherent artifacts caused by unpaired conditions. For the second stage, we apply data augmentation to diversify anomaly locations by swapping the left and right lung regions on the uniform registered frames, further improving the performance by alleviating imbalance in data distribution showing left and right lung lesions. The proposed method is model agnostic and shows consistent AL-CXR performance improvement in representative AI models. Therefore, we believe GAN-IT for AL-CXR can be clinically implemented by using our basis framework, even if learning data are scarce or difficult for the pixel-level disease annotation.


title: Arc-consistency and linear programming duality: an analysis of reduced cost based filtering

abstract: In Constraint Programming (CP), achieving arc-consistency (AC) of a global constraint with costs consists in removing from the domains of the variables all the values that do not belong to any solution whose cost is below a fixed bound. We analyse how linear duality and reduced costs can be used to find all such inconsistent values. In particular, when the constraint has an ideal Linear Programming (LP) formulation, we show that n dual solutions are always enough to achieve AC (where n is the number of variables). This analysis leads to a simple algorithm with n calls to an LP solver to achieve AC, as opposed to the naive approach based on one call for each value of each domain. It extends the work presented in [German et al., 2017] for satisfaction problems and in [Claus et al., 2020] for the specific case of the minimum weighted alldifferent constraint. We propose some answers to the following questions: does there always exists a dual solution that can prove a value consistent/inconsistent ? given a dual solution, how do we know which values are proved consistent/inconsistent ? can we identify simple conditions for a family of dual solutions to ensure arc-consistency ?


title: On quantum complex flows

abstract: We study the propagation of quantum T{\"o}plitz observables through quantized complex linear canonical transformation of one degree of freedom systems. We associate to such a propagated observable a non local "T{\"o}plitz'' expression involving off diagonal terms. We study the link of this constrauction with the usual Weyl symbolic paradigm.


title: On the regularization and optimization in quantum detector tomography

abstract: Quantum detector tomography (QDT) is a fundamental technique for calibrating quantum devices and performing quantum engineering tasks. In this paper, we utilize regularization to improve the QDT accuracy whenever the probe states are informationally complete or informationally incomplete. In the informationally complete scenario, without regularization, we optimize the resource (probe state) distribution by converting it to a semidefinite programming problem. Then in both the informationally complete and informationally incomplete scenarios, we discuss different regularization forms and prove the mean squared error scales as $ O(\frac{1}{N}) $ or tends to a constant with $ N $ state copies under the static assumption. We also characterize the ideal best regularization for the identifiable parameters, accounting for both the informationally complete and informationally incomplete scenarios. Numerical examples demonstrate the effectiveness of different regularization forms and a quantum optical experiment test shows that a suitable regularization form can reach a reduced mean squared error.


title: Anomalous Absorption in Arrays of Metallic Nanoparticles: A Powerful Tool for Quantum Dot Optoelectronics

abstract: Periodic arrays of noble metal nanoparticles are emblematic nanostructures in photonics. Their ability to sustain localized surface plasmon resonances has been used throughout the years to demonstrate a variety of passive and active functionalities such as enhanced luminescence in dipolar media and LEDs as well as higher responsivities in photoconductive detectors. Here, we show that additional magnetic resonances, associated with inductive current loops between the nanoparticles and accessible with transverse electric waves, emerge in the limit of dense arrays with subwavelength periods. Moreover, their interplay with the plasmons of the system results in spectrally sharp analogues of electromagnetically induced absorption (EIA). We use these metasurfaces to induce changes and enhancements in the emission, absorption, photoconduction, and polarization properties of active layers of PbS nanocrystals, illustrating the potential of EIA beyond the passive functionalities demonstrated so far in literature.


title: Imaging current control of magnetization in Fe$_3$GeTe$_2$ with a widefield nitrogen-vacancy microscope

abstract: Van der Waals (vdW) magnets are appealing candidates for realising spintronic devices that exploit current control of magnetization (e.g. switching or domain wall motion), but so far experimental demonstrations have been sparse, in part because of challenges associated with imaging the magnetization in these systems. Widefield nitrogen-vacancy (NV) microscopy allows rapid, quantitative magnetic imaging across entire vdW flakes, ideal for capturing changes in the micromagnetic structure due to an electric current. Here we use a widefield NV microscope to study the effect of current injection in thin flakes ($\sim10$nm) of the vdW ferromagnet Fe$_3$GeTe$_2$ (FGT). We first observe current-reduced coercivity on an individual domain level, where current injection in FGT causes substantial reduction in the magnetic field required to locally reverse the magnetisation. We then explore the possibility of current-induced domain-wall motion, and provide preliminary evidence for such a motion under relatively low current densities, suggesting the existence of strong current-induced torques in our devices. Our results illustrate the applicability of widefield NV microscopy to imaging spintronic phenomena in vdW magnets, highlight the possibility of efficient magnetization control by direct current injection without assistance from an adjacent conductor, and motivate further investigations of the effect of currents in FGT and other vdW magnets.