title: Learning Distinct and Representative Styles for Image Captioning

abstract: Over the years, state-of-the-art (SoTA) image captioning methods have achieved promising results on some evaluation metrics (e.g., CIDEr). However, recent findings show that the captions generated by these methods tend to be biased toward the "average" caption that only captures the most general mode (a.k.a, language pattern) in the training corpus, i.e., the so-called mode collapse problem. Affected by it, the generated captions are limited in diversity and usually less informative than natural image descriptions made by humans. In this paper, we seek to avoid this problem by proposing a Discrete Mode Learning (DML) paradigm for image captioning. Our innovative idea is to explore the rich modes in the training caption corpus to learn a set of "mode embeddings", and further use them to control the mode of the generated captions for existing image captioning models. Specifically, the proposed DML optimizes a dual architecture that consists of an image-conditioned discrete variational autoencoder (CdVAE) branch and a mode-conditioned image captioning (MIC) branch. The CdVAE branch maps each image caption to one of the mode embeddings stored in a learned codebook, and is trained with a pure non-autoregressive generation objective to make the modes distinct and representative. The MIC branch can be simply modified from an existing image captioning model, where the mode embedding is added to the original word embeddings as the control signal. In the experiments, we apply the proposed DML to two widely used image captioning models, Transformer and AoANet. The results show that the learned mode embedding successfully facilitates these models to generate high-quality image captions with different modes, further leading to better performance for both diversity and quality on the MSCOCO dataset.


title: On self-similar finite-time blowups of the De Gregorio model on the real line

abstract: We show that the De Gregorio model on the real line admits infinitely many compactly supported, self-similar solutions that are distinct under rescaling and will blow up in finite time. These self-similar solutions fall into two classes: the basic class and the general class. The basic class consists of countably infinite solutions that are eigenfunctions of a self-adjoint compact operator. In particular, the leading eigenfunction coincides with the finite-time singularity solution of the De Gregorio model recently obtained by numerical approaches. The general class consists of more complicated solutions that can be obtained by solving nonlinear eigenvalue problems associated with the same compact operator.


title: Fluctuations of conserved charges in hydrodynamics and molecular dynamics

abstract: I present an overview of recent theoretical results on fluctuations of conserved charges in heavy-ion collisions obtained in relativistic hydrodynamics and molecular dynamics frameworks. In particular, I discuss the constraints on the location of the QCD critical point based on comparisons of experimental data on proton number cumulants with precision calculations of non-critical contributions. Recent developments on critical fluctuations in molecular dynamics simulations are covered as well.


title: Bayesian Image-on-Scalar Regression with a Spatial Global-Local Spike-and-Slab Prior

abstract: In this article, we propose a novel spatial global-local spike-and-slab selection prior for image-on-scalar regression. We consider a Bayesian hierarchical Gaussian process model for image smoothing, that uses a flexible Inverse-Wishart process prior to handle within-image dependency, and propose a general global-local spatial selection prior that extends a rich class of well-studied selection priors. Unlike existing constructions, we achieve simultaneous global (i.e, at covariate-level) and local (i.e., at pixel/voxel-level) selection by introducing `participation rate' parameters that measure the probability for the individual covariates to affect the observed images. This along with a hard-thresholding strategy leads to dependency between selections at the two levels, introduces extra sparsity at the local level, and allows the global selection to be informed by the local selection, all in a model-based manner. We design an efficient Gibbs sampler that allows inference for large image data. We show on simulated data that parameters are interpretable and lead to efficient selection. Finally, we demonstrate performance of the proposed model by using data from the Autism Brain Imaging Data Exchange (ABIDE) study. To the best of our knowledge, the proposed model construction is the first in the Bayesian literature to simultaneously achieve image smoothing, parameter estimation and a two-level variable selection for image-on-scalar regression.


title: Technical Report for Trend Prediction Based Intelligent UAV Trajectory Planning for Large-scale Dynamic Scenarios

abstract: The unmanned aerial vehicle (UAV)-enabled communication technology is regarded as an efficient and effective solution for some special application scenarios where existing terrestrial infrastructures are overloaded to provide reliable services. To maximize the utility of the UAV-enabled system while meeting the QoS and energy constraints, the UAV needs to plan its trajectory considering the dynamic characteristics of scenarios, which is formulated as the Markov Decision Process (MDP). To solve the above problem, a deep reinforcement learning (DRL)-based scheme is proposed here, which predicts the trend of the dynamic scenarios to provide a long-term view for the UAV trajectory planning. Simulation results validate that our proposed scheme converges more quickly and achieves the better performance in dynamic scenarios.


title: Unsupervised Lexical Substitution with Decontextualised Embeddings

abstract: We propose a new unsupervised method for lexical substitution using pre-trained language models. Compared to previous approaches that use the generative capability of language models to predict substitutes, our method retrieves substitutes based on the similarity of contextualised and decontextualised word embeddings, i.e. the average contextual representation of a word in multiple contexts. We conduct experiments in English and Italian, and show that our method substantially outperforms strong baselines and establishes a new state-of-the-art without any explicit supervision or fine-tuning. We further show that our method performs particularly well at predicting low-frequency substitutes, and also generates a diverse list of substitute candidates, reducing morphophonetic or morphosyntactic biases induced by article-noun agreement.


title: Understanding the Impact of Image Quality and Distance of Objects to Object Detection Performance

abstract: Deep learning has made great strides for object detection in images. The detection accuracy and computational cost of object detection depend on the spatial resolution of an image, which may be constrained by both the camera and storage considerations. Compression is often achieved by reducing either spatial or amplitude resolution or, at times, both, both of which have well-known effects on performance. Detection accuracy also depends on the distance of the object of interest from the camera. Our work examines the impact of spatial and amplitude resolution, as well as object distance, on object detection accuracy and computational cost. We develop a resolution-adaptive variant of YOLOv5 (RA-YOLO), which varies the number of scales in the feature pyramid and detection head based on the spatial resolution of the input image. To train and evaluate this new method, we created a dataset of images with diverse spatial and amplitude resolutions by combining images from the TJU and Eurocity datasets and generating different resolutions by applying spatial resizing and compression. We first show that RA-YOLO achieves a good trade-off between detection accuracy and inference time over a large range of spatial resolutions. We then evaluate the impact of spatial and amplitude resolutions on object detection accuracy using the proposed RA-YOLO model. We demonstrate that the optimal spatial resolution that leads to the highest detection accuracy depends on the 'tolerated' image size. We further assess the impact of the distance of an object to the camera on the detection accuracy and show that higher spatial resolution enables a greater detection range. These results provide important guidelines for choosing the image spatial resolution and compression settings predicated on available bandwidth, storage, desired inference time, and/or desired detection range, in practical applications.


title: Onset Temperatures for Superconducting Fluctuations in Te-annealed FeTe$_{1-x}$Se$_x$ Single Crystals: Evidence for the BCS-BEC Crossover

abstract: Recently, the superconductors' community has witnessed an unsettled debate regarding whether iron-based superconductors, in particular FeSe and FeSe$_{1-x}$S$_x$, are in the Bardeen-Cooper-Shrieffer (BCS) - Bose-Einstein condensation (BEC) crossover regime. Nonetheless, one particular system, FeTe$_{1-x}$Se$_x$, has been less investigated in this regard owing to the screening of its intrinsic superconducting properties by the inevitable iron excess. Herein, the onset temperatures for superconducting fluctuations ($T_{scf}$) are investigated by measuring the magnetoresistance (MR) of Te-annealed, high-quality FeTe$_{1-x}$Se$_x$ ($x$ = 0.1, 0.2, 0.3, and 0.4) single crystals. The results reveal very high $T_{scf}$ values for these crystals. Particularly for $x$ = 0.4, $T_{scf}$ reaches approximately 40 K, which is 2.7 times larger than $T_c$. This indicates that the superconductivity of the FeTe$_{1-x}$Se$_x$ system is well within the BCS-BEC crossover regime.


title: Frequency-domain probe beam deflection method for measurement of thermal conductivity of materials on micron length scale

abstract: Time-domain thermoreflectance (TDTR) and frequency-domain thermoreflectance (FDTR) have been widely used for non-contact measurement of anisotropic thermal conductivity of materials with high spatial resolution. However, the requirement of high thermoreflectance coefficient restricts the choice of metal coating and laser wavelength. The accuracy of the measurement is often limited by the high sensitivity to the radii of the laser beams. We describe an alternative frequency-domain pump-probe technique based on probe beam deflection. The beam deflection is primarily caused by thermoelastic deformation of the sample surface with a magnitude determined by the thermal expansion coefficient of the bulk material to measure. We derive an analytical solution to the coupled elasticity and heat diffusion equations for periodic heating of a multilayer sample with anisotropic elastic constants, thermal conductivity, and thermal expansion coefficients. In most cases, a simplified model can reliably describe the frequency dependence of the beam deflection signal without knowledge of the elastic constants and thermal expansion coefficients of the material. The magnitude of the probe beam deflection signal is larger than the maximum magnitude achievable by thermoreflectance detection of surface temperatures if the thermal expansion coefficient is greater than 5x10^(-6) /K. The sensitivity to laser beam radii is suppressed when a larger beam offset is used. We find nearly perfect matching of the measured signal and model prediction, and measure thermal conductivities within 6% of accepted values for materials spanning the range of polymers to gold, 0.1 - 300 W/(m K).


title: Deep Plug-and-Play Prior for Hyperspectral Image Restoration

abstract: Deep-learning-based hyperspectral image (HSI) restoration methods have gained great popularity for their remarkable performance but often demand expensive network retraining whenever the specifics of task changes. In this paper, we propose to restore HSIs in a unified approach with an effective plug-and-play method, which can jointly retain the flexibility of optimization-based methods and utilize the powerful representation capability of deep neural networks. Specifically, we first develop a new deep HSI denoiser leveraging gated recurrent convolution units, short- and long-term skip connections, and an augmented noise level map to better exploit the abundant spatio-spectral information within HSIs. It, therefore, leads to the state-of-the-art performance on HSI denoising under both Gaussian and complex noise settings. Then, the proposed denoiser is inserted into the plug-and-play framework as a powerful implicit HSI prior to tackle various HSI restoration tasks. Through extensive experiments on HSI super-resolution, compressed sensing, and inpainting, we demonstrate that our approach often achieves superior performance, which is competitive with or even better than the state-of-the-art on each task, via a single model without any task-specific training.


title: Fast, Accurate and Object Boundary-Aware Surface Normal Estimation from Depth Maps

abstract: This paper proposes a fast and accurate surface normal estimation method which can be directly used on depth maps (organized point clouds). The surface normal estimation process is formulated as a closed-form expression. In order to reduce the effect of measurement noise, the averaging operation is utilized in multi-direction manner. The multi-direction normal estimation process is reformulated in the next step to be implemented efficiently. Finally, a simple yet effective method is proposed to remove erroneous normal estimation at depth discontinuities. The proposed method is compared to well-known surface normal estimation algorithms. The results show that the proposed algorithm not only outperforms the baseline algorithms in term of accuracy, but also is fast enough to be used in real-time applications.


title: Discovery of a new Local Group Dwarf Galaxy Candidate in UNIONS: Bo\"otes V

abstract: We present the discovery of Bo\"otes V, a new ultra-faint dwarf galaxy candidate. This satellite is detected as a resolved overdensity of stars during an ongoing search for new Local Group dwarf galaxy candidates in the UNIONS photometric dataset. It has a physical half-light radius of 26.9$^{+7.5}_{-5.4}$ pc, a $V$-band magnitude of $-$4.5 $\pm$ 0.4 mag, and resides at a heliocentric distance of approximately 100 kpc. We use Gaia DR3 astrometry to identify member stars, characterize the systemic proper motion, and confirm the reality of this faint stellar system. The brightest star in this system was followed up using Gemini GMOS-N long-slit spectroscopy and is measured to have a metallicity of [Fe/H] $=$ $-$2.85 $\pm$ 0.10 dex and a heliocentric radial velocity of $v_r$ = 5.1 $\pm$ 13.4 km s$^{-1}$. Bo\"otes V is larger (in terms of scale radius), more distant, and more metal-poor than the vast majority of globular clusters. It is likely that Bo\"otes V is an ultra-faint dwarf galaxy, though future spectroscopic studies will be necessary to definitively classify this object.


title: DiPietro-Hazari Kappa: A Novel Metric for Assessing Labeling Quality via Annotation

abstract: Data is a key component of modern machine learning, but statistics for assessing data label quality remain sparse in literature. Here, we introduce DiPietro-Hazari Kappa, a novel statistical metric for assessing the quality of suggested dataset labels in the context of human annotation. Rooted in the classical Fleiss's Kappa measure of inter-annotator agreement, the DiPietro-Hazari Kappa quantifies the the empirical annotator agreement differential that was attained above random chance. We offer a thorough theoretical examination of Fleiss's Kappa before turning to our derivation of DiPietro-Hazari Kappa. Finally, we conclude with a matrix formulation and set of procedural instructions for easy computational implementation.


title: MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learning

abstract: Decentralized learning has shown great promise for cooperative multi-agent reinforcement learning (MARL). However, non-stationarity remains a significant challenge in fully decentralized learning. In the paper, we tackle the non-stationarity problem in the simplest and fundamental way and propose multi-agent alternate Q-learning (MA2QL), where agents take turns updating their Q-functions by Q-learning. MA2QL is a minimalist approach to fully decentralized cooperative MARL but is theoretically grounded. We prove that when each agent guarantees $\varepsilon$-convergence at each turn, their joint policy converges to a Nash equilibrium. In practice, MA2QL only requires minimal changes to independent Q-learning (IQL). We empirically evaluate MA2QL on a variety of cooperative multi-agent tasks. Results show MA2QL consistently outperforms IQL, which verifies the effectiveness of MA2QL, despite such minimal changes.


title: How to Define the Propagation Environment Semantics and Its Application in Scatterer-Based Beam Prediction

abstract: In view of the propagation environment directly determining the channel fading, the application tasks can also be solved with the aid of the environment information. Inspired by task-oriented semantic communication and machine learning (ML) powered environment-channel mapping methods, this work aims to provide a new view of the environment from the semantic level, which defines the propagation environment semantics (PES) as a limited set of propagation environment semantic symbols (PESS) for diverse application tasks. The PESS is extracted oriented to the tasks with channel properties as a foundation. For method validation, the PES-aided beam prediction (PESaBP) is presented in non-line-of-sight (NLOS). The PESS of environment features and graphs are given for the semantic actions of channel quality evaluation and target scatterer detection of maximum power, which can obtain 0.92 and 0.9 precision, respectively, and save over 87% of time cost.


title: Quantum Computing Methods for Supply Chain Management

abstract: Quantum computing is expected to have transformative influences on many domains, but its practical deployments on industry problems are underexplored. We focus on applying quantum computing to operations management problems in industry, and in particular, supply chain management. Many problems in supply chain management involve large state and action spaces and pose computational challenges on classic computers. We develop a quantized policy iteration algorithm to solve an inventory control problem and demonstrative its effectiveness. We also discuss in-depth the hardware requirements and potential challenges on implementing this quantum algorithm in the near term. Our simulations and experiments are powered by \texttt{IBM Qiskit} and the \texttt{qBraid} system.


title: Gradient Properties of Hard Thresholding Operator

abstract: Sparse optimization receives increasing attention in many applications such as compressed sensing, variable selection in regression problems, and recently neural network compression in machine learning. For example, the problem of compressing a neural network is a bi-level, stochastic, and nonconvex problem that can be cast into a sparse optimization problem. Hence, developing efficient methods for sparse optimization plays a critical role in applications. The goal of this paper is to develop analytical techniques for general, large size sparse optimization problems using the hard thresholding operator. To this end, we study the iterative hard thresholding (IHT) algorithm, which has been extensively studied in the literature because it is scalable, fast, and easily implementable. In spite of extensive research on the IHT scheme, we develop several new techniques that not only recover many known results but also lead to new results. Specifically, we first establish a new and critical gradient descent property of the hard thresholding (HT) operator. Our gradient descent result can be related to the distance between points that are sparse. Also, our gradient descent property allows one to study the IHT when the stepsize is less than or equal to 1/L, where L>0 is the Lipschitz constant of the gradient of an objective function. Note that the existing techniques in the literature can only handle the case when the stepsize is strictly less than 1/L. By exploiting this we introduce and study HT-stable and HT-unstable stationary points and show no matter how close an initialization is to a HT-unstable stationary point (saddle point in sparse sense), the IHT sequence leaves it. Finally, we show that no matter what sparse initial point is selected, the IHT sequence converges if the function values at HT-stable stationary points are distinct.


title: PlaneSLAM: Plane-based LiDAR SLAM for Motion Planning in Structured 3D Environments

abstract: LiDAR sensors are a powerful tool for robot simultaneous localization and mapping (SLAM) in unknown environments, but the raw point clouds they produce are dense, computationally expensive to store, and unsuited for direct use by downstream autonomy tasks, such as motion planning. For integration with motion planning, it is desirable for SLAM pipelines to generate lightweight geometric map representations. Such representations are also particularly well-suited for man-made environments, which can often be viewed as a so-called "Manhattan world" built on a Cartesian grid. In this work we present a 3D LiDAR SLAM algorithm for Manhattan world environments which extracts planar features from point clouds to achieve lightweight, real-time localization and mapping. Our approach generates plane-based maps which occupy significantly less memory than their point cloud equivalents, and are suited towards fast collision checking for motion planning. By leveraging the Manhattan world assumption, we target extraction of orthogonal planes to generate maps which are more structured and organized than those of existing plane-based LiDAR SLAM approaches. We demonstrate our approach in the high-fidelity AirSim simulator and in real-world experiments with a ground rover equipped with a Velodyne LiDAR. For both cases, we are able to generate high quality maps and trajectory estimates at a rate matching the sensor rate of 10 Hz.


title: A Sharp Rate of Convergence in the Functional Central Limit Theorem with Gaussian Input

abstract: When the underlying random variables are Gaussian, the classical Central Limit Theorem (CLT) is trivial, but the functional CLT is not. The objective of the paper is to investigate the functional CLT for stationary Gaussian processes in the Wasserstein-1 metric on the space of continuous functions. Matching upper and lower bounds are established, indicating that the convergence rate is slightly faster than in the L\'{e}vy-Prokhorov metric.


title: Gaussian dynamics equation in normal product form

abstract: In this paper, we discuss the normal product form of the density operator of multimode Gaussian states, and obtain the correlation equation between the kernel matrix R of the Gaussian density operator in the normal product form and its kernel matrix G in the standard quadratic form. Further, we explore the time evolution mechanism of R and obtain the Gaussian dynamical equation under the normal product R=i(RJH-HJR). Our work is devoted to searching for another mechanism for Gaussian dynamics. By exploring the description of the normal ordered density matrix under the coherent state representation, we find that our mechanism is feasible and easy to operate.


title: Measurement of Stimulated Raman Side-Scattering Predominance in Directly Driven Experiment

abstract: Due to its particular geometry, stimulated Raman side-scattering (SRSS) drives scattered light emission at non-conventional directions, leading to scarce and complex experimental observations. Direct-irradiation campaigns at the SG-II UP facility have measured the scattered light driven by SRSS over a wide range of angles. It indicated an emission at large polar angles over a broad azimuthal range, sensitive to the plasma profile and laser polarization, resulting in a loss of about 5\% of the total laser energy. Direct comparison with back-scattering measurement has evidenced SRSS as the dominant Raman scattering process. The predominance of SRSS was confirmed by 2D particle-in-cell simulations, and its angular spread has been corroborated by ray-tracing simulations. The main implication is that a complete characterization of the SRS instability and an accurate measurement of the energy losses require the collection of the scattered light in a broad range of directions. Otherwise, spatially limited measurement could lead to an underestimation of the energetic importance of stimulated Raman scattering.


title: A non-Gaussian limit for linear eigenvalue statistics of Hankel matrices

abstract: This article focuses on linear eigenvalue statistics of Hankel matrices with independent entries. Using the convergence of moments we show that the linear eigenvalue statistics of Hankel matrices for odd degree monomials with degree greater than or equal to three does not converge in distribution to a Gaussian random variable. This result is a departure from the known results, Liu, Sun and Wang (2012), Kumar and Maurya (2022), of linear eigenvalue statistics of Hankel matrices for even degree monomial test functions, where the limits were Gaussian random variables.


title: Mitigating Both Covariate and Conditional Shift for Domain Generalization

abstract: Domain generalization (DG) aims to learn a model on several source domains, hoping that the model can generalize well to unseen target domains. The distribution shift between domains contains the covariate shift and conditional shift, both of which the model must be able to handle for better generalizability. In this paper, a novel DG method is proposed to deal with the distribution shift via Visual Alignment and Uncertainty-guided belief Ensemble (VAUE). Specifically, for the covariate shift, a visual alignment module is designed to align the distribution of image style to a common empirical Gaussian distribution so that the covariate shift can be eliminated in the visual space. For the conditional shift, we adopt an uncertainty-guided belief ensemble strategy based on the subjective logic and Dempster-Shafer theory. The conditional distribution given a test sample is estimated by the dynamic combination of that of source domains. Comprehensive experiments are conducted to demonstrate the superior performance of the proposed method on four widely used datasets, i.e., Office-Home, VLCS, TerraIncognita, and PACS.


title: Pole position of $\Lambda(1405)$ measured in $d(K^-,n)\pi\Sigma$ reactions

abstract: We measured a set of $\pi^\pm\Sigma^\mp$, $\pi^0\Sigma^0$, and $\pi^-\Sigma^0$ invariant mass spectra below and above the $\bar{K}N$ mass threshold in $K^-$-induced reactions on deuteron. We deduced the $S$-wave $\bar{K}N\rightarrow\pi\Sigma$ and $\bar{K}N\rightarrow\bar{K}N$ scattering amplitudes in the isospin 0 channel in the framework of a $\bar{K}N$ and $\pi\Sigma$ coupled channel. We find that a resonance pole corresponding to $\Lambda(1405)$ is located at 1417.7$^{+6.0}_{-7.4}$(fitting errors)$^{+1.1}_{-1.0}$(systematic errors) + $[-26.1^{+6.0}_{-7.9}$(fitting errors)$^{+1.7}_{-2.0}$(systematic errors)]$i$ MeV/$c^2$, closer to the $\bar{K}N$ mass threshold than the value determined by the Particle Data Group.


title: Linear Network Coding Based Fast Data Synchronization for Wireless Ad Hoc Networks with Controlled Topology

abstract: Fast data synchronization in wireless ad hoc networks is a challenging and critical problem. It is fundamental for efficient information fusion, control and decision in distributed systems. Previously, distributed data synchronization was mainly studied in the latency-tolerant distributed databases, or assuming the general model of wireless ad hoc networks. In this paper, we propose a pair of linear network coding (NC) and all-to-all broadcast based fast data synchronization algorithms for wireless ad hoc networks whose topology is under operator's control. We consider both data block selection and transmitting node selection for exploiting the benefits of NC. Instead of using the store-and-forward protocol as in the conventional uncoded approach, a compute-and-forward protocol is used in our scheme, which improves the transmission efficiency. The performance of the proposed algorithms is studied under different values of network size, network connection degree, and per-hop packet error rate. Simulation results demonstrate that our algorithms significantly reduce the times slots used for data synchronization compared with the baseline that does not use NC.


title: Can segmentation models be trained with fully synthetically generated data?

abstract: In order to achieve good performance and generalisability, medical image segmentation models should be trained on sizeable datasets with sufficient variability. Due to ethics and governance restrictions, and the costs associated with labelling data, scientific development is often stifled, with models trained and tested on limited data. Data augmentation is often used to artificially increase the variability in the data distribution and improve model generalisability. Recent works have explored deep generative models for image synthesis, as such an approach would enable the generation of an effectively infinite amount of varied data, addressing the generalisability and data access problems. However, many proposed solutions limit the user's control over what is generated. In this work, we propose brainSPADE, a model which combines a synthetic diffusion-based label generator with a semantic image generator. Our model can produce fully synthetic brain labels on-demand, with or without pathology of interest, and then generate a corresponding MRI image of an arbitrary guided style. Experiments show that brainSPADE synthetic data can be used to train segmentation models with performance comparable to that of models trained on real data.


title: Asymmetric Mediator in Scotogenic Model

abstract: The scotogenic model is the Standard Model (SM) with Z_2 symmetry and the addition of Z_2 odd right-handed Majorana neutrinos and SU(2)_L doublet scalar fields. We have extended the original scotogenic model by an additional Z_2 odd singlet scalar field that plays a role in dark matter. In our model, the asymmetries of the lepton and Z_2 odd doublet scalar are simultaneously produced through CP-violating right-handed neutrino decays. While the former is converted into baryon asymmetry through the sphaleron process, the latter is relaid to the DM density through the decay of SU(2)_L doublet scalar that is named "asymmetric mediator". In this way, we provide an extended scotogenic model that predicts the energy densities of baryon and dark matter being in the same order of magnitude, and also explains the low-energy neutrino masses and mixing angles.


title: A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

abstract: The real-time dynamic environment perception has become vital for autonomous robots in crowded spaces. Although the popular voxel-based mapping methods can efficiently represent 3D obstacles with arbitrarily complex shapes, they can hardly distinguish between static and dynamic obstacles, leading to the limited performance of obstacle avoidance. While plenty of sophisticated learning-based dynamic obstacle detection algorithms exist in autonomous driving, the quadcopter's limited computation resources cannot achieve real-time performance using those approaches. To address these issues, we propose a real-time dynamic obstacle tracking and mapping system for quadcopter obstacle avoidance using an RGB-D camera. The proposed system first utilizes a depth image with an occupancy voxel map to generate potential dynamic obstacle regions as proposals. With the obstacle region proposals, the Kalman filter and our continuity filter are applied to track each dynamic obstacle. Finally, the environment-aware trajectory prediction method is proposed based on the Markov chain using the states of tracked dynamic obstacles. We implemented the proposed system with our custom quadcopter and navigation planner. The simulation and physical experiments show that our methods can successfully track and represent obstacles in dynamic environments in real-time and safely avoid obstacles. Our software is available on GitHub as an open-source ROS package.


title: A $Gaia$ EDR3 search for tidal tails in disintegrating open clusters

abstract: We carry out a search for tidal tails in a sample of open clusters with known relatively elongated morphology. We identify the member stars of these clusters from the precise astrometric and deep photometric data from $Gaia$ Early Data Release 3 using the robust membership determination algorithm, ML-MOC. We identify 46 open clusters having a stellar corona beyond the tidal radius, 20 of which exhibit extended tails aligned with the cluster orbit direction in galactocentric coordinates. Notably we find NGC 6940 (at a distance of $\sim1$ kpc) is the furthest open cluster exhibiting tidal tails that are $\sim50$ pc from its center, while also identifying $\sim40$ pc long tidal tails for the nearby Pleiades. Using the minimum spanning tree length for the most massive stars relative to all cluster members, we obtain the mass segregation ratio ($\rm\lambda_{MSR}$) profiles as a function of the number of massive stars in each cluster. From these profiles, we can classify the open clusters into four classes based on the degree of mass segregation experienced by the clusters. We find that clusters in the most mass segregated classes are the oldest on average and have the flattest mass function slope. Of the 46 open clusters studied in this work, 41 exhibit some degree of mass segregation. Furthermore, we estimate the initial masses (M$\rm_{i}$) of these open clusters finding that some of them, having M$\rm_{i}\gtrsim 10^{4} M_{\odot}$, could be the dissolving remnants of Young Massive Clusters.


title: Superconducting zinc heat switch for continuous nuclear demagnetization refrigerator and sub-mK experiments

abstract: We have developed and tested a zinc superconducting heat switch suitable for magnetic refrigeration and calorimetric experiments at sub-millikevin (sub-mK) temperatures. The specific application here is an adiabatic demagnetization refrigerator with two PrNi$_{5}$ nuclear stages, which can keep a temperature of 0.8 mK continuously, (CNDR) proposed by Toda et al. (J. Phys.: Conf. Ser. 969, 012093 (2018). The switch consists of six high-purity zinc foils of 0.25 mm thick which contact seven silver foils by diffusive bonding. The silver foils are electron beam welded to silver rods that are thermal links to other components. The choice of the thin zinc foils is due to reduce the magnetic latent heat on switching and the contact thermal resistance under a constraint on the aspect ratio of the switch element. The measured thermal conductance of the whole switch assembly in the normal (closed) state, $K_\mathrm{closed}$, agrees very well down to 70 mK with the value estimated from the residual electrical resistance 114 n$\mathrm{\Omega}$ at 4.2 K, indicating the validity of the Wiedemann-Franz law for zinc. The measured thermal conductance in the superconducting (open) state, $K_\mathrm{open}$, follows nicely the prediction from the BCS theory and approaches the value expected from the Debye model for thermal phonons near 70 mK. The heat leak through the HSW from the higher temperature side of 30 mK at most is estimated to be less than 0.5 nW, which is much lower than the expected cooling power ($= 10$ nW) of the CNDR at 0.8 mK . The switching ratio $K_\mathrm{closed}/K_\mathrm{open}$ extrapolated to 30 mK, is as high as 5$\times10^4$. All the test results meet the requirements for the CNDR and, for example, heat capacity measurements at sub-mK.


title: Some stochastic comparison results for frailty and resilience models

abstract: Frailty and resilience models provide a way to introduce random effects in hazard and reversed hazard rate modeling by random variables, called frailty and resilience random variables, respectively, to account for unobserved or unexplained heterogeneity among experimental units. This paper investigates the effects of frailty and resilience random variables on the baseline random variables using some shifted stochastic orders based on some ageing properties of the baseline random variables. Relevant examples are provided to illustrate the results. Some results are illustrated with real-world data.


title: A study on the deviations in performance of FNNs and CNNs in the realm of grayscale adversarial images

abstract: Neural Networks are prone to having lesser accuracy in the classification of images with noise perturbation. Convolutional Neural Networks, CNNs are known for their unparalleled accuracy in the classification of benign images. But our study shows that they are extremely vulnerable to noise addition while Feed-forward Neural Networks, FNNs show very less correspondence with noise perturbation, maintaining their accuracy almost undisturbed. FNNs are observed to be better at classifying noise-intensive, single-channeled images that are just sheer noise to human vision. In our study, we have used the hand-written digits dataset, MNIST with the following architectures: FNNs with 1 and 2 hidden layers and CNNs with 3, 4, 6 and 8 convolutions and analyzed their accuracies. FNNs stand out to show that irrespective of the intensity of noise, they have a classification accuracy of more than 85%. In our analysis of CNNs with this data, the deceleration of classification accuracy of CNN with 8 convolutions was half of that of the rest of the CNNs. Correlation analysis and mathematical modelling of the accuracy trends act as roadmaps to these conclusions.


title: Scalable SoftGroup for 3D Instance Segmentation on Point Clouds

abstract: This paper considers a network referred to as SoftGroup for accurate and scalable 3D instance segmentation. Existing state-of-the-art methods produce hard semantic predictions followed by grouping instance segmentation results. Unfortunately, errors stemming from hard decisions propagate into the grouping, resulting in poor overlap between predicted instances and ground truth and substantial false positives. To address the abovementioned problems, SoftGroup allows each point to be associated with multiple classes to mitigate the uncertainty stemming from semantic prediction. It also suppresses false positive instances by learning to categorize them as background. Regarding scalability, the existing fast methods require computational time on the order of tens of seconds on large-scale scenes, which is unsatisfactory and far from applicable for real-time. Our finding is that the $k$-Nearest Neighbor ($k$-NN) module, which serves as the prerequisite of grouping, introduces a computational bottleneck. SoftGroup is extended to resolve this computational bottleneck, referred to as SoftGroup++. The proposed SoftGroup++ reduces time complexity with octree $k$-NN and reduces search space with class-aware pyramid scaling and late devoxelization. Experimental results on various indoor and outdoor datasets demonstrate the efficacy and generality of the proposed SoftGroup and SoftGroup++. Their performances surpass the best-performing baseline by a large margin (6\% $\sim$ 16\%) in terms of AP$_{50}$. On datasets with large-scale scenes, SoftGroup++ achieves a 6$\times$ speed boost on average compared to SoftGroup. Furthermore, SoftGroup can be extended to perform object detection and panoptic segmentation with nontrivial improvements over existing methods. The source code and trained models are available at \url{https://github.com/thangvubk/SoftGroup}.


title: Make Heterophily Graphs Better Fit GNN: A Graph Rewiring Approach

abstract: Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data. A lot of GNNs perform well on homophily graphs while having unsatisfactory performance on heterophily graphs. Recently, some researchers turn their attention to designing GNNs for heterophily graphs by adjusting the message passing mechanism or enlarging the receptive field of the message passing. Different from existing works that mitigate the issues of heterophily from model design perspective, we propose to study heterophily graphs from an orthogonal perspective by rewiring the graph structure to reduce heterophily and making the traditional GNNs perform better. Through comprehensive empirical studies and analysis, we verify the potential of the rewiring methods. To fully exploit its potential, we propose a method named Deep Heterophily Graph Rewiring (DHGR) to rewire graphs by adding homophilic edges and pruning heterophilic edges. The detailed way of rewiring is determined by comparing the similarity of label/feature-distribution of node neighbors. Besides, we design a scalable implementation for DHGR to guarantee high efficiency. DHRG can be easily used as a plug-in module, i.e., a graph pre-processing step, for any GNNs, including both GNN for homophily and heterophily, to boost their performance on the node classification task. To the best of our knowledge, it is the first work studying graph rewiring for heterophily graphs. Extensive experiments on 11 public graph datasets demonstrate the superiority of our proposed methods.


title: Report of the Topical Group on Cosmic Frontier 5 Dark Energy and Cosmic Acceleration: Cosmic Dawn and Before for Snowmass 2021

abstract: This report summarizes the envisioned research activities as gathered from the Snowmass 2021 CF5 working group concerning Dark Energy and Cosmic Acceleration: Cosmic Dawn and Before. The scientific goals are to study inflation and to search for new physics through precision measurements of relic radiation from the early universe. The envisioned research activities for this decade (2025-35) are constructing and operating major facilities and developing critical enabling capabilities. The major facilities for this decade are the CMB-S4 project, a new Stage-V spectroscopic survey facility, and existing gravitational wave observatories. Enabling capabilities include aligning and investing in theory, computation and model building, and investing in new technologies needed for early universe studies in the following decade (2035+).


title: 6DOF Pose Estimation of a 3D Rigid Object based on Edge-enhanced Point Pair Features

abstract: The point pair feature (PPF) is widely used for 6D pose estimation. In this paper, we propose an efficient 6D pose estimation method based on the PPF framework. We introduce a well-targeted down-sampling strategy that focuses more on edge area for efficient feature extraction of complex geometry. A pose hypothesis validation approach is proposed to resolve the symmetric ambiguity by calculating edge matching degree. We perform evaluations on two challenging datasets and one real-world collected dataset, demonstrating the superiority of our method on pose estimation of geometrically complex, occluded, symmetrical objects. We further validate our method by applying it to simulated punctures.


title: Evolutionary games and spatial periodicity

abstract: We establish a theoretical framework to address evolutionary dynamics of spatial games under strong selection. As the selection intensity tends to infinity, strategy competition unfolds in the deterministic way of winners taking all. We rigorously prove that the evolutionary process soon or later either enters a cycle and from then on repeats the cycle periodically, or stabilizes at some state almost everywhere. This conclusion holds for any population graph and a large class of finite games. This framework suffices to reveal the underlying mathematical rationale for the kaleidoscopic cooperation of Nowak and May's pioneering work on spatial games: highly symmetric starting configuration causes a very long transient phase covering a large number of extremely beautiful spatial patterns. For all starting configurations, spatial patterns transit definitely over generations, so cooperators and defectors persist definitely. This framework can be extended to explore games including the snowdrift game, the public goods games (with or without loner, punishment), and repeated games on graphs. Aspiration dynamics can also be fully addressed when players deterministically switch strategy for unmet aspirations by virtue of our framework. Our results have potential implications for exploring the dynamics of a large variety of spatially extended systems in biology and physics.


title: Integrable Harmonic Higgs Bundles With Vanishing $\mathcal{U}$ And Eigenvalues of $\mathcal{Q}$

abstract: We study the tt*-geometry with vanishing endormorphism $\mathcal{U}$. Given an integrable harmonic Higgs bundle $(E, h, \Phi, \mathcal{U},\mathcal{Q})$ on a complex manifold $M$, Firstly we prove that, under the \emph{IS} condition, vanishing $\mathcal{U}$ implies vanishing Higgs field $\Phi$ and the Chern connection of the Hermitian Einstein metric $h$ is a holomorphic connection, so the metric $h$ and $\mathcal{Q}$ are invariant. Secondly, without the \emph{IS} condition, we show that vanishing $\mathcal{U}$ will imply vanishing Higgs field $\Phi$ if we assume that the Chern connection of $h$ is a holomorphic connection. Finally, we add real structure $\kappa$. Given any \emph{CV}-structure, we prove that super-symmetric operator $\mathcal{Q}$ must have $0$ as an eigenvalue when the underlying bundle has odd rank.


title: B$_0$-VPG Representation of AT-free Outerplanar Graphs

abstract: A $k$-bend path is a non-self-intersecting polyline in the plane made of at most $k+1$ axis-parallel line segments. B$_k$-VPG is the class of graphs which can be represented as intersection graphs of $k$-bend paths in the same plane. In this paper, we show that all AT-free outerplanar graphs are B$_0$-VPG, i.e., intersection graphs of horizontal and vertical line segments in the plane. Our proofs are constructive and give a polynomial time B$_0$-VPG drawing algorithm for the class. Following a long line of improvements, Gon\c{c}alves, Isenmann, and Pennarun [SODA 2018] showed that all planar graphs are B$_1$-VPG. Since there are planar graphs which are not B$_0$-VPG, characterizing B$_0$-VPG graphs among planar graphs becomes interesting. Chaplick et al.\ [WG 2012] had shown that it is NP-complete to recognize B$_k$-VPG graphs within B$_{k+1}$-VPG. Hence recognizing B$_0$-VPG graphs within B$_1$-VPG is NP-complete in general, but the question is open when restricted to planar graphs. There are outerplanar graphs and AT-free planar graphs which are not B$_0$-VPG. This piqued our interest in AT-free outerplanar graphs.


title: Magnetic island formation and rotation braking induced by low-Z impurity penetration in an EAST plasma

abstract: Recent observations of the successive formations of the 4=1; 3=1, and 2=1 magnetic islands as well as the subsequent braking of the 2=1 mode during a low-Z impurity penetration process in EAST experiments are well reproduced in our 3D resistive MHD simulations. The enhanced parallel current perturbation induced by impurity radiation predominately contributes to the tearing mode growth, and the 2=1 island rotation is mainly damped by the impurity accumulation as results of the influence from high n modes.


title: TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors

abstract: Translation-based knowledge graph embedding has been one of the most important branches for knowledge representation learning since TransE came out. Although many translation-based approaches have achieved some progress in recent years, the performance was still unsatisfactory. This paper proposes a novel knowledge graph embedding method named TripleRE with two versions. The first version of TripleRE creatively divide the relationship vector into three parts. The second version takes advantage of the concept of residual and achieves better performance. In addition, attempts on using NodePiece to encode entities achieved promising results in reducing the parametric size, and solved the problems of scalability. Experiments show that our approach achieved state-of-the-art performance on the large-scale knowledge graph dataset, and competitive performance on other datasets.


title: Spatio-temporal motion correction and iterative reconstruction of in-utero fetal fMRI

abstract: Resting-state functional Magnetic Resonance Imaging (fMRI) is a powerful imaging technique for studying functional development of the brain in utero. However, unpredictable and excessive movement of fetuses have limited its clinical applicability. Previous studies have focused primarily on the accurate estimation of the motion parameters employing a single step 3D interpolation at each individual time frame to recover a motion-free 4D fMRI image. Using only information from a 3D spatial neighborhood neglects the temporal structure of fMRI and useful information from neighboring timepoints. Here, we propose a novel technique based on four dimensional iterative reconstruction of the motion scattered fMRI slices. Quantitative evaluation of the proposed method on a cohort of real clinical fetal fMRI data indicates improvement of reconstruction quality compared to the conventional 3D interpolation approaches.


title: Low-Rank Covariance Completion for Graph Quilting with Applications to Functional Connectivity

abstract: As a tool for estimating networks in high dimensions, graphical models are commonly applied to calcium imaging data to estimate functional neuronal connectivity, i.e. relationships between the activities of neurons. However, in many calcium imaging data sets, the full population of neurons is not recorded simultaneously, but instead in partially overlapping blocks. This leads to the Graph Quilting problem, as first introduced by (Vinci et.al. 2019), in which the goal is to infer the structure of the full graph when only subsets of features are jointly observed. In this paper, we study a novel two-step approach to Graph Quilting, which first imputes the complete covariance matrix using low-rank covariance completion techniques before estimating the graph structure. We introduce three approaches to solve this problem: block singular value decomposition, nuclear norm penalization, and non-convex low-rank factorization. While prior works have studied low-rank matrix completion, we address the challenges brought by the block-wise missingness and are the first to investigate the problem in the context of graph learning. We discuss theoretical properties of the two-step procedure, showing graph selection consistency of one proposed approach by proving novel L infinity-norm error bounds for matrix completion with block-missingness. We then investigate the empirical performance of the proposed methods on simulations and on real-world data examples, through which we show the efficacy of these methods for estimating functional connectivity from calcium imaging data.


title: Topological Semantic Graph Memory for Image-Goal Navigation

abstract: A novel framework is proposed to incrementally collect landmark-based graph memory and use the collected memory for image goal navigation. Given a target image to search, an embodied robot utilizes semantic memory to find the target in an unknown environment. % The semantic graph memory is collected from a panoramic observation of an RGB-D camera without knowing the robot's pose. In this paper, we present a topological semantic graph memory (TSGM), which consists of (1) a graph builder that takes the observed RGB-D image to construct a topological semantic graph, (2) a cross graph mixer module that takes the collected nodes to get contextual information, and (3) a memory decoder that takes the contextual memory as an input to find an action to the target. On the task of image goal navigation, TSGM significantly outperforms competitive baselines by +5.0-9.0% on the success rate and +7.0-23.5% on SPL, which means that the TSGM finds efficient paths. Additionally, we demonstrate our method on a mobile robot in real-world image goal scenarios.


title: AstroSat view of `Clocked` burster GS 1826-238:broad-band spectral nature of persistent and burst emission during soft state

abstract: In this paper, we have carried out a detailed study of the `Clocked' burster GS $1826-238$ using $\sim$ 90 ks broad-band (0.7 - 60.0 keV) data obtained with {\it AstroSat} observatory. The source was observed during a soft spectral state and traced a `banana' type track in the colour-colour diagram (CCD). We find that a combination of thermal component (multi-colour disc/bbodyrad) and Comptonized component is statistically good description for all the sections of the track in the CCD. The corona becomes optically thick ($\tau$ increases from $\sim$ 5 to 21) and cooler ($kT_e$ decreases from $\sim$ 4.8 to 2.2 keV) as the source moves up in the `banana' branch. Probably cooling is caused by increase in the supply of soft-seed photons from the disc/boundary-layer. Reflection signature is observed at upper `banana' branch of the source. Two type-I X-ray bursts are detected during the {\it AstroSat} observations. During the bursts, hard X-rays increased unlike previous observations where a reduction in hard X-rays is observed during the bursts. Decrease in the electron temperature and increase in the optical depth are observed during the bursts. The PSD (Power Spectral Density) of all the sections of the CCD can be represented by a pure power-law component. The strength of this component increases from $\sim$ 1\% to 4.5\% as the source moves up in the `banana' track. Search for burst oscillations gave a null result. We discuss the implications of our results in the context of previous findings.


title: CARNet:Compression Artifact Reduction for Point Cloud Attribute

abstract: A learning-based adaptive loop filter is developed for the Geometry-based Point Cloud Compression (G-PCC) standard to reduce attribute compression artifacts. The proposed method first generates multiple Most-Probable Sample Offsets (MPSOs) as potential compression distortion approximations, and then linearly weights them for artifact mitigation. As such, we drive the filtered reconstruction as close to the uncompressed PCA as possible. To this end, we devise a Compression Artifact Reduction Network (CARNet) which consists of two consecutive processing phases: MPSOs derivation and MPSOs combination. The MPSOs derivation uses a two-stream network to model local neighborhood variations from direct spatial embedding and frequency-dependent embedding, where sparse convolutions are utilized to best aggregate information from sparsely and irregularly distributed points. The MPSOs combination is guided by the least square error metric to derive weighting coefficients on the fly to further capture content dynamics of input PCAs. The CARNet is implemented as an in-loop filtering tool of the GPCC, where those linear weighting coefficients are encapsulated into the bitstream with negligible bit rate overhead. Experimental results demonstrate significant improvement over the latest GPCC both subjectively and objectively.


title: MiNL: Micro-images based Neural Representation for Light Fields

abstract: Traditional representations for light fields can be separated into two types: explicit representation and implicit representation. Unlike explicit representation that represents light fields as Sub-Aperture Images (SAIs) based arrays or Micro-Images (MIs) based lenslet images, implicit representation treats light fields as neural networks, which is inherently a continuous representation in contrast to discrete explicit representation. However, at present almost all the implicit representations for light fields utilize SAIs to train an MLP to learn a pixel-wise mapping from 4D spatial-angular coordinate to pixel colors, which is neither compact nor of low complexity. Instead, in this paper we propose MiNL, a novel MI-wise implicit neural representation for light fields that train an MLP + CNN to learn a mapping from 2D MI coordinates to MI colors. Given the micro-image's coordinate, MiNL outputs the corresponding micro-image's RGB values. Light field encoding in MiNL is just training a neural network to regress the micro-images and the decoding process is a simple feedforward operation. Compared with common pixel-wise implicit representation, MiNL is more compact and efficient that has faster decoding speed (\textbf{$\times$80$\sim$180} speed-up) as well as better visual quality (\textbf{1$\sim$4dB} PSNR improvement on average).


title: Wave equation for Sturm-Liouville operator with singular potentials

abstract: The paper is denoted to the initial-boundary value problem for the wave equation with the Sturm-Liouville operator with irregular (distributive) potentials. To obtain a solution to the equation, the separation method and asymptotics of the eigenvalues and eigenfunctions of the Sturm-Liouville operator are used. Homogeneous and inhomogeneous cases of the equation are considered. Next, existence, uniqueness, and consistency theorems for a very weak solution of the wave equation with singular coefficients are proved.


title: A profinite analogue of Lasserre's theorem

abstract: A soluble pro-p group of finite rank is finitely axiomatizable in the class of all profinite groups if and only if for each open subgroup H, the image of Z(H) in the abelianization of H is finite, subject to some suitable hypothesis of finite presentability.


title: MHD Simulations on Magnetic Compression of Field Reversed Configurations

abstract: The magnetic compression has long been proposed a promising method for the plasma heating in a field reversed configuration (FRC), however, it remains a challenge to fully understand the physical mechanisms underlying the compression process, due to its highly dynamic nature beyond the one-dimensional (1D) adiabatic theory model [R. L. Spencer et al., Phys. Fluids 26, 1564 (1983)]. In this work, magnetohydrodynamics (MHD) simulations on the magnetic compression of FRCs using the NIMROD code [C. R. Sovinec et al., J. Comput. Phys. 195, 355 (2004)] and their comparisons with the 1D theory have been performed. The effects of the assumptions of the theory on the compression process have been explored, and the detailed profiles of the FRC during compression have been investigated. The pressure evolution agrees with the theoretical prediction under various initial conditions. The axial contraction of the FRC can be affected by the initial density profile and the ramping rate of the compression magnetic field, but the theoretical predictions on the FRC's length in general and the relation $r_s=\sqrt{2}r_o$ in particular hold approximately well during the whole compression process, where $r_s$ is the major radius of FRC separatrix and $r_o$ is that of the magnetic axis. The evolutions of the density and temperature can be affected significantly by the initial equilibrium profile and the ramping rate of the compression magnetic field. During the compression, the major radius of the FRC is another parameter that is susceptible to the ramping rate of the compression field. Basically, for the same magnetic compression ratio, the peak density is higher and the FRC's radius $r_s$ is smaller than the theoretical predictions.


title: Improved Generalization Bound and Learning of Sparsity Patterns for Data-Driven Low-Rank Approximation

abstract: Learning sketching matrices for fast and accurate low-rank approximation (LRA) has gained increasing attention. Recently, Bartlett, Indyk, and Wagner (COLT 2022) presented a generalization bound for the learning-based LRA. Specifically, for rank-$k$ approximation using an $m \times n$ learned sketching matrix with $s$ non-zeros in each column, they proved an $\tilde{\mathrm{O}}(nsm)$ bound on the \emph{fat shattering dimension} ($\tilde{\mathrm{O}}$ hides logarithmic factors). We build on their work and make two contributions. 1. We present a better $\tilde{\mathrm{O}}(nsk)$ bound ($k \le m$). En route to obtaining this result, we give a low-complexity \emph{Goldberg--Jerrum algorithm} for computing pseudo-inverse matrices, which would be of independent interest. 2. We alleviate an assumption of the previous study that sketching matrices have a fixed sparsity pattern. We prove that learning positions of non-zeros increases the fat shattering dimension only by ${\mathrm{O}}(ns\log n)$. In addition, experiments confirm the practical benefit of learning sparsity patterns.


title: Equilibrium Perturbations for Asymmetric Zero Range Process under Diffusive Scaling in Dimensions $d \geq 2$

abstract: We consider the asymmetric zero range process in dimensions $d \geq 2$. Assume the initial density profile is a perturbation of the constant density, which has order $N^{-\alpha}$, $\alpha \in (0,1)$, and is constant along the drift direction. Here, $N$ is the scaling parameter. We show that under some constraints on the jump rate of the zero range process, the perturbed quantity macroscopically obeys the heat equation under diffusive scaling.


title: Detecting Generated Scientific Papers using an Ensemble of Transformer Models

abstract: The paper describes neural models developed for the DAGPap22 shared task hosted at the Third Workshop on Scholarly Document Processing. This shared task targets the automatic detection of generated scientific papers. Our work focuses on comparing different transformer-based models as well as using additional datasets and techniques to deal with imbalanced classes. As a final submission, we utilized an ensemble of SciBERT, RoBERTa, and DeBERTa fine-tuned using random oversampling technique. Our model achieved 99.24% in terms of F1-score. The official evaluation results have put our system at the third place.


title: Structured Knowledge Grounding for Question Answering

abstract: Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include knowledge graphs (KG) to complement LMs with their more logic-driven implicit knowledge. However, effectively extracting information from structured data, like KGs, empowers LMs to remain an open question, and current models rely on graph techniques to extract knowledge. In this paper, we propose to solely leverage the LMs to combine the language and knowledge for knowledge based question-answering with flexibility, breadth of coverage and structured reasoning. Specifically, we devise a knowledge construction method that retrieves the relevant context with a dynamic hop, which expresses more comprehensivenes than traditional GNN-based techniques. And we devise a deep fusion mechanism to further bridge the information exchanging bottleneck between the language and the knowledge. Extensive experiments show that our model consistently demonstrates its state-of-the-art performance over CommensenseQA benchmark, showcasing the possibility to leverage LMs solely to robustly ground QA into the knowledge base.


title: FR: Folded Rationalization with a Unified Encoder

abstract: Conventional works generally employ a two-phase model in which a generator selects the most important pieces, followed by a predictor that makes predictions based on the selected pieces. However, such a two-phase model may incur the degeneration problem where the predictor overfits to the noise generated by a not yet well-trained generator and in turn, leads the generator to converge to a sub-optimal model that tends to select senseless pieces. To tackle this challenge, we propose Folded Rationalization (FR) that folds the two phases of the rationale model into one from the perspective of text semantic extraction. The key idea of FR is to employ a unified encoder between the generator and predictor, based on which FR can facilitate a better predictor by access to valuable information blocked by the generator in the traditional two-phase model and thus bring a better generator. Empirically, we show that FR improves the F1 score by up to 10.3% as compared to state-of-the-art methods.


title: How can voting mechanisms improve the robustness and generalizability of toponym disambiguation?

abstract: A vast amount of geographic information exists in natural language texts, such as tweets and news. Extracting geographic information from texts is called Geoparsing, which includes two subtasks: toponym recognition and toponym disambiguation, i.e., to identify the geospatial representations of toponyms. This paper focuses on toponym disambiguation, which is usually approached by toponym resolution and entity linking. Recently, many novel approaches have been proposed, especially deep learning-based approaches, such as CamCoder, GENRE, and BLINK. In this paper, a spatial clustering-based voting approach that combines several individual approaches is proposed to improve SOTA performance in terms of robustness and generalizability. Experiments are conducted to compare a voting ensemble with 20 latest and commonly-used approaches based on 12 public datasets, including several highly ambiguous and challenging datasets (e.g., WikToR and CLDW). The datasets are of six types: tweets, historical documents, news, web pages, scientific articles, and Wikipedia articles, containing in total 98,300 places across the world. The results show that the voting ensemble performs the best on all the datasets, achieving an average Accuracy@161km of 0.86, proving the generalizability and robustness of the voting approach. Also, the voting ensemble drastically improves the performance of resolving fine-grained places, i.e., POIs, natural features, and traffic ways.


title: Complete tunneling of acoustic waves between closely spaced piezoelectric crystals

abstract: When two piezoelectric solids are placed in close proximity, acoustic waves (phonons) can "tunnel" across a vacuum gap transmitting energy between the two solids. Here, we demonstrate analytically that not only is such a phenomenon possible, but that a simple resonance condition exists for which complete transmission of the incoming wave is possible, physically corresponding to the excitation of leaky surface waves. This result is derived for an arbitrary anisotropic crystal symmetry and orientation. We also show that the complete transmission condition can be related to the surface electric impedance and the effective surface permittivity of the piezoelectric material, making it possible to be determined experimentally. In addition, we present numerical results for the maximum power transmittance of a slow transverse wave, tunneling between identical ZnO crystals, as function of all possible crystal orientations. The results show a large range of orientations for which complete tunneling can be achieved.


title: Self-supervised learning of hologram reconstruction using physics consistency

abstract: The past decade has witnessed transformative applications of deep learning in various computational imaging, sensing and microscopy tasks. Due to the supervised learning schemes employed, these methods mostly depend on large-scale, diverse, and labeled training data. The acquisition and preparation of such training image datasets are often laborious and costly, also leading to biased estimation and limited generalization to new sample types. Here, we report a self-supervised learning model, termed GedankenNet, that eliminates the need for labeled or experimental training data, and demonstrate its effectiveness and superior generalization on hologram reconstruction tasks. Without prior knowledge about the sample types to be imaged, the self-supervised learning model was trained using a physics-consistency loss and artificial random images that are synthetically generated without any experiments or resemblance to real-world samples. After its self-supervised training, GedankenNet successfully generalized to experimental holograms of various unseen biological samples, reconstructing the phase and amplitude images of different types of objects using experimentally acquired test holograms. Without access to experimental data or knowledge of real samples of interest or their spatial features, GedankenNet's self-supervised learning achieved complex-valued image reconstructions that are consistent with the Maxwell's equations, and its output inference and object solutions accurately represent the wave propagation in free-space. GedankenNet framework also exhibits resilience to random, unknown perturbations in the physical forward model, including changes in the hologram distances, pixel size and illumination wavelength. This self-supervised learning of image reconstruction tasks creates new opportunities for various inverse problems in holography, microscopy and computational imaging fields.


title: Continuously Controllable Facial Expression Editing in Talking Face Videos

abstract: Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is a strong demand in the industry. The challenge is that speech-related expressions and emotion-related expressions are often highly coupled. Meanwhile, traditional image-to-image translation methods cannot work well in our application due to the coupling of expressions with other attributes such as poses, i.e., translating the expression of the character in each frame may simultaneously change the head pose due to the bias of the training data distribution. In this paper, we propose a high-quality facial expression editing method for talking face videos, allowing the user to control the target emotion in the edited video continuously. We present a new perspective for this task as a special case of motion information editing, where we use a 3DMM to capture major facial movements and an associated texture map modeled by a StyleGAN to capture appearance details. Both representations (3DMM and texture map) contain emotional information and can be continuously modified by neural networks and easily smoothed by averaging in coefficient/latent spaces, making our method simple yet effective. We also introduce a mouth shape preservation loss to control the trade-off between lip synchronization and the degree of exaggeration of the edited expression. Extensive experiments and a user study show that our method achieves state-of-the-art performance across various evaluation criteria.


title: Changer: Feature Interaction is What You Need for Change Detection

abstract: Change detection is an important tool for long-term earth observation missions. It takes bi-temporal images as input and predicts "where" the change has occurred. Different from other dense prediction tasks, a meaningful consideration for change detection is the interaction between bi-temporal features. With this motivation, in this paper we propose a novel general change detection architecture, MetaChanger, which includes a series of alternative interaction layers in the feature extractor. To verify the effectiveness of MetaChanger, we propose two derived models, ChangerAD and ChangerEx with simple interaction strategies: Aggregation-Distribution (AD) and "exchange". AD is abstracted from some complex interaction methods, and "exchange" is a completely parameter\&computation-free operation by exchanging bi-temporal features. In addition, for better alignment of bi-temporal features, we propose a flow dual-alignment fusion (FDAF) module which allows interactive alignment and feature fusion. Crucially, we observe Changer series models achieve competitive performance on different scale change detection datasets. Further, our proposed ChangerAD and ChangerEx could serve as a starting baseline for future MetaChanger design.


title: Superfunctional high-entropy alloys and ceramics by severe plastic deformation

abstract: High-entropy alloys and ceramics containing at least five principal elements have recently received high attention for various mechanical and functional applications. The application of severe plastic deformation (SPD), particularly the high-pressure torsion (HPT) method, combined with the CALPHAD and first-principles calculations resulted in the development of numerous superfunctional high-entropy materials with superior properties compared to the normal functions of engineering materials. This article reviews the recent advances in the application of SPD to developing superfunctional high-entropy materials. These superfunctional properties include (i) ultrahigh hardness levels comparable to the hardness of ceramics in high-entropy alloys, (ii) high yield strength and good hydrogen embrittlement resistance in high-entropy alloys; (iii) high strength, low elastic modulus, and high biocompatibility in high-entropy alloys, (iv) fast and reversible hydrogen storage in high-entropy hydrides, (v) photovoltaic performance and photocurrent generation on high-entropy semiconductors, (vi) photocatalytic oxygen and hydrogen production from water splitting on high-entropy oxides and oxynitrides, and (vii) CO2 photoreduction on high-entropy ceramics. These findings introduce SPD as not only a processing tool to improve the properties of existing high-entropy materials but also as a synthesis tool to produce novel high-entropy materials with superior properties compared with conventional engineering materials.


title: Comparison of two aspects of a PDE model for biological network formation

abstract: We compare the solutions of two systems of partial differential equations (PDE), seen as two different interpretations of the same model that describes formation of complex biological networks. Both approaches take into account the time evolution of the medium flowing through the network, and we compute the solution of an elliptic-parabolic PDE system for the conductivity vector $m$, the conductivity tensor $\mathbb{C}$ and the pressure $p$. We use finite differences schemes in a uniform Cartesian grid in the spatially two-dimensional setting to solve the two systems, where the parabolic equation is solved by a semi-implicit scheme in time. Since the conductivity vector and tensor appear also in the Poisson equation for the pressure $p$, the elliptic equation depends implicitly on time. For this reason we compute the solution of three linear systems in the case of the conductivity vector $m\in\mathbb{R}^2$, and four linear systems in the case of the symmetric conductivity tensor $\mathbb{C}\in\mathbb{R}^{2\times 2}$, at each time step. To accelerate the simulations, we make use of the Alternating Direction Implicit (ADI) method. The role of the parameters is important for obtaining detailed solutions. We provide numerous tests with various values of the parameters involved, to see the differences in the solutions of the two systems.


title: Locally cyclic extensions with Galois group $GL_2(p)$

abstract: Using Galois representations attached to elliptic curves, we construct Galois extensions of $\mathbb{Q}$ with group $GL_2(p)$ in which all decomposition groups are cyclic. This is the first such realization for all primes $p$.


title: A Survey on the Network Models applied in the Industrial Network Optimization

abstract: Network architecture design is very important for the optimization of industrial networks. The type of network architecture can be divided into small-scale network and large-scale network according to its scale. Graph theory is an efficient mathematical tool for network topology modeling. For small-scale networks, its structure often has regular topology. For large-scale networks, the existing research mainly focuses on the random characteristics of network nodes and edges. Recently, popular models include random networks, small-world networks and scale-free networks. Starting from the scale of network, this survey summarizes and analyzes the network modeling methods based on graph theory and the practical application in industrial scenarios. Furthermore, this survey proposes a novel network performance metric - system entropy. From the perspective of mathematical properties, the analysis of its non-negativity, monotonicity and concave-convexity is given. The advantage of system entropy is that it can cover the existing regular network, random network, small-world network and scale-free network, and has strong generality. The simulation results show that this metric can realize the comparison of various industrial networks under different models.


title: Superfunctional materials by ultra-severe plastic deformation

abstract: Superfunctional materials are defined as materials with specific properties being superior to the functions of engineering materials. Numerous studies introduced severe plastic deformation (SPD) as an effective process to improve the functional and mechanical properties of various metallic and non-metallic materials. Moreover, the concept of ultra-SPD - introducing shear strains over 1000 to reduce the thickness of sheared phases to levels comparable to atomic distances - was recently utilized to synthesize novel superfunctional materials. In this article, the application of ultra-SPD for controlling atomic diffusion and phase transformation and synthesizing new materials with superfunctional properties is discussed. The main properties achieved by ultra-SPD include: (i) high-temperature thermal stability in new immiscible age-hardenable aluminum alloys; (ii) room-temperature superplasticity for the first time in magnesium and aluminum alloys; (iii) high strength and high plasticity in nanograined intermetallics; (iv) low elastic modulus and high hardness in biocompatible binary and high-entropy alloys; (v) superconductivity and high strength in the Nb-Ti alloys; (vi) room-temperature hydrogen storage for the first time in magnesium alloys; and (vii) superior photocatalytic hydrogen production, oxygen production, and carbon dioxide conversion on high-entropy oxides and oxynitrides as a new family of photocatalysts.


title: The impact of binaries on the dynamical mass estimate of dwarf galaxies

abstract: Binary stars are recognized to be important in driving the dynamical evolution of stellar systems and also in determining some of their observational features. In this study, we explore the role that binary stars have in modulating the estimates of the velocity dispersion of stellar systems. To this aim, we developed a tool which allows to investigate the dependence of synthetic velocity dispersion on a number of crucial quantities characterizing the binary content: binary fraction and the distributions of their mass ratio, eccentricity and semi-major axis. As an application, we evaluate the impact that binary stars have on the estimation of the dynamical mass of dwarf spheroidal and ultra-faint dwarf galaxies, finding that it can be particularly relevant, especially for low mass and low density systems. These results bear profound implications for the interpretation of the measured velocity dispersion in such systems, since it weakens or relieves the claim for the need of large amounts of dark matter.


title: Dual-camera high-speed imaging of n-hexane oxidation in a high-pressure shock tube

abstract: Shock tubes are widely used in the study of chemical kinetics. Its benefits rely on the almost ideal shock-heating process that provides high temperatures and pressures to a chemical system for a limited test time. Just like any reactor, shock tubes are not immune to non-ideal effects. The study of conditions that might deviate experiments from ideal conditions is thus of the utmost importance. High-speed imaging has been proven to be a powerful bytool to analyze non-ideal / non-homogenous combustion in shock tubes. In this work, dual-camera high-speed imaging experiments were performed at 10, 15 and 20 bar in a high-pressure shock tube (HPST). An optical section was designed as an extension of the HPST which enabled simultaneous visualization from the endwall and the sidewall of the driven section of the shock tube. n-Hexane, a fuel with a negative temperature coefficient (NTC) behavior that has been identified as prone to non-homogenous ignition, is used as a test fuel. Reactive mixtures and thermodynamic conditions were selected to visually analyze ignition processes at the high-temperature, NTC and low-temperature regimes. Non-homogeneous ignition was observed mostly at the local maximum of the IDT, which is comprised by the high-temperature and NTC regions. Stoichiometric n-hexane mixture with high fuel loading (5% n-hexane) presented the highest deviation from constant volume chemical kinetic simulations. The inclusion of helium as a bath gas to mitigate preignition was tested and it showed to improve the susceptibility of the mixtures to develop reaction fronts. The modified Sankaran criterion for the identification of ignition regimes in shock tubes was tested and it showed an overall good agreement against the experimental observations.


title: Active photocatalysts for CO2 conversion by severe plastic deformation (SPD)

abstract: Excessive CO2 emission from fossil fuel usage has resulted in global warming and environmental crises. To solve this problem, the photocatalytic conversion of CO2 to CO or useful components is a new strategy that has received significant attention. The main challenge in this regard is exploring photocatalysts with high efficiency for CO2 photoreduction. Severe plastic deformation (SPD) through the high-pressure torsion (HPT) process has been effectively used in recent years to develop novel active catalysts for CO2 conversion. These active photocatalysts have been designed based on four main strategies: (i) oxygen vacancy and strain engineering, (ii) stabilization of high-pressure phases, (iii) synthesis of defective high-entropy oxides, and (iv) synthesis of low-bandgap high-entropy oxynitrides. These strategies can enhance the photocatalytic efficiency compared with conventional and benchmark photocatalysts by improving CO2 adsorption, increasing light absorbance, aligning the band structure, narrowing the bandgap, accelerating the charge carrier migration, suppressing the recombination rate of electrons and holes, and providing active sites for photocatalytic reactions. This article reviews recent progress in the application of SPD to develop functional ceramics for photocatalytic CO2 conversion.


title: Synthesizing Nested Relational Queries from Implicit Specifications

abstract: Derived datasets can be defined implicitly or explicitly. An implicit definition (of dataset $O$ in terms of datasets $\vec{I}$) is a logical specification involving the source data $\vec{I}$ and the interface data $O$. It is a valid definition of $O$ in terms of $\vec{I}$, if any two models of the specification agreeing on $\vec{I}$ agree on $O$. In contrast, an explicit definition is a query that produces $O$ from $\vec{I}$. Variants of Beth's theorem state that one can convert implicit definitions to explicit ones. Further, this conversion can be done effectively given a proof witnessing implicit definability in a suitable proof system. We prove the analogous effective implicit-to-explicit result for nested relations: implicit definitions, given in the natural logic for nested relations, can be effectively converted to explicit definitions in the nested relational calculus NRC. As a consequence, we can effectively extract rewritings of NRC queries in terms of NRC views, given a proof witnessing that the query is determined by the views.


title: Subclass of bi-univalent function associated to Chebyshev polynomial

abstract: The Chebyshev polynomials are utilized in this study to define the subclass of the bi-univalent function. Also, Chebyshev polynomial bounds and Fekete-Szego inequalities for functions defined in the classes are established.


title: Geometric ergodicity of Gibbs samplers for Bayesian error-in-variable regression

abstract: Multivariate Bayesian error-in-variable (EIV) linear regression is considered to account for additional additive Gaussian error in the features and response. A 3-variable deterministic scan Gibbs samplers is constructed for multivariate EIV regression models using classical and Berkson errors with independent normal and inverse-Wishart priors. These Gibbs samplers are proven to always be geometrically ergodic which ensures a central limit theorem for many time averages from the Markov chains. We demonstrate the strengths and limitations of the Gibbs sampler with simulated data for large data problems, robustness to misspecification and also analyze a real-data example in astrophysics.


title: Interference phenomenon in electron-molecule collisions

abstract: The article discusses how the pattern of elastic scattering of an electron on a pair of identical atomic spheres will look if we abandon the standard in the molecular physics assumption that, outside the molecular sphere, in the external region, the wave function of the molecular continuum is atomic-like and is a linear combination of regular and irregular solutions of the wave equations. To do this, the elastic scattering of slow particles by pair of non-overlapping short-range potentials has been studied. The continuum wave function of particle is represented as a combination of a plane wave and two spherical s-waves that propagated freely throughout space. The asymptotic of this function determines in closed form the amplitude of elastic particle scattering. It has been shown that this amplitude can be presented as a partial expansion in a set of ortho-normal functions other, than spherical harmonics . General formulas for these functions are obtained. The coefficients of the scattering amplitude expansion to a series of functions determine the scattering phases for the two-atomic target under consideration. The special features of the S-matrix method for the case of arbitrary non-spherical potentials are discussed.


title: Limitations to Realize Quantum Zeno Effect in Beam Splitter Array -- a Monte Carlo Wavefunction Analysis

abstract: Effects of non-ideal optical components in realizing quantum Zeno effect in an all-optical setup are analyzed. Beam splitters are the important components in this experimental configuration. Nonuniform transmission coefficient, photon absorption and thermal noise are considered. Numerical simulation of the experiment is performed using the Monte Carlo wavefunction method. It is argued that there is an optimal number of beam splitters to be used for maximizing the expected output in the experiment.


title: A Bakry-\'Emery criterion for weighted contractivity and $L^2$-Hardy inequalities

abstract: We show a symmetric Markov diffusion semigroup satisfies a weighted contractivity condition if and only if a $L^2$-Hardy inequality holds, and we give a Bakry-\'Emery type criterion for the former. We then give some applications.


title: Active-Passive SimStereo -- Benchmarking the Cross-Generalization Capabilities of Deep Learning-based Stereo Methods

abstract: In stereo vision, self-similar or bland regions can make it difficult to match patches between two images. Active stereo-based methods mitigate this problem by projecting a pseudo-random pattern on the scene so that each patch of an image pair can be identified without ambiguity. However, the projected pattern significantly alters the appearance of the image. If this pattern acts as a form of adversarial noise, it could negatively impact the performance of deep learning-based methods, which are now the de-facto standard for dense stereo vision. In this paper, we propose the Active-Passive SimStereo dataset and a corresponding benchmark to evaluate the performance gap between passive and active stereo images for stereo matching algorithms. Using the proposed benchmark and an additional ablation study, we show that the feature extraction and matching modules of a selection of twenty selected deep learning-based stereo matching methods generalize to active stereo without a problem. However, the disparity refinement modules of three of the twenty architectures (ACVNet, CascadeStereo, and StereoNet) are negatively affected by the active stereo patterns due to their reliance on the appearance of the input images.


title: Variational quantum circuit learning of entanglement purification in multiple degrees of freedom

abstract: Entanglement purification is a crucial technique for promising the effective entanglement channel in noisy large-scale quantum networks, yet complicated in designing protocols in multi-degree of freedom (DoF). To execute the above tasks easily and effectively, developing a learning framework for designing the entanglement purification with multi-DoF is a promising way and still an open research question. Inspired by variational quantum circuit (VQC) with remarkable advantage in learning optimal quantum operations with near-term quantum devices, in this paper we propose an effective VQC framework for the entanglement purification in multi-DoF and exploit it to learn the optimal purification protocols of the objective function which are based on postselection. By properly introducing additional circuit lines for representing each of the ancillary DoFs of all the particles, e.g., space and time, the parametrized quantum circuit can effectively simulate scalable entanglement purification. To verify our framework, the well-known protocols in linear optics are learned well with alternative operations in low-depth quantum circuit. Moreover, we simulate the multipair cases with multi-DoF to show the scalability and discover one-round protocols. Our work provides an effective way for exploring the entanglement purification protocols in multi-DoF and multipair with near-term quantum devices.


title: A review of predictive uncertainty estimation with machine learning

abstract: Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and forecasting with machine learning models in academia and industry are becoming more frequent, related concepts and methods have not been formalized and structured under a holistic view of the entire field. Here, we review the topic of predictive uncertainty estimation with machine learning algorithms, as well as the related metrics (consistent scoring functions and proper scoring rules) for assessing probabilistic predictions. The review covers a time period spanning from the introduction of early statistical (linear regression and time series models, based on Bayesian statistics or quantile regression) to recent machine learning algorithms (including generalized additive models for location, scale and shape, random forests, boosting and deep learning algorithms) that are more flexible by nature. The review of the progress in the field, expedites our understanding on how to develop new algorithms tailored to users' needs, since the latest advancements are based on some fundamental concepts applied to more complex algorithms. We conclude by classifying the material and discussing challenges that are becoming a hot topic of research.


title: The Lemmens-Seidel conjecture for base size $5$

abstract: In 2020, Lin and Yu claimed to prove the so-called Lemmens-Seidel conjecture for base size $5$. However, their proof has a gap, and in fact, some set of equiangular lines found by Greaves et al. in 2021 is a counterexample to one of their claims. In this paper, we give a proof of the conjecture for base size $5$. Also, we answer in the negative a question of Greaves et al. in 2021 whether some sets of $57$ equiangular lines with common angle $\arccos(1/5)$ in dimension $18$ are contained in a unique set of $276$ equiangular lines with common angle $\arccos(1/5)$ in dimension $23$. In addition, we answer in the negative a question of Cao et al. in 2021 whether a strongly maximal set of equiangular lines with common angle $\arccos(1/5)$ exists except the set of $276$ equiangular lines with common angle $\arccos(1/5)$ in dimension $23$.


title: AdaCC: Cumulative Cost-Sensitive Boosting for Imbalanced Classification

abstract: Class imbalance poses a major challenge for machine learning as most supervised learning models might exhibit bias towards the majority class and under-perform in the minority class. Cost-sensitive learning tackles this problem by treating the classes differently, formulated typically via a user-defined fixed misclassification cost matrix provided as input to the learner. Such parameter tuning is a challenging task that requires domain knowledge and moreover, wrong adjustments might lead to overall predictive performance deterioration. In this work, we propose a novel cost-sensitive boosting approach for imbalanced data that dynamically adjusts the misclassification costs over the boosting rounds in response to model's performance instead of using a fixed misclassification cost matrix. Our method, called AdaCC, is parameter-free as it relies on the cumulative behavior of the boosting model in order to adjust the misclassification costs for the next boosting round and comes with theoretical guarantees regarding the training error. Experiments on 27 real-world datasets from different domains with high class imbalance demonstrate the superiority of our method over 12 state-of-the-art cost-sensitive boosting approaches exhibiting consistent improvements in different measures, for instance, in the range of [0.3%-28.56%] for AUC, [3.4%-21.4%] for balanced accuracy, [4.8%-45%] for gmean and [7.4%-85.5%] for recall.


title: Learning to Weight Samples for Dynamic Early-exiting Networks

abstract: Early exiting is an effective paradigm for improving the inference efficiency of deep networks. By constructing classifiers with varying resource demands (the exits), such networks allow easy samples to be output at early exits, removing the need for executing deeper layers. While existing works mainly focus on the architectural design of multi-exit networks, the training strategies for such models are largely left unexplored. The current state-of-the-art models treat all samples the same during training. However, the early-exiting behavior during testing has been ignored, leading to a gap between training and testing. In this paper, we propose to bridge this gap by sample weighting. Intuitively, easy samples, which generally exit early in the network during inference, should contribute more to training early classifiers. The training of hard samples (mostly exit from deeper layers), however, should be emphasized by the late classifiers. Our work proposes to adopt a weight prediction network to weight the loss of different training samples at each exit. This weight prediction network and the backbone model are jointly optimized under a meta-learning framework with a novel optimization objective. By bringing the adaptive behavior during inference into the training phase, we show that the proposed weighting mechanism consistently improves the trade-off between classification accuracy and inference efficiency. Code is available at https://github.com/LeapLabTHU/L2W-DEN.


title: De Bruijn goes Neural: Causality-Aware Graph Neural Networks for Time Series Data on Dynamic Graphs

abstract: We introduce De Bruijn Graph Neural Networks (DBGNNs), a novel time-aware graph neural network architecture for time-resolved data on dynamic graphs. Our approach accounts for temporal-topological patterns that unfold in the causal topology of dynamic graphs, which is determined by causal walks, i.e. temporally ordered sequences of links by which nodes can influence each other over time. Our architecture builds on multiple layers of higher-order De Bruijn graphs, an iterative line graph construction where nodes in a De Bruijn graph of order k represent walks of length k-1, while edges represent walks of length k. We develop a graph neural network architecture that utilizes De Bruijn graphs to implement a message passing scheme that follows a non-Markovian dynamics, which enables us to learn patterns in the causal topology of a dynamic graph. Addressing the issue that De Bruijn graphs with different orders k can be used to model the same data set, we further apply statistical model selection to determine the optimal graph topology to be used for message passing. An evaluation in synthetic and empirical data sets suggests that DBGNNs can leverage temporal patterns in dynamic graphs, which substantially improves the performance in a supervised node classification task.


title: Base rate neglect in computer science education

abstract: Machine learning (ML) algorithms are gaining increased importance in many academic and industrial applications, and such algorithms are, accordingly, becoming common components in computer science curricula. Learning ML is challenging not only due to its complex mathematical and algorithmic aspects, but also due to a) the complexity of using correctly these algorithms in the context of real-life situations and b) the understanding of related social and ethical issues. Cognitive biases are phenomena of the human brain that may cause erroneous perceptions and irrational decision-making processes. As such, they have been researched thoroughly in the context of cognitive psychology and decision making; they do, however, have important implications for computer science education as well. One well-known cognitive bias, first described by Kahneman and Tversky, is the base rate neglect bias, according to which humans fail to consider the base rate of the underlying phenomena when evaluating conditional probabilities. In this paper, we explore the expression of the base rate neglect bias in ML education. Specifically, we show that about one third of students in an Introduction to ML course, from varied backgrounds (computer science students and teachers, data science, engineering, social science and digital humanities), fail to correctly evaluate ML algorithm performance due to the base rate neglect bias. This failure rate should alert educators and promote the development of new pedagogical methods for teaching ML algorithm performance.