title: Computational Reproducibility Within Prognostics and Health Management

abstract: Scientific research frequently involves the use of computational tools and methods. Providing thorough documentation, open-source code, and data -- the creation of reproducible computational research -- helps others understand a researcher's work. Here, we explore computational reproducibility, broadly, and from within the field of prognostics and health management (PHM). The adoption of reproducible computational research practices remains low across scientific disciplines and within PHM. Our text mining of more than 300 articles, from publications engaged in PHM research, showed that fewer than 1% of researchers made their code and data available to others. Although challenges remain, there are also clear opportunities, and benefits, for engaging in reproducible computational research. Highlighting an opportunity, we introduce an open-source software tool, called PyPHM, to assist PHM researchers in accessing and preprocessing common industrial datasets.


title: A Model RRNet for Spectral Information Exploitation and LAMOST Medium-resolution Spectrum Parameter Estimation

abstract: This work proposes a Residual Recurrent Neural Network (RRNet) for synthetically extracting spectral information, and estimating stellar atmospheric parameters together with 15 chemical element abundances for medium-resolution spectra from Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST). The RRNet consists of two fundamental modules: a residual module and a recurrent module. The residual module extracts spectral features based on the longitudinally driving power from parameters, while the recurrent module recovers spectral information and restrains the negative influences from noises based on Cross-band Belief Enhancement. RRNet is trained by the spectra from common stars between LAMOST DR7 and APOGEE-Payne catalog. The 17 stellar parameters and their uncertainties for 2.37 million medium-resolution spectra from LAMOST DR7 are predicted. For spectra with S/N >= 10, the precision of estimations Teff and log g are 88 K and 0.13 dex respectively, elements C, Mg, Al, Si, Ca, Fe, Ni are 0.05 dex to 0.08 dex, and N, O, S, K, Ti, Cr, Mn are 0.09 dex to 0.14 dex, while that of Cu is 0.19 dex. Compared with StarNet and SPCANet, RRNet shows higher accuracy and robustness. In comparison to Apache Point Observatory Galactic Evolution Experiment and Galactic Archaeology with HERMES surveys, RRNet manifests good consistency within a reasonable range of bias. Finally, this work releases a catalog for 2.37 million medium-resolution spectra from the LAMOST DR7, the source code, the trained model and the experimental data respectively for astronomical science exploration and data processing algorithm research reference.


title: Second main theorem and uniqueness problem of meromorphic functions with finite growth index sharing five small functions on a complex disc

abstract: This paper has twofold. The first is to establish a second main theorem for meromorphic functions on the complex disc $\Delta (R_0)\subset\mathbb C$ with finite growth index and small functions, where the counting functions are truncated to level $1$ and the small term is more detailed estimated. The second is to prove a generalization and improvement of the five values theorem of Nevanlinna for the case of five small functions on the complex disc $\Delta (R_0)$.


title: Sepsis Prediction with Temporal Convolutional Networks

abstract: We design and implement a temporal convolutional network model to predict sepsis onset. Our model is trained on data extracted from MIMIC III database, based on a retrospective analysis of patients admitted to intensive care unit who did not fall under the definition of sepsis at the time of admission. Benchmarked with several machine learning models, our model is superior on this binary classification task, demonstrates the prediction power of convolutional networks for temporal patterns, also shows the significant impact of having longer look back time on sepsis prediction.


title: Detection of multipartite entanglement based on Heisenberg-Weyl representation of density matrices

abstract: We study entanglement and genuine entanglement of tripartite and four-partite quantum states by using Heisenberg-Weyl (HW) representation of density matrices. Based on the correlation tensors in HW representation, we present criteria to detect entanglement and genuine tripartite and four-partite entanglement. Detailed examples show that our method can detect more entangled states than previous criteria.


title: Certifying Some Distributional Fairness with Subpopulation Decomposition

abstract: Extensive efforts have been made to understand and improve the fairness of machine learning models based on observational metrics, especially in high-stakes domains such as medical insurance, education, and hiring decisions. However, there is a lack of certified fairness considering the end-to-end performance of an ML model. In this paper, we first formulate the certified fairness of an ML model trained on a given data distribution as an optimization problem based on the model performance loss bound on a fairness constrained distribution, which is within bounded distributional distance with the training distribution. We then propose a general fairness certification framework and instantiate it for both sensitive shifting and general shifting scenarios. In particular, we propose to solve the optimization problem by decomposing the original data distribution into analytical subpopulations and proving the convexity of the subproblems to solve them. We evaluate our certified fairness on six real-world datasets and show that our certification is tight in the sensitive shifting scenario and provides non-trivial certification under general shifting. Our framework is flexible to integrate additional non-skewness constraints and we show that it provides even tighter certification under different real-world scenarios. We also compare our certified fairness bound with adapted existing distributional robustness bounds on Gaussian data and demonstrate that our method is significantly tighter.


title: Joint Spatial-Temporal and Appearance Modeling with Transformer for Multiple Object Tracking

abstract: The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model both the appearance features of each object and the spatial-temporal relationships among objects. TransSTAM consists of two major parts: (1) The encoder utilizes the powerful self-attention mechanism of Transformer to learn discriminative features for each tracklet; (2) The decoder adopts the standard cross-attention mechanism to model the affinities between the tracklets and the detections by taking both spatial-temporal and appearance features into account. TransSTAM has two major advantages: (1) It is solely based on the encoder-decoder architecture and enjoys a compact network design, hence being computationally efficient; (2) It can effectively learn spatial-temporal and appearance features within one model, hence achieving better tracking accuracy. The proposed method is evaluated on multiple public benchmarks including MOT16, MOT17, and MOT20, and it achieves a clear performance improvement in both IDF1 and HOTA with respect to previous state-of-the-art approaches on all the benchmarks. Our code is available at \url{https://github.com/icicle4/TranSTAM}.


title: Towards Lifelong Federated Learning in Autonomous Mobile Robots with Continuous Sim-to-Real Transfer

abstract: The role of deep learning (DL) in robotics has significantly deepened over the last decade. Intelligent robotic systems today are highly connected systems that rely on DL for a variety of perception, control, and other tasks. At the same time, autonomous robots are being increasingly deployed as part of fleets, with collaboration among robots becoming a more relevant factor. From the perspective of collaborative learning, federated learning (FL) enables continuous training of models in a distributed, privacy-preserving way. This paper focuses on vision-based obstacle avoidance for mobile robot navigation. On this basis, we explore the potential of FL for distributed systems of mobile robots enabling continuous learning via the engagement of robots in both simulated and real-world scenarios. We extend previous works by studying the performance of different image classifiers for FL, compared to centralized, cloud-based learning with a priori aggregated data. We also introduce an approach to continuous learning from mobile robots with extended sensor suites able to provide automatically labeled data while they are completing other tasks. We show that higher accuracies can be achieved by training the models in both simulation and reality, enabling continuous updates to deployed models.


title: Valdivia's lifting theorem for non-metrizable spaces. Preprint

abstract: The lifting theorem of Valdivia concerning (pre) compact sets and convergent (respectively, Cauchy) sequences from a quasi-(LB) space to a metrizable, strictly barrelled space is extended to a strictly larger collection of range spaces. Specifically, we assume that the range space has a sequential web structure and do not require that it be metrizable, nor strictly barrelled, and the range space need not even be barrelled. Distinguishing examples are provided that include natural constructions of range spaces connected with applications, such as the space of distributions having their wavefront sets in a specified closed cone. The same and other examples could also serve as domain spaces for the closed graph theorem of Valdivia, revealing a much wider collection of domain spaces that can be used in that result.


title: Hadamard matrices related to a certain series of ternary self-dual codes

abstract: In 2013, Nebe and Villar gave a series of ternary self-dual codes of length $2(p+1)$ for a prime $p$ congruent to $5$ modulo $8$. As a consequence, the third ternary extremal self-dual code of length $60$ was found. We show that the ternary self-dual code contains codewords which form a Hadamard matrix of order $2(p+1)$ when $p$ is congruent to $5$ modulo $24$. In addition, it is shown that the ternary self-dual code is generated by the rows of the Hadamard matrix. We also demonstrate that the third ternary extremal self-dual code of length $60$ contains at least two inequivalent Hadamard matrices.


title: Exponential ergodicity of branching processes with immigration and competition

abstract: We study the ergodic property of a continuous-state branching process with immigration and competition. The exponential ergodicity in a weighted total variation distance is proved under natural assumptions. The main theorem applies to subcritical, critical and supercritical branching mechanisms, including all those of stable types. The proof is based on the construction of a Markov coupling process and the choice of a nonsymmetric control function for the distance. Those are designed to identify and to take the advantage of the dominating factor from the branching, immigration and competition mechanisms in different parts of the state space. The approach provides a way of finding a lower bound of the ergodicity rate.


title: Brane Dynamics of Holographic BCFTs

abstract: In this paper we study various dynamical aspects of the AdS/BCFT correspondence in higher dimensions. We study properties of holographic stress energy tensor by analyzing the metric perturbation in the gravity dual. We also calculate the stress energy tensor for a locally excited state on a half plane in a free scalar CFT. Both of them satisfy a reflective boundary condition that is expected for any BCFTs. We also study the behavior of the scalar field perturbation in the AdS/BCFT setup and show that they also show complete reflections. Moreover, we find that the entanglement entropy of a BCFT computed from the AdS/BCFT matched with that calculated from the Island formula, which supports the Island/BCFT correspondence in higher dimensions. Finally we show how we can calculate one point functions in a BCFT in our gravity dual.


title: Multi-Entanglement Routing Design over Quantum Networks

abstract: Quantum networks are considered as a promising future platform for quantum information exchange and quantum applications, which have capabilities far beyond the traditional communication networks. Remote quantum entanglement is an essential component of a quantum network. How to efficiently design a multi-routing entanglement protocol is a fundamental yet challenging problem. In this paper, we study a quantum entanglement routing problem to simultaneously maximize the number of quantum-user pairs and their expected throughput. Our approach is to formulate the problem as two sequential integer programming steps. We propose efficient entanglement routing algorithms for the two integer programming steps and analyze their time complexity and performance bounds. Results of evaluation highlight that our approach outperforms existing solutions in both served quantum-user pairs numbers and the network expected throughput.


title: The trace and Estrada index of uniform hypergraphs with cut vertices

abstract: Let $\mathcal{H}$ be an $m$-uniform hypergraph, and let $\mathcal{A}(\mathcal{H})$ be the adjacency tensor of $\mathcal{H}$ which can be viewed as a system of homogeneous polynomials of degree $m-1$. Morozov and Shakirov generalized the traces of linear systems to nonlinear homogeneous polynomial systems and obtained explicit formulas for multidimensional resultants. Sun, Zhou and Bu introduced the Estrada index of uniform hypergraphs which is closely related to the traces of their adjacency tensors. In this paper we give formulas for the traces of $\mathcal{A}(\mathcal{H})$ when $\mathcal{H}$ contains cut vertices, and obtain results on the traces and Estrada index when $\mathcal{H}$ is perturbed under local changes. We prove that among all hypertrees with fixed number of edges, the hyperpath is the unique one with minimum Estrada index and the hyperstar is the unique one with maximum Estrada index.


title: Leveraging Pre-Trained Language Models to Streamline Natural Language Interaction for Self-Tracking

abstract: Current natural language interaction for self-tracking tools largely depends on bespoke implementation optimized for a specific tracking theme and data format, which is neither generalizable nor scalable to a tremendous design space of self-tracking. However, training machine learning models in the context of self-tracking is challenging due to the wide variety of tracking topics and data formats. In this paper, we propose a novel NLP task for self-tracking that extracts close- and open-ended information from a retrospective activity log described as a plain text, and a domain-agnostic, GPT-3-based NLU framework that performs this task. The framework augments the prompt using synthetic samples to transform the task into 10-shot learning, to address a cold-start problem in bootstrapping a new tracking topic. Our preliminary evaluation suggests that our approach significantly outperforms the baseline QA models. Going further, we discuss future application domains toward which the NLP and HCI researchers can collaborate.


title: Stepping beyond your comfort zone: Diffusion-based network analytics for knowledge trajectory recommendation

abstract: Interest in tracing the research interests of scientific researchers is rising, and particularly that of predicting a researcher's knowledge trajectories beyond their current foci into potential inter-/cross-/multi-disciplinary interactions. Hence, in this study, we present a method of diffusion-based network analytics for knowledge trajectory recommendation. The method begins by constructing a heterogeneous bibliometric network consisting of a co-topic layer and a co-authorship layer. A novel link prediction approach with a diffusion strategy is then used to reflect real-world academic activity, such as knowledge sharing between co-authors or diffusing between similar research topics. This strategy differentiates the interactions occurring between homogeneous and heterogeneous nodes and weights the strengths of these interactions. Two sets of experiments - one with a local dataset and another with a global dataset - demonstrate that the proposed method is prior to selected baselines. In addition, to further examine the reliability of our method, we conducted a case study on recommending knowledge trajectories of selected information scientists and their research groups. The results demonstrate the empirical insights our method yields for individual researchers, communities, and research institutions in the information science discipline.


title: DNA Pattern Matching Acceleration with Analog Resistive CAM

abstract: DNA pattern matching is essential for many widely used bioinformatics applications. Disease diagnosis is one of these applications, since analyzing changes in DNA sequences can increase our understanding of possible genetic diseases. The remarkable growth in the size of DNA datasets has resulted in challenges in discovering DNA patterns efficiently in terms of run time and power consumption. In this paper, we propose an efficient hardware and software codesign that determines the chance of the occurrence of repeat-expansion diseases using DNA pattern matching. The proposed design parallelizes the DNA pattern matching task using associative memory realized with analog content-addressable memory and implements an algorithm that returns the maximum number of consecutive occurrences of a specific pattern within a DNA sequence. We fully implement all the required hardware circuits with PTM 45-nm technology, and we evaluate the proposed architecture on a practical human DNA dataset. The results show that our design is energy-efficient and significantly accelerates the DNA pattern matching task compared to previous approaches described in the literature.


title: Random node reinforcement and $K$-core structure of complex networks

abstract: To enhance robustness of complex networked systems, a simple method is introducing reinforced nodes which always function during failure propagation. A random scheme of node reinforcement can be considered as a benchmark for finding an optimal reinforcement solution. Yet there still lacks a systematic evaluation on how node reinforcement affects network structure at a mesoscopic level upon failures. Here we study this problem through the lens of $K$-cores of networks. Based on an analytical percolation framework, we first show that, on uncorrelated random graphs, with a critical size of reinforced nodes, an abrupt emergence of $K$-cores is smoothed out to a continuous one, and a detailed phase diagram is derived. We then show that, with a cost-benefit analysis on random reinforcement, for proper weight factors in cost functions with constant and increasing marginal costs, a gain function shows a unimodality, thus we can analytically find an optimal reinforcement fraction by locating the maximal gain. In all, our framework offers a gain-oriented analytical perspective to designing robust interconnected systems.


title: Local Spiral Structure Traced by Red Clump Stars

abstract: Using the cross-matched data of Gaia EDR3 and the 2MASS Point Source Catalog, a sample of RC stars with parallax accuracies better than 20% is identified and used to reveal the nearby spiral pattern traced by old stars. As shown in the overdensity distribution of RC stars, there is an arc-like feature extended from $l~\sim$ 90$^\circ$ to $\sim$ 243$^\circ$, which passed close to the Sun. This feature is probably an arm segment traced by old stars, indicating the Galaxy potential in the vicinity of the Sun. By comparing to the spiral arms depicted by young objects, we found that there are considerable offsets between the two different components of Galactic spiral arms. The spiral arm traced by RC stars tends to have a larger pitch angle, hence a more loose wound pattern.


title: Rethinking Graph Neural Networks for Anomaly Detection

abstract: Graph Neural Networks (GNNs) are widely applied for graph anomaly detection. As one of the key components for GNN design is to select a tailored spectral filter, we take the first step towards analyzing anomalies via the lens of the graph spectrum. Our crucial observation is the existence of anomalies will lead to the `right-shift' phenomenon, that is, the spectral energy distribution concentrates less on low frequencies and more on high frequencies. This fact motivates us to propose the Beta Wavelet Graph Neural Network (BWGNN). Indeed, BWGNN has spectral and spatial localized band-pass filters to better handle the `right-shift' phenomenon in anomalies. We demonstrate the effectiveness of BWGNN on four large-scale anomaly detection datasets. Our code and data are released at https://github.com/squareRoot3/Rethinking-Anomaly-Detection


title: ADAPT: Vision-Language Navigation with Modality-Aligned Action Prompts

abstract: Vision-Language Navigation (VLN) is a challenging task that requires an embodied agent to perform action-level modality alignment, i.e., make instruction-asked actions sequentially in complex visual environments. Most existing VLN agents learn the instruction-path data directly and cannot sufficiently explore action-level alignment knowledge inside the multi-modal inputs. In this paper, we propose modAlity-aligneD Action PrompTs (ADAPT), which provides the VLN agent with action prompts to enable the explicit learning of action-level modality alignment to pursue successful navigation. Specifically, an action prompt is defined as a modality-aligned pair of an image sub-prompt and a text sub-prompt, where the former is a single-view observation and the latter is a phrase like ''walk past the chair''. When starting navigation, the instruction-related action prompt set is retrieved from a pre-built action prompt base and passed through a prompt encoder to obtain the prompt feature. Then the prompt feature is concatenated with the original instruction feature and fed to a multi-layer transformer for action prediction. To collect high-quality action prompts into the prompt base, we use the Contrastive Language-Image Pretraining (CLIP) model which has powerful cross-modality alignment ability. A modality alignment loss and a sequential consistency loss are further introduced to enhance the alignment of the action prompt and enforce the agent to focus on the related prompt sequentially. Experimental results on both R2R and RxR show the superiority of ADAPT over state-of-the-art methods.


title: Molecular Dipole Moment Learning via Rotationally Equivariant Gaussian Process Regression with Derivatives in Molecular-orbital-based Machine Learning

abstract: This study extends the accurate and transferable molecular-orbital-based machine learning (MOB-ML) approach to modeling the contribution of electron correlation to dipole moments at the cost of Hartree-Fock computations. A molecular-orbital-based (MOB) pairwise decomposition of the correlation part of the dipole moment is applied, and these pair dipole moments could be further regressed as a universal function of molecular orbitals (MOs). The dipole MOB features consist of the energy MOB features and their responses to electric fields. An interpretable and rotationally equivariant Gaussian process regression (GPR) with derivatives algorithm is introduced to learn the dipole moment more efficiently. The proposed problem setup, feature design, and ML algorithm are shown to provide highly-accurate models for both dipole moment and energies on water and fourteen small molecules. To demonstrate the ability of MOB-ML to function as generalized density-matrix functionals for molecular dipole moments and energies of organic molecules, we further apply the proposed MOB-ML approach to train and test the molecules from the QM9 dataset. The application of local scalable GPR with Gaussian mixture model unsupervised clustering (GMM/GPR) scales up MOB-ML to a large-data regime while retaining the prediction accuracy. In addition, compared with literature results, MOB-ML provides the best test MAEs of 4.21 mDebye and 0.045 kcal/mol for dipole moment and energy models, respectively, when training on 110000 QM9 molecules. The excellent transferability of the resulting QM9 models is also illustrated by the accurate predictions for four different series of peptides.


title: Enhancing Event-Level Sentiment Analysis with Structured Arguments

abstract: Previous studies about event-level sentiment analysis (SA) usually model the event as a topic, a category or target terms, while the structured arguments (e.g., subject, object, time and location) that have potential effects on the sentiment are not well studied. In this paper, we redefine the task as structured event-level SA and propose an End-to-End Event-level Sentiment Analysis ($\textit{E}^{3}\textit{SA}$) approach to solve this issue. Specifically, we explicitly extract and model the event structure information for enhancing event-level SA. Extensive experiments demonstrate the great advantages of our proposed approach over the state-of-the-art methods. Noting the lack of the dataset, we also release a large-scale real-world dataset with event arguments and sentiment labelling for promoting more researches\footnote{The dataset is available at https://github.com/zhangqi-here/E3SA}.


title: Nearly Minimax Optimal Offline Reinforcement Learning with Linear Function Approximation: Single-Agent MDP and Markov Game

abstract: Offline reinforcement learning (RL) aims at learning an optimal strategy using a pre-collected dataset without further interactions with the environment. While various algorithms have been proposed for offline RL in the previous literature, the minimax optimality has only been (nearly) established for tabular Markov decision processes (MDPs). In this paper, we focus on offline RL with linear function approximation and propose a new pessimism-based algorithm for offline linear MDP. At the core of our algorithm is the uncertainty decomposition via a reference function, which is new in the literature of offline RL under linear function approximation. Theoretical analysis demonstrates that our algorithm can match the performance lower bound up to logarithmic factors. We also extend our techniques to the two-player zero-sum Markov games (MGs), and establish a new performance lower bound for MGs, which tightens the existing result, and verifies the nearly minimax optimality of the proposed algorithm. To the best of our knowledge, these are the first computationally efficient and nearly minimax optimal algorithms for offline single-agent MDPs and MGs with linear function approximation.


title: A Unified Framework for Emotion Identification and Generation in Dialogues

abstract: Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and promote social chatbots, we need to concentrate on increasing user interaction and take into account both the intellectual and emotional quotient in the conversational agents. In this paper, we propose a multi-task framework that jointly identifies the emotion of a given dialogue and generates response in accordance to the identified emotion. We employ a BERT based network for creating an empathetic system and use a mixed objective function that trains the end-to-end network with both the classification and generation loss. Experimental results show that our proposed framework outperforms current state-of-the-art models


title: A Knowledge-Enhanced Adversarial Model for Cross-lingual Structured Sentiment Analysis

abstract: Structured sentiment analysis, which aims to extract the complex semantic structures such as holders, expressions, targets, and polarities, has obtained widespread attention from both industry and academia. Unfortunately, the existing structured sentiment analysis datasets refer to a few languages and are relatively small, limiting neural network models' performance. In this paper, we focus on the cross-lingual structured sentiment analysis task, which aims to transfer the knowledge from the source language to the target one. Notably, we propose a Knowledge-Enhanced Adversarial Model (\texttt{KEAM}) with both implicit distributed and explicit structural knowledge to enhance the cross-lingual transfer. First, we design an adversarial embedding adapter for learning an informative and robust representation by capturing implicit semantic information from diverse multi-lingual embeddings adaptively. Then, we propose a syntax GCN encoder to transfer the explicit semantic information (e.g., universal dependency tree) among multiple languages. We conduct experiments on five datasets and compare \texttt{KEAM} with both the supervised and unsupervised methods. The extensive experimental results show that our \texttt{KEAM} model outperforms all the unsupervised baselines in various metrics.


title: Impact of gravitational lensing on black hole mass function inference with third-generation gravitational wave detectors

abstract: The recent rapid growth of the black hole (BH) catalog from gravitational waves (GWs), has allowed us to study the substructure of black hole mass function (BHMF) beyond the simplest Power-Law distribution. However, the BH masses inferred from binary BH merger events, may be systematically 'brightened' or 'dimmed' by the gravitational lensing effect. In this work, we investigate the impact of gravitational lensing on the BHMF inference considering the detection of the third-generation GW detector -- the Einstein Telescope (ET). We focus on high redshift, $z=10$, in order to obtain the upper limits of this effect. We use Monte Carlo (MC) method to simulate the data adopting 3 original BHMFs under Un-Lensed and Lensed scenarios, then recover the parameters of BHMFs from the mock data, and compare the difference of results, respectively. We found that all the parameters are well recovered within one standard deviation(std., 1$\sigma$), and all 3 BHMF models are reconstructed within 68\% credible interval, suggesting that lensing would not change the main structure drastically, even at very high redshifts and with high precision of ET. And the modest influence beyond $50M_{\odot}$, depends on the modeling of the high mass tail or substructure of BHMF. We conclude that the impact of lensing on BHMF inference with ET can be safely ignored in the foreseeable future. Careful handling of lensing effects is required only when focusing on an accurate estimation of the high mass end of BHMF at high redshifts.


title: Multi-Scan Multi-Sensor Multi-Object State Estimation

abstract: If computational tractability were not an issue, multi-object estimation should integrate all measurements from multiple sensors across multiple scans. In this article, we propose an efficient numerical solution to the multi-scan multi-sensor multi-object estimation problem by computing the (labeled) multi-sensor multi-object posterior density. Minimizing the $L_{1}$-norm error from the exact posterior density requires solving large-scale multi-dimensional assignment problems that are NP-hard. An efficient multi-dimensional assignment algorithm is developed based on Gibbs sampling, together with convergence analysis. The resulting multi-scan multi-sensor multi-object estimation algorithm can be applied either offline in one batch or recursively. The efficacy of the algorithm is demonstrated using numerical experiments with a simulated dataset.


title: IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis

abstract: Existing 3D-aware facial generation methods face a dilemma in quality versus editability: they either generate editable results in low resolution or high-quality ones with no editing flexibility. In this work, we propose a new approach that brings the best of both worlds together. Our system consists of three major components: (1) a 3D-semantics-aware generative model that produces view-consistent, disentangled face images and semantic masks; (2) a hybrid GAN inversion approach that initialize the latent codes from the semantic and texture encoder, and further optimized them for faithful reconstruction; and (3) a canonical editor that enables efficient manipulation of semantic masks in canonical view and product high-quality editing results. Our approach is competent for many applications, e.g. free-view face drawing, editing, and style control. Both quantitative and qualitative results show that our method reaches the state-of-the-art in terms of photorealism, faithfulness, and efficiency.


title: On Forward Kinematics of a 3SPR Parallel Manipulator

abstract: In this paper, a new numerical method to solve the forward kinematics (FK) of a parallel manipulator with three-limb spherical-prismatic-revolute (3SPR) structure is presented. Unlike the existing numerical approaches that rely on computation of the manipulator's Jacobian matrix and its inverse at each iteration, the proposed algorithm requires much less computations to estimate the FK parameters. A cost function is introduced that measures the difference of the estimates from the actual FK values. At each iteration, the problem is decomposed into two steps. First, the estimates of the platform orientation from the heave estimates are obtained. Then, heave estimates are updated by moving in the gradient direction of the proposed cost function. To validate the performance of the proposed algorithm, it is compared against a Jacobian-based (JB) approach for a 3SPR parallel manipulator.


title: Vector-wise Joint Diagonalization of Almost Commuting Matrices

abstract: This work aims to numerically construct exactly commuting matrices close to given almost commuting ones, which is equivalent to the joint approximate diagonalization problem. We first prove that almost commuting matrices generically have approximate common eigenvectors that are almost orthogonal to each other. Based on this key observation, we propose a fast and robust vector-wise joint diagonalization (VJD) algorithm, which constructs the orthogonal similarity transform by sequentially finding these approximate common eigenvectors. In doing so, we consider sub-optimization problems over the unit sphere, for which we present a Riemannian quasi-Newton method with rigorous convergence analysis. We also discuss the numerical stability of the proposed VJD algorithm. Numerical examples with applications in independent component analysis are provided to reveal the relation with Huaxin Lin's theorem and to demonstrate that our method compares favorably with the state-of-the-art Jacobi-type joint diagonalization algorithm.


title: Optimizing the Deployment of Reconfigurable Intelligent Surfaces in MmWave Vehicular Systems

abstract: Millimeter wave (MmWave) systems are vulnerable to blockages, which cause signal drop and link outage. One solution is to deploy reconfigurable intelligent surfaces (RISs) to add a strong non-line-of-sight path from the transmitter to receiver. To achieve the best performance, the location of the deployed RIS should be optimized for a given site, considering the distribution of potential users and possible blockers. In this paper, we find the optimal location, height and downtilt of RIS working in a realistic vehicular scenario. Because of the proximity between the RIS and the vehicles, and the large electrical size of the RIS, we consider a 3D geometry including the elevation angle and near-field beamforming. We provide results on RIS configuration in terms of both coverage ratio and area-averaged rate. We find that the optimized RIS improves the average averaged rate fifty percent over the case without a RIS, as well as further improvements in the coverage ratio.


title: An Analytical Formula for Determining the Electrical Impedance between a Single Adherent Cell and Sensor Substrate

abstract: An analytical formula for electrical impedance between an adherent living cell and sensor substrate measured using a microelectrode is presented for the first time. Previously-reported formula has been applicable only for the case where many cells are on a large electrode. In contrast, our formula is valid even when a microelectrode smaller than the cell size is underneath the cell, which is often the case for the state-of-the-art single-cell analysis. Numerical simulations for verifying the accuracy of our formula reveals that the discrepancies between the theoretical impedances calculated by our formula and numerical simulation results are negligibly small. Our formula will be useful for describing cell-substrate impedance properties in equivalent circuit model analysis or sensor design optimizations.


title: Surface valence transition in SmS by alkali metal adsorption

abstract: The electronic structure changes of SmS surfaces under potassium (K) doping are elucidated using synchrotron-based core-level photoelectron spectroscopy and angle-resolved photoelectron spectroscopy (ARPES). The Sm core-level and ARPES spectra indicate that the Sm mean valence of the surface increased from the nearly divalent to trivalent states, with increasing K deposition. Carrier-induced valence transition (CIVT) from Sm$^{2+}$ to Sm$^{3+}$ exhibits a behavior opposite to that under conventional electron doping. Excess electrons are trapped by isolated excitons, which is inconsistent with the phase transition from the black insulator with Sm$^{2+}$ to the gold metal with Sm$^{3+}$ under pressure. This CIVT helps to clarify the pressure-induced black-to-golden phase transition in this material, which originates from the Mott transition of excitons.


title: Variational Transfer Learning using Cross-Domain Latent Modulation

abstract: To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to achieve effective transfer learning. Our key idea is to procure deep representations from one data domain and use it to influence the reparameterization of the latent variable of another domain. Specifically, deep representations of the source and target domains are first extracted by a unified inference model and aligned by employing gradient reversal. The learned deep representations are then cross-modulated to the latent encoding of the alternative domain, where consistency constraints are also applied. In the empirical validation that includes a number of transfer learning benchmark tasks for unsupervised domain adaptation and image-to-image translation, our model demonstrates competitive performance, which is also supported by evidence obtained from visualization.


title: Symmetrized two-scale finite element discretizations for partial differential equations with symmetric solutions

abstract: In this paper, a symmetrized two-scale finite element method is proposed for a class of partial differential equations with symmetric solutions. With this method, the finite element approximation on a fine tensor product grid is reduced to the finite element approximations on a much coarse grid and a univariant fine grid. It is shown by both theory and numerics including electronic structure calculations that the resulting approximation still maintains an asymptotically optimal accuracy. Consequently the symmetrized two-scale finite element method reduces computational cost significantly.


title: Gapless symmetry-protected topological phase of quantum antiferromagnets on anisotropic triangular strip

abstract: We study a three-leg spin-1/2 ladder with geometrically frustrated interleg interactions. We call this model an anisotropic triangular-strip (ATS) model. We numerically and field-theoretically show that its ground state belongs to a gapless symmetry-protected topological (SPT) phase. The numerical approach is based on density-matrix renormalization group analyses of the entanglement entropy and the entanglement spectrum. Whereas the entanglement entropy exhibits a critical behavior, the entanglement spectrum is nontrivially degenerate. These entanglement properties imply that the ground state is a gapless topological phase. We investigate the ATS model using a quantum field theory to support the numerical findings. When the frustrated interchain interaction is deemed a perturbation acting on the three spin chains, the frustrated interchain interaction almost isolates the second chain from the other two chains. However, at the same time, the second chain mediates a ferromagnetic interaction between the first and third chains. Therefore, the ground state of the ATS model is a gapless Tomonaga-Luttinger liquid weakly coupled to a spin-1 Haldane chain with irrelevant interactions. Last but not least, we show that the gapless SPT phase of the ATS model is a symmetry-protected critical phase. We point out that the symmetry protection of criticality is essential in characterization of the gapless SPT phase.


title: Unicellular LLT polynomials and twin of regular semisimple Hessenberg varieties

abstract: The solution of Shareshian-Wachs conjecture by Brosnan-Chow linked together the cohomology of regular semisimple Hessenberg varieties and graded chromatic symmetric functions on unit interval graphs. On the other hand, it is known that unicellular LLT polynomials have similar properties to graded chromatic symmetric functions. In this paper, we link together the unicellular LLT polynomials and twin of regular semisimple Hessenberg varieties introduced by Ayzenberg-Buchstaber. We prove their palindromicity from topological viewpoint. We also show that modules of a symmetric group generated by faces of a permutohedron are related to a shifted unicellular LLT polynomial and observe the $e$-positivity of shifted unicellular LLT polynomials, which is established by Alexandersson-Sulzgruber in general, for path graphs and complete graphs through the cohomology of the twins.


title: Complete analysis of the maximally hyperentangled state via the weak cross-Kerr nonlinearity

abstract: We present a simple method for the complete analysis of maximally hyperentangled state in polarization and spatial-mode degrees of freedom assisted by the weak cross-Kerr nonlinearity. Our method not only can be used for two-photon hyperentangled Bell state analysis and three-photon hyperentangled Greenberger-Horne-Zeilinger (GHZ) state analysis, but also is suitable for N-photon hyperentangled GHZ state analysis. In our protocols, the bit information of hyperentanglement is read out via the nonlinear interaction, and the phase information is obtained by using linear optical element and single photon detector. This approach is achievable with the current technology, and will be useful for the practical high-capacity quantum communication schemes.


title: Enabling NLoS LEO Satellite Communications with Reconfigurable Intelligent Surfaces

abstract: Low Earth Orbit (LEO) satellite communications (SatCom) are considered a promising solution to provide uninterrupted services in cellular networks. Line-of-sight (LoS) links between the LEO satellites and the ground users are, however, easily blocked in urban scenarios. In this paper, we propose to enable LEO SatCom in non-line-of-sight (NLoS) channels, as those corresponding to links to users in urban canyons, with the aid of reconfigurable intelligent surfaces (RISs). First, we derive the near field signal model for the satellite-RIS-user link. Then, we propose two deployments to improve the coverage of a RIS-aided link: down tilting the RIS located on the top of a building, and considering a deployment with RISs located on the top of opposite buildings. Simulation results show the effectiveness of using RISs in LEO SatCom to overcome blockages in urban canyons. Insights about the optimal tilt angle and the coverage extension provided by the deployment of an additional RIS are also provided.


title: Observation of Non-Markovian Spin Dynamics in a Jaynes-Cummings-Hubbard Model using a Trapped-Ion Quantum Simulator

abstract: Jaynes-Cummings-Hubbard (JCH) model is a fundamental many-body model for light-matter interaction. As a leading platform for quantum simulation, the trapped ion system has realized the JCH model for two to three ions. Here we report the quantum simulation of the JCH model using up to 32 ions. We verify the simulation results even for large ion numbers by engineering low excitations and thus low effective dimensions; then we extend to 32 excitations for an effective dimension of $2^{77}$, which is difficult for classical computers. By regarding the phonon modes as baths, we explore Markovian or non-Markovian spin dynamics in different parameter regimes of the JCH model, similar to quantum emitters in a structured photonic environment. We further examine the dependence of the non-Markovian dynamics on the effective Hilbert space dimension. Our work demonstrates the trapped ion system as a powerful quantum simulator for many-body physics and open quantum systems.


title: Pseudo-Data based Self-Supervised Federated Learning for Classification of Histopathological Images

abstract: Computer-aided diagnosis (CAD) can help pathologists improve diagnostic accuracy together with consistency and repeatability for cancers. However, the CAD models trained with the histopathological images only from a single center (hospital) generally suffer from the generalization problem due to the straining inconsistencies among different centers. In this work, we propose a pseudo-data based self-supervised federated learning (FL) framework, named SSL-FT-BT, to improve both the diagnostic accuracy and generalization of CAD models. Specifically, the pseudo histopathological images are generated from each center, which contains inherent and specific properties corresponding to the real images in this center, but does not include the privacy information. These pseudo images are then shared in the central server for self-supervised learning (SSL). A multi-task SSL is then designed to fully learn both the center-specific information and common inherent representation according to the data characteristics. Moreover, a novel Barlow Twins based FL (FL-BT) algorithm is proposed to improve the local training for the CAD model in each center by conducting contrastive learning, which benefits the optimization of the global model in the FL procedure. The experimental results on three public histopathological image datasets indicate the effectiveness of the proposed SSL-FL-BT on both diagnostic accuracy and generalization.


title: itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detection

abstract: Point-cloud based 3D object detectors recently have achieved remarkable progress. However, most studies are limited to the development of network architectures for improving only their accuracy without consideration of the computational efficiency. In this paper, we first propose an autoencoder-style framework comprising channel-wise compression and decompression via interchange transfer-based knowledge distillation. To learn the map-view feature of a teacher network, the features from teacher and student networks are independently passed through the shared autoencoder; here, we use a compressed representation loss that binds the channel-wised compression knowledge from both student and teacher networks as a kind of regularization. The decompressed features are transferred in opposite directions to reduce the gap in the interchange reconstructions. Lastly, we present an head attention loss to match the 3D object detection information drawn by the multi-head self-attention mechanism. Through extensive experiments, we verify that our method can train the lightweight model that is well-aligned with the 3D point cloud detection task and we demonstrate its superiority using the well-known public datasets; e.g., Waymo and nuScenes.


title: Dataset Bias in Android Malware Detection

abstract: Researchers have proposed kinds of malware detection methods to solve the explosive mobile security threats. We argue that the experiment results are inflated due to the research bias introduced by the variability of malware dataset. We explore the impact of bias in Android malware detection in three aspects, the method used to flag the ground truth, the distribution of malware families in the dataset, and the methods to use the dataset. We implement a set of experiments of different VT thresholds and find that the methods used to flag the malware data affect the malware detection performance directly. We further compare the impact of malware family types and composition on malware detection in detail. The superiority of each approach is different under various combinations of malware families. Through our extensive experiments, we showed that the methods to use the dataset can have a misleading impact on evaluation, and the performance difference can be up to over 40%. We argue that these research biases observed in this paper should be carefully controlled/eliminated to enforce a fair comparison of malware detection techniques. Providing reasonable and explainable results is better than only reporting a high detection accuracy with vague dataset and experimental settings.


title: R-symmetries and curvature constraints in A-twisted heterotic Landau-Ginzburg models

abstract: In this paper, we discuss various aspects of a class of A-twisted heterotic Landau-Ginzburg models on a Kaehler variety X. We provide a classification of the R-symmetries in these models which allow the A-twist to be implemented, focusing on the case in which the gauge bundle is either a deformation of the tangent bundle of X or a deformation of a sub-bundle of the tangent bundle of X. Some anomaly-free examples are provided. The curvature constraint imposed by supersymmetry in these models when the superpotential is not holomorphic is reviewed. Constraints of this nature have been used to establish properties of analogues of pullbacks of Mathai-Quillen forms which arise in the correlation functions of the corresponding A-twisted or B-twisted heterotic Landau-Ginzburg models. The analogue most relevant to this paper is a deformation of the pullback of a Mathai-Quillen form. We discuss how this deformation may arise in the class of models studied in this paper. We then comment on how analogues of pullbacks of Mathai-Quillen forms not discussed in previous work may be obtained. Standard Mathai-Quillen formalism is reviewed in an appendix. We also include an appendix which discusses the deformation of the pullback of a Mathai-Quillen form.


title: Gluing Neural Networks Symbolically Through Hyperdimensional Computing

abstract: Hyperdimensional Computing affords simple, yet powerful operations to create long Hyperdimensional Vectors (hypervectors) that can efficiently encode information, be used for learning, and are dynamic enough to be modified on the fly. In this paper, we explore the notion of using binary hypervectors to directly encode the final, classifying output signals of neural networks in order to fuse differing networks together at the symbolic level. This allows multiple neural networks to work together to solve a problem, with little additional overhead. Output signals just before classification are encoded as hypervectors and bundled together through consensus summation to train a classification hypervector. This process can be performed iteratively and even on single neural networks by instead making a consensus of multiple classification hypervectors. We find that this outperforms the state of the art, or is on a par with it, while using very little overhead, as hypervector operations are extremely fast and efficient in comparison to the neural networks. This consensus process can learn online and even grow or lose models in real time. Hypervectors act as memories that can be stored, and even further bundled together over time, affording life long learning capabilities. Additionally, this consensus structure inherits the benefits of Hyperdimensional Computing, without sacrificing the performance of modern Machine Learning. This technique can be extrapolated to virtually any neural model, and requires little modification to employ - one simply requires recording the output signals of networks when presented with a testing example.


title: Do Customized Android Frameworks Keep Pace with Android?

abstract: To satisfy varying customer needs, device vendors and OS providers often rely on the open-source nature of the Android OS and offer customized versions of the Android OS. When a new version of the Android OS is released, device vendors and OS providers need to merge the changes from the Android OS into their customizations to account for its bug fixes, security patches, and new features. Because developers of customized OSs might have made changes to code locations that were also modified by the developers of the Android OS, the merge task can be characterized by conflicts, which can be time-consuming and error-prone to resolve. To provide more insight into this critical aspect of the Android ecosystem, we present an empirical study that investigates how eight open-source customizations of the Android OS merge the changes from the Android OS into their projects. The study analyzes how often the developers from the customized OSs merge changes from the Android OS, how often the developers experience textual merge conflicts, and the characteristics of these conflicts. Furthermore, to analyze the effect of the conflicts, the study also analyzes how the conflicts can affect a randomly selected sample of 1,000 apps. After analyzing 1,148 merge operations, we identified that developers perform these operations for 9.7\% of the released versions of the Android OS, developers will encounter at least one conflict in 41.3\% of the merge operations, 58.1\% of the conflicts required developers to change the customized OSs, and 64.4\% of the apps considered use at least one method affected by a conflict. In addition to detailing our results, the paper also discusses the implications of our findings and provides insights for researchers and practitioners working with Android and its customizations.


title: DeepDefacer: Automatic Removal of Facial Features via U-Net Image Segmentation

abstract: Recent advancements in the field of magnetic resonance imaging (MRI) have enabled large-scale collaboration among clinicians and researchers for neuroimaging tasks. However, researchers are often forced to use outdated and slow software to anonymize MRI images for publication. These programs specifically perform expensive mathematical operations over 3D images that rapidly slow down anonymization speed as an image's volume increases in size. In this paper, we introduce DeepDefacer, an application of deep learning to MRI anonymization that uses a streamlined 3D U-Net network to mask facial regions in MRI images with a significant increase in speed over traditional de-identification software. We train DeepDefacer on MRI images from the Brain Development Organization (IXI) and International Consortium for Brain Mapping (ICBM) and quantitatively evaluate our model against a baseline 3D U-Net model with regards to Dice, recall, and precision scores. We also evaluate DeepDefacer against Pydeface, a traditional defacing application, with regards to speed on a range of CPU and GPU devices and qualitatively evaluate our model's defaced output versus the ground truth images produced by Pydeface. We provide a link to a PyPi program at the end of this manuscript to encourage further research into the application of deep learning to MRI anonymization.


title: All Optical Integrated MOEMS Optical Coherence Tomography System

abstract: Integrating all optical components of an optical coherence tomography (OCT) device into a single chip is a non-trivial and a challenging job. The design and development of such a lab-on-a chip will be possible only via Micro-Opto-Electro-Mechanical System (MOEMS) technology. The reproducible and integrated optical device fabrication would reduce cost and size many fold as compared to bulk or fiber optic OCT system. A miniaturized OCT of size less than 5mm$^2$ area is designed, simulated and optimized. The successful fabrication of this device would help in point-of-contact devices as well as embedded biomedical sensor applications. Also, the design promises the possibility of fabrication of all optical components of OCT integrated into a single chip.


title: Twenty years of quantum contextuality at USTC

abstract: Quantum contextuality is one of the most perplexing and peculiar features of quantum mechanics. Concisely, it refers to the observation that the result of a single measurement in quantum mechanics depends on the set of joint measurements actually performed. The study of contextuality has a long history at University of Science and Technology of China (USTC). Here we review the theoretical and experimental advances in this direction achieved at USTC over the last 20 years. We start by introducing the renowned simplest proof of state-independent contextuality. We then present several experimental tests of quantum versus noncontextual theories with photons. Finally, we discuss the investigation on the role of contextuality in general quantum information science and its application in quantum computation.


title: n-Type diamond synthesized with tert-butylphosphine for long spin coherence times of perfectly aligned NV centers

abstract: The longest spin coherence times for nitrogen-vacancy (NV) centers at room temperature have been achieved in phosphorus-doped n-type diamond. However, difficulty controlling impurity incorporation and the utilization of highly toxic phosphine gas in the chemical vapor deposition (CVD) technique pose problems for the growth of n-type diamond. In the present study, n-type diamond samples were synthesized by CVD using tert-butylphosphine, which is much less toxic than phosphine. The unintentional incorporation of nitrogen was found to be suppressed by incrementally increasing the gas flow rates of H2 and CH$_4$. Hall measurements confirmed n-type conduction in three measured samples prepared under different growth conditions. The highest measured Hall mobility at room temperature was 422 cm$^2$/(Vs). In the sample with the lowest nitrogen concentration, the spin coherence time ($T_2$) increased to 1.62 $\pm$ 0.10 ms. Optically detected magnetic resonance spectra indicated that all of the measured NV centers were aligned along the [111] direction. This study provides appropriate CVD conditions for growing phosphorus-doped n-type diamond with perfectly aligned NV centers exhibiting long spin coherence times, which is important for the production of quantum diamond devices.


title: MACE: An Efficient Model-Agnostic Framework for Counterfactual Explanation

abstract: Counterfactual explanation is an important Explainable AI technique to explain machine learning predictions. Despite being studied actively, existing optimization-based methods often assume that the underlying machine-learning model is differentiable and treat categorical attributes as continuous ones, which restricts their real-world applications when categorical attributes have many different values or the model is non-differentiable. To make counterfactual explanation suitable for real-world applications, we propose a novel framework of Model-Agnostic Counterfactual Explanation (MACE), which adopts a newly designed pipeline that can efficiently handle non-differentiable machine-learning models on a large number of feature values. in our MACE approach, we propose a novel RL-based method for finding good counterfactual examples and a gradient-less descent method for improving proximity. Experiments on public datasets validate the effectiveness with better validity, sparsity and proximity.


title: Dynamics of the US domestic airline network during the COVID-19 pandemic

abstract: The ongoing COVID-19 pandemic has had serious impacts on the airline industry. Ensuring that aviation policies in emergent situations both guarantee network connectivity and maintain competition among airlines is crucial in these circumstances. To this end, we aimed to understand the network dynamics of individual airlines. In this study, we quantitatively reveal the day-to-day dynamics of these US domestic airline networks, comprising 17 airlines, from January 2019 to December 2021. Specifically, we applied a framework for analyzing temporal networks, in which the network structure changes over time. We found that, first, even though the number of nodes and edges returned to pre-pandemic levels around July 2021, the structure of the entire US domestic airline network remained altered. We also found that the network dynamics varied significantly from airline to airline. Full-service carriers were less flexible in changing their network structure and suffered higher revenue losses. On the contrary, most regional carriers completely shifted to a new structure, which may have contributed to reducing their revenue losses. Low-cost carriers were characterized by more pronounced differences between airlines and drastically changed their network structure immediately after the declaration of a national emergency.


title: On Gorenstein homological dimension of groups

abstract: Let $G$ be a group and $R$ be a ring. We define the Gorenstein homological dimension of $G$ over $R$, denoted by ${\rm Ghd}_{R}G$, as the Gorenstein flat dimension of trivial $RG$-module $R$. It is proved that ${\rm Ghd}_SG \leq {\rm Ghd}_RG$ for any flat extension of commutative rings $R\rightarrow S$; in particular, ${\rm Ghd}_{R}G$ is a refinement of ${\rm Ghd}_{\mathbb{Z}}G$ if $R$ is $\mathbb{Z}$-torsion-free. We show a Gorenstein homological version of Serre's theorem, i.e. ${\rm Ghd}_{R}G = {\rm Ghd}_{R}H$ for any subgroup $H$ of $G$ with finite index. As an application, $G$ is a finite group if and only if ${\rm Ghd}_{R}G = 0$; this is different from the fact that the homological dimension of any non-trivial finite group is infinity.


title: AI-based automated Meibomian gland segmentation, classification and reflection correction in infrared Meibography

abstract: Purpose: Develop a deep learning-based automated method to segment meibomian glands (MG) and eyelids, quantitatively analyze the MG area and MG ratio, estimate the meiboscore, and remove specular reflections from infrared images. Methods: A total of 1600 meibography images were captured in a clinical setting. 1000 images were precisely annotated with multiple revisions by investigators and graded 6 times by meibomian gland dysfunction (MGD) experts. Two deep learning (DL) models were trained separately to segment areas of the MG and eyelid. Those segmentation were used to estimate MG ratio and meiboscores using a classification-based DL model. A generative adversarial network was implemented to remove specular reflections from original images. Results: The mean ratio of MG calculated by investigator annotation and DL segmentation was consistent 26.23% vs 25.12% in the upper eyelids and 32.34% vs. 32.29% in the lower eyelids, respectively. Our DL model achieved 73.01% accuracy for meiboscore classification on validation set and 59.17% accuracy when tested on images from independent center, compared to 53.44% validation accuracy by MGD experts. The DL-based approach successfully removes reflection from the original MG images without affecting meiboscore grading. Conclusions: DL with infrared meibography provides a fully automated, fast quantitative evaluation of MG morphology (MG Segmentation, MG area, MG ratio, and meiboscore) which are sufficiently accurate for diagnosing dry eye disease. Also, the DL removes specular reflection from images to be used by ophthalmologists for distraction-free assessment.


title: Refining Low-Resource Unsupervised Translation by Language Disentanglement of Multilingual Model

abstract: Numerous recent work on unsupervised machine translation (UMT) implies that competent unsupervised translations of low-resource and unrelated languages, such as Nepali or Sinhala, are only possible if the model is trained in a massive multilingual environment, where these low-resource languages are mixed with high-resource counterparts. Nonetheless, while the high-resource languages greatly help kick-start the target low-resource translation tasks, the language discrepancy between them may hinder their further improvement. In this work, we propose a simple refinement procedure to separate languages from a pre-trained multilingual UMT model for it to focus on only the target low-resource task. Our method achieves the state of the art in the fully unsupervised translation tasks of English to Nepali, Sinhala, Gujarati, Latvian, Estonian and Kazakh, with BLEU score gains of 3.5, 3.5, 3.3, 4.1, 4.2, and 3.3, respectively. Our codebase is available at https://github.com/nxphi47/refine_unsup_multilingual_mt


title: Rethinking Block Storage Encryption with Virtual Disks

abstract: Disk encryption today uses standard encryption methods that are length preserving and do not require storing any additional information with an encrypted disk sector. This significantly simplifies disk encryption management as the disk mapping does not change with encryption. On the other hand, it forces the encryption to be deterministic when data is being overwritten and it disallows integrity mechanisms, thus lowering security guarantees. Moreover, because the most widely used standard encryption methods (like AES-XTS) work at small sub-blocks of no more than 32 bytes, deterministic overwrites form an even greater security risk. Overall, today's standard practice forfeits some security for ease of management and performance considerations. This shortcoming is further amplified in a virtual disk setting that supports versioning and snapshots so that overwritten data remains accessible. In this work, we address these concerns and stipulate that especially with virtual disks, there is motivation and potential to improve security at the expense of a small performance overhead. Specifically, adding per-sector metadata to a virtual disk allows running encryption with a random initialization vector (IV) as well as potentially adding integrity mechanisms. We explore how best to implement additional per-sector information in Ceph RBD, a popular open-source distributed block storage with client-side encryption. We implement and evaluate several approaches and show that one can run AES-XTS encryption with a random IV at a manageable overhead ranging from 1\%--22\%, depending on the IO size.


title: Identifying and Characterizing Silently-Evolved Methods in the Android API

abstract: With over 500,000 commits and more than 700 contributors, the Android platform is undoubtedly one of the largest industrial-scale software projects. This project provides the Android API, and developers heavily rely on this API to develop their Android apps. Unfortunately, because the Android platform and its API evolve at an extremely rapid pace, app developers need to continually monitor API changes to avoid compatibility issues in their apps (\ie issues that prevent apps from working as expected when running on newer versions of the API). Despite a large number of studies on compatibility issues in the Android API, the research community has not yet investigated issues related to silently-evolved methods (SEMs). These methods are functions whose behavior might have changed but the corresponding documentation did not change accordingly. Because app developers rely on the provided documentation to evolve their apps, changes to methods that are not suitably documented may lead to unexpected failures in the apps using these methods. To shed light on this type of issue, we conducted a large-scale empirical study in which we identified and characterized SEMs across ten versions of the Android API. In the study, we identified SEMs, characterized the nature of the changes, and analyzed the impact of SEMs on a set of 1,000 real-world Android apps. Our experimental results show that SEMs do exist in the Android API, and that 957 of the apps we considered use at least one SEM. Based on these results, we argue that the Android platform developers should take actions to avoid introducing SEMs, especially those involving semantic changes. This situation highlights the need for automated techniques and tools to help Android practitioners in this task.


title: Discovery of Keys for Graphs [Extended Version]

abstract: Keys for graphs uses the topology and value constraints needed to uniquely identify entities in a graph database. They have been studied to support object identification, knowledge fusion, data deduplication, and social network reconciliation. In this paper, we present our algorithm to mine keys over graphs. Our algorithm discovers keys in a graph via frequent subgraph expansion. We present two properties that define a meaningful key, including minimality and support. Lastly, using real-world graphs, we experimentally verify the efficiency of our algorithm on real world graphs.


title: Robust Projection based Anomaly Extraction (RPE) in Univariate Time-Series

abstract: This paper presents a novel, closed-form, and data/computation efficient online anomaly detection algorithm for time-series data. The proposed method, dubbed RPE, is a window-based method and in sharp contrast to the existing window-based methods, it is robust to the presence of anomalies in its window and it can distinguish the anomalies in time-stamp level. RPE leverages the linear structure of the trajectory matrix of the time-series and employs a robust projection step which makes the algorithm able to handle the presence of multiple arbitrarily large anomalies in its window. A closed-form/non-iterative algorithm for the robust projection step is provided and it is proved that it can identify the corrupted time-stamps. RPE is a great candidate for the applications where a large training data is not available which is the common scenario in the area of time-series. An extensive set of numerical experiments show that RPE can outperform the existing approaches with a notable margin.


title: VC Theoretical Explanation of Double Descent

abstract: There has been growing interest in generalization performance of large multilayer neural networks that can be trained to achieve zero training error, while generalizing well on test data. This regime is known as 'second descent' and it appears to contradict the conventional view that optimal model complexity should reflect an optimal balance between underfitting and overfitting, i.e., the bias-variance trade-off. This paper presents a VC-theoretical analysis of double descent and shows that it can be fully explained by classical VC-generalization bounds. We illustrate an application of analytic VC-bounds for modeling double descent for classification, using empirical results for several learning methods, such as SVM, Least Squares, and Multilayer Perceptron classifiers. In addition, we discuss several reasons for the misinterpretation of VC-theoretical results in Deep Learning community.


title: A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference

abstract: Natural Language Inference (NLI) is a growingly essential task in natural language understanding, which requires inferring the relationship between the sentence pairs (premise and hypothesis). Recently, low-resource natural language inference has gained increasing attention, due to significant savings in manual annotation costs and a better fit with real-world scenarios. Existing works fail to characterize discriminative representations between different classes with limited training data, which may cause faults in label prediction. Here we propose a multi-level supervised contrastive learning framework named MultiSCL for low-resource natural language inference. MultiSCL leverages a sentence-level and pair-level contrastive learning objective to discriminate between different classes of sentence pairs by bringing those in one class together and pushing away those in different classes. MultiSCL adopts a data augmentation module that generates different views for input samples to better learn the latent representation. The pair-level representation is obtained from a cross attention module. We conduct extensive experiments on two public NLI datasets in low-resource settings, and the accuracy of MultiSCL exceeds other models by 3.1% on average. Moreover, our method outperforms the previous state-of-the-art method on cross-domain tasks of text classification.


title: Simulation of Lindblad equations for quarkonium in the quark-gluon plasma

abstract: We study the properties of the Lindbladian quantum mechanical evolution of quarkonia with non-Abelian charges (color-singlet and octet) in the quark-gluon plasma. We confirm that heavy quark recoils in the Lindblad equation correctly thermalize quarkonium colorful states within statistical errors from the simulation method. We also demonstrate that the Lindblad equation in the dipole limit can provide an efficient alternative method, which is applicable to a finite time evolution before thermalization and dramatically reduces the numerical cost. Our findings will serve as a foundation for large-scale simulation of quarkonium dynamics in the relativistic heavy-ion collisions.

categories: nucl-th cond-mat.quant-gas hep-ph nucl-ex quant-ph


title: Standardizing reverberation-measured C IV time-lag quasars, and using them with standardized Mg II quasars to constrain cosmological parameters

abstract: We use 38 C IV quasar (QSO) reverberation-mapped (RM) observations, which span eight orders of magnitude in luminosity and the redshift range $0.001064 \leq z \leq 3.368$, to simultaneously constrain cosmological-model and QSO radius-luminosity ($R-L$) relation parameters in six cosmological models, using an improved technique that more correctly accounts for the asymmetric errors bars of the time-lag measurements. We find that $R-L$ relation parameters are independent of the cosmological models used in the analysis and so the $R-L$ relation can be used to standardize the C IV QSOs. The C IV QSO cosmological constraints are consistent with those from Mg II QSOs, allowing us to derive joint C IV + Mg II QSO cosmological constraints which are consistent with currently accelerated cosmological expansion, as well as consistent with cosmological constraints derived using better-established baryon acoustic oscillation (BAO) and Hubble parameter [$H(z)$] measurements. When jointly analyzed with $H(z)$ + BAO data, current C IV + Mg II QSO data mildly tighten current $H(z)$ + BAO data cosmological constraints.


title: Mask2Hand: Learning to Predict the 3D Hand Pose and Shape from Shadow

abstract: We present a self-trainable method, Mask2Hand, which learns to solve the challenging task of predicting 3D hand pose and shape from a 2D binary mask of hand silhouette/shadow without additional manually-annotated data. Given the intrinsic camera parameters and the parametric hand model in the camera space, we adopt the differentiable rendering technique to project 3D estimations onto the 2D binary silhouette space. By applying a tailored combination of losses between the rendered silhouette and the input binary mask, we are able to integrate the self-guidance mechanism into our end-to-end optimization process for constraining global mesh registration and hand pose estimation. The experiments show that our method, which takes a single binary mask as the input, can achieve comparable prediction accuracy on both unaligned and aligned settings as state-of-the-art methods that require RGB or depth inputs. Our code is available at https://github.com/lijenchang/Mask2Hand.


title: Combinatorics on bounded free Motzkin paths and its applications

abstract: In this paper, we construct a bijection from a set of bounded free Motzkin paths to a set of bounded Motzkin prefixes that induces a bijection from a set of bounded free Dyck paths to a set of bounded Dyck prefixes. We also give bijections between a set of bounded cornerless Motzkin paths and a set of $t$-core partitions, and a set of bounded cornerless symmetric Motzkin paths and a set of self-conjugate $t$-core partitions. As an application, we get explicit formulas for the number of ordinary and self-conjugate $t$-core partitions with a fixed number of corners.


title: Graph-level Neural Networks: Current Progress and Future Directions

abstract: Graph-structured data consisting of objects (i.e., nodes) and relationships among objects (i.e., edges) are ubiquitous. Graph-level learning is a matter of studying a collection of graphs instead of a single graph. Traditional graph-level learning methods used to be the mainstream. However, with the increasing scale and complexity of graphs, Graph-level Neural Networks (GLNNs, deep learning-based graph-level learning methods) have been attractive due to their superiority in modeling high-dimensional data. Thus, a survey on GLNNs is necessary. To frame this survey, we propose a systematic taxonomy covering GLNNs upon deep neural networks, graph neural networks, and graph pooling. The representative and state-of-the-art models in each category are focused on this survey. We also investigate the reproducibility, benchmarks, and new graph datasets of GLNNs. Finally, we conclude future directions to further push forward GLNNs. The repository of this survey is available at https://github.com/GeZhangMQ/Awesome-Graph-level-Neural-Networks.


title: Optimal Cloud Network Control with Strict Latency Constraints

abstract: The timely delivery of resource-intensive and latency-sensitive services (e.g., industrial automation, augmented reality) over distributed computing networks (e.g., mobile edge computing) is drawing increasing attention. Motivated by the insufficiency of average delay performance guarantees provided by existing studies, we focus on the critical goal of delivering next generation real-time services ahead of corresponding deadlines on a per-packet basis, while minimizing overall cloud network resource cost. We introduce a novel queuing system that is able to track data packets' lifetime and formalize the optimal cloud network control problem with strict deadline constraints. After illustrating the main challenges in delivering packets to their destinations before getting dropped due to lifetime expiry, we construct an equivalent formulation, where relaxed flow conservation allows leveraging Lyapunov optimization to derive a provably near-optimal fully distributed algorithm for the original problem. Numerical results validate the theoretical analysis and show the superior performance of the proposed control policy compared with state-of-the-art cloud network control.


title: Optimal Multicast Service Chain Control: Packet Processing, Routing, and Duplication

abstract: Distributed computing (cloud) networks, e.g., mobile edge computing (MEC), are playing an increasingly important role in the efficient hosting, running, and delivery of real-time stream-processing applications such as industrial automation, immersive video, and augmented reality. While such applications require timely processing of real-time streams that are simultaneously useful for multiple users/devices, existing technologies lack efficient mechanisms to handle their increasingly multicast nature, leading to unnecessary traffic redundancy and associated network congestion. In this paper, we address the design of distributed packet processing, routing, and duplication policies for optimal control of multicast stream-processing services. We present a characterization of the enlarged capacity region that results from efficient packet duplication, and design the first fully distributed multicast traffic management policy that stabilizes any input rate in the interior of the capacity region while minimizing overall operational cost. Numerical results demonstrate the effectiveness of the proposed policy to achieve throughput- and cost-optimal delivery of stream-processing services over distributed computing networks.


title: Exact solution to two-body financial dealer model: revisited from the viewpoint of kinetic theory

abstract: The two-body stochastic dealer model is revisited to provide an exact solution to the average order-book profile using the kinetic approach. The dealer model is a microscopic financial model where individual traders make decisions on limit-order prices stochastically and then reach agreements on transactions. In the literature, this model was solved for several cases: an exact solution for two-body traders $N=2$ and a mean-field solution for many traders $N\gg 1$. Remarkably, while kinetic theory plays a significant role in the mean-field analysis for $N\gg 1$, its role is still elusive for the case of $N=2$. In this paper, we revisit the two-body dealer model $N=2$ to clarify the utility of the kinetic theory. We first derive the exact master-Liouville equations for the two-body dealer model by several methods. We next illustrate the physical picture of the master-Liouville equation from the viewpoint of the probability currents. The master-Liouville equations are then solved exactly to derive the order-book profile and the average transaction interval. Furthermore, we introduce a generalised two-body dealer model by incorporating interaction between traders via the market midprice and exactly solve the model within the kinetic framework. We finally confirm our exact solution by numerical simulations. This work provides a systematic mathematical basis for the econophysics model by developing better mathematical intuition.


title: Highly anisotropic magnetism in the vanadium-based kagome metal TbV6Sn6

abstract: RV6Sn6 (R=rare earth) compounds are appealing materials platforms for exploring the interplay between R-site magnetism and nontrivial band topology associated with the nonmagnetic vanadium-based kagome network. Here we present the synthesis and characterization of the kagome metal TbV6Sn6 via single-crystal x-ray diffraction, magnetization, transport, and heat capacity measurements. Magnetization measurements reveal strong, uniaxial magnetic anisotropy rooted in the alignment of Tb3{\AA} moments in the interplane direction below 4.3(2) K. TbV6Sn6 exhibits multiband transport behavior with high mobilities of charge carriers, and our measurements suggest TbV6Sn6 is a promising candidate for hosting Chern gaps driven via the interplay between Tb-site magnetic order and the band topology of the V-site kagome network.


title: A novel analysis approach of uniform persistence for a COVID-19 model with quarantine and standard incidence rate

abstract: A coronavirus disease 2019 (COVID-19) model with quarantine and standard incidence rate is first developed, then a novel analysis approach for finding the ultimate lower bound of COVID-19 infectious individuals is proposed, which means that the COVID-19 pandemic is uniformly persistent if the control reproduction number $\mathcal{R}_{c}>1$. This approach can be applied to other related biomathematical models, and some existing works can be improved by using it. In addition, the COVID-19-free equilibrium $V^0$ is locally asymptotically stable (LAS) if $\mathcal{R}_{c}<1$ and linearly stable if $\mathcal{R}_{c}=1$, respectively; while $V^0$ is unstable if $\mathcal{R}_{c}>1$.


title: Automatically Detecting API-induced Compatibility Issues in Android Apps: A Comparative Analysis (Replicability Study)

abstract: Fragmentation is a serious problem in the Android ecosystem. This problem is mainly caused by the fast evolution of the system itself and the various customizations independently maintained by different smartphone manufacturers. Many efforts have attempted to mitigate its impact via approaches to automatically pinpoint compatibility issues in Android apps. Unfortunately, at this stage, it is still unknown if this objective has been fulfilled, and the existing approaches can indeed be replicated and reliably leveraged to pinpoint compatibility issues in the wild. We, therefore, propose to fill this gap by first conducting a literature review within this topic to identify all the available approaches. Among the nine identified approaches, we then try our best to reproduce them based on their original datasets. After that, we go one step further to empirically compare those approaches against common datasets with real-world apps containing compatibility issues. Experimental results show that existing tools can indeed be reproduced, but their capabilities are quite distinct, as confirmed by the fact that there is only a small overlap of the results reported by the selected tools. This evidence suggests that more efforts should be spent by our community to achieve sound compatibility issues detection.


title: iFS-RCNN: An Incremental Few-shot Instance Segmenter

abstract: This paper addresses incremental few-shot instance segmentation, where a few examples of new object classes arrive when access to training examples of old classes is not available anymore, and the goal is to perform well on both old and new classes. We make two contributions by extending the common Mask-RCNN framework in its second stage -- namely, we specify a new object class classifier based on the probit function and a new uncertainty-guided bounding-box predictor. The former leverages Bayesian learning to address a paucity of training examples of new classes. The latter learns not only to predict object bounding boxes but also to estimate the uncertainty of the prediction as guidance for bounding box refinement. We also specify two new loss functions in terms of the estimated object-class distribution and bounding-box uncertainty. Our contributions produce significant performance gains on the COCO dataset over the state of the art -- specifically, the gain of +6 on the new classes and +16 on the old classes in the AP instance segmentation metric. Furthermore, we are the first to evaluate the incremental few-shot setting on the more challenging LVIS dataset.


title: Spectrum of MATLABs magic squares

abstract: This article looks at the eigenvalues of magic squares generated by the MATLAB's magic($n$) function. The magic($n$) function constructs doubly even ($n = 4k$) magic squares, singly even ($n = 4k+2$) magic squares and odd ($n = 2k+1$) magic squares using different algorithms. The doubly even magic squares are constructed by a criss-cross method that involves reflecting the entries of a simple square about the center. The odd magic squares are constructed using the Siamese method. The singly even magic squares are constructed using a lower-order odd magic square (Strachey method). We obtain approximations of eigenvalues of odd and singly even magic squares and prove error bounds on the approximation. For the sake of completeness, we also obtain the eigenpairs of doubly even magic squares generated by MATLAB. The approximation of the spectra involves some interesting connections with the spectrum of g-circulant matrices and the use of Bauer-Fike theorem.


title: Secure Federated Clustering

abstract: We consider a foundational unsupervised learning task of $k$-means data clustering, in a federated learning (FL) setting consisting of a central server and many distributed clients. We develop SecFC, which is a secure federated clustering algorithm that simultaneously achieves 1) universal performance: no performance loss compared with clustering over centralized data, regardless of data distribution across clients; 2) data privacy: each client's private data and the cluster centers are not leaked to other clients and the server. In SecFC, the clients perform Lagrange encoding on their local data and share the coded data in an information-theoretically private manner; then leveraging the algebraic structure of the coding, the FL network exactly executes the Lloyd's $k$-means heuristic over the coded data to obtain the final clustering. Experiment results on synthetic and real datasets demonstrate the universally superior performance of SecFC for different data distributions across clients, and its computational practicality for various combinations of system parameters. Finally, we propose an extension of SecFC to further provide membership privacy for all data points.


title: Sub-Image Histogram Equalization using Coot Optimization Algorithm for Segmentation and Parameter Selection

abstract: Contrast enhancement is very important in terms of assessing images in an objective way. Contrast enhancement is also significant for various algorithms including supervised and unsupervised algorithms for accurate classification of samples. Some contrast enhancement algorithms solve this problem by addressing the low contrast issue. Mean and variance based sub-image histogram equalization (MVSIHE) algorithm is one of these contrast enhancements methods proposed in the literature. It has different parameters which need to be tuned in order to achieve optimum results. With this motivation, in this study, we employed one of the most recent optimization algorithms, namely, coot optimization algorithm (COA) for selecting appropriate parameters for the MVSIHE algorithm. Blind/referenceless image spatial quality evaluator (BRISQUE) and natural image quality evaluator (NIQE) metrics are used for evaluating fitness of the coot swarm population. The results show that the proposed method can be used in the field of biomedical image processing.


title: Morse shellings out of discrete Morse functions

abstract: From the topological viewpoint, Morse shellings of finite simplicial complexes are {\it pinched} handle decompositions and extend the classical shellings. We prove that every discrete Morse function on a finite simplicial complex induces Morse shellings on its second barycentric subdivision whose critical tiles-or pinched handles-are in oneto-one correspondence with the critical faces of the function, preserving the index. The same holds true, given any smooth Morse function on a closed manifold, for any piecewise-linear triangulation on it after sufficiently many barycentric subdivisions.


title: Few-Shot Unlearning by Model Inversion

abstract: We consider a practical scenario of machine unlearning to erase a target dataset, which causes unexpected behavior from the trained model. The target dataset is often assumed to be fully identifiable in a standard unlearning scenario. Such a flawless identification, however, is almost impossible if the training dataset is inaccessible at the time of unlearning. Unlike previous approaches requiring a complete set of targets, we consider few-shot unlearning scenario when only a few samples of target data are available. To this end, we formulate the few-shot unlearning problem specifying intentions behind the unlearning request (e.g., purely unlearning, mislabel correction, privacy protection), and we devise a straightforward framework that (i) retrieves a proxy of the training data via model inversion fully exploiting information available in the context of unlearning; (ii) adjusts the proxy according to the unlearning intention; and (iii) updates the model with the adjusted proxy. We demonstrate that our method using only a subset of target data can outperform the state-of-the-art unlearning methods even with a complete indication of target data.


title: HW-Aware Initialization of DNN Auto-Tuning to Improve Exploration Time and Robustness

abstract: The process of optimizing the latency of DNN operators with ML models and hardware-in-the-loop, called auto-tuning, has established itself as a pervasive method for the deployment of neural networks. From a search space of loop-optimizations, the candidate providing the best performance has to be selected. Performance of individual configurations is evaluated through hardware measurements. The combinatorial explosion of possible configurations, together with the cost of hardware evaluation makes exhaustive explorations of the search space infeasible in practice. Machine Learning methods, like random forests or reinforcement learning are used to aid in the selection of candidates for hardware evaluation. For general purpose hardware like x86 and GPGPU architectures impressive performance gains can be achieved, compared to hand-optimized libraries like cuDNN. The method is also useful in the space of hardware accelerators with less wide-spread adoption, where a high-performance library is not always available. However, hardware accelerators are often less flexible with respect to their programming which leads to operator configurations not executable on the hardware target. This work evaluates how these invalid configurations affect the auto-tuning process and its underlying performance prediction model for the VTA hardware. From these results, a validity-driven initialization method for AutoTVM is developed, only requiring 41.6% of the necessary hardware measurements to find the best solution, while improving search robustness.


title: GSR: A Generalized Symbolic Regression Approach

abstract: Identifying the mathematical relationships that best describe a dataset remains a very challenging problem in machine learning, and is known as Symbolic Regression (SR). In contrast to neural networks which are often treated as black boxes, SR attempts to gain insight into the underlying relationships between the independent variables and the target variable of a given dataset by assembling analytical functions. In this paper, we present GSR, a Generalized Symbolic Regression approach, by modifying the conventional SR optimization problem formulation, while keeping the main SR objective intact. In GSR, we infer mathematical relationships between the independent variables and some transformation of the target variable. We constrain our search space to a weighted sum of basis functions, and propose a genetic programming approach with a matrix-based encoding scheme. We show that our GSR method is competitive with strong SR benchmark methods, achieving promising experimental performance on the well-known SR benchmark problem sets. Finally, we highlight the strengths of GSR by introducing SymSet, a new SR benchmark set which is more challenging relative to the existing benchmarks.


title: Nested sampling for physical scientists

abstract: We review Skilling's nested sampling (NS) algorithm for Bayesian inference and more broadly multi-dimensional integration. After recapitulating the principles of NS, we survey developments in implementing efficient NS algorithms in practice in high-dimensions, including methods for sampling from the so-called constrained prior. We outline the ways in which NS may be applied and describe the application of NS in three scientific fields in which the algorithm has proved to be useful: cosmology, gravitational-wave astronomy, and materials science. We close by making recommendations for best practice when using NS and by summarizing potential limitations and optimizations of NS.

categories: stat.CO astro-ph.CO astro-ph.IM cond-mat.mtrl-sci hep-ph


title: Hierarchical Spherical CNNs with Lifting-based Adaptive Wavelets for Pooling and Unpooling

abstract: Pooling and unpooling are two essential operations in constructing hierarchical spherical convolutional neural networks (HS-CNNs) for comprehensive feature learning in the spherical domain. Most existing models employ downsampling-based pooling, which will inevitably incur information loss and cannot adapt to different spherical signals and tasks. Besides, the preserved information after pooling cannot be well restored by the subsequent unpooling to characterize the desirable features for a task. In this paper, we propose a novel framework of HS-CNNs with a lifting structure to learn adaptive spherical wavelets for pooling and unpooling, dubbed LiftHS-CNN, which ensures a more efficient hierarchical feature learning for both image- and pixel-level tasks. Specifically, adaptive spherical wavelets are learned with a lifting structure that consists of trainable lifting operators (i.e., update and predict operators). With this learnable lifting structure, we can adaptively partition a signal into two sub-bands containing low- and high-frequency components, respectively, and thus generate a better down-scaled representation for pooling by preserving more information in the low-frequency sub-band. The update and predict operators are parameterized with graph-based attention to jointly consider the signal's characteristics and the underlying geometries. We further show that particular properties are promised by the learned wavelets, ensuring the spatial-frequency localization for better exploiting the signal's correlation in both spatial and frequency domains. We then propose an unpooling operation that is invertible to the lifting-based pooling, where an inverse wavelet transform is performed by using the learned lifting operators to restore an up-scaled representation. Extensive empirical evaluations on various spherical domain tasks validate the superiority of the proposed LiftHS-CNN.


title: 3PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologies

abstract: Recent advances in learning 3D shapes using neural implicit functions have achieved impressive results by breaking the previous barrier of resolution and diversity for varying topologies. However, most of such approaches are limited to closed surfaces as they require the space to be divided into inside and outside. More recent works based on unsigned distance function have been proposed to handle complex geometry containing both the open and closed surfaces. Nonetheless, as their direct outputs are point clouds, robustly obtaining high-quality meshing results from discrete points remains an open question. We present a novel learnable implicit representation, called the three-pole signed distance function (3PSDF), that can represent non-watertight 3D shapes with arbitrary topologies while supporting easy field-to-mesh conversion using the classic Marching Cubes algorithm. The key to our method is the introduction of a new sign, the NULL sign, in addition to the conventional in and out labels. The existence of the null sign could stop the formation of a closed isosurface derived from the bisector of the in/out regions. Further, we propose a dedicated learning framework to effectively learn 3PSDF without worrying about the vanishing gradient due to the null labels. Experimental results show that our approach outperforms the previous state-of-the-art methods in a wide range of benchmarks both quantitatively and qualitatively.