title: Hard X-ray polarization catalog for a 5-year sample of Gamma-Ray Bursts using AstroSat CZT-Imager

abstract: Cadmium Zinc Telluride Imager (CZTI) aboard AstroSat has been regularly detecting Gamma-Ray Bursts (GRBs) since its launch in 2015. Its sensitivity to polarization measurements at energies above 100 keV allows CZTI to attempt spectro-polarimetric studies of GRBs. Here, we present the first catalog of GRB polarization measurements made by CZTI during its first five years of operation. This presents the time integrated polarization measurements of the prompt emission of 20 GRBs in the energy range 100-600 keV. The sample includes the bright GRBs which were detected within an angle range of 0-60 degree and 120-180 degree where the instrument has useful polarization sensitivity and is less prone to systematics. We implement a few new modifications in the analysis to enhance polarimetric sensitivity of the instrument. Majority of the GRBs in the sample are found to possess less / null polarization across the total bursts' duration in contrast to a small fraction of five GRBs exhibiting high polarization. The low polarization across the bursts can be speculated to be either due to the burst being intrinsically weakly polarized or due to varying polarization angle within the burst even when it is highly polarized. In comparison to POLAR measurements, CZTI has detected a larger number of cases with high polarization. This may be a consequence of the higher energy window of CZTI observations which results in the sampling of smaller duration of burst emissions in contrast to POLAR, thereby, probing emissions of less temporal variations of polarization properties.


title: A Novel Potential Featuring Off-Center Circular Orbits

abstract: In Book 1, Proposition 7, Problem 2 of his 1687 Philosophiae Naturalis Principia Mathematica, Isaac Newton poses and answers the following question: Let the orbit of a particle moving in a central force field be an off-center circle. How does the magnitude of the force depend on the position of the particle onthat circle? In this article, we identify a potential that can produce such a force, only at zero energy. We further map the zero-energy orbits in this potential to finite-energy free motion orbits on a sphere; such a duality is a particular instance of a general result by Goursat, from 1887. The map itself is an inverse stereographic projection, and this fact explains the circularity of the zero-energy orbits in the system of interest. Finally, we identify an additional integral of motion - an analogue of the Runge-Lenz vector in the Coulomb problem - that is responsible for the closeness of the zero-energy orbits in our problem.


title: Influence of heavy resonances in SMASH

abstract: Recent lattice QCD results, comparing to a hadron resonance gas model, have shown the need for hundreds of particles in hadronic models. These extra particles influence both the equation of state and hadronic interactions within hadron transport models. Here, we introduce the PDG21+ particle list, which contains the most up-to-date database of particles and their properties. We then convert all particles decays into 2 body decays so that they are compatible with SMASH in order to produce a more consistent description of a heavy-ion collision.


title: Probablement, Wahrscheinlich, Likely ? A Cross-Language Study of How People Verbalize Probabilities in Icon Array Visualizations

abstract: Visualizations today are used across a wide range of languages and cultures. Yet the extent to which language impacts how we reason about data and visualizations remains unclear. In this paper, we explore the intersection of visualization and language through a cross-language study on estimative probability tasks with icon-array visualizations. Across Arabic, English, French, German, and Mandarin, n = 50 participants per language both chose probability expressions - e.g. likely, probable - to describe icon-array visualizations (Vis-to-Expression), and drew icon-array visualizations to match a given expression (Expression-to-Vis). Results suggest that there is no clear one-to-one mapping of probability expressions and associated visual ranges between languages. Several translated expressions fell significantly above or below the range of the corresponding English expressions. Compared to other languages, French and German respondents appear to exhibit high levels of consistency between the visualizations they drew and the words they chose. Participants across languages used similar words when describing scenarios above 80% chance, with more variance in expressions targeting mid-range and lower values. We discuss how these results suggest potential differences in the expressiveness of language as it relates to visualization interpretation and design goals, as well as practical implications for translation efforts and future studies at the intersection of languages, culture, and visualization. Experiment data, source code, and analysis scripts are available at the following repository: https://osf.io/g5d4r/.


title: Towards Accurate and Robust Classification in Continuously Transitioning Industrial Sprays with Mixup

abstract: Image classification with deep neural networks has seen a surge of technological breakthroughs with promising applications in areas such as face recognition, medical imaging, and autonomous driving. In engineering problems, however, such as high-speed imaging of engine fuel injector sprays or body paint sprays, deep neural networks face a fundamental challenge related to the availability of adequate and diverse data. Typically, only thousands or sometimes even hundreds of samples are available for training. In addition, the transition between different spray classes is a continuum and requires a high level of domain expertise to label the images accurately. In this work, we used Mixup as an approach to systematically deal with the data scarcity and ambiguous class boundaries found in industrial spray applications. We show that data augmentation can mitigate the over-fitting problem of large neural networks on small data sets, to a certain level, but cannot fundamentally resolve the issue. We discuss how a convex linear interpolation of different classes naturally aligns with the continuous transition between different classes in our application. Our experiments demonstrate Mixup as a simple yet effective method to train an accurate and robust deep neural network classifier with only a few hundred samples.


title: Unsupervised Deep Multi-Shape Matching

abstract: 3D shape matching is a long-standing problem in computer vision and computer graphics. While deep neural networks were shown to lead to state-of-the-art results in shape matching, existing learning-based approaches are limited in the context of multi-shape matching: (i) either they focus on matching pairs of shapes only and thus suffer from cycle-inconsistent multi-matchings, or (ii) they require an explicit template shape to address the matching of a collection of shapes. In this paper, we present a novel approach for deep multi-shape matching that ensures cycle-consistent multi-matchings while not depending on an explicit template shape. To this end, we utilise a shape-to-universe multi-matching representation that we combine with powerful functional map regularisation, so that our multi-shape matching neural network can be trained in a fully unsupervised manner. While the functional map regularisation is only considered during training time, functional maps are not computed for predicting correspondences, thereby allowing for fast inference. We demonstrate that our method achieves state-of-the-art results on several challenging benchmark datasets, and, most remarkably, that our unsupervised method even outperforms recent supervised methods.


title: Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions

abstract: Federated learning (FL) and split learning (SL) are two emerging collaborative learning methods that may greatly facilitate ubiquitous intelligence in Internet of Things (IoT). Federated learning enables machine learning (ML) models locally trained using private data to be aggregated into a global model. Split learning allows different portions of an ML model to be collaboratively trained on different workers in a learning framework. Federated learning and split learning, each has unique advantages and respective limitations, may complement each other toward ubiquitous intelligence in IoT. Therefore, combination of federated learning and split learning recently became an active research area attracting extensive interest. In this article, we review the latest developments in federated learning and split learning and present a survey on the state-of-the-art technologies for combining these two learning methods in an edge computing-based IoT environment. We also identify some open problems and discuss possible directions for future research in this area with a hope to further arouse the research community's interest in this emerging field.


title: Linear change and minutes variability of solar wind velocity revealed by FAST

abstract: Observation of Interplanetary Scintillation (IPS) provides an important and effective way to study the solar wind and the space weather. A series of IPS observations were conducted by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The extraordinary sensitivity and the wide frequency coverage make FAST an ideal platform for IPS studies. In this paper we present some first scientific results from FAST observations of IPS with the L-band receiver. Based on the solar wind velocity fitting values of FAST observations on September 26-28, 2020, we found that the velocity decreases with increasing frequency linearly, which has not yet been reported in literature. And we have also detected a variation of solar wind velocity on a timescale of 3-5 minutes, which imply the slow change of the background solar wind, a co-existence of high- and low-speed streams, or a reflect of the quasi-periodic electron-density fluctuations.


title: Exploiting Domain Transferability for Collaborative Inter-level Domain Adaptive Object Detection

abstract: Domain adaptation for object detection (DAOD) has recently drawn much attention owing to its capability of detecting target objects without any annotations. To tackle the problem, previous works focus on aligning features extracted from partial levels (e.g., image-level, instance-level, RPN-level) in a two-stage detector via adversarial training. However, individual levels in the object detection pipeline are closely related to each other and this inter-level relation is unconsidered yet. To this end, we introduce a novel framework for DAOD with three proposed components: Multi-scale-aware Uncertainty Attention (MUA), Transferable Region Proposal Network (TRPN), and Dynamic Instance Sampling (DIS). With these modules, we seek to reduce the negative transfer effect during training while maximizing transferability as well as discriminability in both domains. Finally, our framework implicitly learns domain invariant regions for object detection via exploiting the transferable information and enhances the complementarity between different detection levels by collaboratively utilizing their domain information. Through ablation studies and experiments, we show that the proposed modules contribute to the performance improvement in a synergic way, demonstrating the effectiveness of our method. Moreover, our model achieves a new state-of-the-art performance on various benchmarks.


title: Adaptive Partition of Unity Interpolation Method with Moving Patches

abstract: The adaptive partition of unity interpolation method, introduced by Aiton and Driscoll, using Chebyshev local interpolants, is explored for interpolating functions with sharp gradients representing two-medium problems. For functions that evolve under vector fields, the partition of unity patches (covers) can be shifted and resized to follow the changing dynamics of local profiles. The method is tested for selected 1D and 2D two-medium problems with linear divergence-free vector fields. In those cases, the volume fraction in each patch contributing to volume conservation throughout the domain can be kept in high accuracy down to machine precisions. Applications that could benefit from the method include volume tracking and multiphase flow modeling.


title: Overlooked factors in concept-based explanations: Dataset choice, concept learnability, and human capability

abstract: Concept-based interpretability methods aim to explain deep neural network model predictions using a predefined set of semantic concepts. These methods evaluate a trained model on a new, "probe" dataset and correlate model predictions with the visual concepts labeled in that dataset. Despite their popularity, they suffer from limitations that are not well-understood and articulated by the literature. In this work, we analyze three commonly overlooked factors in concept-based explanations. First, the choice of the probe dataset has a profound impact on the generated explanations. Our analysis reveals that different probe datasets may lead to very different explanations, and suggests that the explanations are not generalizable outside the probe dataset. Second, we find that concepts in the probe dataset are often less salient and harder to learn than the classes they claim to explain, calling into question the correctness of the explanations. We argue that only visually salient concepts should be used in concept-based explanations. Finally, while existing methods use hundreds or even thousands of concepts, our human studies reveal a much stricter upper bound of 32 concepts or less, beyond which the explanations are much less practically useful. We make suggestions for future development and analysis of concept-based interpretability methods. Code for our analysis and user interface can be found at \url{https://github.com/princetonvisualai/OverlookedFactors}


title: Towards Transmission-Friendly and Robust CNN Models over Cloud and Device

abstract: Deploying deep convolutional neural network (CNN) models on ubiquitous Internet of Things (IoT) devices has attracted much attention from industry and academia since it greatly facilitates our lives by providing various rapid-response services. Due to the limited resources of IoT devices, cloud-assisted training of CNN models has become the mainstream. However, most existing related works suffer from a large amount of model parameter transmission and weak model robustness. To this end, this paper proposes a cloud-assisted CNN training framework with low model parameter transmission and strong model robustness. In the proposed framework, we first introduce MonoCNN, which contains only a few learnable filters, and other filters are nonlearnable. These nonlearnable filter parameters are generated according to certain rules, i.e., the filter generation function (FGF), and can be saved and reproduced by a few random seeds. Thus, the cloud server only needs to send these learnable filters and a few seeds to the IoT device. Compared to transmitting all model parameters, sending several learnable filter parameters and seeds can significantly reduce parameter transmission. Then, we investigate multiple FGFs and enable the IoT device to use the FGF to generate multiple filters and combine them into MonoCNN. Thus, MonoCNN is affected not only by the training data but also by the FGF. The rules of the FGF play a role in regularizing the MonoCNN, thereby improving its robustness. Experimental results show that compared to state-of-the-art methods, our proposed framework can reduce a large amount of model parameter transfer between the cloud server and the IoT device while improving the performance by approximately 2.2% when dealing with corrupted data. The code is available at https://github.com/evoxlos/mono-cnn-pytorch.


title: On the Smallest Number of Functions Representing Isotropic Functions of Scalars, Vectors and Tensors

abstract: In this paper, we address the open problem (stated in Pennisi and Trovato, 1987. Int. J. Engng Sci., 25(8), 1059-1065) associated with the irreducibility of representations for isotropic functions. In particular, we prove that for isotropic functions that depend on $P$ vectors, $N$ symmetric tensors and $M$ non-symmetric tensors (a) the number of irreducible invariants for a scalar-valued isotropic function is $3P+9M+6N-3$ (b) the number of irreducible vectors for a vector-valued isotropic function is $3$ and (c) the number of irreducible tensors for a tensor-valued isotropic function is at most $9$. The irreducible numbers in given (a), (b) and (c) are much lower than those obtained in the literature. This significant reduction in the number of irreducible scalar/vector/tensor-valued functions have the potential to substantially simplify modelling complexity.


title: Dynamical system-based computational models for solving combinatorial optimization on hypergraphs

abstract: The intrinsic energy minimization in dynamical systems offers a valuable tool for minimizing the objective functions of computationally challenging problems in combinatorial optimization. However, most prior works have focused on mapping such dynamics to combinatorial optimization problems whose objective functions have quadratic degree (e.g., MaxCut); such problems can be represented and analyzed using graphs. However, the work on developing such models for problems that need objective functions with degree greater than two, and subsequently, entail the use of hypergraph data structures, is relatively sparse. In this work, we develop dynamical system-inspired computational models for several such problems. Specifically, we define the 'energy function' for hypergraph-based combinatorial problems ranging from Boolean SAT and its variants to integer factorization, and subsequently, define the resulting system dynamics. We also show that the design approach is applicable to optimization problems with quadratic degree, and use it develop a new dynamical system formulation for minimizing the Ising Hamiltonian. Our work not only expands on the scope of problems that can be directly mapped to, and solved using physics-inspired models, but also creates new opportunities to design high-performance accelerators for solving combinatorial optimization.


title: Learning Latent Traits for Simulated Cooperative Driving Tasks

abstract: To construct effective teaming strategies between humans and AI systems in complex, risky situations requires an understanding of individual preferences and behaviors of humans. Previously this problem has been treated in case-specific or data-agnostic ways. In this paper, we build a framework capable of capturing a compact latent representation of the human in terms of their behavior and preferences based on data from a simulated population of drivers. Our framework leverages, to the extent available, knowledge of individual preferences and types from samples within the population to deploy interaction policies appropriate for specific drivers. We then build a lightweight simulation environment, HMIway-env, for modelling one form of distracted driving behavior, and use it to generate data for different driver types and train intervention policies. We finally use this environment to quantify both the ability to discriminate drivers and the effectiveness of intervention policies.


title: An ergodic approach towards an equidistribution result of Ferrero--Washington

abstract: An important ingredient in the Ferrero--Washington proof of the vanishing of cyclotomic $\mu$-invariant for Kubota--Leopoldt $p$-adic $L$-functions is an equidistribution result which they established using the Weyl criterion. The purpose of our manuscript is to provide an alternative proof by adopting a dynamical approach. A key ingredient to our methods is studying an ergodic skew-product map on $\mathbb{Z}_p \times [0,1]$, which is then suitably identified as a factor of the $2$-sided Bernoulli shift on the sample space $\{0,1,2,\cdots,p-1\}^{\mathbb{Z}}$.


title: Gravitational wave of intermediate-mass black holes in Population III star clusters

abstract: Previous theoretical studies suggest that the Population III (Pop3) stars tend to form in extremely metal poor gas clouds with approximately $10^5 M_\odot$ embedded in mini dark matter halos. Very massive stars can form via multiple collisions in Pop3 star clusters and eventually evolve to intermediate-mass black holes (IMBHs). In this work, we conduct star-by-star $N$-body simulations for modelling the long-term evolution of Pop3 star clusters. We find that if the mini dark matter halos can survive today, these star clusters can avoid tidal disruption by the galactic environment and can efficiently produce IMBH-BH mergers among a wide range of redshift from 0 to 20. The average gravitational wave event rate is estimated to be $0.1-0.8~\mathrm{yr}^{-1} \mathrm{Gpc}^{-3}$, and approximately $40-80$ percent of the mergers occur at high redshift ($z>6$). The characteristic strain shows that a part of low-redshift mergers can be detected by LISA, TianQin, and Taiji, whereas most mergers can be covered by DECIGO and advanced LIGO/VIRGO/Kagra. Mergers with pair-instability BHs have a rate of approximately $0.01-0.15$~yr$^{-1}$~Gpc$^{-3}$, which can explain the GW190521-like events.


title: Natural Thresholding Algorithms for Signal Recovery with Sparsity

abstract: The algorithms based on the technique of optimal $k$-thresholding (OT) were recently proposed for signal recovery, and they are very different from the traditional family of hard thresholding methods. However, the computational cost for OT-based algorithms remains high at the current stage of their development. This stimulates the development of the so-called natural thresholding (NT) algorithm and its variants in this paper. The family of NT algorithms is developed through the first-order approximation of the so-called regularized optimal $k$-thresholding model, and thus the computational cost for this family of algorithms is significantly lower than that of the OT-based algorithms. The guaranteed performance of NT-type algorithms for signal recovery from noisy measurements is shown under the restricted isometry property and concavity of the objective function of regularized optimal $k$-thresholding model. Empirical results indicate that the NT-type algorithms are robust and very comparable to several mainstream algorithms for sparse signal recovery.


title: On property-$\bm{(R_1)}$ and relative Chebyshev centers in Banach spaces-II

abstract: We continue to study (strong) property-$(R_1)$ in Banach spaces. As discussed by Pai \& Nowroji in [{\it On restricted centers of sets}, J. Approx. Theory, {\bf 66}(2), 170--189 (1991)], this study corresponds to a triplet $(X,V,\mathcal{F})$, where $X$ is a Banach space, $V$ is a closed convex set, and $\mathcal{F}$ is a subfamily of closed, bounded subsets of $X$. It is observed that if $X$ is a Lindenstrauss space then $(X,B_X,\mathcal{K}(X))$ has strong property-$(R_1)$, where $\mathcal{K}(X)$ represents the compact subsets of $X$. It is established that for any $F\in\mathcal{K}(X)$, $\textrm{Cent}_{B_X}(F)\neq\emptyset$. This extends the well-known fact that a compact subset of a Lindenstrauss space $X$ admits a nonempty Chebyshev center in $X$. We extend our observation that $\textrm{Cent}_{B_X}$ is Lipschitz continuous in $\mathcal{K}(X)$ if $X$ is a Lindenstrauss space. If $Y$ is a subspace of a Banach space $X$ and $\mathcal{F}$ represents the set of all finite subsets of $B_X$ then we observe that $B_Y$ exhibits the condition for simultaneously strongly proximinal (viz. property-$(P_1)$) in $X$ for $F\in\mathcal{F}$ if $(X, Y, \mathcal{F}(X))$ satisfies strong property-$(R_1)$, where $\mathcal{F}(X)$ represents the set of all finite subsets of $X$. It is demonstrated that if $P$ is a bi-contractive projection in $\ell_\infty$, then $(\ell_\infty, Range (P), \mathcal{K}(\ell_\infty))$ exhibits the strong property-$(R_1)$, where $\mathcal{K}(\ell_\infty)$ represents the set of all compact subsets of $\ell_\infty$. Furthermore, stability results for these properties are derived in continuous function spaces, which are then studied for various sums in Banach spaces.


title: Learning from few examples: Classifying sex from retinal images via deep learning

abstract: Deep learning has seen tremendous interest in medical imaging, particularly in the use of convolutional neural networks (CNNs) for developing automated diagnostic tools. The facility of its non-invasive acquisition makes retinal fundus imaging amenable to such automated approaches. Recent work in analyzing fundus images using CNNs relies on access to massive data for training and validation - hundreds of thousands of images. However, data residency and data privacy restrictions stymie the applicability of this approach in medical settings where patient confidentiality is a mandate. Here, we showcase results for the performance of DL on small datasets to classify patient sex from fundus images - a trait thought not to be present or quantifiable in fundus images until recently. We fine-tune a Resnet-152 model whose last layer has been modified for binary classification. In several experiments, we assess performance in the small dataset context using one private (DOVS) and one public (ODIR) data source. Our models, developed using approximately 2500 fundus images, achieved test AUC scores of up to 0.72 (95% CI: [0.67, 0.77]). This corresponds to a mere 25% decrease in performance despite a nearly 1000-fold decrease in the dataset size compared to prior work in the literature. Even with a hard task like sex categorization from retinal images, we find that classification is possible with very small datasets. Additionally, we perform domain adaptation experiments between DOVS and ODIR; explore the effect of data curation on training and generalizability; and investigate model ensembling to maximize CNN classifier performance in the context of small development datasets.


title: Explicit Image Caption Editing

abstract: Given an image and a reference caption, the image caption editing task aims to correct the misalignment errors and generate a refined caption. However, all existing caption editing works are implicit models, ie, they directly produce the refined captions without explicit connections to the reference captions. In this paper, we introduce a new task: Explicit Caption Editing (ECE). ECE models explicitly generate a sequence of edit operations, and this edit operation sequence can translate the reference caption into a refined one. Compared to the implicit editing, ECE has multiple advantages: 1) Explainable: it can trace the whole editing path. 2) Editing Efficient: it only needs to modify a few words. 3) Human-like: it resembles the way that humans perform caption editing, and tries to keep original sentence structures. To solve this new task, we propose the first ECE model: TIger. TIger is a non-autoregressive transformer-based model, consisting of three modules: Tagger_del, Tagger_add, and Inserter. Specifically, Tagger_del decides whether each word should be preserved or not, Tagger_add decides where to add new words, and Inserter predicts the specific word for adding. To further facilitate ECE research, we propose two new ECE benchmarks by re-organizing two existing datasets, dubbed COCO-EE and Flickr30K-EE, respectively. Extensive ablations on both two benchmarks have demonstrated the effectiveness of TIger.


title: Ultrahomogeneous tensor spaces

abstract: A cubic space is a vector space equipped with a symmetric trilinear form. Using categorical Fra\"iss\'e theory, we show that there is a universal ultrahomogeneous cubic space $V$ of countable infinite dimension, which is unique up to isomorphism. The automorphism group $G$ of $V$ is quite large and, in some respects, similar to the infinite orthogonal group. We show that $G$ is a linear-oligomorphic group (a class of groups we introduce), and we determine the algebraic representation theory of $G$. We also establish some model-theoretic results about $V$: it is $\omega$-categorical (in a modified sense), and has quantifier elimination (for vectors). Our results are not specific to cubic spaces, and hold for a very general class of tensor spaces; we view these spaces as linear analogs of the relational structures studied in model theory.


title: EVHA: Explainable Vision System for Hardware Testing and Assurance -- An Overview

abstract: Due to the ever-growing demands for electronic chips in different sectors the semiconductor companies have been mandated to offshore their manufacturing processes. This unwanted matter has made security and trustworthiness of their fabricated chips concerning and caused creation of hardware attacks. In this condition, different entities in the semiconductor supply chain can act maliciously and execute an attack on the design computing layers, from devices to systems. Our attack is a hardware Trojan that is inserted during mask generation/fabrication in an untrusted foundry. The Trojan leaves a footprint in the fabricated through addition, deletion, or change of design cells. In order to tackle this problem, we propose Explainable Vision System for Hardware Testing and Assurance (EVHA) in this work that can detect the smallest possible change to a design in a low-cost, accurate, and fast manner. The inputs to this system are Scanning Electron Microscopy (SEM) images acquired from the Integrated Circuits (ICs) under examination. The system output is determination of IC status in terms of having any defect and/or hardware Trojan through addition, deletion, or change in the design cells at the cell-level. This article provides an overview on the design, development, implementation, and analysis of our defense system.


title: Control parameter dependence of fluctuation near jamming

abstract: The fluctuations of the physical quantities play a central role to characterize the critical phenomena. Here, we report that the nature of the fluctuation highly depends on the control parameter near the jamming transition point $\varphi_J$. We show that the fluctuations do not diverge when the pressure is used as the control parameter. On the contrary, if the distance to the transition point $\varphi_J$ is used as the control parameter, the fluctuations show the power-law divergence.


title: Perspective Phase Angle Model for Polarimetric 3D Reconstruction

abstract: Current polarimetric 3D reconstruction methods, including those in the well-established shape from polarization literature, are all developed under the orthographic projection assumption. In the case of a large field of view, however, this assumption does not hold and may result in significant reconstruction errors in methods that make this assumption. To address this problem, we present the perspective phase angle (PPA) model that is applicable to perspective cameras. Compared with the orthographic model, the proposed PPA model accurately describes the relationship between polarization phase angle and surface normal under perspective projection. In addition, the PPA model makes it possible to estimate surface normals from only one single-view phase angle map and does not suffer from the so-called $\pi$-ambiguity problem. Experiments on real data show that the PPA model is more accurate for surface normal estimation with a perspective camera than the orthographic model.


title: On singularities of the Gauss map components of surfaces in ${\mathbb R}^4$

abstract: The Gauss map of a generic immersion of a smooth, oriented surface into $\mathbb R^4$ is an immersion. But this map takes values on the Grassmanian of oriented 2-planes in $\mathbb R^4$. Since this manifold has a structure of a product of two spheres, the Gauss map has two components that take values on the sphere. We study the singularities of the components of the Gauss map and relate them to the geometric properties of the generic immersion. Moreover, we prove that the singularities are generically stable, and we connect them to the contact type of the surface and $\mathcal J$-holomorphic curves with respect to an orthogonal complex structure $\mathcal J$ on $\mathbb R^4$. Finally, we get some formulas of Gauss-Bonnet type involving the geometry of the singularities of the components with the geometry and topology of the surface.


title: Well posedness and limit theorems for a class of stochastic dyadic models

abstract: We consider stochastic inviscid dyadic models with energy-preserving noise. It is shown that the models admit weak solutions which are unique in law. Under a certain scaling limit of the noise, the stochastic models converge weakly to a deterministic viscous dyadic model, for which we provide explicit convergence rates in terms of the parameters of noise. A central limit theorem underlying such scaling limit is also established. In case that the stochastic dyadic model is viscous, we show the phenomenon of dissipation enhancement for suitably chosen noise.


title: Diffuse supernova neutrino background

abstract: Neutrinos are the second most ubiquitous Standard Model particles in the universe. On the other hand, they are also the ones least likely to interact. Connecting these two points suggests that when a neutrino is detected, it can divulge unique pieces of information about its source. Among the known neutrino sources, core-collapse supernovae in the universe are the most abundant for MeV-energies. On average, a single collapse happens every second in the observable universe and produces $10^{58}$ neutrinos. The flux of neutrinos reaching the Earth from all the core-collapse supernovae in the universe is known as diffuse supernova neutrino background. In this Chapter, the basic prediction for the diffuse supernova neutrino background is presented. This includes a discussion of an average neutrino signal from a core-collapse supernova, variability of that signal due to the remnant formed in the process, and uncertainties connected to the other astrophysical parameters determining the diffuse flux, such as cosmological supernova rate. In addition, the current experimental limits and detection perspectives of diffuse supernova neutrino background are reported.


title: Matrix Kendall's tau in High-dimensions: A Robust Statistic for Matrix Factor Model

abstract: In this article, we first propose generalized row/column matrix Kendall's tau for matrix-variate observations that are ubiquitous in areas such as finance and medical imaging. For a random matrix following a matrix-variate elliptically contoured distribution, we show that the eigenspaces of the proposed row/column matrix Kendall's tau coincide with those of the row/column scatter matrix respectively, with the same descending order of the eigenvalues. We perform eigenvalue decomposition to the generalized row/column matrix Kendall's tau for recovering the loading spaces of the matrix factor model. We also propose to estimate the pair of the factor numbers by exploiting the eigenvalue-ratios of the row/column matrix Kendall's tau. Theoretically, we derive the convergence rates of the estimators for loading spaces, factor scores and common components, and prove the consistency of the estimators for the factor numbers without any moment constraints on the idiosyncratic errors. Thorough simulation studies are conducted to show the higher degree of robustness of the proposed estimators over the existing ones. Analysis of a financial dataset of asset returns and a medical imaging dataset associated with COVID-19 illustrate the empirical usefulness of the proposed method.


title: HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detection

abstract: The fast development of self-supervised learning lowers the bar learning feature representation from massive unlabeled data and has triggered a series of research on change detection of remote sensing images. Challenges in adapting self-supervised learning from natural images classification to remote sensing images change detection arise from difference between the two tasks. The learned patch-level feature representations are not satisfying for the pixel-level precise change detection. In this paper, we proposed a novel pixel-level self-supervised hyperspectral spatial-spectral understanding network (HyperNet) to accomplish pixel-wise feature representation for effective hyperspectral change detection. Concretely, not patches but the whole images are fed into the network and the multi-temporal spatial-spectral features are compared pixel by pixel. Instead of processing the two-dimensional imaging space and spectral response dimension in hybrid style, a powerful spatial-spectral attention module is put forward to explore the spatial correlation and discriminative spectral features of multi-temporal hyperspectral images (HSIs), separately. Only the positive samples at the same location of bi-temporal HSIs are created and forced to be aligned, aiming at learning the spectral difference-invariant features. Moreover, a new similarity loss function named focal cosine is proposed to solve the problem of imbalanced easy and hard positive samples comparison, where the weights of those hard samples are enlarged and highlighted to promote the network training. Six hyperspectral datasets have been adopted to test the validity and generalization of proposed HyperNet. The extensive experiments demonstrate the superiority of HyperNet over the state-of-the-art algorithms on downstream hyperspectral change detection tasks.


title: A large deviation approach to superstatistics: thermodynamic duality symmetry between conjugate variables

abstract: Superstatistics generalizes Boltzmann statistics by assuming spatio-temporal fluctuations of the intensive variables. It has many applications in the analysis of experimental and simulated data. The fluctuation of the intensity variable is the key to the validity of superstatistical theory, but the law of its distribution is still unclear. In the framework of large deviation theory, we show that the fluctuation of the intensive variable of superstatistics emerges naturally from measurements in the large data limit. Combining Bayes' theorem, we demonstrate the conditional probability distribution of the intensity variable also follows the Boltzmann statistics and the conjugate variable of the intensive variable is the extensive variable, indicating a thermodynamic duality symmetry between conjugate variables in the superstatistical systems. A new thermodynamic relation between the entropy functions of conjugate variables is obtained. We utilized a simple Ising model with fluctuating temperature to verify the dual relationship between temperature and energy. Our work may contribute to the understanding of statistical physics in complex systems and Bayesian inference.


title: Lens Antenna Arrays-Assisted mmWave MU-MIMO Uplink Transmission: Joint Beam Selection and Phase-Only Beamforming Design

abstract: This paper considers a lens antenna array-assisted millimeter wave (mmWave) multiuser multiple-input multiple-output (MU-MIMO) system. The base station's beam selection matrix and user terminals' phase-only beamformers are jointly designed with the aim of maximizing the uplink sum rate. In order to deal with the formulated mixed-integer optimization problem, a penalty dual decomposition (PDD)-based iterative algorithm is developed via capitalizing on the weighted minimum mean square error (WMMSE), block coordinate descent (BCD), and minorization-maximization (MM) techniques. Moreover, a low-complexity sequential optimization (SO)-based algorithm is proposed at the cost of a slight sum rate performance loss. Numerical results demonstrate that the proposed methods can achieve higher sum rates than state-of-the-art methods.


title: Kernel representation formula from complex to real Wiener-Ito integrals and vice versa

abstract: We clearly characterize the relation between real and complex Wiener-Ito integrals. Given a complex multiple Wiener-Ito integral, we get explicit expressions for two kernels of its real and imaginary parts. Conversely, consider a two-dimensional real Wiener-Ito integral, we obtain the representation formula by a finite sum of complex Wiener-Ito integrals. The main tools are a recursion technique and Malliavin derivative operators. We build a bridge between real and complex Wiener-Ito integrals.


title: Doge Tickets: Uncovering Domain-general Language Models by Playing Lottery Tickets

abstract: Over-parameterized models, typically pretrained language models (LMs), have shown an appealing expressive power due to their small learning bias. However, the huge learning capacity of LMs can also lead to large learning variance. In a pilot study, we find that, when faced with multiple domains, a critical portion of parameters behave unexpectedly in a domain-specific manner while others behave in a domain-general one. Motivated by this phenomenon, we for the first time posit that domain-general parameters can underpin a domain-general LM that can be derived from the original LM. To uncover the domain-general LM, we propose to identify domain-general parameters by playing lottery tickets (dubbed doge tickets). In order to intervene the lottery, we propose a domain-general score, which depicts how domain-invariant a parameter is by associating it with the variance. Comprehensive experiments are conducted on the Amazon, Mnli and OntoNotes datasets. The results show that the doge tickets obtains an improved out-of-domain generalization in comparison with a range of competitive baselines. Analysis results further hint the existence of domain-general parameters and the performance consistency of doge tickets.


title: DC-BENCH: Dataset Condensation Benchmark

abstract: Dataset Condensation is a newly emerging technique aiming at learning a tiny dataset that captures the rich information encoded in the original dataset. As the size of datasets contemporary machine learning models rely on becomes increasingly large, condensation methods become a prominent direction for accelerating network training and reducing data storage. Despite numerous methods have been proposed in this rapidly growing field, evaluating and comparing different condensation methods is non-trivial and still remains an open issue. The quality of condensed dataset are often shadowed by many critical contributing factors to the end performance, such as data augmentation and model architectures. The lack of a systematic way to evaluate and compare condensation methods not only hinders our understanding of existing techniques, but also discourages practical usage of the synthesized datasets. This work provides the first large-scale standardized benchmark on Dataset Condensation. It consists of a suite of evaluations to comprehensively reflect the generability and effectiveness of condensation methods through the lens of their generated dataset. Leveraging this benchmark, we conduct a large-scale study of current condensation methods, and report many insightful findings that open up new possibilities for future development. The benchmark library, including evaluators, baseline methods, and generated datasets, is open-sourced to facilitate future research and application.


title: Test-Time Adaptation via Conjugate Pseudo-labels

abstract: Test-time adaptation (TTA) refers to adapting neural networks to distribution shifts, with access to only the unlabeled test samples from the new domain at test-time. Prior TTA methods optimize over unsupervised objectives such as the entropy of model predictions in TENT [Wang et al., 2021], but it is unclear what exactly makes a good TTA loss. In this paper, we start by presenting a surprising phenomenon: if we attempt to meta-learn the best possible TTA loss over a wide class of functions, then we recover a function that is remarkably similar to (a temperature-scaled version of) the softmax-entropy employed by TENT. This only holds, however, if the classifier we are adapting is trained via cross-entropy; if trained via squared loss, a different best TTA loss emerges. To explain this phenomenon, we analyze TTA through the lens of the training losses's convex conjugate. We show that under natural conditions, this (unsupervised) conjugate function can be viewed as a good local approximation to the original supervised loss and indeed, it recovers the best losses found by meta-learning. This leads to a generic recipe that can be used to find a good TTA loss for any given supervised training loss function of a general class. Empirically, our approach consistently dominates other baselines over a wide range of benchmarks. Our approach is particularly of interest when applied to classifiers trained with novel loss functions, e.g., the recently-proposed PolyLoss, where it differs substantially from (and outperforms) an entropy-based loss. Further, we show that our approach can also be interpreted as a kind of self-training using a very specific soft label, which we refer to as the conjugate pseudolabel. Overall, our method provides a broad framework for better understanding and improving test-time adaptation. Code is available at https://github.com/locuslab/tta_conjugate.


title: An exact solution of the higher-order gravity in standard radiation-dominated era

abstract: We report that the standard evolution of radiation-dominated era (RDE) universe $a \propto t^{1/2}$ is a sufficient condition for solving a sixth order gravitational field equation derived from the Lagrangian containing $B R^{ab}R_{ab} + C R {R^{;c}}_{c}$ as well as a polynomial $f(R)$ for a spatially flat radiation FLRW universe. By virtue of the similarity between $R^{ab}R_{ab}$ and $R^2$ models up to the background order and of the vanishing property of ${R^{;c}}_{c}$ for $ H = 1/(2t)$, the analytical solution can be obtained from a special case to general one. This proves that the standard cosmic evolution is valid even within modified gravitational theory involving higher-order terms. An application of this background solution to the tensor-type perturbation reduces the complicated equation to the standard second order equation of gravitational wave. We discuss the possible ways to discriminate the modified gravity model on the observations such as the gravitational wave from the disturbed universe and primordial abundances.


title: Compositions and parities of complete mappings and of orthomorphisms

abstract: We determine the permutation groups $P_{\mathrm{comp}}(\mathbb{F}_q),P_{\mathrm{orth}}(\mathbb{F}_q)\leq\operatorname{Sym}(\mathbb{F}_q)$ generated by the complete mappings, respectively the orthomorphisms, of the finite field $\mathbb{F}_q$ -- both are equal to $\operatorname{Sym}(\mathbb{F}_q)$ unless $q\in\{2,3,4,5,8\}$. More generally, denote by $P_{\mathrm{comp}}(G)$, respectively $P_{\mathrm{orth}}(G)$, the subgroup of $\operatorname{Sym}(G)$ generated by the complete mappings, respectively the orthomorphisms, of the group $G$. Using recent results of Eberhard-Manners-Mrazovi\'c and M\"uyesser-Pokrovskiy, we show that for each large enough finite group $G$ that has a complete mapping (i.e., whose Sylow $2$-subgroups are trivial or noncyclic), $P_{\mathrm{comp}}(G)=\operatorname{Sym}(G)$ and $P_{\mathrm{orth}}(G)\geq\operatorname{Alt}(G)$. We also prove that $P_{\mathrm{orth}}(G)=\operatorname{Sym}(G)$ for every large enough finite solvable group $G$ that has a complete mapping. Proving these results requires us to study the parities of complete mappings and of orthomorphisms. Some connections with known results in cryptography and with parity types of Latin squares are also discussed.


title: Integrating Linguistic Theory and Neural Language Models

abstract: Transformer-based language models have recently achieved remarkable results in many natural language tasks. However, performance on leaderboards is generally achieved by leveraging massive amounts of training data, and rarely by encoding explicit linguistic knowledge into neural models. This has led many to question the relevance of linguistics for modern natural language processing. In this dissertation, I present several case studies to illustrate how theoretical linguistics and neural language models are still relevant to each other. First, language models are useful to linguists by providing an objective tool to measure semantic distance, which is difficult to do using traditional methods. On the other hand, linguistic theory contributes to language modelling research by providing frameworks and sources of data to probe our language models for specific aspects of language understanding. This thesis contributes three studies that explore different aspects of the syntax-semantics interface in language models. In the first part of my thesis, I apply language models to the problem of word class flexibility. Using mBERT as a source of semantic distance measurements, I present evidence in favour of analyzing word class flexibility as a directional process. In the second part of my thesis, I propose a method to measure surprisal at intermediate layers of language models. My experiments show that sentences containing morphosyntactic anomalies trigger surprisals earlier in language models than semantic and commonsense anomalies. Finally, in the third part of my thesis, I adapt several psycholinguistic studies to show that language models contain knowledge of argument structure constructions. In summary, my thesis develops new connections between natural language processing, linguistic theory, and psycholinguistics to provide fresh perspectives for the interpretation of language models.


title: Hierarchically Self-Supervised Transformer for Human Skeleton Representation Learning

abstract: Despite the success of fully-supervised human skeleton sequence modeling, utilizing self-supervised pre-training for skeleton sequence representation learning has been an active field because acquiring task-specific skeleton annotations at large scales is difficult. Recent studies focus on learning video-level temporal and discriminative information using contrastive learning, but overlook the hierarchical spatial-temporal nature of human skeletons. Different from such superficial supervision at the video level, we propose a self-supervised hierarchical pre-training scheme incorporated into a hierarchical Transformer-based skeleton sequence encoder (Hi-TRS), to explicitly capture spatial, short-term, and long-term temporal dependencies at frame, clip, and video levels, respectively. To evaluate the proposed self-supervised pre-training scheme with Hi-TRS, we conduct extensive experiments covering three skeleton-based downstream tasks including action recognition, action detection, and motion prediction. Under both supervised and semi-supervised evaluation protocols, our method achieves the state-of-the-art performance. Additionally, we demonstrate that the prior knowledge learned by our model in the pre-training stage has strong transfer capability for different downstream tasks.


title: Downwash-aware Control Allocation for Over-actuated UAV Platforms

abstract: Tracking position and orientation independently affords more agile maneuver for over-actuated multirotor Unmanned Aerial Vehicles (UAVs) while introducing undesired downwash effects; downwash flows generated by thrust generators may counteract others due to close proximity, which significantly threatens the stability of the platform. The complexity of modeling aerodynamic airflow challenges control algorithms from properly compensating for such a side effect. Leveraging the input redundancies in over-actuated UAVs, we tackle this issue with a novel control allocation framework that considers downwash effects and explores the entire allocation space for an optimal solution. This optimal solution avoids downwash effects while providing high thrust efficiency within the hardware constraints. To the best of our knowledge, ours is the first formal derivation to investigate the downwash effects on over-actuated UAVs. We verify our framework on different hardware configurations in both simulation and experiment.


title: Aware of the History: Trajectory Forecasting with the Local Behavior Data

abstract: The historical trajectories previously passing through a location may help infer the future trajectory of an agent currently at this location. Despite great improvements in trajectory forecasting with the guidance of high-definition maps, only a few works have explored such local historical information. In this work, we re-introduce this information as a new type of input data for trajectory forecasting systems: the local behavior data, which we conceptualize as a collection of location-specific historical trajectories. Local behavior data helps the systems emphasize the prediction locality and better understand the impact of static map objects on moving agents. We propose a novel local-behavior-aware (LBA) prediction framework that improves forecasting accuracy by fusing information from observed trajectories, HD maps, and local behavior data. Also, where such historical data is insufficient or unavailable, we employ a local-behavior-free (LBF) prediction framework, which adopts a knowledge-distillation-based architecture to infer the impact of missing data. Extensive experiments demonstrate that upgrading existing methods with these two frameworks significantly improves their performances. Especially, the LBA framework boosts the SOTA methods' performance on the nuScenes dataset by at least 14% for the K=1 metrics.


title: Deep Learning Based Automatic Modulation Recognition: Models, Datasets, and Challenges

abstract: Automatic modulation recognition (AMR) detects the modulation scheme of the received signals for further signal processing without needing prior information, and provides the essential function when such information is missing. Recent breakthroughs in deep learning (DL) have laid the foundation for developing high-performance DL-AMR approaches for communications systems. Comparing with traditional modulation detection methods, DL-AMR approaches have achieved promising performance including high recognition accuracy and low false alarms due to the strong feature extraction and classification abilities of deep neural networks. Despite the promising potential, DL-AMR approaches also bring concerns to complexity and explainability, which affect the practical deployment in wireless communications systems. This paper aims to present a review of the current DL-AMR research, with a focus on appropriate DL models and benchmark datasets. We further provide comprehensive experiments to compare the state of the art models for single-input-single-output (SISO) systems from both accuracy and complexity perspectives, and propose to apply DL-AMR in the new multiple-input-multiple-output (MIMO) scenario with precoding. Finally, existing challenges and possible future research directions are discussed.


title: Roadmap Towards Responsible AI in Crisis Resilience Management

abstract: Novel data sensing and AI technologies are finding practical use in the analysis of crisis resilience, revealing the need to consider how responsible artificial intelligence (AI) practices can mitigate harmful outcomes and protect vulnerable populations. In this paper, we present a responsible AI roadmap that is embedded in the Crisis Information Management Circle. This roadmap includes six propositions to highlight and address important challenges and considerations specifically related to responsible AI for crisis resilience management. We cover a wide spectrum of interwoven challenges and considerations pertaining to the responsible collection, analysis, sharing, and use of information such as equity, fairness, biases, explainability and transparency, accountability, privacy and security, inter-organizational coordination, and public engagement. Through examining issues around AI systems for crisis resilience management, we dissect the inherent complexities of information management and decision-making in crises and highlight the urgency of responsible AI research and practice. The ideas laid out in this paper are the first attempt in establishing a roadmap for researchers, practitioners, developers, emergency managers, humanitarian organizations, and public officials to address important considerations for responsible AI pertaining to crisis resilience management.


title: GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulation

abstract: Automatic artistic text generation is an emerging topic which receives increasing attention due to its wide applications. The artistic text can be divided into three components, content, font, and texture, respectively. Existing artistic text generation models usually focus on manipulating one aspect of the above components, which is a sub-optimal solution for controllable general artistic text generation. To remedy this issue, we propose a novel approach, namely GenText, to achieve general artistic text style transfer by separably migrating the font and texture styles from the different source images to the target images in an unsupervised manner. Specifically, our current work incorporates three different stages, stylization, destylization, and font transfer, respectively, into a unified platform with a single powerful encoder network and two separate style generator networks, one for font transfer, the other for stylization and destylization. The destylization stage first extracts the font style of the font reference image, then the font transfer stage generates the target content with the desired font style. Finally, the stylization stage renders the resulted font image with respect to the texture style in the reference image. Moreover, considering the difficult data acquisition of paired artistic text images, our model is designed under the unsupervised setting, where all stages can be effectively optimized from unpaired data. Qualitative and quantitative results are performed on artistic text benchmarks, which demonstrate the superior performance of our proposed model. The code with models will become publicly available in the future.


title: Task Allocation using a Team of Robots

abstract: Task allocation using a team or coalition of robots is one of the most important problems in robotics, computer science, operational research, and artificial intelligence. In recent work, research has focused on handling complex objectives and feasibility constraints amongst other variations of the multi-robot task allocation problem. There are many examples of important research progress in these directions. We present a general formulation of the task allocation problem that generalizes several versions that are well-studied. Our formulation includes the states of robots, tasks, and the surrounding environment in which they operate. We describe how the problem can vary depending on the feasibility constraints, objective functions, and the level of dynamically changing information. In addition, we discuss existing solution approaches for the problem including optimization-based approaches, and market-based approaches.


title: Approximate Methods for Solving Chance Constrained Linear Programs in Probability Measure Space

abstract: A risk-aware decision-making problem can be formulated as a chance-constrained linear program in probability measure space. Chance-constrained linear program in probability measure space is intractable, and no numerical method exists to solve this problem. This paper presents numerical methods to solve chance-constrained linear programs in probability measure space for the first time. We propose two solvable optimization problems as approximate problems of the original problem. We prove the uniform convergence of each approximate problem. Moreover, numerical experiments have been implemented to validate the proposed methods.


title: Permutations and the divisor graph of $[1,n]$

abstract: Let $S_{\rm div}(n)$ denote the set of permutations $\pi$ of $n$ such that for each $1\leq j \leq n$ either $j \mid \pi(j)$ or $\pi(j) \mid j$. These permutations can also be viewed as vertex-disjoint directed cycle covers of the divisor graph $\mathcal{D}_{[1,n]}$ on vertices $v_1, \ldots, v_n$ with an edge between $v_i$ and $v_j$ if $i\mid j$ or $j \mid i$. We improve on recent results of Pomerance by showing $c_d = \lim_{n \to \infty }\left(\# S_{\rm div}(n)\right)^{1/n}$ exists and that $2.069<c_d<2.694$. We also obtain similar results for the set $S_{\rm lcm}(n)$ of permutations where ${\rm lcm}(j,\pi(j))\leq n$ for all $j$. The results rely on a graph theoretic result bounding the number of vertex-disjoint directed cycle covers, which may be of independent interest.


title: FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning

abstract: Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based FL algorithms require a large number of communication rounds to obtain a well-performed model due to extremely unbalanced and non-i.i.d data partitioning among different clients. Thus, we propose FedDM to build the global training objective from multiple local surrogate functions, which enables the server to gain a more global view of the loss landscape. In detail, we construct synthetic sets of data on each client to locally match the loss landscape from original data through distribution matching. FedDM reduces communication rounds and improves model quality by transmitting more informative and smaller synthesized data compared with unwieldy model weights. We conduct extensive experiments on three image classification datasets, and results show that our method can outperform other FL counterparts in terms of efficiency and model performance. Moreover, we demonstrate that FedDM can be adapted to preserve differential privacy with Gaussian mechanism and train a better model under the same privacy budget.


title: Learning Topological Interactions for Multi-Class Medical Image Segmentation

abstract: Deep learning methods have achieved impressive performance for multi-class medical image segmentation. However, they are limited in their ability to encode topological interactions among different classes (e.g., containment and exclusion). These constraints naturally arise in biomedical images and can be crucial in improving segmentation quality. In this paper, we introduce a novel topological interaction module to encode the topological interactions into a deep neural network. The implementation is completely convolution-based and thus can be very efficient. This empowers us to incorporate the constraints into end-to-end training and enrich the feature representation of neural networks. The efficacy of the proposed method is validated on different types of interactions. We also demonstrate the generalizability of the method on both proprietary and public challenge datasets, in both 2D and 3D settings, as well as across different modalities such as CT and Ultrasound. Code is available at: https://github.com/TopoXLab/TopoInteraction


title: Investigating the contribution of author- and publication-specific features to scholars' h-index prediction

abstract: Evaluation of researchers' output is vital for hiring committees and funding bodies, and it is usually measured via their scientific productivity, citations, or a combined metric such as h-index. Assessing young researchers is more critical because it takes a while to get citations and increment of h-index. Hence, predicting the h-index can help to discover the researchers' scientific impact. In addition, identifying the influential factors to predict the scientific impact is helpful for researchers seeking solutions to improve it. This study investigates the effect of author, paper and venue-specific features on the future h-index. For this purpose, we used machine learning methods to predict the h-index and feature analysis techniques to advance the understanding of feature impact. Utilizing the bibliometric data in Scopus, we defined and extracted two main groups of features. The first relates to prior scientific impact, and we name it 'prior impact-based features' and includes the number of publications, received citations, and h-index. The second group is 'non-impact-based features' and contains the features related to author, co-authorship, paper, and venue characteristics. We explored their importance in predicting h-index for researchers in three different career phases. Also, we examine the temporal dimension of predicting performance for different feature categories to find out which features are more reliable for long- and short-term prediction. We referred to the gender of the authors to examine the role of this author's characteristics in the prediction task. Our findings showed that gender has a very slight effect in predicting the h-index. We found that non-impact-based features are more robust predictors for younger scholars than seniors in the short term. Also, prior impact-based features lose their power to predict more than other features in the long-term.


title: Unsupervised Domain Adaptation for One-stage Object Detector using Offsets to Bounding Box

abstract: Most existing domain adaptive object detection methods exploit adversarial feature alignment to adapt the model to a new domain. Recent advances in adversarial feature alignment strives to reduce the negative effect of alignment, or negative transfer, that occurs because the distribution of features varies depending on the category of objects. However, by analyzing the features of the anchor-free one-stage detector, in this paper, we find that negative transfer may occur because the feature distribution varies depending on the regression value for the offset to the bounding box as well as the category. To obtain domain invariance by addressing this issue, we align the feature conditioned on the offset value, considering the modality of the feature distribution. With a very simple and effective conditioning method, we propose OADA (Offset-Aware Domain Adaptive object detector) that achieves state-of-the-art performances in various experimental settings. In addition, by analyzing through singular value decomposition, we find that our model enhances both discriminability and transferability.


title: Reducing Training Time in Cross-Silo Federated Learning using Multigraph Topology

abstract: Federated learning is an active research topic since it enables several participants to jointly train a model without sharing local data. Currently, cross-silo federated learning is a popular training setting that utilizes a few hundred reliable data silos with high-speed access links to training a model. While this approach has been widely applied in real-world scenarios, designing a robust topology to reduce the training time remains an open problem. In this paper, we present a new multigraph topology for cross-silo federated learning. We first construct the multigraph using the overlay graph. We then parse this multigraph into different simple graphs with isolated nodes. The existence of isolated nodes allows us to perform model aggregation without waiting for other nodes, hence effectively reducing the training time. Intensive experiments on three public datasets show that our proposed method significantly reduces the training time compared with recent state-of-the-art topologies while maintaining the accuracy of the learned model. Our code can be found at https://github.com/aioz-ai/MultigraphFL


title: Learning Depth from Focus in the Wild

abstract: For better photography, most recent commercial cameras including smartphones have either adopted large-aperture lens to collect more light or used a burst mode to take multiple images within short times. These interesting features lead us to examine depth from focus/defocus. In this work, we present a convolutional neural network-based depth estimation from single focal stacks. Our method differs from relevant state-of-the-art works with three unique features. First, our method allows depth maps to be inferred in an end-to-end manner even with image alignment. Second, we propose a sharp region detection module to reduce blur ambiguities in subtle focus changes and weakly texture-less regions. Third, we design an effective downsampling module to ease flows of focal information in feature extractions. In addition, for the generalization of the proposed network, we develop a simulator to realistically reproduce the features of commercial cameras, such as changes in field of view, focal length and principal points. By effectively incorporating these three unique features, our network achieves the top rank in the DDFF 12-Scene benchmark on most metrics. We also demonstrate the effectiveness of the proposed method on various quantitative evaluations and real-world images taken from various off-the-shelf cameras compared with state-of-the-art methods. Our source code is publicly available at https://github.com/wcy199705/DfFintheWild.


title: Decomposition of triangle-free planar graphs

abstract: A decomposition of a graph $G$ is a family of subgraphs of $G$ whose edge sets form a partition of $E(G)$. In this paper, we prove that every triangle-free planar graph $G$ can be decomposed into a $2$-degenerate graph and a matching. Consequently, every triangle-free planar graph $G$ has a matching $M$ such that $G-M$ is online 3-DP-colorable. This strengthens an earlier result in [R. \v{S}krekovski, {\em A Gr\"{o}tzsch-Type Theorem for List Colourings with Impropriety One}, Combin. Prob. Comput. 8 (1999), 493-507] that every triangle-free planar graph is $1$-defective $3$-choosable.


title: Alternating minimization for generalized rank one matrix sensing: Sharp predictions from a random initialization

abstract: We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study the convergence properties of a natural alternating update rule for this nonconvex optimization problem starting from a random initialization. We show sharp convergence guarantees for a sample-split version of the algorithm by deriving a deterministic recursion that is accurate even in high-dimensional problems. Notably, while the infinite-sample population update is uninformative and suggests exact recovery in a single step, the algorithm -- and our deterministic prediction -- converges geometrically fast from a random initialization. Our sharp, non-asymptotic analysis also exposes several other fine-grained properties of this problem, including how the nonlinearity and noise level affect convergence behavior. On a technical level, our results are enabled by showing that the empirical error recursion can be predicted by our deterministic sequence within fluctuations of the order $n^{-1/2}$ when each iteration is run with $n$ observations. Our technique leverages leave-one-out tools originating in the literature on high-dimensional $M$-estimation and provides an avenue for sharply analyzing higher-order iterative algorithms from a random initialization in other high-dimensional optimization problems with random data.


title: Hand-Assisted Expression Recognition Method from Synthetic Images at the Fourth ABAW Challenge

abstract: Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The fourth Affective Behavior Analysis in-the-wild Competition raises the challenge and provides the synthetic images generated from Aff-Wild2 dataset. In this paper, we propose a hand-assisted expression recognition method to reduce the gap between the synthetic data and real data. Our method consists of two parts: expression recognition module and hand prediction module. Expression recognition module extracts expression information and hand prediction module predicts whether the image contains hands. Decision mode is used to combine the results of two modules, and post-pruning is used to improve the result. F1 score is used to verify the effectiveness of our method.


title: HTNet: Anchor-free Temporal Action Localization with Hierarchical Transformers

abstract: Temporal action localization (TAL) is a task of identifying a set of actions in a video, which involves localizing the start and end frames and classifying each action instance. Existing methods have addressed this task by using predefined anchor windows or heuristic bottom-up boundary-matching strategies, which are major bottlenecks in inference time. Additionally, the main challenge is the inability to capture long-range actions due to a lack of global contextual information. In this paper, we present a novel anchor-free framework, referred to as HTNet, which predicts a set of <start time, end time, class> triplets from a video based on a Transformer architecture. After the prediction of coarse boundaries, we refine it through a background feature sampling (BFS) module and hierarchical Transformers, which enables our model to aggregate global contextual information and effectively exploit the inherent semantic relationships in a video. We demonstrate how our method localizes accurate action instances and achieves state-of-the-art performance on two TAL benchmark datasets: THUMOS14 and ActivityNet 1.3.


title: Streamable Neural Fields

abstract: Neural fields have emerged as a new data representation paradigm and have shown remarkable success in various signal representations. Since they preserve signals in their network parameters, the data transfer by sending and receiving the entire model parameters prevents this emerging technology from being used in many practical scenarios. We propose streamable neural fields, a single model that consists of executable sub-networks of various widths. The proposed architectural and training techniques enable a single network to be streamable over time and reconstruct different qualities and parts of signals. For example, a smaller sub-network produces smooth and low-frequency signals, while a larger sub-network can represent fine details. Experimental results have shown the effectiveness of our method in various domains, such as 2D images, videos, and 3D signed distance functions. Finally, we demonstrate that our proposed method improves training stability, by exploiting parameter sharing.


title: Pseudo-label Guided Cross-video Pixel Contrast for Robotic Surgical Scene Segmentation with Limited Annotations

abstract: Surgical scene segmentation is fundamentally crucial for prompting cognitive assistance in robotic surgery. However, pixel-wise annotating surgical video in a frame-by-frame manner is expensive and time consuming. To greatly reduce the labeling burden, in this work, we study semi-supervised scene segmentation from robotic surgical video, which is practically essential yet rarely explored before. We consider a clinically suitable annotation situation under the equidistant sampling. We then propose PGV-CL, a novel pseudo-label guided cross-video contrast learning method to boost scene segmentation. It effectively leverages unlabeled data for a trusty and global model regularization that produces more discriminative feature representation. Concretely, for trusty representation learning, we propose to incorporate pseudo labels to instruct the pair selection, obtaining more reliable representation pairs for pixel contrast. Moreover, we expand the representation learning space from previous image-level to cross-video, which can capture the global semantics to benefit the learning process. We extensively evaluate our method on a public robotic surgery dataset EndoVis18 and a public cataract dataset CaDIS. Experimental results demonstrate the effectiveness of our method, consistently outperforming the state-of-the-art semi-supervised methods under different labeling ratios, and even surpassing fully supervised training on EndoVis18 with 10.1% labeling.


title: ExoSGAN and ExoACGAN: Exoplanet Detection using Adversarial Training Algorithms

abstract: Exoplanet detection opens the door to the discovery of new habitable worlds and helps us understand how planets were formed. With the objective of finding earth-like habitable planets, NASA launched Kepler space telescope and its follow up mission K2. The advancement of observation capabilities has increased the range of fresh data available for research, and manually handling them is both time-consuming and difficult. Machine learning and deep learning techniques can greatly assist in lowering human efforts to process the vast array of data produced by the modern instruments of these exoplanet programs in an economical and unbiased manner. However, care should be taken to detect all the exoplanets precisely while simultaneously minimizing the misclassification of non-exoplanet stars. In this paper, we utilize two variations of generative adversarial networks, namely semi-supervised generative adversarial networks and auxiliary classifier generative adversarial networks, to detect transiting exoplanets in K2 data. We find that the usage of these models can be helpful for the classification of stars with exoplanets. Both of our techniques are able to categorize the light curves with a recall and precision of 1.00 on the test data. Our semi-supervised technique is beneficial to solve the cumbersome task of creating a labeled dataset.


title: GRIT: Faster and Better Image captioning Transformer Using Dual Visual Features

abstract: Current state-of-the-art methods for image captioning employ region-based features, as they provide object-level information that is essential to describe the content of images; they are usually extracted by an object detector such as Faster R-CNN. However, they have several issues, such as lack of contextual information, the risk of inaccurate detection, and the high computational cost. The first two could be resolved by additionally using grid-based features. However, how to extract and fuse these two types of features is uncharted. This paper proposes a Transformer-only neural architecture, dubbed GRIT (Grid- and Region-based Image captioning Transformer), that effectively utilizes the two visual features to generate better captions. GRIT replaces the CNN-based detector employed in previous methods with a DETR-based one, making it computationally faster. Moreover, its monolithic design consisting only of Transformers enables end-to-end training of the model. This innovative design and the integration of the dual visual features bring about significant performance improvement. The experimental results on several image captioning benchmarks show that GRIT outperforms previous methods in inference accuracy and speed.


title: Generalizable and Robust Deep Learning Algorithm for Atrial Fibrillation Diagnosis Across Ethnicities, Ages and Sexes

abstract: To drive health innovation that meets the needs of all and democratize healthcare, there is a need to assess the generalization performance of deep learning (DL) algorithms across various distribution shifts to ensure that these algorithms are robust. This retrospective study is, to the best of our knowledge, the first to develop and assess the generalization performance of a deep learning (DL) model for AF events detection from long term beat-to-beat intervals across ethnicities, ages and sexes. The new recurrent DL model, denoted ArNet2, was developed on a large retrospective dataset of 2,147 patients totaling 51,386 hours of continuous electrocardiogram (ECG). The models generalization was evaluated on manually annotated test sets from four centers (USA, Israel, Japan and China) totaling 402 patients. The model was further validated on a retrospective dataset of 1,730 consecutives Holter recordings from the Rambam Hospital Holter clinic, Haifa, Israel. The model outperformed benchmark state-of-the-art models and generalized well across ethnicities, ages and sexes. Performance was higher for female than male and young adults (less than 60 years old) and showed some differences across ethnicities. The main finding explaining these variations was an impairment in performance in groups with a higher prevalence of atrial flutter (AFL). Our findings on the relative performance of ArNet2 across groups may have clinical implications on the choice of the preferred AF examination method to use relative to the group of interest.


title: Convergence Results of Two-Step Inertial Proximal Point Algorithm

abstract: This paper proposes a two-point inertial proximal point algorithm to find zero of maximal monotone operators in Hilbert spaces. We obtain weak convergence results and non-asymptotic $O(1/n)$ convergence rate of our proposed algorithm in non-ergodic sense. Applications of our results to various well-known convex optimization methods, such as the proximal method of multipliers and the alternating direction method of multipliers are given. Numerical results are given to demonstrate the accelerating behaviors of our method over other related methods in the literature.


title: Efficient Dependency Analysis for Rule-Based Ontologies

abstract: Several types of dependencies have been proposed for the static analysis of existential rule ontologies, promising insights about computational properties and possible practical uses of a given set of rules, e.g., in ontology-based query answering. Unfortunately, these dependencies are rarely implemented, so their potential is hardly realised in practice. We focus on two kinds of rule dependencies -- positive reliances and restraints -- and design and implement optimised algorithms for their efficient computation. Experiments on real-world ontologies of up to more than 100,000 rules show the scalability of our approach, which lets us realise several previously proposed applications as practical case studies. In particular, we can analyse to what extent rule-based bottom-up approaches of reasoning can be guaranteed to yield redundancy-free "lean" knowledge graphs (so-called cores) on practical ontologies.


title: Optimal Trajectory Planning for Connected and Automated Vehicles in Lane-free Traffic with Vehicle Nudging

abstract: The paper presents a movement strategy for Connected and Automated Vehicles (CAVs) in a lane-free traffic environment with vehicle nudging by use of an optimal control approach. State-dependent constraints on control inputs are considered to ensure that the vehicle moves within the road boundaries and to prevent collisions. An objective function, comprising various weighted sub-objectives, is designed, whose minimization leads to vehicle advancement at the desired speed, when possible, while avoiding obstacles. A nonlinear optimal control problem (OCP) is formulated for the minimization of the objective function subject to constraints for each vehicle. A computationally efficient Feasible Direction Algorithm (FDA) is called, on event-triggered basis, to compute in real-time the numerical solution for finite time-horizons within a Model Predictive Control (MPC) framework. The approach is applied to each vehicle on the road, while running simulations on a lane-free ring-road, for a wide range of vehicle densities and different types of vehicles. From the simulations, which create myriads of driving episodes for each involved vehicle, it is observed that the proposed approach is highly efficient in delivering safe, comfortable and efficient vehicle trajectories, as well as high traffic flow outcomes. The approach is under investigation for further use in various lane-free road infrastructures for CAV traffic.


title: Spatio-temporal models of infectious disease with high rates of asymptomatic transmission

abstract: The surprisingly mercurial Covid-19 pandemic has highlighted the need to not only accelerate research on infectious disease, but to also study them using novel techniques and perspectives. A major contributor to the difficulty of containing the current pandemic is due to the highly asymptomatic nature of the disease. In this investigation, we develop a modeling framework to study the spatio-temporal evolution of diseases with high rates of asymptomatic transmission, and we apply this framework to a hypothetical country with mathematically tractable geography; namely, square counties uniformly organized into a rectangle. We first derive a model for the temporal dynamics of susceptible, infected, and recovered populations, which is applied at the county level. Next we use likelihood-based parameter estimation to derive temporally varying disease transmission parameters on the state-wide level. While these two methods give us some spatial structure and show the effects of behavioral and policy changes, they miss the evolution of hot zones that have caused significant difficulties in resource allocation during the current pandemic. It is evident that the distribution of cases will not be stagnantly based on the population density, as with many other diseases, but will continuously evolve. We model this as a diffusive process where the diffusivity is spatially varying based on the population distribution, and temporally varying based on the current number of simulated asymptomatic cases. With this final addition coupled to the SIR model with temporally varying transmission parameters, we capture the evolution of "hot zones" in our hypothetical setup.


title: Duplicate Detection as a Service

abstract: Completeness of a knowledge graph is an important quality dimension and factor on how well an application that makes use of it performs. Completeness can be improved by performing knowledge enrichment. Duplicate detection aims to find identity links between the instances of knowledge graphs and is a fundamental subtask of knowledge enrichment. Current solutions to the problem require expert knowledge of the tool and the knowledge graph they are applied to. Users might not have this expert knowledge. We present our service-based approach to the duplicate detection task that provides an easy-to-use no-code solution that is still competitive with the state-of-the-art and has recently been adopted in an industrial context. The evaluation will be based on several frequently used test scenarios.


title: Role of Polarization-Photon Coupling in Ultrafast Terahertz Excitation of Ferroelectrics

abstract: We investigate the role of polarization-photon coupling (specifically, polarization-oscillation-induced radiation electric field) in the excitation of ferroelectric thin films by an ultrafast terahertz (THz) electric-field pulse. Analytical theory is developed to predict how the frequencies and relaxation time of three-dimensional soft mode phonons (intrinsic polarization oscillation) are modulated by radiation electric field and epitaxial strain. Ultrafast THz-pulse-driven excitation of harmonic polarization oscillation in strained single-domain ferroelectric thin film is then simulated using a dynamical phase-field model that considers the coupled strain-polarization-photon dynamics. The frequencies and relaxational time extracted from such numerical simulations agree well with analytical predictions. In relatively thin films, it is predicted that the radiation electric field slightly reduces the frequencies but significantly shortens the relaxational time. These results demonstrate the necessity of considering polarization-photon coupling in understanding and predicting the response of ferroelectric materials to ultrafast pulses of THz and higher frequencies.


title: Improving Data Driven Inverse Text Normalization using Data Augmentation

abstract: Inverse text normalization (ITN) is used to convert the spoken form output of an automatic speech recognition (ASR) system to a written form. Traditional handcrafted ITN rules can be complex to transcribe and maintain. Meanwhile neural modeling approaches require quality large-scale spoken-written pair examples in the same or similar domain as the ASR system (in-domain data), to train. Both these approaches require costly and complex annotations. In this paper, we present a data augmentation technique that effectively generates rich spoken-written numeric pairs from out-of-domain textual data with minimal human annotation. We empirically demonstrate that ITN model trained using our data augmentation technique consistently outperform ITN model trained using only in-domain data across all numeric surfaces like cardinal, currency, and fraction, by an overall accuracy of 14.44%.


title: ERA: Expert Retrieval and Assembly for Early Action Prediction

abstract: Early action prediction aims to successfully predict the class label of an action before it is completely performed. This is a challenging task because the beginning stages of different actions can be very similar, with only minor subtle differences for discrimination. In this paper, we propose a novel Expert Retrieval and Assembly (ERA) module that retrieves and assembles a set of experts most specialized at using discriminative subtle differences, to distinguish an input sample from other highly similar samples. To encourage our model to effectively use subtle differences for early action prediction, we push experts to discriminate exclusively between samples that are highly similar, forcing these experts to learn to use subtle differences that exist between those samples. Additionally, we design an effective Expert Learning Rate Optimization method that balances the experts' optimization and leads to better performance. We evaluate our ERA module on four public action datasets and achieve state-of-the-art performance.


title: Round fold maps into the plane on some $7$-dimensional closed and simply-connected manifolds

abstract: Round fold maps are smooth maps on closed manifolds which are locally represented as the product maps of Morse functions and identity maps on open disks and whose singularity is realized as concentrically embedded spheres. The author previously introduced such maps. Our paper presents round fold maps on some $7$-dimensional simply-connected manifolds whose cohomology rings are isomorphic to that of the product of the $2$-dimensional complex projective space and a $3$-dimensional sphere. Such manifolds have been studied precisely by Wang and round fold maps on spin manifolds in these manifolds have been previously studied by the author. These manifolds form explicit classes of higehr dimensional closed and simply-connected manifolds, which are central objects in classical algeberic topology and differential topology. Understanding these manifolds in geometric and constructive ways is still attractive, which we think as pioneers. Fold maps are defined as smooth maps which are locally represented as the product maps of Morse functions and identity maps on open disks. They are fundamental and strong tools in generalizations of theory of Morse functions and applications to geometry of manifolds. Explicit construction of fold maps are difficult even on elementary or well-known manifolds whereas we can know the (non-)existence from Eliashberg's celebrating theory in the 1970s and related one in considerable cases.


title: Mathematical and numerical analysis to shrinking-dimer saddle dynamics with local Lipschitz conditions

abstract: We present a mathematical and numerical investigation to the shrinkingdimer saddle dynamics for finding any-index saddle points in the solution landscape. Due to the dimer approximation of Hessian in saddle dynamics, the local Lipschitz assumptions and the strong nonlinearity for the saddle dynamics, it remains challenges for delicate analysis, such as the the boundedness of the solutions and the dimer error. We address these issues to bound the solutions under proper relaxation parameters, based on which we prove the error estimates for numerical discretization to the shrinking-dimer saddle dynamics by matching the dimer length and the time step size. Furthermore, the Richardson extrapolation is employed to obtain a high-order approximation. The inherent reason of requiring the matching of the dimer length and the time step size lies in that the former serves a different mesh size from the later, and thus the proposed numerical method is close to a fully-discrete numerical scheme of some spacetime PDE model with the Hessian in the saddle dynamics and its dimer approximation serving as a "spatial operator" and its discretization, respectively, which in turn indicates the PDE nature of the saddle dynamics.


title: Optimal Structures for Failure Resistance Under Impact

abstract: The complex physics and numerous failure modes of structural impact creates challenges when designing for impact resistance. While simple geometries of layered material are conventional, advances in 3D printing and additive manufacturing techniques have now made tailored geometries or integrated multi-material structures achievable. Here, we apply gradient-based topology optimization to the design of such structures. We start by constructing a variational model of an elastic-plastic material enriched with gradient phase-field damage, and present a novel method to efficiently compute its transient dynamic time evolution. We consider a finite element discretization with explicit updates for the displacements. The damage field is solved through an augmented Lagrangian formulation, splitting the operator coupling between the nonlinearity and non-locality. Sensitivities over this trajectory are computed through the adjoint method, resulting in an adjoint problem which we solve in a similar manner to the forward dynamics. We demonstrate this formulation by studying the optimal design of 2D solid-void structures undergoing blast loading. Then, we explore the trade-offs between strength and toughness in the design of a spall-resistant structure composed of two materials of differing properties undergoing dynamic impact.


title: Explaining Deepfake Detection by Analysing Image Matching

abstract: This paper aims to interpret how deepfake detection models learn artifact features of images when just supervised by binary labels. To this end, three hypotheses from the perspective of image matching are proposed as follows. 1. Deepfake detection models indicate real/fake images based on visual concepts that are neither source-relevant nor target-relevant, that is, considering such visual concepts as artifact-relevant. 2. Besides the supervision of binary labels, deepfake detection models implicitly learn artifact-relevant visual concepts through the FST-Matching (i.e. the matching fake, source, target images) in the training set. 3. Implicitly learned artifact visual concepts through the FST-Matching in the raw training set are vulnerable to video compression. In experiments, the above hypotheses are verified among various DNNs. Furthermore, based on this understanding, we propose the FST-Matching Deepfake Detection Model to boost the performance of forgery detection on compressed videos. Experiment results show that our method achieves great performance, especially on highly-compressed (e.g. c40) videos.


title: The Tunka-Grande scintillation array: current results

abstract: The Tunka-Grande experiment is a scintillation array with about 0.5 sq.km sensitive area at Tunka Valley, Siberia, for measuring charged particles and muons in extensive air showers (EASs). Tunka-Grande is optimized for cosmic ray studies in the energy range 10 PeV to about 1 EeV, where exploring the composition is of fundamental importance for understanding the transition from galactic to extragalactic origin of cosmic rays. This paper attempts to provide a synopsis of the current results of the experiment. In particular, the reconstruction of the all-particle energy spectrum in the range of 10 PeV to 1 EeV based on experimental data from four observation seasons is presented.


title: Extremal problems on planar graphs without k edge-disjoint cycles

abstract: In the 1960s, Erd\H{o}s and his cooperators initiated the research of the maximum numbers of edges in a graph or a planar graph on $n$ vertices without $k$ edge-disjoint cycles. This problem had been solved for $k\leq4$. As pointed out by Bollob\'{a}s, it is very difficult for general $k$. Recently, Tait and Tobin [J. Combin. Theory Ser. B, 2017] confirmed a famous conjecture on maximum spectral radius of $n$-vertex planar graphs. Motivated by the above results, we consider two extremal problems on planar graphs without $k$ edge-disjoint cycles. We first determine the maximum number of edges in a planar graph of order $n$ and maximum degree $n-1$ without $k$ edge-disjoint cycles. Based on this, we then determine the maximum spectral radius as well as its unique extremal graph over all planar graphs on $n$ vertices without $k$ edge-disjoint cycles. Finally, we also discuss several extremal problems for general graphs.


title: Quantized Training of Gradient Boosting Decision Trees

abstract: Recent years have witnessed significant success in Gradient Boosting Decision Trees (GBDT) for a wide range of machine learning applications. Generally, a consensus about GBDT's training algorithms is gradients and statistics are computed based on high-precision floating points. In this paper, we investigate an essentially important question which has been largely ignored by the previous literature: how many bits are needed for representing gradients in training GBDT? To solve this mystery, we propose to quantize all the high-precision gradients in a very simple yet effective way in the GBDT's training algorithm. Surprisingly, both our theoretical analysis and empirical studies show that the necessary precisions of gradients without hurting any performance can be quite low, e.g., 2 or 3 bits. With low-precision gradients, most arithmetic operations in GBDT training can be replaced by integer operations of 8, 16, or 32 bits. Promisingly, these findings may pave the way for much more efficient training of GBDT from several aspects: (1) speeding up the computation of gradient statistics in histograms; (2) compressing the communication cost of high-precision statistical information during distributed training; (3) the inspiration of utilization and development of hardware architectures which well support low-precision computation for GBDT training. Benchmarked on CPUs, GPUs, and distributed clusters, we observe up to 2$\times$ speedup of our simple quantization strategy compared with SOTA GBDT systems on extensive datasets, demonstrating the effectiveness and potential of the low-precision training of GBDT. The code will be released to the official repository of LightGBM.