title: A Generalized A* Algorithm for Finding Globally Optimal Paths in Weighted Colored Graphs

abstract: Both geometric and semantic information of the search space is imperative for a good plan. We encode those properties in a weighted colored graph (geometric information in terms of edge weight and semantic information in terms of edge and vertex color), and propose a generalized A* to find the shortest path among the set of paths with minimal inclusion of low-ranked color edges. We prove the completeness and optimality of this Class-Ordered A* (COA*) algorithm with respect to the hereto defined notion of optimality. The utility of COA* is numerically validated in a ternary graph with feasible, infeasible, and unknown vertices and edges for the cases of a 2D mobile robot, a 3D robotic arm, and a 5D robotic arm with limited sensing capabilities. We compare the results of COA* to that of the regular A* algorithm, the latter of which finds the shortest path regardless of uncertainty, and we show that the COA* dominates the A* solution in terms of finding less uncertain paths.


title: Compactness and fractal dimensions of inhomogeneous continuum random trees

abstract: We introduce a new stick-breaking construction for inhomogeneous continuum random trees (ICRT). This new construction allows us to prove the necessary and sufficient condition for compactness conjectured by Aldous, Miermont and Pitman arXiv:math/0401115 by comparison with L\'evy trees. We also compute the fractal dimensions (Minkowski, Packing, Hausdorff).


title: White matter hyperintensities volume and cognition: Assessment of a deep learning based lesion detection and quantification algorithm on the Alzheimers Disease Neuroimaging Initiative

abstract: The relationship between cognition and white matter hyperintensities (WMH) volumes often depends on the accuracy of the lesion segmentation algorithm used. As such, accurate detection and quantification of WMH is of great interest. Here, we use a deep learning-based WMH segmentation algorithm, StackGen-Net, to detect and quantify WMH on 3D FLAIR volumes from ADNI. We used a subset of subjects (n=20) and obtained manual WMH segmentations by an experienced neuro-radiologist to demonstrate the accuracy of our algorithm. On a larger cohort of subjects (n=290), we observed that larger WMH volumes correlated with worse performance on executive function (P=.004), memory (P=.01), and language (P=.005).


title: Dust polarized emission observations of NGC 6334; BISTRO reveals the details of the complex but organized magnetic field structure of the high-mass star-forming hub-filament network

abstract: [Abridged] Filaments and hubs have received special attention recently thanks to studies showing their role in star formation. While the column density and velocity structures of both filaments and hubs have been studied, their magnetic fields (B-field) are not yet characterized. We aim to understand the role of the B-field in the dynamical evolution of the NGC 6334 hub-filament network. We present new observations of the dust polarized emission at 850$\mu$m towards NGC 6334 obtained with the JCMT/POL-2. We study the distribution and dispersion of the polarized intensity ($PI$), the polarization fraction ($PF$), and the B-field angle ($\theta_{B}$). We derive the power spectrum of the intensity and $\theta_{B}$ along the ridge crest. Our analyses show a complex B-field structure when observed over the whole region ($\sim10$ pc), however, at smaller scales ($\sim1$ pc), $\theta_{B}$ varies coherently along the filaments. The observed power spectrum of $\theta_{B}$ can be well represented with a power law function with a slope $-1.33\pm0.23$, which is $\sim20\%$ shallower than that of $I$. This result is compatible with the properties of simulated filaments and may indicate the processes at play in the formation of filaments. $\theta_{B}$ rotates from being mostly perpendicular to the filament crests to mostly parallel as they merge with the hubs. This variation of $\theta_{B}$ may be tracing local velocity flows of matter in-falling onto the hubs. Our analysis suggests a variation of the energy balance along the crests of these filaments, from magnetically critical/supercritical at their far ends to magnetically subcritical near the hubs. We detect an increase of $PF$ towards the high-column density star cluster-forming hubs that may result from the increase of grain alignment efficiency due to stellar radiation from the newborn stars.


title: Quantifying the Privacy-Utility Trade-offs in COVID-19 Contact Tracing Apps

abstract: How to contain the spread of the COVID-19 virus is a major concern for most countries. As the situation continues to change, various countries are making efforts to reopen their economies by lifting some restrictions and enforcing new measures to prevent the spread. In this work, we review some approaches that have been adopted to contain the COVID-19 virus such as contact tracing, clusters identification, movement restrictions, and status validation. Specifically, we classify available techniques based on some characteristics such as technology, architecture, trade-offs (privacy vs utility), and the phase of adoption. We present a novel approach for evaluating privacy using both qualitative and quantitative measures of privacy-utility assessment of contact tracing applications. In this new method, we classify utility at three (3) distinct levels: no privacy, 100% privacy, and at k where k is set by the system providing the utility or privacy.


title: The NRGTEN Python package: an extensible toolkit for coarse-grained normal mode analysis of proteins, nucleic acids, small molecules and their complexes

abstract: Summary: Coarse-grained normal mode analysis (NMA) is a fast computational technique to study the dynamics of biomolecules. Here we present the Najmanovich Research Group Toolkit for Elastic Networks (NRGTEN). NRGTEN is a Python toolkit that implements four different NMA models in addition to popular and novel metrics to benchmark and measure properties from these models. Furthermore, the toolkit is available as a public Python package and is easily extensible for the development or implementation of additional NMA models. The inclusion of the ENCoM model (Elastic Network Contact Model) developed in our group within NRGTEN is noteworthy, owing to its account for the specific chemical nature of atomic interactions. This makes possible some unique predictions of the effect of mutations, such as on stability (via changes in vibrational entropy differences), on the transition probability between different conformational states or on the flexibility profile of the whole macromolecule/complex (to study allostery and signalling). In addition, all NMA models can be used to generate conformational ensembles from a starting structure to aid in protein-protein, protein-ligand or other docking studies among applications. NRGTEN is freely available via a public Python package which can be easily installed on any modern machine and includes a detailed user guide hosted online. Availability and implementation: https://github.com/gregorpatof/nrgten_package/ Contact: rafael.najmanovich@umontreal.ca


title: Decentralized Federated Learning via Mutual Knowledge Transfer

abstract: In this paper, we investigate the problem of decentralized federated learning (DFL) in Internet of things (IoT) systems, where a number of IoT clients train models collectively for a common task without sharing their private training data in the absence of a central server. Most of the existing DFL schemes are composed of two alternating steps, i.e., model updating and model averaging. However, averaging model parameters directly to fuse different models at the local clients suffers from client-drift especially when the training data are heterogeneous across different clients. This leads to slow convergence and degraded learning performance. As a possible solution, we propose the decentralized federated earning via mutual knowledge transfer (Def-KT) algorithm where local clients fuse models by transferring their learnt knowledge to each other. Our experiments on the MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100 datasets reveal that the proposed Def-KT algorithm significantly outperforms the baseline DFL methods with model averaging, i.e., Combo and FullAvg, especially when the training data are not independent and identically distributed (non-IID) across different clients.


title: Exponential integrators preserving first integrals or Lyapunov functions for conservative or dissipative systems

abstract: In this paper, combining the ideas of exponential integrators and discrete gradients, we propose and analyze a new structure-preserving exponential scheme for the conservative or dissipative system $\dot{y} = Q(M y + \nabla U (y))$, where $Q$ is a $d\times d$ skew-symmetric or negative semidefinite real matrix, $M$ is a $d\times d$ symmetric real matrix, and $U : \mathbb{R}^d\rightarrow\mathbb{R}$ is a differentiable function. We present two properties of the new scheme. The paper is accompanied by numerical results that demonstrate the remarkable superiority of our new scheme in comparison with other structure-preserving schemes in the scientific literature.


title: Comments on Axions, Domain Walls, and Cosmic Strings

abstract: Axions have for some time been considered a plausible candidate for dark matter. They can be produced through misalignment, but it has been argued that when inflation occurs before a Peccei-Quinn transition, appreciable production can result from cosmic strings. This has been the subject of extensive simulations. But there are reasons to be skeptical about the possible role of axion strings. We review and elaborate on these questions, and argue that parametrically strings are already accounted for by the assumption of random misalignment angles. We review and elaborate on these questions, and provide several qualitative arguments that parametrically strings are already accounted for by the assumption of random misalignment angles. The arguments are base on considerations of the collective modes of the string solutions, on computations of axion radiation in particular models, and reviews of simulations.


title: Functionally-fitted energy-preserving methods for solving oscillatory nonlinear Hamiltonian systems

abstract: In the last few decades, numerical simulation for nonlinear oscillators has received a great deal of attention, and many researchers have been concerned with the design and analysis of numerical methods for solving oscillatory problems. In this paper, from the perspective of the continuous finite element method, we propose and analyze new energy-preserving functionally fitted methods, in particular trigonometrically fitted methods of an arbitrarily high order for solving oscillatory nonlinear Hamiltonian systems with a fixed frequency. To implement these new methods in a widespread way, they are transformed into a class of continuous-stage Runge--Kutta methods. This paper is accompanied by numerical experiments on oscillatory Hamiltonian systems such as the FPU problem and nonlinear Schr\"odinger equation. The numerical results demonstrate the remarkable accuracy and efficiency of our new methods compared with the existing high-order energy-preserving methods in the literature.


title: Stability property and Dirichlet problem for translating solitons

abstract: In this paper, we prove that the infimum of the mean curvature is zero for a translating solitons of hypersurface in $\re^{n+k}$. We give some conditions under which a complete hypersurface translating soliton is stable. We show that if the norm of its mean curvature is less than one, then the weighted volume may have exponent growth. We also study the Dirichlet problem for graphic translating solitons in higher codimensions.


title: The ultradiscrete Toda lattice and the Smith normal form of bidiagonal matrices

abstract: The discrete Toda lattice preserves the eigenvalues of tridiagonal matrices, and convergence of dependent variables to the eigenvalues can be proved under appropriate conditions. We show that the ultradiscrete Toda lattice preserves invariant factors of a certain bidiagonal matrix over a principal ideal domain, and prove convergence of dependent variables to invariant factors using properties of box and ball system. Using this fact, we present a new method for computing the Smith normal form of a given matrix.


title: Yamabe metrics, Fine solutions to the Yamabe flow, and local L1-stability

abstract: In this paper, we study the existence of complete Yamabe metric with zero scalar curvature on an n-dimensional complete Riemannian manifold $(M,g_0)$, $n\geq 3$. Under suitable conditions about the initial metric, we show that there is a global fine solution to the Yamabe flow. The interesting point here is that we have no curvature assumption about the initial metric. We show that on an n-dimensional complete Riemannian manifold $(M,g_0)$ with non-negative Ricci curvature, $n\geq 3$, the Yamabe flow enjoys the local $L^1$-stability property from the view-point of the porous media equation. Complete Yamabe metrics with zero scalar curvature on an n-dimensional Riemannian model space are also discussed.


title: Ubiquity in graphs III: Ubiquity of locally finite graphs with extensive tree-decompositions

abstract: A graph $G$ is said to be ubiquitous, if every graph $\Gamma$ that contains arbitrarily many disjoint $G$-minors automatically contains infinitely many disjoint $G$-minors. The well-known Ubiquity conjecture of Andreae says that every locally finite graph is ubiquitous. In this paper we show that locally finite graphs admitting a certain type of tree-decomposition, which we call an extensive tree-decomposition, are ubiquitous. In particular this includes all locally finite graphs of finite tree-width, and also all locally finite graphs with finitely many ends, all of which have finite degree. It remains an open question whether every locally finite graph admits an extensive tree-decomposition.


title: Two solutions to Kazdan-Warner's problem on surfaces

abstract: In this paper, we study the sign-changing Kazdan-Warner's problem on two dimensional closed Riemannian manifold with negative Euler number $\chi(M)<0$. We show that once, the direct method on convex sets is used to find a minimizer of the corresponding functional, then there is another solution via a use of the variational method of mountain pass. In conclusion, we show that there are at least two solutions to the Kazdan-Warner's problem on two dimensional Kazdan-Warner equation provided the prescribed function changes signs and with this average negative.


title: Pusz--Woronowicz's functional calculus revisited

abstract: This note is a complement to Pusz--Woronowicz's works on functional calculus for two positive forms from the viewpoint of operator theory. Based on an elementary, self-contained and purely Hilbert space operator explanation of their functional calculus, we show that any operator connection type operations (including any operator perspectives) are captured by their functional calculus.


title: Task-Adaptive Negative Envision for Few-Shot Open-Set Recognition

abstract: We study the problem of few-shot open-set recognition (FSOR), which learns a recognition system capable of both fast adaptation to new classes with limited labeled examples and rejection of unknown negative samples. Traditional large-scale open-set methods have been shown ineffective for FSOR problem due to data limitation. Current FSOR methods typically calibrate few-shot closed-set classifiers to be sensitive to negative samples so that they can be rejected via thresholding. However, threshold tuning is a challenging process as different FSOR tasks may require different rejection powers. In this paper, we instead propose task-adaptive negative class envision for FSOR to integrate threshold tuning into the learning process. Specifically, we augment the few-shot closed-set classifier with additional negative prototypes generated from few-shot examples. By incorporating few-shot class correlations in the negative generation process, we are able to learn dynamic rejection boundaries for FSOR tasks. Besides, we extend our method to generalized few-shot open-set recognition (GFSOR), which requires classification on both many-shot and few-shot classes as well as rejection of negative samples. Extensive experiments on public benchmarks validate our methods on both problems.


title: A Plug-and-Play Priors Framework for Hyperspectral Unmixing

abstract: Spectral unmixing is a widely used technique in hyperspectral image processing and analysis. It aims to separate mixed pixels into the component materials and their corresponding abundances. Early solutions to spectral unmixing are performed independently on each pixel. Nowadays, investigating proper priors into the unmixing problem has been popular as it can significantly enhance the unmixing performance. However, it is non-trivial to handcraft a powerful regularizer, and complex regularizers may introduce extra difficulties in solving optimization problems in which they are involved. To address this issue, we present a plug-and-play (PnP) priors framework for hyperspectral unmixing. More specifically, we use the alternating direction method of multipliers (ADMM) to decompose the optimization problem into two iterative subproblems. One is a regular optimization problem depending on the forward model, and the other is a proximity operator related to the prior model and can be regarded as an image denoising problem. Our framework is flexible and extendable which allows a wide range of denoisers to replace prior models and avoids handcrafting regularizers. Experiments conducted on both synthetic data and real airborne data illustrate the superiority of the proposed strategy compared with other state-of-the-art hyperspectral unmixing methods.


title: Correlated Wishart Matrices Classification via an Expectation-Maximization Composite Likelihood-Based Algorithm

abstract: Positive-definite matrix-variate data is becoming popular in computer vision. The computer vision data descriptors in the form of Region Covariance Descriptors (RCD) are positive definite matrices, which extract the key features of the images. The RCDs are extensively used in image set classification. Some classification methods treating RCDs as Wishart distributed random matrices are being proposed. However, the majority of the current methods preclude the potential correlation among the RCDs caused by the so-called non-voxel information (e.g., subjects' ages and nose widths, etc). Modeling correlated Wishart matrices is difficult since the joint density function of correlated Wishart matrices is difficult to be obtained. In this paper, we propose an Expectation-Maximization composite likelihood-based algorithm of Wishart matrices to tackle this issue. Given the numerical studies based on the synthetic data and the real data (Chicago face data-set), our proposed algorithm performs better than the alternative methods which do not consider the correlation caused by the so-called non-voxel information. All these above demonstrate our algorithm's compelling potential in image set classification in the coming future.


title: Symmetry and Unification from Soft Theorems and Unitarity

abstract: We argue that symmetry and unification can emerge as byproducts of certain physical constraints on dynamical scattering. To accomplish this we parameterize a general Lorentz invariant, four-dimensional theory of massless and massive scalar fields coupled via arbitrary local interactions. Assuming perturbative unitarity and an Adler zero condition, we prove that any finite spectrum of massless and massive modes will necessarily unify at high energies into multiplets of a linearized symmetry. Certain generators of the symmetry algebra can be derived explicitly in terms of the spectrum and three-particle interactions. Furthermore, our assumptions imply that the coset space is symmetric.


title: AsymptoticNG: A regularized natural gradient optimization algorithm with look-ahead strategy

abstract: Optimizers that further adjust the scale of gradient, such as Adam, Natural Gradient (NG), etc., despite widely concerned and used by the community, are often found poor generalization performance, compared with Stochastic Gradient Descent (SGD). They tend to converge excellently at the beginning of training but are weak at the end. An immediate idea is to complement the strengths of these algorithms with SGD. However, a truncated replacement of optimizer often leads to a crash of the update pattern, and new algorithms often require many iterations to stabilize their search direction. Driven by this idea and to address this problem, we design and present a regularized natural gradient optimization algorithm with look-ahead strategy, named asymptotic natural gradient (ANG). According to the total iteration step, ANG dynamic assembles NG and Euclidean gradient, and updates parameters along the new direction using the intensity of NG. Validation experiments on CIFAR10 and CIFAR100 data sets show that ANG can update smoothly and stably at the second-order speed, and achieve better generalization performance.


title: Rotation Equivariant Siamese Networks for Tracking

abstract: Rotation is among the long prevailing, yet still unresolved, hard challenges encountered in visual object tracking. The existing deep learning-based tracking algorithms use regular CNNs that are inherently translation equivariant, but not designed to tackle rotations. In this paper, we first demonstrate that in the presence of rotation instances in videos, the performance of existing trackers is severely affected. To circumvent the adverse effect of rotations, we present rotation-equivariant Siamese networks (RE-SiamNets), built through the use of group-equivariant convolutional layers comprising steerable filters. SiamNets allow estimating the change in orientation of the object in an unsupervised manner, thereby facilitating its use in relative 2D pose estimation as well. We further show that this change in orientation can be used to impose an additional motion constraint in Siamese tracking through imposing restriction on the change in orientation between two consecutive frames. For benchmarking, we present Rotation Tracking Benchmark (RTB), a dataset comprising a set of videos with rotation instances. Through experiments on two popular Siamese architectures, we show that RE-SiamNets handle the problem of rotation very well and out-perform their regular counterparts. Further, RE-SiamNets can accurately estimate the relative change in pose of the target in an unsupervised fashion, namely the in-plane rotation the target has sustained with respect to the reference frame.


title: The Hoffman program of graphs: old and new

abstract: The Hoffman program with respect to any real or complex square matrix $M$ associated to a graph $G$ stems from A. J. Hoffman's pioneering work on the limit points for the spectral radius of adjacency matrices of graphs less than $\sqrt{2+\sqrt{5}}$. The program consists of two aspects: finding all the possible limit points of $M$-spectral radii of graphs and detecting all the connected graphs whose $M$-spectral radius does not exceed a fixed limit point. In this paper, we summarize the results on this topic concerning several graph matrices, including the adjacency, the Laplacian, the signless Laplacian, the Hermitian adjacency and skew-adjacency matrix of graphs. As well, the tensors of hypergraphs are discussed. Moreover, we obtain new results about the Hoffman program with relation to the $A_\alpha$-matrix. Some further problems on this topic are also proposed.


title: Super interference fringes of two-photon photoluminescence in individual Au nanoparticles: the critical role of the intermediate state

abstract: The interaction between light and metal nanoparticles enables investigations of microscopic phenomena on nanometer length and ultrashort time scales, benefiting from strong confinement and enhancement of the optical field. However, the ultrafast dynamics of these nanoparticles are primarily investigated by multiphoton photoluminescence on picoseconds or photoemission on femtoseconds independently. Here, we presented two-photon photoluminescence (TPPL) measurements on individual Au nanobipyramids (AuNP) to reveal their ultrafast dynamics by two-pulse excitation on a global time scale ranging from sub-femtosecond to tens of picoseconds. Two-orders-of-magnitude photoluminescence enhancement, namely super interference fringes, has been demonstrated on tens of femtoseconds. Power-dependent measurements uncovered the transform of the nonlinearity from 1 to 2 when the interpulse delay varied from tens of femtoseconds to tens of picoseconds. We proved that the real intermediate state plays a critical role in the observed phenomena, supported by numerical simulations with a three eigenstates model and further experiments on Au nanospheres with different diameters. The crucial parameters, including the dephasing time, the radiative rate, and the coupling between different states, have been estimated using numerical simulations. Our results provide insight into the role of intermediate states in the ultrafast dynamics of noble metal nanoparticles. The giant photoluminescence in super interference fringes enables potential practical applications in imaging, sensing, and nanophotonics.


title: Design and optimization of dihedral angle offsets for the next generation lunar retro-reflectors

abstract: Lunar laser ranging (LLR) to the Apollo retro-reflectors, which features the most long-lasting experiment in testing General Relativity theories, has remained operational over the past four decades. To date, with significant improvement of ground observatory conditions, the bottleneck of LLR accuracy lies in the retro-reflectors. A new generation of large aperture retro-reflectors with intended dihedral angle offsets have been suggested and implemented based on NASA's recent lunar projects to reduce its ranging uncertainty to be less than 1.0 mm. The technique relies on the retro-reflector's ability to offset its relative angular velocity with regard to a ground LLR observatory (LLRO), so that the LLR accuracy can be ensured along with the larger area of beam reflection. In deployment, solid corner-cube reflectors (CCRs) based on empirical successes of the Apollo 11 and 15 arrays have been selected for the next generation lunar reflectors (NGLRs) due to their stability against heat and dust problems on the Moon. In this work, we present the optical effects in designing the new retro-reflectors given various sets of intended diheral angle offsets (DAOs), and support the design principles with the measurements of of two manufactured NGLRs.

categories: astro-ph.IM gr-qc physics.optics physics.space-ph


title: Analysis and Design of Partially Information- and Partially Parity-Coupled Turbo Codes

abstract: In this paper, we study a class of spatially coupled turbo codes, namely partially information- and partially parity-coupled turbo codes. This class of codes enjoy several advantages such as flexible code rate adjustment by varying the coupling ratio and the encoding and decoding architectures of the underlying component codes can remain unchanged. For this work, we first provide the construction methods for partially coupled turbo codes with coupling memory $m$ and study the corresponding graph models. We then derive the density evolution equations for the corresponding ensembles on the binary erasure channel to precisely compute their iterative decoding thresholds. Rate-compatible designs and their decoding thresholds are also provided, where the coupling and puncturing ratios are jointly optimized to achieve the largest decoding threshold for a given target code rate. Our results show that for a wide range of code rates, the proposed codes attain close-to-capacity performance and the decoding performance improves with increasing the coupling memory. In particular, the proposed partially parity-coupled turbo codes have thresholds within 0.0002 of the BEC capacity for rates ranging from $1/3$ to $9/10$, yielding an attractive way for constructing rate-compatible capacity-approaching channel codes.


title: Self-Supervised Representation Learning for Astronomical Images

abstract: Sky surveys are the largest data generators in astronomy, making automated tools for extracting meaningful scientific information an absolute necessity. We show that, without the need for labels, self-supervised learning recovers representations of sky survey images that are semantically useful for a variety of scientific tasks. These representations can be directly used as features, or fine-tuned, to outperform supervised methods trained only on labeled data. We apply a contrastive learning framework on multi-band galaxy photometry from the Sloan Digital Sky Survey (SDSS) to learn image representations. We then use them for galaxy morphology classification, and fine-tune them for photometric redshift estimation, using labels from the Galaxy Zoo 2 dataset and SDSS spectroscopy. In both downstream tasks, using the same learned representations, we outperform the supervised state-of-the-art results, and we show that our approach can achieve the accuracy of supervised models while using 2-4 times fewer labels for training.


title: The CatWISE2020 Catalog

abstract: The CatWISE2020 Catalog consists of 1,890,715,640 sources over the entire sky selected from WISE and NEOWISE survey data at 3.4 and 4.6 $\mu$m (W1 and W2) collected from 2010 Jan. 7 to 2018 Dec. 13. This dataset adds two years to that used for the CatWISE Preliminary Catalog (Eisenhardt et al., 2020), bringing the total to six times as many exposures spanning over sixteen times as large a time baseline as the AllWISE catalog. The other major change from the CatWISE Preliminary Catalog is that the detection list for the CatWISE2020 Catalog was generated using ${\it crowdsource}$ (Schlafly et al. 2019), while the CatWISE Preliminary Catalog used the detection software used for AllWISE. These two factors result in roughly twice as many sources in the CatWISE2020 Catalog. The scatter with respect to ${\it Spitzer}$ photometry at faint magnitudes in the COSMOS field, which is out of the Galactic plane and at low ecliptic latitude (corresponding to lower WISE coverage depth) is similar to that for the CatWISE Preliminary Catalog. The 90% completeness depth for the CatWISE2020 Catalog is at W1=17.7 mag and W2=17.5 mag, 1.7 mag deeper than in the CatWISE Preliminary Catalog. From comparison to ${\it Gaia}$, CatWISE2020 motions are accurate at the 20 mas yr$^{-1}$ level for W1$\sim$15 mag sources, and at the $\sim100$ mas yr$^{-1}$ level for W1$\sim$17 mag sources. This level of precision represents a 12$\times$ improvement over AllWISE. The CatWISE catalogs are available in the WISE/NEOWISE Enhanced and Contributed Products area of the NASA/IPAC Infrared Science Archive.


title: Semi-Supervised Node Classification on Graphs: Markov Random Fields vs. Graph Neural Networks

abstract: Semi-supervised node classification on graph-structured data has many applications such as fraud detection, fake account and review detection, user's private attribute inference in social networks, and community detection. Various methods such as pairwise Markov Random Fields (pMRF) and graph neural networks were developed for semi-supervised node classification. pMRF is more efficient than graph neural networks. However, existing pMRF-based methods are less accurate than graph neural networks, due to a key limitation that they assume a heuristics-based constant edge potential for all edges. In this work, we aim to address the key limitation of existing pMRF-based methods. In particular, we propose to learn edge potentials for pMRF. Our evaluation results on various types of graph datasets show that our optimized pMRF-based method consistently outperforms existing graph neural networks in terms of both accuracy and efficiency. Our results highlight that previous work may have underestimated the power of pMRF for semi-supervised node classification.


title: Structure, Electrical and Optical Properties of ITO Thin Films and their Influence on Performance of CdS/CdTe Thin-Film Solar Cells

abstract: In terms of mixing graded TiO2 and SnO2 powders by solid-state reaction method, ITO was prepared. Using electron beam gun technology, ITO films with different thicknesses were prepared. The influence of film thickness on structure, electrical and optical properties was studied. The XRD patterns were utilized to determine the structural parameters (lattice strain and crystallite size) of ITO with different thicknesses. It is observed that the average crystallite size increases as the film thickness increases, but the lattice strain decreases. SEM shows that as the film thickness increases, the grain size of ITO increases and improves. The electrical properties of ITO films with different thicknesses were measured by the standard four-point probe method. It can be seen that as the thickness of the ITO film increases from 75 nm to 325 nm, the resistivity decreases from 29x10^-4 Ohm/cm to 1.65x10^-4 Ohm/cm. This means that ITO films with lower electrical properties will be more suitable for high-efficiency CdTe solar cells. Three optical layer models (adhesive layer of the substrate/B-spline layer of ITO film/surface roughness layer) are used to calculate the film thickness with high-precision ellipsometry. In the higher T(lambda) and R(lambda) absorption regions, the absorption coefficient is determined to calculate the optical energy gap, which increases from 3.56 eV to 3.69 eV. Finally, the effects of ITO layers of various thicknesses on the performance of CdS/CdTe solar cells are also studied. When the thickness of the ITO window layer is 325 nm, Voc = 0.82 V, Jsc = 17 mA/cm2, and FF = 57.4%, the highest power conversion efficiency (PCE) is 8.6%.


title: Stochastic Steepest Descent Methods for Linear Systems: Greedy Sampling & Momentum

abstract: Recently proposed adaptive Sketch & Project (SP) methods connect several well-known projection methods such as Randomized Kaczmarz (RK), Randomized Block Kaczmarz (RBK), Motzkin Relaxation (MR), Randomized Coordinate Descent (RCD), Capped Coordinate Descent (CCD), etc. into one framework for solving linear systems. In this work, we first propose a Stochastic Steepest Descent (SSD) framework that connects SP methods with the well-known Steepest Descent (SD) method for solving positive-definite linear system of equations. We then introduce two greedy sampling strategies in the SSD framework that allow us to obtain algorithms such as Sampling Kaczmarz Motzkin (SKM), Sampling Block Kaczmarz (SBK), Sampling Coordinate Descent (SCD), etc. In doing so, we generalize the existing sampling rules into one framework and develop an efficient version of SP methods. Furthermore, we incorporated the Polyak momentum technique into the SSD method to accelerate the resulting algorithms. We provide global convergence results for both the SSD method and the momentum induced SSD method. Moreover, we prove $\mathcal{O}(\frac{1}{k})$ convergence rate for the Cesaro average of iterates generated by both methods. By varying parameters in the SSD method, we obtain classical convergence results of the SD method as well as the SP methods as special cases. We design computational experiments to demonstrate the performance of the proposed greedy sampling methods as well as the momentum methods. The proposed greedy methods significantly outperform the existing methods for a wide variety of datasets such as random test instances as well as real-world datasets (LIBSVM, sparse datasets from matrix market collection). Finally, the momentum algorithms designed in this work accelerate the algorithmic performance of the SSD methods.


title: High-Dimensional Bayesian Optimization via Tree-Structured Additive Models

abstract: Bayesian Optimization (BO) has shown significant success in tackling expensive low-dimensional black-box optimization problems. Many optimization problems of interest are high-dimensional, and scaling BO to such settings remains an important challenge. In this paper, we consider generalized additive models in which low-dimensional functions with overlapping subsets of variables are composed to model a high-dimensional target function. Our goal is to lower the computational resources required and facilitate faster model learning by reducing the model complexity while retaining the sample-efficiency of existing methods. Specifically, we constrain the underlying dependency graphs to tree structures in order to facilitate both the structure learning and optimization of the acquisition function. For the former, we propose a hybrid graph learning algorithm based on Gibbs sampling and mutation. In addition, we propose a novel zooming-based algorithm that permits generalized additive models to be employed more efficiently in the case of continuous domains. We demonstrate and discuss the efficacy of our approach via a range of experiments on synthetic functions and real-world datasets.


title: P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding

abstract: Self-supervised representation learning is a critical problem in computer vision, as it provides a way to pretrain feature extractors on large unlabeled datasets that can be used as an initialization for more efficient and effective training on downstream tasks. A promising approach is to use contrastive learning to learn a latent space where features are close for similar data samples and far apart for dissimilar ones. This approach has demonstrated tremendous success for pretraining both image and point cloud feature extractors, but it has been barely investigated for multi-modal RGB-D scans, especially with the goal of facilitating high-level scene understanding. To solve this problem, we propose contrasting "pairs of point-pixel pairs", where positives include pairs of RGB-D points in correspondence, and negatives include pairs where one of the two modalities has been disturbed and/or the two RGB-D points are not in correspondence. This provides extra flexibility in making hard negatives and helps networks to learn features from both modalities, not just the more discriminating one of the two. Experiments show that this proposed approach yields better performance on three large-scale RGB-D scene understanding benchmarks (ScanNet, SUN RGB-D, and 3RScan) than previous pretraining approaches.


title: Slow decay of infection in the inhomogeneous SIR model

abstract: The SIR model with spatially inhomogeneous infection rate is studied with numerical simulations in one, two, and three dimensions, considering the case that the infection spreads inhomogeneously in densely populated regions or hot spots. We find that the total population of infection decays very slowly in the inhomogeneous systems in some cases, in contrast to the exponential decay of the infected population I(t) in the SIR model of the ordinary differential equation. The slow decay of the infected population suggests that the infection is locally maintained for long and it is difficult for the disease to disappear completely.

categories: physics.med-ph cond-mat.stat-mech nlin.AO nlin.PS


title: Auto-Agent-Distiller: Towards Efficient Deep Reinforcement Learning Agents via Neural Architecture Search

abstract: AlphaGo's astonishing performance has ignited an explosive interest in developing deep reinforcement learning (DRL) for numerous real-world applications, such as intelligent robotics. However, the often prohibitive complexity of DRL stands at the odds with the required real-time control and constrained resources in many DRL applications, limiting the great potential of DRL powered intelligent devices. While substantial efforts have been devoted to compressing other deep learning models, existing works barely touch the surface of compressing DRL. In this work, we first identify that there exists an optimal model size of DRL that can maximize both the test scores and efficiency, motivating the need for task-specific DRL agents. We therefore propose an Auto-Agent-Distiller (A2D) framework, which to our best knowledge is the first neural architecture search (NAS) applied to DRL to automatically search for the optimal DRL agents for various tasks that optimize both the test scores and efficiency. Specifically, we demonstrate that vanilla NAS can easily fail in searching for the optimal agents, due to its resulting high variance in DRL training stability, and then develop a novel distillation mechanism to distill the knowledge from both the teacher agent's actor and critic to stabilize the searching process and improve the searched agents' optimality. Extensive experiments and ablation studies consistently validate our findings and the advantages and general applicability of our A2D, outperforming manually designed DRL in both the test scores and efficiency. All the codes will be released upon acceptance.


title: Clarifying ultrafast carrier dynamics in ultrathin films of the topological insulator Bi2Se3 using transient absorption spectroscopy

abstract: Ultrafast carrier dynamics in the topological insulator Bi2Se3 have recently been intensively studied using a variety of techniques. However, we are not aware of any successful experiments exploiting transient absorption (TA) spectroscopy for these purposes. Here we demonstrate that if the ~730 nm wavelength pumping (~1.7 eV photon energy) is applied to ultrathin Bi2Se3 films, TA spectra cover the entire visible region, thus unambiguously pointing to two-photon excitation (~3.4 eV). The carrier relaxation dynamics is found to be governed by the polar optical phonon cascade emission occurring in both the bulk states and the Dirac surface states (SS), including SS-bulk-SS vertical electron transport and being also exclusively influenced by whether the Dirac point is presented between the Dirac cones of the higher energy (~1.5 eV) Dirac SS (known as SS2). We have recognized that SS2 act as a valve substantially slowing down the relaxation of electrons when the gap between Dirac cones exceeds the polar optical phonon and resonant defects energies. The resulting progressive accumulation of electrons in the gapped SS2 becomes detectable through the inverse bremsstrahlung type free carrier absorption.


title: EDN: Salient Object Detection via Extremely-Downsampled Network

abstract: Recent progress on salient object detection (SOD) mainly benefits from multi-scale learning, where the high-level and low-level features collaborate in locating salient objects and discovering fine details, respectively. However, most efforts are devoted to low-level feature learning by fusing multi-scale features or enhancing boundary representations. High-level features, which although have long proven effective for many other tasks, yet have been barely studied for SOD. In this paper, we tap into this gap and show that enhancing high- level features is essential for SOD as well. To this end, we introduce an Extremely-Downsampled Network (EDN), which employs an extreme downsampling technique to effectively learn a global view of the whole image, leading to accurate salient object localization. To accomplish better multi-level feature fusion, we construct the Scale-Correlated Pyramid Convolution (SCPC) to build an elegant decoder for recovering object details from the above extreme downsampling. Extensive experiments demonstrate that EDN achieves state-of-the-art performance with real-time speed. Our efficient EDN-Lite also achieves competitive performance with a speed of 316fps. Hence, this work is expected to spark some new thinking in SOD. Code is available at https://github.com/yuhuan-wu/EDN.


title: The Wilson-loop $d \log$ representation for Feynman integrals

abstract: We introduce and study the Wilson-loop ${\rm d}\log$ representation of certain Feynman integrals for scattering amplitudes in ${\cal N}=4$ SYM and beyond, which makes their evaluation completely straightforward. Such a representation was motivated by the dual Wilson loop picture, and it can also be derived by partial Feynman parametrization of loop integrals. We first introduce it for the simplest one-loop examples, the chiral pentagon in four dimensions and the three-mass-easy hexagon in six dimensions, which are represented by two- and three-fold ${\rm d}\log$ integrals that are nicely related to each other. For multi-loop examples, we write the $L$-loop generalized penta-ladders as $2(L{-}1)$-fold ${\rm d}\log$ integrals of some one-loop integral, so that once the latter is known, the integration can be performed in a systematic way. In particular, we write the eight-point penta-ladder as a $2L$-fold ${\rm d}\log$ integral whose symbol can be computed without performing the integration; we also obtain the last entries and the symbol alphabet of these integrals. Similarly we compute and study the symbol of the seven-point double-penta-ladder, which is represented by a $2(L{-}1)$-fold integral of a hexagon; the latter can be written as a two-fold ${\rm d}\log$ integral plus a boundary term. We comment on the relation of our representation to differential equations and resum the ladders by solving certain integral equations.


title: MobileSal: Extremely Efficient RGB-D Salient Object Detection

abstract: The high computational cost of neural networks has prevented recent successes in RGB-D salient object detection (SOD) from benefiting real-world applications. Hence, this paper introduces a novel network, MobileSal, which focuses on efficient RGB-D SOD using mobile networks for deep feature extraction. However, mobile networks are less powerful in feature representation than cumbersome networks. To this end, we observe that the depth information of color images can strengthen the feature representation related to SOD if leveraged properly. Therefore, we propose an implicit depth restoration (IDR) technique to strengthen the mobile networks' feature representation capability for RGB-D SOD. IDR is only adopted in the training phase and is omitted during testing, so it is computationally free. Besides, we propose compact pyramid refinement (CPR) for efficient multi-level feature aggregation to derive salient objects with clear boundaries. With IDR and CPR incorporated, MobileSal performs favorably against state-of-the-art methods on six challenging RGB-D SOD datasets with much faster speed (450fps for the input size of 320 $\times$ 320) and fewer parameters (6.5M). The code is released at https://mmcheng.net/mobilesal.


title: Wheel-Rail Interface Condition Estimation (W-RICE)

abstract: The surface roughness between the wheel and rail has a huge influence on rolling noise level. The presence of the third body such as frost or grease at wheel-rail interface contributes towards change in adhesion coefficient resulting in the generation of noise at various levels. Therefore, it is possible to estimate adhesion conditions between the wheel and rail from the analysis of noise patterns originating from wheel-rail interaction. In this study, a new approach to estimate adhesion condition is proposed which takes rolling noise as input.


title: Deep learning based quantum vortex detection in atomic Bose-Einstein condensates

abstract: Quantum vortices naturally emerge in rotating Bose-Einstein condensates (BECs) and, similarly to their classical counterparts, allow the study of a range of interesting out-of-equilibrium phenomena like turbulence and chaos. However, the study of such phenomena requires to determine the precise location of each vortex within a BEC, which becomes challenging when either only the condensate density is available or sources of noise are present, as is typically the case in experimental settings. Here, we introduce a machine learning based vortex detector motivated by state-of-the-art object detection methods that can accurately locate vortices in simulated BEC density images. Our model allows for robust and real-time detection in noisy and non-equilibrium configurations. Furthermore, the network can distinguish between vortices and anti-vortices if the condensate phase profile is also available. We anticipate that our vortex detector will be advantageous both for experimental and theoretical studies of the static and dynamical properties of vortex configurations in BECs.


title: Learning with Retrospection

abstract: Deep neural networks have been successfully deployed in various domains of artificial intelligence, including computer vision and natural language processing. We observe that the current standard procedure for training DNNs discards all the learned information in the past epochs except the current learned weights. An interesting question is: is this discarded information indeed useless? We argue that the discarded information can benefit the subsequent training. In this paper, we propose learning with retrospection (LWR) which makes use of the learned information in the past epochs to guide the subsequent training. LWR is a simple yet effective training framework to improve accuracies, calibration, and robustness of DNNs without introducing any additional network parameters or inference cost, only with a negligible training overhead. Extensive experiments on several benchmark datasets demonstrate the superiority of LWR for training DNNs.


title: Cooperative Policy Learning with Pre-trained Heterogeneous Observation Representations

abstract: Multi-agent reinforcement learning (MARL) has been increasingly explored to learn the cooperative policy towards maximizing a certain global reward. Many existing studies take advantage of graph neural networks (GNN) in MARL to propagate critical collaborative information over the interaction graph, built upon inter-connected agents. Nevertheless, the vanilla GNN approach yields substantial defects in dealing with complex real-world scenarios since the generic message passing mechanism is ineffective between heterogeneous vertices and, moreover, simple message aggregation functions are incapable of accurately modeling the combinational interactions from multiple neighbors. While adopting complex GNN models with more informative message passing and aggregation mechanisms can obviously benefit heterogeneous vertex representations and cooperative policy learning, it could, on the other hand, increase the training difficulty of MARL and demand more intense and direct reward signals compared to the original global reward. To address these challenges, we propose a new cooperative learning framework with pre-trained heterogeneous observation representations. Particularly, we employ an encoder-decoder based graph attention to learn the intricate interactions and heterogeneous representations that can be more easily leveraged by MARL. Moreover, we design a pre-training with local actor-critic algorithm to ease the difficulty in cooperative policy learning. Extensive experiments over real-world scenarios demonstrate that our new approach can significantly outperform existing MARL baselines as well as operational research solutions that are widely-used in industry.


title: Generalized Potential and Mathematical Principles of Nonlinear Analysis

abstract: In the past hundred years, chaos has always been a mystery to human beings, including the butterfly effect discovered in 1963 and the dissipative structure theory which won the chemistry Nobel Prize in 1977. So far, there is no quantitative mathematical-physical method to solve and analyze these problems. In this paper, the idea of using field theory to study nonlinear systems is put forward, and the concept of generalized potential is established mathematically. The physical essence of generalized potential promoting the development of nonlinear field is extended and the spatiotemporal evolution law of generalized potential is clarified. Then the spatiotemporal evolution law of conservative system and pure dissipative system is clarified. Acceleration field, conservative vector field and dissipation vector field are established to evaluate the degree of conservation and dissipation of physical field. Finally, the development route of new field research and the precondition of promoting engineering application in the future are discussed.


title: Detection and Parameter Estimation of Gravitational Waves from Binary Neutron-Star Mergers in Real LIGO Data using Deep Learning

abstract: One of the key challenges of real-time detection and parameter estimation of gravitational waves from compact binary mergers is the computational cost of conventional matched-filtering and Bayesian inference approaches. In particular, the application of these methods to the full signal parameter space available to the gravitational-wave detectors, and/or real-time parameter estimation is computationally prohibitive. On the other hand, rapid detection and inference are critical for prompt follow-up of the electromagnetic and astro-particle counterparts accompanying important transients, such as binary neutron-star and black-hole neutron-star mergers. Training deep neural networks to identify specific signals and learn a computationally efficient representation of the mapping between gravitational-wave signals and their parameters allows both detection and inference to be done quickly and reliably, with high sensitivity and accuracy. In this work we apply a deep-learning approach to rapidly identify and characterize transient gravitational-wave signals from binary neutron-star mergers in real LIGO data. We show for the first time that artificial neural networks can promptly detect and characterize binary neutron star gravitational-wave signals in real LIGO data, and distinguish them from noise and signals from coalescing black-hole binaries. We illustrate this key result by demonstrating that our deep-learning framework classifies correctly all gravitational-wave events from the Gravitational-Wave Transient Catalog, GWTC-1 [Phys. Rev. X 9 (2019), 031040]. These results emphasize the importance of using realistic gravitational-wave detector data in machine learning approaches, and represent a step towards achieving real-time detection and inference of gravitational waves.


title: THUIR@COLIEE-2020: Leveraging Semantic Understanding and Exact Matching for Legal Case Retrieval and Entailment

abstract: In this paper, we present our methodologies for tackling the challenges of legal case retrieval and entailment in the Competition on Legal Information Extraction / Entailment 2020 (COLIEE-2020). We participated in the two case law tasks, i.e., the legal case retrieval task and the legal case entailment task. Task 1 (the retrieval task) aims to automatically identify supporting cases from the case law corpus given a new case, and Task 2 (the entailment task) to identify specific paragraphs that entail the decision of a new case in a relevant case. In both tasks, we employed the neural models for semantic understanding and the traditional retrieval models for exact matching. As a result, our team (TLIR) ranked 2nd among all of the teams in Task 1 and 3rd among teams in Task 2. Experimental results suggest that combing models of semantic understanding and exact matching benefits the legal case retrieval task while the legal case entailment task relies more on semantic understanding.


title: Improving the Certified Robustness of Neural Networks via Consistency Regularization

abstract: A range of defense methods have been proposed to improve the robustness of neural networks on adversarial examples, among which provable defense methods have been demonstrated to be effective to train neural networks that are certifiably robust to the attacker. However, most of these provable defense methods treat all examples equally during training process, which ignore the inconsistent constraint of certified robustness between correctly classified (natural) and misclassified examples. In this paper, we explore this inconsistency caused by misclassified examples and add a novel consistency regularization term to make better use of the misclassified examples. Specifically, we identified that the certified robustness of network can be significantly improved if the constraint of certified robustness on misclassified examples and correctly classified examples is consistent. Motivated by this discovery, we design a new defense regularization term called Misclassification Aware Adversarial Regularization (MAAR), which constrains the output probability distributions of all examples in the certified region of the misclassified example. Experimental results show that our proposed MAAR achieves the best certified robustness and comparable accuracy on CIFAR-10 and MNIST datasets in comparison with several state-of-the-art methods.


title: Cubes and cubical chains and cochains in combinatorial topology

abstract: The present paper is a continuation of author's paper arXiv:1909.00940 [math.AT] devoted to the lemmas of Alexander and Sperner, but is independent from it. We begin by a step back from Alexander and Sperner to Lebesgue work on the invariance of the dimension. In contrast with almost everybody else, Lebesgue worked with cubes rather than with simplices. His methods were developed by Hurewicz and Lusternik-Schnirelmann and then forgotten. In the present paper these methods are recast in the language of cubical chains and cochains. After this, we present a new approach to Lebesgue and Lusternik-Schnirelmann theorems which is both conceptual and elementary. It is based on adaptation of Serre's definition of products of singular cubical cochains to discrete setting. The main results are new purely combinatorial "cubical lemmas". This approach also clarifies the cubical versions of Sperner lemma of Kuhn and Ky Fan. In particular, Ky Fan's lemma can be understood as a natural strengthening of Lebesgue or Kuhn's results under a transversality assumption. The exposition does not assume any knowledge of algebraic topology.


title: Time-dependent unbounded Hamiltonian simulation with vector norm scaling

abstract: The accuracy of quantum dynamics simulation is usually measured by the error of the unitary evolution operator in the operator norm, which in turn depends on certain norm of the Hamiltonian. For unbounded operators, after suitable discretization, the norm of the Hamiltonian can be very large, which significantly increases the simulation cost. However, the operator norm measures the worst-case error of the quantum simulation, while practical simulation concerns the error with respect to a given initial vector at hand. We demonstrate that under suitable assumptions of the Hamiltonian and the initial vector, if the error is measured in terms of the vector norm, the computational cost may not increase at all as the norm of the Hamiltonian increases using Trotter type methods. In this sense, our result outperforms all previous error bounds in the quantum simulation literature. Our result extends that of [Jahnke, Lubich, BIT Numer. Math. 2000] to the time-dependent setting. We also clarify the existence and the importance of commutator scalings of Trotter and generalized Trotter methods for time-dependent Hamiltonian simulations.


title: Dependence of variance on covariate design in nonparametric link regression

abstract: This paper discusses a design-dependent nature of variance in nonparametric link regression aiming at predicting a mean outcome at a link, i.e., a pair of nodes, based on currently observed data comprising covariates at nodes and outcomes at links.


title: Transverse Coupled Cavity VCSEL: Making 100 GHz Bandwidth Achievable

abstract: Enhancing the modulation bandwidth (MBW) of semiconductor lasers has been the challenge of research and technology to meet the need of high-speed photonic applications. In this paper, we propose the design of vertical-cavity surface-emitting laser integrated with multiple transverse coupled cavities (MTCCs) as a promising device with ultra-high 3-dB bandwidth. The laser features high modulation performance because of the accumulated strong coupling of the slow-light feedback from the surrounding lateral TCCs into the VCSEL cavity. Photon-photon resonance (PPR) is predicted to occur at ultra-high frequencies exceeding 145 GHz due to the optical feedback from short TCCs, which achieves 3-dB MBW reaching 170 GHz. The study is based on the modeling of the VCSEL dynamics under multiple transverse slow-light feedback from the surrounding TCCs. We show that the integration of the VCSEL with four or six feedback cavities is advantageous over the TCC-VCSEL in achieving much higher MBW enhancement under weaker coupling of slow-light into the VCSEL cavity. We also characterize the noise properties of the promising MTCC-VCSEL in the regime of ultra-high bandwidth in terms of the Fourier spectrum of the relative intensity noise (RIN).


title: Implementation of Security Features in Software Development Phases

abstract: Security holds an important role in a software. Most people are not aware of the significance of security in software system and tend to assume that they will be fine without security in their software systems. However, the lack of security features causes to expose all the vulnerabilities possible to the public. This provides opportunities for the attackers to perform dangerous activities to the vulnerable insecure systems. This is the reason why many organizations are reported for being victims of system security attacks. In order to achieve the security requirement, developers must take time to study so that they truly understand the consequences and importance of security. Hence, this paper is written to discuss how secure software development can be performed. To reach the goal of this paper, relevant researches have been reviewed. Multiple case study papers have been studied to find out the answers to how the vulnerabilities are identified, how to eliminate them, when to implement security features, why do we implement them. Finally, the paper is concluded with final remarks on implementation of security features during software development process. It is expected that this paper will be a contribution towards the aforementioned software security domain which is often ignored during practical application.


title: Stabilizing Multimode Hopping Oscillations and Reducing Associated Noise in Long Wavelength Laser Diode Using External Optical Feedback

abstract: We report on converting the multimode hopping oscillation (MHO) in long-wavelength semiconductor laser into single-mode oscillation (SMO) by applying external optical feedback (OFB). We characterize and compare the noise performance of the laser when supporting SMO and multimode oscillations. The study is based on a modified time-delay multimode rate-equation model of the laser that includes mechanisms of spectral gain suppression along with OFB induced due to multiple reflections by an external reflector. The study is applied to 1.55um-InGaAsP laser that exhibits multimode hopping in its solitary version and supports wide bandwidth. The noise is evaluated in terms of the relative intensity noise (RIN). We show that when OFB synchronizes with the asymmetric gain suppression (AGS), it enhances the gain of one longer wavelength mode and supports SMO. In this case OFB improves the noise performance of the laser. On the other hand, when OFB works against AGS, it sustains hopping multimode oscillation (HMMO) and deteriorates the side-mode suppression ratio (SMSR) and the noise performance.


title: Decomposing Convexified Security-Constrained ACOPF Problem with AGC Reformulation

abstract: This paper presents a reformulation for the automatic generation control (AGC) in a decomposed convex relaxation algorithm. It finds an optimal solution to the AC optimal power flow (ACOPF) problem that is secure against a large set of contingencies. The original ACOPF problem which represents the system without contingency constraints, is convexified by applying the second-order cone relaxation method. The contingencies are filtered to distinguish those that will be treated with preventive actions from those that will be left for corrective actions. The selected contingencies for preventive action are included in the set of security constraints. Benders decomposition is employed to decompose the convexified Security-Constrained ACOPF problem into a master problem and several security check sub-problems. Sub-problems are evaluated in a parallel computing process with enhanced computational efficiency. AGC within each sub-problem is modeled by a set of proposed valid constraints, so the procured solution is the physical response of each generation unit during a contingency. Benders optimality cuts are generated for the sub-problems having mismatches and the cuts are passed to the master problem to encounter the security-constraints. The accuracy of the relaxation results is verified using the presented tightness measure. The effectiveness of the presented valid AGC constraints and scalability of the proposed algorithm is demonstrated in several case studies.


title: Exploring Adversarial Examples via Invertible Neural Networks

abstract: Adversarial examples (AEs) are images that can mislead deep neural network (DNN) classifiers via introducing slight perturbations into original images. This security vulnerability has led to vast research in recent years because it can introduce real-world threats into systems that rely on neural networks. Yet, a deep understanding of the characteristics of adversarial examples has remained elusive. We propose a new way of achieving such understanding through a recent development, namely, invertible neural models with Lipschitz continuous mapping functions from the input to the output. With the ability to invert any latent representation back to its corresponding input image, we can investigate adversarial examples at a deeper level and disentangle the adversarial example's latent representation. Given this new perspective, we propose a fast latent space adversarial example generation method that could accelerate adversarial training. Moreover, this new perspective could contribute to new ways of adversarial example detection.


title: Bayesian prognostic covariate adjustment

abstract: Historical data about disease outcomes can be integrated into the analysis of clinical trials in many ways. We build on existing literature that uses prognostic scores from a predictive model to increase the efficiency of treatment effect estimates via covariate adjustment. Here we go further, utilizing a Bayesian framework that combines prognostic covariate adjustment with an empirical prior distribution learned from the predictive performances of the prognostic model on past trials. The Bayesian approach interpolates between prognostic covariate adjustment with strict type I error control when the prior is diffuse, and a single-arm trial when the prior is sharply peaked. This method is shown theoretically to offer a substantial increase in statistical power, while limiting the type I error rate under reasonable conditions. We demonstrate the utility of our method in simulations and with an analysis of a past Alzheimer's disease clinical trial.


title: FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training

abstract: Recent breakthroughs in deep neural networks (DNNs) have fueled a tremendous demand for intelligent edge devices featuring on-site learning, while the practical realization of such systems remains a challenge due to the limited resources available at the edge and the required massive training costs for state-of-the-art (SOTA) DNNs. As reducing precision is one of the most effective knobs for boosting training time/energy efficiency, there has been a growing interest in low-precision DNN training. In this paper, we explore from an orthogonal direction: how to fractionally squeeze out more training cost savings from the most redundant bit level, progressively along the training trajectory and dynamically per input. Specifically, we propose FracTrain that integrates (i) progressive fractional quantization which gradually increases the precision of activations, weights, and gradients that will not reach the precision of SOTA static quantized DNN training until the final training stage, and (ii) dynamic fractional quantization which assigns precisions to both the activations and gradients of each layer in an input-adaptive manner, for only "fractionally" updating layer parameters. Extensive simulations and ablation studies (six models, four datasets, and three training settings including standard, adaptation, and fine-tuning) validate the effectiveness of FracTrain in reducing computational cost and hardware-quantified energy/latency of DNN training while achieving a comparable or better (-0.12%~+1.87%) accuracy. For example, when training ResNet-74 on CIFAR-10, FracTrain achieves 77.6% and 53.5% computational cost and training latency savings, respectively, compared with the best SOTA baseline, while achieving a comparable (-0.07%) accuracy. Our codes are available at: https://github.com/RICE-EIC/FracTrain.


title: A Frequency-Based Learning-To-Rank Approach for Personal Digital Traces

abstract: Personal digital traces are constantly produced by connected devices, internet services and interactions. These digital traces are typically small, heterogeneous and stored in various locations in the cloud or on local devices, making it a challenge for users to interact with and search their own data. By adopting a multidimensional data model based on the six natural questions -- what, when, where, who, why and how -- to represent and unify heterogeneous personal digital traces, we can propose a learning-to-rank approach using the state of the art LambdaMART algorithm and frequency-based features that leverage the correlation between content (what), users (who), time (when), location (where) and data source (how) to improve the accuracy of search results. Due to the lack of publicly available personal training data, a combination of known-item query generation techniques and an unsupervised ranking model (field-based BM25) is used to build our own training sets. Experiments performed over a publicly available email collection and a personal digital data trace collection from a real user show that the frequency-based learning approach improves search accuracy when compared with traditional search tools.


title: Upper Confidence Bounds for Combining Stochastic Bandits

abstract: We provide a simple method to combine stochastic bandit algorithms. Our approach is based on a "meta-UCB" procedure that treats each of $N$ individual bandit algorithms as arms in a higher-level $N$-armed bandit problem that we solve with a variant of the classic UCB algorithm. Our final regret depends only on the regret of the base algorithm with the best regret in hindsight. This approach provides an easy and intuitive alternative strategy to the CORRAL algorithm for adversarial bandits, without requiring the stability conditions imposed by CORRAL on the base algorithms. Our results match lower bounds in several settings, and we provide empirical validation of our algorithm on misspecified linear bandit and model selection problems.


title: Asymptotic profile of a two-dimensional chemotaxis--Navier--Stokes system with singular sensitivity and logistic source

abstract: The chemotaxis--Navier--Stokes system \begin{equation*}\label{0.1} \left\{\begin{array}{ll} n_t+u\cdot \nabla n=\triangle n-\chi\nabla\cdotp \left(\displaystyle\frac n {c}\nabla c\right)+n(r-\mu n), c_t+u\cdot \nabla c=\triangle c-nc, u_t+ (u\cdot \nabla) u=\Delta u+\nabla P+n\nabla\phi, \nabla\cdot u=0, \end{array}\right. \end{equation*} is considered in a bounded smooth domain $\Omega \subset \mathbb{R}^2$, where $\phi\in W^{1,\infty}(\Omega)$, $\chi>0$, $r\in \mathbb{R}$ and $\mu> 0$ are given parameters. It is shown that there exists a value $\mu_*(\Omega,\chi, r)\geq 0$ such that whenever $ \mu>\mu_*(\Omega,\chi, r)$, the global-in-time classical solution to the system is uniformly bounded with respect to $x\in \Omega$. Moreover, for the case $r>0$, $(n,c,\frac {|\nabla c|}c,u)$ converges to $(\frac r \mu,0,0,0)$ in $L^\infty(\Omega)\times L^\infty(\Omega)\times L^p(\Omega)\times L^\infty(\Omega)$ for any $p>1$ exponentially as $t\rightarrow \infty$, while in the case $r=0$, $(n,c,\frac {|\nabla c|}c,u)$ converges to $(0,0,0,0)$ in $(L^\infty(\Omega))^4$ algebraically. To the best of our knowledge, these results provide the first precise information on the asymptotic profile of solutions in two dimensions.


title: Nine Best Practices for Research Software Registries and Repositories: A Concise Guide

abstract: Scientific software registries and repositories serve various roles in their respective disciplines. These resources improve software discoverability and research transparency, provide information for software citations, and foster preservation of computational methods that might otherwise be lost over time, thereby supporting research reproducibility and replicability. However, developing these resources takes effort, and few guidelines are available to help prospective creators of registries and repositories. To address this need, we present a set of nine best practices that can help managers define the scope, practices, and rules that govern individual registries and repositories. These best practices were distilled from the experiences of the creators of existing resources, convened by a Task Force of the FORCE11 Software Citation Implementation Working Group during the years 2019-2020. We believe that putting in place specific policies such as those presented here will help scientific software registries and repositories better serve their users and their disciplines.


title: Hausdorff Point Convolution with Geometric Priors

abstract: Without a shape-aware response, it is hard to characterize the 3D geometry of a point cloud efficiently with a compact set of kernels. In this paper, we advocate the use of Hausdorff distance as a shape-aware distance measure for calculating point convolutional responses. The technique we present, coined Hausdorff Point Convolution (HPC), is shape-aware. We show that HPC constitutes a powerful point feature learning with a rather compact set of only four types of geometric priors as kernels. We further develop a HPC-based deep neural network (HPC-DNN). Task-specific learning can be achieved by tuning the network weights for combining the shortest distances between input and kernel point sets. We also realize hierarchical feature learning by designing a multi-kernel HPC for multi-scale feature encoding. Extensive experiments demonstrate that HPC-DNN outperforms strong point convolution baselines (e.g., KPConv), achieving 2.8% mIoU performance boost on S3DIS and 1.5% on SemanticKITTI for semantic segmentation task.


title: Carbon Paste Electrode Modified Poly-Glutamic Acid (PGA) with Molecularly Imprinted for Detection of Rhodamine B

abstract: Rhodamine B is a synthetic dye used for coloring textiles, paper and ceramics. In addition, Rhodamine B is also often used for coloring ingredients in food ingredients such as crackers, syrups, candy, cakes, and is often used for coloring lipsticks. The accumulation of Rhodamine B in the body can cause liver, kidney and lymph damage. In this study, a modified carbon paste electrode (CPE) with molecularly imprinted polymers (glutamic acid) was developed for the determination of rhodamine B using potentiometric techniques. The modification was carried out by electropolymerization of glutamic acid monomer from a solution containing 3.0 mM glutamic acid and 1.0 mM rhodamine B in a phosphate buffer pH 7 using a cyclic voltammetry technique of 15 cycles in the potential range between (-0.2 V) to (1.8 V) with a scan rate of 100 mV/sec. Measurements with these electrodes have optimum performance at pH 4. The Nerst factor is 29.2 mV/decade. The measurement range is 10-5 M to 10-2 M. With the detection limit of Rhodamine B which can be measured by the electrode is 8.91 x 10-6 M. This electrode has a fairly good value of accuracy and precision, and does not have a significant difference. when compared with the UV-Vis spectrophotometric method.


title: Mode Angular Degree Identification in Subgiant Stars with Convolutional Neural Networks based on Power Spectrum

abstract: Identifying the angular degrees $l$ of oscillation modes is essential for asteroseismology and depends on visual tagging before fitting power spectra in a so-called peakbagging analysis. In oscillating subgiants, radial ($l$= 0) mode frequencies distributed linearly in frequency, while non-radial ($l$ >= 1) modes are p-g mixed modes that having a complex distribution in frequency, which increased the difficulty of identifying $l$. In this study, we trained a 1D convolutional neural network to perform this task using smoothed oscillation spectra. By training simulation data and fine-tuning the pre-trained network, we achieved a 95 per cent accuracy on Kepler data.


title: Memory-Gated Recurrent Networks

abstract: The essence of multivariate sequential learning is all about how to extract dependencies in data. These data sets, such as hourly medical records in intensive care units and multi-frequency phonetic time series, often time exhibit not only strong serial dependencies in the individual components (the "marginal" memory) but also non-negligible memories in the cross-sectional dependencies (the "joint" memory). Because of the multivariate complexity in the evolution of the joint distribution that underlies the data generating process, we take a data-driven approach and construct a novel recurrent network architecture, termed Memory-Gated Recurrent Networks (mGRN), with gates explicitly regulating two distinct types of memories: the marginal memory and the joint memory. Through a combination of comprehensive simulation studies and empirical experiments on a range of public datasets, we show that our proposed mGRN architecture consistently outperforms state-of-the-art architectures targeting multivariate time series.


title: SubICap: Towards Subword-informed Image Captioning

abstract: Existing Image Captioning (IC) systems model words as atomic units in captions and are unable to exploit the structural information in the words. This makes representation of rare words very difficult and out-of-vocabulary words impossible. Moreover, to avoid computational complexity, existing IC models operate over a modest sized vocabulary of frequent words, such that the identity of rare words is lost. In this work we address this common limitation of IC systems in dealing with rare words in the corpora. We decompose words into smaller constituent units 'subwords' and represent captions as a sequence of subwords instead of words. This helps represent all words in the corpora using a significantly lower subword vocabulary, leading to better parameter learning. Using subword language modeling, our captioning system improves various metric scores, with a training vocabulary size approximately 90% less than the baseline and various state-of-the-art word-level models. Our quantitative and qualitative results and analysis signify the efficacy of our proposed approach.


title: Surface tension and instability in the hydrodynamic white hole of a circular hydraulic jump

abstract: We impose a linearized Eulerian perturbation on a steady, shallow, radial outflow of a liquid (water), whose local pressure function includes both the hydrostatic and the Laplace pressure terms. The resulting wave equation bears the form of a hydrodynamic metric. A dispersion relation, extracted from the wave equation, gives an instability due to surface tension and the cylindrical flow symmetry. Using the dispersion relation, we also derive three known relations that scale the radius of the circular hydraulic jump in the outflow. The first two relations are scaled by viscosity and gravity, with a capillarity-dependent crossover to the third relation, which is scaled by viscosity and surface tension. The perturbation as a high-frequency travelling wave, propagating radially inward against the bulk outflow, is blocked just outside the circular hydraulic jump. The amplitude of the wave also diverges here because of a singularity. The blocking is associated with surface tension, which renders the circular hydraulic jump a hydrodynamic white hole.


title: Some notes on orthogonally additive polynomials

abstract: We provide two new characterizations of bounded orthogonally additive polynomials from a uniformly complete vector lattice into a convex bornological space using separately two polynomial identities of Kusraeva involving the root mean power and the geometric mean. Furthermore, it is shown that a polynomial on a vector lattice is orthogonally additive whenever it is orthogonally additive on the positive cone. These results improve recent characterizations of bounded orthogonally additive polynomials by G. Buskes and the author.


title: The Intriguing Flow Behavior of Soft Materials

abstract: Materials that can be deformed by thermal stresses at room temperature are called soft materials. Colloidal suspensions comprising solid particles evenly distributed in a fluid phase (smoke, fog, ink and milk, for example), emulsions(mayonnaise, lotions and creams), pastes (tomato ketchup, toothpaste), granular media (a bag of rice or sand), and polymer gels (polysaccharide gels) can be categorized as soft materials and are ubiquitous both at home and in industrial setups. Soft materials exhibit rich flow and deformation behaviors characterized by intriguing properties such as shear-thinning or thixotropy, shear-thickening or dilatancy, non-zero normal and yield stresses, etc. This article explains some of the mysterious flow properties of soft materials.


title: StellarICS: Inverse Compton Emission from the Quiet Sun and Stars from keV to TeV

abstract: The study of the quiet Sun in gamma rays started over a decade ago, and rapidly gained a wide interest. Gamma rays from the quiet Sun are produced by Cosmic Rays (CRs) interacting with its surface (disk component) and with its photon field (spatially extended inverse-Compton component, IC). The latter component is maximum close to the Sun and it is above the background even at large angular distances, extending over the whole sky. First detected with EGRET, it is studied now with Fermi-LAT with high statistical significance. Observations of the IC component allow us to obtain information on CR electrons and positrons close to the Sun and in the heliosphere for the various periods of solar activity and polarity. They allow to learn about CR interactions and propagation close to stars, in the heliosphere and on the solar surface, and to understand the Sun itself, its environment, and its activity. Analyses of solar observations are usually model-driven. Hence advances in model calculations and constraints from precise CR measurements are timely and needed. Here we present our StellarICS code to compute the gamma-ray IC emission from the Sun and also from single stars. The code is publicly available and it is extensively used by the scientific community to analyze Fermi-LAT data. It has been used by the Fermi-LAT collaboration to produce the solar models released with the FSSC Fermi Tools. Our modeling provides the basis for analyzing and interpreting high-energy data of the Sun and of stars. After presenting examples of updated solar IC models in the Fermi-LAT energy range that account for the various CR measurements, we extend the models to keV, MeV, and TeV energies for predictions for future possible telescopes such as AMEGO, GECCO, e-ASTROGAM, HAWC, LHAASO, SWGO, and present X-ray telescopes. We also present predictions for some of the closest and most luminous stars.


title: Operator means in JB-algebras

abstract: In this paper, the notion of operator means in the setting of JB-algebras is introduced and their properties are studied. Many identities and inequalities are established, most of them have origins from operators on Hilbert space but they have different forms and connotations, and their proofs require techniques in JB-algebras.


title: Relativistic Coulomb S-factor of Two Spinor Particles with Arbitrary Masses

abstract: A new resummation of the $S$-factor of a composite system of two relativistic spin-1/2 particles of arbitrary masses interacting via a Coulomb-like chromodynamical potential is presented. The analysis is performed in the framework of a relativistic quasipotential approach based on the Hamiltonian formulation of the covariant quantum field theory in the relativistic configuration representation. The pseudoscalar, vector, and pseudovector systems are considered and the behaviour of the $S$-factor near the threshold and in the relativistic limit is investigated in detail. The spin dependence of the $S$-factors is discussed as well. It is argued that at the threshold the contribution of spins significantly reduces the Sommerfeld effect, while at ultrarelativistic velocities their role diminishes and the $S$-factor becomes basically the same as for the spinless systems. A connection between the new and previously obtained S-factors for spinless particles of arbitrary masses and for relativistic spinor particles of equal masses is established.


title: Rast: A Language for Resource-Aware Session Types

abstract: Traditional session types prescribe bidirectional communication protocols for concurrent computations, where well-typed programs are guaranteed to adhere to the protocols. However, simple session types cannot capture properties beyond the basic type of the exchanged messages. In response, recent work has extended session types with refinements from linear arithmetic, capturing intrinsic attributes of processes and data. These refinements then play a central role in describing sequential and parallel complexity bounds on session-typed programs. The Rast language provides an open-source implementation of session-typed concurrent programs extended with arithmetic refinements as well as ergometric and temporal types to capture work and span of program execution. To further support generic programming, Rast also enhances arithmetically refined session types with recently developed nested parametric polymorphism. Type checking relies on Cooper's algorithm for quantifier elimination in Presburger arithmetic with a few significant optimizations, and a heuristic extension to nonlinear constraints. Rast furthermore includes a reconstruction engine so that most program constructs pertaining the layers of refinements and resources are inserted automatically. We provide a variety of examples to demonstrate the expressivity of the language.


title: On the stability of kernel bundles over chain-like curves

abstract: Let $C$ be a chain-like curve having $n$ smooth components and $n-1$ nodes, where $n \geq 2$. Let $E$ be a vector bundle on $C$ and $V \subseteq H^0(E)$ be a linear subspace generating $E$. We investigate the (semi)stability of the kernel bundle $M_{E,V}$ associated to $(E,V)$.


title: State-dependent Routing Dynamics in Noisy Quantum Computing Devices

abstract: Routing plays an important role in programming noisy, intermediate-scale quantum (NISQ) devices, where limited connectivity in the register is overcome by swapping quantum information between locations. However, routing a quantum state using noisy gates introduces non-trivial noise dynamics, and deciding on an optimal route to minimize accumulated error requires estimates of the expected state fidelity. Here we validate a model for state-dependent routing dynamics in a NISQ processor based on correlated binary noise. We develop a composable, state-dependent noise model for CNOT and SWAP operations that can be characterized efficiently using pair-wise experimental measurements, and we compare model predictions with tomographic state reconstructions recovered from a quantum device. These results capture the state-dependent routing dynamics that are needed to guide routing decisions for near-real time operation of NISQ devices.


title: On the Conditions of Absorption Property for Morphological Opening and Closing

abstract: This paper aims to establish the theoretical foundation for shift inclusion in mathematical morphology. In this paper, we prove that the morphological opening and closing concerning structuring elements of shift inclusion property would preserve the ordering of images, while this property is important in granulometric analysis and related image processing tasks. Furthermore, we proposed a systematic way, called the decomposition theorem for shift inclusion, to construct sequences of structuring elements with shift inclusion property. Moreover, the influences of the image domain are discussed and the condition named weak shift inclusion is defined, which is proved as an equivalent condition for ensuring the order-preserving property.


title: Kryging: Geostatistical analysis of large-scale datasets using Krylov subspace methods

abstract: Analyzing massive spatial datasets using Gaussian process model poses computational challenges. This is a problem prevailing heavily in applications such as environmental modeling, ecology, forestry and environmental heath. We present a novel approximate inference methodology that uses profile likelihood and Krylov subspace methods to estimate the spatial covariance parameters and makes spatial predictions with uncertainty quantification. The proposed method, Kryging, applies for both observations on regular grid and irregularly-spaced observations, and for any Gaussian process with a stationary covariance function, including the popular $\Matern$ covariance family. We make use of the block Toeplitz structure with Toeplitz blocks of the covariance matrix and use fast Fourier transform methods to alleviate the computational and memory bottlenecks. We perform extensive simulation studies to show the effectiveness of our model by varying sample sizes, spatial parameter values and sampling designs. A real data application is also performed on a dataset consisting of land surface temperature readings taken by the MODIS satellite. Compared to existing methods, the proposed method performs satisfactorily with much less computation time and better scalability.


title: Sensitivity - Local Index to Control Chaoticity or Gradient Globally -

abstract: Here, we introduce a fully local index named "sensitivity" for each neuron to control chaoticity or gradient globally in a neural network (NN). We also propose a learning method to adjust it named "sensitivity adjustment learning (SAL)". The index is the gradient magnitude of its output with respect to its inputs. By adjusting its time average to 1.0 in each neuron, information transmission in the neuron changes to be moderate without shrinking or expanding for both forward and backward computations. That results in moderate information transmission through a layer of neurons when the weights and inputs are random. Therefore, SAL can control the chaoticity of the network dynamics in a recurrent NN (RNN). It can also solve the vanishing gradient problem in error backpropagation (BP) learning in a deep feedforward NN or an RNN. We demonstrate that when applying SAL to an RNN with small and random initial weights, log-sensitivity, which is the logarithm of RMS (root mean square) sensitivity over all the neurons, is equivalent to the maximum Lyapunov exponent until it reaches 0.0. We also show that SAL works with BP or BPTT (BP through time) to avoid the vanishing gradient problem in a 300-layer NN or an RNN that learns a problem with a lag of 300 steps between the first input and the output. Compared with manually fine-tuning the spectral radius of the weight matrix before learning, SAL's continuous nonlinear learning nature prevents loss of sensitivities during learning, resulting in a significant improvement in learning performance.


title: MRDet: A Multi-Head Network for Accurate Oriented Object Detection in Aerial Images

abstract: Objects in aerial images usually have arbitrary orientations and are densely located over the ground, making them extremely challenge to be detected. Many recently developed methods attempt to solve these issues by estimating an extra orientation parameter and placing dense anchors, which will result in high model complexity and computational costs. In this paper, we propose an arbitrary-oriented region proposal network (AO-RPN) to generate oriented proposals transformed from horizontal anchors. The AO-RPN is very efficient with only a few amounts of parameters increase than the original RPN. Furthermore, to obtain accurate bounding boxes, we decouple the detection task into multiple subtasks and propose a multi-head network to accomplish them. Each head is specially designed to learn the features optimal for the corresponding task, which allows our network to detect objects accurately. We name it MRDet short for Multi-head Rotated object Detector for convenience. We test the proposed MRDet on two challenging benchmarks, i.e., DOTA and HRSC2016, and compare it with several state-of-the-art methods. Our method achieves very promising results which clearly demonstrate its effectiveness.


title: LCEval: Learned Composite Metric for Caption Evaluation

abstract: Automatic evaluation metrics hold a fundamental importance in the development and fine-grained analysis of captioning systems. While current evaluation metrics tend to achieve an acceptable correlation with human judgements at the system level, they fail to do so at the caption level. In this work, we propose a neural network-based learned metric to improve the caption-level caption evaluation. To get a deeper insight into the parameters which impact a learned metrics performance, this paper investigates the relationship between different linguistic features and the caption-level correlation of the learned metrics. We also compare metrics trained with different training examples to measure the variations in their evaluation. Moreover, we perform a robustness analysis, which highlights the sensitivity of learned and handcrafted metrics to various sentence perturbations. Our empirical analysis shows that our proposed metric not only outperforms the existing metrics in terms of caption-level correlation but it also shows a strong system-level correlation against human assessments.


title: WEmbSim: A Simple yet Effective Metric for Image Captioning

abstract: The area of automatic image caption evaluation is still undergoing intensive research to address the needs of generating captions which can meet adequacy and fluency requirements. Based on our past attempts at developing highly sophisticated learning-based metrics, we have discovered that a simple cosine similarity measure using the Mean of Word Embeddings(MOWE) of captions can actually achieve a surprisingly high performance on unsupervised caption evaluation. This inspires our proposed work on an effective metric WEmbSim, which beats complex measures such as SPICE, CIDEr and WMD at system-level correlation with human judgments. Moreover, it also achieves the best accuracy at matching human consensus scores for caption pairs, against commonly used unsupervised methods. Therefore, we believe that WEmbSim sets a new baseline for any complex metric to be justified.


title: A non-alternating graph hashing algorithm for large scale image search

abstract: In the era of big data, methods for improving memory and computational efficiency have become crucial for successful deployment of technologies. Hashing is one of the most effective approaches to deal with computational limitations that come with big data. One natural way for formulating this problem is spectral hashing that directly incorporates affinity to learn binary codes. However, due to binary constraints, the optimization becomes intractable. To mitigate this challenge, different relaxation approaches have been proposed to reduce the computational load of obtaining binary codes and still attain a good solution. The problem with all existing relaxation methods is resorting to one or more additional auxiliary variables to attain high quality binary codes while relaxing the problem. The existence of auxiliary variables leads to coordinate descent approach which increases the computational complexity. We argue that introducing these variables is unnecessary. To this end, we propose a novel relaxed formulation for spectral hashing that adds no additional variables to the problem. Furthermore, instead of solving the problem in original space where number of variables is equal to the data points, we solve the problem in a much smaller space and retrieve the binary codes from this solution. This trick reduces both the memory and computational complexity at the same time. We apply two optimization techniques, namely projected gradient and optimization on manifold, to obtain the solution. Using comprehensive experiments on four public datasets, we show that the proposed efficient spectral hashing (ESH) algorithm achieves highly competitive retrieval performance compared with state of the art at low complexity.