title: Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark

abstract: Tracking by natural language specification is a new rising research topic that aims at locating the target object in the video sequence based on its language description. Compared with traditional bounding box (BBox) based tracking, this setting guides object tracking with high-level semantic information, addresses the ambiguity of BBox, and links local and global search organically together. Those benefits may bring more flexible, robust and accurate tracking performance in practical scenarios. However, existing natural language initialized trackers are developed and compared on benchmark datasets proposed for tracking-by-BBox, which can't reflect the true power of tracking-by-language. In this work, we propose a new benchmark specifically dedicated to the tracking-by-language, including a large scale dataset, strong and diverse baseline methods. Specifically, we collect 2k video sequences (contains a total of 1,244,340 frames, 663 words) and split 1300/700 for the train/testing respectively. We densely annotate one sentence in English and corresponding bounding boxes of the target object for each video. We also introduce two new challenges into TNL2K for the object tracking task, i.e., adversarial samples and modality switch. A strong baseline method based on an adaptive local-global-search scheme is proposed for future works to compare. We believe this benchmark will greatly boost related researches on natural language guided tracking.


title: Sim-to-Real for Robotic Tactile Sensing via Physics-Based Simulation and Learned Latent Projections

abstract: Tactile sensing is critical for robotic grasping and manipulation of objects under visual occlusion. However, in contrast to simulations of robot arms and cameras, current simulations of tactile sensors have limited accuracy, speed, and utility. In this work, we develop an efficient 3D finite element method (FEM) model of the SynTouch BioTac sensor using an open-access, GPU-based robotics simulator. Our simulations closely reproduce results from an experimentally-validated model in an industry-standard, CPU-based simulator, but at 75x the speed. We then learn latent representations for simulated BioTac deformations and real-world electrical output through self-supervision, as well as projections between the latent spaces using a small supervised dataset. Using these learned latent projections, we accurately synthesize real-world BioTac electrical output and estimate contact patches, both for unseen contact interactions. This work contributes an efficient, freely-accessible FEM model of the BioTac and comprises one of the first efforts to combine self-supervision, cross-modal transfer, and sim-to-real transfer for tactile sensors.


title: Dual Contrastive Loss and Attention for GANs

abstract: Generative Adversarial Networks (GANs) produce impressive results on unconditional image generation when powered with large-scale image datasets. Yet generated images are still easy to spot especially on datasets with high variance (e.g. bedroom, church). In this paper, we propose various improvements to further push the boundaries in image generation. Specifically, we propose a novel dual contrastive loss and show that, with this loss, discriminator learns more generalized and distinguishable representations to incentivize generation. In addition, we revisit attention and extensively experiment with different attention blocks in the generator. We find attention to be still an important module for successful image generation even though it was not used in the recent state-of-the-art models. Lastly, we study different attention architectures in the discriminator, and propose a reference attention mechanism. By combining the strengths of these remedies, we improve the compelling state-of-the-art Fr\'{e}chet Inception Distance (FID) by at least 17.5% on several benchmark datasets. We obtain even more significant improvements on compositional synthetic scenes (up to 47.5% in FID). Code and models are available at https://github.com/ningyu1991/AttentionDualContrastGAN .


title: Dark Modes in Non-Markovian Linear Quantum Systems

abstract: In this note, we are concerned with dark modes in a class of non-Markovian open quantum systems. Based on a microscopic model, a time-convoluted linear quantum stochastic differential equation and an output equation are derived to describe the system dynamics. The definition of dark modes is given building on the input-output structure of the system. Then, we present a necessary and sufficient condition for the existence of dark modes. Also, the problem of dark mode synthesis via Hamiltonian engineering is constructively solved and an example is presented to illustrate our results.


title: CloneBot: Personalized Dialogue-Response Predictions

abstract: Our project task was to create a model that, given a speaker ID, chat history, and an utterance query, can predict the response utterance in a conversation. The model is personalized for each speaker. This task can be a useful tool for building speech bots that talk in a human-like manner in a live conversation. Further, we succeeded at using dense-vector encoding clustering to be able to retrieve relevant historical dialogue context, a useful strategy for overcoming the input limitations of neural-based models when predictions require longer-term references from the dialogue history. In this paper, we have implemented a state-of-the-art model using pre-training and fine-tuning techniques built on transformer architecture and multi-headed attention blocks for the Switchboard corpus. We also show how efficient vector clustering algorithms can be used for real-time utterance predictions that require no training and therefore work on offline and encrypted message histories.


title: Full-color nanorouter for high-resolution imaging

abstract: Pixel scaling effects have been a major issue for the development of high-resolution color image sensors due to the reduced photoelectric signal and the color crosstalk. Various structural color techniques have been proposed and demonstrated the large freedom in color manipulation by the structure design. However, the optical efficiency and the color distortion limit the practical applications due to its intrinsic filtering mechanism. Instead, on-chip full-color routing is quite charming for improving the signal-to-noise ratio. In this paper, a single-layer quick response code like nanorouter is proposed for the full-color light routing in a pixel level of image sensors. It shows much higher routing efficiency than various planar lens schemes for signal wavelength focusing. Moreover, over 60% signal enhancement with robust polarization insensitivity is obtained in all three primary color bands with a same nanorouter by a multi-objective optimization method. Negligible color distortion is observed from the reconstructed color image. Such a simple nanorouter structure is promising for the development of image sensor, photovoltaics and display.


title: Iteration complexity analysis of a partial LQP-based alternating direction method of multipliers

abstract: In this paper, we consider a prototypical convex optimization problem with multi-block variables and separable structures. By adding the Logarithmic Quadratic Proximal (LQP) regularizer with suitable proximal parameter to each of the first grouped subproblems, we develop a partial LQP-based Alternating Direction Method of Multipliers (ADMM-LQP). The dual variable is updated twice with relatively larger stepsizes than the classical region $(0,\frac{1+\sqrt{5}}{2})$. Using a prediction-correction approach to analyze properties of the iterates generated by ADMM-LQP, we establish its global convergence and sublinear convergence rate of $O(1/T)$ in the new ergodic and nonergodic senses, where $T$ denotes the iteration index. We also extend the algorithm to a nonsmooth composite convex optimization and establish {similar convergence results} as our ADMM-LQP.


title: Optical Imaging of Chemically and Geometrically Controlled Interfacial Diffusion and Redox in 2D van der Waals Space

abstract: Molecular motions and chemical reactions occurring in constrained space play key roles in many catalysis and energy storage applications. However, its understanding has been impeded by difficulty in detection and lack of reliable model systems. In this work, we report geometric and chemical manipulation of O2 diffusion and ensuing O2-mediated charge transfer (CT) that occur in the 2D space between single-layer transition metal dichalcogenides (TMDs) and dielectric substrates. As a sensitive real-time wide-field imaging signal, charge-density-dependent photoluminescence (PL) from TMDs was used. The two sequential processes inducing spatiotemporal PL change could be drastically accelerated by increasing the interfacial gap size or introducing artificial defects serving as CT reaction centers. We also show that widely varying CT kinetics of four TMDs are rate-determined by the degree of hydration required for the reactions. The reported findings will be instrumental in designing novel functional nanostructures and devices.


title: Wormholes without averaging

abstract: After averaging over fermion couplings, SYK has a collective field description that sometimes has "wormhole" solutions. We study the fate of these wormholes when the couplings are fixed. Working mainly in a simple model, we find that the wormhole saddles persist, but that new saddles also appear elsewhere in the integration space -- "half-wormholes." The wormhole contributions depend only weakly on the specific choice of couplings, while the half-wormhole contributions are strongly sensitive. The half-wormholes are crucial for factorization of decoupled systems with fixed couplings, but they vanish after averaging, leaving the non-factorizing wormhole behind.


title: Emergent long-range interaction and state-selective localization in a strongly driven $ XXZ $ model

abstract: The nonlinear effect of a driving force in periodically driven quantum many-body systems can be systematically investigated by analyzing the effective Floquet Hamiltonian. In particular, under an appropriate definition of the effective Hamiltonian, simple driving forces may result in non-local interactions. Here we consider a driven $ XXZ $ model to show that four-site interactions emerge owing to the driving force, which can produce state-selective localization, a phenomenon where some limited Ising-like product states become fixed points of dynamics. We first derive the effective Hamiltonian of a driven $ XXZ $ model on an arbitrary lattice for general spin $ S $. We then analyze in detail the case of a one-dimensional chain with $ S=1/2 $ as a special case and find a condition imposed on the cluster of four consecutive sites as a necessary and sufficient condition for the state of the whole system to be localized. We construct such a localized state based on this condition and demonstrate it by numerical simulation of the original time-periodic model.


title: Sums of Squares: Methods for Proving Identity Families

abstract: This paper presents both a method and a result. The result presents a closed formula for the sum of the first $m+1,m \ge 0,$ squares of the sequence $F^{(k)}$ where each member is the sum of the previous $k$ members and with initial conditions of $k-1$ zeroes followed by a 1. The generalized result includes the known result of sums of squares of the Fibonacci numbers and a recent result of Schumaker on sums of squares of Tribonacci numbers. To prove the identities uniformly for all $k,$ the Algebraic Verification method is presented which reduces proof of an identity to verification of the equality of finitely many pairs of finite-degree polynomials, possibly in several variables. Several other papers proving families of identities are examined, and it is suggested that the collection of the uniform proof methods used in these papers could produce a new trend in stating and proving identities.


title: Disk vs wind accretion in X-ray pulsar GX 301-2

abstract: GX 301-2 provides a rare opportunity to study both disk and wind accretion in a same target. We report Insight-HXMT observations of the spin-up event of GX 301-2 happened in 2019 and compare with those of wind-fed state. The pulse profiles of the initial rapid spin-up period are dominated by one main peak, while those of the later slow spin-up period are composed of two similar peaks, as those of wind-fed state. These behaviors are confirmed by Fermi/GBM data, which also show that during the rapid spin-up period, the main peak increases with luminosity up to $8\times10^{37}$ erg s$^{-1}$, but the faint peak keeps almost constant. The absorption column densities during the spin-up period are $\sim1.5\times10^{23}$ cm$^{-2}$, much less than those of wind-fed state at similar luminosity ($\sim9\times10^{23}$ cm$^{-2}$), supporting the scenario that most of material is condensed into a disk during the spin-up period. We discuss possible differences between disk and wind accretion that may explain the observed different trend of pulse profiles.


title: Evaluation of Multimodal Semantic Segmentation using RGB-D Data

abstract: Our goal is to develop stable, accurate, and robust semantic scene understanding methods for wide-area scene perception and understanding, especially in challenging outdoor environments. To achieve this, we are exploring and evaluating a range of related technology and solutions, including AI-driven multimodal scene perception, fusion, processing, and understanding. This work reports our efforts on the evaluation of a state-of-the-art approach for semantic segmentation with multiple RGB and depth sensing data. We employ four large datasets composed of diverse urban and terrain scenes and design various experimental methods and metrics. In addition, we also develop new strategies of multi-datasets learning to improve the detection and recognition of unseen objects. Extensive experiments, implementations, and results are reported in the paper.


title: Multiply minimal points for the product of iterates

abstract: The multiple Birkhoff recurrence theorem states that for any $d\in\mathbb N$, every system $(X,T)$ has a multiply recurrent point $x$, i.e. $(x,x,\ldots, x)$ is recurrent under $\tau_d=:T\times T^2\times \ldots \times T^d$. It is natural to ask if there always is a multiply minimal point, i.e. a point $x$ such that $(x,x,\ldots,x)$ is $\tau_d$-minimal. A negative answer is presented in this paper via studying the horocycle flows. However, it is shown that for any minimal system $(X,T)$ and any non-empty open set $U$, there is $x\in U$ such that $\{n\in{\mathbb Z}: T^nx\in U, \ldots, T^{dn}x\in U\}$ is piecewise syndetic; and that for a PI minimal system, any $M$-subsystem of $(X^d, \tau_d)$ is minimal.


title: Facial Masks and Soft-Biometrics: Leveraging Face Recognition CNNs for Age and Gender Prediction on Mobile Ocular Images

abstract: We address the use of selfie ocular images captured with smartphones to estimate age and gender. Partial face occlusion has become an issue due to the mandatory use of face masks. Also, the use of mobile devices has exploded, with the pandemic further accelerating the migration to digital services. However, state-of-the-art solutions in related tasks such as identity or expression recognition employ large Convolutional Neural Networks, whose use in mobile devices is infeasible due to hardware limitations and size restrictions of downloadable applications. To counteract this, we adapt two existing lightweight CNNs proposed in the context of the ImageNet Challenge, and two additional architectures proposed for mobile face recognition. Since datasets for soft-biometrics prediction using selfie images are limited, we counteract over-fitting by using networks pre-trained on ImageNet. Furthermore, some networks are further pre-trained for face recognition, for which very large training databases are available. Since both tasks employ similar input data, we hypothesize that such strategy can be beneficial for soft-biometrics estimation. A comprehensive study of the effects of different pre-training over the employed architectures is carried out, showing that, in most cases, a better accuracy is obtained after the networks have been fine-tuned for face recognition.


title: Blockwise Phase Rotation-Aided Analog Transmit Beamforming for 5G mmWave Systems

abstract: In this letter, we propose a blockwise phase rotation-aided analog transmit beamforming (BPR-ATB) scheme to improve the spectral efficiency and the bit-error-rate (BER) performance in millimeter wave (mmWave) communication systems. Due to the phase angle optimization issues of the conventional analog beamforming, we design the BPR-ATB for reducing the rotated beamspace of the equivalent channel and improving the minimum Euclidean distance. To verify the effectiveness of the proposed BPR-ATB scheme, we employ an Alamouti coding technique at the transmitter and evaluate the bit-error-rate performance for mmWave multiple-input and single-output systems. The simulation results show that the proposed BPR-ATB scheme outperforms the conventional discrete Fourier transform-based ATB scheme.


title: Weakly-Supervised Image Semantic Segmentation Using Graph Convolutional Networks

abstract: This work addresses weakly-supervised image semantic segmentation based on image-level class labels. One common approach to this task is to propagate the activation scores of Class Activation Maps (CAMs) using a random-walk mechanism in order to arrive at complete pseudo labels for training a semantic segmentation network in a fully-supervised manner. However, the feed-forward nature of the random walk imposes no regularization on the quality of the resulting complete pseudo labels. To overcome this issue, we propose a Graph Convolutional Network (GCN)-based feature propagation framework. We formulate the generation of complete pseudo labels as a semi-supervised learning task and learn a 2-layer GCN separately for every training image by back-propagating a Laplacian and an entropy regularization loss. Experimental results on the PASCAL VOC 2012 dataset confirm the superiority of our scheme to several state-of-the-art baselines. Our code is available at https://github.com/Xavier-Pan/WSGCN.


title: Classifying toric 3-fold codes of dimensions 4 and 5

abstract: A toric code is an error-correcting code determined by a toric variety or its associated integral convex polytope. We investigate $4$- and $5$-dimensional toric $3$-fold codes, which are codes arising from polytopes in $\mathbf{R}^3$ with four and five lattice points, respectively. By computing the minimum distances of each code, we fully classify the $4$-dimensional codes. We further present progress toward the same goal for dimension $5$ codes. In particular, we classify the $5$-dimensional toric $3$-fold codes arising from polytopes of width 1.


title: Research of Damped Newton Stochastic Gradient Descent Method for Neural Network Training

abstract: First-order methods like stochastic gradient descent(SGD) are recently the popular optimization method to train deep neural networks (DNNs), but second-order methods are scarcely used because of the overpriced computing cost in getting the high-order information. In this paper, we propose the Damped Newton Stochastic Gradient Descent(DN-SGD) method and Stochastic Gradient Descent Damped Newton(SGD-DN) method to train DNNs for regression problems with Mean Square Error(MSE) and classification problems with Cross-Entropy Loss(CEL), which is inspired by a proved fact that the hessian matrix of last layer of DNNs is always semi-definite. Different from other second-order methods to estimate the hessian matrix of all parameters, our methods just accurately compute a small part of the parameters, which greatly reduces the computational cost and makes convergence of the learning process much faster and more accurate than SGD. Several numerical experiments on real datesets are performed to verify the effectiveness of our methods for regression and classification problems.


title: Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptation

abstract: Unsupervised Domain Adaptation (UDA) transfers predictive models from a fully-labeled source domain to an unlabeled target domain. In some applications, however, it is expensive even to collect labels in the source domain, making most previous works impractical. To cope with this problem, recent work performed instance-wise cross-domain self-supervised learning, followed by an additional fine-tuning stage. However, the instance-wise self-supervised learning only learns and aligns low-level discriminative features. In this paper, we propose an end-to-end Prototypical Cross-domain Self-Supervised Learning (PCS) framework for Few-shot Unsupervised Domain Adaptation (FUDA). PCS not only performs cross-domain low-level feature alignment, but it also encodes and aligns semantic structures in the shared embedding space across domains. Our framework captures category-wise semantic structures of the data by in-domain prototypical contrastive learning; and performs feature alignment through cross-domain prototypical self-supervision. Compared with state-of-the-art methods, PCS improves the mean classification accuracy over different domain pairs on FUDA by 10.5%, 3.5%, 9.0%, and 13.2% on Office, Office-Home, VisDA-2017, and DomainNet, respectively. Our project page is at http://xyue.io/pcs-fuda/index.html


title: Cooperative Beam Hopping for Accurate Positioning in Ultra-Dense LEO Satellite Networks

abstract: In ultra-dense LEO satellite networks, conventional communication-oriented beam pattern design cannot provide multiple favorable signals from different satellites simultaneously, and thus leads to poor positioning performance. To tackle this issue, in this paper, we propose a novel cooperative beam hopping (BH) framework to adaptively tune beam layouts suitable for multi-satellite coordinated positioning. On this basis, a joint user association, BH design and power allocation optimization problem is formulated to minimize average Cram\'er-Rao lower bound (CRLB). An efficient flexible BH control algorithm (FBHCA) is then proposed to solve the problem. Finally, a thorough experimental platform is built following the Third Generation Partnership Project (3GPP) defined non-terrestrial network (NTN) simulation parameters to validate the performance gain of the devised algorithm. The numerical results demonstrate that FBHCA can significantly improve CRLB performance over the benchmark scheme.


title: Orientation gradients in rapidly solidified pure aluminum thin films: comparison of experiments and phase-field crystal simulations

abstract: Rapid solidification experiments on thin film aluminum samples reveal the presence of lattice orientation gradients within crystallizing grains. To study this phenomenon, a single-component phase-field crystal (PFC) model that captures the properties of solid, liquid, and vapor phases is proposed to model pure aluminium quantitatively. A coarse-grained amplitude representation of this model is used to simulate solidification in samples approaching micrometer scales. The simulations reproduce the experimentally observed orientation gradients within crystallizing grains when grown at experimentally relevant rapid quenches. We propose a causal connection between formation of defects and orientation gradients.


title: Topology-Preserving 3D Image Segmentation Based On Hyperelastic Regularization

abstract: Image segmentation is to extract meaningful objects from a given image. For degraded images due to occlusions, obscurities or noises, the accuracy of the segmentation result can be severely affected. To alleviate this problem, prior information about the target object is usually introduced. In [10], a topology-preserving registration-based segmentation model was proposed, which is restricted to segment 2D images only. In this paper, we propose a novel 3D topology-preserving registration-based segmentation model with the hyperelastic regularization, which can handle both 2D and 3D images. The existence of the solution of the proposed model is established. We also propose a converging iterative scheme to solve the proposed model. Numerical experiments have been carried out on the synthetic and real images, which demonstrate the effectiveness of our proposed model.


title: Temporal and spatial superbunching effects from apair of modulated distinguishable classical light

abstract: From the Feynman path integration theory of view, the Hanbury Brown--Twiss effect would not be observed for one definite two-photon propagation path, as well as the superbunching effect. Here, temporal and spatial superbunching effects are measured from a pair of modulated distinguishable classical light. These interesting phenomena are realized by passing two orthogonal polarized laser beams through two rotating ground glass plates in sequence. To understand the underlying physical process, the intensity fluctuation correlation theory is developed to describe the superbunching effect in the temporal and spatial domain, which agrees with experimental results well. Such experimental results are conducive to the study of superbunching effect which plays an important role in improving the performance in related applications, such as the contrast of ghost imaging.


title: Constellations with range and IS-categories

abstract: Constellations are asymmetric generalisations of categories. Although they are not required to possess a notion of range, many natural examples do. These include commonly occurring constellations related to concrete categories (since they model surjective morphisms), and also others arising from quite different sources, including from well-studied classes of semigroups. We show how constellations with a well-behaved range operation are nothing but ordered categories with restrictions. We characterise abstractly those categories that are canonical extensions of constellations with range, as so-called IS-categories. Such categories contain distinguished subcategories of insertions (which are monomorphisms) and surjections (in general different to the epimorphisms) such that each morphism admits a unique factorisation into a surjection followed by an insertion. Most familiar concrete categories are IS-categories, and we show how some of the well-known properties of these categories arise from the fact that they are IS-categories. For appropriate choices of morphisms in each, the category of IS-categories is shown to be equivalent to the category of constellations with range.


title: Space-Time Video Regularity and Visual Fidelity: Compression, Resolution and Frame Rate Adaptation

abstract: In order to be able to deliver today's voluminous amount of video contents through limited bandwidth channels in a perceptually optimal way, it is important to consider perceptual trade-offs of compression and space-time downsampling protocols. In this direction, we have studied and developed new models of natural video statistics (NVS), which are useful because high-quality videos contain statistical regularities that are disturbed by distortions. Specifically, we model the statistics of divisively normalized difference between neighboring frames that are relatively displaced. In an extensive empirical study, we found that those paths of space-time displaced frame differences that provide maximal regularity against our NVS model generally align best with motion trajectories. Motivated by this, we build a new video quality prediction engine that extracts NVS features from displaced frame differences, and combines them in a learned regressor that can accurately predict perceptual quality. As a stringent test of the new model, we apply it to the difficult problem of predicting the quality of videos subjected not only to compression, but also to downsampling in space and/or time. We show that the new quality model achieves state-of-the-art (SOTA) prediction performance compared on the new ETRI-LIVE Space-Time Subsampled Video Quality (STSVQ) database, which is dedicated to this problem. Downsampling protocols are of high interest to the streaming video industry, given rapid increases in frame resolutions and frame rates.


title: Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policies

abstract: We present CREST, an approach for causal reasoning in simulation to learn the relevant state space for a robot manipulation policy. Our approach conducts interventions using internal models, which are simulations with approximate dynamics and simplified assumptions. These interventions elicit the structure between the state and action spaces, enabling construction of neural network policies with only relevant states as input. These policies are pretrained using the internal model with domain randomization over the relevant states. The policy network weights are then transferred to the target domain (e.g., the real world) for fine tuning. We perform extensive policy transfer experiments in simulation for two representative manipulation tasks: block stacking and crate opening. Our policies are shown to be more robust to domain shifts, more sample efficient to learn, and scale to more complex settings with larger state spaces. We also show improved zero-shot sim-to-real transfer of our policies for the block stacking task.


title: PAUL: Procrustean Autoencoder for Unsupervised Lifting

abstract: Recent success in casting Non-rigid Structure from Motion (NRSfM) as an unsupervised deep learning problem has raised fundamental questions about what novelty in NRSfM prior could the deep learning offer. In this paper we advocate for a 3D deep auto-encoder framework to be used explicitly as the NRSfM prior. The framework is unique as: (i) it learns the 3D auto-encoder weights solely from 2D projected measurements, and (ii) it is Procrustean in that it jointly resolves the unknown rigid pose for each shape instance. We refer to this architecture as a Procustean Autoencoder for Unsupervised Lifting (PAUL), and demonstrate state-of-the-art performance across a number of benchmarks in comparison to recent innovations such as Deep NRSfM and C3PDO.


title: Towards understanding the power of quantum kernels in the NISQ era

abstract: A key problem in the field of quantum computing is understanding whether quantum machine learning (QML) models implemented on noisy intermediate-scale quantum (NISQ) machines can achieve quantum advantages. Recently, Huang et al. [Nat Commun 12, 2631] partially answered this question by the lens of quantum kernel learning. Namely, they exhibited that quantum kernels can learn specific datasets with lower generalization error over the optimal classical kernel methods. However, most of their results are established on the ideal setting and ignore the caveats of near-term quantum machines. To this end, a crucial open question is: does the power of quantum kernels still hold under the NISQ setting? In this study, we fill this knowledge gap by exploiting the power of quantum kernels when the quantum system noise and sample error are considered. Concretely, we first prove that the advantage of quantum kernels is vanished for large size of datasets, few number of measurements, and large system noise. With the aim of preserving the superiority of quantum kernels in the NISQ era, we further devise an effective method via indefinite kernel learning. Numerical simulations accord with our theoretical results. Our work provides theoretical guidance of exploring advanced quantum kernels to attain quantum advantages on NISQ devices.


title: Attention, please! A survey of Neural Attention Models in Deep Learning

abstract: In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior. For decades, concepts and functions of attention have been studied in philosophy, psychology, neuroscience, and computing. For the last six years, this property has been widely explored in deep neural networks. Currently, the state-of-the-art in Deep Learning is represented by neural attention models in several application domains. This survey provides a comprehensive overview and analysis of developments in neural attention models. We systematically reviewed hundreds of architectures in the area, identifying and discussing those in which attention has shown a significant impact. We also developed and made public an automated methodology to facilitate the development of reviews in the area. By critically analyzing 650 works, we describe the primary uses of attention in convolutional, recurrent networks and generative models, identifying common subgroups of uses and applications. Furthermore, we describe the impact of attention in different application domains and their impact on neural networks' interpretability. Finally, we list possible trends and opportunities for further research, hoping that this review will provide a succinct overview of the main attentional models in the area and guide researchers in developing future approaches that will drive further improvements.


title: Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone

abstract: Transcribing meetings containing overlapped speech with only a single distant microphone (SDM) has been one of the most challenging problems for automatic speech recognition (ASR). While various approaches have been proposed, all previous studies on the monaural overlapped speech recognition problem were based on either simulation data or small-scale real data. In this paper, we extensively investigate a two-step approach where we first pre-train a serialized output training (SOT)-based multi-talker ASR by using large-scale simulation data and then fine-tune the model with a small amount of real meeting data. Experiments are conducted by utilizing 75 thousand (K) hours of our internal single-talker recording to simulate a total of 900K hours of multi-talker audio segments for supervised pre-training. With fine-tuning on the 70 hours of the AMI-SDM training data, our SOT ASR model achieves a word error rate (WER) of 21.2% for the AMI-SDM evaluation set while automatically counting speakers in each test segment. This result is not only significantly better than the previous state-of-the-art WER of 36.4% with oracle utterance boundary information but also better than a result by a similarly fine-tuned single-talker ASR model applied to beamformed audio.


title: A simple model for ultradiscrete Hopf bifurcation

abstract: Dynamical properties of ultradiscrete Hopf bifurcation, similar to those of the standard Hopf bifurcation, are discussed by proposing a simple model of ultradiscrete equations with max-plus algebra. In ultradiscrete Hopf bifurcation, limit cycles emerge depending on the value of a bifurcation parameter in the model. The limit cycles are composed of a finite number of discrete states. Furthermore, the model exhibits excitability. The model is derived from two different dynamical models with Hopf bifurcation by means of ultradiscretization; it is a candidate for a normal form for ultradiscrete Hopf bifurcation.


title: Review of Mercury's Dynamic Magnetosphere: Post-MESSENGER Era and Comparative Magnetospheres

abstract: This review summarizes the research of Mercury's magnetosphere in the Post-MESSENGER era and compares its dynamics to those in other planetary magnetospheres, especially to those in Earth's magnetosphere. This review starts by introducing the planet Mercury, including its interplanetary environment, magnetosphere, exosphere, and conducting core. The frequent and intense magnetic reconnection on the dayside magnetopause, which is represented by the flux transfer event "shower", is reviewed on how they depend on magnetosheath plasma beta and magnetic shear angle across the magnetopause, following by how they contribute to the flux circulation and magnetosphere-surface-exosphere coupling. In the next, the progress of Mercury's magnetosphere under extreme solar events, including the core induction and the reconnection erosion on the dayside magnetosphere, the responses of the nightside magnetosphere, are reviewed. Then, the dawn-dusk properties of the plasma sheet, including the features of the ions, the structure of the current sheet, and the dynamics of magnetic reconnection, are summarized. The last topic reviews the particle energization in Mercury's magnetosphere, which includes the energization of the Kelvin-Helmholtz waves on the magnetopause boundaries, reconnection-generated magnetic structures, and the cross-tail electric field. In each chapter, the last section discusses the open questions related with each topic, which can be considered by the simulations and the future spacecraft mission. We close by summarizing the future BepiColombo opportunities, which is a joint mission between ESA and JAXA, and is en route to Mercury.


title: Measurements of the branching fractions of $\psi(3686)\rightarrow\bar{\Sigma}^{0}\Lambda+c.c.$ and $\chi_{cJ (J = 0,1,2)} \rightarrow \Lambda \bar{\Lambda}$

abstract: Based on $4.481\times10^8$ $\psi(3686)$ events collected with the BESIII detector at BEPCII, the branching fraction of the isospin violating decay $\psi(3686)\rightarrow\bar{\Sigma}^{0}\Lambda+c.c.$ is measured to be $(1.60 \pm 0.31 \pm 0.13~\pm~0.58) \times 10^{-6}$, where the first uncertainty is statistical, the second is systematic, and the third is the uncertainty arising from interference with the continuum. This result is significantly smaller than the measurement based on CLEO-c data sets. The decays $\chi_{cJ} \rightarrow\Lambda\bar{\Lambda}$ are measured via $\psi(3686)\rightarrow\gamma\chi_{cJ}$, and the branching fractions are determined to be $\mathcal{B}\left(\chi_{c0}\rightarrow\Lambda\bar{\Lambda}\right)=(3.64 \pm 0.10 \pm 0.10 \pm 0.07)\times 10^{-4}$, $\mathcal{B}\left(\chi_{c1}\rightarrow\Lambda\bar{\Lambda}\right)=(1.31\pm0.06 \pm 0.06 \pm0.03)\times 10^{-4}$, $\mathcal{B}\left(\chi_{c2}\rightarrow\Lambda\bar{\Lambda}\right)=(1.91\pm0.08 \pm 0.17 \pm0.04)\times 10^{-4}$, where the third uncertainties are systematic due to the $\psi(3686) \rightarrow \gamma \chi_{c J}$ branching fractions.


title: Ephemeral Antibubbles: Spatiotemporal Evolution from Direct Numerical Simulations

abstract: Antibubbles, which consist of a shell of a low-density fluid inside a high-density fluid, have several promising applications. We show, via extensive direct numerical simulations (DNSs), in both two and three dimensions (2D and 3D), that the spatiotemporal evolution of antibubbles can be described naturally by the coupled Cahn-Hilliard-Navier-Stokes (CHNS) equations for a binary fluid. Our DNSs capture elegantly the gravity-induced thinning and breakup of an antibubble via the time evolution of the Cahn-Hilliard scalar order parameter field $\phi$, which varies continuously across interfaces, so we do not have to enforce complicated boundary conditions at the moving antibubble interfaces. To ensure that our results are robust, we supplement our CHNS simulations with sharp-interface Volume-of-Fluid (VoF) DNSs. We track the thickness of the antibubble and calculate the dependence of the lifetime of an antibubble on several parameters; we show that our DNS results agree with various experimental results; in particular, the velocity with which the arms of the antibubble retract after breakup scales as $\sigma^{1/2}$, where $\sigma$ is the surface tension.


title: Bidirectional information flow quantum state tomography

abstract: The exact reconstruction of many-body quantum systems is one of the major challenges in modern physics, because it is impractical to overcome the exponential complexity problem brought by high-dimensional quantum many-body systems. Recently, machine learning techniques are well used to promote quantum information research and quantum state tomography has been also developed by neural network generative models. We propose a quantum state tomography method, which is based on Bidirectional Gated Recurrent Unit neural network (BiGRU), to learn and reconstruct both easy quantum states and hard quantum states in this paper. We are able to use fewer measurement samples in our method to reconstruct these quantum states and obtain high fidelity.


title: Robust Trajectory Tracking Error Model-Based Predictive Control for Unmanned Ground Vehicles

abstract: This paper proposes a new robust trajectory tracking error-based control approach for unmanned ground vehicles. A trajectory tracking error-based model is used to design a linear model predictive controller and its control action is combined with feedforward and robust control actions. The experimental results show that the proposed control structure is capable to let a tractor-trailer system track both linear and curvilinear target trajectories with low tracking error.


title: What do Indian Researchers download from Sci-Hub

abstract: Recently three foreign academic publishers filed a case of copyright infringement against Sci-Hub and LibGen before the Delhi High Court and prayed for complete blocking these websites in India. In this context, this paper attempted to assess the impact that blocking of Sci-Hub may have on Indian research community. The download requests originating from India on a daily-basis are counted, geotagged and analysed by discipline, publisher, country and publication year etc. Results indicate that blocking Sci-Hub in India may actually hurt Indian research community in a significant way.


title: Some noncommutative subsequential weighted individual ergodic theorems

abstract: This article is devoted to studying individual ergodic theorems for subsequential weighted ergodic averages on the noncommutative Lp-spaces associated to a semifinite von Neumann algebra M. In particular, we establish the convergence of these averages along sequences with density one and certain types of block sequences with positive lower density, and we extend known results along uniform sequences in the sense of Brunel and Keane.


title: Individually Fair Gradient Boosting

abstract: We consider the task of enforcing individual fairness in gradient boosting. Gradient boosting is a popular method for machine learning from tabular data, which arise often in applications where algorithmic fairness is a concern. At a high level, our approach is a functional gradient descent on a (distributionally) robust loss function that encodes our intuition of algorithmic fairness for the ML task at hand. Unlike prior approaches to individual fairness that only work with smooth ML models, our approach also works with non-smooth models such as decision trees. We show that our algorithm converges globally and generalizes. We also demonstrate the efficacy of our algorithm on three ML problems susceptible to algorithmic bias.


title: Robust Beamforming Design for Covert Communications

abstract: In this paper, we consider a common unicast beamforming network where Alice utilizes the communication to Carol as a cover and covertly transmits a message to Bob without being recognized by Willie. We investigate the beamformer design of Alice to maximize the covert rate to Bob when Alice has either perfect or imperfect knowledge about Willie's channel state information (WCSI). For the perfect WCSI case, the problem is formulated under the perfect covert constraint, and we develop a covert beamformer by applying semidefinite relaxation and the bisection method. Then, to reduce the computational complexity, we further propose a zero-forcing beamformer design with a single iteration processing. For the case of the imperfect WCSI, the robust beamformer is developed based on a relaxation and restriction approach by utilizing the property of Kullback-Leibler divergence. Furthermore, we derive the optimal decision threshold of Willie, and analyze the false alarm and the missed detection probabilities in this case. Finally, the performance of the proposed beamformer designs is evaluated through numerical experiments.


title: Differentially Private Histograms under Continual Observation: Streaming Selection into the Unknown

abstract: We generalize the continuous observation privacy setting from Dwork et al. '10 and Chan et al. '11 by allowing each event in a stream to be a subset of some (possibly unknown) universe of items. We design differentially private (DP) algorithms for histograms in several settings, including top-$k$ selection, with privacy loss that scales with polylog$(T)$, where $T$ is the maximum length of the input stream. We present a meta-algorithm that can use existing one-shot top-$k$ DP algorithms as a subroutine to continuously release private histograms from a stream. Further, we present more practical DP algorithms for two settings: 1) continuously releasing the top-$k$ counts from a histogram over a known domain when an event can consist of an arbitrary number of items, and 2) continuously releasing histograms over an unknown domain when an event has a limited number of items.


title: DER: Dynamically Expandable Representation for Class Incremental Learning

abstract: We address the problem of class incremental learning, which is a core step towards achieving adaptive vision intelligence. In particular, we consider the task setting of incremental learning with limited memory and aim to achieve better stability-plasticity trade-off. To this end, we propose a novel two-stage learning approach that utilizes a dynamically expandable representation for more effective incremental concept modeling. Specifically, at each incremental step, we freeze the previously learned representation and augment it with additional feature dimensions from a new learnable feature extractor. This enables us to integrate new visual concepts with retaining learned knowledge. We dynamically expand the representation according to the complexity of novel concepts by introducing a channel-level mask-based pruning strategy. Moreover, we introduce an auxiliary loss to encourage the model to learn diverse and discriminate features for novel concepts. We conduct extensive experiments on the three class incremental learning benchmarks and our method consistently outperforms other methods with a large margin.


title: An Exploration of Data Augmentation Techniques for Improving English to Tigrinya Translation

abstract: It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, often requiring large amounts of auxiliary data to achieve competitive results. An effective method of generating auxiliary data is back-translation of target language sentences. In this work, we present a case study of Tigrinya where we investigate several back-translation methods to generate synthetic source sentences. We find that in low-resource conditions, back-translation by pivoting through a higher-resource language related to the target language proves most effective resulting in substantial improvements over baselines.


title: Positivity-preserving and energy-dissipative finite difference schemes for the Fokker-Planck and Keller-Segel equations

abstract: In this work, we introduce semi-implicit or implicit finite difference schemes for the continuity equation with a gradient flow structure. Examples of such equations include the linear Fokker-Planck equation and the Keller-Segel equations. The two proposed schemes are first order accurate in time, explicitly solvable, and second order and fourth order accurate in space, which are obtained via finite difference implementation of the classical continuous finite element method. The fully discrete schemes are proven positivity-preserving and energy-dissipative: the second order scheme can achieve so unconditionally; the fourth order scheme only requires a mild time step and mesh size constraint. Furthermore, the fourth order scheme is the first high order spatial discretization that can achieve both positivity and energy decay properties, which is suitable for long time simulation and to obtain accurate steady state solutions.


title: Data-driven stochastic modeling of coarse-grained dynamics with finite-size effects using Langevin regression

abstract: Obtaining coarse-grained models that accurately incorporate finite-size effects is an important open challenge in the study of complex, multi-scale systems. We apply Langevin regression, a recently developed method for finding stochastic differential equation (SDE) descriptions of realistically-sampled time series data, to understand finite-size effects in the Kuramoto model of coupled oscillators. We find that across the entire bifurcation diagram, the dynamics of the Kuramoto order parameter are statistically consistent with an SDE whose drift term has the form predicted by the Ott-Antonsen ansatz in the $N\to \infty$ limit. We find that the diffusion term is nearly independent of the bifurcation parameter, and has a magnitude decaying as $N^{-1/2}$, consistent with the central limit theorem. This shows that the diverging fluctuations of the order parameter near the critical point are driven by a bifurcation in the underlying drift term, rather than increased stochastic forcing.


title: Learning Camera Localization via Dense Scene Matching

abstract: Camera localization aims to estimate 6 DoF camera poses from RGB images. Traditional methods detect and match interest points between a query image and a pre-built 3D model. Recent learning-based approaches encode scene structures into a specific convolutional neural network (CNN) and thus are able to predict dense coordinates from RGB images. However, most of them require re-training or re-adaption for a new scene and have difficulties in handling large-scale scenes due to limited network capacity. We present a new method for scene agnostic camera localization using dense scene matching (DSM), where a cost volume is constructed between a query image and a scene. The cost volume and the corresponding coordinates are processed by a CNN to predict dense coordinates. Camera poses can then be solved by PnP algorithms. In addition, our method can be extended to temporal domain, which leads to extra performance boost during testing time. Our scene-agnostic approach achieves comparable accuracy as the existing scene-specific approaches, such as KFNet, on the 7scenes and Cambridge benchmark. This approach also remarkably outperforms state-of-the-art scene-agnostic dense coordinate regression network SANet. The Code is available at https://github.com/Tangshitao/Dense-Scene-Matching.


title: Changing Accretion Geometry of Seyfert 1 Mrk 335 with {\it NuSTAR}: A Comparative Study

abstract: We present a detailed spectral study of the narrow-line Seyfert~1 galaxy, Markarian~335, using eight epoch observations made between 2013 and 2020 with the Nuclear Spectroscopic Telescope Array. The source was variable during this period both in spectral flux and flow geometry. We estimated the height of the Compton cloud from the model fitted parameters for the whole observation period. This allowed us to investigate the underlying physical processes that drive the variability in X-rays. Our model fitted mass varies in a narrow range, between $(2.44\pm0.45-3.04\pm0.56)\times10^{7}M_\odot$, however, given the large error bars, it is consistent with being constant and is in agreement with that known from optical reverberation mapping observations. The disk mass accretion rate reached a maximum of 10\% of the Eddington rate during June 2013. Our study sheds light on mass outflows from the system and also compares different aspects of accretion with X-ray binaries.


title: Solar Gamma Ray Constraints on Dark Matter Annihilation to Secluded Mediators

abstract: We consider the indirect detection of dark matter that is captured in the Sun and subsequently annihilates to long-lived dark mediators. If these mediators escape the Sun before decaying, they can produce striking gamma ray signals, either via the decay of the mediators directly to photons, or via bremsstrahlung and hadronization of the mediator decay products. Using recent measurements from the HAWC Observatory, we determine model-independent limits on heavy dark matter that are orders of magnitude more powerful than direct detection experiments, for both spin-dependent and spin-independent scattering. We also consider a well-motivated model in which fermionic dark matter annihilates to dark photons. For such a realistic scenario, the strength of the solar gamma ray constraints are reduced, compared to the idealistic case, because the dark matter capture cross section and mediator lifetime are related. Nonetheless, solar gamma ray constraints enable us to exclude a previously unconstrained region of dark photon parameter space.


title: Multi-Class Multi-Instance Count Conditioned Adversarial Image Generation

abstract: Image generation has rapidly evolved in recent years. Modern architectures for adversarial training allow to generate even high resolution images with remarkable quality. At the same time, more and more effort is dedicated towards controlling the content of generated images. In this paper, we take one further step in this direction and propose a conditional generative adversarial network (GAN) that generates images with a defined number of objects from given classes. This entails two fundamental abilities (1) being able to generate high-quality images given a complex constraint and (2) being able to count object instances per class in a given image. Our proposed model modularly extends the successful StyleGAN2 architecture with a count-based conditioning as well as with a regression sub-network to count the number of generated objects per class during training. In experiments on three different datasets, we show that the proposed model learns to generate images according to the given multiple-class count condition even in the presence of complex backgrounds. In particular, we propose a new dataset, CityCount, which is derived from the Cityscapes street scenes dataset, to evaluate our approach in a challenging and practically relevant scenario.


title: Ising formulations for two-dimensional cutting stock problem with setup cost

abstract: We proposed the method that translates the 2-D CSP for minimizing the number of cuts to the Ising model. After that, we conducted computer experiments of the proposed model using the benchmark problem. From the above, the following results are obtained. (1) The proposed Ising model adequately represents the target problem. (2) Acceptance rates were low as 0.2% to 9.8% and from 21.8% to 49.4%. (3) Error rates from optimal solution were broad as 0% to 25.9%. As the future work, (1) Improve the Hamiltonian for Constraints. (2) Improve the proposed model to adjust more complex 2-D CSP and reduce the number of spins when it deals with large materials and components. (3) Conduct experiments using a quantum annealer.


title: Optimized quantum f-divergences

abstract: The quantum relative entropy is a measure of the distinguishability of two quantum states, and it is a unifying concept in quantum information theory: many information measures such as entropy, conditional entropy, mutual information, and entanglement measures can be realized from it. As such, there has been broad interest in generalizing the notion to further understand its most basic properties, one of which is the data processing inequality. The quantum f-divergence of Petz is one generalization of the quantum relative entropy, and it also leads to other relative entropies, such as the Petz--Renyi relative entropies. In this contribution, I introduce the optimized quantum f-divergence as a related generalization of quantum relative entropy. I prove that it satisfies the data processing inequality, and the method of proof relies upon the operator Jensen inequality, similar to Petz's original approach. Interestingly, the sandwiched Renyi relative entropies are particular examples of the optimized f-divergence. Thus, one benefit of this approach is that there is now a single, unified approach for establishing the data processing inequality for both the Petz--Renyi and sandwiched Renyi relative entropies, for the full range of parameters for which it is known to hold.


title: Quasi-one-dimensional uniform spin-$\frac{1}{2}$ Heisenberg antiferromagnet KNaCuP$_2$O$_7$ probed by $^{31}$P and $^{23}$Na NMR

abstract: We present the structural and magnetic properties of KNaCuP$_2$O$_7$ investigated via x-ray diffraction, magnetization, specific heat, and $^{31}$P NMR and $^{23}$Na NMR measurements and complementary electronic structure calculations. The temperature dependent magnetic susceptibility and $^{31}$P NMR shift could be modeled very well by the uniform spin-$1/2$ Heisenberg antiferromagnetic chain model with nearest-neighbour interaction $J/k_{\rm B}\simeq 58.7$ K. The corresponding mapping using first principles electronic structure calculations leads to $J^{\rm DFT}/k_{\rm B} \simeq 59$ K with negligibly small inter-chain couplings ($J^{\prime}/k_{\rm B}$, $J^{\prime \prime}/k_{\rm B} < 0.1$ K), further confirming that the system is indeed an one-dimensional uniform spin-$1/2$ Heisenberg antiferromagnet. The temperature-dependent unit cell volume could be described well using the Debye approximation with a Debye temperature of $\Theta_{\rm D} \simeq 294$ K, consistent with the heat capacity data. The diverging trend of the NMR spin-lattice relaxation rates ($^{31}1/T_1$ and $^{23}1/T_1$) imply the onset of a magnetic long-range-ordering at very low temperatures supporting the anticipated $T_{\rm N} \simeq 0.38$ K from the inter-chain couplings. Moreover, the NMR spin-lattice relaxation rates show the dominant contributions from uniform ($q=0$) and staggered ($q = \pm \pi/a$) spin fluctuations in the high and low temperature regimes, respectively mimicking one-dimensionality of the spin-lattice. We have also demonstrated that $^{31}1/T_1$ in high temperatures varies linearly with $1/\sqrt{H}$ reflecting the effect of spin diffusion on the dynamic susceptibility. Further, the inter-chain frustration also substantially impede the magnetic ordering rendering the spin-lattice a perfect one-dimensional uniform spin-$1/2$ Heisenberg antiferromagnet over a wide temperature range.


title: Quantum analog of resource theory of stinginess

abstract: We present a resource theory of stinginess, first in a classical scenario, and then, point to a possible quantum version of the same.


title: Optimal Retirement Time and Consumption with the Variation in Habitual Persistence

abstract: In this paper,we study the individual's optimal retirement time and optimal consumption under habitual persistence. Because the individual feels equally satisfied with a lower habitual level and is more reluctant to change the habitual level after retirement, we assume that both the level and the sensitivity of the habitual consumption decline at the time of retirement. We establish the concise form of the habitual evolutions, and obtain the optimal retirement time and consumption policy based on martingale and duality methods. The optimal consumption experiences a sharp decline at retirement, but the excess consumption raises because of the reduced sensitivity of the habitual level. This result contributes to explain the "retirement consumption puzzle". Particularly, the optimal retirement and consumption policies are balanced between the wealth effect and the habitual effect. Larger wealth increases consumption, and larger growth inertia (sensitivity) of the habitual level decreases consumption and brings forward the retirement time.


title: Joint Khmer Word Segmentation and Part-of-Speech Tagging Using Deep Learning

abstract: Khmer text is written from left to right with optional space. Space is not served as a word boundary but instead, it is used for readability or other functional purposes. Word segmentation is a prior step for downstream tasks such as part-of-speech (POS) tagging and thus, the robustness of POS tagging highly depends on word segmentation. The conventional Khmer POS tagging is a two-stage process that begins with word segmentation and then actual tagging of each word, afterward. In this work, a joint word segmentation and POS tagging approach using a single deep learning model is proposed so that word segmentation and POS tagging can be performed spontaneously. The proposed model was trained and tested using the publicly available Khmer POS dataset. The validation suggested that the performance of the joint model is on par with the conventional two-stage POS tagging.


title: Optimal sensor and actuator placement for feedback control of vortex shedding

abstract: We consider linear feedback control of the two-dimensional flow past a cylinder at low Reynolds numbers, with a particular focus on the optimal placement of a single sensor and a single actuator. To accommodate the high dimensionality of the flow we compute its leading resolvent forcing and response modes to enable the design of H2-optimal estimators and controllers. We then investigate three control problems: i) optimal estimation (OE) in which we measure the flow at a single location and estimate the entire flow; ii) full-state information control (FIC) in which we measure the entire flow but actuate at only one location; and iii) the overall feedback control problem in which a single sensor is available for measurement and a single actuator is available for control. We characterize the performance of these control arrangements over a range of sensor and actuator placements and discuss implications for effective feedback control when using a single sensor and a single actuator. The optimal sensor and actuator placements found for the OE and FIC problems are also compared to those found for the overall feedback control problem over a range of Reynolds numbers. This comparison reveals the key factors and conflicting trade-offs that limit feedback control performance.


title: Localization-delocalization effects of a delocalizing dissipation on disordered XXZ spin chains

abstract: The interplay between interaction, disorder, and dissipation has shown a rich phenomenology. Here we investigate a disordered XXZ spin chain in contact with a bath which, alone, would drive the system towards a highly delocalized and coherent Dicke state. We show that there exist regimes for which the natural orbitals of the single-particle density matrix of the steady state are all localized in the presence of strong disorders, either for weak interaction or strong interaction. We show that the averaged steady-state occupation in the eigenbasis of the open system Hamiltonian could follow an exponential decay for intermediate disorder strength in the presence of weak interactions, while it is more evenly spread for strong disorder or for stronger interactions. Last, we show that strong dissipation increases the coherence of the steady states, thus reducing the signatures of localization. We capture such signatures of localization also with a concatenated inverse participation ratio which simultaneously takes into account how localized are the eigenstates of the Hamiltonian, and how close is the steady state to an incoherent mixture of different energy eigenstates.


title: TS-RIR: Translated synthetic room impulse responses for speech augmentation

abstract: We present a method for improving the quality of synthetic room impulse responses for far-field speech recognition. We bridge the gap between the fidelity of synthetic room impulse responses (RIRs) and the real room impulse responses using our novel, TS-RIRGAN architecture. Given a synthetic RIR in the form of raw audio, we use TS-RIRGAN to translate it into a real RIR. We also perform real-world sub-band room equalization on the translated synthetic RIR. Our overall approach improves the quality of synthetic RIRs by compensating low-frequency wave effects, similar to those in real RIRs. We evaluate the performance of improved synthetic RIRs on a far-field speech dataset augmented by convolving the LibriSpeech clean speech dataset [1] with RIRs and adding background noise. We show that far-field speech augmented using our improved synthetic RIRs reduces the word error rate by up to 19.9% in Kaldi far-field automatic speech recognition benchmark [2].


title: Convergence rate for homogenization of a nonlocal model with oscillating coefficients

abstract: This letter deals with homogenization of a nonlocal model with Levy-type operator of rapidly oscillating coefficients. This nonlocal model describes mean residence time and other escape phenomena for stochastic dynamical systems with non-Gaussian Levy noise. We derive an effective model with a specific convergence rate. This enables efficient analysis and simulation of escape phenomena under non-Gaussian fluctuations.


title: Self-Regression Learning for Blind Hyperspectral Image Fusion Without Label

abstract: Hyperspectral image fusion (HIF) is critical to a wide range of applications in remote sensing and many computer vision applications. Most traditional HIF methods assume that the observation model is predefined or known. However, in real applications, the observation model involved are often complicated and unknown, which leads to the serious performance drop of many advanced HIF methods. Also, deep learning methods can achieve outstanding performance, but they generally require a large number of image pairs for model training, which are difficult to obtain in realistic scenarios. Towards these issues, we proposed a self-regression learning method that alternatively reconstructs hyperspectral image (HSI) and estimate the observation model. In particular, we adopt an invertible neural network (INN) for restoring the HSI, and two fully-connected network (FCN) for estimating the observation model. Moreover, \emph{SoftMax} nonlinearity is applied to the FCN for satisfying the non-negative, sparsity and equality constraints. Besides, we proposed a local consistency loss function to constrain the observation model by exploring domain specific knowledge. Finally, we proposed an angular loss function to improve spectral reconstruction accuracy. Extensive experiments on both synthetic and real-world dataset show that our model can outperform the state-of-the-art methods


title: Learning and Exploring Motor Skills with Spacetime Bounds

abstract: Equipping characters with diverse motor skills is the current bottleneck of physics-based character animation. We propose a Deep Reinforcement Learning (DRL) framework that enables physics-based characters to learn and explore motor skills from reference motions. The key insight is to use loose space-time constraints, termed spacetime bounds, to limit the search space in an early termination fashion. As we only rely on the reference to specify loose spacetime bounds, our learning is more robust with respect to low quality references. Moreover, spacetime bounds are hard constraints that improve learning of challenging motion segments, which can be ignored by imitation-only learning. We compare our method with state-of-the-art tracking-based DRL methods. We also show how to guide style exploration within the proposed framework


title: Self-Supervised Euphemism Detection and Identification for Content Moderation

abstract: Fringe groups and organizations have a long history of using euphemisms--ordinary-sounding words with a secret meaning--to conceal what they are discussing. Nowadays, one common use of euphemisms is to evade content moderation policies enforced by social media platforms. Existing tools for enforcing policy automatically rely on keyword searches for words on a "ban list", but these are notoriously imprecise: even when limited to swearwords, they can still cause embarrassing false positives. When a commonly used ordinary word acquires a euphemistic meaning, adding it to a keyword-based ban list is hopeless: consider "pot" (storage container or marijuana?) or "heater" (household appliance or firearm?) The current generation of social media companies instead hire staff to check posts manually, but this is expensive, inhumane, and not much more effective. It is usually apparent to a human moderator that a word is being used euphemistically, but they may not know what the secret meaning is, and therefore whether the message violates policy. Also, when a euphemism is banned, the group that used it need only invent another one, leaving moderators one step behind. This paper will demonstrate unsupervised algorithms that, by analyzing words in their sentence-level context, can both detect words being used euphemistically, and identify the secret meaning of each word. Compared to the existing state of the art, which uses context-free word embeddings, our algorithm for detecting euphemisms achieves 30-400% higher detection accuracies of unlabeled euphemisms in a text corpus. Our algorithm for revealing euphemistic meanings of words is the first of its kind, as far as we are aware. In the arms race between content moderators and policy evaders, our algorithms may help shift the balance in the direction of the moderators.


title: Limited Data Emotional Voice Conversion Leveraging Text-to-Speech: Two-stage Sequence-to-Sequence Training

abstract: Emotional voice conversion (EVC) aims to change the emotional state of an utterance while preserving the linguistic content and speaker identity. In this paper, we propose a novel 2-stage training strategy for sequence-to-sequence emotional voice conversion with a limited amount of emotional speech data. We note that the proposed EVC framework leverages text-to-speech (TTS) as they share a common goal that is to generate high-quality expressive voice. In stage 1, we perform style initialization with a multi-speaker TTS corpus, to disentangle speaking style and linguistic content. In stage 2, we perform emotion training with a limited amount of emotional speech data, to learn how to disentangle emotional style and linguistic information from the speech. The proposed framework can perform both spectrum and prosody conversion and achieves significant improvement over the state-of-the-art baselines in both objective and subjective evaluation.


title: An Expectation-Maximization Algorithm for Continuous-time Hidden Markov Models

abstract: We propose a unified framework that extends the inference methods for classical hidden Markov models to continuous settings, where both the hidden states and observations occur in continuous time. Two different settings are analyzed: hidden jump process with a finite state space, and hidden diffusion process with a continuous state space. For each setting, we first estimate the hidden states given the observations and model parameters, showing that the posterior distribution of the hidden states can be described by differential equations in continuous time. We then consider the estimation of unknown model parameters, deriving the continuous-time formulas for the expectation-maximization algorithm. We also propose a Monte Carlo method based on the continuous formulation, sampling the posterior distribution of the hidden states and updating the parameter estimation.


title: A Generalization of a Theorem of Rothschild and van Lint

abstract: A classical result of Rothschild and van Lint asserts that if every non-zero Fourier coefficient of a Boolean function $f$ over $\mathbb{F}_2^{n}$ has the same absolute value, namely $|\hat{f}(\alpha)|=1/2^k$ for every $\alpha$ in the Fourier support of $f$, then $f$ must be the indicator function of some affine subspace of dimension $n-k$. In this paper we slightly generalize their result. Our main result shows that, roughly speaking, Boolean functions whose Fourier coefficients take values in the set $\{-2/2^k, -1/2^k, 0, 1/2^k, 2/2^k\}$ are indicator functions of two disjoint affine subspaces of dimension $n-k$ or four disjoint affine subspace of dimension $n-k-1$. Our main technical tools are results from additive combinatorics which offer tight bounds on the affine span size of a subset of $\mathbb{F}_2^{n}$ when the doubling constant of the subset is small.


title: Descending Predictive Feedback: From Optimal Control to the Sensorimotor System

abstract: Descending predictive feedback (DPF) is an ubiquitous yet unexplained phenomenon in the central nervous system. Motivated by recent observations on motor-related signals in the visual system, we approach this problem from a sensorimotor standpoint and make use of optimal controllers to explain DPF. We define and analyze DPF in the optimal control context, revisiting several control problems (state feedback, full control, and output feedback) to explore conditions that necessitate DPF. We find that even small deviations from the unconstrained state feedback problem (e.g. incomplete sensing, communication delay) necessitate DPF in the optimal controller. We also discuss parallels between controller structure and observations from neuroscience. In particular, the system level (SLS) controller displays DPF patterns compatible with predictive coding theory and easily accommodates signaling restrictions (e.g. delay) typical to neurons, making it a candidate for use in sensorimotor modeling.


title: Cooperator driven oscillation in a time-delayed feedback-evolving game

abstract: Considering feedback of collective actions of cooperation on common resources has vital importance to reach sustainability. But such efforts may have not immediate consequence on the state of environment and it is unclear how they influence the strategic and environmental dynamics with feedbacks. To address this issue, we construct a feedback-evolving game model in which we consider the growth capacity of resources and the punishment efficiency on defectors who do not provide returns to the environment. Importantly, we further assume a delay in adopting the contribution of cooperative individuals to environmental change in our model. We find that when this contribution amount from cooperators' endowment is fixed, the time delay has no particular consequence on the coevolutionary dynamics. However, when the return is proportional to their endowment, then the time delay can induce periodic oscillatory dynamics of cooperation level and environment. Our work reveals the potential effects of time delay of cooperative actions on the coevolutionary dynamics in strategic interactions with environmental feedback.


title: Novel Outage-Aware NOMA Protocol for Secrecy Fairness Maximization Among Untrusted Users

abstract: Observing the significance of spectrally-efficient secure non-orthogonal multiple access (NOMA), this paper proposes a novel quality of service (QoS) aware secure NOMA protocol that maximizes secrecy fairness among untrusted users. Considering a base station (BS) and two users, a novel decoding order is designed that provides security to both users. With the objective of ensuring secrecy fairness between users, while satisfying their QoS requirements under BS transmit power budget constraint, we explore the problem of minimizing the maximum secrecy outage probability (SOP). Closed-form expression of pair outage probability (POP) and optimal power allocation (PA) minimizing POP are obtained. To analyze secrecy performance, analytical expressions of SOP for both users are derived, and individual SOP minimization problems are solved using concept of generalized-convexity. High signal-to-noise ratio approximation of SOP and asymptotically optimized solution minimizing this approximation is also found. Furthermore, a global-optimal solution from secrecy fairness standpoint is obtained at low computational complexity, and tight approximation is derived to get analytical insights. Numerical results present useful insights on globally optimized PA which ensure secrecy fairness and provide performance gain of about 55.12%, 69.30%, and 19.11%, respectively, compared to fixed PA and individual users' optimal PAs. Finally, a tradeoff between secrecy fairness performance and QoS demands is presented.


title: Beta-decay formulas revisited (I): Gamow--Teller and spin-dipole contributions to allowed and first-forbidden transitions

abstract: We propose formulas of the nuclear beta-decay rate that are useful in a practical calculation. The decay rate is determined by the product of the lepton and hadron current densities. A widely used formula relies upon the fact that the low-energy lepton wave functions in a nucleus can be well approximated by a constant and linear to the radius for the $s$-wave and $p$-wave wave functions, respectively. We find, however, the deviation from such a simple approximation is evident for heavy nuclei with large $Z$ by numerically solving the Dirac equation. In our proposed formulas, the neutrino wave function is treated exactly as a plane wave, while the electron wave function is obtained by iteratively solving the integral equation, thus we can control the uncertainty of the approximate wave function. The leading-order approximation gives a formula equivalent to the conventional one and overestimates the decay rate. We demonstrate that the next-to-leading-order formula reproduces well the exact result for a schematic transition density as well as a microscopic one obtained by a nuclear energy-density functional method.


title: QUEST: Queue Simulation for Content Moderation at Scale

abstract: Moderating content in social media platforms is a formidable challenge due to the unprecedented scale of such systems, which typically handle billions of posts per day. Some of the largest platforms such as Facebook blend machine learning with manual review of platform content by thousands of reviewers. Operating a large-scale human review system poses interesting and challenging methodological questions that can be addressed with operations research techniques. We investigate the problem of optimally operating such a review system at scale using ideas from queueing theory and simulation.


title: Learning Generalizable Robotic Reward Functions from "In-The-Wild" Human Videos

abstract: We are motivated by the goal of generalist robots that can complete a wide range of tasks across many environments. Critical to this is the robot's ability to acquire some metric of task success or reward, which is necessary for reinforcement learning, planning, or knowing when to ask for help. For a general-purpose robot operating in the real world, this reward function must also be able to generalize broadly across environments, tasks, and objects, while depending only on on-board sensor observations (e.g. RGB images). While deep learning on large and diverse datasets has shown promise as a path towards such generalization in computer vision and natural language, collecting high quality datasets of robotic interaction at scale remains an open challenge. In contrast, "in-the-wild" videos of humans (e.g. YouTube) contain an extensive collection of people doing interesting tasks across a diverse range of settings. In this work, we propose a simple approach, Domain-agnostic Video Discriminator (DVD), that learns multitask reward functions by training a discriminator to classify whether two videos are performing the same task, and can generalize by virtue of learning from a small amount of robot data with a broad dataset of human videos. We find that by leveraging diverse human datasets, this reward function (a) can generalize zero shot to unseen environments, (b) generalize zero shot to unseen tasks, and (c) can be combined with visual model predictive control to solve robotic manipulation tasks on a real WidowX200 robot in an unseen environment from a single human demo.


title: Optical response properties of hybrid electro-opto-mechanical system interacting with a qubit

abstract: We investigate the optical response of a hybrid electro-optomechanical system interacting with a qubit. In our experimentally feasible system, tunable all-optical-switching, double-optomechanically induced transparency (OMIT) and optomechanically induced absorption (OMIA) can be realized. The proposed system is also shown to generate anomalous dispersion. Based on our theoretical results, we provide a tunable switch between OMIT and OMIA of the probe field by manipulating the relevant system parameters. Also, the normal-mode-splitting (NMS) effect induced by the interactions between the subsystems are discussed in detail and the effects of varying the interactions on the NMS are clarified. These rich optical properties of the probe field may provide a promising platform for controllable all-optical-switch and various other quantum photonic devices.


title: Comparing the Inner and Outer Star Forming Complexes in the Nearby Spiral Galaxies NGC 628, NGC 5457 and NGC 6946 using UVIT Observations

abstract: We present a far-UV (FUV) study of the star-forming complexes (SFCs) in three nearby galaxies using the Ultraviolet Imaging Telescope (UVIT). The galaxies are close to face-on and show significant outer disk star formation. Two of them are isolated (NGC 628, NGC 6946), and one is interacting with distant companions (NGC 5457). We compared the properties of the SFCs inside and outside the optical radius (R$_{25}$). We estimated the sizes, star formation rates (SFRs), metallicities, and the Toomre Q parameter of the SFCs. We find that the outer disk SFCs are at least ten times smaller in area than those in the inner disk. The SFR per unit area ($\Sigma_{SFR}$) in both regions have similar mean values, but the outer SFCs have a much smaller range of $\Sigma_{SFR}$. They are also metal-poor compared to the inner disk SFCs. The FUV emission is well correlated with the neutral hydrogen gas (\HI) distribution and is detected within and near several \HI~holes. Our estimation of the Q parameter in the outer disks of the two isolated galaxies suggests that their outer disks are stable (Q$>$1). However, their FUV images indicate that there is ongoing star formation in these regions. This suggests that there may be some non-luminous mass or dark matter in their outer disks, which increases the disk surface density and supports the formation of local gravitational instabilities. In the interacting galaxy, NGC 5457, the baryonic surface density is sufficient (Q$<$1) to trigger local disk instabilities in the outer disk.


title: Can the center lane really have advantages for swimmers?

abstract: In swimming competitions, the center lane is considered to be the best lane. The main objective of this study is to discuss the validity of the assertion, "good swimmers should be placed in the center lanes because these lanes has advantage." This study extracts the (positive) lane bias in the center lanes from many records utilizing statistical hypothesis tests. The data is collected from nationwide competitions of Japan over 10 years. The data set contains more than 5900 swimmers and 56000 records. No significant evidence was obtained on the lane advantage of the center lanes.


title: Superdiffusion of Aerosols Emitted After Sneezing -- Nonequilibrium Statistical Mechanics Approach

abstract: We study a stochastic behavior of aerosols by the non-equilibrium statistical mechanics approach using the analytical approach of the Langevin equation. We firstly show that superdiffusion can possibly occur right after the emission, which may be attributed to the physical mechanism of the outbreak of the COVID-19 pandemic. We also provide clear evidence of the least required distance to prevent infections occurred by aerosols. In particular, the required distance to prevent aerosol infections is derived to be about 42 m when we assume Cauchy distribution as an initial velocity distribution. This fact implies that due to superdiffusion the aerosol infection can occur even far away from a long distance as compared to the previous considerations.


title: The RS CVn type star GT Mus shows most energetic X-ray flares throughout the 2010s

abstract: We report that the RS CVn-type star GT Mus (HR 4492, HD 101379 + HD 101380) was the most active star in the X-ray sky in the last decade in terms of the scale of recurrent energetic flares. We detected 11 flares from GT Mus in 8 yr of observations with Monitor of All-sky X-ray Image (MAXI) from 2009 August to 2017 August. The detected flare peak luminosities were 1-4 $\times$ 10$^{33}$ erg s$^{-1}$ in the 2.0-20.0 keV band for its distance of 109.6 pc. Our timing analysis showed long durations ($\tau_{\rm r} + \tau_{\rm d}$) of 2-6 days with long decay times ($\tau_{\rm d}$) of 1-4 days. The released energies during the decay phases of the flares in the 0.1-100 keV band ranged 1-11 $\times$ 10$^{38}$ erg, which are at the upper end of the observed stellar flare. The released energies during whole duration time ranged 2-13 $\times$ 10$^{38}$ erg in the same band. We carried out X-ray follow-up observations for one of the 11 flares with Neutron star Interior Composition Explorer (NICER) on 2017 July 18 and found that the flare cooled quasi-statically. On the basis of a quasi-static cooling model, the flare loop length is derived to be 4 $\times$ 10$^{12}$ cm (or 60 R$_{\odot}$). The electron density is derived to be 1 $\times$ 10$^{10}$ cm$^{-3}$, which is consistent with the typical value of solar and stellar flares (10$^{10-13}$ cm$^{-3}$). The ratio of the cooling timescales between radiative cooling ($\tau_{\rm rad}$) and conductive cooling ($\tau_{\rm cond}$) is estimated to be $\tau_{\rm rad}$ $\sim$ 0.1$\tau_{\rm cond}$ from the temperature; thus radiative cooling was dominant in this flare.


title: Double forms: Regular elliptic bilaplacian operators

abstract: Double forms are sections of the vector bundles $\Lambda^{k}T^*\mathcal{M}\otimes \Lambda^{m}T^*\mathcal{M}$, where in this work $(\mathcal{M},\mathfrak{g})$ is a compact Riemannian manifold with boundary. We study graded second-order differential operators on double forms, which are used in physical applications. A Combination of these operators yields a fourth-order operator, which we call a double bilaplacian. We establish the regular ellipticity of the double bilaplacian for several sets of boundary conditions. Under additional conditions, we obtain a Hodge-like decomposition for double forms, whose components are images of the second-order operators, along with a biharmonic element. This analysis lays foundations for resolving several topics in incompatible elasticity, most prominently the existence of stress potentials and Saint-Venant compatibility.


title: On the Impulsive Heating of Quiet Solar Corona

abstract: The solar corona consists of a million-degree Kelvin plasma. A complete understanding of this phenomenon demands the study of Quiet Sun (QS) regions. In this work, we study QS regions in the 171 {\AA}, 193 {\AA} and 211 {\AA} passbands of the Atmospheric Imaging Assembly (AIA) on board the Solar Dynamics Observatory (SDO), by combining the empirical impulsive heating forward model of Pauluhn & Solanki (2007) with a machine-learning inversion model that allows uncertainty quantification. We find that there are {\approx} 2--3 impulsive events per min, with a lifetime of about 10--20 min. Moreover, for all the three passbands, the distribution of power law slope {\alpha} peaks above 2. Our exploration of correlations among the frequency of impulsive events and their timescales and peak energy suggests that conduction losses dominate over radiative cooling losses. All these finding suggest that impulsive heating is a viable heating mechanism in QS corona.


title: A multi-component Fermi surface in the vortex state of an underdoped high-Tc superconductor

abstract: In order to understand the origin of superconductivity, it is crucial to ascertain the nature and origin of the primary carriers available to participate in pairing. Recent quantum oscillation experiments on high Tc cuprate superconductors have revealed the existence of a Fermi surface akin to normal metals, comprising fermionic carriers that undergo orbital quantization. However, the unexpectedly small size of the observed carrier pocket leaves open a variety of possibilities as to the existence or form of any underlying magnetic order, and its relation to d-wave superconductivity. Here we present quantum oscillations in the magnetisation (the de Haas-van Alphen or dHvA effect) observed in superconducting YBa2Cu3O6.51 that reveal more than one carrier pocket. In particular, we find evidence for the existence of a much larger pocket of heavier mass carriers playing a thermodynamically dominant role in this hole-doped superconductor. Importantly, characteristics of the multiple pockets within this more complete Fermi surface impose constraints on the wavevector of any underlying order and the location of the carriers in momentum space. These constraints enable us to construct a possible density-wave scenario with spiral or related modulated magnetic order, consistent with experimental observations.


title: Radial stellar populations of AGN-host dwarf galaxies in SDSS-IV MaNGA survey

abstract: Based on MaNGA integral field unit (IFU) spectroscopy we search 60 AGN candidates, which have stellar masses $M_{\star}\leqslant5\times10^{9}$$M_{\odot}$ and show AGN ionization signatures in the BPT diagram. For these AGN candidates, we derive the spatially resolved stellar population with the stellar population synthesis code STARLIGHT and measure the gradients of the mean stellar age and metallicity. We find that the gradients of mean stellar age (metallicity) of individual AGN-host dwarfs are diverse in 0-0.5 Re, 0.5-1 Re and 0-1 Re. However, the overall behavior of the mean stellar age (metallicity) profiles tend to be flat, as the median values of the gradients are close to zero. We further study the overall behavior of the mean stellar age (metallicity) by plotting the co-added radial profiles for the AGN sample and compare with a control sample with similar stellar mass. We find that the median values of light-weighted mean stellar ages of AGN sample are as old as 2-3 ~Gyr within 2 Re,which are about 4-7 times older than those of the control sample. Meanwhile, most of the AGN candidates are low-level AGNs, as only eight sources have L[OIII]>$10^{39.5}$~erg~s$^{-1}$. Hence, the AGNs in dwarf galaxies might accelerate the evolution of galaxies by accelerating the consumption of the gas, resulting in an overall quenching of the dwarf galaxies, and the AGNs also become weak due to the lack of gas. The median values of mass-weighted mean stellar age of both samples within 2 $Re$ are similar and as old as about 10~Gyr, indicating that the stellar mass is mainly contributed by old stellar populations.The gradients of co-added mean stellar metallicity for both samples tend to be negative but close to zero, and the similar mean stellar metallicity profiles for both samples indicate that the chemical evolution of the host galaxy is not strongly influenced by the AGN.


title: Integer-only Zero-shot Quantization for Efficient Speech Recognition

abstract: End-to-end neural network models achieve improved performance on various automatic speech recognition (ASR) tasks. However, these models perform poorly on edge hardware due to large memory and computation requirements. While quantizing model weights and/or activations to low-precision can be a promising solution, previous research on quantizing ASR models is limited. In particular, the previous approaches use floating-point arithmetic during inference and thus they cannot fully exploit efficient integer processing units. Moreover, they require training and/or validation data during quantization, which may not be available due to security or privacy concerns. To address these limitations, we propose an integer-only, zero-shot quantization scheme for ASR models. In particular, we generate synthetic data whose runtime statistics resemble the real data, and we use it to calibrate models during quantization. We apply our method to quantize QuartzNet, Jasper, and Conformer and show negligible WER degradation as compared to the full-precision baseline models, even without using any data. Moreover, we achieve up to 2.35x speedup on a T4 GPU and 4x compression rate, with a modest WER degradation of <1% with INT8 quantization.


title: Spatial Content Alignment For Pose Transfer

abstract: Due to unreliable geometric matching and content misalignment, most conventional pose transfer algorithms fail to generate fine-trained person images. In this paper, we propose a novel framework Spatial Content Alignment GAN (SCAGAN) which aims to enhance the content consistency of garment textures and the details of human characteristics. We first alleviate the spatial misalignment by transferring the edge content to the target pose in advance. Secondly, we introduce a new Content-Style DeBlk which can progressively synthesize photo-realistic person images based on the appearance features of the source image, the target pose heatmap and the prior transferred content in edge domain. We compare the proposed framework with several state-of-the-art methods to show its superiority in quantitative and qualitative analysis. Moreover, detailed ablation study results demonstrate the efficacy of our contributions. Codes are publicly available at github.com/rocketappslab/SCA-GAN.


title: Graph-Based Topological Exploration Planning in Large-Scale 3D Environments

abstract: Currently, state-of-the-art exploration methods maintain high-resolution map representations in order to optimize exploration goals in each step that maximizes information gain. However, during exploring, those "optimal" selections could quickly become obsolete due to the influx of new information, especially in large-scale environments, and result in high-frequency re-planning that hinders the overall exploration efficiency. In this paper, we propose a graph-based topological planning framework, building a sparse topological map in three-dimensional (3D) space to guide exploration steps with high-level intents so as to render consistent exploration maneuvers. Specifically, this work presents a novel method to estimate 3D space's geometry with convex polyhedrons. Then, the geometry information is utilized to group space into distinctive regions. And those regions are added as nodes into the topological map, directing the exploration process. We compared our method with the state-of-the-art in simulated environments. The proposed method achieves higher space coverage and outperforms exploration efficiency by more than 40% during experiments. Finally, a field experiment was conducted to further evaluate the applicability of our method to empower efficient and robust exploration in real-world environments.


title: Experimental study on controlled production of two-electron temperature plasma

abstract: A two-electron temperature plasma is produced by the method of diffusion of two different plasmas with distinct temperatures and densities. The method is simple and provides an adequate control over the plasma parameters. The study reveals that the temperature and density of both the electron groups can be effectively controlled by just changing the discharge currents of both the plasmas. An ion-acoustic (IA) wave is excited in the plasma and is detected using a planar Langmuir probe. The damped amplitude of the wave is measured and is used as a diagnostic tool for establishing the presence of two-electron components. This production method can be helpful in controlling the hot electron density and temperature in plasma processing industries.


title: Convolutional Hough Matching Networks

abstract: Despite advances in feature representation, leveraging geometric relations is crucial for establishing reliable visual correspondences under large variations of images. In this work we introduce a Hough transform perspective on convolutional matching and propose an effective geometric matching algorithm, dubbed Convolutional Hough Matching (CHM). The method distributes similarities of candidate matches over a geometric transformation space and evaluate them in a convolutional manner. We cast it into a trainable neural layer with a semi-isotropic high-dimensional kernel, which learns non-rigid matching with a small number of interpretable parameters. To validate the effect, we develop the neural network with CHM layers that perform convolutional matching in the space of translation and scaling. Our method sets a new state of the art on standard benchmarks for semantic visual correspondence, proving its strong robustness to challenging intra-class variations.


title: Online Learning of a Probabilistic and Adaptive Scene Representation

abstract: Constructing and maintaining a consistent scene model on-the-fly is the core task for online spatial perception, interpretation, and action. In this paper, we represent the scene with a Bayesian nonparametric mixture model, seamlessly describing per-point occupancy status with a continuous probability density function. Instead of following the conventional data fusion paradigm, we address the problem of online learning the process how sequential point cloud data are generated from the scene geometry. An incremental and parallel inference is performed to update the parameter space in real-time. We experimentally show that the proposed representation achieves state-of-the-art accuracy with promising efficiency. The consistent probabilistic formulation assures a generative model that is adaptive to different sensor characteristics, and the model complexity can be dynamically adjusted on-the-fly according to different data scales.


title: A categorical framework for congruence of applicative bisimilarity in higher-order languages

abstract: Applicative bisimilarity is a coinductive characterisation of observational equivalence in call-by-name lambda-calculus, introduced by Abramsky (1990). Howe (1996) gave a direct proof that it is a congruence, and generalised the result to all languages complying with a suitable format. We propose a categorical framework for specifying operational semantics, in which we prove that (an abstract analogue of) applicative bisimilarity is automatically a congruence. Example instances include standard applicative bisimilarity in call-by-name, call-by-value, and call-by-name non-deterministic $\lambda$-calculus, and more generally all languages complying with a variant of Howe's format.