title: Structure, magnetism and electronic properties in 3$d$-5$d$ based double perovskite (Sr$_{1-x}$Ca$_x$)$_2$FeIrO$_6$ (0 $\leq$ $x$ $\leq$ 1): A combined experimental and theoretical investigation

abstract: The 3$d$-5$d$ based double perovskites offer an ideal playground to study the interplay between electron correlation ($U$) and spin-orbit coupling (SOC) effect, showing exotic physics. The Sr$_2$FeIrO$_6$ is an interesting member in this family with ionic distribution of Fe$^{3+}$ (3$d^5$) and Ir$^{5+}$ (5$d^4$) where the later is believed to be nonmagnetic under the picture of strong SOC. Here, we report detailed investigation of structural, magnetic and electronic transport properties along with electronic structure calculations in (Sr$_{1-x}$Ca$_x$)$_2$FeIrO$_6$ series with $x$ from 0 to 1. While the basic interactions such as, $U$ and SOC are unlikely to be modified but a structural modification is expected due to ionic size difference between Sr$^{2+}$ and Ca$^{2+}$ which would influence other properties such as crystal field effect and band widths. While a nonmonotonic changes in lattice parameters are observed across the series, the spectroscopic investigations reveal that 3+/5+ charge state of Fe/Ir continue till end of the series. An analysis of magnetic data suggests similar nonmonotonic evolution of magnetic parameters with doping. Temperature dependent crystal structure as well as low temperature (5 K) magnetic structure have been determined from neutron powder diffraction measurements. The whole series shows insulating behavior. The electronic structure calculations show, SOC enhanced, a noncollinear antiferromagnetic and Mott-type insulating state is the stable ground state for present series with a substantial amount of orbital moment, but less than the spin magnetic moment, at the Ir site and the magnetocrystalline anisotropy. The obtained results imply that the Ca$^{2+}$ has large influence on the magnetic and transport properties, further showing a large agreement between experimental results as well as theoretical calculations.


title: Predicting human decision making in psychological tasks with recurrent neural networks

abstract: Unlike traditional time series, the action sequences of human decision making usually involve many cognitive processes such as beliefs, desires, intentions, and theory of mind, i.e., what others are thinking. This makes predicting human decision-making challenging to be treated agnostically to the underlying psychological mechanisms. We propose here to use a recurrent neural network architecture based on long short-term memory networks (LSTM) to predict the time series of the actions taken by human subjects engaged in gaming activity, the first application of such methods in this research domain. In this study, we collate the human data from 8 published literature of the Iterated Prisoner's Dilemma comprising 168,386 individual decisions and post-process them into 8,257 behavioral trajectories of 9 actions each for both players. Similarly, we collate 617 trajectories of 95 actions from 10 different published studies of Iowa Gambling Task experiments with healthy human subjects. We train our prediction networks on the behavioral data and demonstrate a clear advantage over the state-of-the-art methods in predicting human decision-making trajectories in both the single-agent scenario of the Iowa Gambling Task and the multi-agent scenario of the Iterated Prisoner's Dilemma. Moreover, we observe that the weights of the LSTM networks modeling the top performers tend to have a wider distribution compared to poor performers, as well as a larger bias, which suggest possible interpretations for the distribution of strategies adopted by each group.


title: Thermal stability and Thermal conductivity of pillared black phosphorene hybrid nanostructures:A molecular dynamics Study

abstract: In this study, a newly pillared black phosphorene hybrid nanostructures (PBP) is constructed with its thermal stability as well as thermal conductivity are studied by performing equilibrium molecular dynamics simulation (EMD). The results show that the curvature of the nanotube and the intense thermal vibration of the atoms are responsible for the failure of PBP at finite temperature simultaneously. The calculation of normalized HCACF and running thermal conductivities (RTC) as a function of correlation time demonstrate that thermal conductivities decreases with the temperature significantly, which is attributed by phonon coupling and scattering from phonon spectrum analyzing. Our result indicates that the thermal conductance of pillared black phosphorene is comparatively low as to that of pillared graphene, black phosphorous, and black phosphorus nanotubes, which may be promising for applications of some specific low dimensional nanostructure based thermal and nanoelectronic devices.


title: Maximum Mean Discrepancy Test is Aware of Adversarial Attacks

abstract: The maximum mean discrepancy (MMD) test could in principle detect any distributional discrepancy between two datasets. However, it has been shown that the MMD test is unaware of adversarial attacks -- the MMD test failed to detect the discrepancy between natural and adversarial data. Given this phenomenon, we raise a question: are natural and adversarial data really from different distributions? The answer is affirmative -- the previous use of the MMD test on the purpose missed three key factors, and accordingly, we propose three components. Firstly, the Gaussian kernel has limited representation power, and we replace it with an effective deep kernel. Secondly, the test power of the MMD test was neglected, and we maximize it following asymptotic statistics. Finally, adversarial data may be non-independent, and we overcome this issue with the wild bootstrap. By taking care of the three factors, we verify that the MMD test is aware of adversarial attacks, which lights up a novel road for adversarial data detection based on two-sample tests.


title: Rank-structured QR for Chebyshev rootfinding

abstract: We consider the computation of roots of polynomials expressed in the Chebyshev basis. We extend the QR iteration presented in [Eidelman, Y., Gemignani, L., and Gohberg, I., Numer. Algorithms, 47.3 (2008): pp. 253-273] introducing an aggressive early deflation strategy, and showing that the rank-structure allows to parallelize the algorithm avoiding data dependencies which would be present in the unstructured QR. We exploit the particular structure of the colleague linearization to achieve quadratic complexity and linear storage requirements. The (unbalanced) QR iteration used for Chebyshev rootfinding does not guarantee backward stability on the polynomial coefficients, unless the vector of coefficients satisfy $\|p\| \approx 1$, an hypothesis which is almost never verified for polynomials approximating smooth functions. Even though the presented method is mathematically equivalent to the unbalanced QR algorithm, we show that exploiting the rank structure allows to guarantee a small backward error on the polynomial, up to an explicitly computable amplification factor $\hat\gamma_1(p)$, which depends on the polynomial under consideration. We show that this parameter is almost always of moderate size, making the method accurate on several numerical tests, in contrast with what happens in the unstructured unbalanced QR.


title: Positive definiteness of the asymptotic covariance matrix of OLS estimators in parsimonious regressions

abstract: Recently, Ghysels, Hill, and Motegi (2020) proposed a test for examining whether a large number of coefficients in linear regression models is zero. The test is called the max test. The test statistic is calculated by first running multiple ordinary least squares (OLS) regressions, each including only one of key regressors, whose coefficients are supposed to be zero under the null, and then taking the maximum value of the squared OLS coefficient estimates of those key regressors. They called these regressions parsimonious regressions. This paper answers a question raised in their Remark 2.4; whether the asymptotic covariance matrix of the OLS estimators in the parsimonious regressions is generally positive definite. The paper shows that it is generally positive definite, and the result may be utilized to facilitate the calculation of the simulated p value necessary for implementing the max test.


title: Rethinking pooling in graph neural networks

abstract: Graph pooling is a central component of a myriad of graph neural network (GNN) architectures. As an inheritance from traditional CNNs, most approaches formulate graph pooling as a cluster assignment problem, extending the idea of local patches in regular grids to graphs. Despite the wide adherence to this design choice, no work has rigorously evaluated its influence on the success of GNNs. In this paper, we build upon representative GNNs and introduce variants that challenge the need for locality-preserving representations, either using randomization or clustering on the complement graph. Strikingly, our experiments demonstrate that using these variants does not result in any decrease in performance. To understand this phenomenon, we study the interplay between convolutional layers and the subsequent pooling ones. We show that the convolutions play a leading role in the learned representations. In contrast to the common belief, local pooling is not responsible for the success of GNNs on relevant and widely-used benchmarks.


title: Basket Recommendation with Multi-Intent Translation Graph Neural Network

abstract: The problem of basket recommendation~(BR) is to recommend a ranking list of items to the current basket. Existing methods solve this problem by assuming the items within the same basket are correlated by one semantic relation, thus optimizing the item embeddings. However, this assumption breaks when there exist multiple intents within a basket. For example, assuming a basket contains \{\textit{bread, cereal, yogurt, soap, detergent}\} where \{\textit{bread, cereal, yogurt}\} are correlated through the "breakfast" intent, while \{\textit{soap, detergent}\} are of "cleaning" intent, ignoring multiple relations among the items spoils the ability of the model to learn the embeddings. To resolve this issue, it is required to discover the intents within the basket. However, retrieving a multi-intent pattern is rather challenging, as intents are latent within the basket. Additionally, intents within the basket may also be correlated. Moreover, discovering a multi-intent pattern requires modeling high-order interactions, as the intents across different baskets are also correlated. To this end, we propose a new framework named as \textbf{M}ulti-\textbf{I}ntent \textbf{T}ranslation \textbf{G}raph \textbf{N}eural \textbf{N}etwork~({\textbf{MITGNN}}). MITGNN models $T$ intents as tail entities translated from one corresponding basket embedding via $T$ relation vectors. The relation vectors are learned through multi-head aggregators to handle user and item information. Additionally, MITGNN propagates multiple intents across our defined basket graph to learn the embeddings of users and items by aggregating neighbors. Extensive experiments on two real-world datasets prove the effectiveness of our proposed model on both transductive and inductive BR. The code is available online at https://github.com/JimLiu96/MITGNN.


title: Deterministic Approximation for Submodular Maximization over a Matroid in Nearly Linear Time

abstract: We study the problem of maximizing a non-monotone, non-negative submodular function subject to a matroid constraint. The prior best-known deterministic approximation ratio for this problem is $\frac{1}{4}-\epsilon$ under $\mathcal{O}(({n^4}/{\epsilon})\log n)$ time complexity. We show that this deterministic ratio can be improved to $\frac{1}{4}$ under $\mathcal{O}(nr)$ time complexity, and then present a more practical algorithm dubbed TwinGreedyFast which achieves $\frac{1}{4}-\epsilon$ deterministic ratio in nearly-linear running time of $\mathcal{O}(\frac{n}{\epsilon}\log\frac{r}{\epsilon})$. Our approach is based on a novel algorithmic framework of simultaneously constructing two candidate solution sets through greedy search, which enables us to get improved performance bounds by fully exploiting the properties of independence systems. As a byproduct of this framework, we also show that TwinGreedyFast achieves $\frac{1}{2p+2}-\epsilon$ deterministic ratio under a $p$-set system constraint with the same time complexity. To showcase the practicality of our approach, we empirically evaluated the performance of TwinGreedyFast on two network applications, and observed that it outperforms the state-of-the-art deterministic and randomized algorithms with efficient implementations for our problem.


title: Pool-based sequential active learning with multi kernels

abstract: We study a pool-based sequential active learning (AL), in which one sample is queried at each time from a large pool of unlabeled data according to a selection criterion. For this framework, we propose two selection criteria, named expected-kernel-discrepancy (EKD) and expected-kernel-loss (EKL), by leveraging the particular structure of multiple kernel learning (MKL). Also, it is identified that the proposed EKD and EKL successfully generalize the concepts of popular query-by-committee (QBC) and expected-model-change (EMC), respectively. Via experimental results with real-data sets, we verify the effectiveness of the proposed criteria compared with the existing methods.


title: Learning Loss for Test-Time Augmentation

abstract: Data augmentation has been actively studied for robust neural networks. Most of the recent data augmentation methods focus on augmenting datasets during the training phase. At the testing phase, simple transformations are still widely used for test-time augmentation. This paper proposes a novel instance-level test-time augmentation that efficiently selects suitable transformations for a test input. Our proposed method involves an auxiliary module to predict the loss of each possible transformation given the input. Then, the transformations having lower predicted losses are applied to the input. The network obtains the results by averaging the prediction results of augmented inputs. Experimental results on several image classification benchmarks show that the proposed instance-aware test-time augmentation improves the model's robustness against various corruptions.


title: DeepCSR: A 3D Deep Learning Approach for Cortical Surface Reconstruction

abstract: The study of neurodegenerative diseases relies on the reconstruction and analysis of the brain cortex from magnetic resonance imaging (MRI). Traditional frameworks for this task like FreeSurfer demand lengthy runtimes, while its accelerated variant FastSurfer still relies on a voxel-wise segmentation which is limited by its resolution to capture narrow continuous objects as cortical surfaces. Having these limitations in mind, we propose DeepCSR, a 3D deep learning framework for cortical surface reconstruction from MRI. Towards this end, we train a neural network model with hypercolumn features to predict implicit surface representations for points in a brain template space. After training, the cortical surface at a desired level of detail is obtained by evaluating surface representations at specific coordinates, and subsequently applying a topology correction algorithm and an isosurface extraction method. Thanks to the continuous nature of this approach and the efficacy of its hypercolumn features scheme, DeepCSR efficiently reconstructs cortical surfaces at high resolution capturing fine details in the cortical folding. Moreover, DeepCSR is as accurate, more precise, and faster than the widely used FreeSurfer toolbox and its deep learning powered variant FastSurfer on reconstructing cortical surfaces from MRI which should facilitate large-scale medical studies and new healthcare applications.


title: Chiral channel network from magnetization textures in 2D MnBi2Te4

abstract: When atomically thin van der Waals (vdW) magnet forms long-period moir\'e pattern with a magnetic substrate, the sensitive dependence of interlayer magnetic coupling on the atomic registries can lead to moir\'e defined magnetization textures in the two-dimensional (2D) magnets. The recent discovery of 2D magnetic topological insulators such as MnBi2Te4 leads to the interesting possibility to explore the interplay of such magnetization textures with the topological surface states, which we explore here with a minimal model established for 2D MnBi2Te4. The sign flip of the exchange gap across a magnetization domain wall gives rise to a single in-gap chiral channel on each surface. In the periodic magnetization textures, such chiral spin channels at the domain walls couple to form a network and superlattice minibands emerge. We find that in magnetization textures with closed domain wall geometries, the formed superlattice miniband is a gapped Dirac cone featuring orbital magnetization from the current circulation in the close loops of chiral channels, while in magnetization textures with open domain wall geometries, gapless mini-Dirac cone is found instead. The miniband Bloch states feature a spatial texture of spin and local current density, which are clear manifestation of the spin-momentum locked chiral channels at the domain walls. The results suggest a new platform to engineer spin and current flows through the manipulation of magnetization domains for spintronic devices.


title: Differentially-Private Federated Linear Bandits

abstract: The rapid proliferation of decentralized learning systems mandates the need for differentially-private cooperative learning. In this paper, we study this in context of the contextual linear bandit: we consider a collection of agents cooperating to solve a common contextual bandit, while ensuring that their communication remains private. For this problem, we devise \textsc{FedUCB}, a multiagent private algorithm for both centralized and decentralized (peer-to-peer) federated learning. We provide a rigorous technical analysis of its utility in terms of regret, improving several results in cooperative bandit learning, and provide rigorous privacy guarantees as well. Our algorithms provide competitive performance both in terms of pseudoregret bounds and empirical benchmark performance in various multi-agent settings.


title: Efficient Scale-Permuted Backbone with Learned Resource Distribution

abstract: Recently, SpineNet has demonstrated promising results on object detection and image classification over ResNet model. However, it is unclear if the improvement adds up when combining scale-permuted backbone with advanced efficient operations and compound scaling. Furthermore, SpineNet is built with a uniform resource distribution over operations. While this strategy seems to be prevalent for scale-decreased models, it may not be an optimal design for scale-permuted models. In this work, we propose a simple technique to combine efficient operations and compound scaling with a previously learned scale-permuted architecture. We demonstrate the efficiency of scale-permuted model can be further improved by learning a resource distribution over the entire network. The resulting efficient scale-permuted models outperform state-of-the-art EfficientNet-based models on object detection and achieve competitive performance on image classification and semantic segmentation. Code and models will be open-sourced soon.


title: High-efficiency arbitrary quantum operation on a high-dimensional quantum system

abstract: The ability to manipulate quantum systems lies at the heart of the development of quantum technology. The ultimate goal of quantum control is to realize arbitrary quantum operations (AQuOs) for all possible open quantum system dynamics. However, the demanding extra physical resources impose great obstacles. Here, we experimentally demonstrate a universal approach of AQuO on a photonic qudit with minimum physical resource of a two-level ancilla and a $\log_{2}d$-scale circuit depth for a $d$-dimensional system. The AQuO is then applied in quantum trajectory simulation for quantum subspace stabilization and quantum Zeno dynamics, as well as incoherent manipulation and generalized measurements of the qudit. Therefore, the demonstrated AQuO for complete quantum control would play an indispensable role in quantum information science.


title: Confidence Estimation for Attention-based Sequence-to-sequence Models for Speech Recognition

abstract: For various speech-related tasks, confidence scores from a speech recogniser are a useful measure to assess the quality of transcriptions. In traditional hidden Markov model-based automatic speech recognition (ASR) systems, confidence scores can be reliably obtained from word posteriors in decoding lattices. However, for an ASR system with an auto-regressive decoder, such as an attention-based sequence-to-sequence model, computing word posteriors is difficult. An obvious alternative is to use the decoder softmax probability as the model confidence. In this paper, we first examine how some commonly used regularisation methods influence the softmax-based confidence scores and study the overconfident behaviour of end-to-end models. Then we propose a lightweight and effective approach named confidence estimation module (CEM) on top of an existing end-to-end ASR model. Experiments on LibriSpeech show that CEM can mitigate the overconfidence problem and can produce more reliable confidence scores with and without shallow fusion of a language model. Further analysis shows that CEM generalises well to speech from a moderately mismatched domain and can potentially improve downstream tasks such as semi-supervised learning.


title: An efficient spectral-Galerkin method for fractional reaction-diffusion equations in unbounded domains

abstract: In this work, we apply a fast and accurate numerical method for solving fractional reaction-diffusion equations in unbounded domains. By using the Fourier-like spectral approach in space, this method can effectively handle the fractional Laplace operator, leading to a fully diagonal representation of the fractional Laplacian. To fully discretize the underlying nonlinear reaction-diffusion systems, we propose to use an accurate time marching scheme based on ETDRK4. Numerical examples are presented to illustrate the effectiveness of the proposed method.


title: Self-training and Pre-training are Complementary for Speech Recognition

abstract: Self-training and unsupervised pre-training have emerged as effective approaches to improve speech recognition systems using unlabeled data. However, it is not clear whether they learn similar patterns or if they can be effectively combined. In this paper, we show that pseudo-labeling and pre-training with wav2vec 2.0 are complementary in a variety of labeled data setups. Using just 10 minutes of labeled data from Libri-light as well as 53k hours of unlabeled data from LibriVox achieves WERs of 3.0%/5.2% on the clean and other test sets of Librispeech - rivaling the best published systems trained on 960 hours of labeled data only a year ago. Training on all labeled data of Librispeech achieves WERs of 1.5%/3.1%.


title: Entanglement of assistance in three-qubit systems

abstract: The entanglement of assistance quantifies the amount of entanglement that can be concentrated among a group of spatially-separated parties using the assistance of some auxiliary system. In this paper we study the entanglement of assistance in the simplest scenario of three qubits. We consider how much entanglement is lost when the helper party becomes uncoupled by local measurement and classical communication. For three-qubit pure states, it is found that lossless decoupling is always possible when entanglement is quantified by the maximum probability of locally generating a Bell state. However, with respect to most other entanglement measures, such as concurrence and entanglement entropy, a lossless decoupling of the helper is possible only for a special family of states that we fully characterize.


title: Strong Mg II and Fe II Absorbers at 2.2 < z < 6.0

abstract: We present a study of strong intervening absorption systems in the near-IR spectra of 31 luminous quasars at $z>5.7$. The quasar spectra were obtained with {\it Gemini} GNIRS that provide continuous wavelength coverage from $\sim$0.9 to $\sim$2.5 $\mu$m. We detect 32 strong Mg II doublet absorbers with rest-frame equivalent width $W_r$ ($\lambda2796$) $>1.0$ \AA at $2.2 < z < 6.0$. Each Mg II absorber is confirmed by at least two associated Fe II absorption lines in the rest-frame wavelength range of $\sim 1600-2600$ \AA. We find that the comoving line density ($dN/dX$) of the strong Fe II-bearing Mg II absorbers decreases towards higher redshift at $z>3$, consistent with previous studies. Compared with strong Mg II absorbers detected in damped Ly$\alpha$ systems at 2 $<z<$ 4, our absorbers are potentially less saturated and show much larger rest-frame velocity widths. This suggests that the gas traced by our absorbers are potentially affected by galactic superwinds. We analyze the {\it Hubble Space Telescope} near-IR images of the quasars and identify possible associated galaxies for our strong absorbers. There are a maximum of two galaxy candidates found within 5" radius of each absorber. The median F105W-band magnitude of these galaxy candidates is 24.8 mag, which is fainter than the $L^*$ galaxy luminosity at $z\sim$ 4. By using our observed $dN/dX$ of strong Mg II absorbers and galaxy candidates median luminosity, we suggest that at high redshift, strong Mg II absorbers tend to have a more disturbed environment but smaller halo size than that at $z <$ 1.


title: Unsupervised Representation Learning for Speaker Recognition via Contrastive Equilibrium Learning

abstract: In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing the uniformity loss. Also, to preserve speaker discriminability, a contrastive similarity loss function is used together. Experimental results showed that the proposed CEL significantly outperforms the state-of-the-art unsupervised speaker verification systems and the best performing model achieved 8.01% and 4.01% EER on VoxCeleb1 and VOiCES evaluation sets, respectively. On top of that, the performance of the supervised speaker embedding networks trained with initial parameters pre-trained via CEL showed better performance than those trained with randomly initialized parameters.


title: Localization for affine $W$-algebras

abstract: We prove a localization theorem for affine $W$-algebras in the spirit of Beilinson--Bernstein and Kashiwara--Tanisaki. More precisely, for any non-critical regular weight $\lambda$, we identify $\lambda$-monodromic Whittaker $D$-modules on the enhanced affine flag variety with a full subcategory of Category $\mathscr{O}$ for the $W$-algebra. To identify the essential image of our functor, we provide a new realization of Category $\mathscr{O}$ for affine $W$-algebras using Iwahori--Whittaker modules for the corresponding Kac--Moody algebra. Using these methods, we also obtain a new proof of Arakawa's character formulae for simple positive energy representations of the $W$-algebra.


title: Doppler Boosting of the S-stars in the Galactic Center

abstract: Astrometry and spectroscopy of the S-stars in the Galactic Center provide a unique way to probe the properties of the central supermassive black hole, as well as the post-Newtonian effects caused by its gravity, e.g. gravitational redshift and general relativistic precession. It has also been suggested that the photometry of S-stars can be used for studying the properties of gaseous environment of Sgr A$^*$. Due to the high velocities of the S-stars, sometimes approaching $~0.1c$, their photometric signal should be considerably affected by the Doppler boosting. We calculate this relativistic effect for several S-stars closely approaching the central black hole (most of them recently announced) and show that the amplitude of the photometric variability due to the Doppler boosting for some of them (S62 and S4714) exceeds $6\%$; for the well studied star S2 it is about $2\%$. Measurement of the Doppler boosting can confirm the existence and help refine orbital parameters of the S-stars with noisy spectroscopy and astrometry. This effect should be explicitly accounted for when the photometry of S-stars is used for probing the medium around the Sgr A$^*$. We discuss the observability of the Doppler boosting given the complications typical for the Galactic Center and conclude, in particular, that the purely photometric detection of the higher order relativistic corrections to the Doppler boosting signal (due to the gravitational redshift and transverse Doppler shift, which we also calculate) is hardly possible for the S-stars.


title: Density-independent plasmons for terahertz-stable topological metamaterials

abstract: To efficiently integrate cutting-edge terahertz technology into compact devices, the highly confined terahertz plasmons are attracting intensive attentions. Compared to plasmons at visible frequencies in metals, terahertz plasmons, typically in lightly doped semiconductors or graphene, are sensitive to carrier density (n) and thus have an easy tunability, which, however, leads to unstable or imprecise terahertz spectra. By deriving a simplified but universal form of plasmon frequencies, here we reveal a unified mechanism for generating unusual n-independent plasmons (DIPs) in all topological states with different dimensions. Remarkably, we predict that terahertz DIPs can be excited in 2D nodal-line and 1D nodal-point systems, confirmed by the first-principles calculations on almost all existing topological semimetals with diverse lattice symmetries. Besides of n independence, the feature of Fermi-velocity and degeneracy-factor dependences in DIPs can be applied to design topological superlattice and multi-walled carbon nanotube metamaterials for broadband terahertz spectroscopy and quantized terahertz plasmons, respectively. Surprisingly, high spatial confinement and quality factor, also insensitive to n, can be simultaneously achieved in these terahertz DIPs. Our findings pave the way to developing topological plasmonic devices for stable terahertz applications.


title: Task-Adaptive Feature Transformer for Few-Shot Segmentation

abstract: Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a learnable module for few-shot segmentation, the task-adaptive feature transformer (TAFT). TAFT linearly transforms task-specific high-level features to a set of task-agnostic features well-suited to the segmentation job. Using this task-conditioned feature transformation, the model is shown to effectively utilize the semantic information in novel classes to generate tight segmentation masks. The proposed TAFT module can be easily plugged into existing semantic segmentation algorithms to achieve few-shot segmentation capability with only a few added parameters. We combine TAFT with Deeplab V3+, a well-known segmentation architecture; experiments on the PASCAL-$5^i$ dataset confirm that this combination successfully adds few-shot learning capability to the segmentation algorithm, achieving the state-of-the-art few-shot segmentation performance in some key representative cases.


title: GAN based Unsupervised Segmentation: Should We Match the Exact Number of Objects

abstract: The unsupervised segmentation is an increasingly popular topic in biomedical image analysis. The basic idea is to approach the supervised segmentation task as an unsupervised synthesis problem, where the intensity images can be transferred to the annotation domain using cycle-consistent adversarial learning. The previous studies have shown that the macro-level (global distribution level) matching on the number of the objects (e.g., cells, tissues, protrusions etc.) between two domains resulted in better segmentation performance. However, no prior studies have exploited whether the unsupervised segmentation performance would be further improved when matching the exact number of objects at micro-level (mini-batch level). In this paper, we propose a deep learning based unsupervised segmentation method for segmenting highly overlapped and dynamic sub-cellular microvilli. With this challenging task, both micro-level and macro-level matching strategies were evaluated. To match the number of objects at the micro-level, the novel fluorescence-based micro-level matching approach was presented. From the experimental results, the micro-level matching did not improve the segmentation performance, compared with the simpler macro-level matching.


title: Parallel Tacotron: Non-Autoregressive and Controllable TTS

abstract: Although neural end-to-end text-to-speech models can synthesize highly natural speech, there is still room for improvements to its efficiency and naturalness. This paper proposes a non-autoregressive neural text-to-speech model augmented with a variational autoencoder-based residual encoder. This model, called \emph{Parallel Tacotron}, is highly parallelizable during both training and inference, allowing efficient synthesis on modern parallel hardware. The use of the variational autoencoder relaxes the one-to-many mapping nature of the text-to-speech problem and improves naturalness. To further improve the naturalness, we use lightweight convolutions, which can efficiently capture local contexts, and introduce an iterative spectrogram loss inspired by iterative refinement. Experimental results show that Parallel Tacotron matches a strong autoregressive baseline in subjective evaluations with significantly decreased inference time.


title: Vertex deletion into bipartite permutation graphs

abstract: A permutation graph can be defined as an intersection graph of segments whose endpoints lie on two parallel lines $l_1$ and $l_2$, one on each. A bipartite permutation graph is a permutation graph which is bipartite. In this paper we study the parameterized complexity of the bipartite permutation vertex deletion problem, which asks, for a given n-vertex graph, whether we can remove at most k vertices to obtain a bipartite permutation graph. This problem is NP-complete by the classical result of Lewis and Yannakakis. We analyze the structure of the so-called almost bipartite permutation graphs which may contain holes (large induced cycles) in contrast to bipartite permutation graphs. We exploit the structural properties of the shortest hole in a such graph. We use it to obtain an algorithm for the bipartite permutation vertex deletion problem with running time $O(9^k\cdot n^9)$, and also give a polynomial-time 9-approximation algorithm.


title: Fusing Keys for Secret Communications: Towards Information-Theoretic Security

abstract: Modern cryptography is essential to communication and information security for performing all kinds of security actions, such as encryption, authentication, and signature. However, the exposure possibility of keys poses a great threat to almost all modern cryptography. This article proposes a key-fusing framework, which enables a high resilience to key exposure by fusing multiple imperfect keys. The correctness of the scheme is strictly verified through a toy model that is general enough to abstract the physical-layer key generation (PLKG) mechanisms. Analysis and results demonstrate that the proposed scheme can dramatically reduce secret outage probability, so that key sources with even high exposure probability can be practically beneficial for actual secret communication. Our framework paves the way for achieving information-theoretic security by integrating various key sources, such as physical layer key generation, lattice-based cryptography, and quantum cryptography.


title: Lattice Diversities

abstract: Diversities are a generalization of metric spaces, where instead of the non-negative function being defined on pairs of points, it is defined on arbitrary finite sets of points. Diversities have a well-developed theory. This includes the concept of a diversity tight span that extends the metric tight span in a natural way. Here we explore the generalization of diversities to lattices. Instead of defining diversities on finite subsets of a set we consider diversities defined on members of an arbitrary lattice (with a 0). We show that many of the basic properties of diversities continue to hold. However, the natural map from a lattice diversity to its tight span is not a lattice homomorphism, preventing the development of a complete tight span theory as in the metric and diversity cases.


title: Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online Algorithms

abstract: We study the problem of improving the performance of online algorithms by incorporating machine-learned predictions. The goal is to design algorithms that are both consistent and robust, meaning that the algorithm performs well when predictions are accurate and maintains worst-case guarantees. Such algorithms have been studied in a recent line of works due to Lykouris and Vassilvitskii (ICML '18) and Purohit et al (NeurIPS '18). They provide robustness-consistency trade-offs for a variety of online problems. However, they leave open the question of whether these trade-offs are tight, i.e., to what extent to such trade-offs are necessary. In this paper, we provide the first set of non-trivial lower bounds for competitive analysis using machine-learned predictions. We focus on the classic problems of ski-rental and non-clairvoyant scheduling and provide optimal trade-offs in various settings.


title: Statistical Properties of a Modified Welch Method That Uses Sample Percentiles

abstract: We present and analyze an alternative, more robust approach to the Welch's overlapped segment averaging (WOSA) spectral estimator. Our method computes sample percentiles instead of averaging over multiple periodograms to estimate power spectral densities (PSDs). Bias and variance of the proposed estimator are derived for varying sample sizes and arbitrary percentiles. We have found excellent agreement between our expressions and data sampled from a white Gaussian noise process.


title: MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation

abstract: End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded approaches (ASR+MT) often suffer from error propagation in the pipeline. On the other hand, existing end-to-end solutions heavily depend on the source language transcriptions for pre-training or multi-task training with Automatic Speech Recognition (ASR). We instead propose a simple technique to learn a robust speech encoder in a self-supervised fashion only on the speech side, which can utilize speech data without transcription. This technique termed Masked Acoustic Modeling (MAM), not only provides an alternative solution to improving E2E-ST, but also can perform pre-training on any acoustic signals (including non-speech ones) without annotation. We conduct our experiments over 8 different translation directions. In the setting without using any transcriptions, our technique achieves an average improvement of +1.1 BLEU, and +2.3 BLEU with MAM pre-training. Pre-training of MAM with arbitrary acoustic signals also has an average improvement with +1.6 BLEU for those languages. Compared with ASR multi-task learning solution, which replies on transcription during training, our pre-trained MAM model, which does not use transcription, achieves similar accuracy.


title: Probabilistic Circuits for Variational Inference in Discrete Graphical Models

abstract: Inference in discrete graphical models with variational methods is difficult because of the inability to re-parameterize gradients of the Evidence Lower Bound (ELBO). Many sampling-based methods have been proposed for estimating these gradients, but they suffer from high bias or variance. In this paper, we propose a new approach that leverages the tractability of probabilistic circuit models, such as Sum Product Networks (SPN), to compute ELBO gradients exactly (without sampling) for a certain class of densities. In particular, we show that selective-SPNs are suitable as an expressive variational distribution, and prove that when the log-density of the target model is a polynomial the corresponding ELBO can be computed analytically. To scale to graphical models with thousands of variables, we develop an efficient and effective construction of selective-SPNs with size $O(kn)$, where $n$ is the number of variables and $k$ is an adjustable hyperparameter. We demonstrate our approach on three types of graphical models -- Ising models, Latent Dirichlet Allocation, and factor graphs from the UAI Inference Competition. Selective-SPNs give a better lower bound than mean-field and structured mean-field, and is competitive with approximations that do not provide a lower bound, such as Loopy Belief Propagation and Tree-Reweighted Belief Propagation. Our results show that probabilistic circuits are promising tools for variational inference in discrete graphical models as they combine tractability and expressivity.


title: Krylov Subspace Recycling for Evolving Structures

abstract: Krylov subspace recycling is a powerful tool for solving long series of large, sparse linear systems that change slowly. In PDE constrained shape optimization, these appear naturally, as hundreds or more optimization steps are needed with only small changes in the geometry. In this setting, however, applying Krylov subspace recycling can be difficult. As the geometry evolves, so does the finite element mesh, especially if re-meshing is needed. As a result, the number of algebraic degrees of freedom in the system may change from one optimization step to the next, and with it the size of the finite element system matrix. Changes in the mesh also lead to structural changes in the matrices. In the case of remeshing, even if the geometry changes only a little, the corresponding mesh might differ substantially from the previous one. This prevents any straightforward mapping of the approximate invariant subspace of the linear system matrix (the focus of recycling in this paper) from one step to the next; similar problems arise for other selected subspaces. We present an algorithm for general meshes to map an approximate invariant subspace of the system matrix for the previous optimization step to an approximate invariant subspace of the system matrix for the current optimization step. We exploit the map from coefficient vectors to finite element functions on the mesh combined with function approximation on the finite element mesh. In addition, we develop a straightforward warm-start adaptation of the Krylov-Schur algorithm [G.W. Stewart, SIAM J. Matrix Anal. Appl. 23, 2001] to improve the approximate invariant subspace at the start of a new optimization step if needed. We demonstrate the effectiveness of our approach numerically with several proof of concept studies for a specific meshing technique.


title: Parallel Algorithms and Heuristics for Efficient Computation of High-Order Line Graphs of Hypergraphs

abstract: This paper considers structures of systems beyond dyadic (pairwise) interactions and investigates mathematical modeling of multi-way interactions and connections as hypergraphs, where captured relationships among system entities are set-valued. To date, in most situations, entities in a hypergraph are considered connected as long as there is at least one common "neighbor". However, minimal commonality sometimes discards the "strength" of connections and interactions among groups. To this end, considering the "width" of a connection, referred to as the $s$-overlap of neighbors, provides more meaningful insights into how closely the communities or entities interact with each other. In addition, $s$-overlap computation is the fundamental kernel to construct the line graph of a hypergraph, a low-order approximation of the hypergraph which can carry significant information about the original hypergraph. Subsequent stages of a data analytics pipeline then can apply highly-tuned graph algorithms on the line graph to reveal important features. Given a hypergraph, computing the $s$-overlaps by exhaustively considering all pairwise entities can be computationally prohibitive. To tackle this challenge, we develop efficient algorithms to compute $s$-overlaps and the corresponding line graph of a hypergraph. We propose several heuristics to avoid execution of redundant work and improve performance of the $s$-overlap computation. Our parallel algorithm, combined with these heuristics, is orders of magnitude (more than $10\times$) faster than the naive algorithm in all cases and the SpGEMM algorithm with filtration in most cases (especially with large $s$ value).


title: PLSO: A generative framework for decomposing nonstationary time-series into piecewise stationary oscillatory components

abstract: To capture the slowly time-varying spectral content of real-world time-series, a common paradigm is to partition the data into approximately stationary intervals and perform inference in the time-frequency domain. However, this approach lacks a corresponding nonstationary time-domain generative model for the entire data and thus, time-domain inference occurs in each interval separately. This results in distortion/discontinuity around interval boundaries and can consequently lead to erroneous inferences based on any quantities derived from the posterior, such as the phase. To address these shortcomings, we propose the Piecewise Locally Stationary Oscillation (PLSO) model for decomposing time-series data with slowly time-varying spectra into several oscillatory, piecewise-stationary processes. PLSO, as a nonstationary time-domain generative model, enables inference on the entire time-series without boundary effects and simultaneously provides a characterization of its time-varying spectral properties. We also propose a novel two-stage inference algorithm that combines Kalman theory and an accelerated proximal gradient algorithm. We demonstrate these points through experiments on simulated data and real neural data from the rat and the human brain.


title: Optimal Approximation -- Smoothness Tradeoffs for Soft-Max Functions

abstract: A soft-max function has two main efficiency measures: (1) approximation - which corresponds to how well it approximates the maximum function, (2) smoothness - which shows how sensitive it is to changes of its input. Our goal is to identify the optimal approximation-smoothness tradeoffs for different measures of approximation and smoothness. This leads to novel soft-max functions, each of which is optimal for a different application. The most commonly used soft-max function, called exponential mechanism, has optimal tradeoff between approximation measured in terms of expected additive approximation and smoothness measured with respect to R\'enyi Divergence. We introduce a soft-max function, called "piecewise linear soft-max", with optimal tradeoff between approximation, measured in terms of worst-case additive approximation and smoothness, measured with respect to $\ell_q$-norm. The worst-case approximation guarantee of the piecewise linear mechanism enforces sparsity in the output of our soft-max function, a property that is known to be important in Machine Learning applications [Martins et al. '16, Laha et al. '18] and is not satisfied by the exponential mechanism. Moreover, the $\ell_q$-smoothness is suitable for applications in Mechanism Design and Game Theory where the piecewise linear mechanism outperforms the exponential mechanism. Finally, we investigate another soft-max function, called power mechanism, with optimal tradeoff between expected \textit{multiplicative} approximation and smoothness with respect to the R\'enyi Divergence, which provides improved theoretical and practical results in differentially private submodular optimization.


title: Defective Majorana zero modes in non-Hermitian Kitaev chain

abstract: Topological stability is an important property for topological materials. However, the non-Hermitian effects may change this situation. Here, we investigate the robustness of edge states in the non-Hermitian Kitaev chain with imbalanced tunneling term and superconducting pairing term. By defining the similarity of Majorana zero modes (MZMs) and magnetic factor, the coalescing phase diagram of the MZMs and corresponding spin polarization phase diagram are provided. Because of the non-Hermitian coalescence effect and non-Hermitian suppression effect induced by the breakdown of sublattice symmetry and particle-hole symmetry, the system emergence very interesting phenomenons, such as defective MZMs, number-anomalous bulk-boundary correspondence, coalescing of many-body ground states, the magnetic phase crossover without gap closing. Those novel non-Hermitian effects offer fresh insights into MZMs and topological physics.


title: Strong gravitational lensing in a spacetime with topological charge within the Eddington-inspired Born-Infeld gravity

abstract: In this work we calculate the angular deflection of light in the strong field limit in two spacetimes which were previously studied within the Eddington-inspired Born-Infeld gravity (EiBI), namely, a black hole and a wormhole, both with topological charge. We show that the presence of the parameters characterizing EiBI and the topological charge promote significant changes in the angular deflection of light with respect to that one obtained in Schwarzschild spacetime. Using the expression for angular deflection in the strong field limit, we calculate the position and magnification of the respective relativistic images.


title: Machine Learning-Based Early Detection of IoT Botnets Using Network-Edge Traffic

abstract: In this work, we present a lightweight IoT botnet detection solution, EDIMA, which is designed to be deployed at the edge gateway installed in home networks and targets early detection of botnets prior to the launch of an attack. EDIMA includes a novel two-stage Machine Learning (ML)-based detector developed specifically for IoT bot detection at the edge gateway. The ML-based bot detector first employs ML algorithms for aggregate traffic classification and subsequently Autocorrelation Function (ACF)-based tests to detect individual bots. The EDIMA architecture also comprises a malware traffic database, a policy engine, a feature extractor and a traffic parser. Performance evaluation results show that EDIMA achieves high bot scanning and bot-CnC traffic detection accuracies with very low false positive rates. The detection performance is also shown to be robust to an increase in the number of IoT devices connected to the edge gateway where EDIMA is deployed. Further, the runtime performance analysis of a Python implementation of EDIMA deployed on a Raspberry Pi reveals low bot detection delays and low RAM consumption. EDIMA is also shown to outperform existing detection techniques for bot scanning traffic and bot-CnC server communication.


title: Fast-HotStuff: A Fast and Resilient HotStuff Protocol

abstract: The HotStuff protocol is a breakthrough in Byzantine Fault Tolerant (BFT) consensus that enjoys both responsiveness and linear view change. It creatively adds an additional round to classic BFT protocols (like PBFT) using two rounds. This brings us to an interesting question: Is this additional round really necessary in practice? In this paper, we answer this question by designing a new two-round BFT protocol called Fast-HotStuff, which enjoys responsiveness and efficient view change that is comparable to linear view change in terms of performance. Compared to (three-round) HotStuff, Fast-HotStuff has lower latency and is more robust against performance attacks that HotStuff is susceptible to.


title: AstroSat Soft X-ray observations of the symbiotic recurrent nova V3890 Sgr during its 2019 outburst

abstract: Two long AstroSat Soft X-ray Telescope observations were taken of the third recorded outburst of the Symbiotic Recurrent Nova, V3890 Sgr. The first observing run, 8.1-9.9 days after the outburst, initially showed a stable intensity level with a hard X-ray spectrum that we attribute to shocks between the nova ejecta and the pre-existing stellar companion. On day 8.57, the first, weak, signs appeared of Super Soft Source (SSS) emission powered by residual burning on the surface of the White Dwarf. The SSS emission was observed to be highly variable on time scales of hours. After day 8.9, the SSS component was more stable and brighter. In the second observing run, on days 15.9-19.6 after the outburst, the SSS component was even brighter but still highly variable. The SSS emission was observed to fade significantly during days 16.8-17.8 followed by re-brightening. Meanwhile the shock component was stable leading to increase in hardness ratio during the period of fading. AstroSat and XMM-Newton observations have been used to study the spectral properties of V3890 Sgr to draw quantitative conclusions even if their drawback is model-dependence. We used the xspec to fit spectral models of plasma emission, and the best fits are consistent with the elemental abundances being lower during the second observing run compared to the first for spectra >1 keV. The SSS emission is well fit by non-local thermal equilibrium model atmosphere used for white dwarfs. The resulting spectral parameters, however, are subject to systematic uncertainties such as completeness of atomic data.


title: An Investigation of the Recoverable Robust Assignment Problem

abstract: We investigate the so-called recoverable robust assignment problem on balanced bipartite graphs with $2n$ vertices, a mainstream problem in robust optimization: For two given linear cost functions $c_1$ and $c_2$ on the edges and a given integer $k$, the goal is to find two perfect matchings $M_1$ and $M_2$ that minimize the objective value $c_1(M_1)+c_2(M_2)$, subject to the constraint that $M_1$ and $M_2$ have at least $k$ edges in common. We derive a variety of results on this problem. First, we show that the problem is W[1]-hard with respect to the parameter $k$, and also with respect to the recoverability parameter $k'=n-k$. This hardness result holds even in the highly restricted special case where both cost functions $c_1$ and $c_2$ only take the values $0$ and $1$. (On the other hand, containment of the problem in XP is straightforward to see.) Next, as a positive result we construct a polynomial time algorithm for the special case where one cost function is Monge, whereas the other one is Anti-Monge. Finally, we study the variant where matching $M_1$ is frozen, and where the optimization goal is to compute the best corresponding matching $M_2$, the second stage recoverable assignment problem. We show that this problem variant is contained in the randomized parallel complexity class $\text{RNC}_2$, and that it is at least as hard as the infamous problem \probl{Exact Matching in Red-Blue Bipartite Graphs} whose computational complexity is a long-standing open problem


title: Momentum Contrast Speaker Representation Learning

abstract: Unsupervised representation learning has shown remarkable achievement by reducing the performance gap with supervised feature learning, especially in the image domain. In this study, to extend the technique of unsupervised learning to the speech domain, we propose the Momentum Contrast for VoxCeleb (MoCoVox) as a form of learning mechanism. We pre-trained the MoCoVox on the VoxCeleb1 by implementing instance discrimination. Applying MoCoVox for speaker verification revealed that it outperforms the state-of-the-art metric learning-based approach by a large margin. We also empirically demonstrate the features of contrastive learning in the speech domain by analyzing the distribution of learned representations. Furthermore, we explored which pretext task is adequate for speaker verification. We expect that learning speaker representation without human supervision helps to address the open-set speaker recognition.


title: Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020

abstract: This paper describes the Microsoft speaker diarization system for monaural multi-talker recordings in the wild, evaluated at the diarization track of the VoxCeleb Speaker Recognition Challenge(VoxSRC) 2020. We will first explain our system design to address issues in handling real multi-talker recordings. We then present the details of the components, which include Res2Net-based speaker embedding extractor, conformer-based continuous speech separation with leakage filtering, and a modified DOVER (short for Diarization Output Voting Error Reduction) method for system fusion. We evaluate the systems with the data set provided by VoxSRCchallenge 2020, which contains real-life multi-talker audio collected from YouTube. Our best system achieves 3.71% and 6.23% of the diarization error rate (DER) on development set and evaluation set, respectively, being ranked the 1st at the diarization track of the challenge.


title: A Framework for Generative and Contrastive Learning of Audio Representations

abstract: In this paper, we present a framework for contrastive learning for audio representations, in a self supervised frame work without access to any ground truth labels. The core idea in self supervised contrastive learning is to map an audio signal and its various augmented versions (representative of salient aspects of audio like pitch, timbre etc.) to a space where they are close together, and are separated from other different signals. In addition we also explore generative models based on state of the art transformer based architectures for learning latent spaces for audio signals, without access to any labels. Here, we map audio signals on a smaller scale to discrete dictionary elements and train transformers to predict the next dictionary element. We only use data as a method of supervision, bypassing the need of labels needed to act as a supervision for training the deep neural networks. We then use a linear classifier head in order to evaluate the performance of our models, for both self supervised contrastive and generative transformer based representations that are learned. Our system achieves considerable performance, compared to a fully supervised method, with access to ground truth labels to train the neural network model. These representations, with avail-ability of large scale audio data show promise in various tasks for audio understanding tasks


title: Duration of exposure to inheritance law in India: Examining the heterogeneous effects on empowerment

abstract: Higher duration of programs that involve legal protection may entail gradual positive changes in social norms that can be leveraged by potential beneficiaries in their favor. This paper examines the heterogeneous impact of the duration of exposure to gender-neutral reforms in the inheritance law in India on two latent domains of women empowerment: intrinsic, which pertains to expansion of agency and instrumental which relates to ability to make decisions. The time lag between the year of the amendment in the respective states and the year of marriage generate exogenous variation in reform exposure across women. The findings indicate a significant non-linear increase in the instrumental as well as intrinsic empowerment. Importantly, improvements in education along with increase in the age of marriage and changes in family structure are found to be the potential channels that signal gradual relaxation of social norms and explain the higher returns to exposure on empowerment.


title: Selection of the optimal embedding positions of digital audio watermarking in wavelet domain

abstract: This work studied embedding positions of digital audio watermarking in wavelet domain, to make beginners understand the nature of watermarking in a short time. Based on the theory of wavelet transform, this paper analyzed statistical distributions of each level after transformation and the features of watermark embedded in different transform levels. Through comparison and analysis, we found that watermark was suitable for embedding into the coefficients of the first four levels of wavelet transform. In current state-of-art approaches, the embedding algorithms were always to replace the coefficient values of the embedded positions. In contrast this paper proposed an embedding algorithm of selfadaptive interpolation to achieve a better imperceptibility. In order to reduce the computational complexity, we took a pseudo random sequence with a length of 31 bits as the watermark. In the experiments, watermark was embedded in different locations, including different transform levels, high-frequency coefficients and low-frequency coefficients, high-energy regions and low-frequency regions. Results showed that the imperceptibility was better than traditional embedding algorithms. The bit error rates of the extracted watermark were calculated and we analyzed the robustness and fragility of each embedded signal. At last we concluded the best embedding positions of watermark for different applications and our future work.


title: Linear-Delay Enumeration for Minimal Steiner Problems

abstract: Kimelfeld and Sagiv [Kimelfeld and Sagiv, PODS 2006], [Kimelfeld and Sagiv, Inf. Syst. 2008] pointed out the problem of enumerating $K$-fragments is of great importance in a keyword search on data graphs. In a graph-theoretic term, the problem corresponds to enumerating minimal Steiner trees in (directed) graphs. In this paper, we propose a linear-delay and polynomial-space algorithm for enumerating all minimal Steiner trees, improving on a previous result in [Kimelfeld and Sagiv, Inf. Syst. 2008]. Our enumeration algorithm can be extended to other Steiner problems, such as minimal Steiner forests, minimal terminal Steiner trees, and minimal directed Steiner trees. As another variant of the minimal Steiner tree enumeration problem, we study the problem of enumerating minimal induced Steiner subgraphs. We propose a polynomial-delay and exponential-space enumeration algorithm of minimal induced Steiner subgraphs on claw-free graphs. Contrary to these tractable results, we show that the problem of enumerating minimal group Steiner trees is at least as hard as the minimal transversal enumeration problem on hypergraphs.


title: MixCon: Adjusting the Separability of Data Representations for Harder Data Recovery

abstract: To address the issue that deep neural networks (DNNs) are vulnerable to model inversion attacks, we design an objective function, which adjusts the separability of the hidden data representations, as a way to control the trade-off between data utility and vulnerability to inversion attacks. Our method is motivated by the theoretical insights of data separability in neural networking training and results on the hardness of model inversion. Empirically, by adjusting the separability of data representation, we show that there exist sweet-spots for data separability such that it is difficult to recover data during inference while maintaining data utility.


title: Fine-tuned Pre-trained Mask R-CNN Models for Surface Object Detection

abstract: This study evaluates road surface object detection tasks using four Mask R-CNN models as a pre-study of surface deterioration detection of stone-made archaeological objects. The models were pre-trained and fine-tuned by COCO datasets and 15,188 segmented road surface annotation tags. The quality of the models were measured using Average Precisions and Average Recalls. Result indicates substantial number of counts of false negatives, i.e. left detection and unclassified detections. A modified confusion matrix model to avoid prioritizing IoU is tested and there are notable true positive increases in bounding box detection, but almost no changes in segmentation masks.


title: Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphs

abstract: One of the fundamental problems in Artificial Intelligence is to perform complex multi-hop logical reasoning over the facts captured by a knowledge graph (KG). This problem is challenging, because KGs can be massive and incomplete. Recent approaches embed KG entities in a low dimensional space and then use these embeddings to find the answer entities. However, it has been an outstanding challenge of how to handle arbitrary first-order logic (FOL) queries as present methods are limited to only a subset of FOL operators. In particular, the negation operator is not supported. An additional limitation of present methods is also that they cannot naturally model uncertainty. Here, we present BetaE, a probabilistic embedding framework for answering arbitrary FOL queries over KGs. BetaE is the first method that can handle a complete set of first-order logical operations: conjunction ($\wedge$), disjunction ($\vee$), and negation ($\neg$). A key insight of BetaE is to use probabilistic distributions with bounded support, specifically the Beta distribution, and embed queries/entities as distributions, which as a consequence allows us to also faithfully model uncertainty. Logical operations are performed in the embedding space by neural operators over the probabilistic embeddings. We demonstrate the performance of BetaE on answering arbitrary FOL queries on three large, incomplete KGs. While being more general, BetaE also increases relative performance by up to 25.4% over the current state-of-the-art KG reasoning methods that can only handle conjunctive queries without negation.


title: Pressure-tuned intralayer exchange in superlattice-like MnBi2Te4/(Bi2Te3)n topological insulators

abstract: The magnetic structures of MnBi2Te4(Bi2Te3)n can be manipulated by tuning the interlayer coupling via the number of Bi2Te3 spacer layers n, while the intralayer ferromagnetic (FM) exchange coupling is considered too robust to control. By applying hydrostatic pressure up to 3.5 GPa, we discover opposite responses of magnetic properties for n = 1 and 2. MnBi4Te7 stays at A-type antiferromagnetic (AFM) phase with a decreasing N\'eel temperature and an increasing saturation field. In sharp contrast, MnBi6Te10 experiences a phase transition from A-type AFM to a quasi-two-dimensional FM state with a suppressed saturation field under pressure. First-principles calculations reveal the essential role of intralayer exchange coupling from lattice compression in determining these magnetic properties. Such magnetic phase transition is also observed in 20% Sb-doped MnBi6Te10 due to the in-plane lattice compression.


title: Strong existence and uniqueness of solutions of SDEs with time dependent Kato class coefficients

abstract: Consider stochastic differential equations (SDEs) in $\Rd$: $dX_t=dW_t+b(t,X_t)\d t$, where $W$ is a Brownian motion, $b(\cdot, \cdot)$ is a measurable vector field. It is known that if $|b|^2(\cdot, \cdot)=|b|^2(\cdot)$ belongs to the Kato class $\K_{d,2}$, then there is a weak solution to the SDE. In this article we show that if $|b|^2$ belongs to the Kato class $\K_{d,\a}$ for some $\a \in (0,2)$ ($\a$ can be arbitrarily close to $2$), then there exists a unique strong solution to the stochastic differential equations, extending the results in the existing literature as demonstrated by examples. Furthermore, we allow the drift to be time-dependent. The new regularity estimates we established for the solutions of parabolic equations with Kato class coefficients play a crucial role.


title: Novel View Synthesis from only a 6-DoF Camera Pose by Two-stage Networks

abstract: Novel view synthesis is a challenging problem in computer vision and robotics. Different from the existing works, which need the reference images or 3D models of the scene to generate images under novel views, we propose a novel paradigm to this problem. That is, we synthesize the novel view from only a 6-DoF camera pose directly. Although this setting is the most straightforward way, there are few works addressing it. While, our experiments demonstrate that, with a concise CNN, we could get a meaningful parametric model that could reconstruct the correct scenery images only from the 6-DoF pose. To this end, we propose a two-stage learning strategy, which consists of two consecutive CNNs: GenNet and RefineNet. GenNet generates a coarse image from a camera pose. RefineNet is a generative adversarial network that refines the coarse image. In this way, we decouple the geometric relationship between mapping and texture detail rendering. Extensive experiments conducted on the public datasets prove the effectiveness of our method. We believe this paradigm is of high research and application value and could be an important direction in novel view synthesis.


title: On finite groups with exactly two non-abelian centralizers

abstract: In this paper, we characterize finite group $G$ with unique proper non-abelian element centralizer. This improves \cite[Theorem 1.1]{nab}. Among other results, we have proved that if $C(a)$ is the proper non-abelian element centralizer of $G$ for some $a \in G$, then $\frac{C(a)}{Z(G)}$ is the Fitting subgroup of $\frac{G}{Z(G)}$, $C(a)$ is the Fitting subgroup of $G$ and $G' \in C(a)$, where $G'$ is the commutator subgroup of $G$.


title: Optimal Change-Point Detection and Localization

abstract: Given a times series ${\bf Y}$ in $\mathbb{R}^n$, with a piece-wise contant mean and independent components, the twin problems of change-point detection and change-point localization respectively amount to detecting the existence of times where the mean varies and estimating the positions of those change-points. In this work, we tightly characterize optimal rates for both problems and uncover the phase transition phenomenon from a global testing problem to a local estimation problem. Introducing a suitable definition of the energy of a change-point, we first establish in the single change-point setting that the optimal detection threshold is $\sqrt{2\log\log(n)}$. When the energy is just above the detection threshold, then the problem of localizing the change-point becomes purely parametric: it only depends on the difference in means and not on the position of the change-point anymore. Interestingly, for most change-point positions, it is possible to detect and localize them at a much smaller energy level. In the multiple change-point setting, we establish the energy detection threshold and show similarly that the optimal localization error of a specific change-point becomes purely parametric. Along the way, tight optimal rates for Hausdorff and $l_1$ estimation losses of the vector of all change-points positions are also established. Two procedures achieving these optimal rates are introduced. The first one is a least-squares estimator with a new multiscale penalty that favours well spread change-points. The second one is a two-step multiscale post-processing procedure whose computational complexity can be as low as $O(n\log(n))$. Notably, these two procedures accommodate with the presence of possibly many low-energy and therefore undetectable change-points and are still able to detect and localize high-energy change-points even with the presence of those nuisance parameters.


title: Exploration of interlacing and avoided crossings in a manifold of potential energy curves by a Unitary Group Adapted State Specific Multi-Reference Perturbation Theory (UGA-SSMRPT)

abstract: The Unitary Group Adapted State-Specific Multi-Reference Perturbation Theory (UGA-SSMRPT2) developed by Mukherjee et al [J. Comput. Chem. 2015, 36, 670] has successfully realized the goal of studying bond dissociation in a numerically stable, spin-preserving and size-consistent manner. In this paper, we explore and analyse the UGA-SSMRPT2 theory in the description of avoided crossings and interlacing between a manifold of states belonging to the same space-spin symmetry. In a state-specific formalism, since each state is an eigenstate of its own effective operator, to include the information of the other states requires the theory to be sufficiently accurate. Three different aspects of UGA-SSMRPT2 have been studied: (a) We introduce and develop the most rigorous version of UGA-SSMRPT2 which emerges from the rigorous version of UGA-SSMRCC utilizing a linearly independent virtual manifold; we call this the 'projection' version of UGA-SSMRPT2 denoted as UGA-SSMRPT2 Scheme P. We compare and contrast this approach with our earlier formulation that used extra sufficiency conditions via amplitude equations, which we will denote as UGA-SSMRPT2 Scheme A. (b) We present the results for a variety of electronic states of a set of molecules which display the striking accuracy of both the two versions of UGA-SSMRPT2; with respect to three different situations involving weakly avoided crossings, moderate/strongly avoided crossings and interlacing in a manifold of PECs of same symmetry. Accuracy of our results has been benchmarked against IC-MRCISD+Q. (c) For weakly avoided crossing between states displaying differently charged sectors in the asymptotes, the insufficient inclusion of state-specific orbital relaxation in a second order perturbative theory might lead to an artefact of double crossing between the pair of PECs.


title: An explainable deep vision system for animal classification and detection in trail-camera images with automatic post-deployment retraining

abstract: This paper introduces an automated vision system for animal detection in trail-camera images taken from a field under the administration of the Texas Parks and Wildlife Department. As traditional wildlife counting techniques are intrusive and labor intensive to conduct, trail-camera imaging is a comparatively non-intrusive method for capturing wildlife activity. However, given the large volume of images produced from trail-cameras, manual analysis of the images remains time-consuming and inefficient. We implemented a two-stage deep convolutional neural network pipeline to find animal-containing images in the first stage and then process these images to detect birds in the second stage. The animal classification system classifies animal images with overall 93% sensitivity and 96% specificity. The bird detection system achieves better than 93% sensitivity, 92% specificity, and 68% average Intersection-over-Union rate. The entire pipeline processes an image in less than 0.5 seconds as opposed to an average 30 seconds for a human labeler. We also addressed post-deployment issues related to data drift for the animal classification system as image features vary with seasonal changes. This system utilizes an automatic retraining algorithm to detect data drift and update the system. We introduce a novel technique for detecting drifted images and triggering the retraining procedure. Two statistical experiments are also presented to explain the prediction behavior of the animal classification system. These experiments investigate the cues that steers the system towards a particular decision. Statistical hypothesis testing demonstrates that the presence of an animal in the input image significantly contributes to the system's decisions.


title: A Novel Variable Stiffness Soft Robotic Gripper

abstract: We propose a novel tri-fingered soft robotic gripper with decoupled stiffness and shape control capability for performing adaptive grasping with minimum system complexity. The proposed soft fingers adaptively conform to object shapes facilitating the handling of objects of different types, shapes, and sizes. Each soft gripper finger has an inextensible articulable backbone and is actuated by pneumatic muscles. We derive a kinematic model of the gripper and use an empirical approach to map input pressures to stiffness and bending deformation of fingers. We use these mappings to achieve decoupled stiffness and shape control. We conduct tests to quantify the ability to hold objects as the gripper changes orientation, the ability to maintain the grasping status as the gripper moves, and the amount of force required to release the object from the gripped fingers, respectively. The results validate the proposed gripper's performance and show how stiffness control can improve the grasping quality.


title: Research Output from Lick Observatory for 1965-2019

abstract: The productivity of Lick Observatory (LO) is reviewed over the years from 1965 to 2019, a 55 yr period which commences with the Shane 3 m telescope being the second-largest astronomical reflector in the world, but transitions into the era of 10 m ground-based optical telescopes. The metric of productivity used here is the annual number of refereed papers within which are presented results that are based at least in part on observations made with the telescopes of LO on Mount Hamilton. Criteria are set forth that have guided the counting of this metric. A bibliography of papers pertinent to observations from Lick Observatory has been compiled, and is made available through a NASA ADS library. The overall productivity of the observatory, counting all telescopes, went through a broad maximum between the years 1975 and 1982. This period also corresponds to a maximum in productivity of the Shane 3 m telescope. An author network shows that this period is attended by the introduction of digital detector systems at LO, particularly at the Shane telescope. Following 1983 the overall productivity of LO shows a net long-term decrease but with two other lesser peaks superimposed on that decrease. A slightly smaller peak occurs around 1996 and is associated with programs taking advantage of CCD spectrometers at both cassegrain and coud\'{e} foci of the Shane telescope. A third lesser peak around 2012 can be attributed to a rise in extragalactic supernova studies originating out of UC Berkeley. Author networks serve to document the UC astronomical communities that were using LO telescopes at these peak times. Institutional affiliations of first authors are documented.


title: High resolution weakly supervised localization architectures for medical images

abstract: In medical imaging, Class-Activation Map (CAM) serves as the main explainability tool by pointing to the region of interest. Since the localization accuracy from CAM is constrained by the resolution of the model's feature map, one may expect that segmentation models, which generally have large feature maps, would produce more accurate CAMs. However, we have found that this is not the case due to task mismatch. While segmentation models are developed for datasets with pixel-level annotation, only image-level annotation is available in most medical imaging datasets. Our experiments suggest that Global Average Pooling (GAP) and Group Normalization are the main culprits that worsen the localization accuracy of CAM. To address this issue, we propose Pyramid Localization Network (PYLON), a model for high-accuracy weakly-supervised localization that achieved 0.62 average point localization accuracy on NIH's Chest X-Ray 14 dataset, compared to 0.45 for a traditional CAM model. Source code and extended results are available at https://github.com/cmb-chula/pylon.


title: Modeling and Validation of Soft Robotic Snake Locomotion

abstract: Snakes are a remarkable evolutionary success story. Many snake-inspired robots have been proposed over the years. Soft robotic snakes (SRS) with their continuous and smooth bending capability better mimic their biological counterparts' unique characteristics. Prior SRSs are limited to planar operation with a limited number of planar gaits. We propose a novel SRS with spatial bending and investigate snake locomotion gaits beyond the capabilities of the state-of-the-art systems. We derive a complete floating-base kinematic model of the robot and use the model to derive jointspace trajectories for serpentine and inward/outward rolling locomotion gaits. The locomotion gaits for the proposed SRS are experimentally validated under varying frequency and amplitude of gait cycles. The results qualitatively and quantitatively validate the SRS ability to leverage spatial bending to achieve locomotion gaits not possible with current SRS.


title: Beating Temporal Phase Sensitivity Limit in Off-axis Interferometry based Quantitative Phase Microscopy

abstract: Phase sensitivity determines the lowest optical path length (OPL) value that can be detected from the noise floor in a quantitative phase microscopy (QPM) system. The temporal phase sensitivity is known to be limited by both photon shot-noise and a variety of noise sources from electronic devices and environment. To beat temporal phase sensitivity limit, we explore different ways to reduce different noise factors in off-axis interferometry-based QPM using laser-illumination. Using a high electron-well-capacity camera, we measured the temporal phase sensitivity values using non-common-path and common-path interferometry based QPM systems under different environmental conditions. A frame summing method and a spatiotemporal filtering method are further used to reduce the noise contributions, thus enabling us to push the overall temporal phase sensitivity to less than 2 picometers.


title: Knowledge Distillation for BERT Unsupervised Domain Adaptation

abstract: A pre-trained language model, BERT, has brought significant performance improvements across a range of natural language processing tasks. Since the model is trained on a large corpus of diverse topics, it shows robust performance for domain shift problems in which data distributions at training (source data) and testing (target data) differ while sharing similarities. Despite its great improvements compared to previous models, it still suffers from performance degradation due to domain shifts. To mitigate such problems, we propose a simple but effective unsupervised domain adaptation method, adversarial adaptation with distillation (AAD), which combines the adversarial discriminative domain adaptation (ADDA) framework with knowledge distillation. We evaluate our approach in the task of cross-domain sentiment classification on 30 domain pairs, advancing the state-of-the-art performance for unsupervised domain adaptation in text sentiment classification.


title: A Generalized Faulhaber Inequality, Improved Bracketing Covers, and Applications to Discrepancy

abstract: We prove a generalized Faulhaber inequality to bound the sums of the $j$-th powers of the first $n$ (possibly shifted) natural numbers. With the help of this inequality we are able to improve the known bounds for bracketing numbers of $d$-dimensional axis-parallel boxes anchored in $0$ (or, put differently, of lower left orthants intersected with the $d$-dimensional unit cube $[0,1]^d$). We use these improved bracketing numbers to establish new bounds for the star-discrepancy of negatively dependent random point sets and its expectation. We apply our findings also to the weighted star-discrepancy.


title: Application of a quantum wave impedance approach for a quantum capacitance calculation

abstract: A method for a calculation of quantum capacitance for a two-dimesional electron gas (2DEG) in potential wells of complicated geometry on the base of a quantum wave impedance technique was proposed. The application of this method was illustated on four different forms of potential wells: infinite and finit rectangular well, a finit rectangular double well and a parabolic double well. It was shown how a quantum capacitance of these wells depends on its parametres. Numerical calculations of a quantum capacitance for mentioned potential wells were made at temperature $T=0$ and the results were presented graphically.


title: Similarity Analysis of Self-Supervised Speech Representations

abstract: Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scale unlabeled data, and their applications to a wide range of speech tasks have also been investigated. However, there has been little research focusing on understanding the properties of existing approaches. In this work, we aim to provide a comparative study of some of the most representative self-supervised algorithms. Specifically, we quantify the similarities between different self-supervised representations using existing similarity measures. We also design probing tasks to study the correlation between the models' pre-training loss and the amount of specific speech information contained in their learned representations. In addition to showing how various self-supervised models behave differently given the same input, our study also finds that the training objective has a higher impact on representation similarity than architectural choices such as building blocks (RNN/Transformer/CNN) and directionality (uni/bidirectional). Our results also suggest that there exists a strong correlation between pre-training loss and downstream performance for some self-supervised algorithms.


title: Approximation-Robust Inference in Dynamic Discrete Choice

abstract: Estimation and inference in dynamic discrete choice models often relies on approximation to lower the computational burden of dynamic programming. Unfortunately, the use of approximation can impart substantial bias in estimation and results in invalid confidence sets. We present a method for set estimation and inference that explicitly accounts for the use of approximation and is thus valid regardless of the approximation error. We show how one can account for the error from approximation at low computational cost. Our methodology allows researchers to assess the estimation error due to the use of approximation and thus more effectively manage the trade-off between bias and computational expedience. We provide simulation evidence to demonstrate the practicality of our approach.


title: Multilingual Approach to Joint Speech and Accent Recognition with DNN-HMM Framework

abstract: Human can recognize speech, as well as the peculiar accent of the speech simultaneously. However, present state-of-the-art ASR system can rarely do that. In this paper, we propose a multilingual approach to recognizing English speech, and related accent that speaker conveys using DNN-HMM framework. Specifically, we assume different accents of English as different languages. We then merge them together and train a multilingual ASR system. During decoding, we conduct two experiments. One is a monolingual ASR-based decoding, with the accent information embedded at phone level, realizing word-based accent recognition (AR), and the other is a multilingual ASR-based decoding, realizing an approximated utterance-based AR. Experimental results on an 8-accent English speech recognition show both methods can yield WERs close to the conventional ASR systems that completely ignore the accent, as well as desired AR accuracy. Besides, we conduct extensive analysis for the proposed method, such as transfer learning without-domain data exploitation, cross-accent recognition confusion, as well as characteristics of accented-word.


title: Boundary rigidity for Randers metrics

abstract: If a non-reversible Finsler norm is the sum of a reversible Finsler norm and a closed 1-form, then one can uniquely recover the 1-form up to potential fields from the boundary distance data. We also show a boundary rigidity result for Randers metrics where the reversible Finsler norm is induced by a Riemannian metric which is boundary rigid. Our theorems generalize Riemannian boundary rigidity results to some non-reversible Finsler manifolds. We provide an application to seismology where the seismic wave propagates in a moving medium.


title: Quasiperiodic Floquet-Thouless energy pump

abstract: Recent work [M. H. Kolodrubetz et al, PRL 120, 150601] has demonstrated that periodically driven one-dimensional fermionic systems can support quantized energy pumping resulting from an adiabatic modulation of a second parameter. In this work, we explore this topological Floquet-Thouless energy pump in the quasiperiodic driving regime where the parametric driving occurs at finite frequency. We show that quantization of energy pumping persists for finite ramping frequencies, as long as they are incommensurate with the driving frequency, and the system remains localized by spatial disorder. Thus, the topological Floquet-Thouless energy pump is stable beyond the adiabatic regime, occupying a finite region of parameter space. Phase transitions away from these topological phases are accompanied by delocalization in position space, photon number (energy) space, or both. Using a dimensional reduction scheme, we demonstrate that a related phase can be realized with a cavity-qubit system driven by two incommensurate modes.


title: Computing Diverse Sets of Solutions for Monotone Submodular Optimisation Problems

abstract: Submodular functions allow to model many real-world optimisation problems. This paper introduces approaches for computing diverse sets of high quality solutions for submodular optimisation problems. We first present diversifying greedy sampling approaches and analyse them with respect to the diversity measured by entropy and the approximation quality of the obtained solutions. Afterwards, we introduce an evolutionary diversity optimisation approach to further improve diversity of the set of solutions. We carry out experimental investigations on popular submodular benchmark functions that show that the combined approaches achieve high quality solutions of large diversity.


title: Faithful Euclidean Distance Field from Log-Gaussian Process Implicit Surfaces

abstract: In this letter, we introduce the Log-Gaussian Process Implicit Surface (Log-GPIS), a novel continuous and probabilistic mapping representation suitable for surface reconstruction and local navigation. Our key contribution is the realisation that the regularised Eikonal equation can be simply solved by applying the logarithmic transformation to a GPIS formulation to recover the accurate Euclidean distance field (EDF) and, at the same time, the implicit surface. To derive the proposed representation, Varadhan's formula is exploited to approximate the non-linear Eikonal partial differential equation (PDE) of the EDF by the logarithm of a linear PDE. We show that members of the Matern covariance family directly satisfy this linear PDE. The proposed approach does not require post-processing steps to recover the EDF. Moreover, unlike sampling-based methods, Log-GPIS does not use sample points inside and outside the surface as the derivative of the covariance allow direct estimation of the surface normals and distance gradients. We benchmarked the proposed method on simulated and real data against state-of-the-art mapping frameworks that also aim at recovering both the surface and a distance field. Our experiments show that Log-GPIS produces the most accurate results for the EDF and comparable results for surface reconstruction and its computation time still allows online operations.


title: SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform

abstract: Segmenting arbitrary 3D objects into constituent parts that are structurally meaningful is a fundamental problem encountered in a wide range of computer graphics applications. Existing methods for 3D shape segmentation suffer from complex geometry processing and heavy computation caused by using low-level features and fragmented segmentation results due to the lack of global consideration. We present an efficient method, called SEG-MAT, based on the medial axis transform (MAT) of the input shape. Specifically, with the rich geometrical and structural information encoded in the MAT, we are able to develop a simple and principled approach to effectively identify the various types of junctions between different parts of a 3D shape. Extensive evaluations and comparisons show that our method outperforms the state-of-the-art methods in terms of segmentation quality and is also one order of magnitude faster.


title: The NTU-AISG Text-to-speech System for Blizzard Challenge 2020

abstract: We report our NTU-AISG Text-to-speech (TTS) entry systems for the Blizzard Challenge 2020 in this paper. There are two TTS tasks in this year's challenge, one is a Mandarin TTS task, the other is a Shanghai dialect TTS task. We have participated both. One of the main challenges is to build TTS systems with low-resource constraints, particularly for the case of Shanghai dialect, of which about three hours data are available to participants. To overcome the constraint, we adopt an average-speaker modeling method. That is, we first employ external Mandarin data to train both End-to-end acoustic model and WaveNet vocoder, then we use Shanghai dialect to tune the acoustic model and WaveNet vocoder respectively. Apart from this, we have no Shanghai dialect lexicon despite syllable transcripts are provided for the training data. Since we are not sure if similar syllable transcripts are provided for the evaluation data during the training stage, we use Mandarin lexicon for Shanghai dialect instead. With the letter, as decomposed from the corresponding Mandarin syllable, as input, though the naturalness and original speaker similarity of the synthesized speech are good, subjective evaluation results indicate the intelligibility of the synthesized speech is deeply undermined for the Shanghai dialect TTS system.


title: On the Effects of Using word2vec Representations in Neural Networks for Dialogue Act Recognition

abstract: Dialogue act recognition is an important component of a large number of natural language processing pipelines. Many research works have been carried out in this area, but relatively few investigate deep neural networks and word embeddings. This is surprising, given that both of these techniques have proven exceptionally good in most other language-related domains. We propose in this work a new deep neural network that explores recurrent models to capture word sequences within sentences, and further study the impact of pretrained word embeddings. We validate this model on three languages: English, French and Czech. The performance of the proposed approach is consistent across these languages and it is comparable to the state-of-the-art results in English. More importantly, we confirm that deep neural networks indeed outperform a Maximum Entropy classifier, which was expected. However , and this is more surprising, we also found that standard word2vec em-beddings do not seem to bring valuable information for this task and the proposed model, whatever the size of the training corpus is. We thus further analyse the resulting embeddings and conclude that a possible explanation may be related to the mismatch between the type of lexical-semantic information captured by the word2vec embeddings, and the kind of relations between words that is the most useful for the dialogue act recognition task.


title: Overview of Networked Supervisory Control with Imperfect Communication Channels

abstract: This paper presents an overview of the networked supervisory control framework for discrete event systems with imperfect communication networks, which can be divided into the centralized supervisory control setup and the decentralized supervisory control setup. We review the state-of-art networked control frameworks with observation channel delays and control channel delays, for untimed and timed models. Data losses in communication channels are also considered. The review of the state-of-art networked control frameworks will be focused on the following parts: 1) the construction of the networked control closed-loop system 2) the condition to ensure the existence of a networked supervisor 3) the synthesis procedure for networked-delay resilient supervisor 4) the possibility of improving the synthesis efficiency.


title: An improved path-integral method for golden-rule rates

abstract: We present a simple method for the calculation of reaction rates in the Fermi golden-rule limit, which accurately captures the effects of tunnelling and zero-point energy. The method is based on a modification of the recently proposed golden-rule quantum transition state theory (GR-QTST) of Thapa, Fang and Richardson. While GR-QTST is not size consistent, leading to the possibility of unbounded errors in the rate, our modified method has no such issue and so can be reliably applied to condensed phase systems. Both methods involve path-integral sampling in a constrained ensemble; the two methods differ, however, in the choice of constraint functional. We demonstrate numerically that our modified method is as accurate as GR-QTST for the one-dimensional model considered by Thapa and coworkers. We then study a multi-dimensional spin-boson model, for which our method accurately predicts the true quantum rate, while GR-QTST breaks down with an increasing number of boson modes in the discretisation of the spectral density. Our method is able to accurately predict reaction rates in the Marcus inverted regime, without the need for the analytic continuation required by Wolynes theory.