This paper seeks to model human language by the mathematical framework of quantum physics. With the well-designed mathematical formulations in quantum physics, this framework unifies different linguistic units in a single complex-valued vector space, e.g. words as particles in quantum states and sentences as mixed systems. A complex-valued network is built to implement this framework for semantic matching. With well-constrained complex-valued components, the network admits interpretations to explicit physical meanings. The proposed complex-valued network for matching (CNM) 1 achieves comparable performances to strong CNN and RNN baselines on two benchmarking question answering (QA) datasets. There is a growing concern on the interpretability of neural networks. Along with the increasing power of neural networks comes the challenge of interpreting the numerical representation of network components into human-understandable language. Lipton (2018) points out two important factors for a model to be interpretable, namely post-hoc interpretability and transparency . The former refers to explanations of why a model works after it is executed, while the latter concerns self-explainability of components through some mechanisms in the designing phase of the model. We seek inspirations from quantum physics to build transparent and post-hoc interpretable networks for modeling human language. The emerging research field of cognition suggests that there exist quantum-like phenomena in human cognition (Aerts and Sozzo, 2014), especially language understanding (Bruza et al., 2008). Intuitively, a  Equal Contribution  Corresponding Author 1 https://github.com/wabyking/qnn.git sentence can be treated as a physical system with multiple words (like particles), and these words are usually polysemous (superposed) and correlated (entangled) with each other. Motivated by these existing works, we aim to investigate the following Research Question (RQ). Towards this question, we build a novel quantum-theoretic framework for modeling language, in an attempt to capture the quantum-ness in the cognitive aspect of human language. The framework models different linguistic units as quantum states with the adoption of quantum probability (QP), which is the mathematical framework of quantum physics that models uncertainly on a uniform Semantic Hilbert Space (SHS). Complex values are crucial in the mathematical framework of characterizing quantum physics. In order to preserve physical properties, the linguistic units have to be represented as complex vectors or matrices. This naturally gives rise to another research question: RQ2 : Can we benefit from the complex-valued representation of human language in a real natural language processing (NLP) scenario? To this end, we formulate a linguistic unit as a complex-valued vector, and link its length and direction to different physical meanings: the length represents the relative weight of the word while the direction is viewed as a superposition state. The superposition state is further represented in an amplitude-phase manner, with amplitudes corresponding to the lexical meaning and phases implicitly reflecting the higher-level semantic aspects such as polarity, ambiguity or emotion. In order to evaluate the above framework, we implement it as a complex-valued network (CNM) for semantic matching. The network is applied to the question answering task, which is the most typical matching task that aims at selecting the best answer for a question from a pool of candidates. In order to facilitate local matching with n-grams of a sentence pair, we design a local matching scheme in CNM. Most of State-of-the-art QA models are mainly based on Convolution Neural Network (CNN), Recurrent Neural Network (RNN) and many variants thereof (Wang and Nyberg, 2015; Yang et al., 2016; Hu et al., 2014; Tan et al., 2015). However, with opaque structures of convolutional kernels and recurrent cells, these models are hard to understand for humans. We argue that our model is advantageous in terms of interpretability. Our proposed CNM is transparent in that it is designed in alignment with quantum physics. Experiments on benchmarking QA datasets show that CNM has comparable performance to strong CNN and RNN baselines, whilst admitting post-hoc interpretations to human-understandable language. We therefore answer RQ1 by claiming that it is possible to model human language with the proposed quantum-theoretical framework in this paper. Furthermore, an ablation study shows that the complex-valued word embedding performs better than its real counterpart, which allows us to answer RQ2 by claiming that we benefit from the complex-valued representation of natural language on the QA task. Quantum probability provides a sound explanation for the phenomena and concepts of quantum mechanics, by formulating events as subspaces in a vector space with projective geometry. Quantum Superposition is one of the fundamental concepts in Quantum Physics, which describes the uncertainty of a single particle. In the micro world, a particle like a photon can be in multiple mutual-exclusive basis states simultaneously with a probability distribution. In a two-dimensional example, two basis vectors are denoted as | 0 (cid:105) and | 1 (cid:105) 2 . 2 We here adopt the widely used Dirac notations in quantum probability, in which a unit vector (cid:126) and its transpose (cid:126) T are denoted as a ket | u (cid:105) and a bra (cid:104) u | respectively. Superposition is implemented to model a general state which is a linear combination of basis vectors with complex-valued weights such that |  (cid:105) =  0 | 0 (cid:105) +  1 | 1 (cid:105) , (1) where  0 and  1 are complex scalars satisfying 0  |  0 | 2  1 , 0  |  1 | 2  1 and |  0 | 2 + |  1 | 2 = 1 . It follows that |  (cid:105) is defined over the complex field. When  0 and  1 are non-zero values, the state |  (cid:105) is said to be a superposition of the states | 0 (cid:105) and | 1 (cid:105) , and the scalars  0 and  1 denote the probability amplitudes of the superposition. The uncertainty of an ensemble system with multiple particles is encapsulated as a mixed state, represented by a positive semi-definite matrix with unitary trace called density matrix :  = (cid:80) mi |  i (cid:105) (cid:104)  i | , where {|  i (cid:105)} mi =0 are pure states like Eq. 1. In order to infer the probabilistic properties of  in the state space, Gleason's theorem (Glea-son, 1957; Hughes, 1992) is used to calculate probability to observe x through projection measurements | x (cid:105) (cid:104) x | that is a rank-one projector denoted as a outer product of | x (cid:105) . The measured probability p x (  ) is a nonnegative real-valued scalar, since both  and | x (cid:105) (cid:104) x | are Hermitian. The unitary trace property guarantees (cid:80) x  X p x (  ) = 1 for X being a set of orthogonal basis states. Based on the density matrices representation for documents in information retrieval (Van Rijsber-gen, 2004; Sordoni et al., 2013), Zhang et al. (2018a) built a neural network with density matrix for question answering. This Neural Network based Quantum Language Model (NNQLM) embeds a word as a unit vector and a sentence as a real-valued density matrix. The distance between a pair of density matrices is obtained by extracting features of their matrix multiplication in two ways: NNQLM-I directly takes the trace of the resulting matrix, while NNQLM-II applies convolutional structures on top of the matrix to determine whether the pair of sentences match or not. NNQLM is limited in that it does not make proper use of the full potential of probabilistic property of a density matrices.By treating density matrices as ordinary real vectors (NNQLM-I) or matrices (NNQLM-II), the full potential with complex-valued formulations is largely ignored. Meanwhile, adding convolutional layers on top of a density matrix is more of an empirical workaround than an implementation of a theoretical framework. In contrast, a complex-valued matching network is built on top of a quantum-theoretical framework for natural language. In particular, an indirect way to measure the distance between two density matrices through trainable measurement operations, which makes advantage of the probabilistic properties of density matrices and also provides flexible matching score driven by training data. Here we introduce the Semantic Hilbert Space H defined on a complex vector space C n , and three different linguistic units, namely sememes, words and word combinations on the space. The concept of semantic measurement is introduced at last. Sememes. We assume H is spanned by the set of orthogonal basis states {| e j (cid:105)} nj =1 for sememes , which are the minimum semantic units of word meanings in language universals (Goddard and Wierzbicka, 1994). The unit state | e j (cid:105) can be seen as a one-hot vector, i.e., the j -th element in | e j (cid:105) is one while other elements are zero, in order to obtain a set of orthogonal unit states. Semantic units with larger granularities are based on the set of sememe basis. Words. Words are composed of sememes in superposition. Each word w is a superposition over all sememes {| e j (cid:105)} nj =1 , or equivalently a unit-length vector on H : | w (cid:105) = n (cid:88) j =1 r j e i j | e j (cid:105) , (3) i is the imaginary number with i 2 =  1 . In the above expression, { r j } nj =1 are non-negative real-valued amplitudes satisfying (cid:80) nj =1 r j 2 =1 and  j  [  ,  ] are the corresponding complex phases. In comparison to Eq. 1, { r j e i j } nj =0 are the polar form representation of the complex-valued scalars {  j } 1 j =0 . Word Combinations. We view a combination of words (e.g. phrase, n -gram, sentence or document) as a mixed system composed of individual words, and its representation is computed as follows:  = m (cid:88) j 1 m | w j (cid:105) (cid:104) w j | , (4) where m is the number of words and | w j (cid:105) is word superposition state in Eq. 3, allowing multiple occurrences. Eq. 4 produces a density matrix  for semantic composition of words. It also describes a non-classical distribution over the set of sememes: the complex-valued off-diagonal elements describes the correlations between sememes, while the diagonal entries (guaranteed to be real by its original property) correspond to a standard probability distribution. The off-diagonal elements provide our framework some potentials to model the possible interactions between the basic sememe basis, which was usually considered mutually independent with each other. Semantic Measurements. The high-level features of a sequence of words are extracted through measurements on its mixed state. Given a density matrix  of a mixed state, a rank-one projector P , which is the outer product of a unit complex vector, i.e. P = | x (cid:105) (cid:104) x | , is applied as a measurement projector. It is worth mentioning that | x (cid:105) could be any pure state in this Hilbert space (not only limited to a specific word w ). The measured probability is computed by Gleasons Theorem in Eq. 2. 4 Complex-valued Network for Matching We implemented an end-to-end network for matching on the Semantic Hilbert Space. Fig. 1 shows the overall structure of the proposed Complex-valued Network for Matching (CNM). Each component of the network is further discussed in this section. On the Semantic Hilbert Space, each word w is embedded as a complex-valued vector (cid:126)w . Here we link its length and direction to different physical meanings: the length of a vector represents the relative weight of the word while the vector direction is viewed as a superposition state. Each word w adopts a normalization into a superposition state | w (cid:105) and a word-dependent weight  ( w ) : | w (cid:105) = (cid:126)w || (cid:126)w || ,  ( w ) = || (cid:126)w || , (5) where || (cid:126)w || denotes the 2-norm length of (cid:126)w . ( w ) is used to compute the relative weight of a word in Figure 1: Architecture of Complex-valued Network for Matching. a local context window, which we will elaborate in Section 4.2. A sentence is modeled as a combination of individual words in it. NNQLM (Zhang et al., 2018a) models a sentence as a global mixture of all words, which implicitly assumes a global interaction among all sentence words. This seems to be unreasonable in practice, especially for a long text segment such as a paragraph or a document, where the interaction between the first word and the last word is often negligible. Therefore, we address this limitation by proposing a local mixture of words, which tends to capture the semantic relations between neighboring words and undermine the long-range word dependencies. As is shown in Fig. 2, a sliding window is applied and a density matrix is constructed for a local window of length l (e.g. 3). Therefore, a sentence is composed of a sequence of density matrices for l -grams. The representation of a local l -gram window is obtained by an improved approach over Eq. 4. In Eq. 4, each word is assigned with the same weight, which does not hold from an empirical point of view. In this study, we take the L 2 -norm of the word vector as the relative weight in a local context window for a specific word, which could be updated during training. To some extent, L 2 -norm is a measure of semantic richness of a word, i.e. the longer the vector the richer the meaning. The Figure 2: Architecture of local mixture component. density matrix of an l -gram is computed as follows:  = l (cid:88) i p ( w i ) | w i (cid:105) (cid:104) w i | , (6) where the relative importance of each word p ( w i ) in an l -gram is the soft-max normalized word-dependent weight: p ( w i ) = e  ( wi ) (cid:80) lj e  ( wj ) , where  ( w i ) is the word-dependent weight. By converting word-dependent weights to a probability distribution, a legal density matrix is produced, because (cid:80) li p ( w i ) = 1 gives tr (  ) = 1 . Moreover, the weight of a word also depends on its neighboring words in a local context. In quantum information, there have been works trying to estimate a quantum state from the results of a series of measurements ( Rehacek et al., 2001; Lvovsky, 2004). Inspired by these works, we introduce trainable measurements to extract density matrix features and match a pair of sentences. Suppose a pair of sentences with length L are represented as two sets of density matrices {  1 j } Lj =1 and {  2 j } Lj =1 respectively. The same set of K semantic measurement operators {| v k (cid:105)} Kk =1 are applied to both sets, producing a pair of k byL probability matrix p 1 and p 2 , where p 1 jk = (cid:104) v k |  1 j | v k (cid:105) and p 2 jk = (cid:104) v k |  2 j | v k (cid:105) for k  { 1 , ..., K } and j  { 1 , ..., L } . A classical vector-based distances between p 1 and p 2 can be computed as the matching score of the sentence pair. By involving a set of semantic measurements, the properties of density matrix are taken into consideration in computing the density matrix distance. We believe that this way of computing density matrix distance is both theoretically sound and applicable in practice. The trace inner product of density matrices (Zhang et al., 2018a) breaks the basic axioms of metric, namely the non-negativity, identity of indiscernibles and triangle inequality. The CNN-based feature extraction (Zhang et al., 2018a) for density matrix multiplication loses the property of density matrix as a probability distribution. Nielsen and Chuang (2010) introduced three measures namely trace distance, fidelity, and VN-divergence. However, it is computationally costly to compute these metrics and propagate the loss in an end-to-end training framework. We set the measurements to be trainable so that the matching of question and answering can be integrated into the whole neural network, and identify the discriminative semantic measurements in a data-driven manner. From the perspective of linear discriminant analysis (LDA) (Fisher, 1936), this approach is intended to find a group of finite discriminative projection directions for a better di-vision of different classes, but in a more sound framework inspired by quantum probability with complex-valued values. From an empirical point of view, the data-driven measurements make it flexible to match two sentences. The experiments were conducted on two benchmarking question answering datasets for question answering (QA), namely TREC QA (Voorhees and Tice, 2000) and WikiQA (Yang et al., 2015). TREC QA is a standard QA dataset in the Text REtrieval Conference (TREC). WikiQA is released by Microsoft Research on open domain question answering. On both datasets, the task is to select the most appropriate answer from the candidate answers for a question, which requires a ranking of candidate answers. After removing the questions with no correct answers, the statistics of the cleaned datasets are given in the Tab. 1. Two common rank-based metrics, namely mean average precision (MAP) and mean reciprocal rank (MRR), are used to measure the performance of models. We conduct a comprehensive comparison across a wide range of models. On TREC QA the experimented models include Bigram-CNN (Yu et al., 2014), three-layered Long Short-term Memory (LSTM) in combination with BM25 (LSTM-3L-BM25) (Wang and Nyberg, 2015), attention-based neural matching model (aNMM) (Yang et al., 2016), Multi-perspective CNN (MP-CNN) (He et al., 2015), CNTN (Qiu and Huang, 2015), attention-based LSTM+CNN model (LSTM-CNN-attn) (Tang et al., 2015) and pairwise word interaction modeling (PWIM) (He and Lin, 2016). On WikiQA dataset, we involve the following models into comparison: Bigram-CNN (Yu et al., 2014), CNN with word count information (CNN-Cnt) (Yang et al., 2015), QA-BILSTM (Santos et al., 2016), BILSTM with attentive pooling (AP-BILSTM) (Santos et al., 2016), and LSTM with attention (LSTM-attn) (Miao et al., 2015). On both datasets, we report the results of quantum language model (Sordoni et al., 2013) and two models NNQLM-I, NNQLM-II by (Zhang et al., 2018a) for comparison. The parameters in the network are  = { R,  , {| v i (cid:105)} ki =1 } , in which R and  denote the lookup tables for amplitudes and complex phases of each word, and {| v i (cid:105)} ki =1 denotes the set of semantic measurements. We use 50-dimension complex word embedding. The amplitudes are initialized with 50-dimension Glove vectors (Penning-ton et al., 2014) and L2-norm regularized during training. The phases are randomly initialized under a normal distribution of [  ,  ] . The semantic measurements {| v i (cid:105)} ki =1 } are initialized with orthogonal real-valued one-hot vectors, and each measurement is constrained to be of unit length during training. We perform max pooling over the sentence dimension on the measurement probability matrices, resulting in a k -dim vector for both a question and an answer. We concatenate the vectors for l = 1 , 2 , 3 , 4 for questions and answers, and the larger size of windows are also tried. We will use a longer sliding window in datasets with longer sentences. The cosine similarity is used as the distance metric of measured probabilities. We use triplet hinge loss and set the margin  = 0 . 1 . A dropout layer is built over the embedding layer and measurement probabilities with a dropout rate of 0.9. A grid search is conducted over the parameter pools to explore the best parameters. The parameters under exploration include { 0 . 01 , 0 . 05 , 0 . 1 } for the learning rate, { 1 e  5 , 1 e  6 , 1 e  7 , 1 e  8 } for the L2-normalization of complex word embeddings, { 8 , 16 , 32 } for batch size, and { 50 , 100 , 300 , 500 } for the number of semantic measurements. The proposed CNM has a limited scale of parameters. Apart from the complex word embed-dings which are | V |  2 n by size, the only set of parameters are {| v i (cid:105)} ki =1 which is k  2 n , with | V | , k, n being the vocabulary size, number of semantic measurements and the embedding dimension, respectively. In comparison, a single-layered CNN has at least l  k  n additional parameters with l being the filter width, while a single-layered LSTM is 4  k  ( k + n ) by the minimum parameter scale. Although we use both amplitude part and phase part for word embedding, lower dimensions of embedding are adopted, namely 50, with Model MAP MRR Bigram-CNN 0.5476 0.6437 LSTM-3L-BM25 0.7134 0.7913 LSTM-CNN-attn 0.7279 0.8322 aNMM 0.7495 0.8109 MP-CNN 0.7770 0.8360 CNTN 0.7278 0.7831 PWIM 0.7588 0.8219 QLM 0.6780 0.7260 NNQLM-I 0.6791 0.7529 NNQLM-II 0.7589 0.8254 CNM 0.7701 0.8591 Over NNQLM-II 1.48%  4.08%  Table 2: Experiment Results on TREC QA Dataset. Therefore, our network scales better than the advanced models on the CNN or LSTM basis. Tab. 2 and 3 show the experiment results on TREC QA and WikiQA respectively, where bold values are the best performances out of all models. Our model achieves 3 best performances out of the 4 metrics on TREC QA and WikiQA, and performs slightly worse than the best-performed models on the remaining metric. This illustrates the effectiveness of our proposed model from a general perspective. Specifically, CNM outperforms most CNN and LSTM-based models, which have more complicated structures and a relatively larger parameters scale. Also, CNM performs better than existing quantum-inspired QA models, QLM and NNQLM on both datasets, which means that the quantum theoretical framework gives rise to better performs model. Moreover, a significant improvement over NNQLM-1 is observed on these two datasets, supporting our claim that the trace inner product is not an effective distance metric of two density matrices. An ablation test is conducted to examine the influ-ence of each component on our proposed CNM. The following models are implemented in the ablation test. FastText-MaxPool adopt max pooling over word-embedding, just like FastText (Joulin et al., 2016). CNM-Real replaces word embed-dings and measurements with their real counterparts. CNM-Global-Mixture adopts a global mixture of the whole sentence, in which a sentence is represented as a single density matrix, leading to a probability vector for the measurement result. CNM-trace-inner-product replaces the trainable measurements with trace inner product like NNQLM. For the real-valued models, we replace the embedding with double size of dimension, in order to eliminate the impact of the parameter scale on the performance. Due to limited space, we only report the ablation test result on TREC QA, and WikiQA has similar trends. The test results in Tab. 4 demonstrate that each component plays a crucial role in the CNM model. In particular, the comparison with CNM-Real and FastText-MaxPool shows the effectiveness of introducing complex-valued components, the increase in performance over CNM-Global-Mixture reveals the superiority of local mixture, and the comparison with CNM-trace-inner-product confirms the usefulness of trainable measurements. This section aims to investigate the proposed research questions mentioned in Sec 1. For RQ1, we explain the physical meaning of each component in term of the transparency (Sec. 6.1), and design some case studies for the post-hoc interpretability (Sec. 6.2). For RQ2, we argue that the complex-valued representation can model different aspects of semantics and naturally address the non-linear semantic compositionality, as discussed in Sec. 6.3. CNM aims to unify many semantic units with different granularity e.g. sememes, words, phrases (or N-gram) and document in a single complex-valued vector space, as shown in Tab. 5. In particular, we formulate atomic sememes as a group of complete orthogonal basis states and words as superposition states over them. A linguistic unit with larger-granularity e.g. a word phrase or a sentence is represented as a mixed system over the words (with a density matrix, i.e. a positive semi-definite matrix with unit trace). More importantly, trainable projection measurements are used to extract high-level representation for a word phrase or a sentence. Each measurement is also directly embedded in this unified Hilbert space, as a specific unit state (like words), thus making it easily understood by the neighbor words near this specific state. The corresponding trainable components in state-of-art neural network architectures, namely, kernels in CNN and cells in RNN, are represented as arbitrary real-valued without any constraints, lead to difficulty to be understood. The post-hoc Interpretability is shown in three groups of case studies, namely word weight scheme, matching pattern, and discriminative semantic measurements. tant ones. The importance of words is based on the L2-norm of its learned amplitude embedding according to Eq. 5. It is consistent with the intuition that, the important words are more about specific topics or discriminative nouns, while the unimportant words include meaningless numbers or super-high frequency words. Note that some special form (e.g. plural form in the last row ) of words are also identified as unimportant words, since we commonly did not stem the words. Tab. 7 shows the match schema with local sliding windows. In a local context window, we visualize the relative weights (i.e. the weights after normalized by softmax ) for each word with darkness degrees. The table illustrates that our model is capable of identifying true matched local windows of a sentence pair. Even some words are replaced with similar forms (e.g. commit and committing in the last case) or meanings (e.g. change and new in the fourth case), it could be robust to get a relatively high matching score. From an empirical point of view, our model outperforms other models in situations where specific matching pattern are crucial to the sentence meaning, such as when two sentences share some unordered bag-of-word combinations. To some extent, it is robust up to replacement of words with similar ones in the Semantic Hilbert Space. The semantic measurements are performed through rank-one projectors {| x (cid:105) (cid:104) x |} . From a classical point of view, each projector is associated with a superposition of fundamental sememes, which is not necessarily linked to a particular word. Since the similarity metric in the Semantic Hilbert Space can be used to indicate semantic relatedness, we rely on the nearby words of the learned measurement projectors to understand what they may refer to. Essentially, we identified the 10 most similar words to a measurement based on the cosine sim-Selected neighborhood words for a measurement vector 1 andes, nagoya, inter-american, low-caste 2 cools, injection, boiling,adrift 3 andrews, paul, manson, bair 4 historically, 19th-century, genetic, hatchback 5 missile, exile, rebellion, darkness Table 8: Selected learned measurements for TREC QA. ilarity metric. Tab. 8 shows part of the most similar words of 5 measurements, which are randomly chosen from the total number of k =10 trainable measurements for the TREC QA dataset. It can be seen that the first three selected measurements were about positions, movement verbs, and peo-ple's names, while the rest were about the topic of history and rebellion respectively. Even though a clear explanation of the measurements is not available, we are still able to roughly understand the meaning of the measurements in the proposed data-driven approach. In CNM, each word is naturally embedded as a complex vector, composed of a complex phase part, a unit amplitude part, and a scalar-valued length. We argue that the amplitude part (i.e. the squared root of a probabilistic weight), corresponds to the classical word embedding with the lexical meaning, while the phase part implicitly reflects the higher-level semantic aspect e.g. polarity, ambiguity or emotion. The scalar-valued length is considered as the relative weight in a mixed system. The ablation study in Sec. 5.4 confirms that the complex-valued word embedding performs better than the real word embedding, which indicates that we benefit from the complex-valued embedding on the QA task. From a mathematical point of view, complex-valued word embedding and other complex-valued components forms a new Hilbert vector space for modelling language, with a new definitions of addition and multiplication, as well as a new inner product operation. For instance, addition in the word meaning combination is defined as z = z 1 + z 2 = r 1 e i 1 + r 2 e i 2 = (cid:113) r 21 + r 22 + 2 r 1 r 2 cos(  2   1 )  e i arctan (cid:16) r 1 sin(  1)+ r 2 sin(  2) r 1 cos(  1)+ r 2 cos(  2) (cid:17) (7) where z 1 and z 2 are the values for the corresponding element for two different word vectors | w 1 (cid:105) and | w 2 (cid:105) respectively. Both the amplitudes and complex phases of z are added with a nonlinear combination of phases and amplitudes of z 1 and z 2 . A classical linear addition gives  z = r 1 + r 2 , which can be viewed as a degenerating case of the complex-valued addition with the phase information being removed (  1 =  2 = 0 in the example). Towards the interpretable matching issue, we propose two research questions to investigate the possibility of language modelling with quantum mathematical framework. To this end, we design a new framework to model all the linguistic units in a unified Hilbert space with well-defined mathematical constraints and explicit physical meaning. We implement the above framework with neural network and then demonstrate its effectiveness in question answering (QA) task. Due to the well-designed components, our model is advantageous with its interpretability in term of transparency and post-hoc interpretability, and also shows its potential to use complex-valued components in NLP. Despite the effectiveness of the current network, we would like to further explore the phase part in complex-valued word embedding to directly link to concrete semantics such as word sentiment or word position. Another possible direction is to borrow other quantum concepts to capture the interaction and non-interaction between word semantics, such as the Fock Space (Sozzo, 2014) which considers both interacting and noninteracting entities in different Hilbert Spaces. Furthermore, a deeper and robust quantum-inspired neural architecture in a higher-dimension Hilbert space like (Zhang et al., 2018b) is also worth to be investigated for achieving stronger performances with better explanatory power. We thank Sagar Uprety, Dawei Song, and Prayag Tiwari for helpful discussions. Peng Zhang and Peter Bruza gave us constructive comments to improve the paper. The GPU computing resources are partly supported by Beijing Ultrapower Software Co., Ltd and Jianquan Li. Anne Elize R. V. Lima helped us redraw the figures using her talent. The three authors are supported by the Quantum Access and Retrieval Theory (QUARTZ) project, which has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skodowska-Curie grant agreement No. 721321.
abstain abstain abstain abstain abstain abstain abstain abstain abstain method abstain other objective objective abstain abstain abstain abstain method abstain method abstain method abstain abstain abstain objective abstain objective result other other other other method other other other other other other other other other other other other other other method abstain abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain method abstain abstain abstain abstain method abstain abstain abstain abstain abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method abstain abstain other abstain abstain abstain method abstain other abstain abstain method abstain abstain abstain abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain other other result abstain abstain abstain abstain abstain result abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain result abstain abstain abstain result abstain abstain abstain result abstain abstain abstain abstain abstain abstain abstain result abstain abstain abstain abstain method abstain abstain abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain method abstain abstain abstain method abstain result abstain abstain abstain method method abstain abstain abstain abstain abstain abstain method abstain method abstain other abstain abstain objective objective objective result objective abstain abstain other other other other other