title: How to write huge table data to file | Informatica 10.x
body: <p>I have created a Informatica flow</p>
  <p>where I need to read data from table that to only one column which contain <code>empids</code>.</p>
  <p>But the column might contain duplicate need to write distinct values to file from below query</p>
  <p><strong>Query :</strong></p>
  <pre><code>select distinct
     emp_id 
  from
     employee 
  where
     empid not in 
     (
        select distinct
           custid 
        from
           customer
     );
  </code></pre>
  <p>I have added the above query in <code>Source Qualifier</code></p>
  <p>employee table contains : <code>5</code> <strong>million records</strong> and customer table contains : <code>20</code> <strong>billion records</strong></p>
  <p>My Informatica is still running not got completed - <code>6 hours</code> over till now and nothing is written to file because of huge data in both tables</p>
  <p><strong>Following is my query plan</strong></p>
  <pre><code>--------------------------------------------------------------------
  Id   | Operation                                     |  Name       |
  --------------------------------------------------------------------
  0    | SELECT STATEMENT                              |             |
  1    |   AX COORDINATOR                              |             |
  2    |     AX SEND QC (RANDOM)                       | :AQ10002    |
  3    |       HASH UNIQUE                             |             |
  4    |          AX RECEIVE                           |             |
  5    |             AX SEND HASH                      | :AQ10001    |
  6    |               HASH UNIQUE                     |             |
  7    |                  HASH JOIN ANTI               |             |
  8    |                     AX RECEIVE                |             |
  9    |                       AX SEND PARTITION (KEY) | :AQ10000    |
  10   |                          AX SELECTOR          |             |
  11   |              INDEX FAST FULL SCAN             | PK_EMP_ID   |
  12   |           AX PARTITION RANGE ALL              |             |
  13   |              INDEX FAST FULL SCAN             | PK_CUST_ID  |
  --------------------------------------------------------------------
  </code></pre>
  <p><strong>Sample table data :</strong></p>
  <p><strong>employee</strong></p>
  <pre><code>111
  123
  145
  1345
  111
  123
  145
  678
  ....
  </code></pre>
  <p><strong>customer</strong></p>
  <pre><code>111
  111
  111
  1345
  111
  145
  145
  145
  145
  145
  145
  ....
  </code></pre>
  <p><strong>Expected output :</strong></p>
  <pre><code>123
  678
  </code></pre>
  <p>Any solution is much appreciated !!!</p>