title: Why is SparkR-dropna not giving me the desired output?
body: <p>I have applied the following code on airquality dataset available in R, which has some missing values. I want to omit the rows which has NAs</p>
  <pre><code>library(SparkR)
  Sys.setenv('SPARKR_SUBMIT_ARGS'='&quot;--packages&quot; &quot;com.databricks:spark-csv_2.10:1.2.0&quot; &quot;sparkr-shell&quot;')
  
  sc &lt;- sparkR.init(&quot;local&quot;,sparkHome = &quot;/Users/devesh/Downloads/spark-1.5.1-bin-hadoop2.6&quot;)
  
  sqlContext &lt;- sparkRSQL.init(sc)
  
  path&lt;-&quot;/Users/devesh/work/airquality/&quot;
  
  aq &lt;- read.df(sqlContext,path,source = &quot;com.databricks.spark.csv&quot;, header=&quot;true&quot;, inferSchema=&quot;true&quot;)
  
  head(dropna(aq,how=&quot;any&quot;))
  </code></pre>
  <pre>
  Ozone Solar_R Wind Temp Month Day
  1    41     190  7.4   67     5   1
  2    36     118  8.0   72     5   2
  3    12     149 12.6   74     5   3
  4    18     313 11.5   62     5   4
  5    NA      NA 14.3   56     5   5
  6    28      NA 14.9   66     5   6
  </pre>
  <p>The NAs still exist in the output.
  Am I missing something here?</p>