Spark, Spark Core, Rdd, Spark Api.
RDDs can be created using sc.textFile(name, partitions)method. This method takes an URI for the file (either a local path on the machine, or a hdfs://, s3n://, etc URI) and reads it as a collection of lines. RDD of pairs of a file and its content from a directory can can be created using