67746/distcp-from-local-to-hdfs-giving-error-file-not-found
I was checking the ways to copy data from local to HDFS, so I found copyFromLocal, put and distcp command. Distcp performs the operation faster than put or copyFromLocal. So I was trying the same but I am receiving the error FIleNotFoundException. Can anyone help to resolve the error?
Hey, @Amey,
This is probably because of a lack of configuration. Try to add the Hadoop configuration files as a resource to the object Configuration:
Configuration conf = new Configuration();
conf.addResource(new Path("/etc/hadoop/conf/core-site.xml"));
conf.addResource(new Path("/etc/hadoop/conf/hdfs-site.xml"));
FileSystem hdfs = FileSystem.get(conf);
I hope this will help. If you get any other queries regarding this, please post it here.
Well, the reason you are getting such ...READ MORE
There are two possible ways to copy ...READ MORE
You dont have to specify the file name ...READ MORE
Step 1: Go to My Lab and ...READ MORE
Please refer to the below code:
import org.apache.hadoop.conf.Configuration
import ...READ MORE
Please make sure you connect to spark2-shell ...READ MORE
Hi@akhtar,
You can copy files from your local ...READ MORE
The distributed copy command, distcp, is a ...READ MORE
Hey!
The error seems like the problem is ...READ MORE
Hey,
You can do one thing, make a ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.