How to do it...

You can use client-node1 to configure Hadoop S3A client. 

  1.  Install Java packages in the client-node1:
        # yum install java* -y
  1. Extract the Hadoop .tar file:
        # tar -xvf hadoop-2.7.3.tar.gz 
  1. Add the following in the .bashrc file: 
        export JAVA_HOME=/usr/lib/jvm/jre-1.8.0-openjdk
export
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/
bin:/root/hadoop-2.7.3/bin
  1. Update the /root/hadoop-2.7.3/etc/hadoop/core-site.xml file with the following details. Add the RGW node IP and Port and we have the RGW user pratima as the access key and secret key.
  1. You can now upload a file using the hadoop distcp command to your RGW first-bucket:
        # hadoop distcp /root/anaconda-ks.cfg s3a://first-bucket/

You will have initial map logs in the command line:

Once it will finish the upload, you will have the following logs:

  1. Now you can verify if the anaconda-ks.cfg file got uploaded to the first-bucket
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset