title: AWS Data pipeline CSV data from S3 to DynamoDB
body: <p>I am trying to transfer CSV data from S3 bucket to DynamoDB using AWS pipeline, following is my pipe line script, it is not working properly, </p>
  
  <p>CSV file structure</p>
  
  <pre><code>Name, Designation,Company
  
  A,TL,C1
  
  B,Prog, C2
  </code></pre>
  
  <p>DynamoDb : N_Table, with Name as hash value</p>
  
  <pre><code>{
  "objects": [
      {
          "id": "Default",
          "scheduleType": "cron",
          "name": "Default",
          "role": "DataPipelineDefaultRole",
          "resourceRole": "DataPipelineDefaultResourceRole"
      },
      {
          "id": "DynamoDBDataNodeId635",
          "schedule": {
              "ref": "ScheduleId639"
          },
          "tableName": "N_Table",
          "name": "MyDynamoDBData",
          "type": "DynamoDBDataNode"
      },
      {
          "emrLogUri": "s3://onlycsv/error",
          "id": "EmrClusterId636",
          "schedule": {
              "ref": "ScheduleId639"
          },
          "masterInstanceType": "m1.small",
          "coreInstanceType": "m1.xlarge",
          "enableDebugging": "true",
          "installHive": "latest",
          "name": "ImportCluster",
          "coreInstanceCount": "1",
          "logUri": "s3://onlycsv/error1",
          "type": "EmrCluster"
      },
      {
          "id": "S3DataNodeId643",
          "schedule": {
              "ref": "ScheduleId639"
          },
          "directoryPath": "s3://onlycsv/data.csv",
          "name": "MyS3Data",
          "dataFormat": {
              "ref": "DataFormatId1"
          },
          "type": "S3DataNode"
      },
      {
          "id": "ScheduleId639",
          "startDateTime": "2013-08-03T00:00:00",
          "name": "ImportSchedule",
          "period": "1 Hours",
          "type": "Schedule",
          "endDateTime": "2013-08-04T00:00:00"
      },
      {
          "id": "EmrActivityId637",
          "input": {
              "ref": "S3DataNodeId643"
          },
          "schedule": {
              "ref": "ScheduleId639"
          },
          "name": "MyImportJob",
          "runsOn": {
              "ref": "EmrClusterId636"
          },
          "maximumRetries": "0",
          "myDynamoDBWriteThroughputRatio": "0.25",
          "attemptTimeout": "24 hours",
          "type": "EmrActivity",
          "output": {
              "ref": "DynamoDBDataNodeId635"
          },
          "step": "s3://elasticmapreduce/libs/script-runner/script-runner.jar,s3://elasticmapreduce/libs/hive/hive-script,--run-hive-script,--hive-versions,latest,--args,-f,s3://elasticmapreduce/libs/hive/dynamodb/importDynamoDBTableFromS3,-d,DYNAMODB_OUTPUT_TABLE=#{output.tableName},-d,S3_INPUT_BUCKET=#{input.directoryPath},-d,DYNAMODB_WRITE_PERCENT=#{myDynamoDBWriteThroughputRatio},-d,DYNAMODB_ENDPOINT=dynamodb.us-east-1.amazonaws.com"
      },
      {
          "id": "DataFormatId1",
          "name": "DefaultDataFormat1",
          "column": [
              "Name",
              "Designation",
              "Company"
          ],
          "columnSeparator": ",",
          "recordSeparator": "\n",
          "type": "Custom"
      }
  ]
  </code></pre>
  
  <p>}</p>
  
  <p>Out of four steps while executing the pipeline, two are getting finished, but it is not executing completely</p>