Answers: <p>As @Vasiliy Shakhunov and @SheldonH have mentioned, there is no straight way to do what I asked in the question. In the end I ended up uploading the keys into AWS with its CLI like this: </p>
  
  <pre><code>aws ec2 import-key-pair --key-name "name_for_the_key" --public-key-material file:///home/user/.ssh/name_for_the_key.pub
  </code></pre>
  
  <p>and then reference it like that:</p>
  
  <pre><code>resource "aws_instance" "test" {
  
      ami = "${var.ami_id}"
  
      ...
  
      key_name      = "name_for_the_key"   
  
      ...
  
  }
  </code></pre>
  
  <p><strong>Note</strong> Yes <code>file://</code> looks like the "Windowsest" syntax ever but you have to use it on linux too.</p>
  
Answers: CC BY-SA 4.0
Answers: 2020-02-13T08:35:28.763Z
Answers: 2020-02-13T08:35:28.763Z
Answers: Kingindanord
Answers: <p>May be a better way to manage private key is using protected variables into the Terraform Cloud. Otherwise you have to save it in repo that is not secure. </p>
  
Answers: CC BY-SA 4.0
Answers: 2020-02-02T17:33:33.243Z
Answers: 2020-02-02T17:33:33.243Z
Answers: Vasiliy  Shakhunov
Answers: <p>Currently when you run terraform against a remote workspace in terraform cloud the repository that you are working in gets uploaded. If your key is contained in that repo and is a relative path from your working directory then it should find it. However, as mentioned in another answer, leaving your key in your repo is not a good security practice. </p>
  
  <p>I'd recommend considering something like SSM parameter store, vault, or other secure method of storing such information. </p>
  
  <p>However there's one additional way you could do this. If you create the key as a resource, then you could refer to this created key as a data source and terraform and everything would be stored in the state file. If you are okay with that then you could abstract the need to have any file locally, and instead store the key value as an output from a related plan or the same plan. </p>
  
  <p>Be aware this still has some security implications if you don't ensure your remote workspace and terraform cloud has security applied to different levels of users in the team plan. I'm a pretty big fan of using the state this way though when possible, Is it simplifies and removes one more extra complexity from my deployment.</p>
  
  <p>The last option is the other user mentioned, is secure variables. this means you would set up a environment variable that is marked as sensitive in the settings. This would prevent it from being in plain text, and might be a viable option if you can just pass it in part of your job. There's a Python library that supports API calls to simplify updating them across the board if you don't want to use the terraform cloud provider for terraform cloud. </p>
  
Answers: CC BY-SA 4.0
Answers: 2020-02-11T09:36:41.517Z
Answers: Thanks for your thoughts, putting the keys in the repo as you said is not a good security practice. My goal is to use Vault, but at this point I am creating the Vault, so I was wondering how can I mange the keys and secrets before having the Vault installed. I am not comfortable using Secure variables in terraform cloud (for some unknown reason). I ended up sending the keys to AWS with it's CLI and then referring their name in the terraform script.
Answers: Kingindanord
Answers: CC BY-SA 4.0
Answers: 2020-02-11T13:38:52.027Z
Answers: @kingindanord nice. Encourage you answer your own question and close this then or ask for more clarity. We don't want to leave the question unopened for providing help for others in the future
Answers: sheldonhull
Answers: CC BY-SA 4.0
Answers: 2020-02-02T20:59:23.943Z
Answers: 2020-02-02T20:59:23.943Z
Answers: sheldonhull
Body: <p>I am creating AWS EC2 instance and I am using Terraform Cloud as backend. </p>
  
  <p>in <strong>./main.tf</strong>:</p>
  
  <pre><code>terraform {
  
      required_version = "~&gt; 0.12"
      backend "remote" {
      hostname     = "app.terraform.io"
      organization = "organization"
      workspaces { prefix = "test-dev-" }
  
    }
  </code></pre>
  
  <p>in <strong>./modules/instances/function.tf</strong></p>
  
  <pre><code>
  resource "aws_instance" "test" {
      ami = "${var.ami_id}"
      instance_type = "${var.instance_type}"
      subnet_id = "${var.private_subnet_id}"
      vpc_security_group_ids = ["${aws_security_group.test_sg.id}"]
      key_name      = "${var.test_key}"                                        
  
      tags = {
          Name = "name"
          Function = "function"
      }
  
    provisioner "remote-exec" {
      inline = [
        "sudo useradd someuser"
      ]
  
      connection {
        host = "${self.public_ip}"
        type        = "ssh"
        user        = "ubuntu"
        private_key = "${file("~/.ssh/mykey.pem")}"
      }
    }
  }
  
  </code></pre>
  
  <p>and as a result, I got the following error:</p>
  
  <pre><code>Call to function "file" failed: no file exists at /home/terraform/.ssh/...
  </code></pre>
  
  <p>so what is happening here, is that terraform trying to find the file in Terraform Cloud instead of my local machine. How can I transfer file from my local machine and still using Terraform Cloud?</p>
  
Comments: CC BY-SA 4.0
Comments: 2020-02-11T08:25:13.820Z
Comments: did my answer provide any help? Answer still shows open. Wanted to know if you got what you needed. Typically any file based input makes me first look at can it be a data source instead. If not and you need a file, then see if my answer helped
Comments: sheldonhull
Tags: <terraform><provisioning>
Title: How to send local files using Terraform Cloud as remote backend?
UserDisplayName: Kingindanord
ThreadText: # How to send local files using Terraform Cloud as remote backend?
  
  (Asked by: username_0 on 2020-02-01)
  
  I am creating AWS EC2 instance and I am using Terraform Cloud as backend.
  
  in **./main.tf**:
  
  ```
  terraform {
  
      required_version = "~> 0.12"
      backend "remote" {
      hostname     = "app.terraform.io"
      organization = "organization"
      workspaces { prefix = "test-dev-" }
  
    }
  
  ```
  
  in **./modules/instances/function.tf**
  
  ```
  
  resource "aws_instance" "test" {
      ami = "${var.ami_id}"
      instance_type = "${var.instance_type}"
      subnet_id = "${var.private_subnet_id}"
      vpc_security_group_ids = ["${aws_security_group.test_sg.id}"]
      key_name      = "${var.test_key}"                                        
  
      tags = {
          Name = "name"
          Function = "function"
      }
  
    provisioner "remote-exec" {
      inline = [
        "sudo useradd someuser"
      ]
  
      connection {
        host = "${self.public_ip}"
        type        = "ssh"
        user        = "ubuntu"
        private_key = "${file("~/.ssh/mykey.pem")}"
      }
    }
  }
  
  ```
  
  and as a result, I got the following error:
  
  ```
  Call to function "file" failed: no file exists at /home/terraform/.ssh/...
  
  ```
  
  so what is happening here, is that terraform trying to find the file in Terraform Cloud instead of my local machine. How can I transfer file from my local machine and still using Terraform Cloud?
  
  **Tags:** terraform, provisioning
  
  > **Comments:**
  > **username_1**: did my answer provide any help? Answer still shows open. Wanted to know if you got what you needed. Typically any file based input makes me first look at can it be a data source instead. If not and you need a file, then see if my answer helped  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_0 on 2020-02-13. Score: 0 | Accepted answer
  
  As @username_2 username_2 and @SheldonH have mentioned, there is no straight way to do what I asked in the question. In the end I ended up uploading the keys into AWS with its CLI like this:
  
  ```
  aws ec2 import-key-pair --key-name "name_for_the_key" --public-key-material file:///home/user/.ssh/name_for_the_key.pub
  
  ```
  
  and then reference it like that:
  
  ```
  resource "aws_instance" "test" {
  
      ami = "${var.ami_id}"
  
      ...
  
      key_name      = "name_for_the_key"   
  
      ...
  
  }
  
  ```
  
  **Note** Yes `file://` looks like the "Windowsest" syntax ever but you have to use it on linux too.
  
  
  ---
  
  ### Answer by username_2 on 2020-02-02. Score: 1
  
  May be a better way to manage private key is using protected variables into the Terraform Cloud. Otherwise you have to save it in repo that is not secure.
  
  
  ---
  
  ### Answer by username_1 on 2020-02-02. Score: 1
  
  Currently when you run terraform against a remote workspace in terraform cloud the repository that you are working in gets uploaded. If your key is contained in that repo and is a relative path from your working directory then it should find it. However, as mentioned in another answer, leaving your key in your repo is not a good security practice.
  
  I'd recommend considering something like SSM parameter store, vault, or other secure method of storing such information.
  
  However there's one additional way you could do this. If you create the key as a resource, then you could refer to this created key as a data source and terraform and everything would be stored in the state file. If you are okay with that then you could abstract the need to have any file locally, and instead store the key value as an output from a related plan or the same plan.
  
  Be aware this still has some security implications if you don't ensure your remote workspace and terraform cloud has security applied to different levels of users in the team plan. I'm a pretty big fan of using the state this way though when possible, Is it simplifies and removes one more extra complexity from my deployment.
  
  The last option is the other user mentioned, is secure variables. this means you would set up a environment variable that is marked as sensitive in the settings. This would prevent it from being in plain text, and might be a viable option if you can just pass it in part of your job. There's a Python library that supports API calls to simplify updating them across the board if you don't want to use the terraform cloud provider for terraform cloud.
  
  > **Comments:**
  > **username_0**: Thanks for your thoughts, putting the keys in the repo as you said is not a good security practice. My goal is to use Vault, but at this point I am creating the Vault, so I was wondering how can I mange the keys and secrets before having the Vault installed. I am not comfortable using Secure variables in terraform cloud (for some unknown reason). I ended up sending the keys to AWS with it's CLI and then referring their name in the terraform script.  
  > **username_1**: @username_0 nice. Encourage you answer your own question and close this then or ask for more clarity. We don't want to leave the question unopened for providing help for others in the future  
  
  ---
  
  