Automated Rancher Node Deployment in vCD

General Information

Create a repeatable process of deploying a kubernetes node cluster for use with Rancher v2. This is for VMware vCLoud Director deployment and only currently handles the node side of deployment.

At first I was going to include the rancher side as well, but two things. It may be control by a different team and thier maybe only one instance. So putting the process into one automated deployment didn't make sense.Second the current VPN handling of the terraform vCD plugin will destroy other VPNs already created on the edge.

Tools and Referances

• Terraform - v11.3 - Installed Locally
  • Terraform.vCD - Plugin
  • Terraform.ansible - Plugin
• Ansible - Installed locally
• GO - Used to create the two needed plugins for terraform
• Ubuntu - As base image in catalog
• Rancher - v2.2 Installed Remotely

Folder Structure

├── .terraform.d                                    <--- Created During Ansible Creation
│   ├── plugins
│       ├── terraform-provider-vcd_v#               <--- Terraform vCD Plugin
│       ├── terraform-provisioner-ansible_v#        <--- Terraform Ansible Plugin
|
└── Deployments
    ├── Production - Phx
    │   ├── *.tf
    │   ├── *.tfvars
    │   ├── .terrform                               <--- Create when initalized
    │   └── ansible-date                            <--- Folder Structure for [ansible](https://docs.ansible.com/ansible/latest/user_guide/playbooks_reuse_roles.html)
    │       ├── playbooks
    │       │   ├── ps_k8s.yml                      <--- Define variables and calls rolls  
    │       └── roles
    │           ├── docker
    │           │   ├── meta
    │           │   │   ├── main.yml                <--- Dependancies for roels 
    │           │   ├── tasks
    │           │       ├── main.yml                <--- Tasks that will Run
    │           └── <addition roles>
    ├── <Addition Deployments>

Variable File

• vCD Provider Info - Case Sensitive - Basic vCD Provider Infomarmation (terraform.vcd)
• Catalog Image Info - Location of Base image to build off (terraform.vcd)
• Rancher Info - Rancher Instance connecting to and the node run command - LEAVE ROLE OFF (terraform)
• Cluster info - Naming and IP for Edge and to use for SNAT. Note: I plan to make snat optional and add proxy option in the future
• Controlplane/ETCD/WORKER info - Naming and Network setting for each node components
• VPN - Connection to Rancher and JumpBox - Not production ready as kept deleting alreday define roles. Suggest manually setting up VPN for now, leveraging api/vcd-cli, or just good old plain routing.

###Sample .tfvars You can copy and paste this into a *.tfvars file to get you started.

#-------------------------------------------#
# vCD Provider Info - Case Sensitive
#-------------------------------------------#
vcd_user = ""
vcd_pass = ""
vcd_org = ""
vcd_vdc = ""
vcd_url = "" #"https://domain/api"
vcd_edge = ""

#-------------------------------------------#
# Catalog Image Info
#-------------------------------------------#
vcd_catalog = ""
vcd_template = ""
vcd_template_username = ""
vcd_template_pass =  ""

#-------------------------------------------#
# Rancher Info
#-------------------------------------------#
net_rancher_ip = ""
node_run_cmd = "" #leave node role off

#-------------------------------------------#
# Cluster info
#-------------------------------------------#
cluster_name = ""
net_edge_ip = "0.0.0.0"
net_snat_ip = "0.0.0.0"

#-------------------------------------------#
# Controlplane info
#-------------------------------------------#
node_cp_cnt = 1 #1 or more
node_cp = ""
net_cp_name = ""
net_cp_cidr = "0.0.0.0/0"
net_cp_dns = {
    "DNS1" = "8.8.8.8"
    "DNS2" = "8.8.4.4"
}

#-------------------------------------------#
# Etcd info
#-------------------------------------------#
node_etcd_cnt = 1 #1, 3, or 5
node_etcd = ""
net_etcd_name = ""
net_etcd_cidr = "0.0.0.0/24"
net_etcd_dns = {
    "DNS1" = "8.8.8.8"
    "DNS2" = "8.8.4.4"
}

#-------------------------------------------#
# Worker info
#-------------------------------------------#
node_work_cnt = 1 #1 or more
node_work = ""
net_work_name = ""
net_work_cidr = "0.0.0.0/24"
net_work_dns = {
    "DNS1" = "8.8.8.8"
    "DNS2" = "8.8.4.4"
}

#-------------------------------------------#
# VPN - Connection to Rancher and JumpBox
#-------------------------------------------#
vpn_enable = "false"  # <--Do you need a VPN Connection [Default: false]?
vpn_vdc = ""
vpn_edge = ""
vpn_edge_ip = "0.0.0.0"
##Local##
vpn_rancher_cidr = "0.0.0.0/24"
vpn_jump_cidr = "0.0.0.0.0/24"
vpn_secret = ""