Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix indentation for zookeeper annotations #15

Open
wants to merge 31 commits into
base: master
Choose a base branch
from
Open

Fix indentation for zookeeper annotations #15

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
25b6664
DX-15734: add dremio-admin
Mar 29, 2019
a54caa8
DX-15692: configurable zookeeper resource properties
Apr 4, 2019
a7bff69
DX-15572: Add support of uploads in S3 or ADLS
Apr 4, 2019
e7ceae3
DX-15693: enable nodeSelector for pods
Apr 9, 2019
85252f0
DX-15949: enable readiness probe for dremio-master
Apr 9, 2019
1fb92f7
DX-16307: Deploy to Azure using ARM templates
May 10, 2019
72bd56d
DX-16307: change the message for password chars
May 13, 2019
ac9811c
rebase to 3.2 release
May 13, 2019
8f40a51
DX-16588: Remove unnecessary space
May 21, 2019
0238c7a
DX-16610: Remove the strategy from templates
May 22, 2019
28a2443
DX-16550: Support for Cloudformation in AWS
May 21, 2019
4b85995
DX-16739: open port 80
May 29, 2019
7e4c516
DX-16813: Add attribute for reverse DNS
Jun 4, 2019
b2fc9c0
DX-16712: Use Azure Storage for uploads and accelerator data
Jun 6, 2019
6ac0ad9
DX-16710: Configure accelerator and uploads to Storage V2
Jun 5, 2019
ea97ae2
DX-16819: Add TLS support in Helm chart.
ryantse Jun 10, 2019
6519a4f
DX-17385: Dockerfile to build dremio/cloud-tools
Jul 11, 2019
0ed2e68
DX-18003: Fixed CloudFormation template for security group ingress.
mikhaildremio Aug 9, 2019
228380a
DX-18724: Scale memory sizes with instance sizes
Sep 18, 2019
fd8e425
DX-18733: Enable C3 on Dremio executors for CFTs.
ryantse Sep 19, 2019
d199978
Add Helm C3 executor and dist store caching
ryantse Sep 19, 2019
45a0484
Revert "Add Helm C3 executor and dist store caching"
ryantse Sep 27, 2019
c8124e9
DX-18737: Add Helm C3 executor and dist store caching
ryantse Sep 27, 2019
ea3f65d
DX-23723: Update ARM template base image reference.
ryantse Jul 30, 2020
575e58e
DX-23310: Dremio Helm Chart v2
ryantse Aug 10, 2020
ccc5de8
DX-23310: Deprecate Helm Chart v1
ryantse Aug 14, 2020
6f2f2ef
DX-24910: Fix storage class in Helm chart.
ryantse Aug 27, 2020
c8e9c86
DX-25650: Fix context for extraInitContainers.
ryantse Oct 5, 2020
4f3a112
DX-25897: Add Flight support to Dremio v2 Helm chart.
Oct 19, 2020
a4c16f6
DX-27781: Fix annotations/labels in Helm chart
ryantse Jan 26, 2021
c3bf915
Fix indentation for zookeeper annotations
rockpunk Apr 14, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
9 changes: 5 additions & 4 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
# Dremio Container Tools
# Dremio Cloud Tools

This repository contains:
This repository contains tools and utilities to deploy Dremio to cloud environments:

* Tools to build [Dremio Docker images](images/dremio-oss).
* Example [helm chart](charts/dremio) to deploy Dremio to Kubernetes.
* [Dockerfile](images/dremio-oss) to build Dremio Docker images.
* [Helm chart](charts/dremio) to deploy Dremio to Kubernetes.
* [Azure Resource Manager (ARM) template](azure/arm-templates) to deploy to Azure.

These are currently *experimental* items and should be evaluated and extended based on individual needs.
34 changes: 34 additions & 0 deletions aws/cloudformation/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@

# Deploying Dremio to AWS

_Note:_ To try on AWS, you should have:
* Permission to create Security Groups
* An AWS key pair created
* (Optional) A VPC and subnet created if you want to install to a non-default VPC

Try it out [![AWS Cloudformation](https://s3.amazonaws.com/cloudformation-examples/cloudformation-launch-stack.png)](https://us-east-2.console.aws.amazon.com/cloudformation/home?region=us-east-2#/stacks/new?templateURL=https://s3-us-west-2.amazonaws.com/aws-cloudformation.dremio.com/dremio_cf.yaml&stackName=myDremio)

This deploys a Dremio cluster on EC2 instances. The deployment creates a master coordinator node and number of executor nodes depending on the size of the cluster chosen. The table below provides the machine type and number of executor nodes for the different sizes of Dremio clusters.

| Cluster size | Coordinator VM Type | Executor VM Type | No. of Executors |
|--------------|---------------------|------------------|------------------|
| X-Small | m5.2xlarge | r5d.4xlarge | 1 |
| Small | m5.2xlarge | r5d.4xlarge | 5 |
| Medium | m5.4xlarge | r5d.4xlarge | 10 |
| Large | m5.4xlarge | r5d.4xlarge | 25 |
| X-Large | m5.4xlarge | r5d.4xlarge | 50 |

Make sure you are in the AWS region you are planning to deploy your cluster in.

The inputs required during deployment are:

|Input Parameter|Description |
|---|---|
| Stack name |Name of the stack. |
| Cluster Size |Pick a size based on your needs.|
| Deploy to VPC |VPC to deploy the cluster into.|
| Deploy to Subnet |Subnet to deploy the cluster into. Must be in the selected VPC.|
| Dremio Binary | Publicly accessible URL to a Dremio installation RPM |
| AWS keypair | AWS key pair to use to SSH to the VMs. SSH username for the VMs are centos (has sudo privilege). SSH into machines for changing configuration, reviewing logs, etc. |

Once the deployment is successful, you will find the URL to Dremio UI in the output section of the deployment.