This repository creates a docker image containing the OpenSource version of RStudio, with a set of R packages.
The docker file builds RStudio and packages from source. The packages to install are listed in the R_PKGS environment variable.
The running container accepts the following environment variables.
| Name | Description |
|---|---|
| HTTP_PROXY | The internet proxy for HTTP requests. |
| HTTPS_PROXY | The internet proxy for HTTPS requests. |
| NO_PROXY | URLs that we can connect to directly rather than going via the proxy. |
| USER | The username of the RStudio user. |
| JWT_TOKEN | An identity JWT token used to authenticate against HiveServer2 and Livy |
| LIVY_URL | The url for the livy proxy to connect to for livy requests |
| GITHUB_URL | The DNS name for the version of github to connect to. |
Some of these environment variables are used to setup some of the R config files, so the Dockerfile actually writes dynamic scripts which will use those environment variables at runtime.
Note global changes should be added to the /usr/local/lib/R/etc/Rprofile.site rather than overwriting ~/.RProfile
R Studio can connect via ODBC to Hive using the library(odbc) package which Amazon provides. The odbc.ini file specifies the DSN for the ODBC connection. The connection uses SASL and username/password authentication where the JWT_TOKEN is used as a short lived password.
There is an ODBC PDF is available in the R-Studio image at /opt/amazon/hiveodbc/'Amazon ODBC Driver for Hive Install Guide.pdf'.
R Studio can connect via Livy to Spark using the library(sparklyr) package. Note that the connection details are in the helpers.r.
There is a GitHub Actions pipeline in the DWP organisation which builds and deploys the image to docker hub. The image is then mirrored to ECS via the mirror images pipeline in AWS Concourse.
There is also a pipeline for this repo which creates the ECS repository in mgmt and mgmt-dev.