HDInsights

• See https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-port-settings-for-services or similar for port numbers used by Livy and other services. They may differ from what you would assume based on "well-known" port numbers.
• Installing latest version of R:

#!/bin/bash

set -euf -o pipefail -x

sudo apt-get update
sudo apt-get install -y gfortran libreadline-dev libxml2-dev libcurl4-openssl-dev libpcre2-dev libbz2-dev liblzma-dev
wget https://cran.r-project.org/src/base/R-4/R-4.0.0.tar.gz
tar xf R-4.0.0.tar.gz
cd R-4.0.0
./configure --prefix=/usr --with-x=no
make -j4
sudo make install

• May need to first set livy.server.csrf_protection.enabled to false in /etc/livy2/conf/livy.conf
• Launching livy-server:

su - livy
mkdir -p /var/log/livy2
/usr/hdp/3.1.2.7-1/livy2/bin/livy-server start