Installing into Azure Databricks. Could you document recommended arcgis & databricks runtime versions and prerequisites?

[outsidecave]

Could you document:

• the install process
• the versions of the arcgis library and what is the recommended version of the azure databricks runtime?

I've had varying levels of success when installing. For example I've had to create dependencies files in the past, but only at some runtime versions

e.g.

ujson
requests
pandas
six
requests_toolbelt
requests_ntlm
ntlm_auth
cachetools
lxml
requests_oauthlib
geomet

and at other times it just worked, depending on cluster version.

Thanks