File not found error on Azure ADLS gen 2

[prateek-narula]

Description
I want to access/read the .dcm files that are stored on the azure data lake storage gen2. I'm trying to achieve this on databricks spark notebook. When I'm trying to access the .dcm files via dbutils I can get to the file, so there are no access restriction or path issues. But when i try to read it via pydicom.dcmread(path to dcm file) I get file not found error.

To me it seems like pydicom is not able to judge that the path is not local but ADLS path.

Expected behavior
I expect that pdicom is able to read the file over the cloud storage or there should be a way/example/knowledge on how to achieve such a scenario.

Steps To Reproduce

• Create a ADLS gen2 storage
• Upload the dcm files
• Open the databricks notebook
• Add code pydicom.dcmread( path to dcm file )

Environment
pydicom version - 2.3.0
python - 3.8
DBR (dataBricks Runtime) - 10.5 (includes Apache Spark 3.2.1, Scala 2.12)

Error

[darcymason]

I don't know anything about ADLS, but pydicom's dcmread needs either a filename or a "file-like object" passed to it. If there are libraries for ADLS that can give you one of the latter, you shouldn't have any problems. If not, you'd have to retrieve the file and store locally and then read from there.

[mrbean-bremen]

I had a quick look at the ADLS documentation, and as far as I can see, there is no possibility to directly access a file on the storage, you have to download it first (which is the way cloud storage usually works). So @darcymason already answered this - you have to download the file using the ADLS API and access the local copy.