Databricks has at least four ways to interact with the file system, namely the following.
- DBUTILS — Databricks Package
- FS — Magic Command
- OS — Python Libraray
- SH — Magic Command
OS and SH are primary for the operating systems files and dbfs files.
In This Article, we look at all examples to list the file from Databricks data sets.
Databricks has plenty of Datasets for learning and practice in /databricks-datasets/ path. The link to the article explains how to access and what all data sets are available.