Databricks Distributed File System DBFS vs my FILES on local driver node of Spark cluster

Поділитися
Вставка
  • Опубліковано 14 жов 2024
  • Q by my viewers: When work with files on the local driver node of Spark cluster vs distributed Databricks DBFS?
    Databricks File System (DBFS) is a distributed file system mounted into a Databricks workspace and available on Databricks clusters. DBFS is an abstraction on top of scalable object storage.
    Databricks uses a FUSE mount to provide local access to files stored in the cloud. A FUSE mount is a secure, virtual filesystem.
    Credits to:
    docs.databrick...
    #databricks
    #dbfs
    #DriverNode_SparkCluster
    #pyspark
    #cluster
    #deeplearning
    #ai

КОМЕНТАРІ • 4

  • @ociabi
    @ociabi Рік тому

    Would be cool to see an end-to-end sbart mlops example with databricks spark cluster implementation. Thanks for this community leader sir!

  • @ashwinkumar5223
    @ashwinkumar5223 Рік тому

    Very Nice👍