azure-storage-file-datalake-py

Topics in the source

• Azure Data Lake Storage Gen2 SDK for Python
• Installation
• Environment Variables
• Authentication & Lifecycle
• Client Hierarchy
• File System Operations
• Directory Operations
• File Operations

Hierarchical file system for big data analytics workloads. 🔑 Two rules apply to every code sample below: 1. Prefer DefaultAzureCredential. It works locally (Azure CLI / VS Code / Developer CLI) and in Azure (managed identity, workload identity) with no code change. Avoid connection strings, account/API keys — they bypass Entra audit and rotation. - Local dev: DefaultAzureCredential works as-is. - Production: set AZURETOKENCREDENTIALS=prod (or AZURETOKENCREDENTIALS= ) to constrain the credential chain to production-safe credentials. 2. Wrap every client in a context manager so HTTP transports, sockets, and token caches are released deterministically: - Sync: with (...) as client: - Async: async with (...) as client: and async with DefaultAzureCredential() as credential: (from azure.identity.aio) Snippets may abbreviate this setup, but production code should always follow both rules. | Client | Purpose | |--------|---------| | DataLakeServiceClient | Account-level operations | | FileSystemClient | Container (file system) operations | | DataLakeDirectoryClient | Directory operations | | DataLakeFileClient | File operations | 1. Pick sync OR async and stay consistent. Do not mix azure

This is an excerpt. Refer to the complete source and its current requirements.