Skip to content

object_store: Support {az,abfs,abfss}://container@account.blob.{core.windows.net,fabric.microsoft.com} URLs #430

@vladidobro

Description

@vladidobro

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Fsspec allows URLs like "az://container@account.blob.core.windows.net" (https://github.com/fsspec/adlfs/blob/38c393299d61895689b96cae5ff21895724e3fe2/adlfs/spec.py#L404),
Object store now supports these urls only if the endpoint is ".dfs.core.windows.net", even if it has support for ".blob.core.windows.net" in the "https://" scheme.
I would like to add support for it in the "az://" scheme, because that seems to me like the best way to have both fsspec and object_store compatible URLs.

Describe the solution you'd like
Allow URLs like "az://container@account.blob.core.windows.net"

Describe alternatives you've considered
Convert all URLs with ".blob.core.windows.net" to ".dfs.blob.core.windows.net" before passing them to object_store, but this is unnecessarily inconvenient.

Additional context
A few days ago a MR in object_store added support for "az://container@account.dfs.core.windows.net" URLs: (#285).

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions