Git dependencies with pdm fail with error: attribute 'files' missing

[rupurt]

When using the pdm module with git dependencies in pyproject.toml building the derivations fails.

# pyproject.toml
dependencies = [
    # "aioftp >=0.22.0",
    # patched version of aioftp to support custom subcommands
    "aioftp @ git+https://github.com/rupurt/aioftp.git@server-can-add-custom-commands-mapping",
]

error:
       … while calling the 'derivationStrict' builtin
         at <nix/derivation-internal.nix>:34:12:
           33|
           34|   strict = derivationStrict drvAttrs;
             |            ^
           35|

       … while evaluating derivation 'nix-shell'
         whose name attribute is located at /nix/store/7z8msq6a39p88nnfzagpzbykahiz1hrq-source/pkgs/stdenv/generic/make-derivation.nix:336:7

       … while evaluating attribute 'buildInputs' of derivation 'nix-shell'
         at /nix/store/7z8msq6a39p88nnfzagpzbykahiz1hrq-source/pkgs/stdenv/generic/make-derivation.nix:383:7:
          382|       depsHostHost                = elemAt (elemAt dependencies 1) 0;
          383|       buildInputs                 = elemAt (elemAt dependencies 1) 1;
             |       ^
          384|       depsTargetTarget            = elemAt (elemAt dependencies 2) 0;

       … while evaluating the option `groups.default.packages.aioftp."0.24.1".evaluated.public.outPath':

       … while evaluating definitions from `/nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/package-func':

       … while evaluating the option `groups.default.packages.aioftp."0.24.1".evaluated.package-func.result':

       … while evaluating definitions from `/nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/package-func':

       … while evaluating the option `groups.default.packages.aioftp."0.24.1".evaluated.package-func.args':

       … while evaluating definitions from `/nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/mkDerivation':

       … while evaluating the option `groups.default.packages.aioftp."0.24.1".evaluated.mkDerivation.buildInputs':

       … while evaluating definitions from `/nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/WIP-python-pdm, via option overrideType':

       … while evaluating the option `groups.default.packages.aioftp."0.24.1".evaluated.mkDerivation.src':

       … while evaluating definitions from `/nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/WIP-python-pdm, via option groups.default.packages.aioftp."0.24.1".module':

       … while evaluating definitions from `/nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/WIP-python-pdm':

       (stack trace truncated; use '--show-trace' to show the full, detailed trace)

       error: attribute 'files' missing
       at /nix/store/d858pcyym8hif6wbjqqpjdffgavi43qy-source/modules/dream2nix/WIP-python-pdm/lib.nix:177:30:
          176|   parsePackage = environ: item: let
          177|     sources = sourcesToAttrs item.files;
             |                              ^
          178|     compatibleSources =

[jess-sol]

This also occurs with local packages referenced in the pyproject.toml file:

depedencies = [
  "pkg @ file:///${PROJECT_ROOT}/contrib/pkg",
]

It may make sense to default to the path/uri after the @ sign if one is present, instead of looking for the files section in the lockfile.

[rupurt]

@jess-sol yeah I ran into that also.

I managed to find a workaround for now by building the python packages manually in the overrides. However if it's a complicated dependency it becomes a lot more tricky...

[h0nIg]

@jess-sol @rupurt running into the same issue, can you please share how you tackled this in detail?

[rupurt]

@h0nIg are you dealing with a public or private repo?

[rupurt]

For a public repo in the default.nix add an override e.g.

  overrides = {
    # dream2nix pdm doesn't currently support git dependencies
    # - https://github.com/nix-community/dream2nix/issues/1083
    aioftp = {
      mkDerivation = {
        src = config.deps.fetchFromGitHub {
          name = "aioftp";
          owner = "rupurt";
          repo = "aioftp";
          rev = "1308c03c5905644f2b29e885bc3c2f1aba80d42a";
          hash = "sha256-god9KnvUE0jp0odTMhIhdwLN76OhyPH1dmeTmox3X4g=";
        };
      };
      buildPythonPackage = {
        format = "pyproject";
      };
    };