Problem with `pyarrow` dependency when installing dask-deltatable

[avriiil]

I'm following the README instructions to install dask-deltatable from conda-forge. It fails with the following error message

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versionsThe following specifications were found to be incompatible with your system:

  - feature:/osx-arm64::__osx==12.7.1=0
  - feature:|@/osx-arm64::__osx==12.7.1=0
  - dask-deltatable -> pyarrow -> __osx[version='>=10.9']

Your installed version is: 12.7.1

Seems strange since clearly my osx version satisfies the >=10.9 condition. Will investigate further but leaving it here in case others run into the same problem.

I'm running on an M1 Mac with python==3.9

[ EDIT ]

• creating a clean conda env and running the conda install -c conda-forge dask-deltatable fails with a similar error

[avriiil]

Got it working with pip install dask-deltatable so I'm assuming something's up with the conda solver/reqs.

[jacobtomlinson]

@charlesbluca do you have any time to look into this?

[charlesbluca]

I can't reproduce this locally because I don't have an osx-arm64 Mac, but my first guess is that we're somehow transitively pinning pyarrow in some way such that there aren't builds available for osx-arm64?

creating a clean conda env

Is this also an environment pinning python=3.9? A little interested in if things are able to solve with python unpinned, might also be able to get some useful information trying this with more recent versions of mamba (if you haven't already) which should provide some more context around the solve failure which could be helpful