libfoundation_models.dylib is missing from the wheel

[simonw]

After failing to run llm-apple directly I downloaded the wheel from here:

https://pypi.org/project/apple-foundation-models/#apple_foundation_models-0.1.3-cp311-cp311-macosx_10_9_universal2.whl

Then tried running it like this:

uvx --python 3.11 --with apple_foundation_models-0.1.3-cp311-cp311-macosx_10_9_universal2.whl \
  --with llm-apple llm -m apple hi

I got this error:

Error: dlopen(/Users/simon/.cache/uv/archive-v0/TDqumhsiDpH6HKB6N1PE8/lib/python3.11/site-packages/applefoundationmodels/_foundationmodels.cpython-311-darwin.so, 0x0002): Library not loaded: @rpath/libfoundation_models.dylib
  Referenced from: <7E7FBA62-C4A4-3364-AACC-9A73D8C0663A> /Users/simon/.cache/uv/archive-v0/TDqumhsiDpH6HKB6N1PE8/lib/python3.11/site-packages/applefoundationmodels/_foundationmodels.cpython-311-darwin.so
  Reason: tried: '/private/var/folders/2h/ld7l40j52ld3xm5md0h0md740000gn/T/build-via-sdist-0kok7i5k/apple_foundation_models-0.1.3/lib/libfoundation_models.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/private/var/folders/2h/ld7l40j52ld3xm5md0h0md740000gn/T/build-via-sdist-0kok7i5k/apple_foundation_models-0.1.3/lib/libfoundation_models.dylib' (no such file), '/Users/simon/.cache/uv/archive-v0/TDqumhsiDpH6HKB6N1PE8/lib/python3.11/site-packages/applefoundationmodels/../lib/libfoundation_models.dylib' (no such file), '/Users/simon/.cache/uv/archive-v0/TDqumhsiDpH6HKB6N1PE8/lib/python3.11/site-packages/applefoundationmodels/libfoundation_models.dylib' (no such file), '/private/var/folders/2h/ld7l40j52ld3xm5md0h0md740000gn/T/build-via-sdist-0kok7i5k/apple_foundation_models-0.1.3/lib/libfoundation_models.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/private/var/folders/2h/ld7l40j52ld3xm5md0h0md740000gn/T/build-via-sdist-0kok7i5k/apple_foundation_models-0.1.3/lib/libfoundation_models.dylib' (no such file), '/Users/simon/.cache/uv/archive-v0/TDqumhsiDpH6HKB6N1PE8/lib/python3.11/site-packages/applefoundationmodels/../lib/libfoundation_models.dylib' (no such file), '/Users/simon/.cache/uv/archive-v0/TDqumhsiDpH6HKB6N1PE8/lib/python3.11/site-packages/applefoundationmodels/libfoundation_models.dylib' (no such file)

I looked in the wheel and found these files:

/tmp % unzip -l apple_foundation_models-0.1.3-cp311-cp311-macosx_10_9_universal2.whl
Archive:  apple_foundation_models-0.1.3-cp311-cp311-macosx_10_9_universal2.whl
  Length      Date    Time    Name
---------  ---------- -----   ----
     1072  11-06-2025 20:56   apple_foundation_models-0.1.3.dist-info/licenses/LICENSE
     2433  11-06-2025 20:56   applefoundationmodels/__init__.py
   542611  11-06-2025 20:56   applefoundationmodels/_foundationmodels.c
   248136  11-06-2025 20:56   applefoundationmodels/_foundationmodels.cpython-311-darwin.so
     2182  11-06-2025 20:56   applefoundationmodels/_foundationmodels.pxd
    10819  11-06-2025 20:56   applefoundationmodels/_foundationmodels.pyx
      873  11-06-2025 20:56   applefoundationmodels/base.py
     6011  11-06-2025 20:56   applefoundationmodels/client.py
      917  11-06-2025 20:56   applefoundationmodels/constants.py
     2786  11-06-2025 20:56   applefoundationmodels/exceptions.py
       64  11-06-2025 20:56   applefoundationmodels/py.typed
     7155  11-06-2025 20:56   applefoundationmodels/session.py
     3732  11-06-2025 20:56   applefoundationmodels/types.py
     1382  11-06-2025 20:56   applefoundationmodels/swift/foundation_models.h
    10528  11-06-2025 20:56   applefoundationmodels/swift/foundation_models.swift
    13078  11-06-2025 20:56   apple_foundation_models-0.1.3.dist-info/METADATA
      114  11-06-2025 20:56   apple_foundation_models-0.1.3.dist-info/WHEEL
       22  11-06-2025 20:56   apple_foundation_models-0.1.3.dist-info/top_level.txt
     1817  11-06-2025 20:56   apple_foundation_models-0.1.3.dist-info/RECORD
---------                     -------
   855732                     19 files

Note how _foundationmodels.cpython-311-darwin.so is in there but the libfoundation_models.dylib file isn't.

(Aside: it would be neat if there were wheels for additional versions of Python too.)

[simonw]

The README suggests this file should be included:

apple-foundation-models-py/README.md

Lines 300 to 316 in 57ac01e

	### Project Structure
	```
	apple-foundation-models-py/
	├── applefoundationmodels/ # Python package
	│ ├── __init__.py # Public API
	│ ├── _foundationmodels.pyx # Cython bindings
	│ ├── _foundationmodels.pxd # C declarations
	│ ├── client.py # High-level Client
	│ ├── session.py # Session management
	│ ├── types.py # Type definitions
	│ ├── exceptions.py # Exception classes
	│ └── swift/ # Swift FoundationModels bindings
	│ ├── foundation_models.swift # Swift implementation
	│ └── foundation_models.h # C FFI header
	├── lib/ # Swift dylib and modules (auto-generated)
	│ └── libfoundation_models.dylib # Compiled Swift library

[btucker]

Reopening until pypi/warehouse#19018 lands.

[btucker]

I just came back to this and I think I finally figured out how to properly package the wheels. They have to incorrectly claim they are compatible with older macOS versions, but otherwise I believe this is working now on macOS 26:

> llm install llm-apple # this should cause apple_foundation_models-0.1.8 to be installed
> llm -m apple "where is cupertino?"
Cupertino is a city located in Santa Clara County, California, USA. It is situated along the eastern edge of Silicon Valley and is a short distance from San Jose, California. Cupertino is known for being the headquarters of several major technology companies, including Apple and Intel.

@simonw Does it work for you now?

[btucker]

PyPI now supports macOS 26! New release pushed with properly tagged wheels.