Hopefully final fix to databricks volume

Author: mateuszkuprowski

CHANGELOG.md

@@ -1,7 +1,7 @@
 ## [1.2.21]
 
 * **fix: Enforce minimum version of databricks-sdk (>=0.62.0) for databricks-volumes connector**
-* **fix: Update databricks-volumes connector to use correct API parameter (data instead of contents) for files.upload() method in databricks-sdk >=0.62.0**
+* **fix: Update databricks-volumes connector to wrap file contents in io.BytesIO for compatibility with files.upload() BinaryIO requirement in databricks-sdk >=0.62.0**
 * **fix: Add constraints to prevent platform compatibility issues with tritonclient/perf-analyzer dependencies**
 
 ## [1.2.20]

unstructured_ingest/processes/connectors/databricks/volumes.py

@@ -1,3 +1,4 @@
+import io
 import os
 from abc import ABC
 from dataclasses import dataclass
@@ -220,9 +221,12 @@ def run(self, path: Path, file_data: FileData, **kwargs: Any) -> None:
         output_path = self.get_output_path(file_data=file_data)
         with open(path, "rb") as elements_file:
             try:
+                # Read file bytes and wrap in BytesIO to create BinaryIO object
+                file_bytes = elements_file.read()
+                binary_data = io.BytesIO(file_bytes)
                 self.connection_config.get_client().files.upload(
                     file_path=output_path,
-                    data=elements_file,
+                    contents=binary_data,
                     overwrite=True,
                 )
             except Exception as e: