Apache Iceberg version
0.10.0 (latest release)
Please describe the bug 🐞
My python version is 3.12. When I use pyiceberg to read a dataset table created Dremio using below code, i got "Cannot promote timestamp to timestamptz" error but if i use the same dataset to create table in spark, the table can be loaded correctly.
namespace = "test"
table_name = "Files_Created_by_Dremio"
table = nessie_catalog.load_table(f"{namespace}.{table_name}")
table.scan().to_pandas()
ResolveError: Cannot promote timestamp to timestamptz
The tables i created on Dremio and spark are actually from the same dataset.
in dremio:
CREATE TABLE nessie.test.Files_Created_by_Dremio AS
select * from nessie.test.Files
in spark
CREATE TABLE nessie.test.Files_Created_by_Spark AS
select * from nessie.test.Files
Willingness to contribute