Using AWS Firehose to ingest data into an Iceberg table managed by AWS Glue, I'm unable to insert timestamp data. Firehose I'm trying to insert data using the following script: json_data = json.dumps( { "ADF_Record": { "foo": "bar", "baz": "2024-09-04T18:56:15.114"…
I have some Athena databases which contain a number of tables, and I know some of these tables use the Iceberg format. It's important to me to know which are Iceberg tables, because those will allow a greater range of…
I'm running the following sql in Athena to create a partition ALTER TABLE database.table ADD PARTITION (partitionone='123', partitiontwo='456') LOCATION 's3://<s3-bucket>/data/partitionone=123/partitiontwo=456'; but I'm getting an error Query type not supported by Athena Iceberg at this time I've tried running MSCK REPAIR…
i'm trying to play around with the platforms, creating some sort of data lake/warehouse. So i have the minio instance on localhost:9000, and can i use the ui and upload files. great. I create the network named spark network and…