I am following https://davidpallmann.hashnode.dev/hello-athena to connect to Athena from VS 2022 C# using AWSSDK.Athena. In C# code var result = await _client.StartQueryExecutionAsync(queryRequest) , I am getting the below error. "You are not authorized to perform: athena:StartQueryExecution on the resource. After…
I have a JSON file in s3 that I'm trying to run queries against using Athena. When I run my Lambda that tries to call Athena, I get this error: SyntaxError: Unexpected token < in JSON at position 0 at…
I have an S3 bucket that contains multiple different files by date with different schemas (they are not in sub-folders). For example: FileTypeA-032323 FileTypeA-032423 FileTypeA-032523 FileTypeB-032323 FileTypeB-032423 FileTypeC-032323 FileTypeD-032423 FileTypeD-032423 FileTypeD-032523 I need to merge all of the files for…
is there any way to implement top 1 result from each group without using ROW_NUMBER? table_a below has already 1 billion rows, so I want to use the most efficient way. And the below query is what I'm using. SELECT…
I have two string formatted columns in my table. One of the columns has json objects in it. The keys in the JSON objects are not fixed - so the problem is I cant use standard json extract functions. Here…
I have a column in my table with the name: efcodmov, every start of the month I need to extract all registers from the last month end of the code: AND efdtmov BETWEEN date('2023-01-01') AND date('2023-01-31') How can I modify…
Data has headers like _col_0, _col_1, etc. I have a sample data file that has the correct column headers. However, all the data is in snappy/parquet across ~250 files. What is the easiest way to remap the column headers in…
Athena’s documentation states that Port 444 must be open to support streaming query results. I do encounter error while querying Athena via JDBC, and the error is gone as soon as I disable query result streaming and use pagination. I…
I have a json formatted like: myjson = {"key":["value1","value2"]} and a I want to convert it as string Sometime this json can return null: myjson = {"key":null} . I want to get the values as a string, but I get…
I'm creating a table in Athena based on a list of CSV files in an S3 bucket. The files in the buckets are placed in folders like this: $ aws s3 ls s3://bucket-name/ --recursive 2023-01-23 16:05:01 25601 logs2023/01/23/23/analytics_Log-1-2023-01-23-23-59-59-6dc5bd4c-f00f-4f34-9292-7bfa9ec33c55 2023-01-23 16:10:03…