I want to delete duplicates from a Redshift table that are true duplicates. Below is an example of two rows that are true duplicates. Since it is Redshift, there are no primary keys to the table. Any help is appreciated.…
I have a data source with a bunch of time stamps. I want to find the week start (sunday) date from these time stamps. Eg, I want to go from "2022-11-23 00:00:00.0" --> "2022-11-20" for every date in the column…
This might be difficult to explain. But Im trying to write a redshift sql query where I have want the count of organizations that fall into different market buckets. There are 50 markets. For example company x can be only…
How do I extract/view the csv files created by this block of code? What the code does is pull data from a table and extract the json elements. I am running this code on Jupyter notebook but I can't figure…
I need to create a single table with same column metrics aggregated for different time periods in Redshift SQL. Instead of repeating the code so many times with varying "WHERE" clause, is there a way I can reuse the code…
How do I configure a redshift lambda UDF to batch requests? On this page Creating a scalar Lambda UDF - Amazon Redshift it says in the note section: You can configure batching of multiple invocations of your Lambda function to…
I am still new to Redshift service and quite confused of when to use or what data to put into Spectrum. Suppose I have star schema data warehouse on Redshift, should I put fact table or dim table into Spectrum(external…
I have this code in tableau which I need to convert to Redshift SQL ( zn( sum([Market_Price]) )- zn( sum( if ISNULL([Market_Price]) then null else [Initial_Price] end ) ))/ zn(sum([Market_Price])) I have tried but not getting the same results. Do…
If I have KBs of data every few seconds, is using Kinesis Firehose with a Lambda function to perform a transformation and using Redshift as the target necessarily better than just doing the same except with S3 instead of Kinesis?…
I'm doing a simple COPY command that used to work: echo " COPY table_name FROM 's3://bucket/<date>/' iam_role 'arn:aws:iam::123:role/copy-iam' format as json 's3://bucket/jupath.json' gzip ACCEPTINVCHARS ' ' TRUNCATECOLUMNS TRIMBLANKS MAXERROR 3; " | psql And now I get: INFO: Load into…