I have data stored in postgreSQL as data source and I want to load dimensions and fact tables of the clickhouse datawarehouse , I am new to clickhouse and used to use traditional integration tools like Talend and Microsoft SSIS to perform ETL
(PS i’m using docker images for both clickhouse and postgreSQL)
Question posted in PostgreSQL
The official documentation can be found here.
The official documentation can be found here.
2
Answers
Have a look at the PostgreSQL engine integration here where you can perform
SELECT
andINSERT
queries on ClickHouse on data stored in remote PostgreSQL.You can also make use of table function as well.
You ingest data from Postgres into Clickhouse using:
External ETL tools like Airbyte and make a connector from Postgres to Clikhouse
Clickhouse integrations table engine to make a view from Clickhouse to Postgres data, after that use
insert into
query to insert data from that view into the real Clickhouse table