Json – read and write two files in one step in one file
I am doing a spring batch project in which I have to read and modify several TXT files and write them in a new file in JSON format. I created my steps for each file, they are written one after…
Mysql – JdbcBatchItemWriter Error Parameter index out of range
There's an error on using Spring batch JdbcBatchItemWriter. insert into books(order_id, order_no, paid_payment_id) values (:orderId, :orderNo, :paidPaymentId) enter image description here private JdbcBatchItemWriter<BooksEntity> booksWriter() { return new JdbcBatchItemWriterBuilder<BooksEntity>() .itemSqlParameterSourceProvider(new BeanPropertyItemSqlParameterSourceProvider<>()) .dataSource(dataSource) .sql( "insert into books(order_id, order_no, paid_at, paid_payment_id, pay_method, pay_no,…
Mysql – Spring Batch java.net.SocketException: Connection timed out (Read failed)
I'm trying to execute a spring batch made by one job and n step. The Job starts and execute correctly first steps, when it arrives on the 'X' step, it should execute a query on the source database (last 1…
Spring Batch – SQL query that reaches Postgres different from the one in source code – Postgresql
I am investigating a performance issue with a Spring Boot application that uses Spring Batch 4.2.0 and Postgres 14.5 and ran into an interesting issue. One of the top queries is the following. Explain plan shows that it executes a…
How to read a Flatfile in batches [Spring Batch 2.7.8 , Mysql 8]
I have a flat file with 3200000 rows and performance of application decreases as time progresses. For e.g 100000 rows in 30 sec to 320000 in total time of about 4 hours. I am using jdbc template for batch saving…
Batch job for spring batch – Twitter-api
I have following job to be processed at certain time interval or on ad-hoc basis. Steps in the job are: Call twitter api and gather tweets for bunch of users and write them in a file Read them from a…