Amazon web services – Optimizing tensorflow tf.data.Dataset when creating it from remote source via from_generator()
Using tensorflow 2.9, python 3.7. My goal is to feed tf.data.dataset into tensorflow model while reducing memory consumption. In S3 there are parquet files that I want to use and create tf.data.Dataset for training deep learning model on keras. First…