u/Unique_Aardvark_7217

Hi all, I need some help with a data load issue. I have a huge data set that I need to load into my database - it's about 1.7tb. I only need to load it in full once as all future updates will be small updates to the data and incremental changes.

My issue is how to do it with Base44. Every method I've tried so far hits some sort of rate limit or size limit. The data is stored on 1000+ CSV files, and I don't want to do it one at a time!

Ideas?