▲ 12 r/dataengineering
Importance of Data Volume as a DE.
I know this may sound a little dumb but how important is the scale of the data being handled by a Data Engineer? Like I have 2 years of experience as a DE but the volume that I handle is laughable. It's around 10 GBs per week or max it goes to 100 GBs per month. What all things am I missing out or out of scope for me when the data volume is this low? Or putting it this way, DEs who handle TBs of data daily, what are the aspects which automatically surfaces when dealing with such data?
u/Aggravating_Ad_1885 — 2 days ago