u/Consistent_Tutor_597

hey guys, I manage tech for a startup. and I have not used an orchestrator before. Just cron mostly. As we are scaling, I wanted to make things more reliable. Which orchestrator should I pick? It will be batch jobs which might run at different intervals do some etl refresh data etc. Since it ran in cron, the dependency logic itself was all handled in the code itself before.

Also both eat equal amount of resources right? I hear airflow being ram heavy but not sure if it's entirely true. let me know what you guys think. Thanks.

hey guys, I use gunicorn with gthread. Since flask is sync. I wanna know how many concurrent requests do I get over time, and if it every exceeds worker\*threads, in my case 10\*10=100. and if I need to add more threads. what's the best way to monitor it?

I use flask with gunicorn, docker, nginx in front. Also have netadata enabled.