u/Own_Elk8276

Career

Hi everyone, I’m an Azure Data Engineer with over 3 years of experience specializing in building end-to-end scalable data pipelines and modern Medallion architectures. I have a strong track record of optimizing data systems and integrating emerging technologies like GenAI to drive business value.

My core stack includes:

• Cloud & Big Data: Azure (ADF, Databricks, Synapse, ADLS Gen2), Delta Lake
• Languages: Python (PySpark, Pandas), SQL (T-SQL, Spark SQL)
• BI & Visualization: Power BI (DAX, Dashboard Design)
• Specialized Expertise: ETL/ELT design, Performance Tuning (Z-Ordering, Partitioning), and GenAI-integrated automation

Key Highlights of my work:

• Advanced Architectures: Designed and implemented Medallion Architecture (Bronze, Silver, Gold) for scalable processing and real-time ingestion using Event Hubs.
• GenAI Integration: Built automated pipelines using LLMs for data enrichment, metadata generation, and classification, reducing manual effort by ~50%.
• Performance & Cost: Consistently reduced query latency by 30-40% through rigorous optimization and implemented cost-reduction strategies like resource scheduling and auto-shutdown.
• Full Lifecycle Ownership: Experienced in managing the entire data lifecycle, from ingestion and validation to CI/CD and production monitoring.

I am currently based in Hyderabad and have a 30-day notice period.

If you’re hiring or know of any relevant opportunities where I could help scale your data infrastructure, please feel free to DM me. I’d love to share my full resume and discuss how I can contribute to your team!

Thanks! 🙌