I am Balasubramaniam Namsivayam, Senior Data Engineer with a PhD in Engineering Sciences and 8+ years of experience architecting and deploying scalable, containerized data pipelines into production.In the quest of finding wisdom, I transform data to information, information to insights .
- Core Technologies: Python, SQL, Apache Spark, Snowflake, Apache Airflow, Docker, and AWS.
- Proven Ability: Own the full data lifecycle, from distributed processing (HPC/Spark) to workflow automation and cloud storage. Ensuring data integrity, reproducibility, and performance.
- Objective: Seeking to leverage deep systems-engineering expertise to solve complex data infrastructure challenges in the tech industry.
Please visit my website to browse my projects and tech notes.