Shivaraj Galagali Shiva-raj Gala-gali

Data Engineer

I am currently a Data Engineer at Happiest Minds Technologies, where I design and develop data engineering solutions leveraging Azure Cloud services, Databricks, and Python to drive business intelligence, operational efficiency, and data-driven decision making.

Download Résumé

Experience

  1. Data Engineer

    Happiest Minds Technologies
    • Building and managing ETL pipelines using Azure Data Factory, Databricks, and SQL for various client projects.
    • Developed 50+ ADF pipelines for ERP data integration across multiple operating companies enabling centralized reporting (Customer & Supplier Data Platform).
    • Migrated processes to event-driven architecture using Azure Synapse & Event Grid reducing processing time by 35%.
    • Built Flask-based scraping applications with robust error handling, API integrations & deployed using Gunicorn.
    • Implemented Databricks Autoloader for incremental ingestion of 40 GB daily log data reducing processing time by 20-40%.
    • Provided data quality checks, pre-escalation analysis, production support, and automation solutions.
    • Technologies: Azure Data Factory, Databricks, Synapse, SQL Server, Python, Flask, Event Grid, Logic Apps, Power BI.

Education

  1. Computer Science Engineering

    National Institute of Engineering Mysore
    Thesis on Smart Street Lighting System. Presented papers at IEEE conference with the contributions being published in Journal.
    Smart Street Lighting System
  2. Pre-University PCMB

    Alvas PU College, Moodbidri
    Percentage: 95/100
Skills & Hobbies
Technical Skills
Python
RStudio
PyTorch
Hobbies
Hiking
Cats
Photography
Awards
Microsoft Certified Azure Data Engineer Associate (DP-203)
Microsoft ∙ August 2023
Earned certification validating expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures suitable for building analytics solutions on Microsoft Azure.
Data Engineering Training Certification
StackRoute | Happiest Minds Technologies ∙ October 2022

Completed intensive Data Engineering training program focused on:

  • Designing and building robust ETL pipelines
  • Working with cloud platforms like Azure
  • Data modeling, SQL optimization, and Python for data engineering use cases
Learning Champion Award and Team Excellence Award
happiestminds ∙ December 2023
Awarded for key contributions towards enabling scalable ETL pipelines and enhancing data processing efficiency in TMF’s Audit Logs and BDR projects.
Languages
100%
English
100%
Kannada
75%
Hindi