Role Title
: Lead Senior Associate | Data Engineering
Location:
Bangalore, Hybrid (3 days onsite, 2 days remote)
Entity
: Deloitte Touche Tohmatsu India LLP
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and data infrastructure that enable analytics, reporting, and AI/ML solutions. The role ensures reliable data availability, quality, and performance across enterprise systems.
•
Design, develop, and maintain ETL/ELT data pipelines for structured and unstructured data.
• Build scalable data architectures using cloud and distributed systems.
• Integrate data from multiple sources such as APIs, databases, streaming platforms, and third-party systems.
• Ensure data quality, integrity, and governance standards are maintained.
• Optimize database performance and query efficiency.
• Support analytics, BI, and AI/ML teams with clean and reliable datasets.
• Implement monitoring, logging, and alerting for data workflows.
• Collaborate with Data Scientists, Analysts, and Product teams to understand data requirements.
• Maintain documentation for data models, pipelines, and workflows.
Snowflake:
Snowflake, Data warehousing, Snow pipe, Streams, Tasks, Time Travel, and Snowpark
Azure Services:
Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake, etc.
Programming Languages:
Python, SQL, T-SQL, PySpark, Spark SQL, Fair knowledge on KQL.
Data Modeling:
ERD, Dimensional Modeling
ETL Tools:
Azure Data Factory, Experience with tools like dbt, Fivetran, Matillion, or Airflow
Big Data Technologies:
Fair knowledge on Hadoop and Spark
Performance Tuning
and
Troubleshooting
Version Control:
Git, Azure DevOps
Experience with
chat apps and micro frontends
Familiarity with
Teams bot framework and adaptive cards
Knowledge of
data visualization libraries (e.g., D3.js, Highcharts), azure web apps, python