Data Engineer Lead
Date:
3 Jun 2025
Company:
Qualitest Group
Country/Region:
IN
JD:
1) Must have 8+ years of experience in Python / Java, Spark, Scala, Hive, Microsoft Azure Cloud Services (Data Bricks platform and developer tools)
2) 4 to 8 years of experience in Data Warehouse, ETL, Snowflake and Report Testing
3) Strong in writing SQL scripts & Database knowledge on Oracle, SQL Server, Snowflake
4) Hands on working experience with any of the ETL tools, preferably Informatica and Report / Dashboard tools
5) Ability to work independently and 12:30 pm to 9:30 pm timings
Good to have,
- Data Processing Ability to build optimized and cleaned ETL pipelines using Databricks flows, Scala, Python, Spark, SQL
- Testing and Deployment Preparing pipelines for deployment
- Data Modeling Knowledge of general data modeling concepts to model data into a lakehouse
- Building custom utilities using Python for ETL automation
- Experience working in agile(scrum) environment and usage of tools like JIRA.
Must haves
Data Bricks: 4/5
Pyspark with Scala: 4/5
SQL: 3/5