Sr. Data Engineer - Data Engineering

Level: Senior Data Engineer

Experience: 7-10 

Location: Any , Bangalore Preferred, Chennai, Hyderabad or Noida

Website: https://www.qualitestgroup.com/

About Us:

Qualitest is the world’s leading managed services provider of AI-led quality engineering solutions. It helps brands transition through the digital assurance journey and make the move from conventional functional testing to adopt innovations such as automation, AI, blockchain, and XR. Qualitest’s core mission is to mitigate business risks associated with digital adoption. It fulfills this through customized quality engineering solutions that leverage Qualitest’s deep, industry-specific knowledge for various sectors, including technology, telecommunications, finance, healthcare, media, utilities, retail, manufacturing, and defense. These scalable solutions protect brands through end-to-end value demonstration with a focus on customer experience and release velocity.  Qualitest has offices in the United States, United Kingdom, Germany, Israel, Romania, India, Mexico, Portugal, Switzerland, and Argentina. It employs more than 7,000 engineers who serve over 400 customers worldwide. A pioneer and innovator in its industry, Qualitest is the only services provider positioned by Everest Group as a Leader in both Next-generation Quality Engineering (QE) Services PEAK Matrix® Assessment 2023 and the Quality Engineering (QE) Specialist Services PEAK Matrix® Assessment 2023.

Responsibilities

• Design and execute scalable data migration pipelines from relational databases (such as Teradata) to AWS Databricks.

• Utilize tools like IBM DataStage, FiveTran, Airflow, and Databricks Workflow to support data migration tasks.

• Optimize ETL processes to enhance performance and streamline data transformations with Spark and SQL.

• Develop and automate data ingestion, validation, and quality checks within a cloud environment to ensure reliable data flows.

• Work closely with data architects and business stakeholders to ensure a seamless, efficient, and secure migration process.