Python Developer
Roles & Responsibilities:
Running Databricks Workflows monthly to perform ETL data loads for partners
Identifying issues in raw data files, communicating with clients, and resolving the issues
Performing unit testing post data load to validate accuracy and completeness
Addressing bugs raised by the QA team and managing business requests
Implementing and maintaining new code change requests in the ETL process
Skills:
Proficient in Python, with hands-on experience in:PandasNumPy
Working knowledge of ETL processes and data pipeline management
Working knowledge of Databricks, including:Databricks SQLWorkflows Notebooks to implement and update code
Domain knowledge in Reinsurance
Good understanding of Git for code versioning
Working Knowledge of AWS, ADLS.
3 must haves
Python
Numpa
Panda