Brief Description of position:

Job Description:

Responsible to aggregate, sort, convert and pipeline terabytes of ingested data in a seamless process of facilitating relevant data to respective Business Units.

This will include scheduling big data pipeline workflows for conversion, indexing, staging and quality assessment.

Primary Skills :

• Programming Python (numpy, pandas, matplotlib)
• Data processing using PySpark / Dask 
• SQL/NoSQL database design
• Very good understanding of clean code concepts
• Data pipeline development and deployment using Airflow

Secondary Skills :

• Azure Databricks
• Tableau
• Kubernetes

Location

Bangalore,Chennai