IElektron : Data Engineering
Brief Description of position:
Job Description:
Responsible to aggregate, sort, convert and pipeline terabytes of ingested data in a seamless process of facilitating relevant data to respective Business Units.
This will include scheduling big data pipeline workflows for conversion, indexing, staging and quality assessment.
Primary Skills :
- Programming Python (numpy, pandas, matplotlib)
- Data processing using PySpark / Dask
- SQL/NoSQL database design
- Very good understanding of clean code concepts
- Data pipeline development and deployment using Airflow
Secondary Skills :
- Azure Databricks
- Tableau
- Kubernetes
Location
Bangalore,Chennai
Mandatory SkillSet:
Python,
SQL,
NoSQL,
Tableau,
Azure,
Spark.