Brief Description of position:
We, at TheMathCompany, enable data analytics transformations for Fortune 500 organizations across the world. We enable our clients to build core capabilities that set them on a path to achieve analytics self-sufficiency.
Over the last three years, we have been consistently doubling in size year-on-year with 300 (and counting…) Data Scientists & Engineers, Consultants and Visualization experts
TheMathCompany has won multiple awards recognizing us as a global Data and Analytics firm – We ranked #23 in the Deloitte Technology Fast 500™ Asia Pacific 2019 and #2 in Deloitte Technology Fast 50™ India 2019.
35+ Fortune 500 Companies, from almost 10 different industries and countries, trust us to power their analytical transformation.
WHAT’S IN IT FOR YOU:
- An exciting opportunity to be a part of the growth journey of one of the fastest growing AI & ML firms – scope for experimentation, the big & small victories, the learnings and everything in between
- Our in-house learning and development cell - Co.ach, run by world-class data analytics experts, enables our folks to stay up to date with the latest trends and technologies
- At TheMathCompany, we insist on a culture that provides us all with enough flexibility to accommodate our personal lives without compromising on the dream of building a great company
- We are changing the way companies go about executing enterprise-wide data engineering and data science initiatives, and we’d love to have you grow with us on this journey
ROLE DESCRIPTION
As a data engineer, you’ll have an opportunity to work on the universe of data and solve some very interesting problems by creating and maintaining scalable data pipelines dealing with petabytes of data. All our projects entail working on cutting edge technologies, petabyte scale data processing systems, data warehouses and data lakes to help manage the ever-growing information needs of our customers.
The responsibilities are detailed as below:
- Experience in designing efficient and robust ETL workflows
- Build, test & maintain enterprise data lake and data pipelines
- Adhere to the plan and quality needs of data solutions to various business problems
- Experience in Database programming using multiple flavors of SQL
- Experience working in an Agile/Scrum development process
- Deploy scalable data pipelines for analytical needs
- Work on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL
- Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
- Scheduling and Monitoring of Hadoop, Hive and Spark jobs
REQUIRED QUALIFICATIONS
We are looking for individuals who are curious, excited about learning, and navigating through the uncertainties and complexities that are associated with growing a company. Some qualifications that we think would help you thrive in this role are:
- BE/BS/Mtech/MS in computer science or equivalent work experience
- 0 to 2 years of experience in building data processing applications using Hadoop, Spark and NoSQL DB and Hadoop streaming
PREFERRED QUALIFICATIONS
- Basic experience in cloud environments (AWS, Azure, GCP)
- Understanding of IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
- Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
- Solid hands-on working knowledge of SQL and scripting
- Exposure to latest cloud ETL tools such as Glue/ADF/Dataflow is a plus
- Proficient in programming language such as Python/Scala
- Good understanding of in relational/dimensional modelling and ETL concepts
- Understanding of any reporting tools such as Tableau, Qlikview or PowerB
