Data Engineer (Pyspark and Databricks)

As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Data related technologies).
• Work as part of a team to develop Cloud Data and Analytics solutions in the vehicle Transmissions space.
• Participate in development of cloud data warehouses, data as a service, business intelligence and machine learning solutions.
• Data wrangling of heterogeneous data
• Ability to provide solutions that are forward-thinking in data and analytics
• Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
• Mentor a team of High Performing Engineers to deliver complex data solutions and identify Data Driven Development opportunities.
• Identify strategic and Operational KPIs for the team and drive the team to deliver the committed targets.
• Collaborating with Global stakeholders.

• Programming experience in Scala or Python, SQL
• Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks) -- Mandatory
• Hands-on experience of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
• Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale
• Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment
• Good Understanding of Modern Data Warehouse/Lambda Architecture, Data warehousing concepts
• Good Understanding of Machine Learning and AI solution space.
• Good Understanding Automobile Components functioning (Knowledge on transmissions will be a big plus)
• Proficient in a source code control system such as GIT
• Ability to code
• Soft Skills
• Excellent written and verbal skills (English)
• Flexible
• Self-Starter
• Team Player, Team Leader

BE / ME/ M.Tech / M.S