Data Engineer

Job Summary

• You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness and business value.
• You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
• You participate in early state design and feature definition activities.
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack.
• Responsible for creating reusable and scalable data pipelines.
• You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Skills

• Advanced working knowledge and experience with relational and non-relational databases.
• Experience building and optimizing Big Data data pipelines, architectures and data sets.
• Strong analytic skills related to working with unstructured datasets.
• Strong experience in Azure Datafactory, Databricks, Eventhub, Python, PySpark, Synapse and SQL.
• Azure Devops experience to deploy the ADF pipelines.

Qualifications and Experience

• Minimum 3-5 years of relevant experience.
• Bachelor’s degree.
• Knowledge/Experience with Azure cloud stack.