Senior Azure Data Engineer

Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team.

3+ years of experience in Python development. Strong experience with SQL and NoSQL databases. Hands-on experience with Databricks, PySpark, including batch and structured streaming. Experience working with Azure services including ADLS, Azure Databricks, Event Hub, Azure SQL Data Warehouse, Azure Functions, and Serverless Architecture. Good understanding of Terraform; hands-on experience is preferred. Experience designing and implementing scalable data engineering solutions based on high-level architecture. Experience building data ingestion, transformation, and preprocessing pipelines using Azure Databricks. Ability to work with customers to understand data pipeline, data lake, and migration requirements. Experience monitoring Azure DevOps and Databricks pipelines and supporting production environments. Willingness to learn and work with Azure monitoring and logging services. Experience with ARM Templates and Azure Data Factory. Knowledge of Kubernetes. Exposure to Machine Learning and AI.

A challenging, innovating environment. Opportunities for learning where needed.