Senior Data Engineer (part-time) (#4286)

N-iX is looking for a Senior Data Engineer to join an exciting new project focused on developing an external API for a leading digital product in the mental health sector. The platform is designed for the UK and US markets, and you will play a key role in shaping its data infrastructure, scalability, and overall performance.

Requirements:

• 5+ years of experience in Data Engineering.
• Strong proficiency in  Python, PySpark and SQL.
• Hands-on experience with Microsoft Power BI.
• Ability to thrive in a dynamic environment with a strong sense of ownership and responsibility.
• Solid understanding of Azure services.
• Hands-on experience with Azure Synapse Analytics and Azure Data Factory.
• Experience with data orchestration tools like Airflow or Dagster.
• Familiarity with Data Quality and Observability best practices.
• Analytical mindset and problem-solving skills for tackling complex technical challenges.
• Bachelor's in Mathematics, Computer Science or other relevant quantitative fields.

Nice-to-Have Skills:

• Experience with DevOps practices, CI/CD, and Infrastructure as Code (Terraform is preferable)
• Solid understanding of Kubernetes and containerisation

Responsibilities:

• Design and develop a scalable data platform to efficiently process and analyze large volumes of data using Azure cloud provider data processing services.
• Enhance existing LLM-related Python services.
• Work closely with DevOps team and handle some infrastructure related tasks if necessary.
• Create Power BI dashboards for internal employees and customers.