Strong Middle Data Engineer (Azure Databricks) (#3104)

We are looking for a Middle Strong Data Engineer with strong expertise in Python and PySpark to join our team. This role is ideal for someone who thrives in designing and implementing robust data solutions in the cloud, with a focus on Azure ecosystems and modern data engineering practices. You’ll work on challenging projects, building and maintaining critical data pipelines, and delivering high-quality software solutions that drive business value.

Responsibilities:

• Develop, optimize, and maintain complex data pipelines using Azure Databricks, Python, and PySpark.
• Implement and deliver complex user stories with hands-on coding and design.
• Design and manage scalable Big Data solutions in Azure cloud environments.
• Ensure reliability and performance of data workflows and proactively monitor critical pipelines.
• Collaborate with cross-functional teams to define, design, and ship new features.
• Apply best practices in OOP and software engineering principles.
• Contribute to version control and CI/CD processes using GitLab.
• Explore and integrate LangChain components.
• Analyze and resolve complex technical problems with a focus on continuous improvement.

Requirements

• 4+ years of hands-on experience in data engineering.
• Strong expertise with Python, Pyspark and Azure Databricks.
• Solid experience in Cloud-based Big Data integration, specifically within the Azure ecosystem.
• Strong data engineering mindset with experience building and maintaining production-level pipelines.
• Solid knowledge of Azure, GitLab, and OOP concepts.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.
• Upper-intermediate English or higher.
• Passionate about delivering high-quality solutions and driving innovation.
• Knowledge of LangChain would be a plus.