Senior Data Engineer (#3538)

N-iX is looking for a talented Senior Data Engineer to join our team!  

Our client is one of Europe's fastest-growing mobile companies with almost 5  million active customers, 1,000 employees worldwide, and operations in five countries. The client is using the mobile virtual network operator business model.

Responsibilities:

• Design and implement data pipelines to collect, clean, and transform data from various sources​
• Build and maintain data storage and processing systems, including databases, data warehouses, and data lakes​
• Follow data governance policies and procedures​
• Collaborate with data analysts, data scientists, and other stakeholders to understand and meet their data needs​
• Participate in code reviews, performance tuning, and best practice discussions within the team, and brainstorming sessions​
• Work with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines​
• Ensure solutions are production-ready in terms of operational, security, and compliance standards​
• Participate in daily project and agile meetings, providing technical support for issue resolution​
• Communicate clearly and concisely with the business about item status and blockers​
• Maintain comprehensive knowledge of the client's data landscape

Requirements:

• 5+ years of design & development experience with big data technologies​
• Proficiency in SQL and Python​
• Experience in cloud technologies like Azure, AWS, GCP​
• Experience with Docker, Helm, Kubernetes ​
• Proven skills in real-time Processing: Kafka, Apache Flink, Apache Spark Structured Streaming​
• Experience with Batch Processing: Apache Spark (PySpark)​
• Data Orchestration: Azure Data Factory, Apache Airflow,  ​
• Data Storage: Parquet, Delta Lake, Iceburg​
• DevOps & CI/CD: Git, Docker, Terraform or Ansibel (basic infra provisioning)​
• Strong skills in querying and manipulating data from various databases (relational and big data)​
• Experience in writing effective and maintainable unit and integration tests for ingestion pipelines​
• Excellent communication, problem-solving, and leadership skills​
• Experience working on high-traffic and large-scale software products​
• Strong intermediate level of English

Nice to have:

• Experience with data visualization tools (e.g., SSRS, Power BI)​
• Knowledge of machine learning algorithms and their applications in big data​
• Familiarity with data privacy regulations (e.g., GDPR, CCPA)​
• Experience with Great Expectations