Lead Data Engineer (Snowflake) (#2672)

N-iX is looking for a passionate and motivated Lead Data Engineer. 

Join an exciting journey to create a greenfield, cutting-edge Consumer Data Lake for a leading global organization based in Europe. This platform will unify, process, and leverage consumer data from various systems, unlocking advanced analytics, insights, and personalization opportunities. As a leader, you will take a hands-on approach, staying actively involved in technical execution while guiding and supporting your team.

Your work will transform consumer data into actionable insights and personalization on a global scale. Using advanced tools to tackle complex challenges, you’ll innovate within a collaborative environment alongside skilled architects, engineers, and leaders.

As Tech Lead, you’ll design and implement a scalable data infrastructure, lead a team of data engineers, and partner with the Solution Architect to realize the vision, combining technical expertise with leadership and strategy.

Key Responsibilities:

• Team Leadership: Lead and mentor data engineers, fostering a collaborative and high-performing team environment.
• Drive technical excellence by enforcing best practices in data engineering and development.
• Hands-On Development: Build, maintain, and optimize data pipelines for ingestion, transformation, and activation.
• Create and execute scalable solutions to handle diverse data sources and high volumes of information.
• Data Modeling & Warehousing: Design efficient data models and schemas for a cloud-based data platform.
• Develop and maintain pipelines to ensure data integrity and accessibility.
• Collaboration: Partner with the Solution Architect to translate high-level designs into actionable implementation plans, and collaborate with the Technical Product Owner to align data solutions with business needs.
• Platform Development: Integrate data from diverse platforms, ensuring scalability, security, and accuracy.
• Enable data readiness for downstream analytics, reporting, and segmentation.
• Testing & Quality Assurance: Implement robust security measures to protect sensitive consumer data at every stage of the pipeline.
• Ensure compliance with data privacy regulations (e.g., GDPR, CCPA ..) and internal policies.
• Monitor and address potential vulnerabilities, ensuring the platform adheres to security best practices.
• Security & Compliance: Develop testing frameworks to validate data accuracy and performance.
• Optimize processes for reliability and efficiency.

Requirements:

• Over 7 years of experience showcasing technical expertise and critical thinking in data engineering.
• Hands-on experience with DBT and strong Python programming skills.
• Proficiency in Snowflake and expertise in data modeling are essential.
• Demonstrated experience in building consumer data lakes and developing consumer analytics capabilities is required.
• In-depth understanding of privacy and security engineering within Snowflake, including concepts like RBAC, dynamic/tag-based data masking, row-level security/access policies, and secure views.
• Ability to design, implement, and promote advanced solution patterns and standards for solving complex challenges.
• Familiarity with multiple cloud platforms (Azure or GCP preferred, with a focus on Azure).
• Practical experience with Big Data batch and streaming tools.
• Competence in SQL, NoSQL, relational database design (SAP HANA experience is a bonus), and efficient methods for data retrieval and preparation at scale.
• Proven ability to collect and process raw data at scale, including scripting, web scraping, API integration, and SQL querying.
• Strategic thinker with strong business acumen.
• Capable of managing and organizing multiple projects simultaneously.
• Experience working in global environments and collaborating with virtual teams.
• A Bachelor’s or Master’s degree in Data Science, Computer Science, Economics, or a related discipline.