Join an exciting journey to create a greenfield, cutting-edge Consumer Data Lake for a leading global organization based in Europe. This platform will unify, process, and leverage consumer data from various systems, unlocking advanced analytics, insights, and personalization opportunities. As a Senior Data Engineer, you will play a pivotal role in shaping and implementing the platform's architecture, focusing on hands-on technical execution and collaboration with cross-functional teams.
Your work will transform consumer data into actionable insights and personalization on a global scale. Using advanced tools to tackle complex challenges, you’ll innovate within a collaborative environment alongside skilled architects, engineers, and leaders.
Key Responsibilities:
- Hands-On Development: Build, maintain, and optimize data pipelines for ingestion, transformation, and activation.
- Create and implement scalable solutions to handle diverse data sources and high volumes of information
- Data Modeling & Warehousing: Design and maintain efficient data models and schemas for a cloud-based data platform.
- Develop pipelines to ensure data accuracy, integrity, and accessibility for downstream analytics.
- Collaboration: Partner with Solution Architects to translate high-level designs into detailed implementation plans.
- Work closely with Technical Product Owners to align data solutions with business needs.
- Collaborate with global teams to integrate data from diverse platforms, ensuring scalability, security, and accuracy.
- Platform Development: Enable data readiness for advanced analytics, reporting, and segmentation.
- Implement robust frameworks to monitor data quality, accuracy, and performance.
- Testing & Quality Assurance: Implement robust security measures to protect sensitive consumer data at every stage of the pipeline
- Ensure compliance with data privacy regulations (e.g., GDPR, CCPA ..) and internal policies.
- Monitor and address potential vulnerabilities, ensuring the platform adheres to security best practices.
Requirements:
- Over 4+ years of experience showcasing technical expertise and critical thinking in data engineering.
- Hands-on experience with DBT and strong Python programming skills.
- Proficiency in Snowflake and expertise in data modeling are essential.
- Demonstrated experience in building consumer data lakes and developing consumer analytics capabilities is required.
- In-depth understanding of privacy and security engineering within Snowflake, including concepts like RBAC, dynamic/tag-based data masking, row-level security/access policies, and secure views.
- Ability to design, implement, and promote advanced solution patterns and standards for solving complex challenges.
- Familiarity with multiple cloud platforms (Azure or GCP preferred, with a focus on Azure).
- Practical experience with Big Data batch and streaming tools.
- Competence in SQL, NoSQL, relational database design (SAP HANA experience is a bonus), and efficient methods for data retrieval and preparation at scale.
- Proven ability to collect and process raw data at scale, including scripting, web scraping, API integration, and SQL querying.
- Experience working in global environments and collaborating with virtual teams.
- A Bachelor’s or Master’s degree in Data Science, Computer Science, Economics, or a related discipline.
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits