Senior Data Engineer (#1421)

N-iX is actively looking for a Senior Data Engineer to join our team! Our customer is one of the largest operators of non-franchised collision repair centers and one of the major retail auto glass operators in North America in terms of number of locations and sales. The Company currently operates locations in Canada and in the U.S..

Responsibilities:

• Conduct analysis of existing data systems, identify areas for improvement, and provide recommendations for architectural enhancements
• Develop data models, data flows, and data integration strategies to ensure seamless and efficient data management across various systems and platforms
• Provide guidance and technical expertise to development teams in implementing data solutions, ensuring compliance with best practices and industry standards
• Perform data profiling, data quality assessments, and data governance activities to ensure data accuracy, integrity, and security
• Collaborate with data scientists and analysts to enable analytics and data-driven insights through the implementation of appropriate data structures and algorithms
• Stay up-to-date with emerging trends, technologies, and industry best practices in data architecture, analytics, and cloud computing
• Provide strategic recommendations and guidance on data-related initiatives.
• Communicate with internal product owners, stakeholders, and external providers

Requirements:

• 6+ years of experience working with enterprise data platforms, building and managing data lakes and using big data technologies
• 5+ years of experience working with relational and non-relational / NoSQL databases, advanced knowledge of SQL
• 4+ years of experience working with AWS platform. Experience with solutioning on AWS infrastructure using services like AWS IAM, S3, API Gateway, Lambda, Glue, Lake formation, Redshift, DynamoDB, RDS
• 4+ years of experience with using Python for data engineering and developing high performance and scalable data pipeline
• 2+ years of experience working with Apache Airflow for orchestrating analytics workload
• 2+ years of experience with IaC solutions like terraform, cloud formation
• Strong understanding of concepts around data warehousing, BI, data security, data quality and profiling
• Prior experience with traditional ETL tools like Talend Open Studio, Informatica, Pentaho or something similar
• Prior experience with working in a SQL server based environment and utilizing technologies like SSIS, TSQL, SSRS, .Net, C#
• Have to be a team player and open to working with newer technologies as well as supporting legacy systems
• Confident knowledge of Agile methodologies
• Upper-Intermediate level of English

Nice to have: 

• Experience AWS EKS service, setting up and managing Kubernetes clusters
• Cloud DevOps experience utilizing products like Gitlab, Bitbucket or similar ones
• Good understanding and experience working with various products in the big data ecosystem like Spark, EMR, Hive, Presto, NoSQL databases like DynamoDB, MongoDB