DataOps Engineer (#14748385)

SPECIAL REFERRAL BONUS $1500
Work type:
Flexible (Office/Remote)
Technical Level:
Middle
Job Category:
Software Development
Project:
Moove

N-iX is looking for an experienced DataOps Engineer to join the global team behind a mobility company that aims to democratize vehicle ownership and financing on the entire continent.

About the role:
You will join a team of 5 Data professionals and Build a Data Lake platform from scratch using cutting-edge technologies. You will also be involved in developing new data pipelines, ingesting, and data orchestration.
The Data Team is a brand-new function that’s been created with data at the heart and minds of growing the business to be a data-led company. We want to hear from experienced and creative data analysts who want to use their skills to improve people’s lives and help us democratize mobility thru fintech.

This role is suitable for beginner DevOps or ETL Engineer interested in switching to DataOps direction.
 
Responsibilities:

  • Work within the global tech team, using your expertise to build highly automated provisioning, monitoring, and operational capabilities for data
  • Support the ongoing growth, design, and expansion of our data platform across a wide variety of data sources, enabling large scale support across an array of streaming, near real-time, and research workflows
  • Provide development of scripting for the cloud platform components and service with CI/CD tooling and services as needed. This scripting may span Jenkins, CloudFormation, shell scripting, Terraform, and ansible as required by the platform
  • Provide exceptionally strong skills in version management and using repositories such as git for ETL, SQL, and other scripting versioning and deployment management
  • Provide ownership and execution of product installation and configuration to prescribed landscape/architecture and best practices for the product. Configure services to meet functional and non-functional requirements, including security compliance
  • Develop data pipelines as required using AWS services
  • Conduct maintenance of ETL code, data quality, reliability, and performance including but not limited to process monitoring, data validation, and data refresh
  • Provide support to data analysts and data scientists with planned and ad hoc data requests, access, and extracts of data contained in a variety of SQL database systems including Aurora
  • Continuously improve automation, processes and service reliability, availability, and performance across the cloud data and application platform

Requirements:

  • Experience in data pipelines design and development with  AWS Glue, Streamsets, or equivalent ETL tools 
  • Ability to create and orchestrate complex and efficient data pipelines across relational, NoSQL, and other data sources including data APIs and streaming data
  • Strong experience in maintaining ‘as a service’ model for data pipelines, databases, CI/CD tooling
  • Excellent troubleshooting and performance optimization skills for ETL platform administration, integration, and performance monitoring
  • Code maintenance, version control, and documentation
  • Experience in building ETL pipelines in AWS Glue
  • Experience in developing RESTful web services for data APIs
  • Strong experience with DataOps principles for automation, lean ops, and Agile
  • BS or MS in Computer Science or related fields
  • English level – upper-intermediate or higher

Nice to have:

  • Experience with containerization and container orchestration technologies, like Docker, Kubernetes, and Argo is a plus
  • Python experience
  • Experienced with Python libraries for web scraping such as beautiful soup and scrapy

We offer:

  • ​Flexible working hours
  • ​A competitive salary and good compensation package
  • ​Best hardware
  • ​A masseur and a corporate doctor
  • ​Healthcare & sport benefits
  • ​An inspiring and comfy office

Professional growth:

  • Challenging tasks and innovative projects
  • ​Meetups and events for professional development
  • ​An individual development plan
  • ​Mentorship program

Fun:

  • ​Corporate events and outstanding parties
  • ​Exciting team buildings
  • ​Memorable anniversary presents
  • ​A fun zone where you can play video games, foosball, ping pong, and more

 

×

Easy apply


    or
    Get a Bonus