Senior Data Engineer (#14841373)

SPECIAL REFERRAL BONUS $2000
Lviv, Kyiv, Remote
Work type:
Office/Remote
Technical Level:
Senior
Job Category:
Project:
Discovery Limited
We are looking for Senior Data Engineer to join our team working on the data platform. 

Our customer is the global company providing insurance products and services. Their insurance model has received international recognition, including being ranked 17th in Fortune’s index of 51 companies “changing the world”, and named a leading health innovator at the World Economic Forum.

The team is responsible for building complex data solutions as well as pipelines used for extraction, cleaning, transformation, and loading into various target databases . The team is also looking at event-based streaming solutions to stream data from on premise to the cloud.


Responsibilities:
  • Design, develop, and operationalize large scale data solutions using various approved technologies 
  • Design, develop, and deploy complex data pipelines from ingestion to consumption for both on premise and in the cloud
  • Develop robust, scalable, and high performable solutions
  • Deliver high quality solutions within the set timelines
  • Improve data quality and efficiency
  • Ensure code is committed into source control and deployed using CI/CD pipelines
  • Adhere to technical best practices including internally defined architectural guidelines and coding standards
  • Understand business products to be able to translate business requirements into technical solutions
  • Provide support and maintenance of new and existing data solutions

Requirements:
  • Previous experience as a data engineer
  • Experience in building and maintaining complex data pipelines
  • Proficiency in Python and SQL
  • Experience in data processing tools such as Spark and/or Pandas
  • Knowledge of relational SQL and NoSQL databases, including PostgreSQL, Redshift, MongoDB, and DocumentDB
  • Knowledge of job scheduling and orchestration tools (Airflow)
  • Experience in AWS services (Glue, S3, Athena, EMR, RDS, Redshift)
  • Good understanding of algorithms and data structures
  • Experience in schema and dimensional data design
  • Good grasp of Software Engineering principles such as: Unit testing; Static Code Analysis, Test Automation, Continuous Integration, Version Control (GIT), Release Management, etc.

Nice to have:
  • Knowledge of message systems such as RabbitMQ, Amazon SQS
  • Knowledge of stream-processing tools such as Apache Kafka, Amazon Kinesis
  • Experience in Oracle PL/SQL
  • Experience in working with containerized applications using Docker, Kubernetes
  • Knowledge of CI/CD tools (GitHub actions, Jenkins)
  • Experience using JIRA issue tracking software
 

We offer:

  • Flexible working hours
  • A competitive salary and good compensation package
  • Possibility of partial remote work
  • Best hardware
  • A masseur and a corporate doctor
  • An inspiring and comfy office


Professional growth:

  • Challenging tasks and innovative projects
  • An individual development plan
  • A personal education budget
  • Mentorship program
  • Business trips


Fun:

  • Corporate events and outstanding parties
  • Exciting team buildings
  • Memorable anniversary presents
  • A fun zone where you can play video games, foosball, ping pong, and more