Client and Project Overview:
Our client is a US company that is specialized in delivering reliable Internet connectivity and entertainment multimedia to aircrafts worldwide, enhancing the experience for both passengers and crew. We are cooperating with the Business Intelligence, Data Analysis and BigData directions and looking for talents who can contribute to the complex data management and analysis projects. We are looking for engineer to join our BigData Operational team and improve his/her AWS BigData skills.
Responsibilities and job specifics:
Develop and support existing end-to-end data AWS based Big Data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, and error handling
Create jobs and queries to perform auditing and error handling
Develop PySpark and Scala Spark pipelines
Requirements:
Experience in Python or Scala
Experience in SQL
Experience in Linux
Good understanding of software development methodologies
Being result-oriented, ability to make things done in a highly dynamic and stressful environment
Good communication skills and good English
Being a good team player
Nice to have:
Apache Spark including an understanding of optimization techniques
Knowledge of Hadoop architecture
Experience in working with AWS (S3, EMR cluster, Lambda, Kinesis, DynamoDB, etc.)
We offer:
Flexible working hours
A competitive salary and good compensation package
The Best hardware
A masseur and a corporate doctor
Healthcare & sport benefits
An inspiring and comfy office
Professional growth:
Challenging tasks and innovative projects
Meetups and events for professional development
An individual development plan
Mentorship program
Fun:
Corporate events and outstanding parties
Exciting team buildings
Memorable anniversary presents
A fun zone where you can play video games, foosball, ping pong, and more
