We are looking for a Senior BigData Engineer to join our team.
Our client is a US company that is specialized in delivering reliable Internet connectivity and entertainment multimedia to aircrafts worldwide, enhancing the experience for both passengers and crew. We are cooperating with the Business Intelligence, Data Analysis and BigData directions and looking for talents who can contribute to the complex data management and analysis projects.
Responsibilities and job specifics:
Develop and support existing end-to-end data AWS based Big Data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, and error handling
Create jobs and queries to perform auditing and error handling
Develop PySpark and Scala Spark pipelines
Experience in Python or Scala
Experience in SQL
Experience in Linux
Good understanding of software development methodologies
Being result-oriented, ability to make things done in a highly dynamic and stressful environment
Good communication skills and good English
Being a good team player
Nice to have:
Apache Spark including an understanding of optimization techniques
Knowledge of Hadoop architecture
Experience in working with AWS (S3, EMR cluster, Lambda, Kinesis, DynamoDB, etc.)
Flexible working hours
A competitive salary and good compensation package
A masseur and a corporate doctor
Healthcare & sport benefits
An inspiring and comfy office
Challenging tasks and innovative projects
Meetups and events for professional development
An individual development plan
Corporate events and outstanding parties
Exciting team buildings
Memorable anniversary presents
A fun zone where you can play video games, foosball, ping pong, and more.
Subscribe to your search result
We’ll drop you a note when there are new jobs that match your search.
We're sorry! The vacancy is already closed so you will be redirected to the jobs page.