cleverbridge is looking for a Data Engineer to build the AWS Data Lake solution from scratch.
Our customer, as a proven leader in global commerce, provides flexible E-commerce solutions for monetizing digital goods, online services, and SaaS. Their cloud-based E-commerce platform simplifies recurring billing, optimizes the customer experience, and offers comprehensive global payment capabilities. Leveraging customers' expertise, technology, and services, clients effectively increase customer acquisition and retention while rapidly expanding into international markets for revenue growth.
Responsibilities:
Build data pipelines and own data quality for data flow
Interact with internal data consumers to understand data needs
Contribute to the design of complex solutions across multiple systems
Introduce code patterns for the team to follow and use new libraries, as needed
Write automated testing of data processing algorithms
Mentor and pair with other data engineers to share knowledge across the team
Requirements:
2+ years of experience with AWS (Lambda, Redshift, EMR, Kinesis, etc.)
Experience with Spark
Development with Python
Proficient working knowledge of data warehousing, data architecture, and dimensional modeling
Proficient in SQL (Snowflake, AWS Redshift, Athena)
Expert in custom or structured ETL design, implementation, and maintenance
Experience working in high performing, agile environment
Understand software architectures and how they are applied in context, best practices in more than one language
Balance development with collaborative meetings
We offer:
Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Flexible and personalized career growth
Professional development tools (mentorship program, tech talks and training, centers of excellence, and more)
Active tech communities with regular knowledge sharing