Data Platform Engineer

Описание

Description

Ciklum is looking for a Data Platform Engineer to join our team full-time in Ukraine.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Data Platform Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. The ideal candidate will have a strong background in data engineering and software engineering, particularly with expertise providing real time ingestion and stream processing solutions on AWS & GCP and providing self serve capabilities to other teams. As part of the team, you will play a crucial role in designing, implementing, and maintaining our stream processing and real time ingestion solutions that will benefit production services as well as analytics. 

About Client:

With almost 100 million active users across 25 countries, they’re a global food tech company. As a recently formed team, they have many opportunities and ideas for sharing value back to the customers within their continuously expanding platform. They're looking for talented and trusted engineers to help them impress their customers.

Responsibilities

Responsible for the developing real time ingestion & stream processing solutions that would be mission critical for applications and analytics Contributes design, code, configurations, manages data ingestion, real-time streaming across multiple clouds Responsible for working with data producers to provide them a self-serve platform to onboard their application to stream processing platform (which would be across different methods of data productions and event buses) and deploy a stream processing data product on that platform. Provide guidance or support application teams to produce their messages into Kafka streams Identify gaps and improve the platform’s quality, robustness, maintainability, and speed

Requirements

3+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design 2+ years contributing to production deployments of large backend data processing and analysis systems 2+ years of experience in working with event driven architecture, stream processing & real time ingestion 2+ years of hands-on implementation experience working with a combination of the following technologies: Kafka, GCP Dataflow, Flink, Spark 2+ years of experience in cloud data platforms (AWS, Azure, GCP) 1+ years of experience in providing self-serve platform solutions Knowledge of professional software engineering best practices for the full software Knowledge of testing quality, automation and results visualization for monitoring Knowledge of the development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience participating in an Agile software development team, . SCRUM Experience designing, documenting, and defending designs for key components in large distributed computing systems Experience in CI/CD configuration A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects Demonstrated ability to learn new technologies quickly and independently Ability to handle multiple competing priorities in a fast-paced environment Experience with supporting data scientists and complex statistical use cases highly desirable

Desirable

Experience in backend development and deployment Experience with Iceberg, Confluent platform services, GCP Dataflow & Pubsub Experience with AWS SNS/SQS Experience with Kubernetes

What's in it for you

Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, Mental Health programs, as well as financial and legal consultations Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy license, language courses and company-paid certifications Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally Own your schedule – you are the one to decide when to start your working day. Just don’t miss your regular team stand-up Opportunities: we value our specialists and always find the best options for them. Our Internal Mobility Program helps change a project if needed to help you grow, excel professionally and fulfill your potential Global impact: work on large-scale projects that redefine industries with international and fast-growing clients Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events