Senior Data Engineer

Описание

Description

Ciklum is looking for a Senior Data Engineer to join our team full-time in Ukraine.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Senior Data Engineer, become a part of a cross-functional development team working to cut company’s costs on Big Data processing. With almost 100 million active users across 25 countries, they’re a global food tech company.

As a recently formed team, they have many opportunities and ideas for sharing value back to the customers within their continuously expanding platform. They're looking for talented and trusted engineers to help them impress their customers.

Responsibilities

Optimize BigQuery performance, identify and resolve inefficient queries, and implement best practices for data processing at scale Analyze SQL code for antipatterns and perform refactoring to improve query execution, cost efficiency, and maintainability Develop and implement strategies for BigQuery storage optimization, including data partitioning, clustering, and archiving Collaborate extensively with various data teams to understand their pipelines, identify optimization opportunities, and provide guidance on efficient BigQuery usage Design, build, and maintain robust and cost-effective data solutions that leverage BigQuery capabilities to meet evolving business needs Provide mentorship and support to data engineers, fostering a culture of continuous improvement in data pipeline efficiency and quality Develop and maintain documentation for BigQuery optimization techniques, best practices, and standard operating procedures Participate in code reviews, ensuring adherence to BigQuery optimization principles and high-quality SQL code standards Research and evaluate new BigQuery features and related technologies to enhance data processing capabilities and efficiency Provide support for the maintenance, optimization, and eventual decommissioning of Python-based data applications and pipelines

Requirements

We know that sometimes, you can’t tick every box. We would still love to hear from you if you think you’re a good fit!

3+ years of experience coding in SQL (BigQuery dialect), Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design 2+ years contributing to production deployments of large backend data processing and analysis systems  2+ years of experience in cloud data platforms (GCP preferred) Comfortable building and maintaining ETL pipelines (Airflow, Bash, Python) Knowledge of professional software engineering best practices for the full software Knowledge of Data Warehousing, design, implementation and optimization Knowledge of Data Quality testing, automation and results visualization Knowledge of BI reports and dashboards design and implementation (Tableau, Looker) Knowledge of the development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience participating in an Agile software development team, . SCRUM A consistent track record of delivering exceptionally high-quality software on cross-functional projects Demonstrated ability to learn new technologies quickly and independently Experience with supporting data scientists and complex statistical use cases highly desirable

Desirable

Experience in data science and machine learning Experience in backend development and deployment Experience in CI/CD configuration Experience with Kubernetes

What's in it for you

Strong community: Work alongside top professionals in a friendly, open-door environment Growth focus: Take on large-scale projects with a global impact and expand your expertise Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies Flexibility: Enjoy radical flexibility – work remotely or from an office, your choice Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations