Senior Data Engineer (#3538)

Описание

Work type: Office/Remote Technical Level: Senior Job Category: Software Development Project: Lebara

N-iX is looking for a talented Senior Data Engineer to join our team!

Our client is one of Europe's fastest-growing mobile companies with almost 5 million active customers, 1,000 employees worldwide, and operations in five countries. The client is using the mobile virtual network operator business model.

Responsibilities:

Design and implement data pipelines to collect, clean, and transform data from various sources​ Build and maintain data storage and processing systems, including databases, data warehouses, and data lakes​ Follow data governance policies and procedures​ Collaborate with data analysts, data scientists, and other stakeholders to understand and meet their data needs​ Participate in code reviews, performance tuning, and best practice discussions within the team, and brainstorming sessions​ Work with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines​ Ensure solutions are production-ready in terms of operational, security, and compliance standards​ Participate in daily project and agile meetings, providing technical support for issue resolution​ Communicate clearly and concisely with the business about item status and blockers​ Maintain comprehensive knowledge of the client's data landscape

Requirements:

5+ years of design & development experience with big data technologies​ Proficiency in SQL and Python​ Experience in cloud technologies like Azure, AWS, GCP​ Experience with Docker, Helm, Kubernetes ​ Proven skills in real-time Processing: Kafka, Apache Flink, Apache Spark Structured Streaming​ Experience with Batch Processing: Apache Spark (PySpark)​ Data Orchestration: Azure Data Factory, Apache Airflow, ​ Data Storage: Parquet, Delta Lake, Iceburg​ DevOps & CI/CD: Git, Docker, Terraform or Ansibel (basic infra provisioning)​ Strong skills in querying and manipulating data from various databases (relational and big data)​ Experience in writing effective and maintainable unit and integration tests for ingestion pipelines​ Excellent communication, problem-solving, and leadership skills​ Experience working on high-traffic and large-scale software products​ Strong intermediate level of English

Nice to have:

Experience with data visualization tools (e.g., SSRS, Power BI)​ Knowledge of machine learning algorithms and their applications in big data​ Familiarity with data privacy regulations (e.g., GDPR, CCPA)​ Experience with Great Expectations

We offer*:

Flexible working format - remote, office-based or flexible A competitive salary and good compensation package Personalized career growth Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more) Active tech communities with regular knowledge sharing Education reimbursement Memorable anniversary presents Corporate events and team buildings Other location-specific benefits

*not applicable for freelancers