Data Engineer

Описание

Summary

The IT company Andersen invites an experienced Data Engineer to work on a project for one of our customers in Georgia.

The customer is the first fully digital neobank in Georgia, existing solely on mobile phones. Since 2015, the company has been providing convenient and secure financial services, including quick loans, money transfers, utility payments, and card management, all without bureaucracy or hidden fees.

The project is modernizing data infrastructure by migrating legacy pipelines to a new platform, implementing an on-premises LakeHouse architecture, applying PII anonymization/tokenization, and developing analytics applications for users and automated systems.

Responsibilities

Designing and optimizing ETL/ELT pipelines using SQL and Python. Migrating legacy pipelines to a modern data platform. Implementing an on-prem LakeHouse using Delta Lake/Apache Iceberg. Ensuring PII anonymization/tokenization for data security. Developing real-time/batch processing solutions with Spark/Flink/Kafka. Deploying and managing cloud data infrastructure (AWS/Azure) using Docker. Building analytics applications with PostgreSQL/ClickHouse/Trino. Maintaining and automating workflows with Apache Airflow.

Requirements

Experience in data engineering or a related field for 5+ years. Strong experience with SQL and Python for data processing. Hands-on experience with Apache Spark, Flink and Kafka for real-time and batch data processing. Experience working with cloud environments (AWS, Azure) and object storage solutions (MinIO). Understanding of RDBMS and SQL Engines like PostgreSQL, MS SQL, ClickHouse, and Trino. Experience with Docker. Knowledge of Apache Airflow. Familiarity with Delta Lake and Apache Iceberg for data lake implementations. Level of English – from Intermediate+.

Desired skills

Experience with Elasticsearch for search and analytics. Exposure to DBT for analytics engineering. Experience working with Scala in data engineering projects.

Reasons to join us

Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc..The opportunity to change the project and/or develop expertise in an interesting business domain.Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.The opportunity to earn up to an additional 1,000 EUR per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).Certification compensation (AWS, PMP, etc).Referral program.English courses.Private health insurance and compensation for sports activities.

Join us!

Apply to vacancy