Middle Data Engineer

Описание

The stable development of a specialist is possible only if his team is stable. At NIX, we are looking for Middle Data Engineer, and we are sure that such a specialist will continue to grow professionally and will be able to reach new career heights.

RESPONSIBILITIES:

Collaborate with product owners and team leads to identify, design, and implement new features to support the growing data needs.Build and maintain optimal architecture to extract, transform, and load data from a wide variety of data sources, including external APIs, data streams, and data lakes.Implement data privacy and data security requirements to ensure solutions stay compliant with security standards and frameworks.Monitor and anticipate trends in data engineering and propose changes in alignment with organizational goals and needs.Share knowledge with other teams on various data engineering or project-related topics.Collaborate with the team to decide which tools and strategies to use within specific data integration scenarios.

WHAT WE EXPECT FROM YOU:

3+ years of commercial experience in data engineering.Strong programming skills in Python or Scala.Solid with distributed computing approaches, patterns, and technologies (Spark, PySpark).Experience working with any cloud platform (GCP, AWS, Azure) and its data-oriented components.Proficiency in SQL and query tuning.Understanding of data warehousing principles and modeling concepts (e.g., knowledge of data model types and terminology including OLTP/OLAP, SCD, (de)normalization, dimensional, star/snowflake modeling, etc.).Expertise in the use of any listed relational databases (PostgreSQL, MSSQL or MySQL).Experience with the orchestration of any data flows (e.g., Apache Airflow, Prefect, Glue, Azure Data Factory).A team player with excellent collaboration skills.Minimum English level B2.

WILL BE A PLUS:

Expertise in data storage design principles. Understanding of pros and cons of SQL/NoSQL solutions, their types, and configurations (standalone/cluster, column/row-oriented, key-value/document stores).Experience in modern data warehouse building using Snowflake, AWS Redshift or BigQuery.Deep knowledge of Spark internals (tuning, query optimization).Experience with data integration and business intelligence architecture.Experience with data lakes and lake-houses (Azure Data Lake, Apache Hudi, Apache Iceberg, Delta Lake).Experience with containerized (Docker, ECS, Kubernetes) or serverless (Lambda) deployment.Good knowledge of popular data standards and formats (e.g., JSON, XML, Proto, Parquet, Avro, ORC, etc.).Experience with Platforms: Informatica, Databricks, Talend, Fivetran or similar.Experience in data science and machine learning with building Machine Learning models.

WHAT WE OFFER:

A long-term strategy for your development as an expert, together with a team that has almost 30 years of professional experience.Participation in large international projects that allow mastering new technologies and domains.Educational events and professional training that will help you build a stable career path.A flexible reward system where your income will depend on you and your desire to grow.A friendly and cozy corporate culture with a minimum level of formality and bureaucracy.There is an option to relocate to Budapest and work from the office, or you can join the project remotely.

To start a successful career with NIX, send your resume to [email protected]. We will be happy to overcome new professional challenges together with you!