Senior Data Engineer (Databricks)

Описание

PROJECT DESCRIPTION:    Our client is a company that provides risk assessment and other valuable statistics on the bank transactions to their clients.

We are looking Senior Data engineer with extensive hands-on experience in designing and implementing data pipelines.

Ideally the profile knows the modern data stack from both the engineering and analytics sides.

Besides being responsible for building data pipelines the senior Data engineer is expected to assume following responsibilities : -Model datasets both for internal and external consumption; -Establish and maintain the data documentation; -Set software engineering best practices for analytics (DataOps); -Close collaboration with other team members and business stakeholders.

IF YOU HAVE:  Good knowledge and experience in modern data stack: - Ingestion (we use Autoloader, might be Kafka in future); - Storage (we use Azure Data Lake Storage); - Data transformation (pySpark, structured streaming); - Workflow orcestration (Databricks workflow); - Data import and export using queue (Kafka in Azure EventHub); - Data governance, data catalog, data quality (Unity Catalog with RBAC, Great Expectations); - BI tools (PowerBI).

Expected skills: - Solid understanding of Distributed Data Processing with Spark; - Structured streaming, Autoloader, udf, pandas, etc; - Databricks with Asset Bundles; - Kafka/Azure EventHub; - Python; - SQL; - PowerBI experience would be a plus; - Understanding of Terraform would be a plus; - Experience with Azure Cloud & Azure DevOPS would be a plus.

AS AN OPINOV8R, YOU WILL HAVE:  -  Digital-First Approach:  Great talent knows no borders!

You can work from wherever you are.

We hire and collaborate with professionals worldwide.    -  Remote Work Model:  Balance your professional and personal life with our flexible working conditions.

We offer an, empowering you to be productive and deliver your best from anywhere.     -  Exciting Projects:  Dive into impactful projects across various industries that challenge and spark your creativity.

Work on innovative solutions that push boundaries, giving you the chance to make a difference and drive change.   -  Boost Your Expertise:  Elevate your career with unmatched experiences that expand your knowledge and master skills.

We foster continuous learning and development opportunities that allow you to grow and reach new heights.   -  Join the Best Team Ever:  Collaborate with our diverse and сross-cultural team of passionate technologists and creative thinkers who inspire and support.

Together, we develop services that make a real impact on the world.  HOW’S THE HIRING PROCESS GOING:  We strive to make a smooth and transparent hiring process to find the perfect match for both sides.

Steps may differ depending on the position — here's what to expect:     -  Initial Interview:  If your background fits the role's criteria, we'll invite you for an interview with a Talent Acquisition Specialist to get to know you better.   -  Technical Interview:  Depending on the role, you may be asked to complete a technical assessment/test task to showcase your expertise.    -  Final Decision:  After completing all interviews and assessments, we'll reach a final decision and get back to you with the result.

Powered by JazzHR