Senior Data Engineer (Databricks)

Описание

ELEKS Software Engineering & Development Office is looking for a Senior Data Engineer (Databricks) in Poland, Croatia, and Argentina.

ABOUT PROJECT

A multinational British-American firm that operates in the professional services and management consulting sector, delivering various products aimed at risk mitigation. Additionally, the company extends its offerings to include data and analytics services, strategy consulting, investment banking advisory, health insurance, and retirement solutions.

REQUIREMENTS

4+ years of working experience as a Data EngineerExperience with Databricks (building pipelines, notebooks, Spark)Strong knowledge of Azure Data Factory (creating and configuring data flows, pipelines) will be a plusExperience with MS SQL DatabasesHands-on experience with Cosmos DBPython programmingUpper-Intermediate level of English

NICE TO HAVE

Knowledge of Data Lakehouse architecture, experience with Microsoft FabricExperience with Entity Framework (EF6)Experience in creating project templates and reusable components (e.g., NuGet packages)Experience with the Microsoft Azure platform for building and hosting microservices and data-driven solutions (App Services, Key Vault, AKS, Storage Queues)Familiarity with security protocols such as OAuth 2.0 (OKTA identity, OAuth, Identity Server, Azure AD, Managed Identity, Key Vaults)Hands-on experience in building RESTful APIs with API ManagementGood knowledge of CI/CD systems setup and configurationUnderstanding of Open API standardsFamiliarity with ORMs, especially Entity Framework 6Familiarity with DDD (Domain-Driven Design)Understanding of canonical API approachesExperience with various databases (Cosmos DB, MS SQL, etc.)Familiarity with APMs (Application Performance Management) toolsExperience with H3 Mapping, Power BIFamiliarity with file storage systems (Blob Storage, File Share, CDN)

RESPONSIBILITIES

Develop solutions and algorithms according to technical specifications or other requirements documentationAnalyze software code compliance with readability and performance standardsUse version control systems to track code optimization progress, as well as to merge or split code entities. Commit changes according to version control rulesPerform analysis, verification, and debugging of the software code at the level of application unitsDevelop procedures to test code availability, collect diagnostic data, generate test data sets with desired characteristics; examine the required software characteristics, etc.Reproduce defects logged in the defect database, establish their causes, and modify code to eliminate defectsDetermine software product compliance with the technical requirementsCollect and analyze results of software tests. Deliver correct interpretation of diagnostic data; analyze the significance of the obtained software characteristics; can document test results. Assess software product availabilityDevelop, document, and edit programming interfaces, software modules and components assembling procedures, software deployment and update procedures, as well as data migration and transformation (conversion) proceduresAssemble software modules and components into a software product; connect the software product to the external environment. Test the availability of software product versionsAnalyze variants of software requirements implementation; evaluate their time-consumption and workload. Conduct assessment and justification of the solutions recommended for software requirements implementation.Approve technical requirements for software with stakeholders. Evaluate and justify terms of task completion. Assign tasks to developers, monitor task implementation

WHAT YOU WILL GET WITH ELEKS

Close cooperation with a customerChallenging tasksCompetence developmentTeam of professionalsDynamic environment with low level of bureaucracy

ABOUT ELEKS

ELEKS is a custom software development company. We deliver value to our clients, thanks to our expertise and experience gained from working as a software innovation partner since 1991.

Our 2000+ professionals located in the Delivery Centers across Eastern Europe and sales offices in Europe and North America, provide our clients with a full range of software engineering services. These include product development, QA, R&D, design, technology consulting and dedicated teams.