Senior/Lead Data Integration Engineer

Описание

We are seeking a talented Senior/Lead Data Integration Engineer to join our client's team in building a revolutionary data platform tailored for tax solutions.This role focuses on leading the migration and integration of complex datasets, predominantly from the O-Series product covering sales tax calculation rules, into a new data platform. The initial data sources will consist of SQL Server, Oracle, CSV files, and unstructured data in HTML and PDF formats.ResponsibilitiesLead the migration of databases from Oracle to AuroraDB (PostgreSQL)Work collaboratively with data analysts to define and refine database modelsImplement transformation logic to optimize data integrationEnsure the integrity and security of data throughout the migration processDevelop strategies for handling unstructured data sources including HTML and PDF filesOptimize existing data integration processes and methodologies for improved performanceDesign and execute test scenarios to validate data migrations and transformationsDocument data integration procedures and outcomes for future referenceProvide technical guidance and mentorship to junior data engineers in the teamStay updated with industry trends and advancements in data integration technologiesRequirementsProficiency in SQL, Oracle, and PostgreSQLExpertise in DB modeling and transformationsBackground in using Liquibase or similar tools for managing and deploying DB schema changesSkills in handling both structured and unstructured data sourcesFluency in spoken EnglishCapability to collaborate effectively with cross-functional teamsNice to haveExperience with AWS DMS and ETL processesKnowledge of AWS S3 and dbtUnderstanding of AWS Lambda, SNS, SQSFamiliarity with implementing data cataloging and other data governance capabilitiesBackground in MLOps principles or real project experience with AI algorithms using database inputsWe offerWork on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in UkraineReceive the necessary equipment to perform your work tasksChange projects and technology stacks within EPAMGain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)Consider relocation options in over 30 countries worldwideParticipate in volunteer, charity programs and communities (both technical and interest-based)You can plan your individual career path together with your manager.Receive regular feedback from colleaguesImprove your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)Get the opportunity to undergo free training and certification in AWS, GCP, or Azure CloudsUse the internal E-learn training program (18,200+ specialized training and mentoring programs)Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resourcesStudy at EPAM Solution Architecture School with the instructors who are practicing architectsDevelop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and moreParticipate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)Vacation and sick leave (including a sick leave without a medical certificate)A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)Medical insurance for family members at corporate ratesCompany support during significant life events (childbirth or adoption, marriage, etc.)Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic trainingE-kids program - a free programming language training program for EPAMers' childrenThe remote option applies only to the Candidates who will be working from any location in Ukraine.EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.