Sr Data engineer IRC268878

Описание

DescriptionThis is an enterprise-level system in the MSG MSS domain, integrated within the Azure cloud environment.The project uses such technology stack:Frontend: React, Material UI, react-hook-form, LESS, styled-components, react-intl, recharts, fetchBackend: .NET Core, Azure Functions, EF Core, Dapper, ADO.NETDevOps: Azure DevOps for CI/CD, task tracking, and version control (will move to github in future)Team communication is conducted entirely in English.Requirements3+ years of experience in a Data Engineer or similar role.Strong hands-on experience with Databricks: Spark jobs, PySpark, Delta Tables, Unity Catalog.Solid understanding of Azure Cloud services and infrastructureProficient in MS SQL Server, including query optimisation and database design.Strong programming skills in Python for data processing and automation.Experience with data modelling concepts and best practices.Experience building API integrations.Proficient in handling and processing Excel files programmatically.Working knowledge of BI Tools and integration with data sources.General:English: Upper-Intermediate or higher (team communication, documentation, meetings)Experience working in Agile teams and with Azure DevOpsNice to have:Experience with Azure Functions and .NET development.Familiarity with orchestration tools such as Azure Data Factory and ETL processes.Exposure to LLM (Large Language Models) or other AI/ML-based systems.Knowledge of PowerQuery and Microsoft Power Automate.Experience in CI/CD practices for data pipeline deployment.Job responsibilitiesDesign, build, and maintain scalable data pipelines using Databricks, PySpark, and Delta Lake.Implement and manage data workflows in Azure Data Lake and support metadata management using Unity Catalog.Write efficient SQL queries and manage MS SQL Server and Azure SQL Databases.Collaborate with ML engineers, and business stakeholders to model and organise data for analytical purposes.Develop and integrate APIs for seamless data exchange across systems.Handle various data formats, including Excel, and automate ingestion and transformation processes.Build and maintain documentation for data systems and workflows.Provide support for BI reports and dashboards, including optimising data models and queries.Proficiency in analysing and structuring data, discovering underlying trends, and preparing curated datasets for analytics and reporting.What we offerCulture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.About GlobalLogicGlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.