Senior Data Engineer

Описание

This is us

At Avenga, we believe that human creativity empowers technology that matters. Operating globally, our 6000+ specialists provide a full spectrum of services, including business and tech advisory, enterprise solutions, CX, UX and Ul design, managed services, product development, and software development.

This is the job

We are seeking a highly skilled Senior Data Engineer with strong expertise in Databricks and Python (PySpark). In this role, you will design and implement robust data pipelines, develop analytical datasets, and build advanced visualization solutions. 

Your work will directly support the creation of interactive and publication-ready outputs that our feasibility team will use in clinical research proposals. 

You will be joining a team working on a toolkit for generating Feasibility Analytics. Rather than a standalone application, this will be a set of tools and code that technical resources and programmers can use to quickly generate consistent outputs for proposals.

This is you

• Strong expertise in Databricks and Python (PySpark).
• Proven track record in building custom, interactive visualizations with Python visualization libraries.
• Hands-on experience working with complex datasets from multiple sources.
• Solid knowledge of ETL/ELT pipeline design and data engineering best practices.
• Strong problem-solving skills with high attention to detail.
• Excellent communication and stakeholder collaboration skills.

This is your role

• Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
• Implement routines to match and merge data from multiple internal and external sources.
• Create standardized queries for internal datasets (e.g., ICD-10 codes).
• Build unified datasets optimized for charting, reporting, and analytics.
• Develop interactive, configurable visualizations using Python libraries (matplotlib, Plotly, seaborn, etc.).
• Generate global and US-specific prevalence/incidence maps, including overlays of target site locations.

What awaits you at Avenga?

• Through our values, Better Minds, Bolder Ideas, and Bigger Hearts, we strive to provide you with the tools, autonomy, trust, and assistance you need to excel. Enjoy benefits like private health insurance, well-being programs, flexible and hybrid work models, laptops and gear, training, language classes, social events, great offices, and more.
• We take pride in the diverse skills and character of our teams, welcoming everyone to apply and contribute to our collective strength.