Work type: Office/Remote Technical Level: Senior Job Category: Software Development Project: Global biopharmaceutical company
Role Overview: As a Lead Big Data Engineer, you will combine hands-on engineering with technical leadership. You’ll be responsible for designing, developing, and optimizing Spark-based big data pipelines in Palantir Foundry, ensuring high performance, scalability, and reliability. You will also mentor and manage a team of engineers, driving best practices in big data engineering, ensuring delivery excellence, and collaborating with stakeholders to meet business needs. While our project uses Palantir Foundry, prior experience with it is a plus, but not mandatory.
Key Responsibilities:
Lead the design, development, and optimization of large-scale, Spark-based (PySpark) data processing pipelines.
Build and maintain big data solutions using Palantir Foundry
Ensure Spark workloads are tuned for performance and cost efficiency.
Oversee and participate in code reviews, architecture discussions, and best practice implementation.
Maintain high standards for data quality, security, and governance.
Manage and mentor a team of Big Data Engineers, providing technical direction
Drive continuous improvement in processes, tools, and development practices.
Foster collaboration across engineering, data science, and product teams to align on priorities and solutions.
Requirements:
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
6+ years in Big Data Engineering, with at least 1-2 years in a lead (tech/team lead) role.
Deep hands-on expertise in Apache Spark (PySpark) for large-scale data processing.
Proficiency in Python and distributed computing principles.
Experience designing, implementing, and optimizing high-volume, low-latency data pipelines.
Strong leadership, communication, and stakeholder management skills.
Experience with Palantir Foundry is a plus, but not required.
Familiarity with CI/CD and infrastructure as code (Terraform, CloudFormation) is desirable.
We offer*:
Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Memorable anniversary presents
Corporate events and team buildings
Other location-specific benefits
Senior Data Engineer with Machine Learning background (#3587)
... We are seeking a proactive Senior Data Engineer to join our vibrant team. As a Senior Data Engineer, you will play a critical ...
Компания: N-iXГород:, ,
Зарплата: Размещено:
ua.talent.com
Senior Data Engineer
... a professional seeking your next big opportunity, we are committed to making the connection that drives success.The Role🚨 READ BEFORE APPLYING – Important Instructions 🚨🚀 Were Hiring: Senior Data Engineer – Join Luxe Vision Consulting 🚀Are ...
Компания: LuxeVision Consulting LLCГород:, ,
Зарплата: Размещено:
ua.talent.com
Senior Data Engineer
... seek a dynamic and talented Data Engineer to join our data team. The ideal candidate should have a strong background in data engineering, with a preference for ... distributed computing principles.Experience with big data tools: Hadoop, Spark, Kafka, etc. ...
Компания: AvengaГород:Kraków - Software Delivery Center, Remote
Зарплата: Размещено:
www.avenga.com
Lead Data Engineer
Big-league professionals never stop and always seek ways to enhance their expertise. The position of Lead Data Engineer on the NIX team is ...
Компания: NIX SolutionsГород:Харьков, Украина
Зарплата: Размещено:
www.nixsolutions.com
Lead Data Science
... ) geographies. The Director of Data Science is a lead Data Scientist role in the Sub- ... to ability to influence senior management within and outside Analytics ... in distributed computing environments big data platforms (Hadoop, Elasticsearch, etc.) as ...
Компания: VisaГород:, Kyiv,
Зарплата: Размещено:
ua.talent.com
Data Engineer
... across Business Intelligence, Data Analysis, Data Science, and Big Data domains. We are now expanding the team with a Big Data Engineer who will help enhance complex data management and analytics solutions.Role OverviewAs a Data Engineer, you will work ...
Компания: N-iXГород:Украина
Зарплата: Размещено:
careers.n-ix.com
Middle/Senior Data Engineer (#4043)
... are building a next-generation data platform, and we’re looking for a Senior Data Engineer to help us make it happen. As a Data Engineer, you will play a key ...
Компания: N-iXГород:, ,
Зарплата: Размещено:
ua.talent.com
Senior/Middle Data Scientist (Data Preparation & Pre-training)
... an experienced Senior Middle Data Scientist with a passion for large language models (LLMs) and cutting-edge AI research. In this role, you will focus on designing and prototyping data preparation pipelines, collaborating closely with data engineers to ...
Компания: КиївстарГород:, Kyiv,
Зарплата: Размещено:
ua.talent.com
Senior/Lead Data Engineer
... . We are looking for a Senior Lead Data Engineer who is passionate about building scalable, cloud-native data solutions and eager to grow ...
Компания: N-iXГород:Украина
Зарплата: Размещено:
careers.n-ix.com
Middle Data Engineer
... are looking for Middle Data Engineer, and we are sure that ... , transform, and load data from a wide variety of data sources, including external APIs, data streams, and data lakes.Implement data privacy and data security requirements to ensure solutions ...
Компания: NIX SolutionsГород:Харьков, Украина
Зарплата: Размещено:
www.nixsolutions.com
Head of Analytics, Core
... to shaping the future of data management. Devart Team is looking ... and data quality management practices Knowledge of agile project management methodologies Soft skills Strategic thinking and ability to see the big picture at the group-of- ...
Компания: DevartГород:Remote, Slovakia, Ukraine
Зарплата: Размещено:
www.devart.com
Data Engineer (#3983)
... the client across Business Intelligence, Data Analysis, Data Science, and Big Data domains. We are now expanding the team with a Big Data Engineer who will help enhance complex data management and analytics solutions. Role ...
Компания: N-iXГород:, ,
Зарплата: Размещено:
ua.talent.com
Lead Big Data Engineer
Role Overview: As a Lead Big Data Engineer, you will combine hands-on engineering with technical leadership. You’ll be responsible for designing, developing, and optimizing Spark-based big data pipelines in Palantir Foundry, ensuring ...
Компания: N-iXГород:Украина
Зарплата: Размещено:
careers.n-ix.com
Senior Data Engineer
Senior Data Engineer Technologies we useExpectedSnowflake Data CloudSQLAbout the projectAre you a skilled Senior Data Engineer (with ETL Talend expertise) looking ...
Компания: INNOVECS POLAND SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄГород:, ,
Зарплата: Размещено:
ua.talent.com
Senior/Lead Data Engineer (#3989)
... are looking for a Lead Data Engineer Architect who is passionate about building scalable, cloud-native data solutions and eager to grow ... design with architects and senior stakeholders - contribute to data architecture, system integrations, and technology ...
Компания: N-iXГород:, ,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Sokil'nyky,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Dnipro,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Odesa,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Odesa,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Odesa,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Sokil'nyky,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Kyiv,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Kharkiv,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Kharkiv,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Dnipro,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Kyiv,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Kyiv,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Sokil'nyky,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Dnipro,
Зарплата: Размещено:
ua.talent.com
AI Engineer (Senior/Lead) ID40978
... for an experienced Senior AI Engineer to join our elite consulting ... with raw, unstructured data and transform it into ML-ready datasets;- Proficiency with data manipulation tools: pandas, NumPy, SQL, and big data frameworks (Spark, Dask);- Expert-level ...
Компания: AgileEngineГород:, Kharkiv,
Зарплата: Размещено:
ua.talent.com
Senior Data Engineer
... field.Proven experience as a Data Engineer or in a similar role.Strong programming skills in languages like Python, Java, or Scala.Experience with big data technologies and frameworks such as ...
Компания: SnaphuntГород:, ,
Зарплата: Размещено:
ua.talent.com
Senior Big Data Engineer
... infrastructure.IF YOU AREExperienced in Data and Analytics Engineering with at ... SQL for delivering and optimizing data assetsStrong in SQL debugging and ... in a multicultural environmentAccustomed to big data frameworks such as Spark or ...
Компания: SoftServeГород:, ,
Зарплата: Размещено:
ua.talent.com
Senior Data Science/AI Engineer
... -performance software solutions that integrate data-driven processes with human expertise to reshape automotive claims management.Your RoleAs a Middle AI Engineer, you will play a key ...
Компания: N-iXГород:Украина
Зарплата: Размещено:
careers.n-ix.com
Senior Technical Business Analyst
... our business stakeholders and the data engineering team. You will work ... as a Technical Business Analyst, Data Analyst, or similar role.Strong data modeling skills and expertise in data analysis techniques.Proficiency in tools ...
Компания: 8allocateГород:Remote
Зарплата: Размещено:
cleverstaff.net
Data Engineer (Senior) ID40199
... development and AI ML, and our people-first ... looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark ...
Компания: AgileEngineГород:, Ternopil,
Зарплата: Размещено:
ua.talent.com
Data Engineer (Senior) ID40199
... development and AI ML, and our people-first ... looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark ...
Компания: AgileEngineГород:, Vovchynets',
Зарплата: Размещено:
ua.talent.com
Data Engineer (Senior) ID40199
... development and AI ML, and our people-first ... looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark ...
Компания: AgileEngineГород:, Vovchynets',
Зарплата: Размещено:
ua.talent.com
Data Engineer (Senior) ID40199
... development and AI ML, and our people-first ... looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark ...
Компания: AgileEngineГород:, ,
Зарплата: Размещено:
ua.talent.com
Data Engineer (Senior) ID40199
... development and AI ML, and our people-first ... looking for a Senior Data Engineer to take ownership of our data infrastructure, designing and optimizing high-performance, scalable solutions. You’ll work with AWS and big data frameworks like Hadoop and Spark ...