Staff Data Engineer/Data Architect

Описание

Transporeon is a SaaS company founded in 2000 in Ulm, Germany. The company provides logistics solutions across several areas, including:Buying & selling of logistics servicesOrganizing shipment executionOrganizing dock, yard, truck, and driver schedulesInvoice auditing for logistics services

It has grown significantly over the years, reaching €150m in revenue before being acquired by Trimble for $2 billion USD in 2022. Transporeon has one of the largest networks of shippers and carriers in Europe, with approximately 1,400 employees:

We are looking for a highly skilled Staff Data Engineer/Data Architect for our Data and Cloud Engineering team with expertise in AWS and Azure. The ideal candidate will have a strong technical background in designing, building, developing, and implementing data pipelines and cloud solutions along with excellent technical guidance and communication skills. This role requires a strong technical background in cloud platforms, data architecture, and engineering best practices.

Your daily tasks...

Lead the design and implement robust, scalable, and secure cloud-based data pipelines and architectures in AWS (later maybe migrating to MS Azure).Ensure best practices in code quality, architecture, and design.Design and implement secure, scalable, and high-performance cloud infrastructure.Manage cloud resources, optimize costs, ensure high availability and disaster recovery.Automate infrastructure provisioning and deployment processes using Infrastructure as Code (IaC) tools such as Terraform, CloudFormation, and ARM templates.Collaborate with cross-functional teams to understand data needs and deliver comprehensive cloud solutions.Oversee cloud infrastructure management, including monitoring, maintenance, and scaling of cloud resources.Ensure compliance with industry standards and regulatory requirements.Implement data governance policies and practices and ensure high data quality, integrity, and security across all cloud platforms.Identify and implement process improvements to enhance efficiency, quality, and scalability of data engineering and cloud operations.Stay current with emerging technologies and industry trends to drive innovation. Utilize AI to increase our efficiency.

Our tech-stack...

Infrastructure: Glue, Lambda, Step Function, Batch, ECS, Quicksight, Machine Learning, Sagemaker, DagsterDevOps: Cloudformation, Terraform, Git, CodeBuildDatabase: Redshift, PostgreSQL, DynamoDB, Athena (Trino), Snowflake, DatabricksLanguage: Bash, Python (PySpark, Pydantic, PyArrow), SQL

What do you bring to the table...

Min. 8 years of proven experience as a Data Engineer with current focus on data architecture design.Extensive experience with AWS and Azure cloud platforms and their data services (, AWS Redshift, AWS Glue, AWS S3, Azure Data Lake, Azure Synapse, Snowflake, Databricks).Strong understanding of ETL processes, data warehousing, and big data technologies.Proficiency in SQL, Python, and other relevant programming languages.Experience with infrastructure as code (IaC) tools such as Terraform, CloudFormation, or ARM templates.Knowledge of containerization and orchestration (, Docker, Kubernetes).Understanding of cloud cost management and optimization strategies.Familiarity with CI/CD pipelines and DevOps practices.Excellent leadership, communication, and interpersonal skills.Ability to work in a fast-paced, dynamic environment.Strong problem-solving and analytical skills.Familiarity with data visualization tools (, Power BI, QuickSight) is a plus.Openness to use AI, in our case Cursor, as your daily tool.

Job Location
Remote role in following countries: Estonia, Latvia, Lithuania, Poland, Slovakia, Hungary, Romania, Portugal, Spain, Italy, Croatia. We are not offering freelancing contract, only local employment contract.
 

Our Inclusiveness Commitment
We believe in celebrating our differences. That is why our diversity is our strength. To us, that means actively participating in opportunities to be inclusive. Diversity, Equity, and Inclusion have guided our current success while also moving our desire to improve. We actively seek to add members to our community who represent our customers and the places we live and work.

We have programs in place to make sure our people are seen, heard, and welcomed and most importantly that they know they belong, no matter who they are or where they are coming from.