About the role
You will develop, deploy, and improve distributed big-data pipelines to support network analysis and machine learning capabilities. Additionally, you will serve as a technical expert in client-facing meetings to bridge the gap between complex government requirements and platform architecture.
What they look for
Requirements
Candidates must have 8+ years of experience in data engineering with a proven track record of managing full-lifecycle data ingestion and standardization pipelines at scale. Proficiency in cloud environments, containerization, and the ability to obtain UK Security Check (SC) clearance are essential.
Full description
Altana is the network for trusted trade. Our AI-powered product network empowers governments and businesses to build a more resilient and secure global economy while keeping trade flowing.
Who We Are
AI can be a powerful tool for good in the world – at Altana we apply AI to the world’s largest organized body of supply chain data to power a more resilient, more secure, and more sustainable model of global commerce. Our customers connect to the Altana network to build resilience for critical industries and infrastructure, automate and safeguard cross-border trade, transform insurance underwriting, protect national security, combat modern slave labor, disrupt fentanyl trafficking, and ensure that their products are sustainable.
Altana is backed by leading investors and used by the world’s most important organizations, including Lloyd’s, Maersk, multiple government agencies across the US, UK, EU, Singapore, and Australia, General Atomics, Boston Scientific, and more. We are building a global platform connecting the public and private sectors into an AI-powered network for building trusted supply chains. We operate in accordance with our values: we focus on value creation, not capture; we foster diversity and embrace difference; we embrace reality; we get things done; we amaze our clients. When you join Altana, you’ll be joining a vibrant, collaborative team working together to solve complex problems with the potential for global societal impact.
The Opportunity at Altana
The Platform Operations & Compliance team is focused on integrating Altana’s products with customers to provide unique insights, business process integrations, and create mutual value. We execute complex customer integrations to create and customize data pipelines for unique customer scenarios; integrate proprietary customer data to our knowledge graph while supporting reliability, release, cost and control obligations that come with operating big-data pipelines for public sector customers. The Platform Operations & Compliance team works closely with customers, as well as our internal Engineering, Machine Learning, InfoSec and Product organizations.
In this role, you will:
- Develop, deploy and continuously improve distributed, big-data pipelines powering Altana’s state of the art network analysis, ML, data ingestion and fusion capabilities
- Understand and drive forward Altana's technology to make it more scalable and to meet the evolving requirements of our customer base
- Support platform reliability, cost and controls and support customer security reviews and accreditations
- Serve as the technical expert in client-facing meetings, bridging the gap between complex government requirements and our platform's technical architecture.
- Work in a cross-functional team of engineers, data scientists, and product managers
- Evaluate and recommend new tools, technologies, and best practices for data pipeline development, orchestration and deployment
About You
You are a seasoned data engineer and technical leader with deep expertise in building and scaling data systems. You combine strong hands-on engineering skills with the ability to set technical direction, influence across teams, and elevate those around you. You are someone who proactively takes ownership of the end-to-end design and operation of data solutions and refines the systems to deliver measurable results.
- 8+ years of technical experience in data engineering or closely related roles
- You have extensive experience across the design, development, and maintenance of complex data models from a variety of sources and schemas
- Demonstrated track record of leading the full lifecycle (Design, Development, Test, Deploy, Monitor, Maintain) of data ingestion and standardization pipelines at scale
- A demonstrated drive for sustainable software development, self-healing data workflows, and a deep appreciation for data security and data governance
- Experience deploying and integrating software solutions across client cloud environments (AWS/GCP/Azure), managing core services like EC2, S3, IAM, and Dockerized microservices
- Experience leading and mentoring other engineers on complex data engineering projects
- You are eligible and willing to obtain UK Security Check (SC) clearance or have an active clearance already
- Excellent written and verbal communication skills, with a track record of successfully interacting directly with external customers and stakeholders to scope technical work and manage expectations
- Keep up to date with latest trends in data engineering and care deeply about engineering excellence and knowledge sharing
Nice to have, but not required
- Experience with managing a data platform, including monitoring and managing releases, costs and infrastructure changes
- Expertise or experience with the deployment of ML pipelines
- Exposure to trade compliance, supply chain management or a field similarly related to international commerce
- Experience working with or within the public sector
- Familiarity using AI tools to enhance the quality & pace of your output
Technologies we love
- Languages: Python, Spark, SQL
- Tools: AWS, Azure, Git, Rest APIs, Kubernetes, Docker, Terraform, Datadog
- Datastores: Databricks, OpenSearch, Postgres
Equal Opportunity Statement
At Altana, we believe that a diverse workforce enables greater creativity, performance, and adaptability. We’re proud to be an equal opportunity employer and welcome you to join us as you are. Our employment opportunities and decisions are based on business needs and individual qualifications, without regard to race, color, religious creed, national origin, ancestry, age, physical or mental disability, medical condition, marital status, sexual orientation, gender identity or expression, genetic information, family care or medical leave status, military or veteran status, or any other characteristic protected by the laws or regulations in the areas in which we operate. We prohibit discrimination and harassment of any type, in any situation.
Our Values
Our values are the core beliefs that shape who we are, what we stand for, and how we behave.They form the foundation of Altana’s culture and integrity and guide how we hire, design, build, and connect with each other and our customers.
- Trust: Our customers and partners entrust us with missions of the highest importance. We honor that by keeping our word, meeting commitments, and ensuring every action we take reinforces confidence in us. We rely on each other to deliver, to speak openly, and to hold ourselves accountable.
- Resilience: In a world of uncertainty and complexity, our work must withstand challenges, evolve with conditions, and ensure reliability over time. Resilience is both how we operate and what we deliver. It’s how we respond when things don’t go to plan –– we adapt, we support each other, and we keep moving forward.
- Stewardship: We are stewards of every mission we touch. Because our work impacts lives and futures, we hold ourselves accountable to delivering mission impact and never compromising. Our responsibility extends beyond individual projects to the broader system of global trade. We believe that stewardship starts from within so that we can bring focus, creativity, and excellence to our work. Each of us is personally responsible for fostering a workplace where people can thrive. And we are stewards of the greater good of the company. By holding ourselves and each other accountable, we build a culture of innovation and collective success that reflects the scale of our mission.
- Courage: Courage is what unlocks the seemingly impossible for our customers. It’s the core value that drives us make bold moves and take on big, complicated network problems—the ones others avoid. We know success isn't guaranteed, but we have the audacious vision to believe a solution is possible and to build it. Courage fuels our growth mindset. It means embracing challenges that make us stronger, and it’s demonstrated by how we approach hard conversations and complex projects.
At Altana, we believe that a diverse workforce enables greater creativity, performance, and adaptability. We’re proud to be an equal opportunity employer and welcome you to join us as you are. Our employment opportunities and decisions are based on business needs and individual qualifications, without regard to race, color, religious creed, national origin, ancestry, age, physical or mental disability, medical condition, marital status, sexual orientation, gender identity or expression, genetic information, family care or medical leave status, military or veteran status, or any other characteristic protected by the laws or regulations in the areas in which we operate. We prohibit discrimination and harassment of any type, in any situation.
Offers related to employment at Altana will come from an Altana.ai email address. We will never ask for payment as part of the interview or onboarding process.
Similar roles
-
Data Engineer
Green River Data Analysis Vermont, United States · $120K–$135K/yr
-
Data Engineer Mid
Bluetab, an IBM Company San Isidro, Lima, Peru
-
Senior Data Engineer, Blockchain data and/or NLP pipelines
Inca Digital, Inc. United States
-
Data Engineer Jr
Bluetab, an IBM Company Bogota, Capital District, RAP (Especial) Central, Colombia
-
Senior Data Engineer
Sporty Group São José da Laje, Alagoas, Brazil
-
Senior Data Engineer
Tastewise Tel Aviv, Tel-Aviv District, Israel