SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Altana is an AI-powered platform that serves as a network for trusted trade, helping governments and businesses build a more resilient and secure global economy. The Platform Operations & Compliance team integrates Altana's products with customers to deliver unique insights, business process integrations, and customer value through complex data pipeline implementations.
In this role, you will develop, deploy, and continuously improve distributed big-data pipelines that power Altana's network analysis, ML, data ingestion, and fusion capabilities. You'll understand and drive forward the platform's technology to meet evolving customer requirements, particularly for public sector clients. You'll support platform reliability, cost management, and controls while assisting customers with security reviews and accreditations. As a technical expert, you'll bridge the gap between complex government requirements and the platform's technical architecture in client-facing meetings. You'll work cross-functionally with engineers, data scientists, and product managers to evaluate and recommend new tools, technologies, and best practices for data pipeline development, orchestration, and deployment.
You are a seasoned data engineer and technical leader with deep expertise in building and scaling data systems. You combine strong hands-on engineering skills with the ability to set technical direction, influence across teams, and elevate those around you. You proactively take ownership of end-to-end design and operation of data solutions, refining systems to deliver measurable results.
Technologies include Python, SQL, Databricks, OpenSearch, Postgres, AWS, Azure, GitHub, Docker, Kubernetes, Terraform, and Datadog.
REQUIREMENTS:
- 8+ years of technical experience in data engineering or closely related roles
- Experience working with or within the public sector
- Extensive experience in design, development, and maintenance of complex data models from various sources and schemas
- Demonstrated track record leading the full lifecycle (Design, Development, Test, Deploy, Monitor, Maintain) of data ingestion and standardisation pipelines at scale
- Demonstrated drive for sustainable software development, self-healing data workflows, and deep appreciation for data security and data governance
- Demonstrated experience working with cloud platforms, including architecting, engineering, or administering cloud solutions
- Excellent written and verbal communication skills with track record of successfully interacting directly with external customers and stakeholders
- Keep up to date with latest trends in data engineering and care deeply about engineering excellence and knowledge sharing
NICE TO HAVE:
- Experience managing a data platform, including monitoring and managing releases, costs, and infrastructure changes
- Experience leading and mentoring other engineers on complex data engineering projects
- Exposure to trade compliance, supply chain management, or international commerce
- Knowledge of entity resolution or graph databases
- Expertise with ML pipeline deployment
- Expertise with IRAP, Essential Eight, or other InfoSec standards and frameworks
- Familiarity using AI tools to enhance output quality and pace
