SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Kpler is a global intelligence platform that simplifies complex trade information across commodities, energy, and maritime sectors. Founded in 2014, the company serves over 850 experts across 69 countries, transforming intricate data into actionable strategies for clients navigating dynamic markets.
In this Senior Data Engineer role, you will architect and maintain production data ingestion pipelines that power Kpler's analytical platforms. You'll design flexible data ingestion frameworks using Java and Python with Airflow, sourcing from Kafka, S3, and Iceberg, and delivering to Snowflake and ClickHouse. You'll own end-to-end service reliability through proactive monitoring, actionable alerting, and on-call participation to minimize pipeline failures.
You will lead technical project delivery by breaking down complex engineering problems, authoring design proposals, and guiding peer engineers to ship capabilities on schedule. A key part of your role is elevating developer experience by building reusable tools, clear documentation, and paved paths that enable other engineering teams to adopt and extend data ingestion frameworks with minimal friction.
You'll collaborate across Cloud Platform engineers, Product Managers, tech leads, and client technical teams to align pipeline capabilities with business and customer needs. You'll also mentor new engineers, conduct constructive code reviews, and share technical best practices to foster continuous improvement.
**Requirements:**
**Must-haves:**
- ~3+ years of professional software or data engineering experience building, operating, and maintaining production data ingestion pipelines (batch/streaming) using tools like Kafka, S3, Iceberg, or Airflow
- High proficiency in Java and Python, backed by strong SQL skills, data modeling fundamentals, and analytical warehouse experience (Snowflake or equivalent cloud data warehouse)
- Demonstrated ownership of production cloud services on AWS, including monitoring/observability, performance tuning, and Kubernetes deployment workflows (GitOps/CI/CD)
- Strong communication skills to partner with cross-functional product, platform, and external client technical teams
**Nice-to-haves:**
- Hands-on experience optimizing Snowflake resource sizing and cost/performance trade-offs, or operating OLAP engines like ClickHouse
- Familiarity with AWS Transfer Family (sFTP), Excel add-in integrations, or Python boto3 client data delivery setups
- Basic exposure to TypeScript, Vue.js, or API integrations for presenting data in end-user workflows
