SlipstreamJobsFresh Startup & VC-Backed Jobs

Senior Data Platform Engineer — Kafka & PostgreSQL

Mirantis - Remote - Remote - posted 2026-09-18

Apply on the company site

SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.

Mirantis is seeking a Senior Data Platform Engineer to architect and operate the event-streaming and transactional database backbone of k0rdent-ai, a multi-tenant control plane for enterprise GPU infrastructure. This role owns the core pipeline connecting Apache Kafka (via Strimzi) to PostgreSQL (via CloudNativePG), running across elastic Kubernetes clusters and bare metal hardware. You will design and deploy high-availability PostgreSQL topologies and distributed Kafka clusters across containerized and bare metal environments. A substantial focus is custom ecosystem engineering: writing enterprise-grade Go systems code to build custom Kafka clients, connector services, and integration libraries. You will architect system integrations connecting PostgreSQL authentication and row-level security (RLS) to enterprise identity providers (Active Directory, LDAP, OIDC) via role-mapping and session-context layers. Key responsibilities include scaling high-throughput Change Data Capture (CDC) pipelines via Debezium and Kafka Connect while maintaining absolute data integrity. You will design cross-region failover and disaster-recovery orchestration for both PostgreSQL and Kafka, including replication topology decisions, split-brain prevention, and explicit RPO/RTO targets for full region or cluster loss scenarios. You will optimize PostgreSQL for heavy ingestion and zero-downtime operations, tuning Write-Ahead Logs (WAL), logical replication streams, and connection pooling (PgBouncer). Additionally, you will maintain a declarative infrastructure-as-code culture using Terraform and ArgoCD, creating self-service workflows for internal teams to provision databases, topics, schemas, and ACLs. You will implement strict multi-tenant isolation combining database-level RLS with CNI network policies, mTLS, and Kafka topic-level RBAC. Requirements: Must Have: - 10+ years in systems, software, data, or platform engineering with a track record of owning large-scale, business-critical data infrastructure - Go (Golang) or similar engineering skills; comfortable writing clean, concurrent systems code and building custom client libraries - 5+ years managing native PostgreSQL with deep knowledge of database internals (WAL streams, logical replication, publications/subscriptions, connection architectures) across Kubernetes and bare metal - Hands-on experience running PostgreSQL on Kubernetes via a mature Postgres operator (CloudNativePG preferred, or equivalent like Zalando's postgres-operator) - Strong experience managing Apache Kafka at scale on Kubernetes via a declarative operator (Strimzi preferred, or equivalent like Confluent for Kubernetes or Koperator) - Proven experience tuning Kafka Connect and Debezium pipelines; experience writing or contributing to open-source database connectors, Kafka client libraries, or integration frameworks - Hands-on experience building integrations connecting distributed systems to enterprise IAM/SSO providers (Active Directory, LDAP, Okta, Azure AD, or OIDC) - Strong grasp of Kubernetes primitives (Pod lifecycles, Operators, CSI storage layers, CNI overlay routing) backed by production experience in AWS or GCP - Bachelor's degree in Computer Science & Engineering or related field, or 10+ years equivalent related experience Nice to Have: - Experience designing and operating cross-region disaster recovery and failover orchestration for stateful systems, including split-brain prevention and RPO/RTO trade-offs - Active contributions to open-source Kafka connectors, PostgreSQL operators, or Go-based database libraries - Experience with schema governance for event streams (Karapace or Confluent Schema Registry) and compatibility-mode management - Familiarity with high-cardinality telemetry ingestion using Apache Flink or Kafka Streams - Familiarity with US enterprise compliance benchmarks (SOC 2, ISO 27001) - Hands-on knowledge of open-source Redis or MongoDB

Similar roles