SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Salary: USD 200,000 - 275,000 / annual
Peregrine Technologies is seeking a Staff Software Engineer to lead the design and operation of the data infrastructure layer that powers its AI-enabled platform for public safety and government agencies. This is a senior individual contributor role focused on architecting and building systems that ingest, store, and serve massive volumes of real-time operational data at scale.
Key responsibilities include designing and operating a high-throughput, real-time data integration platform across diverse customer environments; architecting a scalable open table format layer for reliable data storage at petabyte scale; building and optimizing distributed data processing pipelines using Apache Spark and streaming technologies; driving performance, reliability, and cost efficiency across the full data infrastructure stack; collaborating with platform and product teams to define data contracts and integration patterns; and establishing best practices and tooling that raise the quality bar for data infrastructure across the organization.
The technical stack includes AWS GovCloud, Apache Iceberg, Apache Spark, Apache Kafka, Airflow, and Kubernetes. You will have deep ownership over foundational infrastructure decisions and work closely with deployment teams and users to iterate on solutions.
Required qualifications include 8+ years architecting and operating large-scale data infrastructure in production; deep expertise with Apache Iceberg (schema evolution, partitioning, compaction, time travel); extensive hands-on experience with Apache Spark for batch and streaming; strong background in real-time data integration using Kafka, Flink, or equivalents; experience with Airflow or similar orchestration tools; strong software engineering fundamentals in Python and/or Scala; extensive AWS or comparable cloud platform experience including S3-based data lakes; Kubernetes and containerized deployment experience; and a degree in Computer Science, Engineering, or related field (or equivalent practical experience). Candidates must be located in San Francisco, New York, or Washington DC and open to working in office.
