SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Join Innovaccer's Lakehouse team as a Senior Software Engineer to build and operate data pipelines at the core of our on-premise healthcare platform. You will work hands-on across the full pipeline surface, from file validation and quarantine at ingestion to query performance and table health in serving.
Key responsibilities include:
- Build Spark ingestion jobs that land high-volume raw healthcare files into Apache Iceberg tables with schema handling, bad-record quarantine, and idempotent batch replay
- Develop and operate Trino SQL transform pipelines across data layers: validation and typing, business-rule transforms, MERGE-based deduplication, and aggregate builds
- Port existing warehouse SQL workloads to Trino and Spark SQL dialects, validating results against source outputs
- Automate Iceberg table maintenance: compaction, snapshot expiry, and orphan-file cleanup as scheduled workflows
- Tune query and pipeline performance through partitioning strategy, file sizing, statistics, and resource-group behavior
- Instrument pipelines with data-quality checks, reconciliation reports, and alerting; participate in per-dataset validation during rollout phases
Required qualifications:
- B.E., B.Tech., or M.Sc. in Computer Science or related technical field
- 5+ years of data engineering experience building production pipelines at scale
- Strong SQL skills and hands-on Apache Spark experience for batch processing
- Experience with Trino/Presto (or comparable distributed SQL engine) and open table formats (Iceberg preferred; Delta Lake or Hudi acceptable)
- Working knowledge of S3-compatible object storage and columnar file formats (Parquet)
- Experience with workflow orchestration tools (Airflow or equivalent) and CI/CD for data pipelines
- Professional development experience with Python and/or Java
- Healthcare data formats (HL7, CCDA, claims files) and regulated-environment experience are pluses
Innovaccer builds software that helps hospitals, clinics, and health insurance companies connect scattered data across systems and turn it into actionable insights. The platform is used by major US healthcare systems including CommonSpirit Health, Atlantic Health, and Banner Health.
