SlipstreamJobs tracks this role from the company's public career site. Apply directly on the employer's site.
Octus, a leading global provider of credit intelligence and analytics serving hedge funds, investment banks, management consulting, and law firms, is seeking a Principal Data Engineer to design, develop, and lead scalable data ingestion and transformation pipelines. This is a hands-on individual contributor role with mentoring and technical leadership responsibilities.
You will lead the overarching technical strategy for the data platform, ensuring alignment between data infrastructure and long-term business goals. You'll design and develop data ingestion and transformation pipelines that handle diverse data sources including APIs, web data, and internal feeds, ensuring scalability, efficiency, and reliability. As a foundational technical leader, you'll mentor senior engineers within the data platform team, guiding architecture, design, and implementation decisions.
Key responsibilities include architecting and managing data pipelines and orchestration workflows using AWS services (MWAA/Airflow, Lambda, ECS, SQS), implementing infrastructure-as-code using Terraform, and ensuring data quality through automated testing, monitoring, and alerting. You'll partner with data analysts, scientists, and backend engineers to ensure data consistency and reliability, apply best practices in data modeling and ETL/ELT processes, and promote continuous improvement through code reviews and knowledge sharing.
Required qualifications include 8+ years of data engineering or backend development experience with a focus on scalable data solutions, extensive technical leadership experience including mentoring and leading complex projects end-to-end, expert proficiency in Python and advanced SQL skills, and proven experience designing cloud-native data pipelines on AWS. You should have experience with data warehousing or lakehouse technologies (Redshift, Snowflake, Databricks), Terraform or similar IaC frameworks, CI/CD pipelines, and containerization with Docker. Strong software engineering principles, excellent communication, and problem-solving skills are essential.
