The Lead Specialist, Data Lakehouse II delivers, operates, and optimizes lakehouse platform capabilities to support scalable ingestion, storage, processing, and governed consumption of enterprise data. The role ensures the lakehouse enables reliable analytics and reporting by applying standard patterns for data layers, performance tuning, security, and cost management.
The position works closely with platform engineering, data engineering, and governance teams to embed controls, ensure operational excellence, and support delivery teams with reference architectures and implementation guidance.
Key Accountabilities
- Implement and enhance lakehouse architecture patterns (ingestion, raw/curated layers, data products) ensuring scalability, maintainability, and reuse.
- Optimize performance of compute and storage through partitioning, file formats, indexing, caching, and workload management; ensure SLAs for priority use cases.
- Embed governance-by-design by integrating security, access controls, classification handling, and auditability into platform patterns.
- Support ingestion and transformation pipelines by providing platform guidance on orchestration, reliability patterns, and error handling.
- Define and maintain operational monitoring (health checks, pipeline observability, capacity, costs) and drive incident/problem management improvements.
- Collaborate with data modeling and governance teams to ensure metadata, lineage, and data quality controls are systematically applied to lakehouse assets.
- Provide technical leadership to specialists and vendors; perform design reviews and enforce platform standards across delivery initiatives.
- Contribute to platform roadmap and continuous improvement, evaluating new features and recommending adoption aligned to enterprise needs.
Minimum Qualification
- Bachelor s degree in Computer Science, Data Engineering, Information Systems, or related field.
Minimum Experience
- 7 10 years of experience in data engineering and modern data platforms with hands-on lakehouse experience.
- Experience operating production platforms with reliability, security, and cost optimization responsibilities.
