Senior Azure Data Platform Engineer

Job Title: Senior Azure Data Platform Engineer 

We are seeking a highly experienced Senior Azure Data Platform Engineer with a strong background in building and operating large-scale Enterprise Data, Analytics, and AI platforms. The ideal candidate possesses deep expertise in Infrastructure as Code (IaC)—primarily Terraform—along with proven DevOps expertise and solid programming skills in Python and SQL.

You will drive the observability, monitoring, alerting, and resiliency of data applications and APIs hosted in Azure Databricks and third-party Data Platforms. You must have advanced knowledge of Azure Networking and experience designing regional disaster recovery plans. This role is critical to our initiative to deliver a scalable, secure, and fully automated enterprise data platform that supports advanced analytics and machine learning workloads.

Key Responsibilities

• Design, implement, and operate Azure cloud infrastructure supporting enterprise Data, Analytics, and ML platforms.
• Build and maintain Terraform-based IaC, ensuring standardized, compliant, and fully automated deployments with a focus on modularity and reusability.
• Build automation for provisioning, configuration, governance, and operational tasks using CI/CD pipelines (Azure DevOps or GitHub Actions).
• Architect highly available and fault-tolerant systems within primary regions, while designing roadmaps for future multi-region failover capabilities.
• Design and implement Regional Disaster Recovery Plans (DRP), defining RPO/RTO metrics and establishing processes for regular DRP validation drills.
• Continuously optimize the cost, performance, and scalability of compute, storage, and networking resources.
• Implement enterprise observability and monitoring strategies; define SLIs/SLOs and integrate appropriate metrics, logging, and alerting.
• Troubleshoot complex cloud infrastructure issues, driving root-cause analysis (RCA) and implementing preventative measures.
• Ensure all platform components meet rigorous security, identity, and compliance standards, including network isolation, encryption, key management, RBAC, and least-privilege design.
• Partner closely with Data Engineering, ML Engineering, and Security teams to design platform components that support ingestion, transformation, model training, and model serving.
• Contribute to the evolution of platform architecture and maintain comprehensive technical documentation within an Agile environment.

Required Experience, Skills & Education

Technical Experience

• 5+ years of Azure engineering experience, with a strong focus on infrastructure for large-scale Data/Analytics/ML environments.
• Expert-level Terraform skills, including building, governing and implementing best practices of IaC. 
• Deep understanding of Azure services commonly used in enterprise data platforms, such as:
  • Storage Accounts, Data Lake, Key Vault
  • Azure Databricks, Azure Data Factory
  • Service Bus, Event Hub, API Management
  • Azure Functions, AKS (preferred), Container Apps
• Strong foundational knowledge of Azure core infrastructure:
  • Networking: VNet design, Private Endpoints, VNet Peering, ExpressRoute, APIM and DNS.
  • Security: IAM, RBAC, Managed Identities, Conditional Access, and Policy enforcement.
  • Operations: Load Balancing, Resiliency patterns, and DR strategies.
• Experience designing enterprise monitoring solutions (metrics, logs, traces, dashboards) and defining SLI/SLOs.
• Familiarity with data platform patterns, including the "Medallion" architecture (Bronze/Silver/Gold).
• Hands-on experience with CI/CD pipelines and orchestration via Azure DevOps or GitHub

Soft Skills

• Excellent problem-solving and troubleshooting capabilities.
• Strong communication skills and the ability to collaborate across engineering, data, and security teams.
• Experience working within Agile (Scrum or Kanban) delivery environments.

Education & Certifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Preferred certifications:
  • Azure Solutions Architect Expert
  • Azure Platform Architect 
  • HashiCorp Terraform Associate.

Other Requirements

• Must be authorized to work in the U.S.
• Must be willing to work Pacific Time hours.