Principal Azure Data Platform Architect – Databricks, MLOps Lead
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Azure Data Platform Architect building secure Databricks and MLOps infrastructure for Florida government oversight. Engineering multi-agency pipelines, monitoring, governance, and State ownership transition.
Responsibilities:
- Own the core system architecture across DEV, TEST/QA, UAT, and PROD environments
- Deploy, configure, and manage State-owned Azure infrastructure using ADLS Gen2 and Databricks workspaces
- Establish automated ingestion, loading, schema processing, business-rule, and machine-learning scoring pipelines
- Implement monitoring and alerting for pipeline anomalies, failures, and performance degradation
- Engineer version control, rollback, environment promotion, and disaster-recovery mechanisms aligned to RTO/RPO targets
- Implement logging, error handling, retry logic, metadata management, and source-to-target lineage
- Coordinate technical onboarding for 8–10 state agencies, including secure file transfer and schema integration
- Package and document system components, mapping templates, notebooks, and configuration files for State ownership and transition
Requirements:
- 10+ years of enterprise software or big data engineering experience
- 5+ years of hands-on Azure cloud architecture and data platform deployment experience
- Production experience with Azure Data Lake Storage Gen2, Azure Databricks, and Azure Data Factory or equivalent orchestration tools
- Advanced Python/PySpark and SQL proficiency for streaming and batch processing
- Expert knowledge of Raw, Silver, and Gold data-layer architectures, schema evolution, data quality validation, and ledger reconciliation
- Experience establishing API, database, and flat-file ingestion pathways across disparate legacy architectures
- Advanced hands-on Azure security experience with Entra ID, RBAC, managed identities, and Key Vault
- Experience building CI/CD pipelines, version-controlled repositories, and production monitoring dashboards
- Documented MLOps experience supporting ML scoring workflows, model deployment automation, or pipeline drift detection
- Experience delivering technology, cloud architecture, or data infrastructure projects for local, state, military, or federal government entities
- Must be a U.S.-based citizen or resident and currently live inside the United States
- Must successfully clear an FDLE Level II background screening, including fingerprinting, within 5 business days of contract award
- Resume must explicitly document government customer, architecture scale, personal engineering contributions, production deployment status, and quantifiable performance metrics
- Strongly preferred: Azure Government, MLflow, Delta Lake, data lineage/metadata cataloging, Power BI/.pbix, NIST, FedRAMP High, CJIS, HIPAA, and multi-agency data exchange experience
Benefits:
- Opportunity to work on revolutionary federal IT infrastructure
- Opportunity to grow alongside cutting-edge technology
- Promotion from within
- Equal opportunity employment
Similar Jobs
Software Engineer, Back-End – Mail
Back-end engineer building scalable AI orchestration services and real-time infrastructure for Superhuman’s productivity platform. Collaborating across product teams to deliver reliable AI-powered features.
Senior Python Developer
Senior Python Developer building private cloud solutions for global clients at Software Mind. Designing backend applications, migrating workloads, and supporting production platforms.
Technical Architect, ServiceNow
SAFE/ServiceNow Technical Architect designing enterprise ServiceNow solutions for CGI’s U.S. federal consulting business. Guiding Agile teams across architecture, integrations, automation, governance, and platform strategy.
Senior Python Engineer, Document App
Senior Python Engineer building real-time collaborative document editing systems for PandaDoc’s document workflow automation platform. Owning persistence, event-driven services, reliability, and AI-powered document workflows.
Senior Python Engineer, Document App
Senior Python Engineer for PandaDoc shaping the Document App Track with innovative solutions. Collaborate with a diverse team and tackle technical challenges in a fully remote environment.
Senior Python Engineer, Document App
Senior Python Engineer enhancing document management within the team at PandaDoc. Contributing to architecture and facing technical challenges in a fast-paced environment.
Python Developer – Mid/Senior
Freelance Python developer building and maintaining commercial applications for Monterail’s tech network. Designing reliable databases, cloud infrastructure, and complex systems for client projects.
Senior Ceph/Rook-Ceph, Kubernetes Storage Engineer
Storage Engineer operating production Ceph and Kubernetes storage infrastructure for a long-term project. Troubleshooting clusters, performance, failures, and high-availability environments.
Senior Developer – .NET
Desenvolvedor .NET Sênior analisando e desenvolvendo soluções para seguros na Reply, multinacional italiana de TI. Trabalhando remotamente com .NET, Angular, Azure DevOps e assistentes de IA.
Java Developer – Mid-level
Desenvolvedor Java pleno criando e mantendo aplicações para a RunTalent. Desenvolvimento de rotinas Spring, integrações DB2 e versionamento com Git/GitHub.
GO Developer, German
Desarrollador Go senior o mid-level para Almato Iberia, integrando sistemas empresariales y creando microservicios backend escalables. Trabajo remoto en España con Docker, Kubernetes, APIs REST, grafos de conocimiento y bases de datos SQL/NoSQL.
Senior Java Backend Engineer – WCS Migration
Senior Java Backend Engineer migrating Mindera’s WebSphere Commerce platform. Building Spring and MongoDB services while modernising enterprise e-commerce systems.
Senior Backend Developer, Spark
Senior Backend Spark Developer building scalable Big Data pipelines for Talan, an international technology transformation consultancy. Leading architecture, performance optimization, integrations, and developer mentoring across financial IT projects.
Desarrollador Backend – Java, Quarkus
Desarrollador Backend Java/Quarkus para un proyecto financiero en Ecuador. Diseñando microservicios, APIs REST y soluciones escalables con prácticas TDD y despliegues cloud-native.
Technical Lead – Technical Architect
Technical Lead/Architect guiding secure enterprise application delivery and AI-assisted modernization for USPS at GDIT. Leading architecture, engineering standards, security, and technical teams remotely.
Java Backend Developer – Spring Boot, Camunda
Senior Java-Backend-Entwicklung für Rockstardevelopers, einen deutschen Softwareentwickler für Enterprise- und Mittelstandsprojekte. Entwicklung und Betrieb von Microservices mit Spring Boot, Camunda, REST/SOAP und Kubernetes.
Senior Backend Engineer
Senior Backend Engineer building AI-native learning tools for simpleclub, an education platform used by millions of students. Owning backend architecture, APIs, data pipelines, and LLM integrations.
Senior Back End Engineer – Ruby on Rails, GO
Senior backend engineer building Ruby on Rails and Go services for PrizePicks’ daily fantasy sports platform. Supporting microservices migration, internal operational APIs, reliability, and engineering mentorship.
Senior .NET Engineer
Senior .NET Engineer developing CAD-integrated applications and Power BI dashboards for Avenga’s engineering and manufacturing clients. Supporting data integration, automation, deployments, and legacy modernization.
Applied AI Engineer, Python, AI
Applied AI Engineer building Python services, prompts, and production AI features for BrightPlan’s financial wellness SaaS. Enhancing AI Coach capabilities and integrating LLM workflows into a live fintech platform.