Staff Engineer, Big Data
Employment Information
Job Description
Lead Consultant for Azure Data Platform Engineering and Ops. Designing and managing data solutions on Microsoft Azure while leading a team of data engineers.
Responsibilities:
- Lead and mentor a team of data engineers and operations specialists, providing technical guidance, fostering skill development, and promoting a culture of excellence
- Collaborate with stakeholders to design scalable and efficient data architectures using Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB
- Oversee the development of data pipelines, ETL/ELT processes, and data integrations, ensuring data quality, optimal performance, and adherence to best practices
- Manage the day-to-day operation and maintenance of the Azure Data Platform, including monitoring, troubleshooting, and performance optimization
- Implement automation strategies and DevOps practices to streamline deployment, monitoring, and management of data solutions, ensuring efficient operations and rapid response to issues
- Handle Data Security and Compliance, Capacity Planning and Scalability, Collaboration and Communication, Performance Monitoring and Optimization
Requirements:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
- Extensive experience in data engineering, data architecture, and cloud platform operations, with a focus on the Microsoft Azure ecosystem
- In-depth knowledge of Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB
- Proficiency in designing and optimizing data pipelines, ETL/ELT processes, and data integrations
- Strong understanding of data governance, security best practices, and compliance standards in a cloud environment
- Hands-on experience with automation, infrastructure as code (IaC), and DevOps principles
- Excellent leadership and team management skills, with a proven ability to guide and inspire technical teams
- Azure certifications such as Microsoft Certified: Azure Solutions Architect Expert or equivalent are highly desirable.
Benefits:
- Flexible work arrangements
- Professional development
Related Jobs
Principal Software Engineer
DriveTime
Principal Software Engineer leading AI-driven innovation at SilverRock. Overseeing AI research and engineering strategy with a focus on architectural excellence and mentorship.
Senior Software Developer
Everway
Senior Software Developer designing and developing software solutions at Everway, a neurotechnology company focused on user management and licensing services. Join a remote team enhancing user-centered technologies.
Senior Engineer
Petco
Senior Engineer for developing and implementing solutions in line with Petco's vision for health and wellness. Engaging in complex problem solving to drive business value and improve customer outcomes.
Software Developer, 100% remote
Powerprozesse GmbH
Software Developer creating low-code automations for clients remotely. Analyzing business processes and implementing automation solutions without prior programming experience required.
Software Developer – SaaS, IoT, Full-Stack Product Development
Keycafe
Software Developer building and maintaining IoT solutions within global key management systems. Join a collaborative engineering team to develop scalable applications across diverse technologies.
Principal Software Engineer – Operational Databases
Cloudera
Principal Software Engineer responsible for design and implementation of Apache HBase and Cloudera Operational Database. Collaborating across teams while mentoring engineers in a distributed setting.
Staff Software Engineer
Lyric - Clarity in motion.
Staff Software Engineer designing scalable systems across platform for healthcare tech company. Leading technical decisions and mentoring engineers while driving innovation with AI.
Lead Software Engineer, Full Stack
Capital One
Lead Software Engineer developing cloud-based solutions for Capital One Software. Collaborate with product managers and mentor engineers in a dynamic technological environment.
Software Engineer III
PartnerOne
Software Engineer building cybersecurity solutions for Fortune 500 companies. Join XYPRO to develop and troubleshoot software across various technologies in a remote setting.
Staff Software Engineer – Foundational Data Systems for AI
Granica
Staff Software Engineer developing foundational data systems at Granica for efficient enterprise AI solutions. Collaborating with research on performance at exabyte-scale for major global enterprises.
Software Engineer – Foundational Data Systems for AI
Granica
Software Engineer at Granica designing foundational data systems for AI. Focus on efficient data representation, processing, and infrastructure development.
Senior Software Engineer – Foundational Data Systems for AI
Granica
Senior Software Engineer building foundational data systems for AI at Granica. Focus on efficient data systems for enterprise AI infrastructure.
Director, IT Software Engineering
DIRECTV
Director of IT Software Engineering at DIRECTV, leading innovation across IT and enterprise business systems. Managing hybrid teams while ensuring compliance and modernization of technology systems.
XSIAM Service Tech Lead
Palo Alto Networks
Managed XSIAM Service Tech Lead acting as technical focal point for cybersecurity customers. Driving successful onboarding and collaboration with SOC teams to enhance security outcomes.
Software Engineer
Experian
Software Engineer evaluating and optimizing processes at Experian. Collaborating with engineering teams and ensuring compliance with industry standards in a remote role.
Senior Software Engineer – Reliability Foundations
Canva
Senior Software Engineer at Canva addressing reliability challenges by developing solutions in Python, Go, or Java. Collaborating with product teams to ensure robust engineering practices and reliable operations.
Senior Software Engineer – Reliability Foundations
Canva
Senior Software Engineer focusing on reliability challenges with production-grade code for Canva. Collaborating with teams to implement reliability best practices and driving improvements across services in a remote role.
Software Engineer II
Radicle Health
Software Engineer II developing high-quality features for Radicle Health's Foothold Care Management platform. Collaborating with teams to deliver secure and reliable web applications and APIs.
Staff Software Engineer
Spanx
Staff Software Engineer in SPANX's Digital team, focusing on building and enhancing consumer-facing web experiences using modern technologies and collaborating with dedicated colleagues.
Senior Fullstack Developer
ResMed
Senior Fullstack Developer developing large-scale services in a distributed cloud environment for ResMed. Collaborating with teams and contributing to high-impact projects in software engineering.