Lead Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Lead Data Engineer at 3M designing and optimizing data platforms for AI/ML applications. Collaborating with data scientists and mentoring junior engineers in data engineering best practices.
Responsibilities:
- Lead the architecture and development of scalable, secure data pipelines supporting AI/ML workloads
- Own end to end data engineering processes: ingestion, transformation, storage, quality, and monitoring
- Collaborate with data scientists and ML engineers on model features, training pipelines, and deployment
- Drive best practices in data modeling, orchestration, versioning, and performance optimization
- Mentor and guide junior engineers
- Ensure data governance, lineage, and compliance standards are met across platforms
- Support real time and batch processing frameworks in production environments
Requirements:
- Bachelor's degree or higher in computer science from an accredited institution
- Seven (7) or more years of data engineering experience
- Strong expertise in Python, SQL, and distributed data systems (e.g., Spark, Databricks, Synapse)
- Experience building AI/ML ready data pipelines
- Hands-on experience with cloud platforms (Azure preferred)
- Strong understanding of ML concepts
- Proven experience with workflow orchestration (Airflow, Data Factory, Synapse Pipelines, etc.)
- Experience with streaming platforms (Kafka, Event Hub)
- Background in DevOps, CI/CD, or infrastructure as code
Benefits:
- Medical, Dental & Vision
- Health Savings Accounts
- Health Care & Dependent Care Flexible Spending Accounts
- Disability Benefits
- Life Insurance
- Voluntary Benefits
- Paid Absences
- Retirement Benefits
Similar Jobs
Senior Data Architect – Engineering
Senior Data Architect leading data architecture design and evolution for a tech company. Collaborating with engineering and data teams for scalable data platforms.
Manager, Data Engineering
Manager managing a team of 3-4 data engineers at Capital Blue Cross. Overseeing project workflows, quality, and technical guidance for data solutions.
Senior Data Engineer
Senior Data Engineer managing data engineering projects for a Canadian financial institution. Delivering high-impact initiatives with minimal supervision and strong technical guidance.
Senior Data Engineer – Platform Experience
Senior Data Engineer with Platform Experience helping a Canadian financial institution upgrade its Core Data Platform. Requires 7+ years in Data Engineering and strong technical skills in various tools.
Ingeniero de Datos, Fabric PI
Data Engineer specialized in designing, building and maintaining end-to-end data solutions with Microsoft Fabric. Integrating data ingestion, transformation, modeling, and visualization capabilities with Power BI.
Snowflake Data Engineer
Data Engineer focusing on Snowflake and data modeling for customized projects at Evolved Ideas. Collaborating on high-scale products while enhancing documentation processes and reporting standards.
Software Engineer II – Data Platform
Software Engineer II developing scalable data systems and analytics solutions for Pantheon. Contribute to technical strategy and collaborate across teams to enhance data infrastructure.
Data Engineer – Data Platform
Data Engineer developing data infrastructure enabling data-driven decisions at Intersport. Collaborating with teams to optimize data workflows in a scalable cloud environment.
Senior SAP Data Migration Consultant, SAP S/4HANA
Senior SAP Data Migration Consultant responsible for data migration and transformation projects. Ensuring data quality and consistency in complex corporate environments with SAP S/4HANA.
Engenheiro de Dados
Data Engineer building and optimizing data solutions in Azure with Databricks. Focused on ensuring performance and quality in highly voluminous data scenarios.
Data Engineer I/II
Data Engineer owning data infrastructure for Lahzo's data operations. Focused on building reliable pipelines and ensuring data quality in a startup environment.
Senior Data Engineer – PowerBI, Data Integration
Senior Data Engineer at 3Pillar, leveraging data analytics to provide competitive advantages for clients. Work with AI-native products in a global team environment.
Senior Data Engineer, PowerBI, Data Integration
Senior Data Engineer contributing to AI-driven data analytics projects for global clients. Involves collaboration, coding, data processing, and pipeline management.
Senior Data Engineer, PowerBI, Data Integration
Senior Data Engineer shaping data analytics and solutions at 3Pillar Global. Collaborating with teams and clients to drive impactful data engineering projects.
Engenheiro de Dados Sênior
Data Engineer developing and maintaining scalable data pipelines in cloud environments for projects at FCamara. Collaborating with engineering and analytics teams to ensure data quality and performance.
Senior Data Engineer
Senior Data Engineer building advanced, cloud-native data platforms and migrating legacy systems to the cloud. Collaborating with teams on AI architectures and data pipelines.
Lead Data Engineer
Lead Data Engineer developing PySpark data solutions for U.S. clients in a 100% remote role from Latin America. Collaborate with cross-functional teams to meet business requirements.
Senior Data Architect – Hands on
Senior Data Architect at Stratus, managing canonical data architecture and supporting AI/ML workloads. Driving modernization and technical leadership in data engineering.
Engenheiro de Dados Sr
Senior Data Engineer developing and maintaining data pipelines for innovative agricultural solutions at Solinftec. Collaborating with teams to ensure data integrity and efficiency.
Senior Data Engineer
Senior Data Engineer responsible for designing and optimizing scalable data infrastructure. Collaborating with teams to enhance patient-centered healthcare through advanced analytics.