Data Engineer – 4-month contract
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer creating scalable data pipelines for autonomous truck technology. Focusing on ETL/ELT workflows and AWS-based data infrastructure management.
Responsibilities:
- Design, build, and maintain scalable ETL/ELT pipelines that ingest, transform, and deliver data across the organization.
- Develop and optimize distributed data processing jobs using Python for large-scale data transformation and aggregation.
- Architect and manage PostgreSQL schemas, tables, indexes, and query performance to support downstream analytics and reporting.
- Build and maintain Python-based data workflows to orchestrate, validate, and deliver data reliably across environments.
- Monitor and improve data quality, freshness, and completeness through automated checks, alerting, and observability tooling.
- Design and manage cloud-based data infrastructure on AWS
- Partner with data analysts and stakeholders to translate requirements into well-modeled, maintainable data products.
- Maintain documentation for pipelines, data models, data lineage, and infrastructure.
- Troubleshoot pipeline failures and data issues, providing timely root-cause analysis and remediation.
Requirements:
- Experience: 3+ years of professional experience in data engineering.
- PostgreSQL: Schema design, indexing strategies, query optimization, and performance tuning.
- Python: Pipeline development, data validation, and orchestration frameworks.
- Distributed Processing and Storage: Hands-on production experience with tools such as AWS Athena, Apache Spark, etc.
- ETL/ELT: Proven experience designing and implementing pipelines in production.
- Cloud: AWS (S3, EKS, Glue, Athena).
- Data Modeling: Dimensional modeling, data warehousing patterns, and reproducible transformations.
- Engineering Practices: Git workflows, code reviews, testing, and CI/CD.
- LLM AI Agents: ability to use agents effectively to increase output.
Similar Jobs
Senior Data Architect
Senior Data Architect supporting data architecture initiatives across cloud environments at Goods & Services. Designing, implementing, and optimizing data infrastructure and solutions to drive innovation and decision-making.
Data Architect
Data Architect designing scalable data solutions at EX Squared LATAM. Bridging business and technology to drive data-driven decision-making.
Data Engineer
Data Engineer at Anika Systems responsible for designing and building data pipelines. Supporting federal clients with data strategies and ensuring high-quality data for analytics.
Data Architect
Data Architect leading enterprise data architecture design and implementation for federal clients. Shaping data strategy and supporting data-driven decision-making with AI-driven workflows.
Senior Data Engineer
Senior Data Engineer responsible for building and maintaining Avra's data platform for AI. Engage with complex real-world data challenges in a remote-first environment.
Data Engineer
Data Engineer building and evolving Avra’s data platform from messy to structured datasets. Implementing reliable data pipelines and collaborating with senior engineers for real-world solutions.
Data Engineering Specialist
Data Engineering Solutions Specialist at Snowflake managing Data Engineering sales execution for ingestion workloads. Collaborating with teams to maximize customer adoption and drive revenue targets.
Data Architect
Data Architect designing scalable data solutions for LATAM projects. Leading implementation and guiding cross-functional teams in a modern Microsoft-based data ecosystem.
Senior Data Engineer
Senior Data Engineer supporting analytics and machine learning at Podimetrics. Building and maintaining data systems and pipelines for early diabetic foot ulcer detection.
Senior Data Engineer, Reporting
Senior Data Engineer designing scalable data infrastructure for CreatorIQ's influencer marketing analytics platform. Collaborating on data analytics for enterprise clients with modern technologies.
Data Engineer, L2
Data Engineer (L2) at Forbes Advisor building data pipelines for marketing analytics and reporting. Requires experience in working with Python, SQL, and Meta Ads ecosystem.
Product Growth Specialist – Data Engineering
Product Growth Specialist driving Product Go-to-Market initiatives in Data Engineering. Collaborating across teams to activate critical GTM strategies and enhance product adoption.
Senior Product Manager, Data Platform – Orchestration
Senior Product Manager defining data orchestration across Zillow's platforms with a focus on applications and AI integration. Lead operational frameworks for secure access and usage of data.
Data Engineer
Data Engineer responsible for designing and developing data pipelines for video advertising campaigns. Collaborating with a senior data engineer and a high-output team to shape data architecture.
Data Warehouse Engineer
Data Warehouse Engineer designing, building, and operating Azure data platform for Maverick Payments. Collaborating with teams and managing operational excellence in data processing.
Data Engineer III
Data Engineer optimizing data pipeline architecture for analytics initiatives and collaborating with cross-functional teams. Supporting data analysts to ensure optimal data delivery architecture.
Senior Data Engineer
Senior Data Engineer supporting platform modernization efforts at Data Meaning, focusing on pipeline migration and operational stabilization in a collaborative remote environment.
Senior BI & Data Engineer, PowerBI, Databricks
BI & Data Engineer role focusing on claims reporting for a global reinsurance client. Expertise required in Power BI and Azure Databricks for data modeling and analytics.
Senior Data Engineer
Senior Data Engineer responsible for developing and maintaining data pipelines for LuxuryIQ. Focus on data quality and pipeline architecture for luxury brands analytics.
Data Platform Sales Leader – Snowflake, Databricks
Sales Leader leading growth of cloud data platform solutions at Remote People. Focusing on Snowflake and Databricks to build stakeholder relationships and drive adoption.