Senior Data Engineer
Posted 7hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building scalable AWS data pipelines for AeroVect’s autonomous airport ground-support vehicles. Enabling telemetry processing, fleet monitoring, and engineering analytics.
Responsibilities:
- Design, build, and maintain scalable data pipelines to ingest, process, and store large volumes of autonomous vehicle telemetry, sensor, and operational data
- Develop and operate reliable batch and streaming data pipelines for near-real-time monitoring and historical analysis
- Build and optimize cloud-based data infrastructure using AWS and modern distributed data processing technologies
- Develop systems to move data reliably from edge devices and on-premise infrastructure into cloud-based storage and processing environments
- Design and maintain data models, schemas, and storage architectures for efficient querying, analytics, and downstream engineering workflows
- Ensure data quality, consistency, availability, and observability across production pipelines
- Optimize data processing performance, storage efficiency, and infrastructure costs as fleet size and data volumes increase
- Collaborate with autonomy, software, and infrastructure engineers on debugging, performance analysis, and continuous improvement of autonomous vehicle systems
- Build tools and infrastructure that make data accessible to engineering, product, and fleet operations teams
- Own data infrastructure end-to-end, from architecture and implementation through deployment, monitoring, and production troubleshooting
Requirements:
- 5+ years of experience in data engineering, software engineering, or distributed systems, with a strong focus on building production-grade data infrastructure
- Strong programming experience in Python and SQL
- Hands-on experience designing and operating large-scale batch and streaming data pipelines
- Strong experience with AWS services such as S3, Kinesis, Lambda, Glue, Redshift, or similar cloud-native data infrastructure
- Experience designing data architectures, storage solutions, and data models for high-volume, complex datasets
- Strong understanding of distributed systems, data reliability, fault tolerance, and performance optimization
- Experience deploying, monitoring, and troubleshooting data pipelines in production environments
- Familiarity with terraform and Kubernetes is preferred
- Ability to work independently, navigate ambiguity, and take ownership of complex technical problems
- Strong communication skills and experience collaborating across engineering teams
- Experience working with autonomous vehicles, robotics, automotive telemetry, IoT, or other sensor-heavy systems
- Experience processing large-scale time-series, image, video, or other unstructured datasets
- Familiarity with edge-to-cloud data ingestion architectures and intermittent-connectivity environments
- Experience with data lake architectures, GCP BigQuery and AWS Athena
- Experience building data infrastructure supporting machine learning, simulation, or robotics development workflows
- Knowledge of ROS, ROS bags, or autonomous vehicle data formats
- Experience building data platforms from the ground up in a startup or rapidly scaling engineering organization















