Senior Data Engineer, AWS, Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building AWS and Databricks data platforms for GDIT’s federal court modernization program. Delivering secure pipelines, governance, migration, analytics, and AI/ML capabilities.
Responsibilities:
- Design, build, test, and maintain scalable data engineering components and platform services
- Develop secure cloud-based data platforms, including data lakes, lakehouses, or data warehouses
- Engineer multi-tenant cloud environments supporting hybrid/on-premises systems and multiple database architectures
- Produce and maintain dimensional data models and downstream data marts
- Develop and maintain ETL/ELT processes, reports, dashboards, and data presentation solutions
- Maintain STTMs, logical and physical data models, design documents, testing documents, and related documentation
- Support the Data and Technology Enabler Roadmap across data engineering, reporting/analytics, and AI/ML use cases
- Design and develop ingestion and ETL/ELT pipelines for enterprise data sources
- Implement reusable data services, data quality checks, validations, and error handling
- Configure metadata structures, workflows, automation, security settings, and catalog entries
- Create training, job aids, and communications for user adoption
- Integrate pipelines with cloud services, messaging, and storage components
- Optimize pipeline performance, scalability, and cost efficiency
- Support CI/CD deployments, automated testing, and promotion across environments
- Participate in code reviews, design reviews, and sprint ceremonies
- Resolve incidents and perform root cause analysis for pipeline failures
- Operate in an Agile federal delivery environment across multiple scrum teams
- Collaborate with architects, DBAs, business analysts, QA personnel, and migration teams
- Execute data migration, archival, disaster recovery, and failover-testing strategies
- Implement operational databases, document storage, indexing services, schemas, and secure data APIs using infrastructure as code
- Ensure deliverables meet federal security, governance, and audit requirements
Requirements:
- Bachelor's degree in Data Science or closely related discipline
- 5+ years of specialized experience with AWS Cloud and Databricks
- Deep hands-on experience with core AWS data storage, compute, and serverless tools
- Deep hands-on experience with Databricks, Apache Spark, and Delta Lake
- Advanced proficiency in Python, PySpark, SQL, and data transformation techniques
- Proficiency with ETL/ELT frameworks
- Familiarity with Git, containerization, CI/CD, and data governance frameworks such as Unity Catalog
- Hands-on experience building enterprise-scale data pipelines
- Experience with streaming or near-real-time data ingestion
- Familiarity with data governance, metadata, and classification standards
- Experience with system security best practices
- Experience building and migrating software and IT services to align with strategic business needs
- Experience researching advanced technologies to support business needs
- Experience identifying and applying industry tools, solutions, methods, best practices, and emerging technologies
- Familiarity with Agile/Scrum delivery environments
- Experience in regulated or compliance-driven environments
- Excellent presentation and communication skills
- Consultant mindset and ability to work with high-level customer stakeholders
- Strong analytical and problem-solving skills
- Ability to work effectively independently and as part of a team
- Experience mentoring junior data engineers
- Must pass a background check to obtain Public Trust
- Must provide onsite fingerprinting at a designated facility
- Must be a US Person (Green Card Holder, US Permanent Resident Alien, Refugee, Asylee, or US Citizen)
Benefits:
- Comprehensive medical plan options, some with Health Savings Accounts
- Dental plan options
- Vision plan
- 401(k) plan with pre-tax and post-tax contributions and company match
- Full flex work weeks where possible
- Paid vacation, sick, personal, holiday, parental, military, bereavement, and jury duty leave
- Typically 15 days of paid leave per calendar year
- 10 paid holidays per year
- Up to 160 hours of paid family leave in a rolling 12-month period for eligible employees
- Short- and long-term disability benefits
- Life insurance
- Accidental death and dismemberment insurance
- Personal accident insurance
- Critical illness insurance
- Business travel and accident insurance
- AI-powered career tool identifying career steps and learning opportunities
- Internal mobility team
- Growth and professional development opportunities
- Wellness packages
- Competitive pay
- Military-friendly workplace
Similar Jobs
Senior Engineer – Cloud
Cloud engineer building scalable systems and automation for CrowdStrike’s Falcon Complete cybersecurity platform. Improving reliability, observability, and analyst protection workflows.
Senior Software Engineer, Cloud Platform
Senior Software Engineer building NVIDIA accelerated compute cloud services. Developing scalable automation for hardware, networking, and multi-tenant infrastructure.
Java Developer, AWS, Terraform, Python
Java Developer desarrollando soluciones Java sobre AWS para knowmad mood, compañía de transformación digital. Trabajo con microservicios, arquitectura hexagonal, Terraform y Python.
Cloud Engineer
Ingénieur Cloud chez Synapsys, société de conseil en transformation des infrastructures IT. Conception d’environnements cloud sécurisés, automatisés et observables.
AWS Cloud Engineer
AWS Cloud Engineer designing secure IL6 infrastructure, backend services, and databases. Supporting North South Consulting Group’s mission-critical government and DoD programs.
Cloud Engineer, GCP, BigQuery, TypeScript
Cloud Engineer building TypeScript and Node.js data collection systems across GCP. Managing BigQuery pipelines, containers, Terraform infrastructure, and automated deployments.
Azure Cloud Engineer
Azure Cloud Engineer supporting VDOT tolling infrastructure through Azure administration, networking, security, and automation. Maintaining secure cloud environments with PowerShell, Python, Terraform, and Entra ID.
Salesforce Marketing Cloud Architect
Salesforce Marketing Cloud Architect designing Salesforce Marketing Cloud solutions for VXForward’s technology clients. Building integrations, data models, campaigns, and scalable omnichannel engagement platforms.
Senior Backend Engineer, Cloud Platform
Senior Backend Engineer building scalable AWS and EKS infrastructure for ClickUp’s AI-powered workspace. Improving reliability, security, and cost efficiency across multi-region systems.
Lead Cloud Architect
Lead cloud architecture for C5MI’s secure federal SAP S/4HANA modernization programs. Direct infrastructure, authorization, resilience, and platform engineering for mission-critical defense environments.
Service Cloud Developer
Salesforce Service Cloud Developer building scalable customer-service solutions for Spyrosoft, a software engineering company. Integrating Salesforce with enterprise platforms and automating global service processes.
Principal Cloud Computing Engineer
Principal Cloud Engineer building secure AWS and OCI infrastructure, data pipelines, and AI automation. Supporting SAIC’s regulated U.S. Government technology missions from design through production.
Data Engineer, Azure, Fabric, Databricks
Data Engineer building scalable Azure, Microsoft Fabric, and Databricks lakehouse platforms for Collectiv, an analytics, planning, and AI consulting firm. Enabling reporting, self-service BI, and advanced analytics.
Cloud Engineer, Career Ambition
Cloud Engineer delivering cloud infrastructure and deployment projects for Auralis Group, a German software innovation studio. Developing software, supporting startups, and working with AI and quantum technologies.
Online Visiting Professor – Cloud Computing
Online Cloud Computing Professor teaching undergraduate and graduate students at DeVry University. Developing cloud-computing lessons, assessments, and technology-enhanced learning experiences.
SAP Public Cloud Architect
SAP Public Cloud Architect designing and governing S/4HANA Cloud ERP transformations for Atos digital services clients. Leading architecture, presales, SAP Activate delivery and Clean Core adoption.
Senior AI, Cloud-Native Software Architect
Part-time AI and cloud-native architect designing production GenAI and RAG systems for Cloudary SAS. Building secure, observable cloud-native services and guiding architecture from discovery to go-live.
Cloud Engineering Analyst
Cloud Engineering Analyst supporting Azure infrastructure, automation, security, and cost management for WBL, a remote lender providing real estate-secured business loans.
.NET Developer – Microservizi, Cloud Native
Senior .NET Developer building C#/.NET microservices for B&A Consulting, a software house and digital consulting company. Developing APIs, messaging integrations, and containerized cloud-native services.
Head of Competence Center Cloud Engineering
Head of Cloud Engineering leading Axians Switzerland’s managed IT and cloud services team. Driving cloud platform reliability, innovation, standards, and strategic competence development.