Senior Data Engineer
Posted 3hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer building reliable data pipelines and models for LMI’s federal national security applications. Supporting AI, analytics, deployment, and mission-user workflows.
Responsibilities:
- Investigate source systems and data with mission users
- Define entities, relationships, and quality expectations needed for applications
- Build ingestion and transformation pipelines for structured data, documents, APIs, and operational records
- Reconcile inconsistent identifiers and schemas, model useful relationships, and document definitions and assumptions
- Implement quality checks, lineage, freshness monitoring, and access controls
- Build pipelines that can be tested, monitored, rerun, and safely recovered
- Partner with software and AI engineers to serve reliable application data and prepare information for retrieval and analysis
- Support initial deployment, resolve data failures, and transfer pipelines, documentation, and operating procedures to sustaining teams
Requirements:
- Strong SQL and Python skills, with production ownership of ingestion, transformation, and relational data modeling
- Experience turning inconsistent source data into maintained datasets or data products used by applications or decision-makers
- Experience with a production orchestration and transformation stack such as Airflow or Dagster and dbt or SQLMesh, or comparable tools
- Experience with schema changes, data quality testing, lineage, permissions, and diagnosis of failed or incomplete pipelines
- Software engineering practices for data, including version control, automated tests, CI/CD, and reproducible deployment
- Ability to explain data definitions and limitations, work through ambiguous requirements, and collaborate with application engineers and users
- Demonstrated use of AI coding tools or agents, with independent review, testing, and security checks of generated code
- Travel up to 50% for user engagement, deployment support, and forward deployed delivery
- Active Secret Clearance Required
- Preferred: Experience with Palantir Foundry pipelines and ontology development, Databricks, or comparable enterprise data platforms
- Preferred: Experience with Spark or PySpark, event streaming, document ingestion, entity resolution, or semantic modeling
- Preferred: Experience with cloud data services, object storage, and containerized workloads in AWS, Azure, or Google Cloud
- Preferred: Experience with defense, intelligence, logistics, manufacturing, supply chain, workforce, or autonomy data and the controls governing its use
- Preferred: An active security clearance


















