Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer building data pipelines for analytics and machine learning at Illumination Works. Collaborating across teams to ensure reliable data for insights and experimentation.
Responsibilities:
- Develop and maintain metadata-driven data pipelines for ingestion, transformation, and delivery of data
- Build and support ETL/ELT processes for both legacy and modern data sources
- Implement data transformations to convert legacy formats (e.g., SFTP, flat files) into modern formats (e.g., XML, JSON, APIs)
- Develop API integrations and data services supporting real-time and near real-time data exchange
- Support implementation of data quality checks, validation rules, and monitoring processes
- Collaborate with a Data Architect to implement data models, schemas, and integration patterns
- Optimize pipelines and queries for performance, scalability, and reliability
- Assist in documenting data flows, interfaces, and pipeline configurations
- Support DevSecOps practices to ensure a standardized data environment, including implementing CI/CD pipelines, automated testing, and deployment
- Work in cross-functional team with data scientists, data engineers, and business stakeholders
Requirements:
- Experience developing and maintaining ETL pipelines and data integration workflows
- Strong proficiency in SQL and Python
- Experience with cloud platforms (AWS, Azure, GCP, GovCloud) and cloud-native architectures
- Hands-on experience with cloud-based data warehouses and object storage (S3, Redshift, Snowflake)
- Experience with API integration and data exchange
- Understanding of database design principles, data modeling, schema development, and data-centric documentation
- Experience integrating data from a variety of data source types
- Experience improving code performance and query optimization
- Outstanding problem-solving skills
- Excellent verbal and written communication skills
- 4+ years of experience as a Data Engineer or similar role
- Bachelor’s degree in Computer Science, Mathematics, or comparable academic discipline
- Must have or be willing to obtain Secret Clearance (this requires US Citizenship)
Benefits:
- market competitive salary
- generous PTO package
- comprehensive medical, dental, vision and life insurance plans
- 401K
- short/long-term disability insurance
- fun and engaging culture
- training opportunities to keep you up to speed on the latest technologies
Similar Jobs
Director of Data Engineering – Platforms
Director of Data Engineering at Cotality leading data transformation initiatives and data architecture frameworks. Collaborating with product teams to drive actionable business intelligence.
Data Architect
Design and manage enterprise data architecture with a focus on Air Force Logistics Systems. Collaborate with engineers and government stakeholders for scalable and secure data solutions.
Data Architect – Short-Term Freelance Project, Pharma
Data Architect role focused on implementing modern data governance practices in pharmaceutical projects. Requires strong expertise in Governance as Code and data architecture.
Data Engineer – Medicine & Analytics
Data Engineer responsible for building reliable data solutions for analytics in Medicine. Collaborate with diverse teams to improve patient outcomes through data-driven insights.
Senior Application Data Architect
Senior Application Data Architect leading enterprise data architecture and engineering initiatives. Collaborating with cross-functional teams to design and build scalable data solutions.
Unit Lead, Data Engineering
Lead the Data Engineering team at evoila, driving innovative data projects and developing advanced technological solutions in Germany. Collaborate on Greenfield projects and enhance existing platforms.
Data Engineer – AI Platform
Data Engineer responsible for building data ingestion pipelines for the AI platform at TaskUs. Engaging in scalable data management with strong experience in Python, SQL, and AWS.
Data Engineer II
Data Engineer II contributing to data governance engineering programs at CareSource. Focused on solution design architecture and implementation of standards for data management.
Data Architect
Consultant for Taxwell assisting Americans in finding tax credits and deductions. Advocating for customers and providing guidance in a supportive environment.
Account Executive – AI Data Platform Sales
Account Executive specializing in AI Data Platform Sales, managing enterprise client relationships. Focus on new customer acquisition and account growth driving analytics and AI initiatives.
Lead Data Engineer
Data Engineer Lead designing scalable data platforms for advanced analytics at Blend. Collaborating with cross-functional teams to build robust data solutions.
Data Architect – Strong Azure Services, Finance Experience (GL, AR, AP)
Data Architect specializing in financial systems (GL, AR, AP) and using Azure. Fully remote position requiring 12+ years of relevant experience.
Senior Data Architect – 2 months project
Seeking a Senior Data Architect for a two-month project focused on building a data warehouse in the car rental industry. Must have experience in data engineering and warehouse architecture.
BI Data Engineer
Lead Data Engineering initiatives in IT Analytics for transforming raw data into strategic assets. Collaborate with business areas to develop data solutions with a strong analytical vision.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data pipelines for Pax8's cloud marketplace. Collaborating on architecture and mentoring data engineers while driving data quality and reliability.
Data Engineer IV
Data Engineer IV developing scalable data pipelines and orchestration frameworks at Rackspace Technology. Leading teams in data governance and managing analytics workloads across Azure and Databricks.
Information/Data Architect
Information/Data Architect providing technical expertise and support for data architecture requirements at Concept Plus. Developing data strategies and maintaining information structures for effective governance.
Staff Data Engineer, Financial Data Operations
Staff Data Engineer on a mission to drive financial data operations for Root's tech-focused insurance platform. Collaborating with engineering and finance to enhance data workflows for payments and incentives.
Senior Data Engineer, Marketing Operations
Senior Data Engineer driving marketing operations and strategy at Root. Collaborating with multiple teams to enhance data infrastructure and analytics capabilities.
Data Engineer I
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high-quality data.