Data Engineer

Posted 1ds ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Data Engineer building scalable data pipelines and integrations for VSP Vision, a vision-care company. Supporting analytics, data quality, and strategic business data use.

Responsibilities:

  • Create and maintain data pipelines for enterprise data and analytics capabilities
  • Collaborate with analytics, data warehousing staff, DBAs, subject matter experts, and a multi-disciplinary agile team
  • Develop data integration and transformation solutions
  • Document and analyze functional and non-functional data requirements
  • Develop scalable, automated, fault-tolerant data pipeline solutions
  • Profile data to assess source accuracy and completeness and work with business partners to mitigate issues
  • Build and maintain pipelines across development, test, and production environments
  • Design modular solutions that maximize code reuse
  • Create data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments
  • Use ELT, ETL, data virtualization, and other methods to optimize data movement and performance
  • Maintain metadata management processes and documentation
  • Monitor data quality and develop transformation rules for cleansing
  • Participate in code reviews and unit testing to optimize performance and minimize issues

Requirements:

  • Bachelor’s degree in computer science, data science, statistics, economics or related functional area; or equivalent experience
  • Effective written and verbal communication skills
  • Ability to gather requirements and collaborate with teammates and business partners
  • 4+ years’ experience working in a development team providing analytical capabilities
  • 4+ years of hands-on experience in data preparation, SQL, integration tools, ETL/ELT, and data pipeline design
  • SQL coding experience
  • Familiarity with agile development environments, including Scrum and Kanban
  • Focus on Continuous Integration and Delivery
  • Previous experience using a data integration platform such as IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, or Denodo
  • Familiarity with data warehouse MPP platforms such as Snowflake, Netezza, Teradata, or Redshift
  • Familiarity with event stores and stream processing, including Apache Kafka and platforms like Confluent, is beneficial
  • Familiarity with API development and management platforms such as MuleSoft and Axway is beneficial
  • Ability to focus on specific tasks while ensuring alignment with broader strategic design
  • Pro-active, self-driven approach and continual learning
  • For remote or hybrid roles, high engagement in virtual environments, including maintaining camera presence during meetings
  • Must comply with VSP Vision Information Security and Privacy Policies when accessing sensitive personal information

Benefits:

  • Eligible bonuses and commissions may be included as part of the compensation package
  • VSP Vision benefits
  • Drug-free workplace
  • Pre-employment substance abuse testing