Senior Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer designing and implementing scalable data systems for corporate technology initiatives. Collaborating cross-functionally to ensure high-quality data solutions that meet business needs.
Responsibilities:
- Streamlining Data Integration You’ll design and automate scalable systems to ingest and transform data from diverse sources, ensuring seamless and efficient data flow across the organization.
- Safeguarding Data Quality By implementing robust monitoring frameworks, you’ll proactively detect and resolve data integrity issues, maintaining trust in analytics and reporting.
- Establishing Data Governance You’ll lead the development of governance processes to manage metadata, access, and retention, ensuring compliance and secure data usage for internal and external stakeholders.
- Building Scalable Data Pipelines You’ll architect reliable and high-performance ETL/ELT pipelines with built-in monitoring and alerts, enabling timely and accurate data delivery for business needs.
- Optimizing Database Design and Performance Through thoughtful physical data modeling and indexing strategies, you’ll enhance database efficiency and scalability for large-scale operations.
- Modernizing Data Infrastructure You’ll develop and operate advanced storage and processing solutions using distributed and cloud platforms, supporting big data initiatives and analytics.
- Automating Data Workflows By leveraging modern tools and techniques, you’ll reduce manual data preparation tasks, boosting productivity and minimizing errors.
- Mentoring and Agile Collaboration You’ll coach junior team members and contribute to agile practices like DevOps and Scrum, accelerating delivery of critical analytics projects and fostering team growth.
Requirements:
- Minimum of 5 years of hands-on experience in data engineering with expertise in Azure Databricks and programming in Scala or Python.
- Proven experience in building and maintaining structured streaming pipelines using Spark.
- Strong knowledge of big data technologies, including Delta Lake, Apache Spark, Structured Streaming, and SQL.
- Experience with Git for version control and CI/CD pipeline management.
- Nice to Have (Preferences): Data Engineering Certification (e.g., Databricks Certified Data Engineer, Apache Spark Professional Data Engineer, or equivalent).
- Exposure to real-time data ingestion frameworks and cloud-native data services (e.g., Azure Event Hub, Azure Data Lake, AWS SQS, etc).
- Familiarity with data governance, access control (e.g., Unity Catalog or Immuta), and performance monitoring tools in cloud environments.
Similar Jobs
BI Data Engineer
Lead Data Engineering initiatives in IT Analytics for transforming raw data into strategic assets. Collaborate with business areas to develop data solutions with a strong analytical vision.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data pipelines for Pax8's cloud marketplace. Collaborating on architecture and mentoring data engineers while driving data quality and reliability.
Data Engineer IV
Data Engineer IV developing scalable data pipelines and orchestration frameworks at Rackspace Technology. Leading teams in data governance and managing analytics workloads across Azure and Databricks.
Information/Data Architect
Information/Data Architect providing technical expertise and support for data architecture requirements at Concept Plus. Developing data strategies and maintaining information structures for effective governance.
Staff Data Engineer, Financial Data Operations
Staff Data Engineer on a mission to drive financial data operations for Root's tech-focused insurance platform. Collaborating with engineering and finance to enhance data workflows for payments and incentives.
Senior Data Engineer, Marketing Operations
Senior Data Engineer driving marketing operations and strategy at Root. Collaborating with multiple teams to enhance data infrastructure and analytics capabilities.
Data Engineer I
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high-quality data.
Technical Lead – Data Engineering, Analytics
Technical Lead delivering enterprise data engineering and analytics solutions for Department of Veterans Affairs. Lead teams to architect systems that strengthen mission operations for Veterans.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data infrastructure for enterprise reporting, financial reconciliation, and operational analytics at Vetcor.
Data Migration and Onboarding Specialist
Data Migration and Onboarding Specialist at Alt Legal focused on client data migration and onboarding process. Collaborating internally and externally to ensure customer satisfaction and accurate data management.
Data Engineer – Cloud, BI Architecture
Data Engineer at First Table creating a cloud warehouse from scratch and managing data flow. Leading technical architecture for marketing and product functions to enhance data-driven decision making.
Data Engineer
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
Founding Data Engineer – PG, Opensearch
Founding Data Engineer responsible for building the data infrastructure at Neuroscale AI. Designing and maintaining scalable data systems to support AI-driven products.
Data Architect – Operations Technology
Data Architect designing enterprise-wide data solutions for Trissential's clients. Leading modernization initiatives and collaborating on advanced analytics in Operations Technology.
Senior Data Platform Compliance Engineer
Senior Data Platform Compliance Engineer ensuring compliance in cloud environments. Collaborating on data governance and implementing CI/CD practices for data services.
Data Engineer – Healthcare
Data Engineer designing and maintaining scalable data platforms using AWS at Experian. Collaborating with cross-functional teams to support analytics and machine learning projects.
Principal Data Engineer
Principal Data Engineer playing a key role in developing data infrastructure and analytical platform at Prescryptive. Responsible for architecture, design, implementation, and mentorship across teams.
Senior Data Engineer, SQL DBA
Senior Data Engineer specializing in SQL DBA tasks at M3 Global Research. Focuses on database optimization, performance tuning, and ensuring business alignment.
Principal Data Architect
Principal Data Architect at Cencora leading enterprise strategy and architecture discussions. Responsible for ensuring alignment with business goals and technology tradeoffs.
Data Migration Specialist
Data Migration Specialist responsible for onboarding clients by migrating data into PatientNow platform. Collaborate with stakeholders to ensure data integrity and successful client transitions.