Data Engineer II – Library Systems
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer II building ETL pipelines, metadata systems, and AI-ready data platforms for Johns Hopkins Libraries. Supporting research, analytics, data quality, and library operations.
Responsibilities:
- Manage data extract, transform, and load (ETL) processes across Library operations except cataloging and collection management
- Ensure data capture workflows, translation processes, deposit methods, and quality assurance protocols meet Library requirements
- Design, produce, and maintain software infrastructure for automated data extraction, transformation, and loading
- Input and output data from databases and perform complex queries
- Create scripts for data manipulation, cleaning, filtering, and preparation of data outputs
- Create systems to monitor and guarantee data quality, detect anomalies, and perform daily quality assurance
- Maintain, troubleshoot, and audit data infrastructure and data sources
- Collaborate with Business Analysts to manage ETL and reporting project roadmaps
- Lead the ETL and data exchange software development lifecycle
- Develop tools and processes to capture, normalize, and provide research and library collections data through central and AI-ready data platforms
- Support library catalog and institutional repository systems through bibliographic metadata quality assurance, enrichment, corrections, and metadata crosswalks
- Document data pipelines for technical and non-technical stakeholders using technical writing and systems diagrams
- Design, produce, and maintain data pipelines for acquisition, management, transformation, and back-end development
- Write and maintain ETL/ELT processes for structured and unstructured data sources
- Develop and maintain web data scraping systems
- Help design data architecture and provide ongoing support
- Put data pipelines into production using data warehousing systems
- Source, analyze, and visualize data and generate insights for research projects and organizational requests
- Collaborate with developers, analysts, data scientists, researchers, policy experts, partners, contractors, and vendors
- Communicate with division leadership and team members
Requirements:
- Bachelor’s Degree
- Five years of related work experience focused within database management and design and business requirement gathering
- Additional education may substitute for required experience
- Additional related experience may substitute for required education beyond a high school diploma/graduation equivalent, subject to the JHU equivalency formula
- Proficiency with bibliographic metadata standards including MARC and Dublin Core
- Familiarity with Business Intelligence systems and tools such as Power BI and Tableau
- Experience with AWS and Microsoft Azure data utilities
- Experience designing and implementing ETL processes using stored procedures in an enterprise SQL Server environment
- Experience with data normalization using traditional and dimensional data modelling
- Experience developing software and scripts using SQL, Python, or other relevant languages
- Ability and willingness to learn and apply emerging technologies, including AI-enabled tools
- Intermediate proficiency in data management and analysis, data pipeline architecture and ETL/ELT development, database querying, data validation and quality assurance, data visualization, data warehousing and architecture, programming languages, and web scraping and data acquisition
- Intermediate oral and written communication skills
- Successful candidates must complete a pre-employment background check
- Johns Hopkins University requires faculty, staff, and students to receive the seasonal flu vaccine, subject to stated exceptions
Benefits:
- Total rewards package supporting employees’ health, life, career, and retirement
- Pre-employment background check process
- Seasonal flu vaccine requirement with exceptions for religious or medical reasons
- Workplace accommodations and accessibility support
- Equal opportunity employment
- Potential vaccination support at no cost through Occupational Health for applicable positions
Similar Jobs
Data Engineer
Data Engineer building scalable Azure and Snowflake data platforms for Datavail’s data management and cloud services. Developing pipelines, warehouses, lakes, and analytics solutions.
Senior Data Engineer
Senior Data Engineer building clinical data pipelines and cloud applications for Providence’s healthcare system. Supporting data-driven operations with modern engineering, analytics, and AI technologies.
Data Engineering Analyst
Data Engineering Analyst optimizing Servus Credit Union’s data warehouse, pipelines, integrations, and analytics infrastructure. Supporting data-driven financial services for Alberta members.
Senior Cloud Data Engineer
Senior Cloud Data Engineer building secure cloud data systems for BMC. Designing pipelines, data warehouses, ETL processes, and cloud-based data solutions.
Senior Backend Engineer - Data Platform
Backend Developer building TypeScript and Node.js data services for NaNLABS’ insurance wildfire-risk platform. Designing integrations, ingestion pipelines, and reliable PostgreSQL systems.
Data Engineering Intern
Data Engineering Intern building scalable ELT pipelines and data models at Super.com, a consumer fintech platform. Ensuring data quality, governance, and operational reliability for high-volume datasets.
Data Warehouse, Analytics Architect
Data warehouse architect designing scalable lakehouse and analytics infrastructure for Virtru’s secure data-sharing platform. Leading SRE, technical architecture, and engineering mentorship.
Presales Data Architect, Modern Data Stack, AI
Presales Data Architect diseñando arquitecturas Modern Data Stack y AI para Reclut, marketplace de reclutamiento con IA. Liderando preventa, PoCs y conexión entre clientes y equipos de delivery.
Senior Data Engineer – MS Fabric
Senior Data Engineer building Azure data platforms and ETL pipelines for Keyrus, a global data, digital, and AI consulting company. Supporting enterprise analytics, reporting, and master data management.
Data Architect
Data Architect designing Lakeside's enterprise data architecture for BI, analytics, and AI. Leading Snowflake, data modeling, governance, and resilient integration solutions.
Software Engineer – Agentic Data Pipelines
Software engineer building agentic LLM systems for biomedical data acquisition, curation, and quality control. Supporting Iambic Therapeutics’ AI-driven drug discovery platform and Enchant model training.
Engineer III – Platform Data Engineer
Platform Data Engineer building and operating CrowdStrike's cybersecurity analytics infrastructure. Managing Airflow, Terraform, CI/CD, cloud platforms, and data security at scale.
Lead Forward Deployed Engineer – Data Science, Integration
Forward Deployed Engineer at Salesforce, the AI CRM company, building ML, API integrations, and workflows for defense and intelligence customers. Leading secure, customer-site mission delivery.
Principal Architect, Data Architecture
Principal Data Architect designing data platforms, models, and pipelines for Endava’s technology consulting clients. Translating business needs into scalable analytics and cloud architecture.
Senior Azure Data Architect
Azure Data Architect designing secure, scalable Azure warehouses, lakes, and pipelines for IT services company Exavalu. Leading ingestion, governance, and big-data processing architecture.
Data Engineer II
Data Engineer II building ETL pipelines, data models, and scalable platforms for Ncontracts’ financial risk and compliance solutions. Supporting analytics, reporting, performance, and team mentorship.
Data Engineer – Health Data Metrics
Data Engineer building AWS data pipelines and healthcare quality metrics infrastructure for Keebler Health’s value-based care platform. Integrating FHIR, population health, and HIPAA-compliant data systems.
Mid-Level Data Engineer
Engenheiro de Dados desenvolvendo pipelines batch e streaming na Spread Tecnologia. Otimizando data lakes, ETL/ELT e governança em ambientes GCP e AWS.
Senior Data Engineer
Engenheiro de Dados Sênior construindo pipelines Big Data para a Reply, multinacional de consultoria e soluções de TI. Processamento distribuído em AWS e colaboração com equipes de análise e ciência de dados.
Data Architect
Data Architect designing and building Databricks and Microsoft Fabric lakehouse platforms for Pythian’s data transformation clients. Owning ingestion, governance, modeling, pipelines, and analytics delivery.