Data Engineer – Specialist
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer specializing in AI for data modernization and system optimization. Join Compass UOL in shaping next-gen data solutions and AI-driven outputs.
Responsibilities:
- Define and implement Artificial Intelligence solutions applied to data modernization and legacy systems.
- Develop mechanisms for analyzing, interpreting, and extracting technical information from legacy artifacts.
- Build Generative AI–based solutions to accelerate documentation, transformation, and migration processes.
- Create intermediate metadata models to represent flows, business rules, dependencies, entities, and transformations.
- Develop accelerators and reusable components aligned with the enterprise data architecture.
- Support the definition of templates, technical standards, and declarative structures for modern pipelines.
- Develop and evolve pipelines using Databricks, PySpark, Lakeflow Jobs, and Declarative Pipelines.
- Work with batch loads, incremental ingestions, CDC (Change Data Capture), and enterprise integrations.
- Support the advancement of data governance, traceability, and data quality during migration.
- Collaborate with architects, data engineers, and platform specialists to define scalable and secure solutions.
Requirements:
- Experience with Artificial Intelligence applied to Data Engineering, Software Engineering, or Technical Automation.
- Hands-on knowledge of Generative AI and Large Language Models (LLMs).
- Experience with:
- AI agents
- RAG (Retrieval-Augmented Generation)
- Prompt engineering
- Function calling
- Tool use
- Automated workflows
- Experience with AI orchestration frameworks:
- LangChain
- LangGraph
- Semantic Kernel
- CrewAI
- Or equivalent frameworks
- Experience with Python.
- Experience with PySpark and Spark SQL.
- Development of data pipelines in distributed environments.
- Advanced SQL knowledge.
- Knowledge of XML, JSON, and YAML.
- Experience with data modeling and Data Warehousing.
- Experience working with Databricks environments.
Benefits:
- Position open to candidates with disabilities (PcD)
Similar Jobs
Enterprise Data Warehouse Developer – Microsoft Fabric
Enterprise Data Warehouse Developer utilizing Microsoft Fabric to design and implement data solutions for the healthcare sector. Collaborating with teams to ensure optimal data-driven decisions.
Staff Data Engineer, Ads
Staff Data Engineer at Discord driving technical vision for advertising products with a focus on data infrastructure. Leading cross-functional initiatives while collaborating with data science and product teams.
Enterprise Data Architect
Enterprise Data Architect managing and implementing data models for enterprise applications. Leading security and compliance strategies while overseeing development teams.
Data Engineer – Analytics, Modeling
Senior Data Engineer focusing on analytics and modeling to modernize data platforms in LATAM. Collaborating with engineering teams to build scalable data solutions for high-impact digital products.
Data Engineer
Data Engineer supporting data conversion and migration initiatives for a leading legal services client. Responsibilities include data cleansing, validation, and automation of processes for improved data quality.
Data Engineer
Data Engineer at MVB Financial Corp. responsible for designing scalable data infrastructure and automation solutions, collaborating with cross-functional teams to enhance data quality and delivery.
Data Engineer I
Data Engineer I responsible for designing and building data-centric applications using cloud technologies. Collaborating with teams to support clinical workflows in healthcare system.
Senior Data Engineer
Senior Data Engineer developing AI and machine learning infrastructure for healthcare data. Collaborating with engineers and scientists to support data-driven healthcare solutions.
Data Engineer – Master Data Accountability
Data Engineer ensuring governance and evolution of critical master data at Localiza&Co. Leading Master Data Management strategy while collaborating across business areas.
Senior Data Engineer
Senior Data Engineer at IKS Health developing AI and machine learning infrastructure. Designing data platforms and optimizing cloud data architecture for healthcare applications.
Data Engineer
Senior Data Engineer building and evolving data platforms for ParentSquare's unified communication tools. Collaborating with cross-functional teams to drive data quality and governance.
Senior Data Engineer
Senior Data Engineer at Kreate transforming data into scalable, reliable platforms for analytics and machine learning. Bridging ML experimentation and production deployment to empower decision-making.
Senior Data Engineer
Data Engineer designing and maintaining robust data pipelines for analytics and machine learning at 8x8. Collaborating with cross-functional teams to ensure data integrity and quality.
Senior Data Engineer
Senior Data Engineer at Ceresti designing end-to-end data architecture to improve dementia care outcomes. Collaborating with cross-functional teams and ensuring data quality for healthcare solutions.
Data Engineer
Data Engineer building and maintaining scalable data pipelines and warehouse models for analytics. Collaborating with engineering and analytics teams within the United States.
Associate Data Engineer
Data Engineer designing and maintaining scalable ETL pipelines and Power BI solutions at insightsoftware. Engaging with stakeholders and leveraging AI tools for improved performance.
Data Engineer
Data Engineer supporting cloud operations with ETL pipelines and BI reports. Collaborating with a team on AI agents and data visualization for cloud performance metrics.
Manager, Data Engineering
Data Engineer at CVS Health overseeing design and maintenance of scalable data pipelines and architectures for analytics and reporting. Collaborating with teams to enable reliable data access and performance.
Technology Implementation Lead – Finance Data Platform
Technology Implementation Lead at Humana delivering cloud-first data solutions and translating business strategy into scalable technical solutions. Collaborating in cross-functional teams and preparing executive-ready presentations.
Data Engineer
Data Engineer designing and building scalable cloud-based data solutions for Youth Villages' reporting and analytics. Collaborating with stakeholders to optimize data processes and support governance initiatives.