Data Engineering Specialist – Data Platform
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer specialist developing a scalable data ingestion platform using modern AI techniques. Contributing to a robust technological base within Grupo Casas Bahia for data automation.
Responsibilities:
- Design and develop the next generation of the company's data ingestion platform.
- Define and evolve an AI-driven data ingestion architecture.
- Build and maintain intelligent (ETL/ELT) ingestion pipelines that are scalable, reusable and resilient.
- Incorporate AI agents for automation, orchestration and intelligent data validation.
- Develop solutions based on RAG (Retrieval-Augmented Generation), embeddings and vector search.
- Integrate multiple data sources: APIs, databases, events, SaaS and files (structured and unstructured).
- Work with large-scale batch and streaming data processing.
- Ensure data quality, reliability, governance and observability.
- Apply anomaly detection techniques and intelligent pipeline validation.
- Automate data integration and operations processes.
- Establish best practices, standards and guidelines for data ingestion and Data Platforms.
- Collaborate closely with Engineering, Analytics, Data Science, Product and Business teams.
- Deliver high-impact business solutions with technical autonomy and ownership.
Requirements:
- Strong experience with Databricks (Jobs, Clusters, Unity Catalog).
- Solid experience building data ingestion pipelines (ETL/ELT).
- Experience with distributed processing (Spark) for both batch and streaming (Kafka, Spark Streaming, etc.).
- Experience with cloud platforms (AWS, Azure or GCP).
- Familiarity with workflow orchestrators (Airflow, Dagster or similar).
- Hands-on experience developing AI agents or RAG-based systems.
- Knowledge of LLMs (Large Language Models) and frameworks such as LangChain, LlamaIndex.
- Experience with embeddings, vector search and semantic processing.
- Experience with Agent Frameworks (e.g., LangGraph, CrewAI).
- Experience working with unstructured data (PDFs, documents, HTML, logs, etc.).
- Knowledge of SQL and NoSQL databases and data modeling.
- Familiarity with data governance practices (catalog, lineage, security).
- Critical thinking, autonomy and the ability to solve complex problems creatively.
- Excellent communication, technical influence and sense of responsibility.
- **It would be great if you have:**
- Experience building internal data platforms (Internal Data Platforms) focused on automation and self-service.
- Experience with DataOps practices and data observability.
- Knowledge of Infrastructure as Code (e.g., Terraform).
- Certifications in Data Engineering, Analytics Engineering or AI Engineering.
Benefits:
- Profit Sharing/Bonus: Additional recognition to reward your effort and dedication! 💸
- Health and Dental Insurance: To ensure security and care for you and your family. 🏥
- Meal Allowance: Because we know good food is essential for your day! 🍽️
- Life Insurance: Peace of mind and protection for you and your loved ones. 🛡️
- Extended Maternity Leave: 180 days for our mothers to enjoy this special time with their baby! 👶
- Extended Paternity Leave: 20 days so fathers can also be present in the early days of life. 👨👩👧👦
- Fitness Incentive: Access Wellhub (Gympass) and Total Pass to stay active and healthy. 🏋️♂️
- Transportation Allowance: To ensure your commute to work is smooth and worry-free. 🚆
- Agreement with SESC: Enjoy great benefits in culture, leisure, health and more! 🎭
- Discount Club: Savings up to 70% on products and services with over 2,000 partners across Brazil and Latin America! 🛍️
- Birthday Day-Off: Celebrate your day with extra rest and fun—you get a day off on your birthday! 🎉
- Pharmacy Discounts: Exclusive discounts on medications to help you save on healthcare! 💊
Similar Jobs
Senior Data Engineer
Senior Data Engineer designing data pipelines and processing for a remote workforce in innovative digital experiences. Collaborating with global teams to deliver high-quality solutions.
Engenheiro de Dados Sênior
Senior Data Engineer leading the definition and implementation of data architecture. Responsible for quality, security, and performance optimization of data solutions.
Senior Data Engineer
Senior Data Engineer responsible for analytics function at Vanta. Design and deploy data infrastructure to enhance security measures for businesses.
Data Engineer
Data Engineer developing and maintaining data pipelines for the USMC Logistics Data Systems Program. This remote role involves collaboration and technical solution design for logistics data.
Information Management Data Architect
Principal Databricks Architect leading the development of RGA's data science and AI platform. Driving innovation and ensuring governance within a global team setting.
Senior Software Engineer, Data Engineer
Senior Software Engineer (Data Engineer) developing scalable data solutions for analytics and AI at Maropost. Collaborating across teams to deliver end-to-end engineering solutions with minimal dependencies.
Data Architect – Specialist
Data Architect Specialist working on strategic data architecture transformation projects with global leadership interactions. Focus on improving data governance, scalability, and strategic data management.
Senior Data Engineer – Bilingüe
Senior Data Engineer designing and maintaining ETL/ELT data pipelines using Python. Balancing between hybrid environments and AWS expertise for data integration.
Senior Data Engineer
Senior Data Engineer building high-performance data infrastructure for regulatory reporting at DraftKings. Collaborating with cross-functional teams to enhance data quality and support business operations.
Senior Data Engineer
Senior Data Engineer at ClubReady optimizing reporting solutions and managing data products for enterprise clients in a remote setup. Collaborating with technical domain experts and external stakeholders for data-driven solutions.
Data Architect
Data Technical Lead overseeing the technical direction of the data platform at a FinTech startup specializing in unified AI-powered financial services. Building scalable systems and mentoring engineers.
Senior Data Engineer
Senior Data Engineer developing Sigma Software’s corporate Data Platform that powers analytics and decision-making. Collaborating closely with teams to enhance data quality and operational insights.
Lead Data Engineer
Lead Data Engineer responsible for developing AI-driven data pipelines and infrastructure. Collaborate with the CTO and build a team within a fully remote environment.
Data Engineer
Data Engineer responsible for building data pipelines and ensuring data quality for analytics. Collaborating with cross-functional teams to support enterprise decision-making in a remote setup.
Senior Data Engineer, DataBricks, Data Privacy – LGPD
Senior Data Engineer supporting Databricks integration with focus on data privacy and governance. Working with cross-functional teams to ensure compliance with LGPD requirements.
Senior GenAI Data Engineer, Databricks
Data Engineer specializing in AI applications for a fast-growing advertising tech company. Building data pipelines and enhancing data reliability while collaborating with cross-functional teams.
Lead Architect – Master Data
Lead Architect driving global master data architecture strategy during SAP S/4HANA transformation at Scotts Miracle-Gro. Collaborate with VP, Data Intelligence & AI on enterprise data management initiatives.
Senior Data Science Engineer
Sr Data Science Engineer at LegitScript developing ML models for risk detection and prioritization. Collaborating on data pipelines and production-ready APIs in a flexible work environment.
Director, Data Engineering – Business Applications
Director of Data Engineering and Business Applications at FOCUS overseeing data pipelines and application management. Collaborating with C-level executives to align data infrastructure with strategic growth objectives.
Enterprise Architect – Data Management
Enterprise Architect tackling complex data challenges and shaping integration across the enterprise. Leading technical direction to improve outcomes and operational efficiency.