Data Engineer

Posted 22hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Engenheiro de Dados desenvolvendo e sustentando pipelines corporativos em Azure e Databricks. Apoio à governança, qualidade e performance de dados na Cadmus.

Responsibilities:

  • Develop and maintain data engineering pipelines on Azure and Databricks platforms
  • Gather and analyze business requirements with different areas of the organization
  • Propose technical data solutions aligned with operational and strategic needs
  • Perform testing and validation on pipelines and data systems of medium to high complexity
  • Monitor the performance of cloud big data systems and identify optimization opportunities
  • Support data quality, security, privacy and governance practices
  • Participate in migration projects and implementation of enterprise data solutions
  • Create and maintain technical documentation for pipelines, processes and data solutions
  • Troubleshoot and support resolution of technical issues
  • Mentor less experienced professionals and support other teams on data engineering matters
  • Participate in meetings with internal stakeholders to present solutions, clarify requirements and follow up on projects

Requirements:

  • Programming languages: SQL, Python and PySpark
  • Microsoft Azure platforms (Data Factory, Databricks, Data Lake)
  • Development and maintenance of data pipelines (ETL/ELT)
  • Relational and NoSQL databases
  • Fundamentals of big data and distributed processing
  • Agile methodologies (Scrum, Kanban)
  • Version control (Git)
  • Data governance concepts and LGPD (Brazilian General Data Protection Law)
  • Business requirements elicitation and analysis
  • Technical documentation
  • Clear and objective communication
  • Teamwork and collaboration
  • Results- and quality-oriented
  • Adaptability and continuous learning
  • Organization and time management

Benefits:

  • Meal voucher and/or food allowance (iFood Benefícios)
  • Medical insurance (Amil)
  • Life insurance
  • Dental insurance (Amil)
  • Fuel allowance
  • Gympass/Wellhub: Access to gyms with various training modalities
  • Pet health plan
  • Childcare assistance
  • Lincard: Partnership club with discounts of up to 60% at over 4,000 establishments in Brazil