Data Engineer – Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer developing and evolving corporate data platform for the financial sector at Stefanini. Collaborating in agile teams to deliver scalable and efficient data solutions.
Responsibilities:
- Work on the development and evolution of the new corporate data platform;
- Build and optimize scalable, distributed data pipelines;
- Develop solutions using Databricks and Apache Spark;
- Work on the integration, transformation and provisioning of data to various business areas;
- Support DataOps initiatives, automation, and platform observability;
- Collaborate with multidisciplinary teams in an agile environment;
- Ensure engineering best practices, quality, versioning, and CI/CD;
- Contribute to the architecture and continuous improvement of the cloud platform.
Requirements:
- Bachelor’s degree (completed);
- Proven experience with Databricks and Apache Spark;
- Strong knowledge of Python, SQL, and Scala;
- Experience with cloud computing, preferably GCP;
- Experience with Delta Lake, Parquet, and distributed data formats;
- Knowledge of ETL/ELT tools and data integration;
- Experience with CI/CD and code versioning using Git;
- Experience working in agile, collaborative environments;
- Knowledge of DBT (Data Build Tool).
- ⭐ Nice-to-haves:
- Experience with Kubernetes;
- Experience with Terraform;
- Experience in data platform modernization projects;
- Experience in the financial sector or high-volume data environments;
- Profile focused on Platform Engineering / Data Platform Engineering.
Benefits:
- Meal allowance or meal voucher;
- Discounts on courses, universities, and language institutions;
- Stefanini Academy — platform with online, free, up-to-date courses with certificates;
- Mentoring;
- Benefits club for medical consultations and exams;
- Medical insurance;
- Dental insurance;
- Discount club with offers at top establishments;
- Travel club;
- Pet care benefits.
Similar Jobs
Senior Data Engineer
Senior Data Engineer designing, building, and maintaining data systems for analytics and ML in hybrid SaaS environments. Extending and operating the Elastic Hierarchy framework with data governance.
Data Migration and Onboarding Specialist
Data Migration and Onboarding Specialist managing client data migration and onboarding for a SaaS legal tech company. Collaborating to ensure customer satisfaction through effective communication and data analysis.
Junior Data Engineer
Junior Data Engineer working on data flow creation and maintenance at Lite e-Commerce. Collaborating with teams to improve data handling in innovative projects.
Senior AI / Data Engineer
Senior AI/Data Engineer designing and maintaining data and AI infrastructure for Order.co's innovative B2B commerce solutions. Collaborating with cross-functional teams to enable intelligent decision-making.
Especialista em DataOps – Cloud, Data Platform
Specialist in DataOps at Mobi7 leading evolution of data management platform and developing reusable Terraform modules for data pipelines.
Engenheiro de Dados Pleno – Mid-level Data Engineer
Mid-level Data Engineer responsible for maintaining the scalable Data Platform at Hand Talk. Collaborate across teams to ensure data reliability and efficiency.
Senior Data Engineer
Senior Data Engineer responsible for designing and building data infrastructure in iGaming and Fintech. Collaborate with cross-functional teams to ensure reliable data processing and analysis.
Data Engineer III
Data Engineer III designing and building complex data pipelines for AI/ML capabilities in the leading firm Robert Half. Collaborating with cross-functional teams to optimize data infrastructure and ensure data quality.
Data Engineer
Data Engineer responsible for designing and maintaining data architecture and infrastructure. Developing, testing, and deploying data solutions to meet organizational needs.
Data Engineer, L2
Data Engineer responsible for designing, building, and maintaining data architecture and infrastructure. Develop and deploy data solutions meeting organizational needs.
Lead Data Engineer
Lead Data Engineer building and scaling modern data platforms that power analytics and AI/ML initiatives at Evnek Technologies. Collaborate and mentor while ensuring reliable data infrastructure.
Senior GCP Data Engineer
Senior Consultant in GCP Data Engineering, designing and implementing scalable data solutions at EY. Collaborating with stakeholders and optimizing data pipelines within an agile consulting framework.
Product Owner – Data Platform
Product Owner at Localiza&Co focusing on the evolution of data platforms aligned with company strategies. Collaborating across engineering, data, and business teams.
Senior Data Engineer – PowerBI, Databricks
Senior Data Engineer focusing on Power BI and Azure Databricks for a global reinsurance client. Building centralized reporting platform and contributing to claims data transformation.
Lead Data Engineer, Multiple Positions Available
Lead Data Engineer responsible for designing and implementing data movement solutions for Provident Bank. Collaborating with teams to ensure data warehouse efficiency and quality.
Software Engineer, Data Platform
Software Engineer needed to enhance image capture and analysis platform for recycling tech startup. Create software to sort recyclables and improve sustainability efforts.
Senior Data Engineer
Senior Data Engineer at ZigZag developing data platforms and enabling analytics. Focus on Snowflake architecture and collaboration with multiple teams.
Senior Cloud Data Architect
Data Architect at Vertical Relevance shaping customer cloud journeys with AWS solutions. Designing and implementing data solutions, ensuring customer success through strong technical guidance.
Azure API, Data Engineer
Azure API & Data Engineer part of a strategic LATAM integration project. Focused on Cloud Integration, APIs, and Data Engineering with Azure and AWS.
Manager, Data Engineering
Manager, Data Engineering at Skillable responsible for building data pipelines and managing a team. Leading the engineering practices in a fully remote environment.