PhD Fellow, Data Engineering, Pipeline, PySpark
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineering Trainee at Cielo working on innovative data solutions and projects. Responsible for architecture, automation, and monitoring systems in data processing.
Responsibilities:
- Plan and align the project with the Androidization strategy
- Gather and validate functional and technical requirements
- Design the solution architecture and data model
- Automate the integration and processing of operational data
- Model and automate refined tables
- Implement monitoring and proactive alerts
- Publish and validate tables in the production environment
- Document the platform's full technical and functional structure
- Deliver training and formalize the technical handover
Requirements:
- Degree: PhD
- Education: Computer Engineering, Computer Science, Statistics, or related fields
- English: Intermediate
- Strong knowledge of data engineering using Python
- Ability to automate observability mechanisms and alerts
- Knowledge of PySpark
- Knowledge and experience with the Databricks platform (desirable)
Benefits:
- Stipend: BRL 9,000.00
- Remote work
Similar Jobs
BI Data Engineer
Lead Data Engineering initiatives in IT Analytics for transforming raw data into strategic assets. Collaborate with business areas to develop data solutions with a strong analytical vision.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data pipelines for Pax8's cloud marketplace. Collaborating on architecture and mentoring data engineers while driving data quality and reliability.
Data Engineer IV
Data Engineer IV developing scalable data pipelines and orchestration frameworks at Rackspace Technology. Leading teams in data governance and managing analytics workloads across Azure and Databricks.
Information/Data Architect
Information/Data Architect providing technical expertise and support for data architecture requirements at Concept Plus. Developing data strategies and maintaining information structures for effective governance.
Staff Data Engineer, Financial Data Operations
Staff Data Engineer on a mission to drive financial data operations for Root's tech-focused insurance platform. Collaborating with engineering and finance to enhance data workflows for payments and incentives.
Senior Data Engineer, Marketing Operations
Senior Data Engineer driving marketing operations and strategy at Root. Collaborating with multiple teams to enhance data infrastructure and analytics capabilities.
Data Engineer I
Data Engineer I supporting data platform development at EverCommerce. Collaborating with senior engineers and analytics teams to deliver reliable, high-quality data.
Technical Lead – Data Engineering, Analytics
Technical Lead delivering enterprise data engineering and analytics solutions for Department of Veterans Affairs. Lead teams to architect systems that strengthen mission operations for Veterans.
Senior Data Engineer
Senior Data Engineer designing and maintaining scalable data infrastructure for enterprise reporting, financial reconciliation, and operational analytics at Vetcor.
Data Migration and Onboarding Specialist
Data Migration and Onboarding Specialist at Alt Legal focused on client data migration and onboarding process. Collaborating internally and externally to ensure customer satisfaction and accurate data management.
Data Engineer – Cloud, BI Architecture
Data Engineer at First Table creating a cloud warehouse from scratch and managing data flow. Leading technical architecture for marketing and product functions to enhance data-driven decision making.
Data Engineer
Data Engineer building data integration pipelines for data lakes and warehouses. Collaborating with stakeholders to meet business requirements in a leading publishing company.
Founding Data Engineer – PG, Opensearch
Founding Data Engineer responsible for building the data infrastructure at Neuroscale AI. Designing and maintaining scalable data systems to support AI-driven products.
Data Architect – Operations Technology
Data Architect designing enterprise-wide data solutions for Trissential's clients. Leading modernization initiatives and collaborating on advanced analytics in Operations Technology.
Senior Data Platform Compliance Engineer
Senior Data Platform Compliance Engineer ensuring compliance in cloud environments. Collaborating on data governance and implementing CI/CD practices for data services.
Data Engineer – Healthcare
Data Engineer designing and maintaining scalable data platforms using AWS at Experian. Collaborating with cross-functional teams to support analytics and machine learning projects.
Principal Data Engineer
Principal Data Engineer playing a key role in developing data infrastructure and analytical platform at Prescryptive. Responsible for architecture, design, implementation, and mentorship across teams.
Senior Data Engineer, SQL DBA
Senior Data Engineer specializing in SQL DBA tasks at M3 Global Research. Focuses on database optimization, performance tuning, and ensuring business alignment.
Principal Data Architect
Principal Data Architect at Cencora leading enterprise strategy and architecture discussions. Responsible for ensuring alignment with business goals and technology tradeoffs.
Data Migration Specialist
Data Migration Specialist responsible for onboarding clients by migrating data into PatientNow platform. Collaborate with stakeholders to ensure data integrity and successful client transitions.