Senior Data Engineer, DataBricks, Data Privacy – LGPD
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer supporting Databricks integration with focus on data privacy and governance. Working with cross-functional teams to ensure compliance with LGPD requirements.
Responsibilities:
- Act as a technical advisor for the integration between Databricks and data privacy/governance tools.
- Support the configuration of connectivity, access permissions, metadata, and security requirements within Databricks.
- Guide and validate data discovery, classification, and scanning processes across the Data Lake.
- Provide expertise on Databricks data structures, access patterns, and security models.
- Collaborate with engineering and business teams to ensure data integrity, usability, and compliance.
- Document data architectures, workflows, and technical processes.
- Support troubleshooting and provide technical guidance on data-related challenges.
- Contribute to Data Lake and Data Warehouse architecture discussions and best practices.
Requirements:
- Experience in Data Engineering or related roles.
- Advanced English (C1 or above), both written and spoken- mandatory
- Hands-on experience with Databricks (required), including:
- Data structures and Delta tables
- Access control and security model
- Connectors and metadata management
- Strong knowledge of SQL and Apache Spark.
- Experience with modern cloud-based data engineering environments.
- Experience with Data Lake and Data Warehouse architectures.
- Knowledge of dimensional data modeling.
- Experience with CI/CD pipelines for data and ETL processes.
- Familiarity with data privacy and compliance concepts such as LGPD and GDPR.
- Nice to Have
- Databricks certification.
- Experience with Azure and/or AWS.
- Experience with Unity Catalog and Data Governance practices.
- Knowledge of Data Quality frameworks and processes.
- Experience with data privacy, governance, discovery, or classification platforms.
- Experience supporting scanning and classification tools integrated with cloud data platforms.
- Experience working with international clients.
- Knowledge of Power BI.
Benefits:
- Health and dental insurance
- Meal and food allowance
- Childcare assistance
- Extended paternity leave
- Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
- Profit Sharing and Results Participation (PLR);
- Life insurance
- Continuous learning platform (CI&T University);
- Discount club
- Free online platform dedicated to physical, mental, and overall well-being
- Pregnancy and responsible parenting course
- Partnerships with online learning platforms
- Language learning platform
- And many more!
Similar Jobs
Lead Data Engineer
Lead Data Engineer responsible for developing AI-driven data pipelines and infrastructure. Collaborate with the CTO and build a team within a fully remote environment.
Data Engineer
Data Engineer responsible for building data pipelines and ensuring data quality for analytics. Collaborating with cross-functional teams to support enterprise decision-making in a remote setup.
Senior GenAI Data Engineer, Databricks
Data Engineer specializing in AI applications for a fast-growing advertising tech company. Building data pipelines and enhancing data reliability while collaborating with cross-functional teams.
Lead Architect – Master Data
Lead Architect driving global master data architecture strategy during SAP S/4HANA transformation at Scotts Miracle-Gro. Collaborate with VP, Data Intelligence & AI on enterprise data management initiatives.
Senior Data Science Engineer
Sr Data Science Engineer at LegitScript developing ML models for risk detection and prioritization. Collaborating on data pipelines and production-ready APIs in a flexible work environment.
Director, Data Engineering – Business Applications
Director of Data Engineering and Business Applications at FOCUS overseeing data pipelines and application management. Collaborating with C-level executives to align data infrastructure with strategic growth objectives.
Enterprise Architect – Data Management
Enterprise Architect tackling complex data challenges and shaping integration across the enterprise. Leading technical direction to improve outcomes and operational efficiency.
Director, Data Engineering – Business Applications
Director, Data Engineering responsible for enterprise data engineering and business applications at PEAK6. Collaborating with leaders to align data infrastructure with strategic objectives.
Senior Data Engineer
Senior Data Engineer responsible for building real-time data capabilities and infrastructure at DraftKings. Collaborating with various teams to optimize data solutions and drive innovative AI experiences.
Data Engineer III
Experienced Software Engineer role at Kimedics, LLC, focusing on healthcare staffing. Independently design complex features and mentor junior engineers within the team.
Data Engineer
Data Engineer responsible for developing Azure-based data pipelines and analytics solutions. Collaborating with global teams and delivering data-driven decision-making support at SCIEX.
Software Engineer – Data Platforms
Software Engineer designing and building data engines for TV and advertising data at smartclip. Ensuring systems are scalable and leading automation with cutting-edge tools.
Data Engineer
Data Engineer responsible for establishing data infrastructure and supporting analytics at fintech company Overflow. Collaborating with various teams to ensure reliable access to metrics and data governance.
Data Engineer
Data Engineer optimizing data estate and monitoring ETL processes for digital marketing sector. Collaborating on architecture migration and data analytics projects to enhance performance.
Senior GCP Data Engineer
Senior Data Engineer in healthcare focusing on Google Cloud Platform and scalable data solutions. Developing data pipelines and optimizations using GCP tools and best practices.
Senior Consultant II, Applied Machine Learning, Data Engineering
Applied Machine Learning Engineer Senior Consultant II developing AI-driven data pipelines and solutions. Support data automation initiatives to enhance operational efficiency and data quality.
Data Engineer – Fintech
Data Engineer developing scalable data solutions for the fintech sector at Hypoport. Responsible for end-to-end data product ownership and cross-functional collaboration.
Staff Data Engineer
Founding Data Engineer at Payabli developing data systems and pipelines for payments infrastructure. Owner of data reliability and architecture decisions critical to the platform's analytics and ML efforts.
Data & AI Engineer – Microsoft Fabric
Senior Data Engineer with deep expertise in Microsoft Fabric and AI integration at Reply. Delivering end-to-end data solutions and building large-scale data pipelines.
Data Engineer
Data Engineer designing, building, and optimizing scalable healthcare data solutions leveraging Microsoft Azure ecosystem. Focus on ingestion, transformation, modeling, and delivery of complex datasets.