Senior Data Engineer – Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer developing and deploying Databricks in a cloud environment at EY. Collaborating with teams to manage project timelines and deliverables while optimizing model codes.
Responsibilities:
- Develop & deploy Databricks in a cloud environment
- ETL design, development, and deployment to Cloud Service
- Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams
- Design and optimize model codes for faster execution
- Collaborate with cross-functional teams to manage project timelines and deliverables
Requirements:
- 3 to 5 years of experience in Python (Classes, functions, modules, debugging, error handling)
- Strong experience in SQL (Joins, subqueries, window functions, CTEs, stored procedures)
- Knowledge of (RDD, DataFrames, Spark SQL) – good to have
- Experience working with at least one cloud platform (AWS/Azure/GCP)
- Foundation-level certification in cloud technologies (preferred: Azure Data Engineer Associate, AZ 900, DP 900, AWS Cloud Practitioner, GCP Cloud Digital Leader)
- Essential DevOps practices like commits, pull requests, code versioning etc
- Good understanding of data Lakehouse concepts
- Strong communication and problem solving skills
Benefits:
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Similar Jobs
Freelance Energy Sector Expert
Energy Sector Professional at AI startup evaluating energy sector forecasts with strong analytical skills. Work remotely with a YC-backed company focusing on machine learning technologies.
Head of AI Solutioning
Lead AI Solutioning for clients, focusing on business processes and AI architecture development. Engage in technical leadership and team development within a remote work model.
Biology AI Training Expert
Biology expert creating AI training problems reflecting authentic scientific workflows. Designing challenging questions for frontier AI systems in remote work environment.
Biology AI Training Expert
Biology expert designing advanced problems for AI training. Focus on authentic scientific workflows for leading AI models with immediate availability.
Biology AI Training Expert
Biology expert creating challenging, deterministic problems for AI models in a remote role. Focusing on authentic scientific workflows and high standards of rigor and clarity.
Biology AI Training Expert
Biology expert creating challenging problems for frontier AI training data submission and verification. Engaging in computational analysis and experimental reasoning to enhance AI models.
Chemistry AI Training Expert
Chemistry expert creating advanced problems to train AI systems. Role requires strong skills in Python and chemistry knowledge for advanced problem design.
Chemistry AI Training Expert
Experts in Chemistry designing advanced problems for training frontier AI models. Collaborating on high-quality STEM training data with potential project extensions.
Chemistry AI Training Expert
Chemistry AI Training Expert designing advanced deterministic problems for frontier AI models. Focused on high-quality STEM training data for AI labs with rigorous technical explanations.
Chemistry AI Training Expert
Chemistry expert designing advanced deterministic problems for AI model training. Collaborating on high-quality STEM training data for leading AI labs.
Chemistry AI Training Expert
Design difficult chemistry problems for AI training evaluation processes. Collaborate and ensure reproducibility and technical precision in project deliverables.
Chemistry AI Training Expert
Chemistry expert design challenging problems for AI training data. Focusing on real scientific workflows with strong detail and clarity.
Chemistry AI Training Expert
Chemistry expert designing challenging problems for AI training data in STEM. Create original, verifiable tasks with strong computational rigor and precision.
Biology AI Training Expert
Biology expert creating advanced problems for AI systems. Involves computational analysis, Python usage, and ensuring technical clarity for quality scientific data.
Biology AI Training Expert
Biology expert creating deterministic problems for AI models, improving scientific reasoning in biology. Seeking strong Python and biological analysis skills, fully remote role.
Computer Science AI Training Expert
Computer Science expert needed to design challenging, verifiable problems for AI training. Work involves creating advanced problems in algorithms, machine learning, and computational methods.
Computer Science AI Training Expert
Computer Science expert designing challenging, original computational problems for AI training. Creating tasks that enhance model reasoning with verifiable solutions in a remote capacity.
Computer Science AI Training Expert
Design and create challenging computational problems for AI training in Computer Science. Collaborate to improve technical reasoning in leading AI models.
Computer Science AI Training Expert
Design advanced computational problems and tasks for AI systems. Collaborate to enhance AI model performance through challenging problem sets and verified solutions.
Computer Science AI Training Expert
Designing advanced problems in computer science and computational methods for AI training. Collaborating on tasks that challenge AI systems with clear documentation in English and robust solutions.