Databricks Engineer, Data Engineer III
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer utilizing Databricks for data processing and analytics, transforming data into insights and collaborating with stakeholders in a cloud environment.
Responsibilities:
- Transforming enterprise business data into insights
- Collaborate with business stakeholders to understand their data needs
- Analyzing business requirements and translating them into technical specifications
- Design, develop and implement data engineering solutions using Azure Databricks Lakehouse platform
- Build Data and AI solutions leveraging Databricks components
- Conduct detailed data analysis to identify existing data tables, design new tables, views and other objects
- Apply AI and machine learning techniques to structured and unstructured data processing
- Ensure data quality, integrity, and security throughout the data lifecycle
- Collaborate with data scientists and analysts to meet data requirements
- Communicate effectively with stakeholders on complex data concepts
Requirements:
- Bachelor’s degree in computer science, engineering, or related field
- 5-7 years proven experience as a Data Engineer with cloud-based data platforms like Databricks, Snowflake, BigQuery
- Expertise with Databricks SQL, Compute Warehouses, AI/BI Genie, AgentBricks, Unity Catalog and Vector indexes
- Experience with data modeling, Medallion architecture, ETL processes and data warehousing concepts.
- Strong programming skills in languages such as Python, SQL or Scala
- Experience with DevOps and DataOps process to deploy data objects and pipelines across environments using scripts and agile process
- Experience with AI/ML concepts and their application in data engineering.
- Excellent problem-solving skills and ability to work independently and as part of a team.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP).
Benefits:
- medical, dental, and vision care
- backup dependent care
- adoption assistance
- infertility coverage
- family building support
- behavioral health solutions
- paid parental leave
- paid caregiver leave
- training programs
- professional development resources
- mentorship programs
- employee resource groups
- volunteer activities
Report this job
Job expired or something wrong with this job?
Similar Jobs
Data Engineer
Data Engineer designing large-scale data systems operating at petabytes scale. Collaborating with engineers and product managers to provide robust technical solutions at Stefanini.
Data Engineer
Data Engineer leading design and scalability of Snowflake data platform at Magna Legal Services. Enforcing best practices and enabling analytics through a secure data foundation.
Lead Data Engineer – Architecture, Data Governance
Lead Data Engineer building data pipelines and architectures for Aretum, a federal consulting firm. Involved in modern data practices and assisting various initiatives with technical expertise.
Senior Data Engineer
Senior Data Engineer focusing on building ETL pipelines and data frameworks at Federato. Collaborating with teams to deliver AI-powered features in the insurance domain.
Senior Data Engineer
Sr Data Engineer designing and building data pipelines at Guidehouse. Collaborating with stakeholders to deliver scalable technical solutions for data reporting and analytics.
Senior Data Engineer
Senior Data Engineer responsible for designing and maintaining data solutions for Inetum's product platform. Collaborates with cross-functional teams and ensures data quality and efficiency.
B2B Data Engineer
B2B Data Engineer building a network for data-driven initiatives with projects in cloud data platforms and analytics. Seeking experienced engineers for upcoming project-based collaborations.
Data Engineer
Data Engineer developing AI tools for multimodal datasets at Satalia. Collaborating with data scientists to deliver enterprise-grade solutions and impact FTSE 100 clients.
Senior Data Engineer
Senior Data Engineer at Keyrus building API-driven ingestion pipelines into Snowflake. Working on innovative digital and data projects in a remote setting.
Data Engineer
Data Engineer role at Stefanini, designing, developing, and maintaining data channels for efficient data flow in Colombia. Requires SQL, data modeling, and ETL experience.
Data Architect
Data Architect shaping and strengthening MSB's enterprise data strategy and infrastructure while partnering with educational institutions to simplify Medicaid management.
Data Engineer II
Data Engineer at Judi Health focusing on developing scalable data solutions for healthcare management. Collaborating with analytics teams to enhance data systems for informed decision-making.
Data Engineer I
Data Engineer I developing analytics-ready datasets and metrics for Capital Rx. Collaborates across teams to optimize and enhance data reporting and quality.
Senior Data/AI/ML Technical Interviewer – Data Engineering, ML, MLOps, NLP
Senior Technical Interviewer specializing in Data, AI, and Machine Learning roles. Conducting technical assessments and improving interview processes for engineering talent.
Senior Data Architect
Senior Data Architect designing and optimizing enterprise data solutions for U.S. federal and state government programs. Engaging directly with government clients and maintaining data governance and compliance.
Data Engineer
Data Engineer role focusing on construction and optimization of data platform for a risk exchange company. Engaging in AI, ML processes, and data pipelines.
Senior Data Engineer, Reporting
Senior Data Engineer building scalable analytics infrastructure at CreatorIQ for enterprise partners. Focused on data architecture and real-time insights for influencer marketing.
Data Engineer
Data Engineer responsible for guiding customers in data engineering decisions and building data solutions. Collaborating across teams to operationalize complex data and ensure data quality.
Data Engineer II
Data Engineer II responsible for designing, developing, and maintaining data pipelines and workflows at TREND Health Partners. Collaborating with teams to ensure data integrity and compliance with regulations.
Data Engineer – AWS
Data Engineer developing data solutions with AWS and SQL. Collaborating to design and implement data pipelines while optimizing data management processes.