Associate Technical Architect – Databricks

Posted 2ds ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Associate Technical Architect developing solutions for data migration and processing at Quantiphi, an AI-first digital engineering company.

Responsibilities:

  • As an associate Technical Architect at Quantiphi, you will solve big data problems and will develop solutions for migration, storage, and processing.

Requirements:

  • 8+ years of hands-on experience in delivering data solutions.
  • Experience with Databricks implementations - developing data pipelines using PySpark.
  • Experience in Databricks Workspaces, Notebooks, Delta Lake, APIs.
  • Experience in Python, Scala.
  • Experience in advanced SQL and Query optimization.
  • Experience in implementing data integration projects using ETL.
  • Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2.
  • Good to have skills: Experience with AWS services - S3, Redshift, Secrets Manager.
  • Experience in implementing data integration projects using ETL (preferably Qlik Replicate & Qlik Compose).
  • Experience in using Airflow or Step Functions for orchestration.
  • Exposure to IaC tools like Terraform and to CI/CD tools.
  • Prior experience in migrating (on-prem to cloud) and processing large amounts of data.
  • Experience in implementing data lake and data warehouse on cloud.
  • Experience in implementing the industry's best practices.

Benefits:

  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.
  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.
  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.
  • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.