Senior Data Engineer, PowerBI, Data Integration

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior Data Engineer shaping data analytics and solutions at 3Pillar Global. Collaborating with teams and clients to drive impactful data engineering projects.

Responsibilities:

  • Collaboration with U.S-based client stakeholders on solution design/definition. Identify solutions that solve business problems, translating requirements into technical specifications and actionable work.
  • Writing code and implementing the proposed solutions
  • Creating data pipelines, versioning and change management
  • Manage the complexity inherent in versioned data pipelines
  • Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
  • Design, build and maintain batch or real-time data pipelines in production.
  • Automate data workflows such as data ingestion, aggregation, and ETL processing.
  • Logging and instrumentation of pipelines and services.
  • Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.

Requirements:

  • Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
  • Advanced SQL skills and experience with relational databases and database design.
  • Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
  • Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
  • Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
  • Proficient in data pipeline and workflow management tools e.g. Airflow
  • Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
  • Experience with the AWS/Azure/GCP data engineering services
  • Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
  • OR
  • Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
  • Very good exposure of working on Data Lakes & Data Warehouses solutions
  • Excellent problem-solving, communication, and organizational skills.
  • Proven ability to work independently and with a team.
  • Ability to guide other data engineers.
  • High level of English proficiency required to interact directly with U.S-based client.

Benefits:

  • Medical Insurance benefits as per company policy.
  • Life Insurance as per company policy
  • 15 days of paid vacation plus additional days based on tenure
  • Vacation bonus as per local law
  • Sick leave and paid holidays as per local law
  • Profit sharing as per local law
  • Paternity and maternity leave as per as per local law
  • Marriage, bereavement and graduation leaves as per company policy
  • Christmas bonuses as per local law
  • Work from home allowance as per company policy
  • Punctuality and attendance bonuses as per company policy
  • Food tickets as per company policy
  • Direct deposit of payroll.
  • Paid professional certifications