Senior Data Engineer – PowerBI, Data Integration
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Engineer at 3Pillar, leveraging data analytics to provide competitive advantages for clients. Work with AI-native products in a global team environment.
Responsibilities:
- Collaboration with U.S-based client stakeholders on solution design/definition. Identify solutions that solve business problems, translating requirements into technical specifications and actionable work.
- Writing code and implementing the proposed solutions
- Creating data pipelines, versioning and change management
- Manage the complexity inherent in versioned data pipelines
- Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
- Design, build and maintain batch or real-time data pipelines in production.
- Automate data workflows such as data ingestion, aggregation, and ETL processing.
- Logging and instrumentation of pipelines and services.
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
Requirements:
- Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational databases and database design.
- Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
- Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
- Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
- Proficient in data pipeline and workflow management tools e.g. Airflow
- Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
- Experience with the AWS/Azure/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
- OR
- Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
- Very good exposure of working on Data Lakes & Data Warehouses solutions
- Excellent problem-solving, communication, and organizational skills.
- Proven ability to work independently and with a team.
- Ability to guide other data engineers.
- High level of English proficiency required to interact directly with U.S-based client.
Benefits:
- Medical Insurance benefits as per company policy.
- Life Insurance as per company policy
- 15 days of paid vacation, sick leave and paid holidays as per local law
- Paternity and maternity leave as per as per local law
- Marriage, bereavement and graduation leaves as per company policy
- Sick leave and paid holidays as per local law
- Christmas and Middle year bonuses as per local law
- Monthly productivity bonus as per local law
- Discounts in local shops
- Direct deposit of payroll.
- Paid professional certifications
Similar Jobs
Senior Data Engineer, PowerBI, Data Integration
Senior Data Engineer contributing to AI-driven data analytics projects for global clients. Involves collaboration, coding, data processing, and pipeline management.
Senior Data Engineer, PowerBI, Data Integration
Senior Data Engineer shaping data analytics and solutions at 3Pillar Global. Collaborating with teams and clients to drive impactful data engineering projects.
Engenheiro de Dados Sênior
Data Engineer developing and maintaining scalable data pipelines in cloud environments for projects at FCamara. Collaborating with engineering and analytics teams to ensure data quality and performance.
Senior Data Engineer
Senior Data Engineer building advanced, cloud-native data platforms and migrating legacy systems to the cloud. Collaborating with teams on AI architectures and data pipelines.
Lead Data Engineer
Lead Data Engineer developing PySpark data solutions for U.S. clients in a 100% remote role from Latin America. Collaborate with cross-functional teams to meet business requirements.
Senior Data Architect – Hands on
Senior Data Architect at Stratus, managing canonical data architecture and supporting AI/ML workloads. Driving modernization and technical leadership in data engineering.
Engenheiro de Dados Sr
Senior Data Engineer developing and maintaining data pipelines for innovative agricultural solutions at Solinftec. Collaborating with teams to ensure data integrity and efficiency.
Senior Data Engineer
Senior Data Engineer responsible for designing and optimizing scalable data infrastructure. Collaborating with teams to enhance patient-centered healthcare through advanced analytics.
Data Architect
Data Architect role involves leading data architecture initiatives and collaborating with cross-functional teams. Positions focused on enterprise data solutions using PostgreSQL and SQL Server in a remote setting.
Principal Data Architect
Principal Data Architect leading data architecture and integration efforts at Lifeway. Overseeing data governance and technical mentorship while aligning with business priorities.
Senior Data Engineer
Senior Data Engineer building and maintaining customer data infrastructure for Jane's marketing platform. Overseeing data systems and driving tooling strategies while collaborating across teams.
Data Engineer
Data Engineer role focused on Databricks and SAP integration for international projects. Collaborating with teams from North America for data transformation, reporting, and analytics.
Senior Data Engineer, GCP
Senior Data Engineer responsible for data collection and processing in a digital streaming environment. Join a platform-focused engineering team building scalable data solutions on GCP.
Architect, Data Engineer
Lead Architect Data Engineer at Quantiphi, overseeing next-gen data layer for Agentic AI. Collaborating with clients and engineering teams to optimize data architecture.
Data Migration Specialist
Data Migration Specialist responsible for exporting and organizing data for FundCount's database. Collaborating with clients and internal teams for efficient onboarding and data validation.
SAP Data Migration Consultant – Senior
SAP Data Migration Consultant focusing on data migration projects in SAP FI and MM modules. Remote opportunity with a requirement for advanced knowledge and experience in SAP data migration.
Data Engineer – Healthcare Analytics
Data Engineer involved in building a Contract Performance Analytics platform for healthcare. Focusing on data architecture, pipeline development, and integration of healthcare data.
Senior Data Engineer, Oracle
Senior Data Engineer developing and maintaining OLAP ETL projects for Erbis. Collaborating with Java and Data Science teams to support Oracle database needs.
Principal Data Architect
Principal Data Architect managing the strategy, design, and evolution of enterprise data ecosystem. Collaborating with teams to define and execute scalable data architecture at Mercury Insurance.
Senior Data Engineer
Senior Data Engineer at Reply managing data pipelines and collaborating on data-driven solutions. Working with emerging technologies like AI, Cloud, and Big Data.