Associate Data Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Associate Data Engineer building data pipelines, warehouses, and BI datasets for TaskUs’s outsourced digital services. Supporting ETL automation, data quality, modeling, testing, and monitoring.
Responsibilities:
- Design, develop, and maintain data pipelines and data warehouses for analytics infrastructure
- Configure and set up solutions using pre-approved patterns to move data from operational and external environments to the business intelligence environment
- Manage data integration and ETL jobs, including consolidation, aggregation, filtering, validation, data quality routines, and dimension creation
- Configure and deploy automated jobs using pre-approved reusable patterns
- Execute production-level jobs while considering data dependencies, schedules, validation routines, and data stream updates
- Design, develop, verify, and continuously optimize data models according to business requirements
- Collaborate with technical users to define data requirements and establish business rules
- Collaborate with business stakeholders to deliver and enhance the BI platform and provide relevant, accurate insights through new datasets
- Perform unit and system integration testing
- Conduct peer reviews, assist with testing, and maintain current documentation
- Monitor error-handling and logging tools and processes
- Troubleshoot configuration and data errors
- Monitor performance and raise appropriate flags
- Identify opportunities to optimize the ETL environment
- Implement monitoring, quality, and validation processes to ensure data accuracy and integrity
Requirements:
- At least 2 years of experience in Data Engineering
- Knowledge of Python, Apache Kafka, AWS Redshift, AWS Glue, AWS S3, and Pentaho Data Integration
- Strong knowledge of data warehousing concepts, including traditional and MPP database designs, star and snowflake schemas
- At least 2 years of data modeling experience
- At least 2 years of hands-on development experience using ETL tools such as Pentaho, SSIS, Informatica, Talend, Fivetran, or Airflow
- Knowledge of the architecture, design, and implementation of MPP databases such as Teradata, Snowflake, or Redshift
- 3-year development using cloud-based analytics solutions, preferably AWS or GCP
- Knowledge of designing and implementing streaming pipelines using Apache Kafka, Apache Spark, or Segment
- Knowledge of database tuning and ETL tuning
- Experience using Python in a cloud-based environment preferred
- Knowledge of NoSQL databases preferred
- Knowledge, experience, and exposure to AI tools preferred but not required
- Ability to work effectively across internal functional areas in ambiguous situations
- Structured thinking and effective communication
- Bachelor's/College Degree in Computer Science, Information Technology, Engineering (Computer/Telecommunication), or 4-8 years of experience in place of a degree
- Ability to work 8:00 PM to 5:00 AM PHT, subject to business needs
Benefits:
- Competitive industry salaries
- Comprehensive benefits packages
- Wellness support
- Inclusive environment
- Internal mobility opportunities
- Professional growth opportunities
- Work from home
Similar Jobs
Data Engineer
Data Engineer building scalable pipelines and centralized data platforms for XTB’s online financial trading business. Developing integrations, infrastructure, and data quality standards.
Senior Rust Data Engineer
Senior Rust Data Engineer architecting high-throughput data services and ingestion pipelines for Nagarro’s digital product engineering company. Building low-latency infrastructure integrated with cloud warehouses and lakehouses.
Software Engineer, Data Systems/ETL
Software Engineer developing data systems and ETL software remotely from India. Producing code, unit tests, documentation, technical specifications, and proof of concepts.
Data Engineer – Databricks, Power BI
Data Engineer building Databricks applications and Power BI dashboards for Qualysoft, an international IT consulting and services company. Automating enterprise data integrations for energy and other industry clients.
Senior Principal Technical Product Engineer – Data Security
Principal Technical Product Engineer advancing Palo Alto Networks’ DSPM and DDR capabilities. Designing cloud and AI data-security architectures for strategic enterprise customers.
Engineer III – Platform Data Engineer
Platform Data Engineer operating CrowdStrike’s cybersecurity data platform. Managing Airflow, Superset, Terraform, CI/CD, cloud infrastructure, and data security.
Senior SAP Data Engineer
SAP Data Engineer Sênior projetando e otimizando modelos de dados SAP HANA para a UltraCon Consultoria em TI. Integração, relatórios, planejamento e gestão de incidentes em ambiente SAP BTP.
Senior Data Migration Consultant
Senior Data Migration Consultant migrating Dynamics AX business data to SAP ERP. Mapping, cleansing, validating, and reconciling data for Inetum’s digital transformation services.
Senior Data Engineer – Cybersecurity Platform
Senior Data Engineer modernizing scalable data pipelines and architectures for Sigma Software’s cybersecurity platform. Optimizing SQL, DBT, Snowflake, and Elastic-based security analytics infrastructure.
Data Engineer
Data Engineer remoto apoyando procesos ETL/ELT, validación de datos y troubleshooting en ARKHO. Contribución operativa a la migración y apagado de DataMarts.
Data Engineer
Data Engineer building batch and streaming infrastructure for DKSR’s CIVORA urban data hub. Supporting cities, regions, and mission-critical data use cases.
Senior AI/ML/Data Engineer
Senior AI/ML/Data Engineer building ML, NLP, LLM, and RAG solutions for QAVION’s consulting and technology boutique. Developing semantic search, GenAI services, and scalable data pipelines.
Senior ETL Testing, Data Engineer
Senior ETL/Data Engineer building and testing scalable GCP data pipelines. Developing cloud data warehouses, automation, and CI/CD integrations for an IT services organization.
Assistant Vice President – Technology, Information Management, Data Warehouse
Data Solution Architect leading Mashreq Global Services' Information Management–Data Warehouse department. Designing Databricks Lakehouse solutions, enterprise data models, streaming systems, and governance frameworks.
Assistant Vice President – Technology, Information Management, Data Warehouse
Assistant Vice President leading Mashreq Global Services' enterprise data warehouse architecture, operations, and strategy. Guiding specialists, securing platforms, and driving data modernization.
Senior Software Engineer, Data Platform
Senior Software Engineer solving distributed-systems challenges in Apache Pinot for StarTree’s real-time analytics cloud. Improving performance, reliability, concurrency, and data infrastructure at massive scale.
Data Engineer
Data Engineer building Python and Azure data pipelines, integrations, and APIs. Delivering scalable ETL/ELT and real-time data solutions for enterprise consulting clients.
Data Engineer II – Library Systems
Data Engineer II building ETL pipelines, metadata systems, and AI-ready data platforms for Johns Hopkins Libraries. Supporting research, analytics, data quality, and library operations.
Data Engineer
Data Engineer building scalable Azure and Snowflake data platforms for Datavail’s data management and cloud services. Developing pipelines, warehouses, lakes, and analytics solutions.
Senior Data Engineer
Senior Data Engineer building clinical data pipelines and cloud applications for Providence’s healthcare system. Supporting data-driven operations with modern engineering, analytics, and AI technologies.