Data Engineer (Mid/Senior)
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Data Engineer focusing on quality and agile development at Join. Work on meteorological data processes in a remote environment.
Responsibilities:
- Model and implement PostgreSQL/PostGIS databases for meteorological data;
- Develop ingestion pipelines for radar, satellite, and station data;
- Process and convert shapefiles to optimized formats (MBTiles/Zarr);
- Build FastAPI endpoints to expose data to the frontend;
- Implement Redis caching to optimize frequent queries;
- Ensure data quality, integrity, and performance;
- Document ETL processes and data structures.
Requirements:
- Bachelor's degree in IT or a related field;
- 3 years (Mid) — 5 years (Senior) of experience in the area;
- Advanced Python with a focus on data processing;
- PostgreSQL + PostGIS (spatial queries, optimization, indexing);
- GDAL/OGR for geospatial processing;
- GeoPandas and Shapely for shapefile manipulation;
- MBTiles and Zarr for vector/raster tiles;
- Google Cloud Platform (Cloud Storage, BigQuery, Dataflow);
- FastAPI for building data APIs;
- Redis for caching and queuing;
- Experience with WebSockets for real-time data;
- ETL/ELT pipelines with Apache Airflow or similar;
- Knowledge of Bitbucket Pipelines or other CI/CD tools;
- Meteorological data processing (GRIB2, NetCDF, HDF5);
- Optimization of complex spatial queries;
- Geospatial data versioning.
Benefits:
- Infrastructure allowance (home office support);
- Flexible working hours;
- Day off on your birthday — with a surprise!
- Support for training and certifications;
- Access to Alura;
- Partnership with FIAP;
- Referral bonus;
- Health insurance;
- Dental plan;
- Vittude — mental health platform;
- Wellhub — physical health benefits;
- New Value — discount coupons;
- SESC access;
Similar Jobs
Principal AI & Data Engineer
Principal AI & Data Engineer at US Signal designing and implementing data architectures for AI applications. Working with operational data to build accessible and actionable systems for the business.
Principal Data Engineer
Data Engineer leading teams to innovate technology in federal government. Working on scalable data pipelines using modern tech in an agile environment.
Staff Data Engineer
Staff Data Engineer at Zeta Global leading the design and implementation of a unified semantic data layer. Focused on integrating diverse data sources for enhanced AI and analytics capabilities.
Senior Data Engineer
Senior Data Engineer at Sightline Payments, overseeing data engineering and cloud-based solutions. Collaborating across teams to prepare and deliver complex data sets for improving customer-centric omnichannel experience.
Data Engineer
Júnior Data Engineer supporting SQL Server Data Warehouse, developing ETL routines and data models. Collaborating with Product, Engineering, and Analytics teams in a growing environment.
AVP, Data Engineering
AVP of Data Engineering owning Ensemble’s enterprise data platform strategy. Leading cloud-native data platform design on Azure and Databricks for scalable analytics and AI capabilities.
Data Engineer
Data Engineer developing and maintaining data pipelines and transformation models for analytics at Industrial Electric Manufacturing. Collaborating with stakeholders and ensuring data quality across business decisions.
Senior Data Engineering Manager
Senior Manager of Data Engineering leading a team that manages data at ReUp Education. Empowering adult learners and institutions by developing data solutions and pipelines.
Director, Data Engineering, ML – AI
Director of Data Engineering leading ML and AI initiatives for Measurabl. Responsible for data platform strategy and sustainability analytics in commercial real estate.
Data Engineer
Data Engineer responsible for building foundational infrastructure for AI deployments and product launches. Collaborating with top researchers and engineers in cutting-edge AI systems.
Data Engineer
Data Engineer at OrderlyMeds connecting multiple systems to BigQuery for strategic insights. Collaborating with a cross-functional team to enhance data utility and drive business decisions.
Data Engineer/Software Engineer
Data Engineer/Software Engineer responsible for implementing data-driven solutions and managing data pipelines. Join ALTEN Technology USA to work on challenging engineering projects.
Data Engineering Manager
Engineering leader managing Data Engineering team at Northrop Grumman. Overseeing data systems and leading a collaborative team to ensure engineering excellence.
Data Engineer
Senior Data Engineer serving in Prima's engineering team, building scalable data products and maintaining pipelines for optimal growth. Engaging in innovative solutions to transform motor insurance experience.
Senior Data Engineer
Senior Data Engineer leading design discussions and driving technical vision for healthcare data solutions. Collaborating cross-functionally to ensure high standards and timely project delivery.
Senior Analytics Data Engineer
Full Stack Engineer developing scalable applications for the largest real-world healthcare datasets provider. Collaborating with an international team under technical leadership for critical platform enhancements.
Director – Data Engineering
Director leading and scaling data engineering function for a Weekday's client. Building efficient data platforms powering analytics and business intelligence across the organization.
Data Engineer
Data Engineer building and maintaining data pipelines for marketing and analytics at an EdTech app with 70 million users. Collaborating with analysts and business teams for data quality and reporting.
Data Engineer
Data Engineer responsible for managing data infrastructure at Bemobi with innovative solutions for data access and analysis. Join the Data Platform team to enhance data lifecycle processes.
Senior Lead Software Engineer, Data Platform
Senior Software Engineer building scalable data and analytics platforms at Coupa. Focusing on advanced data ingestion and processing in a multi-cloud environment.