Software Engineer, Data Team
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Software Engineer shaping Confluence’s Python data platform for investment data. Building unified APIs, migrating SQL Server logic, and integrating modern data sources.
Responsibilities:
- Build and shape the next-generation multi-tenant data platform
- Develop and evolve a Python data API using layered router → service → repository architecture
- Migrate business and data logic from legacy SQL Server stored procedures into testable Python
- Use parameterized SQL for data retrieval and pandas for computation and reshaping
- Integrate additional modern data sources and warehouses, such as Snowflake, through a unified API
- Work across the data platform as it grows
- Focus on data correctness, performance, and movement and reconciliation of large datasets across heterogeneous sources
- Deploy and operate solutions using Docker, infrastructure-as-code, Azure, and DevOps practices
- Help define the architecture and direction of the next-generation data platform
- Report to Thomas Garrett
Requirements:
- Bachelor's degree in Software Engineering/development, Computer Science, or related field
- 3 years of experience in software development
- Strong proficiency in Python (3.12+) backend development
- Experience with FastAPI, Pydantic v2, and async/await
- Strong proficiency in T-SQL
- Expert-level SQL Server and data engineering
- Parameterized query authoring
- Query optimization and execution-plan analysis
- Indexing strategy
- Set-based processing
- Bulk / ETL data movement
- Large-dataset performance tuning
- Comfort migrating logic out of legacy stored procedures into Python
- Exposure to modern cloud data platforms and warehouses, e.g. Snowflake
- Interest in integrating multiple heterogeneous data sources behind a unified API
- Enough Azure and DevOps capability to deploy and operate what you build
- Satisfactory pre-employment background checks, including identity and right-to-work verification where applicable
Benefits:
- Generous Time Off packages including additional half days with each public holiday in your location
- Global Career Development opportunities
- Social Events
- Referral Bonus scheme - Upto $3,000 per successful referral
- Flexible working options for all employees
- Plus many more!
Similar Jobs
Data Engineer
Data Engineer criando soluções de dados em nuvem para empresa brasileira de tecnologia e inovação. Gerenciando Databricks, AWS/Azure, data lakes, data warehouses e pipelines ETL/ELT.
Data Engineer – International Client
Data Engineer building scalable Databricks data products for The White Team’s technology consulting clients. Developing dbt, SQL, Jinja pipelines and modern data architecture remotely across the EU.
Senior Big Data Engineer – AdTech Cybersecurity
Senior Big Data Engineer optimizing Snowflake, SQL, and Java services for a cybersecurity AdTech platform. Improving real-time fraud-risk assessment scalability, performance, and cost efficiency.
Data Platform Engineer
Data Platform Engineer building PostgreSQL-to-Azure CDC pipelines for Software Mind’s global technology clients. Operating Kafka, Debezium and Kubernetes data infrastructure in production.
Data Platform Engineer
Data Platform Engineer building secure, observable infrastructure for B2Spin’s social casino and gaming products. Managing IaC, IAM, CI/CD, monitoring, cost governance, and disaster recovery.
Data Engineer – UniData, UniVerse
UniData/UniVerse Data Engineer building commission and incentive-processing systems for direct-selling and MLM businesses. Optimizing hierarchies, payouts, integrations, and high-volume transactional data.
Senior Data Engineer
Senior Data Engineer building trusted Snowflake data products for Granum’s landscaper and arborist software ecosystem. Operating governed pipelines that power analytics, AI, and operational decisions.
Ingeniero de Datos – Spark, Kafka, AWS
Ingeniero de Datos diseñando pipelines batch y streaming con Spark, Kafka y AWS. Optimización de datos a gran escala para una multinacional de consultoría IT.
Senior Data Engineer – Microsoft Fabric
Data Engineer building Microsoft Fabric pipelines, Lakehouses, and curated datasets. Supporting analytics, reporting, and AI use cases for Expleo, a global engineering and consulting provider.
Senior Data Engineer
Engenheiro de Dados na DOMVS iT construindo e mantendo pipelines ETL/ELT escaláveis. Desenvolvendo soluções com AWS, Python, SQL e bases de dados.
Data Architect Lead
Data Architect Lead modernizing VA supply-chain data and systems for SAIC, a mission technology integrator. Building cloud integrations, AI/ML analytics, and real-time inventory dashboards.
Data Engineer III
Senior Data Engineer building high-volume data pipelines for Ookla, a global connectivity intelligence company. Supporting data scientists with Spark, Python, SQL, and modern lakehouse technologies.
Data Engineer II
Data Engineer building high-volume pipelines for Ookla, a connectivity intelligence company. Supporting data scientists and analysts with accurate, scalable internet performance data.
Director, Data Engineering – Google Cloud Platform
Director leading TTEC Digital’s Google Cloud data engineering practice. Building enterprise data platforms, GenAI infrastructure, and governance solutions for client transformations.
Senior Data Architect
Senior Data Architect building Snowflake and dbt data foundations for LG Energy Solution Vertech’s energy storage business. Enabling trusted analytics, reporting, governance, and AI across enterprise systems.
Presales Data Architect – Modern Data Stack, AI
Presales Data Architect diseñando arquitecturas Modern Data Stack y soluciones de IA para Reclut, marketplace de reclutamiento con IA. Liderando preventa, PoCs y assessments de arquitectura.
Staff Clinical Informatics Data Architect
Staff Clinical Informatics Data Architect leading FHIR, OMOP, and healthcare data integration for Verily Health's AI-enabled precision-health platform. Overseeing pipelines, standards, and data quality.
Product Manager, Person Data Platform
Product Manager owning Signify Health’s healthcare person-data ingestion platform roadmap. Driving reliable client data intake, platform stability, and HIPAA-compliant care-delivery operations.
Lead Engineer, Data Platform
Lead Engineer building secure, scalable hybrid data platforms for a global investment management firm. Leading architecture, automation, reliability, and enterprise data engineering standards.
Senior Software Engineer – Data Platform
Senior Software Engineer building LightBox's AI platform and developer tooling. Connecting commercial real estate data, AI models, and production workflow applications.