Senior Backend Developer, Spark
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Backend Spark Developer building scalable Big Data pipelines for Talan, an international technology transformation consultancy. Leading architecture, performance optimization, integrations, and developer mentoring across financial IT projects.
Responsibilities:
- Design, develop, and optimize scalable Big Data solutions using Apache Spark
- Lead technical decisions and contribute to the architecture of data processing solutions
- Develop, maintain, and optimize Big Data pipelines
- Support data integration initiatives across multiple systems and workstreams
- Ensure the performance, scalability, and reliability of data processing applications
- Troubleshoot and resolve complex technical and performance issues
- Collaborate with technical and functional stakeholders to define and implement solutions
- Promote Agile development practices and contribute to CI/CD and DevOps processes
- Mentor and support junior and mid-level developers, sharing best practices and technical knowledge
- Explore and promote emerging technologies, including AI-assisted development and automation
Requirements:
- 5+ years of hands-on experience developing Big Data solutions with Apache Spark
- Strong experience programming in Scala (preferred) or Python
- Solid SQL skills and experience with data modeling
- Experience with Big Data platforms such as Azure Databricks and Apache Hive or similar Spark-based environments
- Experience working in Agile environments and applying CI/CD and DevOps best practices
- Hands-on experience with Git, GitHub, SonarQube, and Nexus
- Strong analytical and problem-solving skills
- Proactive mindset with the ability to work independently and take ownership of technical solutions
- Experience mentoring and supporting other team members
- English level B2+ or above
- Experience with workflow orchestration tools such as Control-M or Apache Airflow is nice to have
- Knowledge of Hadoop ecosystems is nice to have
- Experience using AI-assisted development tools or contributing to AI-driven initiatives is nice to have
Benefits:
- Permanent, full-time contract
- Career development opportunities
- Challenging, multicultural environment with international projects
- Exposure to large-scale financial IT systems and cross-country operations
- Training opportunities to develop new skills in finance, technology, and data management
Similar Jobs
GO Developer, German
Desarrollador Go senior o mid-level para Almato Iberia, integrando sistemas empresariales y creando microservicios backend escalables. Trabajo remoto en España con Docker, Kubernetes, APIs REST, grafos de conocimiento y bases de datos SQL/NoSQL.
Senior Java Backend Engineer – WCS Migration
Senior Java Backend Engineer migrating Mindera’s WebSphere Commerce platform. Building Spring and MongoDB services while modernising enterprise e-commerce systems.
Desarrollador Backend – Java, Quarkus
Desarrollador Backend Java/Quarkus para un proyecto financiero en Ecuador. Diseñando microservicios, APIs REST y soluciones escalables con prácticas TDD y despliegues cloud-native.
Technical Lead – Technical Architect
Technical Lead/Architect guiding secure enterprise application delivery and AI-assisted modernization for USPS at GDIT. Leading architecture, engineering standards, security, and technical teams remotely.
Java Backend Developer – Spring Boot, Camunda
Senior Java-Backend-Entwicklung für Rockstardevelopers, einen deutschen Softwareentwickler für Enterprise- und Mittelstandsprojekte. Entwicklung und Betrieb von Microservices mit Spring Boot, Camunda, REST/SOAP und Kubernetes.
Senior Backend Engineer
Senior Backend Engineer building AI-native learning tools for simpleclub, an education platform used by millions of students. Owning backend architecture, APIs, data pipelines, and LLM integrations.
Senior Back End Engineer – Ruby on Rails, GO
Senior backend engineer building Ruby on Rails and Go services for PrizePicks’ daily fantasy sports platform. Supporting microservices migration, internal operational APIs, reliability, and engineering mentorship.
Senior .NET Engineer
Senior .NET Engineer developing CAD-integrated applications and Power BI dashboards for Avenga’s engineering and manufacturing clients. Supporting data integration, automation, deployments, and legacy modernization.
Applied AI Engineer, Python, AI
Applied AI Engineer building Python services, prompts, and production AI features for BrightPlan’s financial wellness SaaS. Enhancing AI Coach capabilities and integrating LLM workflows into a live fintech platform.
Senior Java Backend Developer, Python – AI Focus
Desenvolvedor Java backend sênior na Evertec, empresa de tecnologia para o setor financeiro. Projetando microsserviços, APIs e soluções de IA generativa com foco em escala e segurança.
C# .NET Developer
C# .NET Developer building modern front- and backend software and AWS cloud solutions for DATAGROUP, a German IT services provider. Maintaining complex transactional systems and collaborating closely with customers.
Python Developer
Python Developer building ETL components and Java frontends for DATAGROUP Polska. Modernizing legacy systems and migrating Oracle workloads to PostgreSQL and cloud platforms.
Senior Technical Architect
Senior Technical Architect delivering enterprise AI/ML solutions on Snowflake. Leading architecture, MLOps, and customer transformation across complex data platforms.
Mid-level Backend Developer, .NET
Desenvolvedor Backend .NET criando APIs e integrações para sistemas de saúde suplementar. Atuando com Azure, mensageria e evolução de sistemas estratégicos.
Senior .NET Backend Developer
Desenvolvedor Backend .NET sênior na Verity, consultoria de transformação e engenharia digital. Desenvolvendo APIs, observabilidade e serviços em nuvem com GCP/GKE.
Senior Backend Engineer, Data
Senior Backend & Data Engineer building Python services and Databricks/PySpark pipelines for Publicis Groupe’s marketing intelligence platform. Supporting distributed systems, analytics, and campaign automation.
Senior PHP Software Engineer
Senior PHP engineer developing OroCommerce applications and enterprise eCommerce/ERP integrations for Trissential’s clients. Leading APIs, production reliability, Agile delivery, and developer mentoring.
Senior Database Engineer – DBRE, SQL Server, Open Source
DBRE sênior administrando bancos SQL Server e open source no Sicredi, instituição financeira cooperativa. Implementando automações, infraestrutura como código, monitoramento e alta disponibilidade para ambientes críticos.
Mid-level Database Engineer – DBRE Oracle & GoldenGate
DBRE Oracle e Golden Gate administrando ambientes críticos da Sicredi, instituição financeira cooperativa brasileira. Implementando automações, infraestrutura como código, monitoramento e alta disponibilidade para bancos de dados.
Mid-level Database Engineer – SQL Server, Open-Source
DBRE SQL Server engineer managing resilient, high-availability databases for Sicredi, Brazil’s cooperative financial institution. Automating infrastructure, monitoring systems, and resolving database incidents.