Senior Software Developer, Big Data
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Software Developer at GoTo resolving complex data processing issues and supporting timely software releases. Collaborating across time zones to enhance the data workflow and ensure reliability.
Responsibilities:
- Diagnose and resolve complex data processing issues to ensure the reliability and performance of critical data pipelines.
- Collaborate with the team to support timely software delivery by proactively managing data-flow risks and dependencies.
- Prevent data errors and inconsistencies by strengthening validation, monitoring, and anomaly detection across a complex data ecosystem.
- Deliver additional business value each development cycle by shipping well-scoped improvements and fixes iteratively.
- Ramp up quickly by learning the existing development cycle, following established processes, and collaborating effectively across time zones as needed.
Requirements:
- Hands-on expertise with Spark, Airflow, AWS, and the Databricks ecosystem is required.
- Strong programming and query skills in Python and SQL; familiarity with Hive is a plus.
- Deep understanding of big data processing concepts (trade-offs, limits, governance, and performance optimization).
- Proven ability in debugging, unit and integration testing, managing task dependencies, monitoring, and anomaly detection.
- Experience with Delta format and comfort using modern AI tools (e.g., Copilot, ChatGPT) to boost productivity.
Benefits:
- Comprehensive health benefits, life and disability insurance, and fertility and family-building support programs.
- Generous paid time off and holidays, volunteer leave, quarterly personal wellness days, and meeting-free days.
- Tuition and book reimbursement programs to support continuous learning and professional development.
- Thrive Global wellness program, confidential Employee Assistance Program (EAP), and one-on-one wellness coaching.
- Employee programs — including Employee Resource Groups (ERGs), the “GoTo Gives Back” initiative, and our charitable donation matching program — to expand your social network and amplify the impact of your efforts.
- A registered retirement savings plan to help you plan for the future.
- Gym reimbursement programs to support your physical well-being.
- Access to telemedicine services for convenient healthcare.
- A GoTo performance bonus program to recognize your contributions.
- A monthly remote work allowance to cover home office expenses.
Similar Jobs
Software Engineer II
Software Engineer II responsible for backend systems and APIs for behavioral health apps. Collaborating with mobile teams on iOS and Android app feature delivery.
Software Engineer – Data Movement Platform
Software Engineer working on data movement platform and infrastructure improvements at Reddit. Collaborating to build high-quality solutions for large-scale data processing and management.
Principal Engineer, AI
Principal Engineer developing AI-powered capabilities to improve early education outcomes. Driving technical direction and mentoring teams in a mission-driven startup environment.
Lead Software Engineer, Architect
Architect and Lead Software Engineer in a consultancy focusing on multi-shore custom application development. Leading architectural design for modernization projects across cloud and on-premise environments.
Staff Software Engineer, Applied AI
Staff Software Engineer developing agentic LLM pipelines for AI features in medical equipment ordering platform. Collaborating with teams to enhance healthcare solutions using cutting-edge technology.
Fullstack Developer – Flutter, Node Specialist II
Fullstack Developer specializing in Flutter and Node.js to develop and maintain applications for Grupo Boticário. Focusing on technical leadership, scalable solutions, and team mentoring.
Product Engineer
Product Engineer owning the full lifecycle of features and products at Careerminds, leveraging AI for product development and shipping continuously.
Lead Software Engineer
Python developer building a rating engine at PURE Insurance. Collaborating with stakeholders and developing solutions for insurance-related needs.
Dynamics 365 Technical Lead
Dynamics 365 Technical Lead at Expleo, creating innovative solutions for clients using Microsoft technologies. Collaborating with teams and leading technical initiatives to achieve operational excellence.
Full Stack Developer – Specialist
Senior Full Stack Developer focusing on backend with Java at Evertec. Collaborating on critical system evolution and architecture decisions in a dynamic team environment.
Software Engineering Architect
Software Engineering Architect leading data platform architecture and engineering at Salesforce. Driving innovation through AI while collaborating across globally distributed teams.
Senior Software Engineer
Senior Software Engineer developing aerospace products and maintaining safety-critical software systems. Leading design and verification activities according to RTCA DO-178 standards at Luminator Technology Group.
AI/ML Software Engineer
AI/ML Software Engineer designing and deploying secure software for FTI Defense. Collaborating on complex engineering solutions for mission operations and analytics.
AI/ML Software Engineer
AI/ML Software Engineer designing, building, and deploying secure software systems for defense missions. Collaborate across teams and solve technical challenges in secure, distributed environments.
Distinguished Software Engineering Lead
Distinguished Software Engineering Lead at FTI Defense architecting secure, scalable software solutions. Guiding teams while being hands-on in development and system integration.
Senior Software Developer
Senior Software Developer designing and building high-performance systems for Pagefreezer's integrity solutions. Collaborating on scalable architecture and innovative technology integration.
Software Engineer – Mid-Level/Senior
Join Boeing as a Software Engineer Developer focusing on RTOS and hypervisor configurations for safety-critical applications. Collaborate on multi-year projects in a remote environment.
Staff Software Engineer – Guarded Containers
Staff Software Engineer developing new features and improving tooling for Chainguard's container images. Collaborating with teams and mentoring engineers in a remote-first culture.
Principal Engineer
Principal Engineer at Kevel, modernizing ad tech infrastructure and enhancing systems. Collaborate across teams to improve performance and deliver innovative features.
Principal Engineer
Principal Engineer evolving ad decision pipeline and enhancing ad serving systems for AI-driven ad tech infrastructure at Kevel. Collaborating with teams to ensure scalability, reliability, and new feature development.