Senior Software Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Software Engineer improving LanceDB’s distributed data infrastructure and open-source Lance format. Building high-performance integrations across big data and AI ecosystems.
Responsibilities:
- Design and maintain efficient distributed Lance dataset operations
- Build efficient indices to enable predicate pushdown and accelerate queries in Spark, Ray, or Trino
- Work on table formats, data encodings, and various aspects of the Lance format in Rust
- Drive open-source community efforts to integrate the Lance format with Spark, Hive Metastore, Presto, Trino, Ray, and other data infrastructure systems
- Operate and improve internal data processing infrastructure
- Promote the Lance format in open-source communities and at Big Data conferences
- Contribute scale and performance improvements, integrations with the wider data and AI ecosystem, simplified distributed operations, and usability and maintainability enhancements
Requirements:
- 10+ years of experience building high-performance databases, big data systems, or large-scale data services
- Deep understanding of internals of open-source Big Data or AI training systems (e.g., Hadoop, Spark, Flink, Ray, Iceberg, Delta Lake, Hudi, ClickHouse, Trino, Presto, PyTorch, or JAX)
- Strong experience with high-performance computing in C++, Java, and/or Scala
- Experience with Rust or willingness to learn it
- Ability to move fast, work independently, and collaborate with a high-caliber team
- Contributor, committer, or PMC member in Apache or other large open-source projects
- Experience with Apache Arrow, DataFusion, Parquet, Iceberg, or Delta Lake
- Track record of driving large features or integrations in distributed systems
- Strong community presence and passion for open-source collaboration
Benefits:
- Equity grants
- Medical, dental, vision, and life insurance
- 401(k) retirement plan
- Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA)
- Commuter benefits
- Generous paid time off
- Paid parental leave program for birthing, non-birthing, adoptive, and foster parents
Similar Jobs
Senior Software Engineer
Engenheiro(a) de Software Sênior desenvolvendo aplicações backend, APIs e microsserviços. Projetando sistemas escaláveis e evoluindo pipelines de CI/CD em São Paulo.
Software Engineering Specialist
Especialista em engenharia de software evoluindo sistemas críticos do mercado de capitais na Depositária. Criando agentes inteligentes, automações e soluções de IA para clientes.
Senior Software Engineer
Engenheiro de Software Sênior na Flash, ecossistema de soluções inteligentes para RH e financeiro. Projetando sistemas escaláveis e acelerando entregas com agentes de código de IA.
Software Engineering Internship Program, 2027
Software engineering intern contributing to Wikimedia’s open-source tools for Wikipedia and free-knowledge projects. Learning through mentored project work across apps, data, infrastructure, and editing teams.
Senior Android Software Engineer, Consumer Engineering
Senior Android engineer building scalable Kotlin experiences for Reddit’s community platform. Leading consumer product development, experimentation, architecture, and cross-functional initiatives.
Senior Software Engineer
Senior Software Engineer building DigiCert’s certificate management, TLS, vulnerability monitoring, and security platform. Owning full-stack TypeScript services, infrastructure, and production operations.
Staff Software Engineer – SRE
Staff SRE scaling AWS Kubernetes, databases, and crypto nodes for Phantom’s global self-custody wallet. Improving reliability, observability, and infrastructure automation across blockchain systems.
Staff Software Engineer
Staff Software Engineer architecting Go and Kubernetes systems for vCluster Labs’ AI infrastructure platform. Building open-source tenant-isolation technology for global AI cloud providers.
Senior Software Engineer
Senior Software Engineer leading scalable cloud software development at Hudl, which helps sports teams capture video, analyze data, and share highlights. Championing agentic AI and mentoring engineers.
Software Development Engineer – Azure CLI, Azure PowerShell
Software Development Engineer building Azure CLI and Azure PowerShell developer tools for Centific’s cloud infrastructure and automation projects. Developing Python or C# features with global engineering teams.
Principal Engineer – Consumer & Merchant Experience
Principal Engineer shaping architecture for InPost’s customer-facing e-commerce and parcel-delivery products. Leading cross-domain technical initiatives across international markets.
AI Solutions Engineer, Full-stack Developer
AI solutions engineer and full-stack developer building telephony, CRM, billing, and scheduling systems. Automating operations for a storage and logistics company serving Australian businesses.
Senior Full Stack Engineer
Sr. Full Stack Engineer building secure AI document-processing solutions for KeyCorp. Developing cloud data pipelines, extraction models, and auditable workflows for regulated documents.
Software Engineer III
Software Engineer III building secure, production-grade rating and quoting software for C.H. Robinson’s global logistics customers. Developing object-oriented applications, microservices, tests, and AI-enabled solutions.
Senior Full Stack Engineer
Senior Full Stack Engineer owning architecture, security, and production readiness for a coaching company’s private-beta community platform. Full-stack work with Vue.js, PostgreSQL, AI integrations, and external engineering partners.
Software Engineer, Annotation Systems
Software Engineer building distributed annotation systems for Obvio AI’s AI-powered traffic safety cameras. Developing secure, reliable backend pipelines that improve road safety.
Senior Software Developer
Senior Software Developer building complex Salesforce applications for CDW, a Fortune 500 technology solutions provider. Leading architecture, development, testing, and technical project teams.
Senior Software Developer
Senior software developer leading Salesforce application architecture, delivery, and technical teams. Building technology solutions for CDW’s business, government, education, and healthcare customers.
Senior Software Engineer II, Mobile – Revenue Experimentation, AI Native
Senior Android engineer building AI-native growth and monetization experiments for Life360’s family safety platform. Shipping subscription, advertising, and purchase features to tens of millions of users.
Senior Software Engineer
Senior Software Engineer building scalable billing and invoicing systems for NMI, a global payment technology platform. Using C#, PHP, Claude, and Cursor to support high-volume merchant transactions.