Senior Software Engineer – Data Platform
Posted 23hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Software Engineer building LightBox's AI platform and developer tooling. Connecting commercial real estate data, AI models, and production workflow applications.
Responsibilities:
- Design and implement API gateways, model routing layers, and service infrastructure connecting fine-tuned CRE models with production applications
- Develop internal developer tooling, including prompt management interfaces, evaluation dashboards, and trace viewers
- Implement integration patterns for embedding AI capabilities into LightBox's existing workflow applications
- Build observability and monitoring infrastructure for AI workloads, including latency tracking, quality metrics, cost attribution, and usage analytics
- Contribute to knowledge retrieval and caching layers, optimizing accuracy and performance at scale
- Collaborate with ML engineers on model serving infrastructure and production deployment
- Participate in architecture decisions and technical design reviews
Requirements:
- 6+ years of software engineering experience with a strong full-stack foundation (backend-leaning preferred)
- Production experience building APIs, microservices, and platform infrastructure in Python and/or TypeScript/Node.js
- Solid understanding of cloud infrastructure (AWS or GCP), containerization (Docker, Kubernetes), and CI/CD pipelines
- Experience building developer-facing tools, SDKs, or internal platforms that other engineers consume
- Familiarity with LLM integration patterns: API-based model consumption, prompt engineering, retrieval-augmented generation, and tool/function calling
- Strong fundamentals in distributed systems, data modeling, and API design
- Comfort working in a small team with high autonomy and owning a feature end-to-end from design through deployment and monitoring
- Preferred: Experience with Model Context Protocol (MCP) or similar structured AI integration standards
- Preferred: Background in data-intensive platforms, particularly property data, geospatial systems, or document processing pipelines
- Preferred: Familiarity with model serving frameworks (LiteLLM, OpenRoute, AWS BedRock) and inference optimization
- Preferred: Experience in real estate technology, financial services, or other regulated/document-heavy industries
- Preferred: Prior work building observability or evaluation tooling for ML/AI systems















