Edge ML, Embedded Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Edge ML Engineer developing on-device machine learning solutions for constrained hardware environments in a contract role at Data Ideology.
Responsibilities:
- Assess target edge hardware against the requirements of an on-device inference loop: evaluate processor architecture, available memory, OS and runtime environment, and whether candidate edge runtimes (such as IoT Greengrass or equivalent) can be supported.
- Evaluate candidate edge inference frameworks for CPU-only SLM deployment — including TensorFlow Lite, ONNX Runtime, llama.cpp, and equivalents — assessing quantization approaches, inference latency, and memory footprint against feasibility targets confirmed during discovery.
- Assess real-time data ingestion feasibility from operational subsystem interfaces, evaluating candidate patterns for consuming concurrent data streams within the memory and compute constraints of the target hardware.
- Design and evaluate local data store options for the on-device SLM context, including storage formats, retrieval latency, and update mechanisms appropriate for the edge environment.
- Build a constrained feasibility demonstrator on laptop or workstation hardware using simulated data feeds.
- Implement a small number of scoped interaction flows in the demonstrator, integrating the voice interface pipeline with the SLM inference and local data retrieval components as agreed through the engagement scope.
- Collaborate with the AI/ML Architect on SLM selection, domain restriction approach, and inference pipeline design — providing hardware and runtime constraint inputs that shape what is architecturally feasible.
- Collaborate with the AWS Solutions Architect on the edge-to-cloud data channel, identifying what can realistically be buffered and transmitted from a constrained edge device under variable connectivity conditions.
- Document hardware assessment findings, framework evaluations, and architectural trade-offs as Architecture Decision Records (ADRs) with explicit rationale.
- Clearly flag where recommendations are conditional on hardware or interface specifications not yet confirmed.
- Communicate technical constraints and feasibility findings clearly to both technical architects and non-technical client stakeholders throughout the engagement.
Requirements:
- Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent professional experience in embedded systems or edge computing.
- 5+ years of hands-on experience in embedded systems engineering, edge computing, or on-device machine learning, with demonstrated work on constrained hardware environments.
- Expert-level proficiency with at least one edge ML inference framework: TensorFlow Lite, ONNX Runtime, llama.cpp, or equivalent.
- Experience optimizing and quantizing models for CPU-only inference is required.
- Strong understanding of memory management, real-time data stream handling, and concurrent processing in resource-constrained environments.
- Experience with C++, Rust, or Python with tight memory management is strongly preferred.
- Experience with embedded Linux or equivalent OS environments, including ARM-based processors, limited RAM, and environments without GPU availability.
- Familiarity with real-time data ingestion from hardware interfaces or industrial systems — including serial protocols, message bus architectures, or event-driven pipelines at the edge.
- AWS familiarity preferred, specifically IoT Greengrass as a candidate edge runtime and IoT Core for device-to-cloud connectivity.
- Hands-on implementation experience is not required but direct familiarity strengthens the candidate’s ability to evaluate candidate architectures.
- Experience with voice-to-text or text-to-speech pipelines in offline or low-connectivity environments is a plus.
- Comfortable operating in a Phase 0 discovery and feasibility mode — producing assessment findings, ADRs, and a constrained demonstrator rather than production-ready software.
- Strong written communication skills with the ability to document hardware constraint findings, framework evaluations, and architectural trade-offs in formats usable by both technical architects and client stakeholders.
- Experience working in consulting or client-facing project environments is preferred.
Benefits:
- Remote work from home
- Flexible work hours
Similar Jobs
Modeling & Simulation Systems Engineer
Modeling & Simulation Systems Engineer supporting a portfolio of analytic capabilities for DoD and IC customers. Involves systems engineering and collaboration with government teams.
Senior Systems Engineer – Internal Support
Senior Engineer providing internal support at Atlas Technica for hedge funds and investment firms. Working with Azure, Microsoft 365 stack, and internal systems for seamless operation.
Systems Engineer – Modern Workplace
Systems Engineer for Modern Workplace duties at DATAGROUP, a leading IT service provider in Germany. Involves client management, software deployment, and team collaboration.
SCADA Systems Engineer 1
SCADA Systems Engineer developing and maintaining systems for electric grid monitoring and control. Monitoring, supporting, and troubleshooting SCADA systems across North America.
Systems Engineer – Level 2/3
Systems Engineer Level 2 or Level 3 at Northrop Grumman focused on launch systems safety and compliance. Working on defining and verifying safety requirements for complex systems.
Internal Systems Engineer – Applied AI
Internal Systems Engineer at impact.com focusing on developing AI-powered tools for Customer Operations. Collaborating closely with business teams to elevate customer journeys and efficiency.
Systems Analyst – Protheus
Analista de Sistemas working on ERP system Protheus for A + A Educação. Responsible for sustaining and developing Protheus functionalities to optimize processes and meet business demands.
Senior Systems Engineer
Sr. Systems Engineer overseeing cloud-based application operations for CAQH. Collaborating with vendor and internal teams to ensure system health and security in a fully remote role.
Business Systems Analyst
Business Systems Analyst responsible for analyzing business requirements and system applications, collaborating with technical teams for solutions and improvements.
Senior Business Systems Analyst
Business Systems Analyst Senior responsible for managing S4 HANA projects at Grainger. Implementing and supporting SAP ABAP Projects with Agile methodology and EWM processes.
Outsystems Developer – Mid-level, Senior, Lead
Senior/Lead Outsystems Developer at 99x Brazil focusing on designing, developing, and maintaining applications. Collaborate with developers and designers to deliver high-quality solutions.
Senior LLM Systems Engineer
Senior LLM Systems Engineer improving accuracy and resilience of LLM-driven oracle automation systems. Collaborating on evaluations, tooling, and debugging for production operations.
Systems Architect, Java, Springboot
Systems Architect responsible for overall system architecture of global B2B applications at CI&T. Engaging with clients and defining architectural standards across teams.
Business Systems Analyst, Acumatica ERP
Business Systems Analyst managing CRM and ERP systems for Alimentiv. Focusing on Acumatica and Salesforce to enhance Finance and Business Development operations.
Systems Analyst – Project-focused
Systems Analyst focusing on projects to improve IT solutions and operational efficiency at PUCRS. Collaborating with business analysts and development teams to achieve strategic objectives.
BSA – Business Systems Analyst Specialist
Specialist BSA driving integration between SAP and fiscal solutions in a leading fintech. Focus on compliance and operational efficiency in financial technology environments.
Systems Analyst III
Systems Analyst at The Standard Insurance focusing on cloud-based solutions and team collaboration. Involving incident response and application lifecycle coordination in a remote environment.
OutSystems Engineer
Senior / Lead OutSystems Engineer focusing on intuitive digital quote journeys for HNW customers. Engaging in hands-on application development and systems integration within a strategic insurance initiative.
Senior System Engineer – Cloud Native
Senior System Engineer at Adfinis AG, leading cloud-native projects and ensuring quality for clients in a remote-first environment.
Operations Systems Analyst
Operations Systems Analyst improving digital workspace processes at Outsource Access. Spearheading evaluations, engineering logic solutions, and creating detailed playbooks.