WEKA Data Platform Administrator
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
WEKA Data Platform Administrator operating NeuralMesh enterprise AI data infrastructure for GPU-cloud customers. Managing storage, Kubernetes, networking, automation, and customer workload performance.
Responsibilities:
- Run the WEKA environment day to day, including monitoring, health, upgrades, capacity, configuration, and audits
- Create and manage file systems, object-storage tiering, snapshots, quotas, and POSIX, NFS, SMB, and S3 protocol configuration
- Maintain a healthy, documented, and recoverable operational run state
- Execute approved changes with scope confirmation, risk classification, validation, rollback, and outcome recording
- Monitor drift, capacity pressure, and anomalies and recommend corrective paths
- Work with tenants and platform teams to understand storage use for training, inference, checkpointing, data loading, and scheduling
- Tune filesystem layout, tiering, snapshot policy, quotas, and per-tenant QoS
- Validate GPU node clients, BlueField-3 and SR-IOV networking, mount options, cgroups, kubelet CPU policy, WEKA Kubernetes operator, and CSI driver
- Onboard tenants and clients through repeatable, verified procedures
- Establish performance baselines and run benchmarks and tests
- Identify scaling limits involving client counts, process ceilings, NAT, and tenant-network routing
- Build and maintain customer operating runbooks covering procedures, access, validation, rollback, and recovery
- Automate repetitive work with Python, Bash, and Ansible
- Prepare handovers and backup briefs
- Explain procedures and decisions to customer operators
- Open and update escalation cases with conditions, impact, evidence, completed work, and requested next steps
- Coordinate with Technical Services, GRE, R&D, cloud providers, network teams, and third parties
- Contribute operational results, trends, and risks to weekly status and quarterly reviews
Requirements:
- 10+ years administering enterprise infrastructure at scale, with strong storage experience (file, object, or block)
- Deep Linux administration skills, including RHEL-family and Ubuntu, in distributed environments
- Hands-on experience with high-speed networking: Ethernet and InfiniBand, RDMA, DNS, ACLs, and TCP/IP fundamentals
- Working knowledge of Kubernetes and containers, including persistent storage, CSI, and operators
- Experience operating GPU, HPC, or large cloud infrastructure for external customers or multiple tenants
- Experience with at least one major cloud: AWS, Azure, Google Cloud, or Oracle Cloud
- Proficiency in Python, Bash, or Ansible
- Experience with monitoring and alerting stacks, including Prometheus, Grafana, and log and metrics tooling
- Experience with ticketing systems such as Jira and major incident management
- Clear written and verbal communication
- Strong technical writing
- Prior experience with WEKA or another parallel or distributed file system is nice to have
- Experience running Slurm or Kubernetes-based AI/ML platforms is nice to have
- Experience with NVIDIA GPU cluster networking and DGX-class systems is nice to have
- Experience collaborating between support and product or engineering teams is nice to have
- Familiarity with Confluence, Slack, and other collaboration tools is nice to have
Similar Jobs
Analytics Engineer – Data Platform
Analytics Engineer building Snowflake and dbt models for Aline’s senior-living resident lifecycle platform. Creating governed data foundations for BI reporting and AI-driven care outcomes.
Senior Data Engineer – Mid Shift
Data Engineer building AWS and Snowflake platforms for Shore360, an Australian-owned Philippine staffing and administrative support firm. Developing reliable pipelines, APIs, and data quality controls.
Senior Software Engineer, Data Infrastructure – RDBMS
Senior engineer operating petabyte-scale PostgreSQL infrastructure for TRM Labs’ AI-powered crime-intelligence platforms. Automating database operations, optimizing performance, and managing CDC pipelines remotely across LATAM.
Data Architect
Databricks Data Architect designing secure Lakehouse architectures and AI-ready data platforms for Devoteam clients. Modernizing legacy systems across cloud and multi-cloud environments.
Senior Data Engineer
Senior Data Engineer building auditable GCP data pipelines for DysrupIT’s financial billing and invoicing platform. Ensuring accurate reconciliation, lineage, and trusted financial data.
Senior Software Engineer, Data Acquisition
Senior software engineer building distributed crawling and ingestion systems for People Data Labs, a provider of people and company data. Improving scalable backend services and data products.
IT Architect, Data Scientist
IT Architect/Data Scientist supporting DLH’s federal health and national-security programs. Leading cloud architecture, data science, interoperability, security engineering, and compliance for SCHARE.
Senior Business Data Engineer
Senior Business Data Engineer building AWS data infrastructure and automated reporting for Nex’s family motion-gaming platform. Improving pipeline reliability and supporting cross-functional business teams.
Senior Data Engineer
Senior Data Engineer building Python, Spark, and Databricks pipelines for Quantiphi’s data and AI solutions. Leading cloud migration, CI/CD automation, and scalable analytics engineering.
Senior Data Engineer – IBM DB2
Senior Data Engineer modernizing IBM DB2 data environments. Building reliable ETL/ELT pipelines and AWS integrations for enterprise applications and payroll systems.
Lead Data Architect
Lead Data Architect owning enterprise data architecture for C5MI Insight’s federal SAP S/4HANA modernization program. Leading data governance, migration, analytics architecture, and master data teams.
FBS Data Engineer, SQL, Power BI
Data Engineer supporting Farmers’ P&C insurance analytics and financial loss reporting solutions. Translating business data needs into requirements, integrations, dashboards, and validated reporting.
Data Engineer – Insurance
Data Engineer building analytics solutions, data pipelines, and enterprise integrations for Farmers Insurance. Improving data quality, reporting, dashboards, and regulatory-compliant business outcomes.
Power BI Data Engineer
Power BI Data Engineer building Azure data pipelines, dimensional models, and executive dashboards for Legence. Transforming complex data into actionable business intelligence across the full BI lifecycle.
Azure Data Engineer
Azure Data Engineer building Azure and Microsoft Fabric data solutions for Quisitive, a global Microsoft cloud partner. Delivering pipelines, integrations, and analytics projects for clients.
Senior Data Engineer
Senior Data Engineer building multi-region data infrastructure for Horizon3’s NodeZero autonomous cybersecurity platform. Supporting Federal workloads, warehouses, pipelines, orchestration, and BI reporting.
Data Engineer, Snowflake
Data Engineer Snowflake diseñando pipelines cloud y transformaciones ELT/ETL para Logicalis Spain. Participación en proyectos de ingeniería de datos, IA y analítica avanzada.
Data Engineer
Data Engineer building Python and AWS data pipelines for 540’s U.S. Army financial-system modernization initiative. Improving secure, scalable data transformation and governance.
Senior Manager, Data Engineering
Data engineering leader building Databricks and Azure platforms for Cushman & Wakefield, a global commercial real estate services firm. Managing engineers, platform delivery, governance, and stakeholder outcomes.
Data Architect
Data Architect designing Azure-integrated data platforms for Tieto’s agricultural analytics projects. Building scalable datasets, ETL pipelines, warehouses, and lakes.