GPU Cloud Platform Engineer
📌Canada, Canada 🇨🇦
⏱︎ full-time
🧙♂️ mid-level
remote
Type: Full-time
Company: Yotta Labs
Apply: careers@yottalabs.ai
🧠 About Yotta Labs
Yotta Labs is pioneering the development of a Decentralized Operating System (DeOS) for AI workload orchestration at a planetary scale. Our mission is to democratize access to AI resources by aggregating geo-distributed GPUs, enabling high-performance computing for AI training and inference on a wide spectrum of hardware—from commodity to high-end GPUs. Our platform supports major large language models (LLMs) and offers customizable solutions for new models, facilitating elastic and efficient AI development.
🛠️ Role Overview
We are seeking a GPU Cloud Platform Engineer to join our core infrastructure team and help build the next-generation AI compute cloud. In this role, you will design, deploy, and operate large-scale, multi-cluster GPU infrastructure across data centers and cloud environments. You will be responsible for ensuring high availability, performance, and efficiency of containerized AI workloads—ranging from LLMs to generative models—deployed in Kubernetes-based GPU clusters. If you're passionate about high-performance systems, distributed orchestration, and scaling real-world AI infrastructure, this role offers a unique opportunity to shape the backbone of our AI cloud platform.
🎯 Responsibilities
- Build and operate large-scale, high-performance GPU clusters; ensure stable operation of compute, network, and storage systems; monitor and troubleshoot online issues.
- Conduct performance testing and evaluation of multi-node GPU clusters using standard benchmarking tools to identify and resolve performance bottlenecks.
- Deploy and orchestrate large models (e.g., LLMs, video generation models) across multi-cluster environments using Kubernetes; implement elastic scaling and cross-cluster load balancing to ensure efficient service response under high concurrency for global users.
- Participate in the design, development, and iteration of GPU cluster scheduling and optimization systems. Define and lead Kubernetes multi-cluster configuration standards; Optimize scheduling strategies (e.g., node affinity, taints/tolerations) to improve GPU resource utilization.
- Build a unified multi-cluster management and monitoring system to support cross-region resource monitoring, traffic scheduling, and fault failover. Collect key metrics such as GPU memory usage, QPS, and response latency in real time; configure alert mechanisms.
-
Coordinate with IDC providers for planning and deploying large-scale GPU clusters, networks, and storage infrastructure to support internal cloud platforms and external customer needs.
- Bachelor's degree or higher in Computer Science, Software Engineering, Electronic Engineering, or related fields; 3+ years of experience in system engineering or DevOps.
- 5+ years of experience in cloud-native development or AI engineering, with at least 2 years of hands-on experience in Kubernetes multi-cluster management and orchestration.
- Familiarity with the Kubernetes ecosystem; hands-on experience with tools such as kubectl, Helm, and expertise in multi-cluster deployment, upgrade, scaling, and disaster recovery.
- Proficient in Docker and containerization technologies; knowledge of image management and cross-cluster distribution.
- Experience with monitoring tools such as Prometheus and Grafana; Has practical experience in GPU fault monitoring and alerting.
- Hands-on experience with cloud platforms such as AWS, GCP, or Azure; understanding of cloud-native multi-cluster architecture.
- Experience with cluster management tools such as Ray, Slurm, KubeSphere, Rancher, Karmada is a plus.
- Familiarity with distributed file systems such as NFS, JuiceFS, CephFS, or Lustre; ability to diagnose and resolve performance bottlenecks.
- Understanding of high-performance communication protocols such as IB, RoCE, NVLink, and PCIe.
-
Strong communication skills, self-motivation, and team collaboration
- Experience in developing and operating MaaS platforms or large-scale model inference clusters. Proven track record of leading multi-cluster system development or performance optimization projects.
- Proficiency in CUDA programming and the NCCL communication library; understanding of high-performance GPUs like H100.
- Ability to develop standardized inference APIs (RESTful/gRPC) and automation tools using Golang or Python.
- Hands-on experience with optimization techniques such as model quantization, static compilation, and multi-GPU parallelism; capable of profiling inference processes in multi-cluster setups and identifying bottlenecks like memory fragmentation and low compute efficiency.
-
Active engagement with open-source communities such as Hugging Face and GitHub; deep understanding of the design principles of inference frameworks like Triton, vLLM, and SGLang; ability to perform secondary development and optimization based on open-source projects and quickly translate cutting-edge techniques into production-ready multi-cluster solutions.
- Be part of a visionary team aiming to redefine AI infrastructure.
- Work on cutting-edge technologies that bridge AI and decentralized computing.
- Collaborate with experts from leading institutions and tech companies.
-
Enjoy a flexible, remote work environment that values innovation and autonomy.
Interested candidates should apply directly or send their resume and a brief cover letter to careers@yottalabs.ai. Please include links to any relevant projects or contributions.
Senior Embedded Software Engineer
@ Embedd 
What we're looking for
At embedd.it, we power hardware-software integration in embedded devices. We turn fragmented semiconductor chip data into configurable digital twins, then deterministically generate code, tests, and documentation – making integration faster, cheaper, and resilient to supply chain shocks.
We’re looking for a true legend – someone with abstract thinking and deep expertise in low-level software development. You’ll build vendor-agnostic tooling for MCU and peripheral integration to solve hardware-software integration once and for all. We work at the intersection of embedded systems, code generation, compilers, and machine learning. It’s your chance to help redefine how low-level development is done.
Responsibilities
- Drive the architecture of the driver structures and system layout
- Define scalable patterns for cross-architectural integration across bare-metal, Zephyr, Linux, and other environments
- Deconstruct complex SoC device trees and translate hardware descriptions into structured internal models for automated reasoning
- Partner with the ML team to shape data and annotation models for AI-driven data-extraction tooling
Qualifications
- 5+ years of experience in embedded systems development, including bare-metal and RTOS-based systems
- Proficiency in C/C++
- Familiarity with firmware configuration, SoC bring-up, and system-level debugging
- Hands-on experience with code generation tools, or low-level compiler/decompiler/emulator technologies
- Strong background in embedded toolchains: compilers, linkers, debuggers, and build systems
- Python or scripting for automation and tooling is a plus
- Experience with functional-safety standards is a plus
Why embedd.it?
- Dynamic, venture-backed team of engineers challenging the status quo 🚀
- Work at the intersection of embedded systems, code generators, compilers, and ML 🤖
- Unusual challenges requiring out-of-the-box abstract thinking 🧠
- Competitive compensation: cash + equity 💰
- Remote work possible 🌍
About Us
embedd.it is a UK-based startup reinventing embedded development. Our platform transforms unstructured semiconductor data into structured digital twins, enabling automatic generation of drivers, tests, and documentation. We're building a single, traceable source of truth to make integration fast, vendor-agnostic, and future-proof.
Other similar jobs
GPU SW Engineer
@ Huawei Technologies Research & Development (UK) Ltd, 📍Canada 🇨🇦
Alternance - Ingénieure/Ingénieur "Edge Computing"
@ EDF, 📍Canada 🇨🇦
SOC Engineer
@ Hitachi Digital, 📍Canada 🇨🇦
Embedded Cyber Security Engineer
@ AeroVironment, 📍Canada 🇨🇦
Embedded Controls Engineer
@ Actalent, 📍Canada 🇨🇦
Embedded Systems Engineer
@ Allied OneSource, 📍Canada 🇨🇦
Embedded RTOS Lead Engineer
@ Carrier, 📍Canada 🇨🇦
Embedded RTOS Engineer
@ Carrier, 📍Canada 🇨🇦
Embedded Engr I
@ Honeywell, 📍Canada 🇨🇦
Technical Lead Engineer, Embedded Systems
@ Lam Research, 📍Canada 🇨🇦
-
Employment
⏱︎ full-time
-
Experience
🧙♂️ mid-level
-
Working model
remote
-
Skills
-
Industry
-
Find similar jobs
GPU SW Engineer
@ Huawei Technologies Research & Development (UK) Ltd, 📍Canada 🇨🇦
Alternance - Ingénieure/Ingénieur "Edge Computing"
@ EDF, 📍Canada 🇨🇦
SOC Engineer
@ Hitachi Digital, 📍Canada 🇨🇦
Embedded Cyber Security Engineer
@ AeroVironment, 📍Canada 🇨🇦
Embedded Controls Engineer
@ Actalent, 📍Canada 🇨🇦
Embedded Systems Engineer
@ Allied OneSource, 📍Canada 🇨🇦
Embedded RTOS Lead Engineer
@ Carrier, 📍Canada 🇨🇦
Embedded RTOS Engineer
@ Carrier, 📍Canada 🇨🇦
Embedded Engr I
@ Honeywell, 📍Canada 🇨🇦
Technical Lead Engineer, Embedded Systems
@ Lam Research, 📍Canada 🇨🇦