Backend Software Engineer (Senior)

• About Lablup

  We are a company providing machine learning platforms and solutions under the motto 'Make AI Accessible'. Lablup strives to solve various problems that arise when sharing scientific and engineering research processes through a standardized platform, and automates all stages of research and service. We develop and service Backend.AI to realize this vision. Backend.AI, a hyperscale AI platform, reduces the difficulties in developing and serving various AI models, from small-scale AI models to large language models.

• About Backend Software Engineer at Lablup

  A Backend Software Engineer at Lablup is an engineer who designs and evolves the core of the Backend.AI platform. You will build the systems that efficiently allocate accelerator resources such as GPUs and NPUs, and that keep training and inference workloads running reliably across diverse execution environments. You will directly design and implement the platform's key components, including the distributed scheduler, storage layer, agent, and model-serving proxy, while working through the problems inherent to distributed systems. In this role, you will experience firsthand how large-scale AI infrastructure operates and where its limits emerge, going beyond feature implementation to help shape the direction of the platform and grow into a deeply skilled engineer.

• Key Responsibilities
  • Take ownership of one or more core backend components of Backend.AI: driving their design, implementation, and operation.
    - Design and improve scheduling policies for distributed workloads, directly modeling and implementing trade-offs across resource efficiency, fairness, and priority.
    - Extend the proxy layer that enables stable serving of LLMs and other models, and continuously improve its performance and reliability.
    - Design and implement abstraction layers that launch and manage sessions across heterogeneous execution environments, including containers, VMs, Kata Containers, and MLX.
  • Continuously raise the bar for code quality and design consistency, identifying and resolving technical issues across the product.                      
  • Break down abstract feature requirements into concrete designs and specifications, shaping them into units the team can build and review collaboratively.               
  • Sustain long-running, large-scale engineering efforts through code review, technical discussion, and clear prioritization
• Basic Qualifications
  • 3+ years of professional experience in backend server development
  • 3+ years of professional development experience with Python and its ecosystem
  • 3+ years of professional experience with Linux systems programming
  • Proficiency in reading and writing technical documentation in English
  • Ability to communicate on technical topics in spoken English
• Preferred Qualifications
  • Hands-on experience designing solutions for concurrency, fault tolerance, and data consistency challenges in distributed systems
  • Experience leading a development project of 3+ engineers for 3+ months (as Tech Lead or PM)
  • Experience developing and operating backend services for web products with tens of thousands of users or more
  • Contributions to or operation of open-source projects
  • Development experience with C, C++, Rust, or Go
  • Experience developing or contributing to extensions and projects within the Kubernetes ecosystem
  • Experience programming Linux kernels and drivers, or working with CUDA and other accelerator environments
• Benefits and Perks
  • Fitness stipend
  • Welfare points
  • Lunch meal support (up to 15,000 KRW)
  • Premium coffee beans and top-of-the-line coffee machines
  • Complimentary snacks always available
  • Annual comprehensive or semi-comprehensive health checkup for employee and spouse
  • Opportunities to participate in developer communities and industry events
  • Employee benefits as a certified family-friendly workplace by the Ministry of Gender Equality and Family