Lablup to Showcase the Future of AI Innovation at NVIDIA GTC 2024
[Mar 4, 2024] Lablup is set to participate as a silver sponsor at NVIDIA's premier AI conference, GTC 2024, taking place from March 18th to 21st at the San Jose Convention Center, USA. This in-person event, the first of its kind in five years, is anticipated to be the largest tech gathering in the GPU sector, with over 300,000 participants joining both online and offline.
At the conference, Lablup will present on two cutting-edge topics within AI technology. The first presentation, titled "From Idea To Crowd: Manipulating Local LLMs At Scale," will be conducted by Lablup's CEO, Jeongkyu Shin, and CTO, Joongi Kim. This session will introduce how Backend.AI leverages resource-saving and model compression technologies such as quantization and QLoRA, along with the integration of vLLM and TensorRT-LLM, to efficiently manipulate large-scale local LLMs. This approach aims to optimize AI model performance while minimizing resource usage.
The second presentation, "Personalized Generative AI: Operation and Fine-Tuning in Household Form Factors," scheduled for March 20th, will be led by CTO Kim Joongi. It will demonstrate how to develop and service customized generative AI using cloud and PC GPUs, presenting new possibilities for integrating AI technology more closely into everyday life through personalized AI.
Furthermore, Lablup will showcase Backend.AI Enterprise at booth #1233, the only NVIDIA DGX-Ready software in the APAC region. Backend.AI is an AI infrastructure operation platform that maximizes the performance of NVIDIA DGX systems and other GPU-accelerated computing resources, enhancing GPU usability without altering the user environment. At the booth, Lablup will showcase FastTrack, an MLOps platform that streamlines and automates AI development, customizing foundation models for various industries and enabling real-time fine-tuning for personalized chatbots.
Following MWC, Lablup aims to strengthen cooperation with global partners such as NVIDIA, Dell, AMAX, and Weka at GTC, paving the way for a significant global expansion.