CEO of @LightbitsLabs Eran Kirzner joined Code Story podcast's Noah Labhart to discuss how the company’s #nvme over TCP storage background led it into #ai #inference. They cover breaking the GPU memory wall, raising effective GPU utilization from roughly 30% to as high as 80%, and building products on a six-month MVP cycle.
Listen to the full episode below:
Buying more GPUs just for more memory? Eran Kirzner explains how Inferra™ by Lightbits extends GPU memory over the network, lifting utilization from ~30% to 80%. On the Code Story podcast.
🎧 www.codestory.co/episodes/e13-bonus-storage-to-inference-…
#aiinference #gpu #kvcache #llm #aiinfrastructure #gpumemory


















































































































































































































































































































