Shivay Lamba (@HowDevelop) header
Shivay Lamba (@HowDevelop) profile picture

AI Architect & Builder - Inference, LLMs, SLMs GSoC Org Admin - Jenkins | Docker Captain | CNCF Ambassador

New Delhi
Joined December 2018
Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)Photo by Shivay Lamba (@HowDevelop)
What an amazing day! Presented a poster at @PyTorch Conference: how we optimised the RLM paper with pre-fix caching & batched Sub calls with @vllm_project And a full house for our Pytorch Conference talk on running LLMs using Executorch on Android!
4
5
2
90
14,298
Shivay Lamba retweeted
Many people have asked what @inferact is building and what it means for @vllm_project. This is the answer: Inferact will build an autonomous inference system around vLLM, one that improves the engine and improves itself.
26
69
14
560
45,165
Shivay Lamba retweeted
Introducing Gemini 4 Neon! Pushing the frontier across domains and punching above its model class in a meaningful way. To me, Neon feels like the right balance of intelligence, speed, and usability. Available now across @GoogleAIStudio, the API, and more!
604
713
522
10,287
675,043
Replying to @Arindam_1729
this is great read and such a wonderful implementation!
25
Shivay Lamba retweeted
Did you know you can run native PyTorch with vLLM on @Qualcomm Dragonfly? Watch Qwen3-VL-32B, running locally in full FP16 via the open-source vLLM-QAIC plugin. #PyTorch #vLLM
🤖 Made with AI
1
2
19
766
Shivay Lamba retweeted
2,000+ people. Two days. The first SGLang Summit. Together, we announced SGLang v1.0, released Miles v0.2, and launched the SGLang Consortium with nine founding members: @nvidia, @AMD, @intel, @Google, @Meta, @thinkymachines, @Cloudflare, @modal, and @radixark. SGLang is now used by 332 organizations. At Meta, it powers production inference for products serving billions of users. Teams from Modal, Cloudflare, LinkedIn, and others shared their production lessons. Across 90+ technical talks and six hands-on workshops, the community explored what comes next for inference, reinforcement learning, and AI agents. To everyone building, deploying, and contributing: thank you for making this possible. Explore the announcements, engineering lessons, and moments from SGLang Summit 2026 in the link below.
149
93
157
1,120
1,009,631
Shivay Lamba retweeted
Crazy...this is Kubernetes moment for AI Agents. Run millions of agents on Kubernetes. Idle agents go to sleep and wake up in under 500ms. 10x more agents on the same hardware. 100% Opensource. github.com/agent-substrate/s…
107
172
16
1,410
112,434
Shivay Lamba retweeted
Introducing Wally Code: UNLIMITED coding at ₹1,000 a month for students. Same model, about 12x cheaper than @SarvamAI's API and 21x cheaper than @deepseek_ai's own API, for an agent running all month. Sarvam got picked to build India's own model and launched a per-token API. This is what India deserves, built with no grants and no subsidies.
Sarvam got picked by the government in April 2025 to build India's own foundation model. They got a ₹98.68 crore GPU subsidy for 4,096 H100s and raised $234M at a $1.5B valuation in June. Now they've opened Token Factory to everyone. 8 models on it. 1 is theirs. 6 are Chinese open weights (DeepSeek, Kimi, GLM) and 1 is Google's Gemma. So India's sovereign AI lab is mostly serving Chinese models from Indian GPUs. That's a hosting business, and plenty of companies already run one. I wanted Sarvam to be the lab that ships frontier research out of India. After that much capital and subsidized compute, this is not it.
36
20
12
162
23,666
huge congrats on this launch!
85
Replying to @rishabhbansal97
Really sorry to hear this Rishabh
112
Replying to @Astrodevil_
this is great!
10
Shivay Lamba retweeted
What an enriching @KubeCon_ NA 2026! From the talks: @kubeflow graduation panel @mesheryio ContribFest to speaking at ArgoCon and BackstageCon on AI-powered self-healing, observability, and agentic AI security, to project booths A packed week in SLC. Here's what I was up to 👇
8
6
50
954
Shivay Lamba retweeted
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen
59,465
120,473
24,289
1,154,945
55,420,406
Shivay Lamba retweeted
GPT-6.2 Astra—a frontier model built for your hardest projects. It sets new highs on evals across professional work and scientific research at less than a third of the cost per task of GPT‑6 Astra. You’ll see the difference in things like slideshows, websites, and 3D designs.
207
375
416
5,058
1,097,857
Shivay Lamba retweeted
Some of you have been asking very politely. Some of you have just been asking. GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts—the real world. openai.com/index/introducing…
2,219
3,584
3,661
35,496
9,714,601
Replying to @Arindam_1729
this is a great read!
1
1
18
I won't be at Ignite, but will be in SF, so happy to see you there
1
1
33
Shivay Lamba retweeted
We’re expanding free access to our frontier models for up to 200,000 scientists worldwide, with training and support. Applications open Nov. 23. By default, we don’t use data shared through the program to train our models. openai.com/index/expanding-c…
We’re giving scientists, mathematicians, and engineers free access to our frontier models—starting with 10,000 researchers and expanding to 100,000 through 2027. ChatGPT for Academic Researchers is built to accelerate discovery across disciplines.
484
496
265
5,655
1,040,626
Shivay Lamba retweeted
Today, we release d1.2 and d1.2-ultra, the state-of-the-art omnimodal decision models. d1.2 and d1.2-ultra both can process text, images, and audio with new output capabilities. > #1 on the @ArtificialAnlys Decision Index (75) > Read a value from the input (text, number or date) > Find every passage of a kind in a text (spans) > Locate things in a picture (box for one, boxes for every instance) > Estimate a number (number with a range) > Pick every option that applies (choice) 1/ 🧵
208
328
116
3,692
25,552,262
Congratulations 🎉
1
90