ray (@raydistributed) profile picture

A distributed compute framework for scaling AI workloads. Created and developed by @anyscalecompute.

Joined August 2019
1/8 Excited to announce the release of SkyRL v0.5.0! Some highlights: - Support for Beam-1.0, DeepSeek-V4.1-Flash, Qwen3.8-Flash-Next - Score centering for stable RL with 4-bit rollouts - 1M-token context training for GLM-5.3-Flash + optimizer offload to disk - A native On-Policy Distillation (OPD) trainer - Better VLM training: sequence packing, context parallelism and images in agentic RL Blog: blog.skyrl.ai/blog/skyrl-v0-… Details in 🧵
4
16
2
57
2,804
Supporting the full range of workloads is one of the main design goals of Ray.
Impressive talk at KubeCon on how @hark_labs builds computer-use agents and multi-modal models. @kaihsunchen and Hao Jiang explain how they use @raydistributed & @kubernetesio together for - data processing - training - evals - inference All across autoscaling, heterogeneous clusters. youtube.com/watch?v=06JNFaNF…
1
6
743
Completely packed RL & data meetup last night! - @TaoTianhua spoke about RL at @mercor with SkyRL - @charlie_ruan shared day-zero model support, the latest SkyRL features - @avigyabasnet talked about 1M-token context training work from @anyscalecompute and @LilaSciences - @xinyzng spoke about native @raydistributed sandboxes - @yaoma_ai shared @coinbase’s work on building custom specialist models - @alexgshaw talked about RL environments and @harborframework
6
3
20
4,308
SkyRL is everywhere.
Completely packed RL & data meetup last night! - @TaoTianhua spoke about RL at @mercor with SkyRL - @charlie_ruan shared day-zero model support, the latest SkyRL features - @avigyabasnet talked about 1M-token context training work from @anyscalecompute and @LilaSciences - @xinyzng spoke about native @raydistributed sandboxes - @yaoma_ai shared @coinbase’s work on building custom specialist models - @alexgshaw talked about RL environments and @harborframework
1
8
988
Last chance to sign up for next week's webinar! Don't miss the opportunity to learn about reinforcement learning for post-training: - How the underlying algorithms work (e.g., RLVR with GRPO) - Recent research advances (on-policy distillation (OPD), multi-teacher on-policy distillation (MOPD)) - Details of post-training a terminal agent (building evals, building custom environments, RL systems) - SkyRL deep dive (async RL, performance monitoring, tuning for RL rollouts) Register: na2.hubs.ly/H08TZfT0
1
8
509
JEPA world models plan by scoring hundreds of candidate action sequences. On a single onboard GPU, that took us 16 s per action. Fanning the search out with Ray Serve across 8x A100s: 2.8 s. That’s 5.7x faster. Blog + runnable example: na2.hubs.ly/H08ZhyJ0
2
1
3
417
ray retweeted
Watch all the #PyTorchCon North America 2026 sessions! PyTorch Conference North America 2026 brought 3,500+ attendees to San Jose on October 20–21 for two days focused on accelerating open intelligence and exploring the impact of PyTorch Foundation projects like PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors. View our playlist featuring 146 sessions from keynotes to technical deep dives spanning core framework development, model training, inference, applications, kernel engineering, responsible AI, and more. Watch and share the videos with anyone who might be interested: youtube.com/playlist?list=PL…
4
2
1
22
6,747
Here's the keynote @istoica05 gave at PyTorch Conference on some of the history of Ray. youtube.com/watch?v=HXxV3GcM…
1
4
395
Replying to @notion
@Notion is scaling AI search for millions of users. Mickey Liu shares how moving from Spark to Ray Data on Anyscale helps generate embeddings across terabytes of data, with CPU and GPU workloads in one pipeline. Watch: na2.hubs.ly/H08TrWn0
1
1
3
425
Anyscale is at #KubeCon in Salt Lake City this week. Find us at booth #P317, join KubeRay 101 on Nov 11, and catch Rueian Huang on The Scheduling Stack panel on Nov 12. na2.hubs.ly/H08TtmM0
1
4
448
📍Nov 17-20 we're at Microsoft Ignite, Moscone SF. Booth 5389L. The next wave of foundation models is coming from enterprises. Every company needs at least one FM it controls: open model, post-trained on your data, on your infra. Session Nov 18 (THR900). Learn more: na2.hubs.ly/H08V4YK0
1
1
4
563
Using Ray on Kubernetes? Try a streamlined approach to run observability and development with KubeRay Connect. New accounts get $500 in Anyscale Platform credits (limited time offer) to test out KubeRay Connect today! 👉 Claim your $500 credits
1
1
2
421
Big news at KubeCon Americas. KubeRay is joining the @CloudNativeFdn Keep your KubeRay stack and add the Anyscale Control Plane in minutes. Find us at #KubeCon booth #P317.  na2.hubs.ly/H08TY0t0
2
5
22
4,872
Replying to @Mind_Robotics
@Mind_Robotics trains robot foundation models on egocentric video captured on automotive production lines. On Nov 19, they'll present what works and what doesn't. Meetup is packed, but we saved a few seats for last-minute registrations: na2.hubs.ly/H08RLpt0
1
6
426
Physical AI Night is back on Nov 17 in SF! We’re teaming up with @Foxglove & @nebiusai to hear from leaders at @BedrockRobotics, @DexterityInc, @wayve_ai & @ThirdWaveAi on the frontier of robotics and autonomy. Save your seat: na2.hubs.ly/H08Qb7p0
3
1
6
497
For post-training AI for science, a genome doesn't fit in a 16k context window. So we went to 1M. To solve this, the SkyRL team at Anyscale worked with @LilaSciences to post-train GLM-5.3-Flash at 1M tokens per sequence on 64 B200 GPUs, using a fully open-source stack. Learn more: na2.hubs.ly/H08Q9vw0
4
3
1
17
2,351
In this session, @erictang000, Software Engineer at Anyscale, will walk through: - Intro to LLM post-training - Intro to RLVR (with GRPO) - Recent development of LLM post-training:     - On-policy distillation (OPD) and Multi-teacher On-policy distillation (MOPD) - Case study: Post-training a terminal agent     - Building evals     - Building custom environments     - RL systems - Demo walkthrough     - Intro to SkyRL     - Full Async RL with SkyRL     - Performance monitoring and tuning for RL rollouts Register: na2.hubs.ly/H08wNDx0
1
5
460
Lots of great topics. This covers - SkyRL at Mercor - What’s new in SkyRL - 1M-context training - Token-in token-out - Ray Sandboxes - Harbor - Terminal-Bench
7
111
10,823
Post-training is now a core workload for AI labs, data providers, and enterprise leveraging proprietary data to build custom models. Learn from the practictioners doing it at @harborframework, @NovaSkyAI and @mercor Doors open 5:30 PM 🍕 na2.hubs.ly/H08MNd-0
1
2
5
589