Amazon Science (@AmazonScience) header
Amazon Science (@AmazonScience) profile picture

The latest news and research from Amazon's science community. #AmazonScience

Global
Joined December 2019
Amazon Science retweeted
ALERT 🚨: Trainium3 Neuron profiling & trace stack is so fine-grained and precise that it can generate pixel art of entire videos! The video below is an actual profile running on Trainium3 DMA engines. We will open-source the entire SKILLS.md later this month.
19
14
4
277
49,914
Amazon Science retweeted
Great work by @radixark, @sgl_project, @BanghuaZ, @alxnails, and AWS on this amazing work on Trainium! Excited to get SGLang Trainium onto the industry-standard AgentX/InferenceX! www.teapawt.org/sgl_project/status/212…
🚀 SGLang-Neuron v0.1.0 is now open source and in public preview! Following October's closed beta, SGLang's serving stack now runs on AWS Trainium, co-developed by the SGLang team and AWS Annapurna Labs @AmazonScience. A PyTorch-native plugin on upstream SGLang for Trainium2 and Trainium3: - One fully asynchronous runtime for every LLM: Trainium chips run decode steps back to back - Megakernels: every decoder layer of a step in a single NKI kernel call - PD disaggregation over EFA: Kimi-K3 across three Trainium3 nodes, GLM-5.2 at 1M context - HiCache: evicted prefixes stay in host memory and load back on a later hit - SGLang Diffusion on Trainium2: FLUX.1-dev, FLUX.3-Action, MiniMax-H3, Wan2.2 A14B, LingBot-World-V2 Thank you to the AWS Annapurna Labs team and @YottaLabs for the contributions!
6
8
84
24,083
Congratulations to the Amazon Last Mile team on winning the 2026 @INFORMS Daniel H. Wagner Prize. Their paper details a planning system that accounts for how temperature and terrain change a delivery EV's energy needs. amzn.to/4iHcbQU ⚡
1
1
6
1,451
📣 Last call: Amazon Research Awards Fall 2026 proposals are due November 11. Successful applicants receive unrestricted funds, AWS promotional credits, and training resources. amazon.science/research-awar…
2
11
46
4,744
How do you keep 70-billion-parameter quality while running up to 20 times as fast? AWS researchers combined knowledge distillation with parallel decoding. For @bookingcom's Smart Filters, that meant responses 15 times as fast for 99% of queries. amazon.science/blog/speeding…
2
5
1,126
A text-to-speech system that knows which character is speaking, and voices them accordingly. @audible_com's controllable TTS profiles characters and attributes dialogue with 97% accuracy in English: amazon.science/blog/better-s…
1
4
944
📢 The Amazon Research Awards Fall 2026 deadline has been extended to November 11. Award recipients receive unrestricted funds, AWS promotional credits, and training resources. Submit your proposal today: amazon.science/research-awar…
2
12
46
7,447
Amazon's custom Trainium chip helps power the diffusion models behind Prime 360's cinematic highlights, reducing diffusion-model inference latency by more than 40%: amzn.to/4e1puZN
1
3
1,363
Amazon Science retweeted
Most AI developers use PyTorch to build their models. And this week @AmazonScience announced a new PyTorch backend for AWS Trainium chips - TorchNeuron. Learn more about the science behind it.
4
5
42
14,061
TorchNeuron is now open source. Our new @PyTorch backend translates code into operations executable on AWS Trainium with minimal or no code changes. Learn how the team used AI agents and hundreds of thousands of models to validate it: amazon.science/blog/the-scie…
4
1
16
14,216
Same quality, twice the throughput, half the memory. Hybrid models increase LLM efficiency with mechanisms like sparse attention or state space layers. New AWS research introduces "priming," which reuses pretrained Transformer weights to build these hybrids at less than 1% of the original training cost. 8B and 32B models released. amazon.science/blog/can-we-c…
5
2
1
27
2,868
The true root cause may generate no alarm at all. New work augments a network graph with agentic AI to produce a "digital twin" that isolates failures in minutes, not hours. amazon.science/blog/graph-ce…
1
1
1
6
1,243
Amazon Science retweeted
Live from #PyTorchCon 2026, Robert Hundt (@Amazon) introduces TorchNeuron, the native PyTorch backend for @awscloud Trainium. Robert shows how TorchNeuron supports eager execution and torch.compile, letting developers train on Trainium using familiar PyTorch code and distributed training APIs. He also covers how vLLM-Neuron uses torch.compile for serving, and how Neuron Explorer lets developers profile execution from PyTorch down to hardware instructions. @AmazonScience
3
4
23
4,660