Svelte Hacker News logo
  • top
  • new
  • show
  • ask
  • jobs
  • about

AMD MI300X for LLM Serving Disaggregating Prefill and Decode with SGLang

rocm.blogs.amd.com

1 points by latchkey 4 days ago