Loading...
Serving 64Mi-Token Contexts on One AMD Instinct™ MI355X Node — ROCm Blogs
Source:https://rocm.blogs.amd.com/artificial-intelligence/long-context-serving/README.html
Impact Score