Lab 6: Run vLLM on HAMi GPU Shares
Install HAMi on a GPU cluster and schedule vLLM inference services with GPU partitioning.
2 docs tagged with "inference"
View all tagsLab 7: Run SGLang on HAMi GPU Shares
Install HAMi on a GPU cluster and schedule SGLang inference services with GPU partitioning.
