• setsubyou@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 days ago

    I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.