• tekato@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    3
    ·
    20 hours ago

    I don’t see where a government would need a chatbot. Anyways, chances are that half the staff was already using some form of LLM before this trial.

      • Treczoks@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        ·
        19 hours ago

        The point is that this is all happening in a cloud. One that is probably located in the US. Not a good thing for a non-US government to send potentially confidential or even secret data to.

        • sugar_in_your_tea@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          19 hours ago

          It doesn’t have to, you can run LLMs locally. We do at my org, and we only have a few dozen people using it, and it’s running on relatively modest hardware (Mac Mini for smaller models, Mac Studio for larger models).