• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    5 days ago

    Fun bit of history: gooners were a huge component of open weights LLM development.

    Pygmalion 6B was poured over by tinkerers before ChatGPT and Llama were even a thing. Ravenous furries and roleplayers have been major contributors to frameworks that have snowballed into huge projects, practical finetuning and quantization methods, CUDA kernels, sampling techniques OpenAI is still catching up on, you name it.

    Horniness (among other things) is a heck of a motivation. But the history is buried in obscure Discords and archived GitHub repos.


    And don’t even get me started on imagegen… Good lord. If Grok is going full “anime waifu,” oh, it has got some competition to catch up to.

    • arararagi@ani.social
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 days ago

      First time I saw a great image upscaler, it was called “waifu2x”, of course.

      There was also an older machine learning project that removed censorship commonly found on japanese pornographic drawings, but this one got deleted of GitHub by the author some years ago and I don’t even remember it’s name anymore.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        Yeah, the history of GANs stretch way back before transformers LLMs, and evolved into ESRGAN, finetunes in obscure Discords…

        That history went somewhere, fortunately, and it definitely blows the venerable waifu2x out of the water: https://openmodeldb.info/

    • Truscape@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      0
      ·
      edit-2
      5 days ago

      I remember those days - using my 3080ti to test the latest Pygmalion model and reporting feedback for how understandable the outputs were to the developers…

      I didn’t use my self-host for horny though - I tried being a DM for a DND session with fictional characters :)

      • Landless2029@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        This is one reason I wanted to get into LLMs DND stuff. I’ve tried virtual DMs and they suck due to hallucinations.

        Never tried the opposite. Would be interesting to DM and have the LLM be 4 players.