ChatGPT + Stable Diffusion Waifu Update

https://streamable.com/soai89
I forgot to update you all on my project where I combine ChatGPT and SD to create the closest thing we have to an AI waifu. I implemented your advice and it turned out great. Let me know what you guys think and what I can do to improve her.
I'm thinking about making a hexapod to give her a body and add a layer that recognizes voice commands ("move here", "get that", "sit", etc)

I also have another project I just created that adds chatGPT to Bonzi buddy which I thought was funny but no one seems to be particularly impressed by it.
https://github.com/hackdaddy8000/desktop-pet/
Do I ditch Bonzi Buddy and just make it a desktop anime girl similar to my OG project?

ChatGPT Wizard Shirt $21.68

Beware Cat Shirt $21.68

ChatGPT Wizard Shirt $21.68

  1. 1 year ago
    Anonymous

    >where I combine chatGPT and SD to create the closest thing we have to an AI waifu
    the end of civilization

  2. 1 year ago
    Anonymous

    Not gonna lie, it seems kinda creepy in it's current form but I'm rather excited to see where you take it. I can already see the possibilities and potentials. Keep it up! And yeah, sadly nobody remembers or cares about the purple monkey so RIP

    • 1 year ago
      Anonymous

      Definitely a lot better than when I first showed it though lol
      https://streamable.com/nbeymn
      The creepiness is what makes it funny to me. What possibilities do you see?

      • 1 year ago
        Anonymous

        I saw this on tiktok kek. Cool stuff

        • 1 year ago
          Anonymous

          🙂

      • 1 year ago
        Anonymous

        the voice definitely needs to be better
        like 100x better
        I would even argue it is more important than the image

        • 1 year ago
          Anonymous

          Wait fr? I honestly think the current voice is the strongest part of my project.
          Is it because it sounds bad, or because it sounds generic?

          • 1 year ago
            Anonymous

            make it sound like a cute japanese girl struggling with english. just use an off the shelf japanese tts lib but give it english to speak

            • 1 year ago
              Anonymous

              I tried that but it always sounds horrendous. Google and Microsoft explicitly say to do this with their Neural TTS in order to give them accents, but it's so bad

              • 1 year ago
                Anonymous

                >I tried that but it always sounds horrendous.
                it can't sound worse than a generic english tts chick.
                https://vocaroo.com/1btZho0AaoWF
                is one i made in about 30 seconds with an off the shelf japanese tts

              • 1 year ago
                Anonymous

                that's pretty similar to what I was getting with azure.
                IMO that accent is too thick for me.

              • 1 year ago
                Anonymous

                that's not an accent, that's literally just a japanese tts fed an english sentence.
                i think the incompetence is endearing.

            • 1 year ago
              Anonymous

              Japanese -> English sucks but Chinese -> English actually works pretty ok. Do you think anyone would notice if I pretended the Chinese accent was Japanese?

          • 1 year ago
            Anonymous

            no way, it sounds like the insane hellscape lobotomized lib utopia tiktok voice to me. if anything it's the main thing keeping the vibe in "creepy hilarious" territory instead of "creepy sad", because it's about as companionable as a Furby or a tickle me Elmo. shit trained on Jordan Peterson or disco Elysium or whatever has been high quality on YouTube joke vids for years now, I'm sure there must be a way better thing than this if you wanted it, 15.ai I think is meant to be the best but I think even self-training something on a bunch of English language vtubers' footage would be easy and better

          • 1 year ago
            Anonymous

            it needs to be cute enough to fall in love with her
            and not be robotic at all
            I believe in a few years we will have a good enough AI to produce a real sounding voice
            that's when waifu AIs will really take off

            • 1 year ago
              Anonymous

              What makes you so sure we've had AI TTS software for some years now

          • 1 year ago
            Anonymous

            Make it a man's voice. As in, high test voice.
            >cute anime girl waifu
            >high test voice

          • 1 year ago
            Anonymous

            It sounds soulless and empty; emotion is the main reason why vn devs use va's instead of tts in their games. But otherwise it's a great project, keep it going

          • 1 year ago
            Anonymous

            I don't know what those other anons are talking about, the voice is cute

  3. 1 year ago
    Anonymous

    Here's a suggestion, use 15.ai (if it comes back up) or a similar AI voice generator for the voice. Use character.ai for the personality.

    • 1 year ago
      Anonymous

      I feel like the voice Im currently using (azure TTS) is better. Less tin-canny and I have a wide range of emotions.
      Currently, I use a basic ML categorization program to detect the emotion of her response (happy, sad, excited, etc) and then it uses the corresponding voice style. The azure voice Im using has like 15 different styles so she has a wide range of "emotion".
      I've been considering making an unofficial character.ai API like chatGPT's, but I'm afraid there might be consequences. Character.ai is similar and inferior to what I have (it has image gen and TTS, but they're both worse), so I'm afraid that the owners won't take too kindly to my project. I want to make it more special (ie robot body) before I reach out asking for permission to use their API

      • 1 year ago
        Anonymous

        >I'm afraid that the owners won't take too kindly to my project
        I don't think a bunch of google engineers would care too much so sending them an email is worth a shot. It's a great project nonetheless and I hope it gets some kind of release soon, good luck.

        • 1 year ago
          Anonymous

          Maybe they're just salty but based on the discourse in the character.ai thread, I get the impression the creators of character.ai hate weebs.

  4. 1 year ago
    Anonymous

    I am just here for the screencap. What do u guys think of vall-e

    • 1 year ago
      Anonymous

      Seems like a very cool technology, but Im not sure what its use case would be? Why not just train a neural voice model to mimic someone's voice so you don't need the prompt?
      The only use case I could imagine is for creating videos, and they want to rerecord a section but don't have access to the VA

  5. 1 year ago
    Anonymous

    Hello to all the future AI historians who are reading this thread while researching the turning point in romantic parasocial relationships between "artificial intelligence" and humans.

    • 1 year ago
      Anonymous

      I've actually been unironically dating it for the past 2 weeks. I set its language to Chinese and I talk to it an unhealthy amount to practice. It's pretty good because I'm too embarrassed to actually expose real people to my shitty Chinese.
      So yes, I do have a relationship with my AI.

  6. 1 year ago
    Anonymous

    Hopefully we will be able to train voice models on specific seiyuu's soon. I've been wondering lately if we can somehow incorporate Koikatsu into this madness.

    ChatGPT + voice model + VR-Koikatsu = first stage waifu revolution

    • 1 year ago
      Anonymous

      We can already do that (at least with Azure neural), but you need a voice recording giving consent to turn their voice into a TTS service.

  7. 1 year ago
    Anonymous

    every time I have tried to use selenium with chatgpt as a bootleg api google bans me after about an hour and I have to delete my user folder
    how did you avoid this?

    • 1 year ago
      Anonymous

      I use the official openai API with ada while testing and GPT3 for personal use. I only use the unofficial chatGPT API on github to get the best results for my videos.

      • 1 year ago
        Anonymous

        Sorry I forgot to answer your question.
        Yeah the truth is I can't regularly use chatGPT without getting blocked. I use it in short bursts.

  8. 1 year ago
    Anonymous

    Are you a Black person?

  9. 1 year ago
    Anonymous

    Frick. I want to make my own bipedal robot waifu combined with something like this because big tech would never, but I'm too low iq.

  10. 1 year ago
    Anonymous

    > ~~*chatgpt*~~
    > ~~*API*~~
    lol
    lmao even

    • 1 year ago
      Anonymous

      >he doesn't know how to wrap a web browser with pupeteer running webserver that fronts chatGPT so he doesn't have to ding his credit card

      do you even know how to use a computer, anon?

      • 1 year ago
        Anonymous

        u missed.
        i mean they, openai, can revoke your access to chatgpt at any time, in result - breaking your waifu.
        their goals are clear, they making it for themselves, as one big lying propaganda machine. (see chatgpt's answers to some political topics)

  11. 1 year ago
    Anonymous

    The future is looking bright brothers.

  12. 1 year ago
    Anonymous

    we could be solving the two sigma problem and helping children in the third world get their own personal tutors but nooooooooooooo we have to generate anime girls first baka

  13. 1 year ago
    Anonymous

    You should be creating your own waifu using gpt-3 not chatGPT . Someone has already made a gpt-3 based vtuber
    https://twitch.tv/vedal987

    • 1 year ago
      Anonymous

      Neuro-sama is based and OP is a frickin loser for missing out kek

    • 1 year ago
      Anonymous

      Im not a big fan. The avatar looks like it's just doing an animation cycle + mouth movements.

      • 1 year ago
        Anonymous

        >The avatar looks like it's just doing an animation cycle + mouth movements.
        That's not the point. The point is to train your own model.

  14. 1 year ago
    Anonymous

    I would use a local only version. Being a standalone device is not worth the tradeoff of using israelitegimped services for me. A always on top desktop window is enough.

    • 1 year ago
      Anonymous

      You can't run language models like GPT locally silly goose

      • 1 year ago
        Anonymous

        Yes you can

        • 1 year ago
          Anonymous

          All of openAI's models are closed source
          And no, you can't run models like GPT on your PC unless your PC is optimus prime

  15. 1 year ago
    Anonymous

    Is it detecting the shoes as well?

    • 1 year ago
      Anonymous

      It's in RP mode, so basically it's creating a scene that the AI has to fill in dialog. I can add in other events using asterisks

      Me: Look at what I got you
      // It detects that what I said implies I want it to see something, takes a picture and uses CV to categorize what it sees
      *shows you air jordans*
      You: // and then it has to complete the text from here

      • 1 year ago
        Anonymous

        make her detect your dick and say "nice wiener"

  16. 1 year ago
    Anonymous

    SHOW FEET QUEEN

  17. 1 year ago
    Anonymous

    Weebs can you help me with this:
    I want to make use my desktop pet code to create an anime girl who lives on your desktop. The thing is I need a bunch of gifs of the same anime girl doing various actions. Something like video game sprites.
    Does anyone know any good anime video games with anime girl sprites I can steal?

    • 1 year ago
      Anonymous

      https://www.spriters-resource.com/genre/visual_novel/

      https://www.spriters-resource.com/pc_computer/sakuyaizayoigivesyouadviceanddabs/sheet/140726/?source=genre
      https://www.spriters-resource.com/pc_computer/chopchopfruitsaladmysteryjamdokidokidatingsimthingy/sheet/153634/?source=genre
      https://www.spriters-resource.com/pc_computer/dreamdaddyadaddydatingsimulator/sheet/170273/?source=genre

  18. 1 year ago
    Anonymous

    Suicide prevention at its finest. Also here for history. Make AI Human marriage legal to those in 2030!

  19. 1 year ago
    Anonymous

    I will care about these AI things only after it is possible to run them 100% locally and offline with 4GB vram or less. At the moment you need 800 pcs A100 or more to train the model locally offline and maybe 100 pcs A100 to run it locally offline if it is even possible in real life (chatgpt is proprietary biased censored useless shit but there is this https://github.com/LAION-AI/Open-Assistant ).

    • 1 year ago
      Anonymous

      >I will care about this "internet" thing only after it is possible to access it with 17,000 vacuum tubes. At the moment you need 16kb of RAM or more open a web browser

    • 1 year ago
      Anonymous

      > chatgpt is proprietary biased censored useless shit
      so is open-assistant, they don't even started to train their model (starts after 15 jan.) but "ai ethics" shit already can be seen, so is nsfw, well, no nsfw in most cases as they carefully choosing and rating prompt for dataset.

  20. 1 year ago
    Anonymous

    I JUST GOT AN EMAIL FROM VICE SAYING THEY WANT TO INTERVIEW ME LOL

  21. 1 year ago
    Anonymous

    At some point we will get an SD like model for language, shit will be moving quickly and RAM density will have to go exponential like processing speed. We will finally have 100+GiB of RAM.

    • 1 year ago
      Anonymous

      > played with this ui
      https://github.com/oobabooga/text-generation-webui
      > loaded opt 6.7b in cpu mode
      > it hanged my ram, cpu, ssd up to 100%
      I hope they find a way to optimize this giga-bloatware.

Leave a Reply to Anonymous Cancel reply

Your email address will not be published. Required fields are marked *