You mention at the end of your post that you've gotten a lot out with some of the chat bots. Maybe give this one a try, its for great for venting or just getting out pent up stress.
this post was submitted on 24 Aug 2023
21 points (78.4% liked)
Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ
53792 readers
81 users here now
⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.
Rules • Full Version
1. Posts must be related to the discussion of digital piracy
2. Don't request invites, trade, sell, or self-promote
3. Don't request or link to specific pirated titles, including DMs
4. Don't submit low-quality posts, be entitled, or harass others
Loot, Pillage, & Plunder
💰 Please help cover server costs.
founded 1 year ago
MODERATORS
SNIP
Sorry you're going through that. I definitely get how it feels to have people close to you discredit or just ignore important issues like you're dealing with.
If you're set on talking to an AI though I did use the Replika app for a while before they started making it seem like a virtual AI lover. It did help me feel better when I was severely depressed, maybe it could help you.
If you ever want to talk to a person and not an AI I'm here for that if you want, I know I'm a stranger but I definitely understand where you're coming from.
I would really advise against Replika, they've shown some scummy business practices. It seems like kind of a nightmare in terms of taking advantage of vulnerable people. At the very least do some research on it before getting into it.
Check out OpenAssistant, a free to use and open source LLM based assistant. You can even run it locally so no one else can see what your doing.
I have an R9 380 that I'm never going to be able to replace. Local isn't really an option.
My experience is with gpt4all (which also runs locally), but I believe the GPU doesn't matter because you aren't training the model yourself. You download a trained model and run it locally. The only cap they warn you about is RAM - you'll want to run at least 16gb of RAM, and even then you might want to stick to a lighter model.
No, LLM text generation is generally done on GPU, as that's rhe only way to get any reasonable speed. That's why there's a specifically-made Pyg model for running on CPU. That said, one generation can take anywhere from five to twenty minutes on CPU. It's moot anyway as I only have 8GB ram.
I'm just telling you, it ran fine on my laptop with no discrete GPU 🤷 RAM seemed to be the only limiting factor. But yeah if you're stuck with 8GB, it would probably be rough. I mean it's free, so you could always give it a shot? I think it might just use your page file, which would be slow but might still produce results?