Fingerthief

joined 1 year ago
[–] [email protected] 2 points 3 months ago

Ahh, I see lol

[–] [email protected] 2 points 3 months ago* (last edited 3 months ago) (2 children)

I'm not sure I understand at all?

It's fully open source, can run/connect any number of fully local models as well as the big name models if a user chooses to use them.

Can you expand on what you mean?

[–] [email protected] 1 points 3 months ago

Thanks!

Unfortunately currently there isn't a true RAG implementation largely due to the fact that this site/app is fully self contained with no additional servers or database etc..which is typically required for RAG.

For now file uploads are stored in the browser's own local database and the content can be extracted and added to the current conversation context easily.

I definitely want to add a more full RAG system but it's a process to say the least, and if I implement it I want it to be quite effective. My experience with RAG generally has left me quite unimpressed with a few quite decent implementations being the exception.

[–] [email protected] 4 points 3 months ago

Web search is definitely something I want to add, haven't quite figured out the route I want to take implementing it just yet though.

Hopefully I can get it added sooner rather than later!

 

cross-posted from: https://infosec.pub/post/13676291

I've been building MinimalChat for a while now, and based on the feedback I've received, it's in a pretty decent place for general use. I figured I'd share it here for anyone who might be interested!

Quick Features Overview:

  • Mobile PWA Support: Install the site like a normal app on any device.
  • Any OpenAI formatted API support: Works with LM Studio, OpenRouter, etc.
  • Local Storage: All data is stored locally in the browser with minimal setup. Just enter a port and go in Docker.
  • Experimental Conversational Mode (GPT Models for now)
  • Basic File Upload and Storage Support: Files are stored locally in the browser.
  • Vision Support with Maintained Context
  • Regen/Edit Previous User Messages
  • Swap Models Anytime: Maintain conversational context while switching models.
  • Set/Save System Prompts: Set the system prompt. Prompts will also be saved to a list so they can be switched between easily.

The idea is to make it essentially foolproof to deploy or set up while being generally full-featured and aesthetically pleasing. No additional databases or servers are needed, everything is contained and managed inside the web app itself locally.

It's another chat client in a sea of clients but it is unique in its own ways in my opinion. Enjoy! Feedback is always appreciated!

Self Hosting Wiki Section https://github.com/fingerthief/minimal-chat/wiki/Self-Hosting-With-Docker

I thought sharing here might be a good idea as well, some might find it useful!

I've added some updates since even the initial post which gave a huge improvement to message rendering speed as well as added a plethora of new models to choose from and load/run fully locally in your browser (Edge and Chrome) with WebGPU and WebLLM

[–] [email protected] 2 points 1 year ago (2 children)

Interesting, thanks for the info!

I wasn't aware of the update process being used as an attack vector (if it's still a thing) gonna have to read up more on that.

[–] [email protected] 5 points 1 year ago (4 children)

I used Apple for the last few years until recently and I can't say I've ever really noticed stuff like apps faking being another app. That's not to say it doesn't happen of course.

I do know the Apple app approval process is definitely more strict than what is required for the Play Store.

I'm not very experienced with Apple or Android development so I'd be curious to hear from devs that use both platforms as well.

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago) (3 children)

What are you talking about? You are the one who ranted about people proving you wrong.

You made a big deal out of someone being perfectly pleasant replying to you.

Your viewpoint of anyone responding to you with anything other than agreement as an attack seems to be the real issue.

I'm not upset, you shouldn't be either, it's not that big of a deal.

[–] [email protected] 11 points 1 year ago (12 children)

Seems like a friendly enough response was given to your comment and you automatically assumed they were only interested in saying you're wrong.

Having a discussion is not "proving everyone wrong"

199
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 
[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

I disliked signal app wise, and Matrix app was a buggy mess for me and the 4 other people who tried to use it as well

SimpleX was easy to setup and has been for the most part stable for all of us.

Basically to answer your question, people like different things.

SimpleX isn’t perfect by any means but it seems to be developed at a somewhat decent pace with noticeable improvements being made.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

I feel like ChatGPT itself probably has a fairly loose temp setting (just a hunch) and I tend to set my conversations up to be more on the strict side

I imagine that’s why our results differ, it’s strange OpenAI doesn’t let ChatGPT site users or at least premium users adjust anything really yet.

view more: next ›