this post was submitted on 28 Sep 2023
12 points (100.0% liked)

Technology

2 readers
1 users here now

This magazine is dedicated to discussions on the latest developments, trends, and innovations in the world of technology. Whether you are a tech enthusiast, a developer, or simply curious about the latest gadgets and software, this is the place for you. Here you can share your knowledge, ask questions, and engage in discussions on topics such as artificial intelligence, robotics, cloud computing, cybersecurity, and more. From the impact of technology on society to the ethical considerations of new technologies, this category covers a wide range of topics related to technology. Join the conversation and let's explore the ever-evolving world of technology together!

founded 1 year ago
 

The chatbot's knowledge previously only included data up to September 2021, but not any more.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 4 points 11 months ago

It gets me how every single comment is the same three tired old jokes about AI. Between "It's only good for imagining up stuff that has no right answer", "And so the downward spiral begins as LLM's are trained on the output of previous LLM's." and "But somehow it still can’t remember what I said one minute ago " we've covered every single anti-LLM talking point.

For one, it looks like the actual training data hasn't changed, even if the model has changed and it's been able to access the internet for a while, this is non-news. For another, a lot of people haven't tried GPT v4 and are just complaining about the free version sucking, well, things you get for free often suck.

And so the downward spiral begins as LLM's are trained on the output of previous LLM's

I think we can be fairly confident that the people in charge of training the LLMs have heard this too and are probably on top of it.