Out of curiosity, why? They have their own TPU which they claim to be quite efficient. Is it because they can't produce enough? Or because they have to resell NVIDIA for their own cloud, Google Cloud, to customers because they prefer to stick to CUDA? Or something else?
utopiah
joined 2 years ago
No and to be honest without a clear comparison with the advantages AND disadvantages with the most popular solutions, e.g containers with implementations like Docker or Podman, I don't think I ever will.
Obviously it's nice to have alternatives which I bet can be interesting in specific use cases but without a way to understand in which specific situations it would be worth investing to learn the tooling, principles, etc then I would, naively, stay with the status quo.
TL;DR: any comparison vs Docker?
- needs root
- no easy way to install
but... supports not just CLI apps, or a terminal, like Termux, but also KWin with Wayland, so GUI, not just TUI.
Comparison with existing alternatives, e.g Termux, please.
It is, if you are not ready to tinker I do not recommend it.
Yet, it works as-is, assuming you don't need to work wirelessly. I use it on a nearly daily basis and it's stable.
My documented process https://fabien.benetou.fr/Content/SelfHostingArtificialIntelligence but honestly I just tinker with this. Most of that isn't useful IMHO except some pieces, e.g STT/TTS, from time to time. The LLM aspect itself is too unreliable, and I do like 2 relatively recent papers on the topic, namely :
- No "Zero-Shot" Without Exponential Data https://arxiv.org/abs/2404.04125
- ChatGPT is bullshit https://link.springer.com/article/10.1007/s10676-024-09775-5
which are respectively saying that the long-tail makes it practically impossible to train AI to be correct in rare cases and that "hallucinations" are a misnomer for marketing purposes to be replaced instead by "bullshit" used to convinced people without caring for veracity.
Still, despite all this criticism it is a very popular topic, hyped up to be the "future" of computing. Consequently I did want to both try and help others to do so rather than imagine that it was restricted to a kind of "elite". I try to keep the page up to date but so far, to be honest, I do it mostly defensively, to be able to genuinely criticize because I did take the time to try, not reject in block.
PS: I do try also state of the art, both close and open-source, via APIs e.g OpenAI or Mistral but only for evaluation purposes, not as tools part of my daily usage.
From video description:
Reason 1: Gaming Reason 2: Creative Apps Reason 3: Foobar2000 (my music player) Reason 4 (bonus) Fussing, fussing, fussing!
Gaming? Fair point.
Unless it's for games that use shitty anticheat solutions probably not a good reason anymore due to the SteamDeck, a LOT of games do work and it's possible to check before hand via ProtonDB.
So it was a fair point 5 years ago, now most AAA games, including VR games, do work without tinkering.
PineTab 2 works but no WiFi or Bluetooth driver for now. Possible to add a USB dongle or USB-C to Ethernet to install missing apps though then work. Also not super powerful so even though I bet Blender3D works, doubt it'd be pleasant for heavy scenes.
As a shareholder (which I'm not), it's absolutely amazing.
As a human being though... it's simple to look at the history of the company, from its inception based on nepotism and locking-down was hitherto the common good, to going from one place of monopoly (OS, app, cloud) to another (extending to whatever is trendy at the moment e.g XR with HoloLens, AI with OpenAI, etc).
It's IMHO one of the very worst thing that could have happened to humanity in terms of cognitive empowerment. Apple is not far behind but in terms of locking up an entire ecosystem but Microsoft, sadly, is doing it better.
To clarify what I mean is that Microsoft is the business embodiment of learned helplessness. Most people would shrug at the quality of software they provide, the price, etc ONLY because they are convinced, wrongfully so, that they are is no legitimate alternative. If users were actually able to chose, not being coerced into but properly chose, by experiencing alternatives, the World would be totally different. Instead of having computer users who feel an adversarial relationship to their devices, we would have a much stronger relation of "this is MY device" the same way a lot (not all) of people have a repair toolbox at home. They know they can try to fix something in THEIR home, even improve it. Most people understand it won't be easy, they might mess it up, but it's possible to try. Not in software, and that's entirely Microsoft "success". Maybe in an alternative reality others, like Apple, would have made that happen to, but in our reality I blame Microsoft, Bill Gates upbringing from his legal mindset father and well connected mother.
We could have a world were users own their devices, have a challenging yet empowering relationship to technology, starting with software, and instead we have exploitative learning helplnessness. So yes, Microsoft is that bad.
FWIW the "opposite", namely Webseed, exists http://bittorrent.org/beps/bep_0019.html so... maybe some already do but it's not even noticed because Wedseed of mirrors handle the load?
view more: next ›
Very entertaining and on point, thanks for sharing.