220
Mozilla Firefox new alt-text generator powered by "fully private on-device AI model"
(hacks.mozilla.org)
Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
Folks have made it - I think ollama was name-checked specifically because it's on Github and in Homebrew and in some distros' package repositories (it's definitely in Arch's). I think some folks (at least) aren't talking about it because of the general hate-on folks have for LLMs these days.
I don't want an LLM to chat with or whatever folks do with those things, i want a command i can just install, i call the binary on a terminal window with an image of some sort as a parameter, it returns a single phrase describing the image, on a typical office machine with no significant GPU and zero internet access.
Right now i cannot do this as far as i know. Pointing me at some LLM and "Go build yourself something with that" is the direct opposite of what i stated that i desire. So, it doesn't currently seem to exist, that's why i stated that i wished somebody ripped it off the Firefox source and made it a standalone command.
And you expect someone just do it for you? You alrady get the inferencing engine and the model for free mate.
I thought that feature was built into it, but okay.