189
this post was submitted on 16 May 2024
189 points (100.0% liked)
Technology
37360 readers
172 users here now
Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Awesome. Truly spectacular.
Generative AI is so energy intensive ($$$), that Google is requiring users subscribe to Gemini.
Google is entirely dependent on advertising sales. Ad revenue subsidizes literally everything else, from Android development to whichever 8-12 products and services they launch and subsequently cancel each year.
Now, Google wants to remove web results and just use generative AI instead of search as it's default user interface.
So, like I said: Awesome.
While I agree in principle, one thing I’d like to clarify is that TRAINING is super energy intensive, once the network is trained, it’s more or less static. Actually using the network isn’t dramatically more energy than any other indexed database lookup.
Training will never stop, tho.
New models will keep coming out, datasets and parameters are going to change.
I firmly believe it will slow down significantly. My prediction for the future is that there will be a much bigger focus on a few “base” models that will be tweaked slightly for different roles, rather than “from the ground up” retraining like we see now. The industry is already starting to move in that direction.