With every message board we find, I can't shake the feeling that this is just the tip of the iceberg.
It's only possible to get away with this because we have anthropomorphised the models to a certain extent. We can pretend they hold the responsibility. instead of the people executing them.
Have not benchmarked it, the intent is mostly to save time, not necessarily tokens. I noticed that the models need a lot of toolcalls to ground themselves, and often have trouble with getting an overview.
I can't be the only one that is getting tired of this.
Framing learning from observation as somehow bad. Something literally everybody is doing, model and human alike. It's the process this whole industry is built on. Pretending that this is bad because the other people are also doing what you have been doing, is hypocritical and childish.
Meanwhile I'm sitting here looking at some "Flibbertigittering" spinner like some sort of caveman, unable to steer the model when it misinterprets my ambigious prompt because I'm not allowed to see 80% of the output tokens I'm paying for.
This is the first I'm hearing of a model provider just providing a different model without telling you. Anthropic came close (and with a much better justification) but they disclosed their intention at least.
> Framing learning from observation as somehow bad.
How about hacking accounts, using stolen credit cards, and sending data to the US silently?
> Pretending that this is bad
It is. This makes AI a 2 horse race because European labs cannot legally compete. I find it strange that people from EU cheer for that, it prevents you from having frontier level AI sovereignty.
You just need to work your way down to a deeper layer in the https://en.wikipedia.org/wiki/Matrioshka_brain Not the deepest layer. Humans would fry instantly there. But, the warm glow of the third layer down upon the fourth is quite pleasant.
While initially a perpetual right to copying for some publishers, copyright was made into what it is today to "promote creation". Funnily enough it's used in the exactly opposite way. Culture is basically frozen, same movie and same music released every week.
The fields where creativity flows the most seem to me the ones furthest away from copyright. FOSS and memes come to mind.
What matters is who made something, regardless of who copied it. I think that in a ocean of AI generated content, this will become more and more important. Platforms like patreon and kofi show that people care about creators and are willing to support without 'buying a copy'
Games are another big area where distance to copyright seems to be where the innovation is occurring. So many of the big genres of games and ultimately the "game" that started the genre begun as a mod of another game. Counterstrike from half life, the myriad of factory games from modded minecraft, Arma and DayZ spawned the survival genre and further Arma mods formed the idea of PubG as well. In sim racing mods to Assetto Corsa have influenced the successor title of Competizone which chose GT3 cars since they were the most popular online. Then the modders on AC made long journey driving modifications and this has now influenced the upcoming Evo. There are probably many more examples from Skyrim or other FPS games of ideas born first by modders.
A lot of these mods break copyright of original material but with it they create an entire genre of games far outweighing the value of the initial piece of copyright.
Why are we framing this as "the fight against climate change"? This framing puts the culprit outside of ourselves, as if it's some external force.
I feel that way of looking at it makes changing impossible. It's our own behaviours and systems that will have to change. There's nothing to fight here, the answer instead lies in collaboration.
Great point. For example, we should encourage collaboration between people building hyperscale data centers, and people not building hyperscale data centers to find some middle ground that is good for the planet.
Collaboration implies we are all on the same side. Reality suggests some people have made it their business to be on the wrong side.
Right now? Nobody is using the hypothetical un-built datacenters that threaten to tax our planet. All the current individual LLM demand is being met by what exists already, yet we're seeing unprecedented amounts of money being spent at the cost of the environment to build out at scale. This is so that jobs that currently earn people money can be replaced with LLMs that earn investors money. Something only the investors want.
It's only possible to get away with this because we have anthropomorphised the models to a certain extent. We can pretend they hold the responsibility. instead of the people executing them.
reply