Dec 4, 2024
The ultimate currency of a technology is the number of researchers advancing it and the amount of positive popularity it has. AI has plenty of both. I think diminishing returns from more training data was something everyone working in the field already anticipated (though they expected it would happen sooner than it did) - improvements in algorithms will bridge the gap, as current methods are extremely sample inefficient compared to humans.