Rich Sutton warned that computational scale ultimately outperforms human expertise.
Does his "bitter lesson" hold true when reproducing our own custom methods with LLMs?
We find: the bitter lesson is sometimes sweet, sometimes bitter, and sometimes inapplicable.
deep-culture.org/the-occasion...
