From 2ce26c057644faa0637e09afa51516b1dc39a9e6 Mon Sep 17 00:00:00 2001 From: Souradeep Nanda Date: Wed, 12 Jun 2024 10:25:47 -0500 Subject: [PATCH 1/2] The Bitter Lesson --- README.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/README.md b/README.md index 1325839..1a24b19 100644 --- a/README.md +++ b/README.md @@ -52,6 +52,7 @@ Like this project? Please considering [sponsoring me](https://github.com/sponsor * [The Two Pizza Rule](#the-two-pizza-rule) * [Wadler's Law](#wadlers-law) * [Wheaton's Law](#wheatons-law) + * [The Bitter Lesson](#the-bitter-lesson) * [Principles](#principles) * [All Models Are Wrong (George Box's Law)](#all-models-are-wrong-george-boxs-law) * [Chesterton's Fence](#chestertons-fence) @@ -714,6 +715,17 @@ See also: Coined by Wil Wheaton (Star Trek: The Next Generation, The Big Bang Theory), this simple, concise, and powerful law aims for an increase in harmony and respect within a professional organization. It can be applied when speaking with coworkers, performing code reviews, countering other points of view, critiquing, and in general, most professional interactions humans have with each other. +### The Bitter Lesson + +[PDF](https://www.cs.utexas.edu/~eunsol/courses/data/bitter_lesson.pdf) +[HTML](http://www.incompleteideas.net/IncIdeas/BitterLesson.html) + +> The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. +> +> Rich Sutton (2019) + +Scale, in terms of both data and computational power, has driven the most significant advancements in AI research, rather than the intricacies of the research methods themselves. + ## Principles Principles are generally more likely to be guidelines relating to design. From a97981e73580730341055528f78d404d45c8ff08 Mon Sep 17 00:00:00 2001 From: Souradeep Nanda Date: Wed, 12 Jun 2024 10:29:07 -0500 Subject: [PATCH 2/2] Add twitter handle of author --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 1a24b19..f81a497 100644 --- a/README.md +++ b/README.md @@ -724,7 +724,7 @@ Coined by Wil Wheaton (Star Trek: The Next Generation, The Big Bang Theory), thi > > Rich Sutton (2019) -Scale, in terms of both data and computational power, has driven the most significant advancements in AI research, rather than the intricacies of the research methods themselves. +The bitter lesson by [Rich Sutton](https://x.com/richardssutton) says that scale, in terms of both data and computational power, has driven the most significant advancements in AI research, rather than the intricacies of the research methods themselves. ## Principles