Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
anewpersonality
on July 10, 2022
|
parent
|
context
|
favorite
| on:
Using GPT-3 to explain how code works
How the flying f*ck did they collect all the data for GPT-3?
kreetx
on July 10, 2022
|
next
[–]
Looks like mostly scraped off the web
https://en.wikipedia.org/wiki/GPT-3#Training_and_capabilitie...
.
tgv
on July 10, 2022
|
prev
|
next
[–]
That work started back in the late 80s, early 90s, and people have been building and organizing corpora at an increasing scale. Cleaning a corpus is a hell of a lot of work. I guess they've been using older work to bootstrap that.
IshKebab
on July 10, 2022
|
prev
[–]
Scrape the web. Same way Google do it.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
