## basics https://en.wikipedia.org/wiki/GPT-3

[Real, Live GPT-3 Apps You Can Use](https://www.youtube.com/watch?v=zQLuqOogQnU)

- https://www.theguardian.com/commentisfree/2020/sep/08/robot-wrote-this-article-gpt-3

## [Language Models are Few-Shot Learners](https://arxiv.org/abs/2005.14165)

[GPT-3: Language Models are Few-Shot Learners](https://blog.inten.to/gpt-3-language-models-are-few-shot-learners-a13d1ae8b1f9) Grigory Sapunov

- [OpenAI's GPT-3 may be the biggest thing since bitcoin](https://maraoz.com/2020/07/18/openai-gpt3/) JUL 18, 2020

[review1](https://knowen-production.s3.amazonaws.com/uploads/attachment/file/4674/GPT-3%2BThe%2BNew%2BMighty%2BLanguage%2BModel%2Bfrom%2BOpenAI%2B%2Bby%2BMoiz%2BSaifee%2B%2BMay_%2B2020%2B%2BTowards%2BData%2BScience.pdf)  [review 2](https://knowen-production.s3.amazonaws.com/uploads/attachment/file/4675/GPT-3_%2Ba%2BGiant%2BStep%2Bfor%2BDeep%2BLearning%2Band%2BNLP%2B%2BTowards%2BData%2BScience.pdf)  [review 3](https://knowen-production.s3.amazonaws.com/uploads/attachment/file/4676/GPT-3%2BCreative%2BPotential%2Bof%2BNLP.%2BNew%2BML%2Bmilestone%2Bby%2BOpenAI_E2_80_8A_E2_80_94_E2_80_8Ain%2Baction%2B%2Bby%2BVlad%2BAlex%2B_Merzmensch_%2B%2BJul_%2B2020%2B%2BTowards%2BData%2BScience.pdf)

video [GPT-2: Why Didn't They Release It? - Computerphile](https://www.youtube.com/watch?v=AJxLtdur5fc)

- distillation

[Distilling the Knowledge in a Neural Network](https://arxiv.org/abs/1503.02531)
Geoffrey Hinton, Oriol Vinyals, Jeff Dean

## Applications



[GPT-3 bottleneck is training data | François Chollet and Lex Fridman](https://www.youtube.com/watch?v=UyPMS3Gvdko)

[How MoMA and the CIA Conspired to Use Unwitting Artists to Promote American Propaganda During the Cold War](https://news.artnet.com/art-world/artcurious-cia-art-excerpt-1909623)

## GPT-2

https://github.com/openai/gpt-2

- Words of wisdom from GPT-2

[**GPT-2 is an application that produces novel text based on a text prompt (Here’s how to install it).**](https://lambdalabs.com/blog/run-openais-new-gpt-2-text-generator-code-with-your-gpu/?utm_campaign=Recomendo&utm_medium=email&utm_source=Revue%20newsletter)
Most of what it generates hovers on the border of sense and nonsense. Here are four pieces of advice it has given to me.  — MF

•	“If we cannot make sense of the present, we cannot plan for the future.” 

•	“The more we change to meet the challenges in our lives, not to stay where we are, the more successful we will be.” 

•	“If it is an animal you have seen, do you think it will be like you, too? This is the first statement of my doctrine, that all things are one thing. Do you want me to prove it, or to let it pass?” —Philosopher Epicurus (384-399 A.D.) 

•	“Your gut tells you it’s not right to continue investing in some idea–it’s too risky, because its consequences are hard to understand. Your gut is right about one thing, though: there is no way of knowing it’s not wrong to spend your energy making the best decision for yourself and your goals.”