DEMO. ANALYZE. DOCUMENT. REPEAT.
I read something somewhere about how transformers (like GPT3) could be used for object detection/classification (like AlexNet). Interesting. That got me to thinking about looking for similarities / correspondence between
AlexNet (docx 438c-2_ALEXNET; this post text is in ch 2d) and
GPT3 (docx 438c_gpt3_decoded)
Both docx’s are on the gdrive.
This chapter describes my ideas (I am not sure that they are correct, but in any case interesting). I have not seen such an analysis anywhere else. This comparison suggests that AI algorithms are pretty universal in the artificial “intelligence” world.
Contents:
0 Pixels <> Tokens
1 # of pixels <> # of tokens
2 Pixel channels <> Token dimensions
3 Diagram summarizing comparison of CNN Detection <> LLM Transforms
4 Convolution filter <> Attention QKV
5 # convolution filters <> # token dimensions
6 Pool <> FFN
7 Detection pipeline <> LLM pipeline
8 Using transformers for image detection (why not?)
9 AI can not do such an analysis as this
0 Pixels <> Tokens
1 # of pixels <> # of tokens
2 Pixel channels <> Token dimensions
3 Diagram summarizing comparison of CNN Detection <> LLM Transforms
NOTE: Diagram of GPT3 pipeline (from docx 438c https://drive.google.com/drive/folders/1-Adawag9uA8_bq-hDF-nOuPYaRLz1eEO )
4 Convolution <> Attention QKV
5 # convolution filters <> # token dimensions
6 Pool <> FFN
7 Detection pipeline <> LLM pipeline
8 Using transformers for image detection (why not?)
I read something somewhere about how transformers (like GPT3) could be used for object detection/classification (like AlexNet). I think that perhaps this section showed valid comparisons. I think many AI algorithms are variations on a them. Its all matrix math.
9 AI can not do such an analysis as this
Took me about a day of intense thinking to come up with the content of this section. Original thought. Something that AI will never be able to do.
I really appreciate Roger Penrose’s opinions about AI. A brilliant physicist who straight talks with no hype. ‘Artificial Intelligence is a misnomer’ - Sir Roger Penrose youtube.com/watch?v=2aiGybCeqgI.
DEMO. ANALYZE. DOCUMENT. REPEAT.