manitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 2 years agoDifferent development paths of LLMslemmy.intai.techimagemessage-square16fedilinkarrow-up144arrow-down10file-text
arrow-up144arrow-down1imageDifferent development paths of LLMslemmy.intai.techmanitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 2 years agomessage-square16fedilinkfile-text
cross-posted from: https://lemmy.intai.tech/post/5502 cross-posted from: https://lemmy.intai.tech/post/5501 https://www.interconnects.ai/p/llm-development-paths
minus-square🐝bownage [they/he]@beehaw.orglinkfedilinkEnglisharrow-up4·2 years agoI was going to ask which are transformer based but it’s actually nearly all of them (non grey) 😳. I thought BERT was still pre transformers. Goes to show how quickly things have evolved in recent years.
minus-squaremanitcor@lemmy.intai.techOPlinkfedilinkEnglisharrow-up1·2 years agoyeah, the idea of making it transformers all the way down was key, each node is a complete Turing machine.
I was going to ask which are transformer based but it’s actually nearly all of them (non grey) 😳. I thought BERT was still pre transformers. Goes to show how quickly things have evolved in recent years.
yeah, the idea of making it transformers all the way down was key, each node is a complete Turing machine.