manitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 2 years agoDifferent development paths of LLMslemmy.intai.techimagemessage-square16fedilinkarrow-up144arrow-down10file-text
arrow-up144arrow-down1imageDifferent development paths of LLMslemmy.intai.techmanitcor@lemmy.intai.tech to Technology@beehaw.orgEnglish · 2 years agomessage-square16fedilinkfile-text
cross-posted from: https://lemmy.intai.tech/post/5502 cross-posted from: https://lemmy.intai.tech/post/5501 https://www.interconnects.ai/p/llm-development-paths
minus-squareentropicdrift@lemmy.sdf.orglinkfedilinkEnglisharrow-up3·2 years agoAlso of note is RWKV, the only purely RNN structured LLM. I’m keeping an eye on that one because of the theoretically infinite context length
Also of note is RWKV, the only purely RNN structured LLM. I’m keeping an eye on that one because of the theoretically infinite context length