Transformers sparked an NLP revolution in 2017, yet nothing matched ChatGPT's capabilities unveiled just last year. And now other companies seem capable of replicating this level of AI absent GPT-3 architecture details. Did transformers progress that much, or are unknown advancements propelling the mysterious explosion in language model prowess?
↧