In the Nature article “Human-like systematic generalization through a meta-learning neural network”, Brenden Lake and I introduced a method that allows modern AI systems for language (such as ChatGPT) to learn “compositionally”, just like children (and humans in general) do. For example, if the network already knows the meaning of “twice”, when it is introduced the new verb “to tiktok”, the network can immediately understand the meaning of the expression “to tiktok twice”. This result had a lot of resonance, generating a wide debate on the nature of learning in humans and machines, and what are the positive and possibly undesirable consequences of similar advancements in AI. Nature published a commentary titled “AI ‘breakthrough’: neural net has human-like ability to generalize language” and Scientific American an article about our work called “New training method helps AI generalize like people do”. Our study had also great resonance in Spain and Catalonia, including a service during the telediario of RTVE, a live interview for the COPE radio and coverage by all the major newspapers (La Vanguardia, El País, Ara, …).
Marco Baroni
Universitat Pompeu Fabra
-
Reference:
– Lake B & Baroni M 2023, ‘Human-like systematic generalization through a meta-learning neural network‘, Nature, 623, 115-121.