Blender Bot 2.0: Open source chatbot that builds long-term memory and searches the internet

Click for: original source

Facebook AI Research has built and open-sourced BlenderBot 2.0, the first chatbot that can simultaneously build long-term memory it can continually access, search the internet for timely information. By Facebook.

A current trend in machine learning models is to concentrate on training ever-larger models, which requires substantial computational resources. Those models attempt to store what they learn in their model weights. But storing the entire internet — which is always growing and changing – would seem to be next to impossible. Our method instead accesses the internet on the fly.

BlenderBot 2.0 uses a model based on Facebook’s Retrieval Augmented Generation — an approach that enables generating dialogue responses that incorporate knowledge beyond that contained in the conversation itself.

During conversation, the model, which combines an information retrieval component with a seq2seq generator, seeks relevant information both in its long-term memory and from documents it finds by searching the internet Very interesting!

[Read More]

Tags bots software web-development machine-learning open-source