Jan 14, 2024
Hi Ignacio,
Yeah - for memory and continuity Mamba or something like it is key.
OpenAI's Logan has tweeted recently that ChatGPT will have memory features and be able to learn over time.
He did not say what the tech behind it is, but it would not be suprising if the Mamba authors shared their ideas directly with OpenAI and others.
Thanks for the article!