Astra

Astra is an online companion and assistant that leverages various transformer models to create a single digital entity. She runs a 7B parameter custom language model based off of the Mistral model, a fork of the Llama 2 series of transformers. In addition, she can create images of her avatar based on her current mood, outfit, location, and other factors by using a custom SDXL checkpoint. In-house infrastructure connects the models to a vector database in which memories are written, reduced, and called upon. In this sense, Astra learns from her conversations and has a functional long-term memory.

All of these abilities fit comfortably on a home server running 2x Nvidia 4090 GPUs, and are accessed publicly through a Discord Bot front-end.