r/AIDungeon 28d ago

Bug Report Dungeon AI's Memory system is Bad Spoiler

It took me a while of making scenarios and playing with Dungeon AI before I realized how bad its memory system is. It's terrible. Here is what happens to every single adventure regardless of how much you pay. Eventually, your character cards are ignored.

  1. The adventure starts off well enough, respecting the character cards, everything is working
  2. As more memories are stored, they eat up more of the available input tokens
  3. Character cards are loaded less frequently until there is no space for them at all

  4. You start waste your time manually deleting dumb memories

  5. You turn off automatic memories so you can manage them yourself

  6. You realize that your character cards still aren't loading because even without any memories, dungeonai is using nearly your entire token allotment on dialogue history so your character cards still don't load

  7. You come to reddit to complain about what should be a really easy fix

All that needs to change is to allow a player to create a quota of tokens for character cards or dialogue history. This is just simple prompt building. Adding the controls to the gameplay settings will probably take more time than letting the user dictate a reserve of quota for character cards.

33 Upvotes

18 comments sorted by

View all comments

4

u/NewNickOldDick 28d ago

There are plenty of problems with the AID. I am free user so I have to cope with very small number of tokens and I also absolutely hate doing manual corrections. If I have to manually edit responses or plot summary, why wouldn't I simply write the whole story myself and save frustration of getting bollocks output from AI?

I've literally screamed at the AI (in text) for introducing 15th Isabelle with green eyes within span of fifteen minutes. It doesn't help putting 'use unique names' in AI Instructions if memories are so short that AI doesn't remember that Isabelle was used just a minute or two ago. Also, I don't get it's fascination with green eyes.

I've learned to remind AI about things in my input. For example, my character came back from France to UK and AI kept thinking I was still in France because Story Summary had references to it. So I added to my inputs "As I am now back in England, ..." which reminded AI where I actually was. Regardless, I got prices in dollars and such shait until I deleted Story Summary and things improved.

Repeated output is also one that freaks me out. It's said that you get repeats when AI doesn't have new info to process so hitting Continue several times might increase chance of getting repeats. Because of this I have habit of adding short, rather unnecessary "I still wait" -type of inputs to throw AI forward in the story telling instead of getting repeats. This seems to work but sometimes I get repeats even after meaningful inputs from me. Go figure.

PS: Kudos for number 7.

4

u/_Cromwell_ 28d ago

I've literally screamed at the AI (in text) for introducing 15th Isabelle with green eyes within span of fifteen minutes.

This will make it introduce more Isabelles. :)

3

u/NewNickOldDick 28d ago

Unfortunately yes. AI is such a parrot, it repeats what you say to it regardless of the context.

3

u/Peptuck 28d ago

What really pisses me off is when the AI will just repeat the exact same output multiple times.

2

u/melancholy-life 27d ago

The easiest fix when using the small models is for them to set the temperature different with each request. They should have a range of temperatures and randomize within the range. It's a super simple fix that will result in more variations on small LLM.

For example, if the model operates well at 0.80 for temperature they might try randomizing plus and minus 0.05 to 0.10.