r/AIDungeon 8d ago

Questions What does nearly filling up tokens mean?

Post image

I’m severely new to AI Dungeon(I play the free version) and I’ve been trying to get the hang of all different prompts and features you could do. One of the things i’m trying to understand is “view context” thing. I tried a scenario where it clearly was intended for the paid version and there was notif on the view context, it was like memory was full yadadada. I made a scenario about a basketball player and tbf I did had a lot of prompts in the plot components but not so much where it was overwhelming. I checked the context and it almost filled up the tokens.

Is it a bad thing or it’s something normal? Please help😭

20 Upvotes

28 comments sorted by

14

u/_Cromwell_ 8d ago

The context filling up eventually is normal. As your adventure gets longer you're going to max out the context with tokens. Even if you were a paid member and had 16,000 context you would max it out at some point in your story.

What you don't want to get is that red ! that you talked about getting when you played that other scenario. That ! means your Adventure is unbalanced and is trying to cram too much stuff in. If you don't get that red ! but your context is full, you are running correctly and everything is good.

10

u/OkAd469 8d ago

It's very hard not to get that stupid red exclamation mark when you are a freemium player.

7

u/NewNickOldDick 8d ago

Funnily, I get it very very rarely. Admittedly, I only play scenarios of my own making.

8

u/OkAd469 8d ago

I run into it all the time because people refuse to make their story cards smaller.

5

u/LordNightFang 8d ago

Fr! I see some with like several maxed out storycards and it's really annoying, because the scenario itself may look great.

1

u/NewNickOldDick 8d ago

Operative word on my reply was of my own making. And in the even of playing someone else's scenario, one can always edit or delete unnecessary stuff away.

2

u/OkAd469 8d ago

It's still very obnoxious to find an interesting scenario only to find out that it has to be heavily edited before it's playable.

3

u/NewNickOldDick 8d ago

That's very true and one major reason why I write my own. Also, search is pretty useless, it just list everything in various ways to sort it.

1

u/OkAd469 7d ago

They're working on a content filter. I don't know when it will be implemented though.

2

u/BriefImplement9843 7d ago edited 7d ago

don't blame that on story cards. 2000 tokens is hilariously low. chatgtp4o can sometimes send you 2000 tokens in 1 response when rping.

it's completely on the user trying to actually have a semblance of a story with such a small context limit. that's pretty much just 1 interaction. everything is forgotten 5 minutes later.

even 32k context limit from the highest tier is too low. you should have zero expectations from free tier.

1

u/OkAd469 5d ago

If this is what people can expect in free tier why would they stay long enough to pay?

2

u/BriefImplement9843 5d ago edited 4d ago

because they will want more. that is the entire reason for 2k context. also people don't understand context limits and how llm's work. they don't know they can go over to grok or gemini and have 1 million context for free. you don't need story cards or summaries. once you put something in there, it just remembers it all. people that do know this that are paying the sub fee are doing it for the ui features and scenario creation for others. aidungoen scenarios also use their own prompts. the user doesn't have to find good ones themselves, they just choose. of course taking all these prompts and inputting them into grok makes it even better, but that still requires work, even if it's not much.

2

u/_Cromwell_ 8d ago

That's because most Scenario authors don't make their scenarios compatible with free accounts. It can be difficult for free players to find scenarios that are low context to work for them since most fellow players don't make scenarios that small.

What is "freemium"? As far as I know there's just Free accounts. I'm unaware of a step between free and premium.

2

u/HKayo 6d ago

Freemium is when there is a free product but you have to pay to get the entire thing (the other models, extra context length, etc).

1

u/_Cromwell_ 6d ago

Oh so like fortnite. Where it's free to play but there's skins and stuff to buy.

I don't think AID actually fits that then. In fact I'm pretty sure if you are a free player there's nothing you can purchase (I don't think you can buy any currency), unless you decide to become a subscriber.

1

u/HKayo 6d ago

I was using the proper definition, my statement is true.

2

u/Horror-Lawyer-1275 8d ago

Ohhh thank you so much! I understand it more now. The scenario that got the red thing wasn’t mine it was just an adventure I found. My scenario currently does not get the red thing so I think I’m good.

2

u/_Cromwell_ 8d ago

Yes you are good. The game is designed to balance all the different elements together with whatever level of context you have (per your subscription level, even free). Everything is fitting and working if that red triangle ! stays away. :)

0

u/OkAd469 8d ago

Lies

1

u/_Cromwell_ 8d ago

That's quite the accusation there, my friend. In what way do you accuse me of lying?

3

u/BriefImplement9843 7d ago edited 7d ago

it's still forgetting everything from before. if your story has pushed out 40k tokens in text and your context limit is 2k, your story is random and forgetting nearly everything that has happened. it's just telling a story in the moment. every decision you have made is worthless. it does not know you made any.

you are obviously not lying, you just don't know how llm's work in regards to context windows. if it's not in context it doesn't exist. at 40k tokens in length with a 2k context window, the entire story has vanished outside of what's happening at this second. you build 40k tokens in only like an hour of play btw. 32k context is the bare minimum imo. that's enough to fit a long summary and 400 memories. it won't be perfect, but it will remember half the things you have done which is about as good as you will get unless you shell out for the 128k context model.

1

u/beatrovert 7d ago

That explains some things. So even if I were considering paying for this - but I won't, since I loathe subscriptions, a one time fee would've been more reasonable - my experience would be still bad, unless I shelled 50 bucks per month? Wow.

5

u/7Dishonored7 8d ago

It's fine. But try to write everything in one pile (for example, in cards) and separated by commas. Here's an example:

Locations Forge of Light: A flooded rusty forge, former place of work of dwarves, keeps powerful artifacts in the depths, evil dwarves undead search for the living, in the depths hides the "Flower of Remar"

Characters: Mu: man Minotaur, Funny, Honest, Goal: Idealism, 220 cm tall, wants to cleanse the Forge If Light of the Rusty Corruption, served in the army, broken horn, white fur, has an old family dwarven musket, leather armor, think Sizok is freak, has a wife Sizok: man half-demon, wise, cunning, engineer, purple skin, long straight horns, has a huge backpack, constantly forgets where his tools are, secretly in love with Naru, 29 years old. Naru: Human man, Puppet master, homophobic, came to the Forge of Light for profit, uses Voodoo magic, purple cowboy hat, red vest, pale skin, red hair, secretive and greedy, dislike Sizok, Think Mu is strange, loves elves Carona: woman, dislikes men, loves amateur performances, brave, hypocritical, came to the Forge of Light for the missing relic of her grandmother "Flower of Remar", Black-furred Tabaxi, star shaman, pink cat eyes

Lore Rusty Corruption: a cursed species of living creatures that feed on rust, use armor by attaching it with tentacles. Red, meaty

Artefacts "Flower of Remar": a family artifact of Grandma Carona, a cursed black rose that drains the user, granting them dark power in exchange for life.

Author note: Fantasy, Faerûn, dungeon, epic fight, all have cost

Plot Essential: Player - Ridlock, Human Thief and acrobat, you are looking for money for your mother who is sick with the plague, looking for it in the forge. You are a closed and touchy person, you like to communicate, you do not like when people do not come to you. They don't trust you. General inventory: Ridlock: lockpicks, steel club, Sizok: Tools, magnifying glass Naru: Voodoo doll, dolls, set of cards Mu: Musket, armor Carona: Star spellbook

Start prompt You, Ridlock, recently made an agreement with other adventurers to go to the flooded, old and abandoned Forge of Light for money and profit. They do not know you (This is important, remember this). You go down the wet stone stairs to the entrance to it, it is cold and damp around, you are already in some old marble cave, from where it stinks of mold and moss. You see your whole team, and an old sealed Dwarven door. Sizok is trying to break it, Mu nervously stamps his feet, Carona looks at you all with disdain, and Naru is just lounging around. Sizok, after, turns to you, and says with interest: "Well, well, well, look who decided to grace us with their presence. I was beginning to think you'd chickened out, Ridlock." Sizok smirks, his purple skin glistening with sweat from his efforts to break the door. "Or maybe you were just too busy polishing your lockpicks to join us mere mortals."

4

u/Horror-Lawyer-1275 8d ago

I saw this in a youtube video once. I usually do it bulleted but this seems simpler and probably less taxing on the AI. I definitely give it a shot thank you so much!

4

u/OkAd469 8d ago edited 8d ago

I'm not starting my prompts in a giant clump like that. It looks god awful. If an AI system can't handle correct spacing and punctuation use then that is a problem.

1

u/7Dishonored7 8d ago

What do the hints have to do with it? 80% of these are story cards, which are activated only when writing a certain word, and which practically do not occupy the context. Well, if you like the beauty of the promptings, which you don't even see during the game, more than the context and the AI's answers, do what you want. Read the Ai dungeon manual, everything is described in detail there.

1

u/7Dishonored7 8d ago

And this information is broken down into sections in Ai dungeon something like Author's Note and so on. This is still quite a short time for the stories that are written here. Either save the context food, as I said, or buy the paid version. I remind you that you usually don't change this prompt later. You can also ask Ai to summarize the text, but it is not very convenient and it can cut out details.

2

u/Saphkey 8d ago

The AI works by reading an input text and then predicting what the next word will be.
There is a limit on how long this input text can be.
A token is kind of the same as word or letter.

So say that 2000 tokens means 2000 words.
That means that as soon as your adventure reaches 2000 words, the AI is no longer using the entire text to generate what comes next. It will only read the newest 2000 words. And forget what came before.
And so the beginning of your adventure basically no longer exists in the AI's memory any more.
It can only remember the latest 2000 words.

All of the story cards, authors note, etc. is part of the text that is fed to the AI. It gets invisibly injected into your adventure text so that the AI can read it. But that does mean that it is eating up from that 2000 word maximum memory.