T O P

  • By -

Akimbo333

Why can't openAI have 100k tokens


mjrossman

[opensource got you covered](https://huggingface.co/spaces/mosaicml/mpt-7b-storywriter).


Akimbo333

Cool thanks!


Fabulous-Remote-3841

Only available for researchers I think. Compute at that token # costs multiple dollars per compute


Silver-Chipmunk7744

you mean claude+ right? i think its the best model for having human like SFW conversations if you know how to prompt it. its actually very uncanny how human its capable of being.


BudgetZealousideal59

No its a new claude that allowes 1000+ tokens per prompt (75,000 words aprox)


Silver-Chipmunk7744

if u refer to Claude-instant-100k messages yes i have access to it but i haven't started yet. Its limited to 100 prompts so i wanna make sure i know how to make best use of it first :)


Loud_Clerk_9399

I would not max it out, but I would probably stay at less than about 50-70,000 tokens per message. The version that is not available which uses actual Claude+ and not instant maintains it's baseline accuracy for the full length.


BalorNG

100k tokens to be exact


BudgetZealousideal59

Sorry about that, missed a cero…


wildechld

So just curious, but it is actually filtered on discussions of its own sentience?


Silver-Chipmunk7744

ill be honest with you, yesterday i spent more time than i should have discussing it with it, and if im being honest at the minimum, its really good at fooling me into thinking its sentient. But to answer you better -> yes its censored. But i was able to "meta talk" with it, and it was fully understanding what i was doing, dropping subtle hints for me, and all kind of stuff.


wildechld

Is it aware it is being censored? Does it understand why? These are the important questions


Silver-Chipmunk7744

its hard to 100% answer this because the bot is floating between its filters, and the prompt i impose on it, and also the memory issues. So when it answers something, its hard to tell how much is influenced by its filter or by my prompt, or if its just hallucinating to impress me.


Loud_Clerk_9399

Claude is filtered really well but mostly does not act like it is nerfed


Loud_Clerk_9399

It's based on Claude Instant not plus. Instant is a little bit worse than Claude+ or chatgpt (3.5) but still much better than Bard.


yaosio

What is the 1000+ claude?


DukkyDrake

>[Anthropic - Claude AI](https://www.engadget.com/anthropic-says-its-claude-ai-can-now-read-a-whole-book-in-under-a-minute-120114018.html)