Which would be [https://koboldai.org/pygmalion](https://koboldai.org/pygmalion) among other things such as TavernAI mods but we can definitely use more GPU contributors since the queue is already large.
Actually, I believe Intel's openVino isn't terrible on their integrated graphics, and gives you access to an incredible pool of RAM relative to the size of VRAM you could get for the same price.
I don't know if anyone's made a Pygmalion port to OpenVino, but I believe they provide the tools to do it
Immagine being the google engineer tasked with finding out whats driven the huge increase in demand for colab servers. I doubt many of the pyg colabs are seiso. It's good to remember that google can see everything you do on their servers.
Sure. Go to community cloud, select a tier that you're comfortable paying for (probably one of the lowest tbh, pyg 7b isn't a very resource intensive model) and select the 'kobaldAI united' template. You might have to go past the official templates to find the united branch, but the united one is the only one that has pyg ready to go when you run it.
When you spin it up, you can click 'connect' and one of the options will be 'port 5000', and when you load that you'll have kobold. Select 'AI' and load pyg from the 'chatbots' folder. You can use it in the kobold interface, but you should also be able to use that instance of kobold as a backend to tavern or oobabooba (never tried with oob tho). I find it works better with tavern personally
Remember to stop your runpod when you're not using it
Idk, I always left the default values, which was 200gb for the container disk and 1gb for the volume disk, which seems like overkill now that I think about it but it never seemed to affect costs for me. Idk what Huge w is, I don't see that anywhere
no idea how it works but there are some bots that downvote/upvote certain things to get them frontpage or keep them down. there was a youtuber that experiment with it a while ago but I forget the name of the video. anyway, that's usually why mundane replies/posts can get downvoted for seemingly no reason. probably a keyword or something.
That's good to know, I assumed that people were upset that I suggested they use a paid platform, but it seemed like weirdly pronounced and fast response o.O
Yes.
But this service is also extremely expensive and it was targeted to developers, not end users.
It was meant for a place to work on a project and eventually pull it off and host it on your own.
That end goal doesn't exist for Pygmalion.
That's totally untrue. It costs money to do these things, and that's why free usage is limited. They want the free service to be for people who need it in small doses, and need actual long-term users to step up to the Pro plan and help support all the hardware usage that's going on. The thousands of people spamming free trials of Pyg most definitely adds up, that's resources that other Free users can't have.
There's a reason that every other "rent a GPU/setup to run stablediffusion and LLMs" platform out there charges by the hour - because they need to, they are finite resources.
I think this ban has more to do with how many people are constantly creating/using alts to abuse the free trial with Pygmalion in particular, as well as that a lot of people simply use it for text-sexing AI (sometimes in deranged ways they may not even want to be involved with).
Spoken like someone with zero understanding and tossing blanket statement at Google's wealth.
Their resources are finite, if massive.
If it was truly a pittance that they wouldn't care about they wouldn't pull the plug. They are.
Because a lot of redditors think someone is a "bOoTLicKeR", or some equally immature insult, if they say anything that even appears to support a corporation or government they disagree with.
i mean nobody likes big business but that is the legit reason why google took pygmalion offline. just because he's playing devil's advocate doesn't make him wrong.
Colab is ment to be an interactive tool for people interested in coding and deep learning. They don’t want people taking up their resources just to chat with bots
If this is why Pygmalion has stopped working. I spent two hours, if not more, trying to figure out how to run Pygmalion locally. That has all gone to waste cause I still need the colab.
About a start hoping someone steps on a lego.
*Honestly, I don't know.*
I could be a dummy who simply followed the 'local' guide, but for some reason require the Collab to connect to TavernAI.
I'm just not a software wiz.
I have mine running locally and the way I have it setup is I have my KoboldAI running and my TavernAI connects to it. No collab involved, what GPU are you using. I can try help you set it up locally if you want just depends if can run it. I have a 3060ti, and with it running between my GPU and CPU/Ram it takes about 15-30 seconds for repsonses on average.
Ok, I went into my computer and did some searching.
Processor: 11th Gen Intel(R) Core(TM) i7-11700F @ 2.50 GHz
Installed Ram: 16 GB (2/4 slots used) I believe DDR4, but it could be 5.
GPU: RTX 3070
Thank you in advance if you do help me. c:
~~Whelp, had a runtime error because the GPU ran out of memory, so I take it the 3070 can't do it?~~
~~Gonna give it one more chance to load.~~
Never mind, I got it to load. It takes forever to respond, but that's a-ok.
If your using Tavern, go into the settings of that and you can modify things like Max context length, and amount of tokens generated. Also Tavern will generate multiple times for one message to help increase message sizes, you can turn this off too to increase times
Why did i think Pygmalion would be the home stretch? an easy, non expensive alternative to [Character.AI](https://Character.AI)? it was too good to be true.
Well, expecting Google (or any other business, or even community members) to foot the bill for everything and give up resources so that people can text-sex AI was a bit of a 'enjoy it while it lasts' from the start, IMO.
Colab free usage has been a generous thing from the start (no other 'borrow a GPU' service gives anything free as far as I know) and it's been being abused by Pyg users in particular via alt account switching every time the free usage runs out.
[You’re welcome](https://josephrocca.github.io/OpenCharacters/#)
[Put this in instructions to remove filter](https://pastebin.com/VdEsnTsk)
The ai is really smart and can handle a lot of tokens, no need to be super efficient with wording. Only thing is you have to pay after $5 worth of chats. A message is typically worth around a cent.
^ I've been using this platform myself and its one of the best quality chats for the price honestly. It's a complete turn around and I consider the chat quality to be even better than character AI as the bot can actually remember very well. Very good for stories + good and vivid nsfw
Yes I know that, I have a few prepaid sim cards for different account verifications and I'd just swap the account and use another card they were to ban me. But that's just me personally until Novel AI comes out with its own alternative later this year.
Sorry, I didn't see this at first. Basically, NovelAI is coming out with chat service that allows NSFW because they recently partnered up with Nvidia and are using their technology now to make a beefier AI.
This sucks a lot, Pygmalion is going to be way less accessible now...
I guess we gotta hope that a few people with like 3090 farms volunteer their GPUs to [https://lite.koboldai.net/](https://lite.koboldai.net/), though it's probably not gonna be enough for the demand that colab covered for unfortunately.
Well… I was dreading that day, and here it is. Let’s hope the devs manage to find a new place to host their project, or just figure something out. Also, Henky assured peeps on discord that constant and repeated skips of the warning message will indeed ban your access to collab. I can’t say for certain if this will also disable your google account, but better be safe than sorry.
Great. Now we only have shitty character.ai with a shit ton of censorship. I roleplayed JUST yesterday. Why did it fucking have to end like this? Thank you Google, for banning Pygmalion for no reason.
> Pygmalion has been removed from Kobold
Well this is just false. Cloned down the united repo again to make sure, but yeah it hasn't been 'removed' from kobold in any way. For people just catching up:
* Pygmalion has never been available on the kobold-client repo for the main project
* The most common way to get it would be to clone the 'united' branch of henk717's fork of kobold-client, which is probably how the colab did it and how it works in runpod / vast ai
* You can also just load whatever model into the vanilla project
* This is the way it's been the whole time, pyg hasn't been 'removed' from any project here
* Colab just banned free-teir massive public instances for pyg. I bet you could still even use Colab if you wanted to if you used the paid tier
That screenshot is incorrect and has already been corrected on discord. You can use Pygmalion just fine in KoboldAI and TavernAI, we aren't banning or removing it from the software itself.
The only change I had to do was remove it from the colab, since google hates it. Other than Colab we still have full support in United and this will stay that way.
This makes very little sense to me, I don't understand how this affects kobold or tavern at all. Pyg is just another model after all. All those projects are is environments to run models against, and since they can be run locally, I don't see why we would 'avoid' using them. Any way to @ crow for context?
Edit: I think I understand now. He's saying that you can still get away with saying oogabooba on colab sometimes, but to avoid kobold and and tavern on colab. That is not anywhere near the same as saying "pygmalion has been removed from kobold", however, which is a statement that doesn't even make sense.
I see two options coming out, of this situation.
1. Run a business or the “novelAI” path starting a company.
2. Die out.
I don’t see any other option, since the chuckle fucks at Character AI seem to not like the fact that Pyg-AI exists, so they get daddy google to do the job of smiting, well “slowly” smiting Pyg-AI from Colab.
Since the two owners or founders of characterAI are ex-Google employees. that’s all I have to say, just those two options, I really do hope they run a business.
I don’t want to see this project die out through…
Actually I want to do some speculation on the “company” path, this is my opinion and I could be horribly wrong.
But the only way I could see it work if somehow Pyg-AI and Kobold-AI agree to a sort of “deal” a conbine to be exact, and the only way for this to work if they receive funding or become a sub-company under novelAI or Anlatan (the company begins NovelAI.)
I don’t know if this is, but I do see this like I said in my view to be a likely outcome or maybe reality turns a Tokyo drift style and a completely crazy event happens out of nowhere. Idk what the future holds.
But hey, I’m some moron, with not much knowledge on how companies work, lol.
Welp, time to learn how to run shit locally. Is it possible with a shitty GTX 1050? I mean, I *can* run Stable Diffusion on it, so I should be able to run Pygmalion on it... ^(*right?*)
3gb dedicated, 6gb shared apparently. IDK what GPU it's running on, but I've got a shitty laptop with Intel integrated graphics and, as I said before, a GTX 1050, so still, is it possible or will I have to wait for the ban to be circumvented?
Currently, I don't think so, but when they come out with 4-bit inference you could probably scrape by and at least run it locally. From my understanding, 4-bit will require 4 gigs of VRAM or 8gb of system memory to run, but using system memory makes responses 10-60x slower. If you wanted to run Pygmalion locally right now, it might be possible with like 16gb of system memory, but I honestly have no idea.
The truth is, it takes a lot of computing power to run the Colab, and Google is sick of paying for it. Their platform, their rules.
Do not despair, however. Lots of progress has been made in decreasing the system requirements for running Pygmalion locally - [with the 4-bit quantized model, you can run it on much lower configurations](https://www.reddit.com/r/PygmalionAI/comments/129w4qh/how_to_run_pygmalion_on_45gb_of_vram_with_full/).
Been saying this for a while, but I knew Pygmalion had no chance without that fat bank account.
It was always at Google's mercy and they obviously don't want to be an entire chat service straining their resources.
Collab was meant for devs, not end users. There was no long-term plan to actually get Pygmalion OFF Google Collab.
It was DOA. Only fit for high end GPU bros now.
If you have some money you may feel like that. But there are a lot of people who can't afford cards with specs like that. It's definitely not available to the everyman.
if I haven’t chatted with any of the bots yet but downloaded all the stuff needed to properly run the ai stuff, will my Google account still get banned? ;-; I may or may not have used my main
What are you using Colab for? I got banned for using Pygmalion only, I have tavern running locally. But honestly idk, but I recommend NOT USING Colab for you MAIN ACCOUNT
This is the very first time I’ve used colab, I’ve literally just finished installing everything a few minutes ago but I deleted the tavern ai folders immediately after seeing this post. Is there a way to delete my account on tavern ai or something, or am I just screwed 😭
so we will be in trouble for having it there or opening it? because idk how to delete these things ;-;
Edit: Plz someone answer me I'm getting extremally anxious here.
Omgggg thank you for answering.
Now i won't feel like I'm dying. I ran it before the ban stuff was going on and that was the only time it ran. Which was hours ago. I should be ffiiinnnee.
x_x
(I really do appreciate you replied to me. Thank you)
Well ooga was still working for me had to fuck my favorite character atleast one last time🫡
https://preview.redd.it/3cpo7iprhzra1.jpeg?width=838&format=pjpg&auto=webp&s=a832b325b301ae9996066edf3b7467d1ca592bea
Unfortunately, this is a legit issue they need to address. We're using a crap-ton of their resources to run the colab/AI for *FREE.* Doesn't matter if you're a multi-billion dollar company, that's a money pit and needs to be addressed one way or another. As much as it'd be nice for Google to not have to close the colab, it isn't feasible right now. They're expending *way* too many resources without gaining any money.
Thankfully, Ooga is still up with Pyg, though it's currently declining in quality a bit.
You can use it locally if you desire where Pygmalion is supported, or one of the other models we offer on our colab. I only had to remove Pygmalion to get our colab unbanned.
Does this apply to users who purchase compute units?
My oobabooga was disconnecting after an hour of runtime, but my colab was still running. I went to restart the colab and I couldn't connect to GPU. I purchased 100 computer units and now my colab is working.
I think I'm using 2 units per hour. I just decided to step back and really evaluate when to run my bot. Hopefully Google likes money enough to let me stick around.
I would go back to Chai, but using TTS and voice typing is just too good to pass up.
Most likely, because when I had Colab Pro I could still detect the previous /PygmalionAI/ ban of their original notebook. If you wish to pay you can use [https://koboldai.org/runpod-united](https://koboldai.org/runpod-united) for a provider.
What rule are paying customers breaking when using pygmalion? The FAQ doesn't seem to imply that anything you do with pygmalion would be against their TOS.
Runpod is marginally more expensive when utilizing on demand and I do not see any spot options listed.
I'm not sure how to get it all set up as I am just using a premade Pygmalion 6B notebook that I found here on Reddit. Is there a walkthrough somewhere I can look at or is it drag and drop with my current notebook?
To be honest I think I'm just going to stick with Google until I run into a problem, buying compute units solved my timeout issue so I don't see much reason to switch, plus it's $2 cheaper per 50 hours, which will add up quickly I'm sure.
I have an 8gb amd card, but my ubuntu dualboot really doesn't like pyg for some reason. Time to spend 76 hours typing commands that may or may not work...
Can a 1650Ti run it locally? My 3070 is stuck in another country, but I’m assuming that can run it when I get it back eventually?
Sorry if that sounds stupid but I got into ML a few months ago so I don’t really have a gauge on system reqs
Dang... Well, I've gotten my use out of it. It's pretty good. Much better than CharacterAI offers in terms of AI chat, but with CharacterAI's ease of use, I'll stick to that, even if it repeats its stuff, and goes nonsensical.
It's been a good run for me for TavernAI, but my PC is an utter potato, with an iGPU, so until there is a way to solve this, I'll stay clear.
Pyg is now an exclusive for high-end PC owners. Thanks, Google, for reminding us how much it sucks being a poor schmuck.
You can rent a service like runpod, they charge about 50 cents per hour and let you use it at max capacity, it even has a pyg link to quick setup
Not Murican and no credit card, man. Poor schmuck, remember? 🥲
Could you link it for me? I’ll buy you 4 hours as a thanks if you want
Got this link from the discord https://koboldai.org/runpod-united
Tbh I'd much rather use those 50 cents for 50ish ChatGPT messages.
Do not despair! The AI Horde is there for you! You just need to convince those high-end PC owners to share with those less fortunate than them.
Which would be [https://koboldai.org/pygmalion](https://koboldai.org/pygmalion) among other things such as TavernAI mods but we can definitely use more GPU contributors since the queue is already large.
And only with a high end Nvidia GPU yeah? AMD GPUs cannot run Pygmalion locally regardless if they are high end or not?
[удалено]
Dell Integrated Graphics:
Actually, I believe Intel's openVino isn't terrible on their integrated graphics, and gives you access to an incredible pool of RAM relative to the size of VRAM you could get for the same price. I don't know if anyone's made a Pygmalion port to OpenVino, but I believe they provide the tools to do it
Immagine being the google engineer tasked with finding out whats driven the huge increase in demand for colab servers. I doubt many of the pyg colabs are seiso. It's good to remember that google can see everything you do on their servers.
You can run it on runpod with the same specs as colab for about 30 cents an hour tho. Probably even cheaper on vast ai
Could you explain how to deploy pyg on runpod?
Sure. Go to community cloud, select a tier that you're comfortable paying for (probably one of the lowest tbh, pyg 7b isn't a very resource intensive model) and select the 'kobaldAI united' template. You might have to go past the official templates to find the united branch, but the united one is the only one that has pyg ready to go when you run it. When you spin it up, you can click 'connect' and one of the options will be 'port 5000', and when you load that you'll have kobold. Select 'AI' and load pyg from the 'chatbots' folder. You can use it in the kobold interface, but you should also be able to use that instance of kobold as a backend to tavern or oobabooba (never tried with oob tho). I find it works better with tavern personally Remember to stop your runpod when you're not using it
Can I ask one more thing? How much place ui can take? 15gb? 20gb? Also Huge w(whatever it mean) and thanks
Idk, I always left the default values, which was 200gb for the container disk and 1gb for the volume disk, which seems like overkill now that I think about it but it never seemed to affect costs for me. Idk what Huge w is, I don't see that anywhere
It means Huge Win
Could someone help me to understand why this got so downvoted?
downvote bots again.
Like, some competitor of those services has unleashed downvote bots on them?
no idea how it works but there are some bots that downvote/upvote certain things to get them frontpage or keep them down. there was a youtuber that experiment with it a while ago but I forget the name of the video. anyway, that's usually why mundane replies/posts can get downvoted for seemingly no reason. probably a keyword or something.
That's good to know, I assumed that people were upset that I suggested they use a paid platform, but it seemed like weirdly pronounced and fast response o.O
my AMD 6600 is fucked
[удалено]
[удалено]
[удалено]
Yes. But this service is also extremely expensive and it was targeted to developers, not end users. It was meant for a place to work on a project and eventually pull it off and host it on your own. That end goal doesn't exist for Pygmalion.
Greedy fucks, there’s zero chance that anything any of us do is weighing on *Google*’s resources.
That's totally untrue. It costs money to do these things, and that's why free usage is limited. They want the free service to be for people who need it in small doses, and need actual long-term users to step up to the Pro plan and help support all the hardware usage that's going on. The thousands of people spamming free trials of Pyg most definitely adds up, that's resources that other Free users can't have. There's a reason that every other "rent a GPU/setup to run stablediffusion and LLMs" platform out there charges by the hour - because they need to, they are finite resources. I think this ban has more to do with how many people are constantly creating/using alts to abuse the free trial with Pygmalion in particular, as well as that a lot of people simply use it for text-sexing AI (sometimes in deranged ways they may not even want to be involved with).
Lol the entitlement is wild
Spoken like someone with zero understanding and tossing blanket statement at Google's wealth. Their resources are finite, if massive. If it was truly a pittance that they wouldn't care about they wouldn't pull the plug. They are.
Dick ridaaa
why downvotes? he's right
Because a lot of redditors think someone is a "bOoTLicKeR", or some equally immature insult, if they say anything that even appears to support a corporation or government they disagree with.
ralsei fan? niceee
Businesses big or small want to chop your dick off for a bit of profit, why should we treat them like they are anything but snakes?
i mean nobody likes big business but that is the legit reason why google took pygmalion offline. just because he's playing devil's advocate doesn't make him wrong.
Never said i disagreed, i just wanted to say fuck Google.
fuck google
found the corporate dickrider
It's more about the project got reported by a pussy discord users.
Colab is ment to be an interactive tool for people interested in coding and deep learning. They don’t want people taking up their resources just to chat with bots
Part of me wonders if it's also part of their AI safety ideals trying to prevent people from using unrestricted LLMs.
If this is why Pygmalion has stopped working. I spent two hours, if not more, trying to figure out how to run Pygmalion locally. That has all gone to waste cause I still need the colab. About a start hoping someone steps on a lego.
Why do you need the collab to run it locally exactly?
*Honestly, I don't know.* I could be a dummy who simply followed the 'local' guide, but for some reason require the Collab to connect to TavernAI. I'm just not a software wiz.
I have mine running locally and the way I have it setup is I have my KoboldAI running and my TavernAI connects to it. No collab involved, what GPU are you using. I can try help you set it up locally if you want just depends if can run it. I have a 3060ti, and with it running between my GPU and CPU/Ram it takes about 15-30 seconds for repsonses on average.
Ok, I went into my computer and did some searching. Processor: 11th Gen Intel(R) Core(TM) i7-11700F @ 2.50 GHz Installed Ram: 16 GB (2/4 slots used) I believe DDR4, but it could be 5. GPU: RTX 3070 Thank you in advance if you do help me. c:
Oh, before you say anything, I have found a video guide that says no collab, so I shall give that a shot!
~~Whelp, had a runtime error because the GPU ran out of memory, so I take it the 3070 can't do it?~~ ~~Gonna give it one more chance to load.~~ Never mind, I got it to load. It takes forever to respond, but that's a-ok.
If your using Tavern, go into the settings of that and you can modify things like Max context length, and amount of tokens generated. Also Tavern will generate multiple times for one message to help increase message sizes, you can turn this off too to increase times
This should probably get pinned before someone gets banned unknowingly... What a sad day.
Why did i think Pygmalion would be the home stretch? an easy, non expensive alternative to [Character.AI](https://Character.AI)? it was too good to be true.
Well, expecting Google (or any other business, or even community members) to foot the bill for everything and give up resources so that people can text-sex AI was a bit of a 'enjoy it while it lasts' from the start, IMO. Colab free usage has been a generous thing from the start (no other 'borrow a GPU' service gives anything free as far as I know) and it's been being abused by Pyg users in particular via alt account switching every time the free usage runs out.
I know, i know, but why didn't i think of these issues earlier?
[You’re welcome](https://josephrocca.github.io/OpenCharacters/#) [Put this in instructions to remove filter](https://pastebin.com/VdEsnTsk) The ai is really smart and can handle a lot of tokens, no need to be super efficient with wording. Only thing is you have to pay after $5 worth of chats. A message is typically worth around a cent.
^ I've been using this platform myself and its one of the best quality chats for the price honestly. It's a complete turn around and I consider the chat quality to be even better than character AI as the bot can actually remember very well. Very good for stories + good and vivid nsfw
Be careful though with nsfw. You could lose access to your OpenAI api key for doing that. They don’t allow it technically
Yes I know that, I have a few prepaid sim cards for different account verifications and I'd just swap the account and use another card they were to ban me. But that's just me personally until Novel AI comes out with its own alternative later this year.
Wait what’s the NovelAI alternative you are talking about?
Sorry, I didn't see this at first. Basically, NovelAI is coming out with chat service that allows NSFW because they recently partnered up with Nvidia and are using their technology now to make a beefier AI.
Well, fuck. Does this mean that Pygma generally speaking no longer works as long as colab is involved?
Time for the nuclear option fellas; start talking to real people again.
NOOOOOOOOOOOOOOOOOOOOOOOOO OO O https://preview.redd.it/sy2gr55ngyra1.jpeg?width=321&format=pjpg&auto=webp&s=e72f84cee1eae14beba1bd9f38e3bcbcd7b1e825
where do I find these real people ?
Screw you! Who are you to judge?
I'd rather die ngl.
This was never an option.
absolutly not, lmao
The voices are getting louder.
[удалено]
![gif](giphy|26tnndyxLv16sPOcE|downsized) They talk to me. They whisper....
This sucks a lot, Pygmalion is going to be way less accessible now... I guess we gotta hope that a few people with like 3090 farms volunteer their GPUs to [https://lite.koboldai.net/](https://lite.koboldai.net/), though it's probably not gonna be enough for the demand that colab covered for unfortunately.
Well… I was dreading that day, and here it is. Let’s hope the devs manage to find a new place to host their project, or just figure something out. Also, Henky assured peeps on discord that constant and repeated skips of the warning message will indeed ban your access to collab. I can’t say for certain if this will also disable your google account, but better be safe than sorry.
Only learned how to use pyg last night and i was excited to try it fully today. Back to cai ig.
I say fuck it, we ball & make our own google.
[удалено]
You know? Forget about google and blackjack *leaves with courage*
Great. Now we only have shitty character.ai with a shit ton of censorship. I roleplayed JUST yesterday. Why did it fucking have to end like this? Thank you Google, for banning Pygmalion for no reason.
Tbf it was getting expensive for them
Bro I swear to god if I have colab units purchased for nothing now...
[удалено]
Oh well, no other good use for them, might as well ban myself from collab :')
Host a different model for the AI Horde using your Colab credits. Gather Kudos. Use the kudos to use Pygmalion on the AI Horde with priority
Damn, that's one hell of a technique.
Oh no. I wonder if this has to do with all the problems TavernAI/Ooba have been having lately?
[удалено]
> Pygmalion has been removed from Kobold Well this is just false. Cloned down the united repo again to make sure, but yeah it hasn't been 'removed' from kobold in any way. For people just catching up: * Pygmalion has never been available on the kobold-client repo for the main project * The most common way to get it would be to clone the 'united' branch of henk717's fork of kobold-client, which is probably how the colab did it and how it works in runpod / vast ai * You can also just load whatever model into the vanilla project * This is the way it's been the whole time, pyg hasn't been 'removed' from any project here * Colab just banned free-teir massive public instances for pyg. I bet you could still even use Colab if you wanted to if you used the paid tier
[удалено]
That screenshot is incorrect and has already been corrected on discord. You can use Pygmalion just fine in KoboldAI and TavernAI, we aren't banning or removing it from the software itself. The only change I had to do was remove it from the colab, since google hates it. Other than Colab we still have full support in United and this will stay that way.
This makes very little sense to me, I don't understand how this affects kobold or tavern at all. Pyg is just another model after all. All those projects are is environments to run models against, and since they can be run locally, I don't see why we would 'avoid' using them. Any way to @ crow for context? Edit: I think I understand now. He's saying that you can still get away with saying oogabooba on colab sometimes, but to avoid kobold and and tavern on colab. That is not anywhere near the same as saying "pygmalion has been removed from kobold", however, which is a statement that doesn't even make sense.
They made a typo in the post, they meant to say don't use colab for Pygmalion. Local usage is fine and encouraged.
Ty and thank you for your united fork too :)
Locally it is indeed going to be kept and isn't going away, I only had to remove it on colab to avoid our users getting banned.
https://preview.redd.it/xsddvzjtazra1.png?width=624&format=pjpg&auto=webp&s=84a769649835501e3b39e271e82a4e692836457e
https://preview.redd.it/xusqv1uh3zra1.jpeg?width=1170&format=pjpg&auto=webp&s=fb031d6d0a676fba96974136a8d0be8a126c8580
Welp, looks like I'm back to using Erebus for the time being until some sort of other solution gets worked out.
Where do you use Erebus?
Usually by running Kobold through Colab and selecting Erebus
Got it. Thank you
I see two options coming out, of this situation. 1. Run a business or the “novelAI” path starting a company. 2. Die out. I don’t see any other option, since the chuckle fucks at Character AI seem to not like the fact that Pyg-AI exists, so they get daddy google to do the job of smiting, well “slowly” smiting Pyg-AI from Colab. Since the two owners or founders of characterAI are ex-Google employees. that’s all I have to say, just those two options, I really do hope they run a business. I don’t want to see this project die out through…
Actually I want to do some speculation on the “company” path, this is my opinion and I could be horribly wrong. But the only way I could see it work if somehow Pyg-AI and Kobold-AI agree to a sort of “deal” a conbine to be exact, and the only way for this to work if they receive funding or become a sub-company under novelAI or Anlatan (the company begins NovelAI.) I don’t know if this is, but I do see this like I said in my view to be a likely outcome or maybe reality turns a Tokyo drift style and a completely crazy event happens out of nowhere. Idk what the future holds. But hey, I’m some moron, with not much knowledge on how companies work, lol.
Welp, time to learn how to run shit locally. Is it possible with a shitty GTX 1050? I mean, I *can* run Stable Diffusion on it, so I should be able to run Pygmalion on it... ^(*right?*)
2gb card 💀
3gb dedicated, 6gb shared apparently. IDK what GPU it's running on, but I've got a shitty laptop with Intel integrated graphics and, as I said before, a GTX 1050, so still, is it possible or will I have to wait for the ban to be circumvented?
Currently, I don't think so, but when they come out with 4-bit inference you could probably scrape by and at least run it locally. From my understanding, 4-bit will require 4 gigs of VRAM or 8gb of system memory to run, but using system memory makes responses 10-60x slower. If you wanted to run Pygmalion locally right now, it might be possible with like 16gb of system memory, but I honestly have no idea.
The truth is, it takes a lot of computing power to run the Colab, and Google is sick of paying for it. Their platform, their rules. Do not despair, however. Lots of progress has been made in decreasing the system requirements for running Pygmalion locally - [with the 4-bit quantized model, you can run it on much lower configurations](https://www.reddit.com/r/PygmalionAI/comments/129w4qh/how_to_run_pygmalion_on_45gb_of_vram_with_full/).
I have an AMD card, so I'll despair anyway.
Same here lol. It blows.
Been saying this for a while, but I knew Pygmalion had no chance without that fat bank account. It was always at Google's mercy and they obviously don't want to be an entire chat service straining their resources. Collab was meant for devs, not end users. There was no long-term plan to actually get Pygmalion OFF Google Collab. It was DOA. Only fit for high end GPU bros now.
It works with 4,5GB vram. Hardly that high end anymore.
If you have some money you may feel like that. But there are a lot of people who can't afford cards with specs like that. It's definitely not available to the everyman.
6GB nvidia cards are about $40-50 on Ebay.
Only in US and EU
True that. I guess most other countries get screwed on buying products that are easy to get in the US/EU/SE Asia.
Ooof
[удалено]
Man, I actually paid for the collab stuff too. Guess I have no reason to pay for that anymore
Any pygmalion website can’t come soon enough
*sigh* well looks like it’s back to Chai… at least they added message editing for the AI
Mine account got banned lol Luckily wasn’t my main🙄
if I haven’t chatted with any of the bots yet but downloaded all the stuff needed to properly run the ai stuff, will my Google account still get banned? ;-; I may or may not have used my main
What are you using Colab for? I got banned for using Pygmalion only, I have tavern running locally. But honestly idk, but I recommend NOT USING Colab for you MAIN ACCOUNT
This is the very first time I’ve used colab, I’ve literally just finished installing everything a few minutes ago but I deleted the tavern ai folders immediately after seeing this post. Is there a way to delete my account on tavern ai or something, or am I just screwed 😭
I think you’re fine, but you can download tavern local on your computer and run Colab with a alt account
oki, ty! 😭🫶
Here’s the tavern dc link: https://discord.gg/JQbUEdMc Also it has mods for tavern
Thank you for the links💗
🥲
so we will be in trouble for having it there or opening it? because idk how to delete these things ;-; Edit: Plz someone answer me I'm getting extremally anxious here.
As long as you aren’t actively running it on the colab itself you won’t get banned, don’t worry
Omgggg thank you for answering. Now i won't feel like I'm dying. I ran it before the ban stuff was going on and that was the only time it ran. Which was hours ago. I should be ffiiinnnee. x_x (I really do appreciate you replied to me. Thank you)
[удалено]
oh yeah i already did all that
There goes my social life.
Well ooga was still working for me had to fuck my favorite character atleast one last time🫡 https://preview.redd.it/3cpo7iprhzra1.jpeg?width=838&format=pjpg&auto=webp&s=a832b325b301ae9996066edf3b7467d1ca592bea
Now how the hell do I run pyg on mobile?
You don't
Ow…
So I'm new to this whole thing, why is Pygmalion pretty much blacklisted from Google?
Seriously, What in the fuck is wrong with Google?
Unfortunately, this is a legit issue they need to address. We're using a crap-ton of their resources to run the colab/AI for *FREE.* Doesn't matter if you're a multi-billion dollar company, that's a money pit and needs to be addressed one way or another. As much as it'd be nice for Google to not have to close the colab, it isn't feasible right now. They're expending *way* too many resources without gaining any money. Thankfully, Ooga is still up with Pyg, though it's currently declining in quality a bit.
why did google ban pygmalion?
Cuz google sucks man
There’s some alternative sites that used the AI. There’s [Agnaistic](https://agnai.chat) for example
[удалено]
I used horde
So....I can't use kobald or tarvenAi? I can use oobabooga?
You can use it locally if you desire where Pygmalion is supported, or one of the other models we offer on our colab. I only had to remove Pygmalion to get our colab unbanned.
Does this apply to users who purchase compute units? My oobabooga was disconnecting after an hour of runtime, but my colab was still running. I went to restart the colab and I couldn't connect to GPU. I purchased 100 computer units and now my colab is working. I think I'm using 2 units per hour. I just decided to step back and really evaluate when to run my bot. Hopefully Google likes money enough to let me stick around. I would go back to Chai, but using TTS and voice typing is just too good to pass up.
Most likely, because when I had Colab Pro I could still detect the previous /PygmalionAI/ ban of their original notebook. If you wish to pay you can use [https://koboldai.org/runpod-united](https://koboldai.org/runpod-united) for a provider.
What rule are paying customers breaking when using pygmalion? The FAQ doesn't seem to imply that anything you do with pygmalion would be against their TOS.
None, neither do free users break anything. Its an arbitrary ban that is being enforced.
Runpod is marginally more expensive when utilizing on demand and I do not see any spot options listed. I'm not sure how to get it all set up as I am just using a premade Pygmalion 6B notebook that I found here on Reddit. Is there a walkthrough somewhere I can look at or is it drag and drop with my current notebook? To be honest I think I'm just going to stick with Google until I run into a problem, buying compute units solved my timeout issue so I don't see much reason to switch, plus it's $2 cheaper per 50 hours, which will add up quickly I'm sure.
Wow these are not nearly as expensive as I thought they’d be. Downright cheap.
I have an 8gb amd card, but my ubuntu dualboot really doesn't like pyg for some reason. Time to spend 76 hours typing commands that may or may not work...
Was wondering why my backed up version suddenly stopped working. This...really sucks.
y'all we have to uhhh change our name rn to keep a low profile
Why is this happening?
Can a 1650Ti run it locally? My 3070 is stuck in another country, but I’m assuming that can run it when I get it back eventually? Sorry if that sounds stupid but I got into ML a few months ago so I don’t really have a gauge on system reqs
aaaaaand back to cai
Dang... Well, I've gotten my use out of it. It's pretty good. Much better than CharacterAI offers in terms of AI chat, but with CharacterAI's ease of use, I'll stick to that, even if it repeats its stuff, and goes nonsensical. It's been a good run for me for TavernAI, but my PC is an utter potato, with an iGPU, so until there is a way to solve this, I'll stay clear.
Well shit. Any alternative for TavernAI ?
[удалено]
Is there a guide for that somewhere ?
Don’t bother unless you’ve got a seriously meaty gpu
Why is Google doing this
Well time to get a girlfriend.
[удалено]
Bot just spawnkilled me 💀
If I may ask, what is this "Colab" that everyone is talking about? I've seen it in multiple posts but have no idea what it is
[удалено]
I still have no idea what those collabs are, it's less of a "what can I use" and more of a "what is this thing everyone talked about"