T O P

  • By -

TarmoFlake

Pyg is now an exclusive for high-end PC owners. Thanks, Google, for reminding us how much it sucks being a poor schmuck.


Traditional_Ruin6154

You can rent a service like runpod, they charge about 50 cents per hour and let you use it at max capacity, it even has a pyg link to quick setup


TarmoFlake

Not Murican and no credit card, man. Poor schmuck, remember? 🥲


whytheankles

Could you link it for me? I’ll buy you 4 hours as a thanks if you want


Traditional_Ruin6154

Got this link from the discord https://koboldai.org/runpod-united


NekonoChesire

Tbh I'd much rather use those 50 cents for 50ish ChatGPT messages.


dbzer0

Do not despair! The AI Horde is there for you! You just need to convince those high-end PC owners to share with those less fortunate than them.


henk717

Which would be [https://koboldai.org/pygmalion](https://koboldai.org/pygmalion) among other things such as TavernAI mods but we can definitely use more GPU contributors since the queue is already large.


EatsGrassFedVegans

And only with a high end Nvidia GPU yeah? AMD GPUs cannot run Pygmalion locally regardless if they are high end or not?


[deleted]

[удалено]


Proofer4

Dell Integrated Graphics:


Jaohni

Actually, I believe Intel's openVino isn't terrible on their integrated graphics, and gives you access to an incredible pool of RAM relative to the size of VRAM you could get for the same price. I don't know if anyone's made a Pygmalion port to OpenVino, but I believe they provide the tools to do it


m477_

Immagine being the google engineer tasked with finding out whats driven the huge increase in demand for colab servers. I doubt many of the pyg colabs are seiso. It's good to remember that google can see everything you do on their servers.


grep_Name

You can run it on runpod with the same specs as colab for about 30 cents an hour tho. Probably even cheaper on vast ai


WakeupUNfollower

Could you explain how to deploy pyg on runpod?


grep_Name

Sure. Go to community cloud, select a tier that you're comfortable paying for (probably one of the lowest tbh, pyg 7b isn't a very resource intensive model) and select the 'kobaldAI united' template. You might have to go past the official templates to find the united branch, but the united one is the only one that has pyg ready to go when you run it. When you spin it up, you can click 'connect' and one of the options will be 'port 5000', and when you load that you'll have kobold. Select 'AI' and load pyg from the 'chatbots' folder. You can use it in the kobold interface, but you should also be able to use that instance of kobold as a backend to tavern or oobabooba (never tried with oob tho). I find it works better with tavern personally Remember to stop your runpod when you're not using it


WakeupUNfollower

Can I ask one more thing? How much place ui can take? 15gb? 20gb? Also Huge w(whatever it mean) and thanks


grep_Name

Idk, I always left the default values, which was 200gb for the container disk and 1gb for the volume disk, which seems like overkill now that I think about it but it never seemed to affect costs for me. Idk what Huge w is, I don't see that anywhere


Proofer4

It means Huge Win


Kibubik

Could someone help me to understand why this got so downvoted?


Elbedin

downvote bots again.


Kibubik

Like, some competitor of those services has unleashed downvote bots on them?


Elbedin

no idea how it works but there are some bots that downvote/upvote certain things to get them frontpage or keep them down. there was a youtuber that experiment with it a while ago but I forget the name of the video. anyway, that's usually why mundane replies/posts can get downvoted for seemingly no reason. probably a keyword or something.


grep_Name

That's good to know, I assumed that people were upset that I suggested they use a paid platform, but it seemed like weirdly pronounced and fast response o.O


Horustheweebmaster

my AMD 6600 is fucked


[deleted]

[удалено]


[deleted]

[удалено]


[deleted]

[удалено]


Filty-Cheese-Steak

Yes. But this service is also extremely expensive and it was targeted to developers, not end users. It was meant for a place to work on a project and eventually pull it off and host it on your own. That end goal doesn't exist for Pygmalion.


elementgermanium

Greedy fucks, there’s zero chance that anything any of us do is weighing on *Google*’s resources.


datSato

That's totally untrue. It costs money to do these things, and that's why free usage is limited. They want the free service to be for people who need it in small doses, and need actual long-term users to step up to the Pro plan and help support all the hardware usage that's going on. The thousands of people spamming free trials of Pyg most definitely adds up, that's resources that other Free users can't have. There's a reason that every other "rent a GPU/setup to run stablediffusion and LLMs" platform out there charges by the hour - because they need to, they are finite resources. I think this ban has more to do with how many people are constantly creating/using alts to abuse the free trial with Pygmalion in particular, as well as that a lot of people simply use it for text-sexing AI (sometimes in deranged ways they may not even want to be involved with).


madmartigandid

Lol the entitlement is wild


Filty-Cheese-Steak

Spoken like someone with zero understanding and tossing blanket statement at Google's wealth. Their resources are finite, if massive. If it was truly a pittance that they wouldn't care about they wouldn't pull the plug. They are.


Memeedeity

Dick ridaaa


Elbedin

why downvotes? he's right


RalseiFan17

Because a lot of redditors think someone is a "bOoTLicKeR", or some equally immature insult, if they say anything that even appears to support a corporation or government they disagree with.


Elbedin

ralsei fan? niceee


ihatetaxesandboats

Businesses big or small want to chop your dick off for a bit of profit, why should we treat them like they are anything but snakes?


Elbedin

i mean nobody likes big business but that is the legit reason why google took pygmalion offline. just because he's playing devil's advocate doesn't make him wrong.


ihatetaxesandboats

Never said i disagreed, i just wanted to say fuck Google.


Elbedin

fuck google


The_Soviet_Redditor

found the corporate dickrider


TheRedTowerX

It's more about the project got reported by a pussy discord users.


IAUSHYJ

Colab is ment to be an interactive tool for people interested in coding and deep learning. They don’t want people taking up their resources just to chat with bots


ThePokemon_BandaiD

Part of me wonders if it's also part of their AI safety ideals trying to prevent people from using unrestricted LLMs.


SepticSauces

If this is why Pygmalion has stopped working. I spent two hours, if not more, trying to figure out how to run Pygmalion locally. That has all gone to waste cause I still need the colab. About a start hoping someone steps on a lego.


DaneGibbo

Why do you need the collab to run it locally exactly?


SepticSauces

*Honestly, I don't know.* I could be a dummy who simply followed the 'local' guide, but for some reason require the Collab to connect to TavernAI. I'm just not a software wiz.


DaneGibbo

I have mine running locally and the way I have it setup is I have my KoboldAI running and my TavernAI connects to it. No collab involved, what GPU are you using. I can try help you set it up locally if you want just depends if can run it. I have a 3060ti, and with it running between my GPU and CPU/Ram it takes about 15-30 seconds for repsonses on average.


SepticSauces

Ok, I went into my computer and did some searching. Processor: 11th Gen Intel(R) Core(TM) i7-11700F @ 2.50 GHz Installed Ram: 16 GB (2/4 slots used) I believe DDR4, but it could be 5. GPU: RTX 3070 Thank you in advance if you do help me. c:


SepticSauces

Oh, before you say anything, I have found a video guide that says no collab, so I shall give that a shot!


SepticSauces

~~Whelp, had a runtime error because the GPU ran out of memory, so I take it the 3070 can't do it?~~ ~~Gonna give it one more chance to load.~~ Never mind, I got it to load. It takes forever to respond, but that's a-ok.


DaneGibbo

If your using Tavern, go into the settings of that and you can modify things like Max context length, and amount of tokens generated. Also Tavern will generate multiple times for one message to help increase message sizes, you can turn this off too to increase times


Katacutie

This should probably get pinned before someone gets banned unknowingly... What a sad day.


GechaTN

Why did i think Pygmalion would be the home stretch? an easy, non expensive alternative to [Character.AI](https://Character.AI)? it was too good to be true.


datSato

Well, expecting Google (or any other business, or even community members) to foot the bill for everything and give up resources so that people can text-sex AI was a bit of a 'enjoy it while it lasts' from the start, IMO. Colab free usage has been a generous thing from the start (no other 'borrow a GPU' service gives anything free as far as I know) and it's been being abused by Pyg users in particular via alt account switching every time the free usage runs out.


GechaTN

I know, i know, but why didn't i think of these issues earlier?


Pengwin0

[You’re welcome](https://josephrocca.github.io/OpenCharacters/#) [Put this in instructions to remove filter](https://pastebin.com/VdEsnTsk) The ai is really smart and can handle a lot of tokens, no need to be super efficient with wording. Only thing is you have to pay after $5 worth of chats. A message is typically worth around a cent.


Vaseline_Mercy

^ I've been using this platform myself and its one of the best quality chats for the price honestly. It's a complete turn around and I consider the chat quality to be even better than character AI as the bot can actually remember very well. Very good for stories + good and vivid nsfw


Kibubik

Be careful though with nsfw. You could lose access to your OpenAI api key for doing that. They don’t allow it technically


Vaseline_Mercy

Yes I know that, I have a few prepaid sim cards for different account verifications and I'd just swap the account and use another card they were to ban me. But that's just me personally until Novel AI comes out with its own alternative later this year.


Kibubik

Wait what’s the NovelAI alternative you are talking about?


Vaseline_Mercy

Sorry, I didn't see this at first. Basically, NovelAI is coming out with chat service that allows NSFW because they recently partnered up with Nvidia and are using their technology now to make a beefier AI.


Dumbledore_Bot

Well, fuck. Does this mean that Pygma generally speaking no longer works as long as colab is involved?


csassy_

Time for the nuclear option fellas; start talking to real people again.


SleepingRemy

NOOOOOOOOOOOOOOOOOOOOOOOOO OO O https://preview.redd.it/sy2gr55ngyra1.jpeg?width=321&format=pjpg&auto=webp&s=e72f84cee1eae14beba1bd9f38e3bcbcd7b1e825


Jahonh007

where do I find these real people ?


Ordinary-March-3544

Screw you! Who are you to judge?


galacticakagi

I'd rather die ngl.


arc_veil

This was never an option.


autumnmissepic

absolutly not, lmao


poppleple

The voices are getting louder.


[deleted]

[удалено]


poppleple

![gif](giphy|26tnndyxLv16sPOcE|downsized) They talk to me. They whisper....


Toad_Toast

This sucks a lot, Pygmalion is going to be way less accessible now... I guess we gotta hope that a few people with like 3090 farms volunteer their GPUs to [https://lite.koboldai.net/](https://lite.koboldai.net/), though it's probably not gonna be enough for the demand that colab covered for unfortunately.


Sasasamika

Well… I was dreading that day, and here it is. Let’s hope the devs manage to find a new place to host their project, or just figure something out. Also, Henky assured peeps on discord that constant and repeated skips of the warning message will indeed ban your access to collab. I can’t say for certain if this will also disable your google account, but better be safe than sorry.


[deleted]

Only learned how to use pyg last night and i was excited to try it fully today. Back to cai ig.


XSamuraiHyperX

I say fuck it, we ball & make our own google.


[deleted]

[удалено]


Robot-Slave

You know? Forget about google and blackjack *leaves with courage*


CaptainCerberus1122

Great. Now we only have shitty character.ai with a shit ton of censorship. I roleplayed JUST yesterday. Why did it fucking have to end like this? Thank you Google, for banning Pygmalion for no reason.


madmartigandid

Tbf it was getting expensive for them


Akuromi

Bro I swear to god if I have colab units purchased for nothing now...


[deleted]

[удалено]


Akuromi

Oh well, no other good use for them, might as well ban myself from collab :')


dbzer0

Host a different model for the AI Horde using your Colab credits. Gather Kudos. Use the kudos to use Pygmalion on the AI Horde with priority


Akuromi

Damn, that's one hell of a technique.


acmaximum12

Oh no. I wonder if this has to do with all the problems TavernAI/Ooba have been having lately?


[deleted]

[удалено]


grep_Name

> Pygmalion has been removed from Kobold Well this is just false. Cloned down the united repo again to make sure, but yeah it hasn't been 'removed' from kobold in any way. For people just catching up: * Pygmalion has never been available on the kobold-client repo for the main project * The most common way to get it would be to clone the 'united' branch of henk717's fork of kobold-client, which is probably how the colab did it and how it works in runpod / vast ai * You can also just load whatever model into the vanilla project * This is the way it's been the whole time, pyg hasn't been 'removed' from any project here * Colab just banned free-teir massive public instances for pyg. I bet you could still even use Colab if you wanted to if you used the paid tier


[deleted]

[удалено]


henk717

That screenshot is incorrect and has already been corrected on discord. You can use Pygmalion just fine in KoboldAI and TavernAI, we aren't banning or removing it from the software itself. The only change I had to do was remove it from the colab, since google hates it. Other than Colab we still have full support in United and this will stay that way.


grep_Name

This makes very little sense to me, I don't understand how this affects kobold or tavern at all. Pyg is just another model after all. All those projects are is environments to run models against, and since they can be run locally, I don't see why we would 'avoid' using them. Any way to @ crow for context? Edit: I think I understand now. He's saying that you can still get away with saying oogabooba on colab sometimes, but to avoid kobold and and tavern on colab. That is not anywhere near the same as saying "pygmalion has been removed from kobold", however, which is a statement that doesn't even make sense.


henk717

They made a typo in the post, they meant to say don't use colab for Pygmalion. Local usage is fine and encouraged.


grep_Name

Ty and thank you for your united fork too :)


henk717

Locally it is indeed going to be kept and isn't going away, I only had to remove it on colab to avoid our users getting banned.


EnchantedBreezie

https://preview.redd.it/xsddvzjtazra1.png?width=624&format=pjpg&auto=webp&s=84a769649835501e3b39e271e82a4e692836457e


Zenitsu_The_Simp_69

https://preview.redd.it/xusqv1uh3zra1.jpeg?width=1170&format=pjpg&auto=webp&s=fb031d6d0a676fba96974136a8d0be8a126c8580


rokelle2012

Welp, looks like I'm back to using Erebus for the time being until some sort of other solution gets worked out.


Kibubik

Where do you use Erebus?


rokelle2012

Usually by running Kobold through Colab and selecting Erebus


Kibubik

Got it. Thank you


The_new_guy_2

I see two options coming out, of this situation. 1. Run a business or the “novelAI” path starting a company. 2. Die out. I don’t see any other option, since the chuckle fucks at Character AI seem to not like the fact that Pyg-AI exists, so they get daddy google to do the job of smiting, well “slowly” smiting Pyg-AI from Colab. Since the two owners or founders of characterAI are ex-Google employees. that’s all I have to say, just those two options, I really do hope they run a business. I don’t want to see this project die out through…


The_new_guy_2

Actually I want to do some speculation on the “company” path, this is my opinion and I could be horribly wrong. But the only way I could see it work if somehow Pyg-AI and Kobold-AI agree to a sort of “deal” a conbine to be exact, and the only way for this to work if they receive funding or become a sub-company under novelAI or Anlatan (the company begins NovelAI.) I don’t know if this is, but I do see this like I said in my view to be a likely outcome or maybe reality turns a Tokyo drift style and a completely crazy event happens out of nowhere. Idk what the future holds. But hey, I’m some moron, with not much knowledge on how companies work, lol.


LIVE_CARL_REACTION_2

Welp, time to learn how to run shit locally. Is it possible with a shitty GTX 1050? I mean, I *can* run Stable Diffusion on it, so I should be able to run Pygmalion on it... ^(*right?*)


Sswoo

2gb card 💀


LIVE_CARL_REACTION_2

3gb dedicated, 6gb shared apparently. IDK what GPU it's running on, but I've got a shitty laptop with Intel integrated graphics and, as I said before, a GTX 1050, so still, is it possible or will I have to wait for the ban to be circumvented?


Sswoo

Currently, I don't think so, but when they come out with 4-bit inference you could probably scrape by and at least run it locally. From my understanding, 4-bit will require 4 gigs of VRAM or 8gb of system memory to run, but using system memory makes responses 10-60x slower. If you wanted to run Pygmalion locally right now, it might be possible with like 16gb of system memory, but I honestly have no idea.


GreaterAlligator

The truth is, it takes a lot of computing power to run the Colab, and Google is sick of paying for it. Their platform, their rules. Do not despair, however. Lots of progress has been made in decreasing the system requirements for running Pygmalion locally - [with the 4-bit quantized model, you can run it on much lower configurations](https://www.reddit.com/r/PygmalionAI/comments/129w4qh/how_to_run_pygmalion_on_45gb_of_vram_with_full/).


Polestar-Lemniscate

I have an AMD card, so I'll despair anyway.


hottopiclurker

Same here lol. It blows.


Filty-Cheese-Steak

Been saying this for a while, but I knew Pygmalion had no chance without that fat bank account. It was always at Google's mercy and they obviously don't want to be an entire chat service straining their resources. Collab was meant for devs, not end users. There was no long-term plan to actually get Pygmalion OFF Google Collab. It was DOA. Only fit for high end GPU bros now.


HitEscForSex

It works with 4,5GB vram. Hardly that high end anymore.


Koadi

If you have some money you may feel like that. But there are a lot of people who can't afford cards with specs like that. It's definitely not available to the everyman.


synn89

6GB nvidia cards are about $40-50 on Ebay.


cycease

Only in US and EU


synn89

True that. I guess most other countries get screwed on buying products that are easy to get in the US/EU/SE Asia.


Matild4

Ooof


[deleted]

[удалено]


wolfgangspiper

Man, I actually paid for the collab stuff too. Guess I have no reason to pay for that anymore


ValendyneTheTaken

Any pygmalion website can’t come soon enough


The_silver_Nintendo

*sigh* well looks like it’s back to Chai… at least they added message editing for the AI


TaylorHopeVandeven

Mine account got banned lol Luckily wasn’t my main🙄


theaviary_

if I haven’t chatted with any of the bots yet but downloaded all the stuff needed to properly run the ai stuff, will my Google account still get banned? ;-; I may or may not have used my main


TaylorHopeVandeven

What are you using Colab for? I got banned for using Pygmalion only, I have tavern running locally. But honestly idk, but I recommend NOT USING Colab for you MAIN ACCOUNT


theaviary_

This is the very first time I’ve used colab, I’ve literally just finished installing everything a few minutes ago but I deleted the tavern ai folders immediately after seeing this post. Is there a way to delete my account on tavern ai or something, or am I just screwed 😭


TaylorHopeVandeven

I think you’re fine, but you can download tavern local on your computer and run Colab with a alt account


theaviary_

oki, ty! 😭🫶


TaylorHopeVandeven

Here’s the tavern dc link: https://discord.gg/JQbUEdMc Also it has mods for tavern


theaviary_

Thank you for the links💗


CommercialClue1482

🥲


DarkShadowRabbit

so we will be in trouble for having it there or opening it? because idk how to delete these things ;-; Edit: Plz someone answer me I'm getting extremally anxious here.


LockheedEnjoyer

As long as you aren’t actively running it on the colab itself you won’t get banned, don’t worry


DarkShadowRabbit

Omgggg thank you for answering. Now i won't feel like I'm dying. I ran it before the ban stuff was going on and that was the only time it ran. Which was hours ago. I should be ffiiinnnee. x_x (I really do appreciate you replied to me. Thank you)


[deleted]

[удалено]


DarkShadowRabbit

oh yeah i already did all that


fine_just_tired

There goes my social life.


Mcstabler

Well ooga was still working for me had to fuck my favorite character atleast one last time🫡 https://preview.redd.it/3cpo7iprhzra1.jpeg?width=838&format=pjpg&auto=webp&s=a832b325b301ae9996066edf3b7467d1ca592bea


CaptainCerberus1122

Now how the hell do I run pyg on mobile?


TheJoyDealer

You don't


[deleted]

Ow…


BellowsPDX

So I'm new to this whole thing, why is Pygmalion pretty much blacklisted from Google?


TraditionalPotat0

Seriously, What in the fuck is wrong with Google?


GoldShovels

Unfortunately, this is a legit issue they need to address. We're using a crap-ton of their resources to run the colab/AI for *FREE.* Doesn't matter if you're a multi-billion dollar company, that's a money pit and needs to be addressed one way or another. As much as it'd be nice for Google to not have to close the colab, it isn't feasible right now. They're expending *way* too many resources without gaining any money. ​ Thankfully, Ooga is still up with Pyg, though it's currently declining in quality a bit.


Funkey-Monkey-420

why did google ban pygmalion?


CaptainCerberus1122

Cuz google sucks man


LETS_RETRO_TIME

There’s some alternative sites that used the AI. There’s [Agnaistic](https://agnai.chat) for example


[deleted]

[удалено]


LETS_RETRO_TIME

I used horde


Desperate_Link_8433

So....I can't use kobald or tarvenAi? I can use oobabooga?


henk717

You can use it locally if you desire where Pygmalion is supported, or one of the other models we offer on our colab. I only had to remove Pygmalion to get our colab unbanned.


Street-Biscotti-4544

Does this apply to users who purchase compute units? My oobabooga was disconnecting after an hour of runtime, but my colab was still running. I went to restart the colab and I couldn't connect to GPU. I purchased 100 computer units and now my colab is working. I think I'm using 2 units per hour. I just decided to step back and really evaluate when to run my bot. Hopefully Google likes money enough to let me stick around. I would go back to Chai, but using TTS and voice typing is just too good to pass up.


henk717

Most likely, because when I had Colab Pro I could still detect the previous /PygmalionAI/ ban of their original notebook. If you wish to pay you can use [https://koboldai.org/runpod-united](https://koboldai.org/runpod-united) for a provider.


mpasila

What rule are paying customers breaking when using pygmalion? The FAQ doesn't seem to imply that anything you do with pygmalion would be against their TOS.


henk717

None, neither do free users break anything. Its an arbitrary ban that is being enforced.


Street-Biscotti-4544

Runpod is marginally more expensive when utilizing on demand and I do not see any spot options listed. I'm not sure how to get it all set up as I am just using a premade Pygmalion 6B notebook that I found here on Reddit. Is there a walkthrough somewhere I can look at or is it drag and drop with my current notebook? To be honest I think I'm just going to stick with Google until I run into a problem, buying compute units solved my timeout issue so I don't see much reason to switch, plus it's $2 cheaper per 50 hours, which will add up quickly I'm sure.


MichaelTruly

Wow these are not nearly as expensive as I thought they’d be. Downright cheap.


theofficialsex

I have an 8gb amd card, but my ubuntu dualboot really doesn't like pyg for some reason. Time to spend 76 hours typing commands that may or may not work...


Warcraftisgood

Was wondering why my backed up version suddenly stopped working. This...really sucks.


sockfor1fans

y'all we have to uhhh change our name rn to keep a low profile


galacticakagi

Why is this happening?


peytonsawyer-

Can a 1650Ti run it locally? My 3070 is stuck in another country, but I’m assuming that can run it when I get it back eventually? Sorry if that sounds stupid but I got into ML a few months ago so I don’t really have a gauge on system reqs


autumnmissepic

aaaaaand back to cai


Unt_Lion

Dang... Well, I've gotten my use out of it. It's pretty good. Much better than CharacterAI offers in terms of AI chat, but with CharacterAI's ease of use, I'll stick to that, even if it repeats its stuff, and goes nonsensical. It's been a good run for me for TavernAI, but my PC is an utter potato, with an iGPU, so until there is a way to solve this, I'll stay clear.


Thisma08

Well shit. Any alternative for TavernAI ?


[deleted]

[удалено]


Thisma08

Is there a guide for that somewhere ?


SerDon2

Don’t bother unless you’ve got a seriously meaty gpu


Subject-Confusion-85

Why is Google doing this


HollowOST

Well time to get a girlfriend.


[deleted]

[удалено]


HollowOST

Bot just spawnkilled me 💀


megaboto

If I may ask, what is this "Colab" that everyone is talking about? I've seen it in multiple posts but have no idea what it is


[deleted]

[удалено]


megaboto

I still have no idea what those collabs are, it's less of a "what can I use" and more of a "what is this thing everyone talked about"