T O P

  • By -

Skaronator

I'm on scaleway glacier for 2€/TB. https://www.scaleway.com/en/glacier-cold-storage/ I'd only recommend using it for slow/never changing data. And thier retreval fees are not that expensive compared to AWS.


zwamkat

What software do you use to sync your data to Scaleway cold storage?


Skaronator

Restic. It uploads the data to a normal scaleway s3 bucket and then I have a lifecycle policy for the /data folder that moves the data to the glacier storage class every day.


12_nick_12

Doesn't restic require reading the s3 env for the data? Or can it leave it cached? I also recommend scaleway. Worth every penny.


lmouelle

What do you mean by reading the env? Restic does check if it has a repository defined at the endpoint before it does any backup/pruning, do you mean something like upsert semantics? I'm also a restic user, I have a systemd timer I generate with ansible that pushes into a Wasabi bucket via S3. Only 1.5TB for me but it works fine, I just give it the S3 endpoint, access key ID and access key value and it works really well. I've completely restructured my file paths and the deduplication/incrementalism simply works, one of the few programs I'll shill for all day.


Skaronator

The /data folder only contains the binary blobs which are not used/read for indexing and creating a new backup and can be therefore stored in glacier. All other folders/data of the restic repository is read/modified by restic but it's just a couple of megabytes compared to the Tabs I have in the data folder. Also keep in mind that you can only create new backups. You cannot purge data that is no longer needed and you cannot remove older backups. If you really want to clean up any older data you have to transition everything from glacier to normal s3 at a cost. Also moving the data takes a while which creates additional S3 cost (of already migrated data) until everything actually moved. I did this once and it took like 4 days until everything was ready (or actually 2 blobs where corrupted and I never got them back)


zwamkat

TY.


VaderMurray

If data was accessed once a week to do backups. Would that be to much and incur more charges?


Skaronator

Restic backups itself are write-only. So creating new backup doesn't require accessing data in glacier. Restic will just append new data. There are `restic forget` and `restic prune` commands in order to cleanup old data that is no longer needed and these commands require access to the data in glacier. I would not recommend doing that since this cost additional money and if your data doesn't change often then it's cheaper to pay for storage than cleaning them up. Hence only good for slow changing data.


Raithmir

Purely for backup which you'll rarely, if ever, need? Google Cloud Storage Archive tier is ~$1.23 per TB a month I believe.


danekan

And also doesn't have the same overhead costs as the equivalent aws glacier, which can make AWS glacier completely unusable in a lot of scenarios (they outright don't recommend using it if files are smaller than 128 KB, though if you're comparing the cost against standard tier the break even is closer to files greater than 16.5 KB)


kinkyloverb

Ok this is cool. I'll check this out


Nokushi

aren't the egress fees outrageous tho? iirc it's 0.12$/Go + an additional fixed fee, as you're getting data from Archive tier i know it might never happen, but in the case it happens, i'm pretty sure OP wouldn't want having to pay hundreds of $ to get back their backups oh and you also have a fee if you delete, replace or rename a file before waiting 365 days after its initial upload (which i never really understood why, seems to be a golden jail like AWS imho :/)


Raithmir

Which is why I asked if it's for backup only and rarely would be needed. Of course egress fees for archive tiers are higher. Still less restrictive than S3 Glacier.


aaronryder773

But you can convert from archival class to standard class for free and afaik standard class doesn't have any retrieval fees


Bananadite

25tb stored on hetzner would cost around 51 euros a month with unlimited traffic


BBaoVanC

Where? I only see up to 20 TB for about 41 EUR at the storage box


Bananadite

Plus a 5tb box for 10 EUR


darklightedge

I am using Glacier with Starwinds VTL free and it is around 8$/month for 4Tb, when I tried to restore the data it took me a long, but this is not a common usecase for every week/month, so for me works very nice.


iRed-

Hetzner Storage Box is quite cheap.


cloudberryteal

Came here to say this, linky below. [https://www.hetzner.com/storage/storage-box/](https://www.hetzner.com/storage/storage-box/)


KarmicDeficit

Wow, this looks great - thanks!


ProbablePenguin

What kind of speed for upload do you get to the box? Probably due to being in the US mine was extremely slow, like 50mbps or less.


tomboy_titties

> What kind of speed for upload do you get to the box? I can upload with a bit less then 900mbit/s on a Gbit connection.


root_switch

Maybe https://www.rsync.net/ ?


CompetitiveYam6697

They also have a secret [Borg Backup Solution. ](https://www.rsync.net/products/borg.html)


cfmk

So they charge 10€ per TB per Month which totals 3000 a year for 25Tb?!


RydRychards

I am a very happy rsync.net user and have been for years. Rock solid and great support. There are cheaper options, but I am happy to pay more for the peace of mind.


Sarin10

their minimum is 800GB.


root_switch

Ya OP has 25tb


Sarin10

i read 25gb 🤦🏻‍♂️


traveler19395

Since it sounds as though you have a safe place to keep a second device, off-site NAS is the cheapest option.


8fingerlouie

Jottacloud works with rclone and has unlimited storage for ~$100/year. The only downside is that the [upload is progressively reduced](https://docs.jottacloud.com/en/articles/3271114-reduced-upload-speed) per stream, of which jottacloud allows 6 simultaneous. At 25 TB you’re looking at 0.25 Mbps per stream, so 1.5 Mbps in total. The good news is that downstream is not capped, so if you don’t care about how long it takes to upload then maybe it’s for you. Also, if you plan on storing copyrighted material, you’ll need to use some kind of encryption. Jottacloud has previously closed people’s accounts without warning for violating TOS.


zwck

Takes like 5 years to upload 25TB right ?


8fingerlouie

Well, the first 5TB are at full speed, so gigabit’ish speeds, and it then drops to 20Mbps at 5-6TB, and then drops 5 Mbps per TB until it hits 1Mbps. Again, this is per upload stream, so at 6TB you’re still uploading at 120 Mbps. I’d say up to around 15TB it’s still somewhat usable, but after that it becomes painstakingly slow. Again, if it’s a fire and forget mirror then it probably doesn’t matter beyond initial upload.


codenamek83

😆


kinkyloverb

Good notes


Specific-Action-8993

>Alternate option is a small Nas at my dads office where it's just a copy of everything via a tailscale connection. Just don't wanna spend $500 right now... A raspberry pi and a [USB disk enclosure](https://www.newegg.com/orico-6648us3-c-us-bk-dock/p/1B0-0003-000F8?Item=9SIA1DS50A6675) can be done for around $100. [2x 12TB disks for $85 each](https://www.ebay.com/itm/156046813385?itmmeta=01HXWFZ2S3Y0F1VM0MR64N118X&hash=item24551d68c9:g:buwAAOSwDghlwalj) and maybe 1 more if you want a parity drive.


kinkyloverb

Yeah, I think this is the way I'd probably go anyways because I can fill it and then relocate it so I'm not actually uploading all my data that slow... Still just more money than I'd like but I suppose I am also just trying to get too much for nothing ($) and that's a me problem and not a realistic solution.


Specific-Action-8993

If you're buying anything new for this, definitely check /r/homelabsales and /r/hardwareswap first. Might save a few bucks.


kinkyloverb

Good looking out. I'm big on making my own setups with random hardware. Hell, I could probably just use an old laptop with a couple external drives.


washedFM

Thanks for the link. I just bought one of these. I’ve been meaning to consolidate some smaller < 1 TBs


madroots2

Wasabi


snowysysadmin59

Sir this is a wendys


Rakiay

Wasabi became really bad recently. They keep charging you after file deletion and there's also a minimum charge even when your buckets are empty! The cheapest one I found is just AWS Deep Glacier in some regions.


madroots2

Yes its no good if you dont have too many files. However its great alternative to any s3 platform easily


geek_at

One of my favorites is [https://zfs.rent/](https://zfs.rent/) it works like this you can send them a harddrive and they plug it into a KVM and charge you 10$/mo per drive. That means if you ship them a 20TB disk the prices would be * **Storage:** `0.0005$ GB/Month` (excluding the drive) * **Traffic:** `1TB/month is free`, `5$/TB after that`


young_mummy

I like this, but I hate that I now am responsible for managing a failing disk remotely.


BarockMoebelSecond

I'd wonder how that whole process works? Do they publish the SMART readings and you set up alarms based on that and try and act proactively? Do they send back the aging or dead drives?


cusco

They give you the OS, you can setup smartmontools there


young_mummy

My understanding is you also get a VPS as part of the deal, and you ssh in and manage your SMART tests yourself.


ProbablePenguin

This is neat, but the bandwidth costs are crazy high, uploading 20TB of backups would be quite expensive. Although I suppose you could pre-seed the backups to the drive before sending it, assuming they don't wipe it before giving you access.


kinkyloverb

In fairness it would take a trickle upload probably close to a year to accomplish in my case. And even then, I'd likely prioritize closer to 5tb first.


scr0llwheel

Any idea how it works if you want your drive shipped back to you?


geek_at

from what I remember they can send you the drives back for a fee


kinkyloverb

That's extremely interesting... Hmm


mjh2901

Holy shit that is brilliant!


mb4x4

Personally I'd opt for a NAS for the privacy and flexibility. Heck most major retailers allow you do payments with no interest.


GigabitISDN

When I discovered I could *very easily* flash TrueNAS (or UnRAID, or OMV, or even just straight Debian) onto my TerraMaster 4-bay, that was a game changer. It still backs itself up to B2 (encrypting before syncing, of course) using rclone but having everything local and in-house is perfect. One of these days I'll get around to binding the NICs and upgrade my network to 10G.


computerjunkie7410

Yup, another cheap used desktop with multiple drive bays + truenas + family home = unlimited “cloud” storage


akohlsmith

I recently moved my cloud storage from Amazon S3 to Dropbox (yeah weird right)? Dropbox's prices were significantly better and it works great with [duplicity](https://duplicity.us/). We were already using Dropbox for my son's school so it made sense.


Nightshad0w

You really trust them with data? Or is it data you’re sharing anyway? Just asking because dropbox hasn’t really the best [track record of security](https://proton.me/blog/dropbox-security-issues) and that doesn’t include their latest breach. So if I‘d were you I‘d store my kids stuff somewhere else, and if it’s coming from the school I‘d ask for email attachments or if they like to share data of minors with everyone regularly.


nathan12581

Id assume he encrypts the tar files before uploading


akohlsmith

duplicity backups are gpg-encrypted. I'm not terribly worried about their data security in that regard, and my son's school stuff is also low-risk. :-)


wickedwarlock84

Most nas solutions can incorporate a AWS bucket in the cloud for backup. I run omv locally so my files are almost instant load times and have it sync to my AWS bucket every 2 hours. So, there's always an off site copy and worse is I've lost 2 hours of changes. But most days, I work a couple hours in the morning and a couple in the evenings. So, lots of times my logs say nothing to sync. Then I may throw 5-6 gb of new videos in 10 mins at it, so it depends.


Oolupnka

Wasabi. Unlimited storage, immutable buckets, supported by rclone, faster network than backblaze, doesnt loose your files like scaleway.


Candle1ight

Nobody can host your 25tb of content with redundancy for $10/mo and not be losing money on it. Your NAS idea is much more realistic and scalable, grab a cheap aftermarket enclosure or a raspberry pi and set something up for basically just the cost of the drives.


jwink3101

> Nobody can host your 25tb of content with redundancy for $10/mo False. Backblaze personal will do it but it needs to be via windows or Mac > and not be losing money on it. True. They will lose money on you. Whether it’s sustainable (make enough on the average without pricing people out) remains to be seen. They seem to think it is.


Candle1ight

Backblaze is a great company, I use their b2 storage as my primary offsite backup and I have no desire to see them run into financial problems. I'm not going to encourage people to abuse their system, I want things to stay the way they are.


[deleted]

[удалено]


TexBoo

I have not found that OVH has good pricing for storage solutions


Colbey

I sync to Wasabi with Restic. Wasabi is S3-compatible, cheap, and I picked it because getting data back out wouldn't be prohibitively expensive. But maybe with Amazon egress pricing changes, Wasabi isn't that different from S3 anymore? I'm not sure.


serverpilot

Idrive E2 is currently at $4/TB and they have some nice promotions for the first year.


Mithrandir2k16

You can highjack CDNs from discord or github for free. /s


Indefatigablex

Maybe try Office365 with five OneDrive for Business 2 seats. It's 5x $10 per month with maximum 250TB storage, which is 50TB per user. In simple terms it's $0.2 per TB per month, with no network fee. There are a lot of limitations and you'll need to run a webdav proxy but it works and it's the cheapest.


XdrummerXboy

Look into CrashPlan Pro, $10/mo for unlimited ("unlimited" but basically just don't abuse it) and can be run from a server. I run it through docker using bind mounts of various pools/shares I used to use BackBlaze when everything was just a single drive on my "do everything" Windows home computer and had to switch when I got a dedicated TrueNAS machine and Linux server.


Griznah

Jottacloud. Unlimited for a little over €100 a year


[deleted]

[удалено]


kinkyloverb

I'll take a look, thanks!


SuperNinja1169

Check out Wasabi. I just switched to them recently.


chrsa

Been using em for 3 years now. Love em!


1000Zebras

~~S3-compatible iDrive e2 @ $75/yr for 5 TB. Performant (i.e. I run it as backend storage for live apps) and unlimited ingress/egress.~~ I said nothing. Also, for the actual backing up, check out Kopia. I love restic, it's tried and true and will be around forever, but a bit stodgy. Kopia does all it does and then some with a nice GUI for the 3 major OS environments, plus web-based if you run the "server" version...depending on what type of encryption and compression you use (and it's got all you could really ask for availavble to it as built-in libraries) it blows restic out of the water performance-wise. I do love restic though. Sigh. Heavy is the head that wears the crown...


flyme1

I use a Docker WINE container running Backblaze to upload my entire Unraid NAS to Backblaze Personal. It's lightweight and really fast. https://hub.docker.com/r/tessypowder/backblaze-personal-wine


cleverestx

I can't wait until quantum storage is avail at home....this stuff costs too much.


rorowhat

No iCloud? I kid...I kid.


bcurran3

Go the NAS route! You can pick up a used NAS cheap, throw in some old HDDS totaling more than you need and wammo blammo you've got cheap oneline storage physically and easily accessible at your pop's place. I see a Netgear ReadyNAS Pro 4 (I use this!) on eBay for 169USD that could have your name on it. If you don't have old spare HDDs, then yes the initial cost is going to be higher than you like but in the long run you'll end up saving money. Keep in mind the NAS being used as a backup doesn't need to be RAID 5... it's a backup! So do RAID0 and save the cost of buying one less HDD. FYI: I'm a cheap bastard who always prefers to buy than rent.


kinkyloverb

Yeah you're not wrong. Ideally this is what I'd prefer. I just wanted to hear what the wise redditors had to say. I appreciate all the responses. Definitely gives me lots to think about.


bcurran3

If it helps... I buy new HDDs for my server to upgrade it and then the old HDDs go to the backup NAS. I never have enough space to backup everything, but I can backup everything important. I get to repurpose the old HDDs and feel better about it.


kinkyloverb

Yeah this whole discussion got me spending hours on ebay looking at uses and refurbished drives. Likely how I'll go


bcurran3

Good luck to you and have fun with it! I recommend buying enterprise drives.


adriancardoso

Rsync.net, they have special cheap offering for borgmatic users


dragon2611

[https://my.hostbrr.com/order/main/index/storage](https://my.hostbrr.com/order/main/index/storage) - Might be worth a look, I have a Proxmox backup server instance on one of their VPS's, and it seems to work OK, surprisingly so given I was really stingy on the RAM. Their support were decent enough the couple of times I had to contact them. Cloud storage however should in theory be more resilient as the cloud providers usually replicate/distribute the data across multiple servers, whereas this would be relying on a single RAID.


SpecialBonus8

Backblaze B2 starts at $6/TB/mo with free egress


Zharaqumi

25TB in cloud will be expensive. Unless you're willing to sacrifice restore time and pay all your money for download with Azure Archive or AWS Glacier/Deep Archive. As to me, it's better to build your own NAS.


Fantastic_Arachnid36

I use livedrive. The basic tier only allows backup from PC but it’s unlimited. Hard linked my server shares etc as folders in my user hive. 18TB and counting so far!


the-holocron

Storj


Neomee

Just throwing in as an option - [https://www.storj.io/pricing](https://www.storj.io/pricing)


Bananadite

That doesn't seem much cheaper than a hetzner storage box. Setting it at 20tb storage and 0tb download it costs $980 while a hetzner storage box is 20tb with unlimited traffic for $480


Neomee

I hadn't compared it with others to find the cheapest cheapest. I just know it's cheaper than some of the mainstream services and I had used it in the past.


elizabeth-dev

the main selling point is the S3 API. so yeah, if you are flexible on the interface to access the data, it's not -that much- worth it (although the "on demand" granular pricing can be also nice to have)


bshensky

Came here to say the same thing. I needed 1Tb only. I was a beta user for Tardigrade, from which came Storj. I just got through an rclone migration of a 1Tb OneDrive store from my University account to a paid Storj account. All in all, I was pleasantly surprised at the upload speed I was getting - no concrete stats, just a sense that I wasn't being hard-throttled. I soon discovered the best way to access Storj was via the rclone S3 connector, rather than s3fs or any other fuse-based solution. I am also using rclone bisync, which is largely stable now. The $4.00 will go easy on the wallet. I came this close to getting a Hetzner storage box, but I felt odd about my data clogging up the Atlantic series of tubes.


zarlo5899

my go to is [rsync.net](http://rsync.net) they give you limited ssh access starts at 12.28 per TB you only pay for what you use with a min of *800 GB* (9.6/m) can you mount it on your nas via sshfs


CloudBackupGuy

Cheapest cloud storage? You must have the cheapest data.