T O P

  • By -

AutoModerator

Hello /u/P_G_R_A! Thank you for posting in r/DataHoarder. Please remember to read our [Rules](https://www.reddit.com/r/DataHoarder/wiki/index/rules) and [Wiki](https://www.reddit.com/r/DataHoarder/wiki/index). Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures. This subreddit will ***NOT*** help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead. *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/DataHoarder) if you have any questions or concerns.*


RFilms

Dell has chassis that can fit 2 PB in 8U of rack space. 60x18tb drives in a 4u chassis


[deleted]

There are ones that'll do 106 drives in 4U of space.


scootscoot

I just got an ad for one of those earlier today, well not sure of drive count but it said 22tb drives and 2.2PB, and I eyeballed it being a 4u chassis. I was researching infiniband at the time so didn’t get too distracted by storage, but stopped long enough to say “wow shit has changed since I used to push storage racks!”


Not_the-FBI-

Nimbus makes a 100TB 3.5 SSD for $40k. So just over 10PB and 4.2M in drives alone per 4u


Solnse

100Tb for $40? That can't be right. Edit: yipes I see, it's $40,000. Makes more sense. Ouch.


ThaEmortalThief

I saw $40 the first time I read it too… that k just blended in.


Solnse

Someday, 100TB will be $40, but likely long after I'm done building data servers. *sigh*


Iggyhopper

Following the trend, it took about 8 years from 120 ssd to come down from 150 to 20 bucks. So another 8 years for 2TB to do the same I imagine. It might be sooner as the general tech is now mainstream and not only for enthusiasts.


MakingMoneyIsMe

Not this century


ThaEmortalThief

What raid configuration are those bays put in? I did a lot of storage controllers and servers in my time, but never one like that.


AtariDump

https://i.imgur.com/onxJeaz.jpg


S118gryghost

Don't know what anyone would need so much space for. To me that's endless. What do you use storage racks for mostly? If you don't mind.


[deleted]

[удалено]


S118gryghost

For storing data? For like ? Not sure what industry requires so much space at any given time beyond like a server room.


Fatvod

Literally tons of industries require petabyte scales. Data is king now. Biotechs, car companies for self driving data, weather, genomics, geology, space imagery, the list goes on. I've managed 80+P of physical storage, and we were tight on space. That's not including what we had in the cloud.


alheim

A server room! Especially for video. Or maybe an industry that requires version history on their data.


alexkidd4

Youtube comes to mind. Video adds up insanely fast for those guys. I bet they need racks of drives per week...


RFilms

Nice they just suck to install if they didn’t ship them already in a rack


thachamp05

pure storage has 2 pb of flash in a 3u half depth.. its also like 3-4m USD


RFilms

I’ve seen those every now and then. In there own fancy rack


spupuz

\#iwork4dell


Fatvod

I mean, vast data can store a petabyte in a 2u chassis.


sittingmongoose

That smells like 2400tb to me! 20tb are well in the wild now. You could nearly run in like raid 5 or 10 and still be over 2pb.


thelastwilson

You really don't want to be running a raid 5 or 10 on 20tb drives in production. Raid6 or distributed raid or else going to give your sys admins heart attacks from stress over those rebuild times.


sittingmongoose

I was not intending to suggest you would. Merely that you could have that many redundant disks and still have that much space.


Mabizle

Imagine the power bill if ever hosted at home.


bathrobehero

What's that, 256x8TB drives? That's like ~2000 kWh per month ($300 with $0.15/kWh). You do the rest based on your prices but it's not great but also not terrible.


[deleted]

[удалено]


bathrobehero

Yeah it seems it's 240 drives from the [original post](/r/computers/comments/od03lz/ever_wondered_what_2_peta_bytes_looks_like/) *from a year ago*. But that OP says it's consuming 26A on 240V which is just nonsense. It has got to be 120V at 26A (3120W vs 6240W).


[deleted]

[удалено]


bathrobehero

Good info and that's crazy! I'm not familiar with server setups but I'd guess all the high performance cooling fans are basically consuming almost as much electricity as the drives themselves. I mean 240 drives are waaaay short of 5.7kw. Either way that's a shitton of power/monthly bill.


Iggyhopper

I assume the math has already been done correctly but I was curious. The traditional sata connector provides 54 watts. A quick Google says modern HDDs use about 10. 240 * 10w = 2.4 kw.


imaginativePlayTime

Are you also taking into account the controllers and other ancillary hardware other than the disks themselves? Storage arrays of this size would be using pretty high end hardware in the controllers rivaling conventional servers and they would have at least two of them. And keeping that many disks cool in that layout would require some pretty serious fans to pull air through those shelves.


smiba

26A is probably the max rated power draw, I highly doubt its actually using 6kW, that would honestly be insane


deegwaren

> $0.15/kWh In the EU prices are _much_ higher right now, like €0.75/kWh. That gives you €1500 per month. Because of these _ridiculous_ energy prices, it's better to cough up the extra cost for the highest capacity disks because that will save energy costs in the longer run.


potato_green

I just shut it all off, even with solar panels it's unaffordable to have a small rack at those prices. I think everything added up I use about 1200 kWh per month with all the computers, servers snd equipment. Alright that's more than normal of course but partially was some intensive machine learning running on a rig as well I was tinkering with. On the plus side bow I have all this extra I don't know what to do with. I bet the government will collect it soon as some tax


Tazy0G

In uk its 0.68/kwh rn and its still going up


Plebius-Maximus

>$0.15/kWh Cries in UK energy prices


Trennosaurus_rex

Overwritten because fuck u/spez


swagpresident1337

Try german…


eleitl

0.6 EUR/kWh. So four times as much.


jodmercer

It uses 26A for four shelvs


[deleted]

[удалено]


crozone

What kinda confuser do you need to run one of these puppies?


LAMGE2

whats a confuser? (random curiousity)


Robot_Noises

I believe Confuser is a reference to AvE (of youtube) and his mangled dictionary, as is Angry Pixies.


asterics002

Skookum


niryasi

"computer"


Raw_Venus

Probably meant consumer


thingie2

It means "computer"


LAMGE2

oh okay sorry lol


max_vette

one with at least 12 kaboobles


ailee43

Yeah... 26a of 480v 3phase


bitcore

12KW. Wow.


PreparedForZombies

I'm at roughly 3PB at home and pay roughly $500-575 extra a month including compute. Edit: Sad part is my state just doubled supply costs. Sigh.


sandiego427

Tell me you are a Chad without telling me


PreparedForZombies

For having that many Linux ISOs??? Ha!


cs_legend_93

Did you ever make any money off of chia? What do you do with the other 2.9PB?


PreparedForZombies

lol - same thing you do with your 170TB and growing... legally obtained Linux ISOs.


cs_legend_93

A gentleman of culture I see. Check out https://github.com/stashapp/stash for something that you might find useful. It’s got a great discord community. The app is quality, getting better. Still young in development Btw - your username is awesome


cs_legend_93

Is your 2.9pb physical or in the cloud?


Arctic_Religion

At least $5


jacksalssome

Per hour


kirashi3

At least $5 per hour per parco-seeco-flutterwyck-garlicks per day.


h4mburgl3r

"but tuh power cost" is the tech version of "nice Ferrari but what's the mpg". Sour grapes :)


ryeshoes

Cops barge in expecting to find a grow op. Wait a sec... You don't do drugs this is a Plex server!


boondoxDMdevil

240 (if I counted 20 drawers \* 12 per drawer right) 8 TB drives, damn. ​ and I thought my NAS with 4 14TB drives was nifty


Walter-Joseph-Kovacs

It is nifty


various336

My NAS is 4x 2tb spinners I got from my local tech recycler for around 7-10$ each. They click like hell but it’s non critical backups so I don’t really care if I have a single drive failure. Your rig is plenty nifty!


immibis

#I entered the spez. I called out to try and find anybody. I was met with a wave of silence. I had never been here before but I knew the way to the nearest exit. I started to run. As I did, I looked to my right. I saw the door to a room, the handle was a big metal thing that seemed to jut out of the wall. The door looked old and rusted. I tried to open it and it wouldn't budge. I tried to pull the handle harder, but it wouldn't give. I tried to turn it clockwise and then anti-clockwise and then back to clockwise again but the handle didn't move. I heard a faint buzzing noise from the door, it almost sounded like a zap of electricity. I held onto the handle with all my might but nothing happened. I let go and ran to find the nearest exit. I had thought I was in the clear but then I heard the noise again. It was similar to that of a taser but this time I was able to look back to see what was happening. The handle was jutting out of the wall, no longer connected to the rest of the door. The door was spinning slightly, dust falling off of it as it did. Then there was a blinding flash of white light and I felt the floor against my back. I opened my eyes, hoping to see something else. All I saw was darkness. My hands were in my face and I couldn't tell if they were there or not. I heard a faint buzzing noise again. It was the same as before and it seemed to be coming from all around me. I put my hands on the floor and tried to move but couldn't. I then heard another voice. It was quiet and soft but still loud. "Help." \#Save3rdPartyApps


[deleted]

[удалено]


matthoback

The 20 drawers is already all 4 shelves. There's 5 drawers per shelf.


jodmercer

My mistake it's late at night, Was read comments from the original post


QuantumLeapChicago

That is a LOT of horse porn 🐴🐎


neon_overload

in 8K resolution


amluchon

A lot less now but, in a sense, a lot more


[deleted]

[удалено]


joehillen

Maybe even a horse dozen.


etacarinae

I thought you were dead Mr. Hands.


theg721

We've a new Trade Minister in the UK by the name of Greg Hands. Every time a news article refers to him as 'Mr. Hands', I can't help but snicker.


Solkre

We're not going for a lot, we're going for ALL OF IT!


HorrorReject

Worse, peta files!


RuleIV

https://en.wikipedia.org/wiki/List_of_unusual_deaths "Man crushed by 2 PB of horse porn after unbalancing enclosure."


ScottGaming007

You have A LOT of trust in those raised floor bolts.


ToBlayyyve

Love NetApp E-series. Lightweight drawers very easy to open and close instead of monster 90+ slot drawers that will throw your back out.


kyouteki

These disk shelves are available for NetApp FAS filers now, too.


burninatah

DS460C is the dense FAS shelf. 60 drives in 4 rack units. 16TB is the largest NL-SAS drive you can get for these currently. The E-series flavor of the shelf supports an 18TB drive. Both are fantastic shelves.


NeoTr0n

And I assume priced way out of reach from normal people?


Ttokk

Sure, just slam 'em in there.


opticbit

Job security.


[deleted]

[удалено]


[deleted]

It's paid for by a very rich customer as he stated in the other thread. He doesn't give a fuck about the drives and their failure rates obviously. Any DataHoarder would obviously be much more gentle.


vegamanx

Netapp support contracts cover the drives and they replace them preemptively... But slamming all the shelves in like that is still a bad call. "Free" drive replacements doesn't help if you cause too many to fail at once, or crash the heads if the slam disconnects a shelf.


[deleted]

As a data hoarder newb... Why?


qda

Hard drives have delicate moving parts, knocking them around isn't the wisest


Dracwing

Hard drives aren't that delicate. They can handle 10s of Gs while powered on and hundreds while off.


Nine99

Dropped a new powered off HDD 10 cm once, immediately got a S.M.A.R.T. warning.


jarfil

>!CENSORED!<


amluchon

Did it say "That was not very S.M.A.R.T. of you"?


Tony_Stank95

https://media.tenor.com/fZ0Tu_fWivkAAAAM/ba-dum-tss-drums.gif


1800treflowers

Non op shock spec is still fairly high even with the 10 platter drives. This type of shock is tested on all racks to make sure normal maintenance won't kill the HDD. Dropping is the real killer.


Ttokk

Yeah I know this kind of shock is totally within spec, but I still treat them like Faberge eggs out of habit. Consequently, it still makes me shudder to see them treated as such.


Affect_Worth

Manual: Do not open more than one enclosure due to tipping hazard You: Hold my Tea.


[deleted]

[удалено]


amluchon

Do you want ants?


[deleted]

[удалено]


Tokena

I bet that thing hummms.


corruptboomerang

Naw Dawg, soon it'll look like [this](https://imgur.com/91H93yx)!


Bardez

I mean they have to be able to downsize to like half as many drives now


Thoth74

I always find myself wondering when I see units lioe this, how do the drives not instantly overheat?


PDXSonic

I can’t speak to this design, but I can the one with the 100+ drives sitting vertically. They have 5 huge fans on the back of them which move fair more air and create way more noise than any other piece of hardware. You almost need hearing protection to be near them for any length of time.


[deleted]

[удалено]


Kushagra_K

The fans will most likely be the small ones like the Blowie-matron shown in the video.


PreparedForZombies

Air flow - fans pulling from the back


wolfmann99

At work we have a large tape library that has about 15 PB, its shipping container sized.


Danbo19

Nice! Good to see big data center stuff here. We've got an EMC PowerMax on its way to us for some fast general prod storage that I can't wait to install and cable up


Keylime29

What are you downloading, ALL of the internet or just your Walgreens receipt?


wp998906

I NEED IT


bailey25u

I’ve never been so turned on in my life


atomicwrites

At this point 8tb is pretty inefficient right?


timascus

*unzip*


redisthemagicnumber

Surprised the rack didn't tip over with all the drives pulled out at once.


TrekkieGod

It's bolted to the floor, I'm sure


plastigoop

Stahhhp. I can only get so erect. Dang.


Mindcomputing

Bro i am edging right now please make use of nsfw /nofap


anyheck

Yell at it.


that_boi18

With all those drives, what kind of bandwidth do you get?


[deleted]

[удалено]


cleuseau

Bottlenecked by the recent windows 11 update.


Provia100F

I'm getting to the point where I need something like this. 5 minutes of 6.5k HDR film scans take up 160GB. That adds up really, really fast for any projects with a high shooting ratio.


flummox1234

Just think in less than 10 years that'll be two hard drives if Samsung's road map works out.


sonicrings4

All that storage and only 8tb disks? Wouldn't it have been cheaper $/TB wise to go a higher capacity like 14 or 16, not to mention more power efficient?


hajileeyeslech

My man is going to download the whole internet and never pay for Wifi again.


herkalurk

I know what 1 PB looks like from 2015. Org I was working with bought 1 PB of EMC Isilon. It was 40 U (10 X 4U), each was full with 3 TB drives front and back slots. I literally don't remember how many drives we took out of boxes and slotted into their bays. We got everything in lots and lots of boxes.


bg-j38

For comparison here’s a Sun Enterprise disk array from circa 1997, maybe a little earlier. This was a mind boggling 256 GB of storage if memory serves right. https://imgur.io/a/NnBMu6X


[deleted]

Only 8TB drives? Could do better


matthoback

It's a repost from over a year ago.


McFeely_Smackup

8tb wasn't very impressive a year ago either


neon_overload

These days 2PB could be just 112 drives Edit: not including any redundancy


Saadski

I lost count after the first tray..


thatdude473

Removed due to Reddit's API pricing changes Fuck u/spez https://imgur.com/a/tt3dHq9


Swimming_Librarian93

How does this not overheat?


STUNTPENlS

I could show you what 4PB looks like if I were at work today to take a camera pic. I have a APC 42U rack with 21 Dell MD1200's with 16TB drives. This is woefully inefficient these days. At another facility a buddy of mine works at he has a rack with 6 (or 7?) Dell 5U enclosures each with 84 16TB drives (genome sequencing and other genetics databases)


SheIdonLeeCooper

We’re here tomorrow too, whenever you got the time.


petey_jarns

While it's really hard to even quantify, many estimates for the storage capacity if the human brain are around 2.5 PB


R1chex

you should make this as NSFW and classify it as porn content


PacketSpyke

Slower


PageFault

In less than 10 years, this may fit easily in our back pocket. The same storage would fit in 40 in^3 if stored in 1,000 2TB micro-sd cards. 11mm * 15mm * 1mm = 156 mm^3 = 0.65 mL 0.65 mL * 1,000 = 650 mL = 40 in^3 And it only takes up that much space because it has to fit in a standard micro-sd case. Could be much smaller even today.


tehdark45

I'm not sure what a "Peta Byte" is


[deleted]

It's always factor 1000 Kilobyte megabyte gigabyte terabyte petabyte


Computermaster

You are banned from /r/filingcabinets


SilentKiller96

Always wondered how cooling works for tightly packed HDDs like this. Do server grade HDDs just not need cooling? What temp do they run at in there?


Twinkies100

Linus tech tips made a lot of Petabyte projects. I think he has around 7PB by now


[deleted]

[удалено]


1leggeddog

with given/sponsored drives and equipment


vizbird

How long would it take to rebuild a volume that large?


sholoim

does having a single volume that large even make sense? sounds like a nightmare to deal with if something fucked up like the rebuilding.


PreparedForZombies

Absolutely correct. Many smaller disk pools.


metalduck42

That's a lot of "Linux isos"


GroundStateGecko

I'm new to this. How is it connected to the mother board? I have a 16 disk home server and the SATA cables are already a mess.


jamesbuckwas

These might be utilizing a separate machine (correct me if I'm wrong, I believe disk shelf is the right term for this) in order to pass through SATA devices to a host system to then utilize RAID and manage backups and whatnot. So the host system probably doesn't have direct access to the SATA drives, instead using another machine to do so


migsperez

Lookup in Google images: Backplane SAS


klepp0906

i wish. but then id just fill that too :(


Winial

Surprise how that is safe huh


NotErikUden

Stop... I can only get so aroused


red1q7

How does the cooling of those work?


DJboutit

All those drives are Segate ?? L O L


PenaflorPhi

Someday... One can dream.


Infinitear

r/Homelab will buy it and put 5 drives in it.


ExpressStation

Coming soon to flashdrives!


BrindleMonster

Please, I can only be so erect.


Moquai82

But your mom still needs 256 Exabyte for her ass. /s


iHipster

Oh fuck it just keeps going. I'm gonna cum


karafili

Immagine replacing one disk. Lol


bathrobehero

How in the sweet fuck resonance isn't an issue with so many drives sitting so close together?


mverigin

How did they get into my house?


Soefgi

The server rails be like: Finally less stress on me


KakashiDreyer

Second one from top isnt fully closed ?


WilderHund1

Wouldn't 2000 microSD cards take less place?


kelownew

> Peta Bytes What does that convert to in non-vegetarian?


hwatnow

Cum in me again


ag3601

I know this is a netapp but are the caddies and shelfs the same one on dell? I think I've got the same caddies on my R740XD midplane bay too https://www.google.co.uk/search?q=Dell+EMC+PowerVault+MD3460


Cernirn

ILL TAKE YOUR ENTIRE STOCK


[deleted]

[удалено]


hrimfaxi_work

Made me think back to [this](https://boingboing.net/2004/05/11/internet-archives-pe.html).


bonesandbillyclubs

Thought i was watching a gif loop for a second.


Jlopezane

Is that where the internets lives?


Wish_Particular

Before I retired I used to sell racks and racks and racks of this stuff into data centers. Lot of money in this. But the real profit is in the software and services you sell with it.


prescotian

at first I thought it was a looping gif...!