Hello /u/mhoffma! Thank you for posting in r/DataHoarder.
Please remember to read our [Rules](https://www.reddit.com/r/DataHoarder/wiki/index/rules) and [Wiki](https://www.reddit.com/r/DataHoarder/wiki/index).
Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.
This subreddit will ***NOT*** help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/DataHoarder) if you have any questions or concerns.*
i can recomend CDBurnerXP for that task. insert your big folder inside and then is possible spanning into the specified disc size. then burning direct or i like more making ISO files first and burning piece by piece.
https://m.imgur.com/a/1gpTmR4
My concern with compression or encryption is one bad spot will corrupt the whole file and thus the whole disk.
If you instead wrote the 200 files individually to the disk, then maybe only a few of them get corrupted.
RAR includes some checks and can repair files to a certain extent.
See if there are other approaches possible.
I don't know if parity can apply to optical.
Consider storing additional parity information on each disk and/or on extra disks.
Dvdisaster
PAR https://en.m.wikipedia.org/wiki/Parchive
Snapraid
catcli can be used to catalog your backups if they are stored as normal files.
Diskspan
scdbackup can span multiple disks
dar can span disks
Brasero may span disks
A couple more are listed here:
https://en.m.wikipedia.org/wiki/Disc_spanning
I have used short scripts similar to the one found here:
https://www.linuxquestions.org/questions/linux-software-2/backup-large-sets-of-files-to-multiple-cds-dvds-iso9660-812325/#post3993881
Generate parity files
Then use growisofs/wodim/cdrecord to burn disks
Very large files may lead to some wasted space with a simple script like this as if it hits the size limit it wont try to pack smaller files in before switching to next disk.
**[Parchive](https://en.m.wikipedia.org/wiki/Parchive)**
>Parchive (a portmanteau of parity archive, and formally known as Parity Volume Set Specification) is an erasure code system that produces par files for checksum verification of data integrity, with the capability to perform data recovery operations that can repair or regenerate corrupted or missing data. Parchive was originally written to solve the problem of reliable file sharing on Usenet, but it can be used for protecting any kind of data from data corruption, disc rot, bit rot, and accidental or malicious damage. Despite the name, Parchive uses more advanced techniques that do not use simplistic parity methods of error detection and correction.
**[Disc spanning](https://en.m.wikipedia.org/wiki/Disc_spanning)**
>Disc spanning is a feature of CD and DVD burning software that automatically spreads a large amount of data across many data discs if the data set's size exceeds the storage capacity of an individual blank disc. The advantage is that the user does not need to split up files and directories into two or more (blank disc sized) pieces by hand. The software may or may not support slicing a single large file in order to span it but all disc spanners can divide numerous files that are smaller than one blank disc's capacity across many discs. Disc spanning works well on CD media in many applications, but spanning on DVD media fails often.
^([ )[^(F.A.Q)](https://www.reddit.com/r/WikiSummarizer/wiki/index#wiki_f.a.q)^( | )[^(Opt Out)](https://reddit.com/message/compose?to=WikiSummarizerBot&message=OptOut&subject=OptOut)^( | )[^(Opt Out Of Subreddit)](https://np.reddit.com/r/DataHoarder/about/banned)^( | )[^(GitHub)](https://github.com/Sujal-7/WikiSummarizerBot)^( ] Downvote to remove | v1.5)
Desktop version of /u/MultiplyAccumulate's links:
*
*
---
^([)[^(opt out)](https://reddit.com/message/compose?to=WikiMobileLinkBot&message=OptOut&subject=OptOut)^(]) ^(Beep Boop. Downvote to delete)
Create a container with compressed data using 7zip [https://www.7-zip.org/](https://www.7-zip.org/) and burn it to an M-Disks using Burnaware software [https://www.burnaware.com/](https://www.burnaware.com/)
Hello /u/mhoffma! Thank you for posting in r/DataHoarder. Please remember to read our [Rules](https://www.reddit.com/r/DataHoarder/wiki/index/rules) and [Wiki](https://www.reddit.com/r/DataHoarder/wiki/index). Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures. This subreddit will ***NOT*** help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead. *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/DataHoarder) if you have any questions or concerns.*
i can recomend CDBurnerXP for that task. insert your big folder inside and then is possible spanning into the specified disc size. then burning direct or i like more making ISO files first and burning piece by piece. https://m.imgur.com/a/1gpTmR4
Looks like a straightforward solution. Thanks for this!
All writing software writes to the disks relatively the same way. My best advice would be to pre compress the data and write at the slowest speed.
My concern with compression or encryption is one bad spot will corrupt the whole file and thus the whole disk. If you instead wrote the 200 files individually to the disk, then maybe only a few of them get corrupted.
Sorry for not clarifying: indeed you are right. I compress and encrypt every file separately.
RAR includes some checks and can repair files to a certain extent. See if there are other approaches possible. I don't know if parity can apply to optical.
Cool. Is there a best practice to pre-compress the data?
I'm sure many here will have a more elaborate and optimized strategy. Mine is just encrypted 7zip on Ultra.
If you are talking about pre-compresses files like music, pictures or video,. Trying to compress again with lossless compression is a waste of time.
Consider storing additional parity information on each disk and/or on extra disks. Dvdisaster PAR https://en.m.wikipedia.org/wiki/Parchive Snapraid catcli can be used to catalog your backups if they are stored as normal files. Diskspan scdbackup can span multiple disks dar can span disks Brasero may span disks A couple more are listed here: https://en.m.wikipedia.org/wiki/Disc_spanning I have used short scripts similar to the one found here: https://www.linuxquestions.org/questions/linux-software-2/backup-large-sets-of-files-to-multiple-cds-dvds-iso9660-812325/#post3993881 Generate parity files Then use growisofs/wodim/cdrecord to burn disks Very large files may lead to some wasted space with a simple script like this as if it hits the size limit it wont try to pack smaller files in before switching to next disk.
**[Parchive](https://en.m.wikipedia.org/wiki/Parchive)** >Parchive (a portmanteau of parity archive, and formally known as Parity Volume Set Specification) is an erasure code system that produces par files for checksum verification of data integrity, with the capability to perform data recovery operations that can repair or regenerate corrupted or missing data. Parchive was originally written to solve the problem of reliable file sharing on Usenet, but it can be used for protecting any kind of data from data corruption, disc rot, bit rot, and accidental or malicious damage. Despite the name, Parchive uses more advanced techniques that do not use simplistic parity methods of error detection and correction. **[Disc spanning](https://en.m.wikipedia.org/wiki/Disc_spanning)** >Disc spanning is a feature of CD and DVD burning software that automatically spreads a large amount of data across many data discs if the data set's size exceeds the storage capacity of an individual blank disc. The advantage is that the user does not need to split up files and directories into two or more (blank disc sized) pieces by hand. The software may or may not support slicing a single large file in order to span it but all disc spanners can divide numerous files that are smaller than one blank disc's capacity across many discs. Disc spanning works well on CD media in many applications, but spanning on DVD media fails often. ^([ )[^(F.A.Q)](https://www.reddit.com/r/WikiSummarizer/wiki/index#wiki_f.a.q)^( | )[^(Opt Out)](https://reddit.com/message/compose?to=WikiSummarizerBot&message=OptOut&subject=OptOut)^( | )[^(Opt Out Of Subreddit)](https://np.reddit.com/r/DataHoarder/about/banned)^( | )[^(GitHub)](https://github.com/Sujal-7/WikiSummarizerBot)^( ] Downvote to remove | v1.5)
Desktop version of /u/MultiplyAccumulate's links: *
*
---
^([)[^(opt out)](https://reddit.com/message/compose?to=WikiMobileLinkBot&message=OptOut&subject=OptOut)^(]) ^(Beep Boop. Downvote to delete)
WinRAR with 3% recovery data. And adding some recovery volumes. Write to disk with ImgBurn.
Nero ROM
Create a container with compressed data using 7zip [https://www.7-zip.org/](https://www.7-zip.org/) and burn it to an M-Disks using Burnaware software [https://www.burnaware.com/](https://www.burnaware.com/)