Infinite Disorder

With this server you can backup large amounts of data (like VMWare VCB backups) and all duplicate data will be ignored. This will usually make 10 TB of backups less than 1TB.

First calculate how much memory you’ll need using this calculation:
<Size of your DeDup Volume in MB> / <blocksize (4 for VMWare images) * 33 = Amount of memory needed in MB

Install ubuntu 10.04 server with openssh server and samba server

scp jdk-7-ea-bin-b98-linux-x64-17_jun_2010.bin.sh root@dedup:~/
chmod 755 jdk-7-ea-bin-b98-linux-x64-17_jun_2010.bin.sh
./jdk-7-ea-bin-b98-linux-x64-17_jun_2010.bin.sh
mv jdk1.7.0 /opt/
add this to ~/.bashrc “export JAVA_HOME=/opt/jdk1.7.0/jre
source ~/.bashrc

sdfs-latest.tar.gz (0.9.2 at the moment)
tar -xvzf sdfs-latest.tar.gz

Create your volume
./mkfs.sdfs –volume-name=sdfs_vol1 –volume-capacity=800GB –io-chunk-size=4 –io-max-file-write-buffers=150

Mount your volume
change -Xmx2g to -Xmx8g for 8GB of memory (modify mount.sdfs)
./mount.sdfs -v sdfs_vol1 -m /dedup
If it hangs on “Mounting Filesystem” then you are in good shape, do some copies to /dedup to make sure java isn’t going to crash. If you don’t see any error messages then its working.

The cache will be located at /opt/sdfs/

OpenDeDup is a very new project, follow it at http://opendedup.org/

Now to setup the samba share, add this to /etc/samba/smb.conf