Skip to content

build a backup server with OpenDeDup

With this server you can backup large amounts of data (like VMWare VCB backups) and all duplicate data will be ignored. This will usually make 10 TB of backups less than 1TB.

First calculate how much memory you’ll need using this calculation:
<Size of your DeDup Volume in MB> / <blocksize (4 for VMWare images) * 33 = Amount of memory needed in MB

Install ubuntu 10.04 server with openssh server and samba server

scp root@dedup:~/
chmod 755
mv jdk1.7.0 /opt/
add this to ~/.bashrc “export JAVA_HOME=/opt/jdk1.7.0/jre
source ~/.bashrc

sdfs-latest.tar.gz (0.9.2 at the moment)
tar -xvzf sdfs-latest.tar.gz

Create your volume
./mkfs.sdfs –volume-name=sdfs_vol1 –volume-capacity=800GB –io-chunk-size=4 –io-max-file-write-buffers=150

Mount your volume
change -Xmx2g to -Xmx8g for 8GB of memory (modify mount.sdfs)
./mount.sdfs -v sdfs_vol1 -m /dedup
If it hangs on “Mounting Filesystem” then you are in good shape, do some copies to /dedup to make sure java isn’t going to crash. If you don’t see any error messages then its working.

The cache will be located at /opt/sdfs/

OpenDeDup is a very new project, follow it at

Now to setup the samba share, add this to /etc/samba/smb.conf

comment = dedup
path = /dedup
valid users = root
public = no
writable = yes
write list = root
printable = no
create mask = 0765
smbpasswd -a root
service smbd restart
You can verify the dedup is working by comparing du -sh to ls -alh or df -h

Post a Comment

You must be logged in to post a comment.