Archive for: ‘December 2009’

Linux deduplication with Leesfs

December 21, 2009 Posted by admin

I have been following this project for some time now.  I was busy testing some EMC dedup solutions when I stumbled accross this project.

Lessfs makes use of the fuse kernel module to provide inline data deduplication. Lessfs make use of tokyocabinet to do it’s file compression and storage.  Although Lessfs is not ready for primetime use as yet you can read more about it at http://www.lessfs.com/wordpress/

Here is a quick howto using the detault install

wget http://1978th.net/tokyocabinet/tokyocabinet-1.4.41.tar.gz

tar -zxvf tokyocabinet-1.4.41.tar.gz

[root@test ~]# cd  tokyocabinet-1.4.41
[root@test tokyocabinet-1.4.41]#  ./configure  –prefix=/usr; make; make install

I downloaded the source code from the lessfs download site.

wget http://downloads.sourceforge.net/project/lessfs/lessfs/lessfs-0.9.5/lessfs-0.9.5.tar.gz?use_mirror=voxel

wget http://downloads.sourceforge.net/project/fuse/fuse-2.X/2.8.0/fuse-2.8.0.tar.gz?use_mirror=hivelocity

next we build the fuse userspace tools

tar -zxvf fuse-2.8.0.tar.gz

cd fuse-2.8.0

[root@test fuse-2.8.0]# ./configure  –prefix=/usr

[root@test fuse-2.8.0]# make

[root@test fuse-2.8.0]#make install

Next I build an RPM from the source

rpmbuild  -ta lessfs-0.9.5.tar.gz

Wrote: /usr/src/redhat/RPMS/i386/lessfs-0.9.5-1.i386.rpm
Wrote: /usr/src/redhat/RPMS/i386/lessfs-debuginfo-0.9.5-1.i386.rpm
Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.62869
+ umask 022
+ cd /usr/src/redhat/BUILD
+ cd lessfs-0.9.5
+ rm -rf /var/tmp/lessfs-0.9.5-1
+ exit 0

rpm -ivh /usr/src/redhat/RPMS/i386/lessfs-0.9.5-1.i386.rpm
Preparing…                ########################################### [100%]
   1:lessfs                 ########################################### [100%]

lessfs  will not work do to kernel version (lower version)
required kernel version is 2.6.26