Network Block Devices » DNBD

'''''This software is still beta - you use it at your own risk. Please create a ticket if you encounter bugs!'''''

= DNBD =

== Introduction ==

DNBD (Distributed Network Block Device) is a read-only and caching network

block device and supports following main features:

 * replication of servers for robustness

 * multicast communication and caching of network traffic for scalability

These characteristics make it suitable especially for use in wireless networks,

e.g. for diskless clients or to share multimedia files in such an environment.

The servers can export a file or block device equipped with a operating system,

movies, music, etc. Several clients can import the block device and access it

like a local hard disk. However, each block transfer over the network can be

cached by all clients: If several users on each client start to watch a movie

within a certain time interval, the movie data has to be transmitted only once

(depending on the cache size). The network is not burdened with unnecessary

traffic. 

DNBD can be used together with [http://www.atconsultancy.nl/cowloop/ cowloop] or [http://www.fsl.cs.sunysb.edu/project-unionfs.html unionfs] in order to get local

write semantics, e.g. for diskless clients. Especially in wireless environments

with limited bandwidth, caching can increase boot-up time enormously.

== Question, problems etc. ==

If you encounter any difficulties, please use search to find out if the problem is 

already known. Also, the [wiki:FAQ FAQ] will contain typical problems.

== Download ==

The source code can be retrieved from the subversion repository.

{{{

$ svn co http://lp-srv02a.ruf.uni-freiburg.de/svn/dnbd

}}}

== Compilation ==

DNBD was developed for kernel 2.6.13 and later releases. For kernels later than 2.6.16 you will need to remove the "devfs" source from ''kernel/main.c'' (simply search for "devfs" and remove all calls and includes). Kernel 2.4 is not supported. The kernel sources and common tools (gcc, make, etc.) have to be installed.

=== Server and Client ===

Compiling:

{{{

$ cd dnbd; make

}}}

== USAGE ==

=== Server ===

To show available command line parameters, start the server without

arguments:

{{{

$ ./server/dnbd-server

dnbd-server, version 0.9.0

Usage: dnbd-server -m <address> -d <device/file> -i <number> 

                  [-t <threads>]

description:

  -m|--mcast     <multicast address>

  -d|--device    <block device or file>

  -i|--id        <unique identification number>

  -t|--threads   <number of threads>

}}}

With the following command, the server will be started for the multicast

network with address 239.0.0.1 and export the given file or block device.

Its unique id is 1:

{{{

root@server1 $ ./server/dnbd-server -m 239.0.0.1 -d <partition/file> -i 1

}}}

To start a server on another computer, the used file or block device must have

the same content and size as on the first server. However, the id has to be

changed:

{{{

root@server2 $ ./server/dnbd-server -m 239.0.0.1 -d <partition/file> -i 2

}}}

If DNBD is used for wired networks and on multi-processor machines, the

number of threads should be increased to the number of CPUs.

To access the exported file or block device, another computer is used as 

client.

=== Client ===

The kernel module has to be loaded, before the client application can be used:

{{{

root@client1 $ insmod ./kernel/dnbd.ko

}}}

There should be an entry in syslog after successful loading. With no command

line arguments the client gives available options:

{{{

root@client1 $ ./client/dnbd-client

dnbd-client, version 0.9.0

Usage: dnbd-client -d device -b <address> [-c <file>]

    or dnbd-client -d device -u

    or dnbd-client -d device -c <file>

description:

  -d|--device    <device>

  -b|--bind      <multicast-address>

  -u|--unbind    

  -c|--cache     <file>

}}}

We will now import the block device of the server, e.g.:

{{{

root@client1 $ ./client/dnbd-client -d /dev/dnbd0 -b 239.0.0.1

}}}

The client should tell you that it found a server with id "1". If you exported

a CDROM with a movie, you can watch it on the client over the network, e.g.

with mplayer (usually after mounting).

If someone else wants to watch the movie on a different client, you should

enable caching either during operation

{{{

root@client1 $ ./client/dnbd-client -d /dev/dnbd0 -c <cachefile>

}}}

or at the beginning

{{{

root@client2 $ ./client/dnbd-client -d /dev/dnbd0 -b 239.0.0.1 -c <cachefile>

}}}

To create a cache with, e.g. 32M use

{{{

root@client1$ dd if=/dev/zero of=/tmp/cachefile bs=1M count=32

}}}

Cache statistics are shown with

{{{

root@client1$ cat /proc/driver/dnbd/dnbd0

}}}

The block device has to be unbound before the module can be unloaded:

{{{

root@client1 $ ./client/dnbd-client -d /dev/dnbd0 -u

root@client1 $ rmmod dnbd

}}}

== Files ==

=== Client ===

{{{

./client

   client.c		# client application

}}}

=== Server ===

{{{

./server

   net.c		# network routines

   query.c		# server request handling

   filer.c		# file/device I/O

   server.c		# server application (main file)

}}}

=== Kernel module ===

{{{

./kernel

   net.c		# server management

   queue.c		# queue handling for requests

   cache.c		# cache implementation (red-black trees)

   main.c		# module and block device (un)registration, threads

}}}

== License ==

DNBD is available through the GNU General Public License (GPL).

This distribution is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

The programs in this distribution are distributed in the hope that they will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

See the file COPYING that is also included with this distribution for more details.