This problem has been reported under Debian 32bit (Etch). We could trace it back to a large part to the NAPI mode, which is situated in the network drivers included in the Debian Kernel.
In case you are encountering these problems we recommend rebuilding the Kernel modules (network drivers) or the whole Kernel with the NAPI mode being disabled.
This had provided remedy most of the cases.