top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

RedHat: NFS v4 Performance degradation

0 votes
308 views

I recently migrated approximately 100 rhel 6 machines from NFS3 to NFS4 (server is rhel 6.6, clients are a mix from 6.3 to 6.6). Things went pretty smooth until several hours into the new configuration, then things started
running very slowly. Restarting the nfs server process clears the issue which seems to indicate the server is the problem.

The file system itself can do some very high io throughput, on the order of 1GB/sec sustained and the "th" values in /proc/net/rpc/nfsd never increase which indicates i/o's are completing on time with no thread starvation. The server itself is set for 384 threads. During the previous NFS3 config the thread count was much higher and had no problems.

I suspect file locking as the primary application in use ( an in house app) uses a lot of little startup scripts which call other scripts to set up the environment etc. Under normal circumstances this startup takes about 6 seconds. Over time that duration increases up to 30 and even 70 seconds in some cases.

I've scoured every reference to nfs4 performance degradation I could find but nothing seems to call out what we are experiencing. A few retrans exist in nfsstat but nothing that stands out. Generally, everything "look" OK but
clearly is not.

Oh, and this is all being run over 10G Ethernet. If memory serves, I believe the kernel is 2.6.2-504.8.1 on the server.

Any ideas about what else to check would be greatly appreciated.

posted May 6, 2015 by anonymous

Looking for an answer?  Promote on:
Facebook Share Button Twitter Share Button LinkedIn Share Button

Similar Questions
0 votes

I'm facing some trouble setting up a 13.04 server (amd64) which I want to use Ethernet bonding and NFS mounted volumes.

I've read the ubuntu tutorial about Ethernet bonding but seems the machine try to mount NFS volumes BEFORE the network comes up , the result is the volumes are not mounted at boot up.

Please help.

+1 vote

It is so slow that i started hating git (for wrong reasons)i'm sure there is a way out, please help me to make my git faster.

0 votes

I get FAILED TO START LOAD KERNEL MODULES during the boot.

Everytime Kernel is updated VirtualBox modules fail I have to reboot into the new Kernel, run the following commands and then it starts working.

$ sudo akmods --force
$ sudo dracut -v -f
$ sudo grub2-mkconfig -o /boot/efi/EFI/fedora/grub.cfg

Then everything starts working again and the boot error goes away. My question is how can I automate this task.

+1 vote

Has any one used resizefs module with cloud-init on centos/redhat before? How to call it with #cloud-config user data, do I need to give it any parameters? I googled cloud-init, but it is pretty difficult to find a manual/book on this, and mostly they are Ubuntu based.

If possible, I'd like to use a same image/AMI to boot up instances(VMs) with different disk size setup, and let cloud-init to take care of increasing partition size, and file system re-sizing. Is it possible for centos/redhat?

0 votes

Wonder how's the relationship between the centos 6's main OS/ repository and redhat 6's repositories. Let's say, Redhat 6 seperate RPMs into a series of repos like:

redhat-6-server ##(base redhat 6 OS/)
redhat-6-server-optional
redhat-6-server-supplementary
redhat-6-server-rhev-agent
rhel-6-server-cf-tools
...

Does centos 6 merge all the redhat 6 repos into one big repository? or still leave out some minor/functional ones? If the second is true, then it will be great if we can find the repo mapping link between Redhat 6 and centos 6.

...