Jump to content
Welcome to our new Citrix community!
  • 0

NFS Write Speed in VM NFS mount much lower than in VM Storage (also NFS)


Jan Rasche

Question

10 answers to this question

Recommended Posts

  • 0

Thanks Alan and Tobias.

 

Network ist 2x 10 GB LACP with VLANs - no dedicated storage lines here (not my decision).

 

Storage is external NetApp over NFS about this 20GBit on both.

 

VM / writes on NetApp 15K  NFS3 mounted as XenServer storage repository MTU 9000 with 948 MB/s

 

VM /storage writes on NetApp 7K NFS3 mounted with same options with 101 MB/s.

 

So would it help to make this /storage NFS mount in a XenServer Repository/VDI instead of mounting it directly in the VM?

 

Best, Jan

 

 

Link to comment
  • 0

Thanks. Yes, no jumbo frames in VM sounds as a very good explanation!

 

 

@tobias You were right - my values above where to big. I hit some write chaching with to small file writen.


Here are more differences only 1:2 with bonnie++.

 

#VM NFS Mount 7.2K Netapp

time bonnie++ -d /storage/bonnie -n 0 -s 50g:64k -u root -f -m nfs_storage
Using uid:0, gid:0.
Writing intelligently...done
Rewriting...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Version  1.97       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine   Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
nfs_storage 50G:64k           100001  10 47815   6           90606   7 573.4  22
Latency                       25606us    3200ms               551ms     531ms

1.97,1.97,nfs_storage,1,1568924445,50G,64k,,,100001,10,47815,6,,,90606,7,573.4,22,,,,,,,,,,,,,,,,,,,25606us,3200ms,,551ms,531ms,,,,,,

real    36m59,844s
user    0m5,108s
sys     2m43,186s

 

# XenServer storage repository NFS mount 7.2 K NetApp

time bonnie++ -d /storage2/bonnie -n 0 -s 50g:64k -u root -f -m nfs_storage_repository
Using uid:0, gid:0.
Writing intelligently...done
Rewriting...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Version  1.97       ------Sequential Output------ --Sequential Input- --Random-
Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine   Size:chnk K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
nfs_storage 50G:64k           175378  20 113748  16           206033  17 476.9  36
Latency                       95629us     172ms               152ms     185ms

1.97,1.97,nfs_storage_repository,1,1568870124,50G,64k,,,175378,20,113748,16,,,206033,17,476.9,36,,,,,,,,,,,,,,,,,,,95629us,172ms,,152ms,185ms,,,,,,

real    17m14,517s
user    0m4,087s
sys     3m0,842s

 

 

Thanks

Jan

Link to comment

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...