Hello we are using a bunch of 24 NVMe Intel SSD DC P3520.
Being disappointed with Lustre performance (although every possible Lustre/ZFS optimization where applied), I proceeded with testing them one by one
reading and writing as block device.
This is the result I got with the first bunch of 6 disk. I am concerned about read performance and not about write performance which looks fairly good.
w (GB/s) r(GB/s)
nvme0n1 1.1 1.9
nvme1n1 1.1 0.623
nvme2n1 1.1 0.626
nvme3n1 1.1 0.624
nvme4n1 1.0 0.618
nvme5n1 1.1 0.622
given that the first disk was performing well I reformatted them using isdct tool (4K per sector):
isdct start -intelssd 0 -nvmeformat LBAFormat=3 SecureEraseSetting=0 ProtectionInformation=0 MetaDataSettings=0
isdct start -intelssd 1 -nvmeformat LBAFormat=3 SecureEraseSetting=0 ProtectionInformation=0 MetaDataSettings=0
isdct start -intelssd 2 -nvmeformat LBAFormat=3 SecureEraseSetting=0 ProtectionInformation=0 MetaDataSettings=0
isdct start -intelssd 3 -nvmeformat LBAFormat=3 SecureEraseSetting=0 ProtectionInformation=0 MetaDataSettings=0
isdct start -intelssd 4 -nvmeformat LBAFormat=3 SecureEraseSetting=0 ProtectionInformation=0 MetaDataSettings=0
isdct start -intelssd 5 -nvmeformat LBAFormat=3 SecureEraseSetting=0 ProtectionInformation=0 MetaDataSettings=0
then I run again the tests and here is the result:
after reformat
nvme0n1 1.1 2.1
nvme1n1 1.1 2.1
nvme2n1 1.1 2.1
nvme3n1 1.1 1.9
nvme4n1 1.1 2.0
nvme5n1 1.1 1.8
So after being used for some time the performance drops especially the read performance. The DeviceStatus is Healthy though.
Is there any problem related to the firmware automatic TRIM/garbage collection ?
Should I upgrade the firmware ?
currently installed firmware version is MDV10253
thank you