--On Thursday, October 7, 2021 6:44 PM +0100 Howard Chu hyc@symas.com wrote:
Jürgen Baier wrote:
Hi,
I'm using LMDB for mapping MD5 hash codes to some data. I noticed that a virtualized environment (Xen/Windows on our own servers and AWS/Windows) slows down LMDB significantly (e.g. a certain workload is executed in 30 minutes on a local machine vs. 15 hours on AWS).
Sounds like whatever filesystem is running on AWS has a really poor implementation of mmap.
How many IOPS is the AWS instance limited to? AWS will rate limit all I/O once you've maxed that to an abysmally low number causing all sorts of problems unless you start shelling out some cash to get decent perf.
--Quanah
--
Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: http://www.symas.com