I am trying out lmdb as an inverted index storage. My usage pattern is very write-heavy

initially (by appending a lot of small bits to existing keys) and when the indexing is

done, there is only read-access needed.

 

During testing I found that write speed decreases with the amount of appends done to the db.

So I wonder if it would bring any benefit, if I write the existing key/value pairs to a second db

(after a certain amount of values appended). The purpose would be to "compact" the values

into one big memory blob per key (this time overwriting values instead of appending).

Would this gain a bit of speed?

 

-Tom