For some reason, test061 routinely fails for back-mdb in HEAD. I've not had luck reproducing the issue with other backends or in RE24.

To eliminate it being a replication delay, I increased the for loop to give 55 seconds time (1 through 10 seconds) chance to replicate. Most of the time the test fails in fewer than 50 iterations (most often fewer than 20), however one time it took as long as 85 iterations before failing.

Interestingly, when the test fails, it is *always* entries 21 through 31 that are missing on slapd instance 2. From slapd.2.log, we can see the failure here:

build@u12build:~/git/symas-packages/thirdparty/openldap/build/UBUNTU12_64/symas-openldap/tests/testrun$ grep syncrepl_message_to_entry slapd.2.log 5892455c syncrepl_message_to_entry: rid=001 DN: dc=example,dc=com, UUID: fe7b6d3e-7d08-1036-8b97-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=1,dc=example,dc=com, UUID: ff6f85e0-7d08-1036-8b98-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=2,dc=example,dc=com, UUID: ff8879a6-7d08-1036-8b99-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=3,dc=example,dc=com, UUID: ff993e26-7d08-1036-8b9a-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=4,dc=example,dc=com, UUID: ffa7a51a-7d08-1036-8b9b-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=5,dc=example,dc=com, UUID: ffb09206-7d08-1036-8b9c-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=6,dc=example,dc=com, UUID: ffc4c78a-7d08-1036-8b9d-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=7,dc=example,dc=com, UUID: ffd25c24-7d08-1036-8b9e-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=8,dc=example,dc=com, UUID: ffe0a4c8-7d08-1036-8b9f-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=9,dc=example,dc=com, UUID: fff34344-7d08-1036-8ba0-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=10,dc=example,dc=com, UUID: 00025b9a-7d09-1036-8ba1-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=11,dc=example,dc=com, UUID: 00142762-7d09-1036-8ba2-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=12,dc=example,dc=com, UUID: 00202eea-7d09-1036-8ba3-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=13,dc=example,dc=com, UUID: 00368172-7d09-1036-8ba4-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=14,dc=example,dc=com, UUID: 004e2fb6-7d09-1036-8ba5-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=15,dc=example,dc=com, UUID: 00641fce-7d09-1036-8ba6-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=16,dc=example,dc=com, UUID: 007a8b56-7d09-1036-8ba7-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=17,dc=example,dc=com, UUID: 00b48a5e-7d09-1036-8ba8-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=18,dc=example,dc=com, UUID: 00ccd636-7d09-1036-8ba9-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=19,dc=example,dc=com, UUID: 00df9186-7d09-1036-8baa-c1adc227e9e3 58924560 syncrepl_message_to_entry: rid=001 DN: ou=20,dc=example,dc=com, UUID: 00f0aef8-7d09-1036-8bab-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=10,dc=example,dc=com, UUID: 00025b9a-7d09-1036-8ba1-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=9,dc=example,dc=com, UUID: fff34344-7d08-1036-8ba0-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=8,dc=example,dc=com, UUID: ffe0a4c8-7d08-1036-8b9f-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=7,dc=example,dc=com, UUID: ffd25c24-7d08-1036-8b9e-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=6,dc=example,dc=com, UUID: ffc4c78a-7d08-1036-8b9d-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=5,dc=example,dc=com, UUID: ffb09206-7d08-1036-8b9c-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=4,dc=example,dc=com, UUID: ffa7a51a-7d08-1036-8b9b-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=3,dc=example,dc=com, UUID: ff993e26-7d08-1036-8b9a-c1adc227e9e3 58924564 syncrepl_message_to_entry: rid=001 DN: ou=2,dc=example,dc=com, UUID: ff8879a6-7d08-1036-8b99-c1adc227e9e3 58924565 syncrepl_message_to_entry: rid=001 DN: ou=1,dc=example,dc=com, UUID: ff6f85e0-7d08-1036-8b98-c1adc227e9e3 58924565 syncrepl_message_to_entry: rid=001 DN: ou=32,dc=example,dc=com, UUID: 032a0142-7d09-1036-8bb7-c1adc227e9e3 58924565 syncrepl_message_to_entry: rid=001 DN: ou=33,dc=example,dc=com, UUID: 0341a072-7d09-1036-8bb8-c1adc227e9e3 58924565 syncrepl_message_to_entry: rid=001 DN: ou=34,dc=example,dc=com, UUID: 03578cb6-7d09-1036-8bb9-c1adc227e9e3 58924565 syncrepl_message_to_entry: rid=001 DN: ou=35,dc=example,dc=com, UUID: 037302f2-7d09-1036-8bba-c1adc227e9e3 58924566 syncrepl_message_to_entry: rid=001 DN: ou=36,dc=example,dc=com, UUID: 03a60a58-7d09-1036-8bbb-c1adc227e9e3 58924566 syncrepl_message_to_entry: rid=001 DN: ou=37,dc=example,dc=com, UUID: 03c72558-7d09-1036-8bbc-c1adc227e9e3 58924566 syncrepl_message_to_entry: rid=001 DN: ou=38,dc=example,dc=com, UUID: 03e5f7b2-7d09-1036-8bbd-c1adc227e9e3 58924566 syncrepl_message_to_entry: rid=001 DN: ou=39,dc=example,dc=com, UUID: 040613e4-7d09-1036-8bbe-c1adc227e9e3 58924566 syncrepl_message_to_entry: rid=001 DN: ou=40,dc=example,dc=com, UUID: 0422b8d2-7d09-1036-8bbf-c1adc227e9e3 58924567 syncrepl_message_to_entry: rid=001 DN: ou=11,dc=example,dc=com, UUID: 00142762-7d09-1036-8ba2-c1adc227e9e3 58924567 syncrepl_message_to_entry: rid=001 DN: ou=12,dc=example,dc=com, UUID: 00202eea-7d09-1036-8ba3-c1adc227e9e3 58924567 syncrepl_message_to_entry: rid=001 DN: ou=13,dc=example,dc=com, UUID: 00368172-7d09-1036-8ba4-c1adc227e9e3 58924567 syncrepl_message_to_entry: rid=001 DN: ou=14,dc=example,dc=com, UUID: 004e2fb6-7d09-1036-8ba5-c1adc227e9e3 58924567 syncrepl_message_to_entry: rid=001 DN: ou=15,dc=example,dc=com, UUID: 00641fce-7d09-1036-8ba6-c1adc227e9e3 58924568 syncrepl_message_to_entry: rid=001 DN: ou=16,dc=example,dc=com, UUID: 007a8b56-7d09-1036-8ba7-c1adc227e9e3 58924568 syncrepl_message_to_entry: rid=001 DN: ou=17,dc=example,dc=com, UUID: 00b48a5e-7d09-1036-8ba8-c1adc227e9e3 58924568 syncrepl_message_to_entry: rid=001 DN: ou=18,dc=example,dc=com, UUID: 00ccd636-7d09-1036-8ba9-c1adc227e9e3 58924568 syncrepl_message_to_entry: rid=001 DN: ou=19,dc=example,dc=com, UUID: 00df9186-7d09-1036-8baa-c1adc227e9e3 58924568 syncrepl_message_to_entry: rid=001 DN: ou=20,dc=example,dc=com, UUID: 00f0aef8-7d09-1036-8bab-c1adc227e9e3

We can compare to a run where things were successful for slapd instance 2:

build@u12build:~/git/symas-packages/thirdparty/openldap/build/UBUNTU12_64/symas-openldap/tests/testrun$ grep syncrepl_message_to_entry slapd.2.log 58924f17 syncrepl_message_to_entry: rid=001 DN: dc=example,dc=com, UUID: cb75b236-7d0e-1036-941d-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=1,dc=example,dc=com, UUID: cc5cfbb4-7d0e-1036-941e-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=2,dc=example,dc=com, UUID: cc70aa1a-7d0e-1036-941f-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=3,dc=example,dc=com, UUID: cc82f968-7d0e-1036-9420-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=4,dc=example,dc=com, UUID: cc9a1e90-7d0e-1036-9421-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=5,dc=example,dc=com, UUID: ccaf8384-7d0e-1036-9422-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=6,dc=example,dc=com, UUID: ccc7e14a-7d0e-1036-9423-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=7,dc=example,dc=com, UUID: ccdd19e8-7d0e-1036-9424-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=8,dc=example,dc=com, UUID: ccf30aa0-7d0e-1036-9425-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=9,dc=example,dc=com, UUID: cd0e4644-7d0e-1036-9426-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=10,dc=example,dc=com, UUID: cd1f0bc8-7d0e-1036-9427-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=11,dc=example,dc=com, UUID: cd301fee-7d0e-1036-9428-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=12,dc=example,dc=com, UUID: cd3fcde0-7d0e-1036-9429-eb3c99065fa9 58924f1a syncrepl_message_to_entry: rid=001 DN: ou=13,dc=example,dc=com, UUID: cd56e2b4-7d0e-1036-942a-eb3c99065fa9 58924f1b syncrepl_message_to_entry: rid=001 DN: ou=14,dc=example,dc=com, UUID: cd74d800-7d0e-1036-942b-eb3c99065fa9 58924f1b syncrepl_message_to_entry: rid=001 DN: ou=15,dc=example,dc=com, UUID: cd8d9e08-7d0e-1036-942c-eb3c99065fa9 58924f1b syncrepl_message_to_entry: rid=001 DN: ou=16,dc=example,dc=com, UUID: cdb00876-7d0e-1036-942d-eb3c99065fa9 58924f1b syncrepl_message_to_entry: rid=001 DN: ou=17,dc=example,dc=com, UUID: cdd2c776-7d0e-1036-942e-eb3c99065fa9 58924f1b syncrepl_message_to_entry: rid=001 DN: ou=18,dc=example,dc=com, UUID: cdf1b672-7d0e-1036-942f-eb3c99065fa9 58924f1c syncrepl_message_to_entry: rid=001 DN: ou=19,dc=example,dc=com, UUID: ce03233a-7d0e-1036-9430-eb3c99065fa9 58924f1c syncrepl_message_to_entry: rid=001 DN: ou=20,dc=example,dc=com, UUID: ce1650cc-7d0e-1036-9431-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=21,dc=example,dc=com, UUID: ce78b3ac-7d0e-1036-9432-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=22,dc=example,dc=com, UUID: ce88a49c-7d0e-1036-9433-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=23,dc=example,dc=com, UUID: ce95f8b8-7d0e-1036-9434-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=24,dc=example,dc=com, UUID: cea6e98e-7d0e-1036-9435-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=25,dc=example,dc=com, UUID: ceb97806-7d0e-1036-9436-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=26,dc=example,dc=com, UUID: cec86c44-7d0e-1036-9437-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=27,dc=example,dc=com, UUID: ced887be-7d0e-1036-9438-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=28,dc=example,dc=com, UUID: cee6a574-7d0e-1036-9439-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=29,dc=example,dc=com, UUID: ceef6434-7d0e-1036-943a-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=30,dc=example,dc=com, UUID: ceff70c2-7d0e-1036-943b-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=31,dc=example,dc=com, UUID: cfc37ada-7d0e-1036-943c-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=32,dc=example,dc=com, UUID: cfd1761c-7d0e-1036-943d-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=33,dc=example,dc=com, UUID: cff7f01c-7d0e-1036-943e-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=34,dc=example,dc=com, UUID: d00e5a78-7d0e-1036-943f-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=35,dc=example,dc=com, UUID: d022182e-7d0e-1036-9440-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=36,dc=example,dc=com, UUID: d032b4fe-7d0e-1036-9441-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=37,dc=example,dc=com, UUID: d0496654-7d0e-1036-9442-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=38,dc=example,dc=com, UUID: d05f15a8-7d0e-1036-9443-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=39,dc=example,dc=com, UUID: d07003fe-7d0e-1036-9444-eb3c99065fa9 58924f21 syncrepl_message_to_entry: rid=001 DN: ou=40,dc=example,dc=com, UUID: d0809476-7d0e-1036-9445-eb3c99065fa9 58924f22 syncrepl_message_to_entry: rid=001 DN: ou=15,dc=example,dc=com, UUID: cd8d9e08-7d0e-1036-942c-eb3c99065fa9 58924f23 syncrepl_message_to_entry: rid=001 DN: ou=16,dc=example,dc=com, UUID: cdb00876-7d0e-1036-942d-eb3c99065fa9 58924f23 syncrepl_message_to_entry: rid=001 DN: ou=17,dc=example,dc=com, UUID: cdd2c776-7d0e-1036-942e-eb3c99065fa9 58924f23 syncrepl_message_to_entry: rid=001 DN: ou=18,dc=example,dc=com, UUID: cdf1b672-7d0e-1036-942f-eb3c99065fa9 58924f23 syncrepl_message_to_entry: rid=001 DN: ou=19,dc=example,dc=com, UUID: ce03233a-7d0e-1036-9430-eb3c99065fa9 58924f23 syncrepl_message_to_entry: rid=001 DN: ou=20,dc=example,dc=com, UUID: ce1650cc-7d0e-1036-9431-eb3c99065fa9 58924f27 syncrepl_message_to_entry: rid=001 DN: ou=36,dc=example,dc=com, UUID: d032b4fe-7d0e-1036-9441-eb3c99065fa9 58924f27 syncrepl_message_to_entry: rid=001 DN: ou=37,dc=example,dc=com, UUID: d0496654-7d0e-1036-9442-eb3c99065fa9 58924f27 syncrepl_message_to_entry: rid=001 DN: ou=38,dc=example,dc=com, UUID: d05f15a8-7d0e-1036-9443-eb3c99065fa9 58924f27 syncrepl_message_to_entry: rid=001 DN: ou=39,dc=example,dc=com, UUID: d07003fe-7d0e-1036-9444-eb3c99065fa9 58924f27 syncrepl_message_to_entry: rid=001 DN: ou=40,dc=example,dc=com, UUID: d0809476-7d0e-1036-9445-eb3c99065fa9

--Quanah

--

Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: http://www.symas.com