Hi,
When testing slapo-refint functionality in a configuration with mirror node masters, and a Delta-syncrepl consumer. I see that refint is working between the 2 providers, but not on the consumer.
Using Openldap 2.4.39 on all instances. Database is hdb
After renaming a uid the ContextCSN on all instances are the same, so changes are propagated successful. Every change if replicated properly, except for refint on a consumer.
The refint configuration: overlay refint refint_attributes uniqueMember refint_nothing cn=Manager,o=test
The logfile on the consumer: Sep 23 17:05:12 sldapa01 slapd[1727]: do_syncrep2: rid=101 cookie=rid=101,sid=001,csn=20140923150512.298991Z#000000#001#000000 Sep 23 17:05:12 sldapa01 slapd[1727]: syncrepl_message_to_entry: rid=101 DN: uid=108284.22593,ou=users,o=test, UUID: 7d4fb488-a789-1033-9f1d-cd9d692f2885 Sep 23 17:05:12 sldapa01 slapd[1727]: syncrepl_entry: rid=101 LDAP_RES_SEARCH_ENTRY(LDAP_SYNC_MODIFY) Sep 23 17:05:12 sldapa01 slapd[1727]: => bdb_filter_candidates Sep 23 17:05:12 sldapa01 slapd[1727]: #011AND Sep 23 17:05:12 sldapa01 slapd[1727]: => bdb_list_candidates 0xa0 Sep 23 17:05:12 sldapa01 slapd[1727]: => bdb_filter_candidates Sep 23 17:05:12 sldapa01 slapd[1727]: #011EQUALITY Sep 23 17:05:12 sldapa01 slapd[1727]: <= bdb_filter_candidates: id=1 first=102822 last=102822 Sep 23 17:05:12 sldapa01 slapd[1727]: <= bdb_list_candidates: id=1 first=102822 last=102822 Sep 23 17:05:12 sldapa01 slapd[1727]: <= bdb_filter_candidates: id=1 first=102822 last=102822 Sep 23 17:05:12 sldapa01 slapd[1727]: => test_filter Sep 23 17:05:12 sldapa01 slapd[1727]: EQUALITY Sep 23 17:05:12 sldapa01 slapd[1727]: <= test_filter 6 Sep 23 17:05:12 sldapa01 slapd[1727]: syncrepl_entry: rid=101 be_search (0) Sep 23 17:05:12 sldapa01 slapd[1727]: syncrepl_entry: rid=101 uid=108284.22593,ou=users,o=test Sep 23 17:05:12 sldapa01 slapd[1727]: slap_queue_csn: queing 0x7ff278108d90 20140923150512.298991Z#000000#001#000000 Sep 23 17:05:12 sldapa01 slapd[1727]: slap_graduate_commit_csn: removing 0x7ff27b1f5150 20140923150512.298991Z#000000#001#000000 Sep 23 17:05:12 sldapa01 slapd[1727]: syncrepl_entry: rid=101 be_modrdn uid=118284.22593,ou=users,o=test Sep 23 17:05:12 sldapa01 slapd[1727]: slap_queue_csn: queing 0x7ff278108d90 20140923150512.298991Z#000000#001#000000 Sep 23 17:05:12 sldapa01 slapd[1727]: slap_graduate_commit_csn: removing 0x7ff27b1f3260 20140923150512.298991Z#000000#001#000000
Logfile on mirror mode master: Sep 23 17:05:11 mldapa01 slapd[2237]: do_syncrep2: rid=100 cookie=rid=100,sid=001,csn=20140923150512.298991Z#000000#001#000000 Sep 23 17:05:11 mldapa01 slapd[2237]: syncrepl_message_to_entry: rid=100 DN: uid=108284.22593,ou=users,o=test, UUID: 7d4fb488-a789-1033-9f1d-cd9d692f2885 Sep 23 17:05:11 mldapa01 slapd[2237]: syncrepl_entry: rid=100 LDAP_RES_SEARCH_ENTRY(LDAP_SYNC_MODIFY) Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011AND Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_list_candidates 0xa0 Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011EQUALITY Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=1 first=102822 last=102822 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_list_candidates: id=1 first=102822 last=102822 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=1 first=102822 last=102822 Sep 23 17:05:11 mldapa01 slapd[2237]: => test_filter Sep 23 17:05:11 mldapa01 slapd[2237]: EQUALITY Sep 23 17:05:11 mldapa01 slapd[2237]: <= test_filter 6 Sep 23 17:05:11 mldapa01 slapd[2237]: syncrepl_entry: rid=100 be_search (0) Sep 23 17:05:11 mldapa01 slapd[2237]: syncrepl_entry: rid=100 uid=108284.22593,ou=users,o=test Sep 23 17:05:11 mldapa01 slapd[2237]: slap_queue_csn: queing 0x7f270b394ad0 20140923150512.298991Z#000000#001#000000 Sep 23 17:05:11 mldapa01 slapd[2237]: syncprov_matchops: skipping original sid 001 Sep 23 17:05:11 mldapa01 slapd[2237]: slap_graduate_commit_csn: removing 0x7f27120a2200 20140923150512.298991Z#000000#001#000000 Sep 23 17:05:11 mldapa01 slapd[2237]: syncprov_matchops: skipping original sid 001 Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011AND Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_list_candidates 0xa0 Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011OR Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_list_candidates 0xa1 Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011EQUALITY Sep 23 17:05:11 mldapa01 slapd[2237]: syncrepl_entry: rid=100 be_modrdn uid=118284.22593,ou=users,o=test Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=0 first=0 last=0 Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011OR Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_list_candidates 0xa1 Sep 23 17:05:11 mldapa01 slapd[2237]: => bdb_filter_candidates Sep 23 17:05:11 mldapa01 slapd[2237]: #011EXT Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_list_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_list_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_list_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: <= bdb_filter_candidates: id=-1 first=1 last=102893 Sep 23 17:05:11 mldapa01 slapd[2237]: => test_filter Sep 23 17:05:11 mldapa01 slapd[2237]: OR Sep 23 17:05:11 mldapa01 slapd[2237]: => test_filter_or Sep 23 17:05:11 mldapa01 slapd[2237]: => test_filter Sep 23 17:05:11 mldapa01 slapd[2237]: EXT Sep 23 17:05:11 mldapa01 slapd[2237]: <= test_filter 5 Sep 23 17:05:11 mldapa01 slapd[2237]: <= test_filter_or 5 Sep 23 17:05:11 mldapa01 slapd[2237]: <= test_filter 5 Sep 23 17:05:11 mldapa01 slapd[2237]: => test_filter
--On Wednesday, September 24, 2014 1:21 PM +0200 Mike Hulsman mike@hulsman.net wrote:
Hi,
When testing slapo-refint functionality in a configuration with mirror node masters, and a Delta-syncrepl consumer. I see that refint is working between the 2 providers, but not on the consumer.
Using Openldap 2.4.39 on all instances. Database is hdb
After renaming a uid the ContextCSN on all instances are the same, so changes are propagated successful. Every change if replicated properly, except for refint on a consumer.
The refint configuration: overlay refint refint_attributes uniqueMember refint_nothing cn=Manager,o=test
Hm, there were 3 fixes to refint in 2.4.40, although I'm not sure they address your issue:
Fixed slapo-refint to check for pauses in cn=config (ITS#7873) Fixed slapo-refint internal search logging (ITS#7929) Fixed slapo-refint connection destroy logic (ITS#7906,ITS#7923)
--Quanah
--
Quanah Gibson-Mount Server Architect Zimbra, Inc. -------------------- Zimbra :: the leader in open source messaging and collaboration
Quoting Quanah Gibson-Mount quanah@zimbra.com:
The refint configuration: overlay refint refint_attributes uniqueMember refint_nothing cn=Manager,o=test
Hm, there were 3 fixes to refint in 2.4.40, although I'm not sure they address your issue:
Fixed slapo-refint to check for pauses in cn=config (ITS#7873) Fixed slapo-refint internal search logging (ITS#7929) Fixed slapo-refint connection destroy logic (ITS#7906,ITS#7923)
Thanks,
I'll give that a try.
If that does not work, I can change the environment so that every instance is an provider and consumer.
Regards. Mike
Quoting Mike Hulsman mike@hulsman.net:
Quoting Quanah Gibson-Mount quanah@zimbra.com:
The refint configuration: overlay refint refint_attributes uniqueMember refint_nothing cn=Manager,o=test
Hm, there were 3 fixes to refint in 2.4.40, although I'm not sure they address your issue:
Fixed slapo-refint to check for pauses in cn=config (ITS#7873) Fixed slapo-refint internal search logging (ITS#7929) Fixed slapo-refint connection destroy logic (ITS#7906,ITS#7923)Thanks,
I'll give that a try.
If that does not work, I can change the environment so that every instance is an provider and consumer.
Regards. Mike
I found the problem, slapo-refint is working fine. But the problem was in the config file. On the slave the refint was defined before the database definition, and therefore it was not working. Move the refint config after the database definition, and all is working now.
- reminder to myself. Check config files more toroughly before asking for help.
Regards,
Mike
openldap-technical@openldap.org
-
Mike Hulsman -
Quanah Gibson-Mount