I tested with 2.4.30 and still have the same problems.
Frank
--
Von: Frank Offermanns/CAE An: openldap-technical@openldap.org Datum: 17.02.2012 11:35 Betreff: Re: delta-syncrepl and mirrormode problem (2.4.29)
I wanted to add, that one database is empty when I start and the other has only some data. But with master/slave this is no problem, so I think it should also work for master/master, doesn't it?
I retried with a patched version with these patches:
< http://www.openldap.org/devel/gitweb.cgi?p=openldap.git;a=patch;h=8e7af6331e...
< http://www.openldap.org/devel/gitweb.cgi?p=openldap.git;a=commitdiff;h=d4b3c...
< http://www.openldap.org/devel/gitweb.cgi?p=openldap.git;a=commitdiff;h=eace2...
Unfortunately the problem still persists.
Could at least anyone confirm that the configuration is correct? Then I can at last stop searching for a error I possibly did and accept that OpenLDAP with Master/Master (delta-syncrepl) for Windows simply does not work.
Best regards, Frank --
openldap-technical-bounces@OpenLDAP.org schrieb am 13.02.2012 11:53:16:
Von: frank.offermanns@caseris.de An: openldap-technical@openldap.org Datum: 13.02.2012 12:07 Betreff: delta-syncrepl and mirrormode problem (2.4.29) Gesendet von: openldap-technical-bounces@OpenLDAP.org
Hi,
I want to use delta-syncrepl replication with 2 masters. But each slapd-process permanently needs about 25 % CPU usage without
any
traffic on it.
The log looks endless like this:
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18) ** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18) ** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
here is my configuration (completely the same for both masters):
-----------------------------------------------------------------------------------------------------
ucdata-path ./ucdata include ./schema/core.schema include ./schema/cosine.schema include ./schema/Personcaesar.schema include ./schema/ConfigObjects.schema
loglevel 0 logfile "C:/test/slapd.log"
pidfile ./run/slapd.pid argsfile ./run/slapd.args
access to * by dn.one="ou=Admins,o=caesar" write by anonymous auth
ServerID 1 "ldap://firstmaster.mydomain.local" ServerID 2 "ldap://secondmaster.mydomain.local"
###################################################################### database config rootdn cn=config rootpw {SHA}secret
####################################################################### # BDB database definitions ####################################################################### # Accesslog database definitions database hdb suffix cn=accesslog checkpoint 1024 5 cachesize 10000 directory "C:/test/accessdata" dbconfig set_cachesize 0 30000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152 rootdn cn=accesslog index objectClass,entryCSN,entryUUID eq # I even tried removing reqMod, reading your docs I am not sure if this
is
needed here index reqEnd,reqResult,reqMod,reqStart eq
overlay syncprov syncprov-nopresent TRUE syncprov-reloadhint TRUE # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar" time.soft=unlimited time.hard=unlimited size.soft=unlimited size.hard=unlimited
# Primary database definitions database hdb suffix "o=caesar" checkpoint 1024 5 cachesize 10000 idlcachesize 30000 rootdn "cn=Administrator,o=caesar" rootpw {SHA}secret directory "C:/test/data" dbconfig set_cachesize 0 100000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152
# syncprov specific indexing index sn pres,eq index cn pres,eq,sub ... index entryUUID eq index entryCSN eq index objectClass eq
# syncrepl Provider for primary db overlay syncprov syncprov-checkpoint 1000 60 syncprov-sessionlog 10000
# accesslog overlay definitions for primary db overlay accesslog logdb cn=accesslog logops writes logsuccess TRUE # scan the accesslog DB every day, and purge entries older than 7 days logpurge 07+00:00 01+00:00
sizelimit size.soft=100 size.hard=1000 size.prtotal=unlimited # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar" time.soft=unlimited time.hard=unlimited size.soft=unlimited size.hard=unlimited
syncrepl rid=001 provider="ldap://firstmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
syncrepl rid=002 provider="ldap://secondmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
MirrorMode On
-----------------------------------------------------------------------------------------------------
I did my test on 2 Windows PCs and OpenLDAP 2.4.29 with Berkeley 5.1 .
Thanks for any hints, FO
--On Thursday, March 01, 2012 3:27 PM +0100 frank.offermanns@caseris.de wrote:
I tested with 2.4.30 and still have the same problems.
According to your configs, you still haven't fixed the ServerID issues I noted previously.
--Quanah
--
Quanah Gibson-Mount Sr. Member of Technical Staff Zimbra, Inc A Division of VMware, Inc. -------------------- Zimbra :: the leader in open source messaging and collaboration
frank.offermanns@caseris.de wrote:
I tested with 2.4.30 and still have the same problems.
What's the result from running test063 in the test suite?
Frank
--
Von: Frank Offermanns/CAE An: openldap-technical@openldap.org Datum: 17.02.2012 11:35 Betreff: Re: delta-syncrepl and mirrormode problem (2.4.29)
I wanted to add, that one database is empty when I start and the other has only some data. But with master/slave this is no problem, so I think it should also work for master/master, doesn't it?
I retried with a patched version with these patches:
< http://www.openldap.org/devel/gitweb.cgi?p=openldap.git;a=patch;h=8e7af6331e...
< http://www.openldap.org/devel/gitweb.cgi?p=openldap.git;a=commitdiff;h=d4b3c...
< http://www.openldap.org/devel/gitweb.cgi?p=openldap.git;a=commitdiff;h=eace2...
Unfortunately the problem still persists.
Could at least anyone confirm that the configuration is correct? Then I can at last stop searching for a error I possibly did and accept that OpenLDAP with Master/Master (delta-syncrepl) for Windows simply does not work.
Best regards, Frank --
openldap-technical-bounces@OpenLDAP.org schrieb am 13.02.2012 11:53:16:
Von: frank.offermanns@caseris.de An: openldap-technical@openldap.org Datum: 13.02.2012 12:07 Betreff: delta-syncrepl and mirrormode problem (2.4.29) Gesendet von: openldap-technical-bounces@OpenLDAP.org
Hi,
I want to use delta-syncrepl replication with 2 masters. But each slapd-process permanently needs about 25 % CPU usage without
any
traffic on it.
The log looks endless like this:
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18) ** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18) ** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
here is my configuration (completely the same for both masters):
ucdata-path ./ucdata include ./schema/core.schema include ./schema/cosine.schema include ./schema/Personcaesar.schema include ./schema/ConfigObjects.schema
loglevel 0 logfile "C:/test/slapd.log"
pidfile ./run/slapd.pid argsfile ./run/slapd.args
access to * by dn.one="ou=Admins,o=caesar" write by anonymous auth
ServerID 1 "ldap://firstmaster.mydomain.local" ServerID 2 "ldap://secondmaster.mydomain.local"
###################################################################### database config rootdn cn=config rootpw {SHA}secret
####################################################################### # BDB database definitions ####################################################################### # Accesslog database definitions database hdb suffix cn=accesslog checkpoint 1024 5 cachesize 10000 directory "C:/test/accessdata" dbconfig set_cachesize 0 30000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152 rootdn cn=accesslog index objectClass,entryCSN,entryUUID eq # I even tried removing reqMod, reading your docs I am not sure if this
is
needed here index reqEnd,reqResult,reqMod,reqStart eq
overlay syncprov syncprov-nopresent TRUE syncprov-reloadhint TRUE # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar" time.soft=unlimited time.hard=unlimited size.soft=unlimited size.hard=unlimited
# Primary database definitions database hdb suffix "o=caesar" checkpoint 1024 5 cachesize 10000 idlcachesize 30000 rootdn "cn=Administrator,o=caesar" rootpw {SHA}secret directory "C:/test/data" dbconfig set_cachesize 0 100000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152
# syncprov specific indexing index sn pres,eq index cn pres,eq,sub ... index entryUUID eq index entryCSN eq index objectClass eq
# syncrepl Provider for primary db overlay syncprov syncprov-checkpoint 1000 60 syncprov-sessionlog 10000
# accesslog overlay definitions for primary db overlay accesslog logdb cn=accesslog logops writes logsuccess TRUE # scan the accesslog DB every day, and purge entries older than 7 days logpurge 07+00:00 01+00:00
sizelimit size.soft=100 size.hard=1000 size.prtotal=unlimited # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar" time.soft=unlimited time.hard=unlimited size.soft=unlimited size.hard=unlimited
syncrepl rid=001 provider="ldap://firstmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
syncrepl rid=002 provider="ldap://secondmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
MirrorMode On
I did my test on 2 Windows PCs and OpenLDAP 2.4.29 with Berkeley 5.1 .
Thanks for any hints, FO
Hello Howard,
What's the result from running test063 in the test suite?
unfortunately I am not able to get the testscripts running with mingw/msys and windows. Is there a documentation which describes what to do to get the tests running with mingw/msys and windows?
I found in slapd.1.log this entry: "line 49 (directory /openldap-2.4.30/tests/testrun/db.1.a) C:/msys/1.0/openldap-2.4.30/tests/testrun/slapd.1.conf: line 49: invalid path: No such file or directory" and in slapd.1.conf the directory path is configured like this: "directory /openldap-2.4.30/tests/testrun/db.1.a" and the directory db.1.a has been created, but it is empty.
Although I can do make hdb, etc, - but how to make a single test (Nr. 63)?
Thanks for your response and best regards, Frank
frank.offermanns@caseris.de wrote:
I tested with 2.4.30 and still have the same problems.
What's the result from running test063 in the test suite?
Frank
--
Von: Frank Offermanns/CAE An: openldap-technical@openldap.org Datum: 17.02.2012 11:35 Betreff: Re: delta-syncrepl and mirrormode problem (2.4.29)
I wanted to add, that one database is empty when I start and the other
has
only some data. But with master/slave this is no problem, so I think
it
should also work for master/master, doesn't it?
I retried with a patched version with these patches:
p=openldap.git;a=patch;h=8e7af6331ec2d0edaeb203b1c52d4016bc2bbcbf
p=openldap.git;a=commitdiff;h=d4b3c2af6a61678060ef417b59bd63a36ec15c13
p=openldap.git;a=commitdiff;h=eace24ef33dfae071b9450866d0ef5b0d3ad6d7f
Unfortunately the problem still persists.
Could at least anyone confirm that the configuration is correct? Then I can at last stop searching for a error I possibly did and
accept
that OpenLDAP with Master/Master (delta-syncrepl) for Windows simply
does
not work.
Best regards, Frank --
openldap-technical-bounces@OpenLDAP.org schrieb am 13.02.2012
11:53:16:
Von: frank.offermanns@caseris.de An: openldap-technical@openldap.org Datum: 13.02.2012 12:07 Betreff: delta-syncrepl and mirrormode problem (2.4.29) Gesendet von: openldap-technical-bounces@OpenLDAP.org
Hi,
I want to use delta-syncrepl replication with 2 masters. But each slapd-process permanently needs about 25 % CPU usage without
any
traffic on it.
The log looks endless like this:
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18) ** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18) ** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
here is my configuration (completely the same for both masters):
-----------------------------------------------------------------------------------------------------
ucdata-path ./ucdata include ./schema/core.schema include ./schema/cosine.schema include ./schema/Personcaesar.schema include ./schema/ConfigObjects.schema
loglevel 0 logfile "C:/test/slapd.log"
pidfile ./run/slapd.pid argsfile ./run/slapd.args
access to * by dn.one="ou=Admins,o=caesar" write by anonymous auth
ServerID 1 "ldap://firstmaster.mydomain.local" ServerID 2 "ldap://secondmaster.mydomain.local"
######################################################################
database config rootdn cn=config rootpw {SHA}secret
#######################################################################
# BDB database definitions
#######################################################################
# Accesslog database definitions database hdb suffix cn=accesslog checkpoint 1024 5 cachesize 10000 directory "C:/test/accessdata" dbconfig set_cachesize 0 30000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152 rootdn cn=accesslog index objectClass,entryCSN,entryUUID eq # I even tried removing reqMod, reading your docs I am not sure if
this
is
needed here index reqEnd,reqResult,reqMod,reqStart eq
overlay syncprov syncprov-nopresent TRUE syncprov-reloadhint TRUE # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar"
time.soft=unlimited
time.hard=unlimited size.soft=unlimited size.hard=unlimited
# Primary database definitions database hdb suffix "o=caesar" checkpoint 1024 5 cachesize 10000 idlcachesize 30000 rootdn "cn=Administrator,o=caesar" rootpw {SHA}secret directory "C:/test/data" dbconfig set_cachesize 0 100000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152
# syncprov specific indexing index sn pres,eq index cn pres,eq,sub ... index entryUUID eq index entryCSN eq index objectClass eq
# syncrepl Provider for primary db overlay syncprov syncprov-checkpoint 1000 60 syncprov-sessionlog 10000
# accesslog overlay definitions for primary db overlay accesslog logdb cn=accesslog logops writes logsuccess TRUE # scan the accesslog DB every day, and purge entries older than 7
days
logpurge 07+00:00 01+00:00
sizelimit size.soft=100 size.hard=1000 size.prtotal=unlimited # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar"
time.soft=unlimited
time.hard=unlimited size.soft=unlimited size.hard=unlimited
syncrepl rid=001 provider="ldap://firstmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
syncrepl rid=002 provider="ldap://secondmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
MirrorMode On
-----------------------------------------------------------------------------------------------------
I did my test on 2 Windows PCs and OpenLDAP 2.4.29 with Berkeley 5.1
.
Thanks for any hints, FO
-- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/
frank.offermanns@caseris.de wrote:
Hello Howard,
What's the result from running test063 in the test suite?
unfortunately I am not able to get the testscripts running with mingw/msys and windows. Is there a documentation which describes what to do to get the tests running with mingw/msys and windows?
I found in slapd.1.log this entry: "line 49 (directory /openldap-2.4.30/tests/testrun/db.1.a) C:/msys/1.0/openldap-2.4.30/tests/testrun/slapd.1.conf: line 49: invalid path: No such file or directory" and in slapd.1.conf the directory path is configured like this: "directory /openldap-2.4.30/tests/testrun/db.1.a" and the directory db.1.a has been created, but it is empty.
Sounds like it's having problems with MSYS's fake pathnames, or your MSYS is not mounting filesystems correctly. If you can't fix that, you may be able to workaround this by overriding the test directory using e.g. export USER_TESTDIR=C:/msys/1.0/openldap-2.4.30/tests/testrun
Although I can do make hdb, etc, - but how to make a single test (Nr. 63)?
In the tests directory: ./run test063
Thanks for your response and best regards, Frank
frank.offermanns@caseris.de wrote:
I tested with 2.4.30 and still have the same problems.
What's the result from running test063 in the test suite?
Frank
--
Von: Frank Offermanns/CAE An: openldap-technical@openldap.org Datum: 17.02.2012 11:35 Betreff: Re: delta-syncrepl and mirrormode problem (2.4.29)
I wanted to add, that one database is empty when I start and the other
has
only some data. But with master/slave this is no problem, so I think
it
should also work for master/master, doesn't it?
I retried with a patched version with these patches:
p=openldap.git;a=patch;h=8e7af6331ec2d0edaeb203b1c52d4016bc2bbcbf
p=openldap.git;a=commitdiff;h=d4b3c2af6a61678060ef417b59bd63a36ec15c13
p=openldap.git;a=commitdiff;h=eace24ef33dfae071b9450866d0ef5b0d3ad6d7f
Unfortunately the problem still persists.
Could at least anyone confirm that the configuration is correct? Then I can at last stop searching for a error I possibly did and
accept
that OpenLDAP with Master/Master (delta-syncrepl) for Windows simply
does
not work.
Best regards, Frank --
openldap-technical-bounces@OpenLDAP.org schrieb am 13.02.2012
11:53:16:
Von: frank.offermanns@caseris.de An: openldap-technical@openldap.org Datum: 13.02.2012 12:07 Betreff: delta-syncrepl and mirrormode problem (2.4.29) Gesendet von: openldap-technical-bounces@OpenLDAP.org
Hi,
I want to use delta-syncrepl replication with 2 masters. But each slapd-process permanently needs about 25 % CPU usage without
any
traffic on it.
The log looks endless like this:
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18)** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
** ld 01e43698 Outstanding Requests:
- msgid 55, origid 55, status InProgress outstanding referrals 0, parent count 0
ld 01e43698 request count 1 (abandoned 18)** ld 01e43698 Response Queue: Empty ld 01e43698 response count 0 ldap_chkResponseList ld 01e43698 msgid 55 all 0 ldap_chkResponseList returns ld 01e43698 NULL ldap_int_select read1msg: ld 01e43698 msgid 55 all 0 ber_get_next ber_get_next: tag 0x30 len 1187 contents: abandoned/discarded ld 01e43698 msgid 53 message type search-entry wait4msg continue ld 01e43698 msgid 55 all 0 ** ld 01e43698 Connections:
- host: secondmaster.mydomain.local port: 389 (default) refcnt: 2 status: Connected last used: Mon Feb 13 11:26:53 2012
here is my configuration (completely the same for both masters):
ucdata-path ./ucdata include ./schema/core.schema include ./schema/cosine.schema include ./schema/Personcaesar.schema include ./schema/ConfigObjects.schema
loglevel 0 logfile "C:/test/slapd.log"
pidfile ./run/slapd.pid argsfile ./run/slapd.args
access to * by dn.one="ou=Admins,o=caesar" write by anonymous auth
ServerID 1 "ldap://firstmaster.mydomain.local" ServerID 2 "ldap://secondmaster.mydomain.local"
######################################################################
database config rootdn cn=config rootpw {SHA}secret
#######################################################################
# BDB database definitions
#######################################################################
# Accesslog database definitions database hdb suffix cn=accesslog checkpoint 1024 5 cachesize 10000 directory "C:/test/accessdata" dbconfig set_cachesize 0 30000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152 rootdn cn=accesslog index objectClass,entryCSN,entryUUID eq # I even tried removing reqMod, reading your docs I am not sure if
this
is
needed here index reqEnd,reqResult,reqMod,reqStart eq
overlay syncprov syncprov-nopresent TRUE syncprov-reloadhint TRUE # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar"
time.soft=unlimited
time.hard=unlimited size.soft=unlimited size.hard=unlimited
# Primary database definitions database hdb suffix "o=caesar" checkpoint 1024 5 cachesize 10000 idlcachesize 30000 rootdn "cn=Administrator,o=caesar" rootpw {SHA}secret directory "C:/test/data" dbconfig set_cachesize 0 100000000 1 dbconfig set_flags DB_LOG_AUTOREMOVE dbconfig set_lg_regionmax 1048576 dbconfig set_lg_max 10485760 dbconfig set_lg_bsize 2097152
# syncprov specific indexing index sn pres,eq index cn pres,eq,sub ... index entryUUID eq index entryCSN eq index objectClass eq
# syncrepl Provider for primary db overlay syncprov syncprov-checkpoint 1000 60 syncprov-sessionlog 10000
# accesslog overlay definitions for primary db overlay accesslog logdb cn=accesslog logops writes logsuccess TRUE # scan the accesslog DB every day, and purge entries older than 7
days
logpurge 07+00:00 01+00:00
sizelimit size.soft=100 size.hard=1000 size.prtotal=unlimited # Let the replica DN have limitless searches limits dn.exact="cn=Replicator,ou=admins,o=caesar"
time.soft=unlimited
time.hard=unlimited size.soft=unlimited size.hard=unlimited
syncrepl rid=001 provider="ldap://firstmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
syncrepl rid=002 provider="ldap://secondmaster.mydomain.local" searchbase="o=caesar" type=refreshAndPersist retry="5 3 15 +" binddn="cn=Replicator,ou=admins,o=caesar" bindmethod=simple credentials="secret" logbase="cn=accesslog" logfilter="(&(objectClass=auditWriteObject)(reqResult=0))" schemachecking=on syncdata=accesslog
MirrorMode On
I did my test on 2 Windows PCs and OpenLDAP 2.4.29 with Berkeley 5.1
Sounds like it's having problems with MSYS's fake pathnames, or your
MSYS is
not mounting filesystems correctly. If you can't fix that, you may be
able to
workaround this by overriding the test directory using e.g. export USER_TESTDIR=C:/msys/1.0/openldap-2.4.30/tests/testrun
Thanks this works.
In the tests directory: ./run test063
Doing this I get the following: "offermanns@CAS-WS091201 /openldap-2.4.30/tests $ env SLAPD_DEBUG=1 ./run test063 Cleaning up test run directory leftover from previous run. Running ./scripts/test063-delta-multimaster for hdb... running defines.sh Initializing server configurations... ./scripts/test063-delta-multimaster: line 116: test: =: unary operator expected Starting server 1 on TCP/IP port 9011... Using ldapsearch to check that server 1 is running... Using ldapadd for context on server 1... ldapadd failed for server 1 database (34)!"
In line 116 @ if test $INDEXDB = indexdb ; then when I echo $INDEXDB it is empty.
Here a extract from test.out, I even changed $ABS_SCHEMADIR in the 063.script to a permanent path, but this does not seem to be the problem
<Original> "ldif_read_record: include file:///openldap-2.4.30/tests/./schema/core.ldif failed"
<Replaced> "ldif_write_entry: wrote entry "cn=schema,cn=config" ldif_read_record: include c:/msys/1.0/openldap-2.4.30/tests/schema/core.ldif failed slapadd shutdown: initiated slapadd destroy: freeing system resources. ldap_bind: Invalid DN syntax (34) additional info: invalid DN"
And here is a extract of the slapd.log "backend_startup_one: starting "cn=config" config_back_db_open slapd starting slap_listener_activate(2):
slap_listener(ldap://localhost:9011/)
connection_get(3): got connid=1000 connection_read(3): checking for input on id=1000 ber_get_next ber_get_next: tag 0x30 len 12 contents: op tag 0x60, time 1330680554 ber_get_next conn=1000 op=0 do_bind ber_scanf fmt ({imt) ber: ber_scanf fmt (m}) ber:
dnPrettyNormal: <>
<<< dnPrettyNormal: <>, <> do_bind: version=3 dn="" method=128 send_ldap_result: conn=1000 op=0 p=3 send_ldap_response: msgid=1 tag=97 err=0 ber_flush2: 14 bytes to sd 1768 do_bind: v3 anonymous bind connection_get(3): got connid=1000 connection_read(3): checking for input on id=1000 ber_get_next ber_get_next: tag 0x30 len 37 contents: op tag 0x63, time 1330680554 ber_get_next conn=1000 op=1 do_search ber_scanf fmt ({miiiib) ber:
dnPrettyNormal: <>
<<< dnPrettyNormal: <>, <> ber_scanf fmt (m) ber: ber_scanf fmt ({M}}) ber: => send_search_entry: conn 1000 dn="" ber_flush2: 50 bytes to sd 1768 <= send_search_entry: conn 1000 exit. send_ldap_result: conn=1000 op=1 p=3 send_ldap_response: msgid=2 tag=101 err=0 ber_flush2: 14 bytes to sd 1768 connection_get(3): got connid=1000 connection_read(3): checking for input on id=1000 ber_get_next ber_get_next: tag 0x30 len 5 contents: op tag 0x42, time 1330680554 ber_get_next ber_get_next on fd 3 failed errno=0 (unknown WSA error) conn=1000 op=2 do_unbind connection_close: conn=1000 sd=3 slap_listener_activate(2):
slap_listener(ldap://localhost:9011/)
connection_get(3): got connid=1001 connection_read(3): checking for input on id=1001 ber_get_next ber_get_next: tag 0x30 len 46 contents: op tag 0x60, time 1330680554 ber_get_next conn=1001 op=0 do_bind ber_scanf fmt ({imt) ber: ber_scanf fmt (m}) ber:
dnPrettyNormal: <cn=Manager,dc=example,dc=com>
conn=1001 op=0 do_bind: invalid dn (cn=Manager,dc=example,dc=com)" send_ldap_result: conn=1001 op=0 p=3 send_ldap_response: msgid=1 tag=97 err=34 ber_flush2: 24 bytes to sd 1768 connection_get(3): got connid=1001 connection_read(3): checking for input on id=1001 ber_get_next
So is there a problem with cn=Manager,dc=example,dc=com?
Hello,
now mirrormode with delta-syncrepl seems to work with windows. The problem was that I added the initial database with slapadd without the -w option. (slapadd on master 1 and empty master 2) Is this a bug or does it work as designed? If it works as designed maybe the manualpage for slapadd should be more clearly that when you work with replication you always have to use the -w option.
Wouldn't it be helpfull if slapadd internally always use the -w option or are there cases in which this option could be harmfull? What happens if i use -w and have no replication configured?
Regards, Frank
openldap-technical-bounces@OpenLDAP.org schrieb am 02.03.2012 10:47:50:
Von: frank.offermanns@caseris.de An: Howard Chu hyc@symas.com Kopie: openldap-technical@openldap.org Datum: 02.03.2012 11:01 Betreff: Re: delta-syncrepl and mirrormode problem (2.4.29 and 2.4.30) Gesendet von: openldap-technical-bounces@OpenLDAP.org
Sounds like it's having problems with MSYS's fake pathnames, or your
MSYS is
not mounting filesystems correctly. If you can't fix that, you may be
able to
workaround this by overriding the test directory using e.g. export USER_TESTDIR=C:/msys/1.0/openldap-2.4.30/tests/testrun
Thanks this works.
In the tests directory: ./run test063
Doing this I get the following: "offermanns@CAS-WS091201 /openldap-2.4.30/tests $ env SLAPD_DEBUG=1 ./run test063 Cleaning up test run directory leftover from previous run. Running ./scripts/test063-delta-multimaster for hdb... running defines.sh Initializing server configurations... ./scripts/test063-delta-multimaster: line 116: test: =: unary operator expected Starting server 1 on TCP/IP port 9011... Using ldapsearch to check that server 1 is running... Using ldapadd for context on server 1... ldapadd failed for server 1 database (34)!"
In line 116 @ if test $INDEXDB = indexdb ; then when I echo $INDEXDB it is empty.
Here a extract from test.out, I even changed $ABS_SCHEMADIR in the 063.script to a permanent path, but this does not seem to be the problem
<Original> "ldif_read_record: include file:///openldap-2.4.30/tests/./schema/core.ldif failed"
<Replaced> "ldif_write_entry: wrote entry "cn=schema,cn=config" ldif_read_record: include c:/msys/1.0/openldap-2.4.30/tests/schema/core.ldif failed slapadd shutdown: initiated slapadd destroy: freeing system resources. ldap_bind: Invalid DN syntax (34) additional info: invalid DN"
And here is a extract of the slapd.log "backend_startup_one: starting "cn=config" config_back_db_open slapd starting slap_listener_activate(2):
slap_listener(ldap://localhost:9011/)
connection_get(3): got connid=1000 connection_read(3): checking for input on id=1000 ber_get_next ber_get_next: tag 0x30 len 12 contents: op tag 0x60, time 1330680554 ber_get_next conn=1000 op=0 do_bind ber_scanf fmt ({imt) ber: ber_scanf fmt (m}) ber:
dnPrettyNormal: <>
<<< dnPrettyNormal: <>, <> do_bind: version=3 dn="" method=128 send_ldap_result: conn=1000 op=0 p=3 send_ldap_response: msgid=1 tag=97 err=0 ber_flush2: 14 bytes to sd 1768 do_bind: v3 anonymous bind connection_get(3): got connid=1000 connection_read(3): checking for input on id=1000 ber_get_next ber_get_next: tag 0x30 len 37 contents: op tag 0x63, time 1330680554 ber_get_next conn=1000 op=1 do_search ber_scanf fmt ({miiiib) ber:
dnPrettyNormal: <>
<<< dnPrettyNormal: <>, <> ber_scanf fmt (m) ber: ber_scanf fmt ({M}}) ber: => send_search_entry: conn 1000 dn="" ber_flush2: 50 bytes to sd 1768 <= send_search_entry: conn 1000 exit. send_ldap_result: conn=1000 op=1 p=3 send_ldap_response: msgid=2 tag=101 err=0 ber_flush2: 14 bytes to sd 1768 connection_get(3): got connid=1000 connection_read(3): checking for input on id=1000 ber_get_next ber_get_next: tag 0x30 len 5 contents: op tag 0x42, time 1330680554 ber_get_next ber_get_next on fd 3 failed errno=0 (unknown WSA error) conn=1000 op=2 do_unbind connection_close: conn=1000 sd=3 slap_listener_activate(2):
slap_listener(ldap://localhost:9011/)
connection_get(3): got connid=1001 connection_read(3): checking for input on id=1001 ber_get_next ber_get_next: tag 0x30 len 46 contents: op tag 0x60, time 1330680554 ber_get_next conn=1001 op=0 do_bind ber_scanf fmt ({imt) ber: ber_scanf fmt (m}) ber:
dnPrettyNormal: <cn=Manager,dc=example,dc=com>
conn=1001 op=0 do_bind: invalid dn (cn=Manager,dc=example,dc=com)" send_ldap_result: conn=1001 op=0 p=3 send_ldap_response: msgid=1 tag=97 err=34 ber_flush2: 24 bytes to sd 1768 connection_get(3): got connid=1001 connection_read(3): checking for input on id=1001 ber_get_next
So is there a problem with cn=Manager,dc=example,dc=com?
openldap-technical@openldap.org
-
frank.offermanns＠caseris.de -
Howard Chu -
Quanah Gibson-Mount