Fix verified.
-------- Original Message -------- Subject: RE: truncated slapcat output Date: Thu, 11 Apr 2013 07:15:17 +0000 From: Hummel, Wolfgang wolfgang.hummel@hp.com To: Howard Chu hyc@symas.com
Hello Howard,
we tested your fix for truncated slapcat and it works fine. Please see test report below. As I am not familiar with your processes in commenting on bugfixes could you use the attached test report and commit the fix so it will become part of next release ?
Thanks a lot for your support
Regards
Wolfgang Hummel
Test execution timeframe: April 9th and 10th 2013
Test platform: Hardware HP DL380 G5, 32 GB Memory, 2 Quadcore CPUs OS RedHat 5.1 OpenLDAP 2.4.32 without / with slapcat truncate bugfix bdb backend
Test setup: - Subscriber profile DB with 1 Mio. entries, each with 10 attributes
Test execution: - ldapbenchmark.pl executing ~ 5 ldapmodifies and ~ 2 ldapsearches / second - slapcat_vfhu_vm_profiles.sh running slapcat in a cycle and counting entries
Test result without slapcat truncate bugfix: - 1826 measurements of entry number - 23 events with truncated slapcat output - slapcat return code was always 0 !
Test result with slapcat truncate bugfix: - 1647 measurements of entry number - 0 events with truncated slapcat output
script to measure it: #!/bin/bash # run slapcat forever and always count number of entries # they should always be the same while : do slapcat -b ou=vm,ou=profiles,ou=xxxx,c=hu,o=yyyy|grep "^dn:"|wc -l
vfhu_vm_entries.txt
echo "Slapcat Return Code: $?; `date`">>vfhu_vm_entries.txt sleep 1 done
log snippet with bug fix: Slapcat Return Code: 0; Wed Apr 10 22:12:42 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 22:13:05 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 22:13:28 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 22:13:52 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 22:14:16 CEST 2013 1000001
log snippet without bugfix: 1000001 Slapcat Return Code: 0; Wed Apr 10 01:01:45 CEST 2013 319284 Slapcat Return Code: 0; Wed Apr 10 01:02:07 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 01:03:15 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 01:03:42 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 01:04:09 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 01:04:37 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 01:05:04 CEST 2013 437990 Slapcat Return Code: 0; Wed Apr 10 01:05:16 CEST 2013 146790 Slapcat Return Code: 0; Wed Apr 10 01:05:21 CEST 2013 72688 Slapcat Return Code: 0; Wed Apr 10 01:05:25 CEST 2013 1000001 Slapcat Return Code: 0; Wed Apr 10 01:05:50 CEST 2013
-----Original Message----- From: Howard Chu [mailto:hyc@symas.com] Sent: Dienstag, 26. März 2013 18:09 To: Hummel, Wolfgang Subject: Re: truncated slapcat output
Hummel, Wolfgang wrote:
Hello Howard,
we are facing in production of our major customer VF the same problems as described in
http://www.openldap.org/lists/openldap-technical/201301/msg00232.html
We are using back-bdb and slapcat to create nightly ldif backups of all DBs
where 2 of them each contains ~ 40 Mio. entries.
Even though write traffic is low when the slapcat job runs, every 1 - 2 weeks
output is truncated without error msg or error return code which creates problems
for subsequent batch jobs.
Therefore a slapcat that retries like slapd if a page is locked would be
really important for us.
2 Questions:
- Is the slapcat retry mechanism the fix you described in
http://www.openldap.org/lists/openldap-technical/201301/msg00232.html ?
The patch for ITS#6365 was committed to master commit 853b9d1335d27e280751e9cfb8ca6b5356ffec73 Author: Howard Chu hyc@openldap.org Date: Thu Feb 7 18:23:25 2013 +0000
ITS#6365 wait for read locks in tool mode
- When will it be available in OpenLDAP ?
When somebody follows up to the ITS and confirms that the patch fixes the issue. So far nobody has followed up. You're welcome to test and followup.
Regards
Wolfgang Hummel
Postal Address: Hewlett-Packard GmbH Wolfgang Hummel Enterprise Services _/ Communication & Media Solutions_/ Herrenberger Str. 140
_/_/_/ _/_/_/ 71034 Böblingen _/ _/ _/ _/ Phone: +49 7031 14-7375 _/ _/ _/_/_/ Fax: +49 711 18562024 _/ mobile: +49 151 14751791 _/ E-Mail: wolfgang.hummel@hp.com
Hewlett-Packard GmbH, Herrenberger Str. 140, 71034 Böblingen
Geschäftsführer: Volker Smid (Vorsitzender), Martin Kinne, Heiko Meyer, Ernst Reichart, Rainer Sterk Vorsitzender des Aufsichtsrates: Jörg Menno Harms Sitz der Gesellschaft: Böblingen, Amtsgericht Stuttgart HRB 244081, WEEE-Reg.-Nr. DE 30409072