openldap-technical August 2013

openldap-technical@openldap.org

70 participants
88 discussions

Re: OpenLDAP 2.4.36 available
by Clément OUDOT 23 Aug '13

23 Aug '13

Hi, LTB project RPMs for OpenLDAP 2.4.36 are available: http://tools.ltb-project.org/news/40 I also created a yum repository to ease the installation: http://ltb-project.org/wiki/documentation/openldap-rpm#yum_repository Clément.

6 7

Issues arising from creating powerdns backend based on LMDB
by Mark Zealey 23 Aug '13

23 Aug '13

Hi Howard, I've now got lmdb working with powerdns in place of kyoto - nice and easy to do thanks! Maximum DNS query load is a little better - about 10-30% depending on use-case, but for us the main gain is that you can have a writer going on at the same time - I was struggling a bit with how to push updates from a different process using kyoto. There's a few issues and things I'd like to comment on though: 1) Can you update documentation to explain what happens when I do a mdb_cursor_del() ? I am assuming it advances the cursor to the next record (this seems to be the behaviour). However there is some sort of bug with this assumption. Basically I have a loop which jumps (MDB_SET_RANGE) to a key and then wants to do a delete until key is like something else. So I do while(..) { mdb_cursor_del(), mdb_cursor_get(..., MDB_GET_CURRENT)}. This works fine mostly, but roughly 1% of the time I get EINVAL returned when I try to MDB_GET_CURRENT after a delete. This always seems to happen on the same records - not sure about the memory structure but could it be something to do with hitting a page boundary somehow invalidating the cursor? At the moment I just catch that and then do an MDB_NEXT to skip over them but this will be an issue for us on live. This is from perl so it /may/ be that, or the version of lmdb that is shipped with it however the perl layer is a very thin wrapper and looking at the code I can only think it comes from lmdb. 2) Currently, because kyoto cabinet didn't have support for multiple identical keys we don't use the DUP options. This leads to quite long keys (1200-1300 bytes in some cases). In the future, it would be nice to have a run-time keylength specifier or something along those lines. 3) Perhaps a mdb_cursor_get_key() function (like kyoto) which doesn't return the data (just the key). As in (2) we store all the data in the key - not sure how much of a performance difference this would make though 4) Creating database with non-sequential keys is very bad (on 4gb databases, 2* slower than kyoto - about 1h30 and uses more memory). I spent quite a bit of time looking at this in perl and then C. Basically I create a database, open 1 txn and then insert a bunch of unordered keys. Up to about 500mb it's fine and nice and quick - from perl about 75k inserts/sec (slow mostly because it's reading from mysql). However after than first 500mb it starts flushing to disk. In a sequential insert case the flush is very quick - 100-200mb/sec or so. However on non-sequential insert I've seen it drop to like 4 or 5mb/sec as it's writing data all over the disk rather than big sequential writes. iostat shows the same ~200tps of write, 100% usage but only 4-10mb/sec of bytes being written. However, even when it's not flushing (or when storing data on SSD or memdisk), after the first 500mb performance massively drops off to perhaps 10-15k inserts/sec. At the same time, looking at `top`, once the residential memory hits about 500mb, the 'shared memory' starts being used and residential just keeps on increasing. I'm not sure if this is some kind of kernel accounting thing to do with mmap usage but it doesn't happen for sequential key inserts (for those, shared mem stays around 0, residential stays 500mb). I'm using centos 6 with various different kernels from default to 3.7.5 and the behaviour is the same. I don't really know how to go about looking for the root cause of this but I'm pretty sure that whilst the IO is crippling it in places there is something else going on of which the shared memory increase is a sign. I've tried using the WRITEMAP option too which doesn't seem to affect anything significantly in terms of performance or memory usage. 5) pkgconfig/rpms would be really nice to have. Or do you expect it to just be bundled with a project as eg the perl module does? Thanks, Mark

3 18

How to check whether OpenLDAP server is provider or consumer ?
by pramod kulkarni 23 Aug '13

23 Aug '13

I am trying to notify a system to check if the openLDAP server is provider or consumer.I can do this by getting a referral error on the consumer side whenever I try to write something on the server , but is their any other way to check if OpenLDAP is provider or consumer without writing to it ? .

2 1

How to two-way synchronization on openldap 2.4.33 version
by Tian Zhiying 23 Aug '13

23 Aug '13

Hi I use OpenLDAP 2.4.33 version, I want to achieve two-way synchronization, but master --> slave ok slave --> master not ok Can it support slave to master data synchronization on 2.4.33 version? Thanks Tian Zhiying

2 1

Mirrormode replication
by Darouichi, Aziz 22 Aug '13

22 Aug '13

Hi, I have 3 local servers and 1 remote server. All servers are configured for Mirror mode replications. Every night replication stops on the remote server. Once I delete the database on the remote, start services replication works fine, the next morning I have to go through the same process. The remote server is a VM image of one of the local servers. They hosing company changed the host name, IP address and allowed communication via a VPN tunnel between them and us. These is my replication entry in slapd.conf #mirrormode TRUE mirrormode on # define the provider to use the syncprov overlay # (last directives in database section) syncrepl rid=006 provider=ldap://192.168.60.42 tls_cert=/etc/pki/tls/certs/ldap-tls.curry.edu.cert.pem tls_key=/etc/pki/tls/private/ldap-tls.curry.edu.key.pem tls_cacert=/etc/pki/tls/certs/cacert.pem tls_reqcert=demand searchbase="dc=curry,dc=edu" schemachecking=on timelimit=unlimited sizelimit=unlimited type=refreshAndPersist retry="60 +" Thanks

2 6

How to start slapd without slapd.conf?
by Steppacher Ralf 20 Aug '13

20 Aug '13

Hello all, this is probably a really stupid question... But I cannot figure out how to start a freshly built slapd using only slapd-config configuration. I built and installed slapd 2.4.35: ./configure --prefix=$HOME/server/openldap --enable-modules --enable-overlays=mod --with-tls=openssl make depend make make test make install After that I find a slapd.conf and slapd.ldif in $HOME/server/openldap/etc/openldap. As I understood from the administrator's guide the slapd.conf approach is deprecated and should not be used. So I renamed the slapd.conf to slapd.conf.ignore so it is not picked up by default as I think it would be. But sudo $HOME/server/openldap/libexec/slapd -s any -F $HOME/server/openldap/etc/openldap/ logs ldif_read_file: no entry file "/home/dpr/server/openldap/etc/openldap//cn=config.ldif" and slapd is stopped immediatelly sudo $HOME/server/openldap/libexec/slapd -s any -F $HOME/server/openldap/etc/openldap/ -f $HOME/server/openldap/etc/openldap/slapd.ldif yields /home/dpr/server/openldap/etc/openldap/slapd.ldif: line 5: unknown directive <dn:> outside backend info and database definitions. and again the demon stops. The only way I got the demon to start is by using the default slapd.conf or with the -f option pointing to a slapd.conf file. Please advise. Thanks! Ralf

5 9

attribute to store system mailbox value
by Zeus Panchenko 19 Aug '13

19 Aug '13

hi, may somebody to recommend the attribute to store path to system mailbox, among attributes of schema files shipped with openldap, "system mailbox" is the path to mbox format file or maildir directory where MDA (depends on MDA configuration) stores received mail messages so, to not to add new LDAP object and attribute definition, I'd like to know, may be close by function attribute already exists? -- Zeus V. Panchenko jid:zeus@im.ibs.dn.ua IT Dpt., I.B.S. LLC GMT+2 (EET)

3 3

How to correct delete objects from cn=config?
by Robert Wolf 19 Aug '13

19 Aug '13

Hello people, I would like to ask for correct and/or official way how to remove objects from cn=config. I have found "how to delete backend DB" and "can't delete bdb backend from cn=config" threads. I know I can activate experimental delete support for cn=config, but I don't want to use experimental features. I would like to do it correct way. Can you explain how to delete objects from cn=config? I wanted to test null backend so I have added olcModuleLoad: {1}back_null in cn=module{0} and then I have created olcDatabase={2}null in cn=config. After testing I wanted to delete null backend and unload null module. But it is impossible to delete olcDatabase={2}null from cn=config (error 53 unwilling to perform) and it is impossible delete the back_null module (error 80 cannot delete olcModuleLoad). What is correct way to remove such configured backends and modules? I have read about slapcat and slapadd, which can be used to dump cn=config into LDIF, then edit this LDIF and import with slapadd, but the slapd should not be running. Is this only way how to remove some configuration? Is there any other way to remove configuration online? Thank you for answers. Regards, Robert Wolf.

6 10

ou=people hidden from ldapsearch
by Adam 17 Aug '13

17 Aug '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm sure this is a really stupid question, and I'm sorry for asking it, but I'm testing a migration from Sun DSEE to OpenLDAP 2.4.35 at the moment. I am creating a DIT similar to the following: dn: ou=people,dc=example,dc=com dn: ou=ftp,dc=example,dc=com dn: ou=groups,dc=example,dc=com dn: ou=hosts,dc=example,dc=com dn: ou=us,ou=people,dc=example,dc=com dn: ou=bd,ou=people,dc=example,dc=com dn: ou=id,ou=people,dc=example,dc=com dn: ou=users,ou=ftp,dc=example,dc=com dn: ou=groups,ou=ftp,dc=example,dc=com dn: ou=us,ou=groups,dc=example,dc=com dn: ou=bd,ou=groups,dc=example,dc=com dn: ou=id,ou=groups,dc=example,dc=com dn: ou=us,ou=hosts,dc=example,dc=com dn: ou=bd,ou=hosts,dc=example,dc=com dn: ou=id,ou=hosts,dc=example,dc=com When I perform a ldapsearch against our current Sun DSEE environment (with the same layout) I see the following: ldapsearch -x -h ldap.example.com -b example.com objectclass=organizationalUnit 1 -LLL dn: ou=people,dc=example,dc=com dn: ou=ftp,dc=example,dc=com dn: ou=groups,dc=example,dc=com dn: ou=hosts,dc=example,dc=com dn: ou=us,ou=people,dc=example,dc=com dn: ou=bd,ou=people,dc=example,dc=com dn: ou=id,ou=people,dc=example,dc=com dn: ou=users,ou=ftp,dc=example,dc=com dn: ou=groups,ou=ftp,dc=example,dc=com dn: ou=us,ou=groups,dc=example,dc=com dn: ou=bd,ou=groups,dc=example,dc=com dn: ou=id,ou=groups,dc=example,dc=com dn: ou=us,ou=hosts,dc=example,dc=com dn: ou=bd,ou=hosts,dc=example,dc=com dn: ou=id,ou=hosts,dc=example,dc=com When I perform the same search against OpenLDAP, I get the following: dn: ou=ftp,dc=example,dc=com dn: ou=hosts,dc=example,dc=com dn: ou=us,ou=people,dc=example,dc=com dn: ou=bd,ou=people,dc=example,dc=com dn: ou=id,ou=people,dc=example,dc=com dn: ou=users,ou=ftp,dc=example,dc=com dn: ou=groups,ou=ftp,dc=example,dc=com dn: ou=us,ou=groups,dc=example,dc=com dn: ou=bd,ou=groups,dc=example,dc=com dn: ou=id,ou=groups,dc=example,dc=com dn: ou=us,ou=hosts,dc=example,dc=com dn: ou=bd,ou=hosts,dc=example,dc=com dn: ou=id,ou=hosts,dc=example,dc=com Notice the destinct lack of ou=people,dc=example,dc=com and ou=groups,dc=example,dc=com. I know they're there, because I can create objects etc in them, but I'm at a complete loss as to why they don't show up in the ldapsearch. I know I'm obviously doing something stupid here, and again, I apologize, but any assistance would be appreciated. Thanks. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQEcBAEBAgAGBQJSD4mtAAoJEH1iO/rgZIL9FwwH/3UxTIgxrVbe7IVf99IRB+hf veJMZ6NaqMjlFfFsla+KLbIF/64I5rwqVCLu/y6necJrQS2EY+cmZmNRlQ02/Cso rfd5ZQgp5q7ECZSkZCTLhrB1CIY183PiloDnG41lmpJkkP+thwj4NUdcMYYxP0bo EOMZIefdOewhV7+DOv0Jw807HCOAYrgfsbIk8uDmBUCdBaf4/WVmnLzTGMLq7zrj HLSJC09bPqcmlEieWVXFNVajE5ztZs8XI6WmFYvrDq1/+1bKoaYMRT2sMh8HnuEM hisFEUsLpQWSpwP52tmSGau2sOhthLPQKRBrIQbCyAwfEfwtqc+TUDmMsaxhKy0= =AqJ2 -----END PGP SIGNATURE-----

2 2

Schema Replication and data replication.
by espeake＠oreillyauto.com 12 Aug '13

12 Aug '13

So we are cooking with warm oil and I wan to the cooking with hot oil!!!! I have been able to get upgraded 2.4.28 on open ldap. Having issue with getting a good build of 2.4.35. But that isn't the problem. Below is the log on my log from one of my consumers after starting the slapd service. Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module back_hdb Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module back_hdb: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module ppolicy Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module ppolicy: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module memberof Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module memberof: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module dynlist Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module dynlist: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module syncprov Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module syncprov: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module refint Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module refint: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: loaded module back_ldap Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: module back_ldap: null module registered Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: Config: ** successfully added syncrepl rid=002 "ldap://tntest-ldap-master-1.oreillyauto.com" Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index objectClass 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index cn 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index uid 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index oreillyGroup 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index locationEntry 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index counterNumber 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index businessCategory 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index locationNumber 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index position 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index title 0x0214 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index givenName 0x0214 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index functionListing 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index manager 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index sn 0x0214 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index nickName 0x0214 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index employeeNumber 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index ou 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index entryUUID 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index supervisor 0x0004 Aug 7 21:36:16 tntest-ldap-2 slapd[3961]: index entryCSN 0x0004 Aug 7 21:36:17 tntest-ldap-2 slapd[3962]: slapd starting Aug 7 21:36:17 tntest-ldap-2 slapd[3962]: do_syncrep2: rid=002 LDAP_RES_SEARCH_RESULT Here is where is stops. Here in the ldif file from my master: # AUTO-GENERATED FILE - DO NOT EDIT!! Use ldapmodify. # CRC32 3411e7fc dn: olcDatabase={0}config objectClass: olcDatabaseConfig olcDatabase: {0}config olcUpdateRef: ldap://tntest-ldap-master-1.oreillyauto.com olcsyncrepl: rid=002 provider=ldap://tntest-ldap-master-1.oreillyauto.com type=refreshAndPersist retry="10 +" searchbase="cn=config" bindmethod=simple binddn="uid=admin,dc=oreillyauto,dc=com" credentials=<password> olcAccess: to * by dn="uid=admin,dc=oreillyauto,dc=com" write by dn="uid=ldapadmin,ou=system,dc=oreillyauto,dc=com" write by * none olcRootDN: cn=admin,cn=config olcRootPW:: c2VjcmV0 structuralObjectClass: olcDatabaseConfig entryUUID: 35b75e72-93c2-1032-9ca4-711c013d2dcb creatorsName: cn=config createTimestamp: 20130807153144Z entryCSN: 20130807153144.468097Z#000000#000#000000 modifiersName: cn=config modifyTimestamp: 20130807153144Z Here is the ldif from my consumer: dn: olcDatabase={0}config objectClass: olcDatabaseConfig olcDatabase: {0}config olcRootDN: cn=admin,cn=config olcRootPW: secret structuralObjectClass: olcDatabaseConfig olcsyncrepl: {0}rid=002 provider=ldap://tntest-ldap-master-1.oreillyauto.com type=refreshOnly retry="5 +" searchbase="cn=config" bindmethod=simple binddn="cn=admin,cn=config" credentials=<password> schemachecking=on olcAccess: to * by dn="uid=admin,dc=oreillyauto,dc=com" write by dn="uid=ldapadmin,ou=system,dc=oreillyauto,dc=com" write by * none entryUUID: f074ba7c-09ed-1030-952b-0bb60fbd91a8 creatorsName: cn=config createTimestamp: 20110503162710Z entryCSN: 20110503162710.319234Z#000000#000#000000 modifiersName: cn=config ModifyTimestamp: 20110503162710Z logging is set to config and sync. Is the issue the maybe the entryCSN? I am wondering if I need to blow out the cn=config stuff and recreate it on the consumer It should be that hard, just take a little time. Am I headed in the right direction or am I off base. Thank you, Eric Speake Web Systems Administrator O'Reilly Auto Parts This communication and any attachments are confidential, protected by Communications Privacy Act 18 USCS � 2510, solely for the use of the intended recipient, and may contain legally privileged material. If you are not the intended recipient, please return or destroy it immediately. Thank you.

3 16

← Newer
1
2
3
4
5
6
7
8
9
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

openldap-technical August 2013