Hi all,
I've got a problem with OpenLdap since I'm trying to insert 1,5 Million of entries into LDAP. OpenLDAP crash with "bdb: malloc: Cannot allocate memory" when approximately 950 000 entries are inserted. My computer got 2GB of RAM and here is my slapd.conf :
# This is the main slapd configuration file. See slapd.conf(5) for more
# info on the configuration options.
####################################################################### # Global Directives:
# Features to permit #allow bind_v2
# Schema and objectClass definitions
include /etc/ldap/schema/core.schema include /etc/ldap/schema/cosine.schema include /etc/ldap/schema/nis.schema include /etc/ldap/schema/inetorgperson.schema #include /etc/schema/samba.schema include /etc/ldap/schema/bvs.schema
# Where the pid file is put. The init.d script # will not stop the server if you change this. pidfile /var/run/slapd/slapd.pid
# List of arguments that were passed to the server argsfile /var/run/slapd/slapd.args
# Read slapd.conf(5) for possible values loglevel none
# Where the dynamically loaded modules are stored modulepath /usr/lib/ldap moduleload back_bdb moduleload syncprov
# logout idle clients after 10 seconds idletimeout 10
# The maximum number of entries that is returned for a search operation sizelimit unlimited
#Specify the maximum number of pending requests for an anonymous session conn_max_pending_auth 300
# The tool-threads parameter sets the actual amount of cpu's that is used # for indexing. tool-threads 2
####################################################################### # Specific Backend Directives for hdb: # Backend specific directives apply to this backend until another # 'backend' directive occurs backend bdb
####################################################################### # Specific Backend Directives for 'other': # Backend specific directives apply to this backend until another # 'backend' directive occurs #backend <other>
####################################################################### # Specific Directives for database #1, of type hdb: # Database specific directives apply to this databasse until another # 'database' directive occurs database bdb
dbnosync # updates are allowed to remain pending cachesize 1500000
index sn,givenName pres,eq index ENTPersonJointure eq
#overlay syncprov
#syncprov-checkpoint 100 10 #syncprov-sessionlog 100
# The base of your directory in database #1 suffix "dc=bvs,dc=fr"
# rootdn directive for specifying a superuser on the database. This is needed # for syncrepl. rootdn "cn=Manager,ou=ENTPerson,dc=bvs,dc=fr" rootpw collaba
# Where the database file are physically stored for database #1 directory /var/lib/ldap
# The dbconfig settings are used to generate a DB_CONFIG file the first # time slapd starts. They do NOT override existing an existing DB_CONFIG # file. You should therefore change these settings in DB_CONFIG directly # or remove DB_CONFIG and restart slapd for changes to take effect.
# For the Debian package we use 2MB as default but be sure to update this # value if you have plenty of RAM dbconfig set_cachesize 0 1024000 0 dbconfig set_flags DB_TXN_NOSYNC
# Sven Hartge reported that he had to set this value incredibly high # to get slapd running at all. See http://bugs.debian.org/303057 for more # information.
# Number of objects that can be locked at the same time. dbconfig set_lk_max_objects 1500 # Number of locks (both requested and granted) dbconfig set_lk_max_locks 1500 # Number of lockers dbconfig set_lk_max_lockers 1500
# Indexing options for database #1 index objectClass eq
# Save the time that the entry gets modified, for database #1 lastmod off
# Checkpoint the BerkeleyDB database periodically in case of system # failure and to speed slapd shutdown. checkpoint 512000 30
# Where to store the replica logs for database #1 # replogfile /var/lib/ldap/replog
# Basic ACL (deprecated in favour of ACLs in /etc/openldap/slapd.access.conf) #access to attr=userPassword # by self write # by anonymous auth # by dn="uid=root,ou=People,dc=example,dc=com" write # by * none
# ACL for "Enseignant" profile only (=> can modify all "userPassword" of its own College) access to dn.regex="^cn=(.*),ou=entperson,ou=(.*),ou=(.*),dc=bvs,dc=fr$" attrs=givenName by set.regex="user/entPersonProfils & [cn=Enseignant_$2,ou=entgroup,ou=$2,ou=$3,dc=bvs,dc=fr]" write by * read
# ACL for "Administrateur" profile only (=> can modify all data of its own College) access to dn.regex="^(.*),ou=(.*),ou=(.*),dc=bvs,dc=fr$" by set.regex="user/entPersonProfils & [cn=Administrateur_$2,ou=entgroup,ou=$2,ou=$3,dc=bvs,dc=fr]" write by * read
# ACL for "Eleve" profile only (=> can modify only its own "userPassword") access to attrs=entPersonDateNaissance by self write by * read
access to * by * read
####################################################################### # Specific Directives for database #2, of type 'other' (can be hdb too): # Database specific directives apply to this databasse until another # 'database' directive occurs #database <other>
# The base of your directory for database #2 #suffix "dc=debian,dc=org"
What am I doing wrong ?
Regards.