RE: Antw: [EXT] RE: slapd 2.4.44 Performance problems
by Maucci, Cyrille
I'd probably need more details to understand what is seen, e.g. a graph over time of the CPU utilization of each core...
I've been discussing with people in the past who were saying "not using" mistakingly :-)
-----Original Message-----
From: Ulrich Windl [mailto:Ulrich.Windl@rz.uni-regensburg.de]
Sent: Thursday, July 2, 2020 7:15 AM
To: daniel.zuniga(a)gmail.com; Maucci, Cyrille <cyrille.maucci(a)hpe.com>; quanah(a)symas.com
Cc: openldap-technical(a)openldap.org
Subject: Antw: [EXT] RE: slapd 2.4.44 Performance problems
>>> "Maucci, Cyrille" <cyrille.maucci(a)hpe.com> schrieb am 01.07.2020 um
>>> 18:06 in
Nachricht
<DF4PR8401MB0555595797F072395C494F66926C0(a)DF4PR8401MB0555.NAMPRD84.PROD.OUTLOOK.
OM>:
> I assume this is with back-bdb/hdb and is because Berkeley DB does not
> scale beyond 8 cores.
There's a difference between "not using" and "not scaling".
>
> From: Daniel Zuniga [mailto:daniel.zuniga@gmail.com]
> Sent: Wednesday, July 1, 2020 3:43 PM
> To: Quanah Gibson-Mount <quanah(a)symas.com>
> Cc: openldap-technical(a)openldap.org
> Subject: Re: slapd 2.4.44 Performance problems
>
> Is there a reason why OpenLDAP does not seem to use more than 8 cores
> regardless of the number of threads it is being told to use? With 16
> threads it saturates 8 cores, 16 threads and 16 cores still uses 8
> cores, 32 threads and 16 cores... only 8 cores are used.
3 years, 5 months
Re: [EXT] Re: syncrepl does not work as expected
by kumar rahul
Hi Quanah
Here is the output of slapd -VVV command. I do see accesslog as static
overlays.
What changes i need to make in below snippet
*dn: cn=module{0},cn=configchangetype: modifyadd:
olcModuleLoadolcModuleLoad: syncprovolcModuleLoad: accesslog*
[HPE SmartFabric:root@SN2100-106 initial_config]#slapd -VVV
@(#) $OpenLDAP: slapd 2.4.50 (Jul 1 2020 20:22:05) $
@SN2100-106:/root/smartfabric/open-ldap/initial_config/openldap-2.4.50/servers/slapd
Included static overlays:
accesslog
syncprov
Included static backends:
config
ldif
monitor
mdb
relay
On Wed, Jul 1, 2020 at 5:13 PM Quanah Gibson-Mount <quanah(a)symas.com> wrote:
>
>
> --On Wednesday, July 1, 2020 4:28 PM -0400 kumar rahul
> <rahul2002mit(a)gmail.com> wrote:
>
> >
> >
> > Hi Quanah
>
>
> > [Rahul] How do I verify this if modules are compiled statically?
>
> slapd -VV
>
> But if you're building OpenLDAP yourself, I suggest reading the output of
> configure, which tells you how to build dynamically vs statically.
>
>
> --Quanah
>
>
> --
>
> Quanah Gibson-Mount
> Product Architect
> Symas Corporation
> Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
> <http://www.symas.com>
>
3 years, 5 months
slapd 2.4.44 Performance problems
by daniel.zuniga＠gmail.com
Hello,
We are running OpenLDAP with a relatively small user base (15K users) and the server does not seem to be able to keep up with demand when there are multiple concurrent logins (20 users X 70 searches each) during user login. When users login to the server all cores in the server (8) run at 100% utilization, sometimes for as long as 20 minutes (depending on how many users are logging in concurrently).
We have experimented and read and re-read the Tuning guidance but with very little success.
We have tried increasing the number of available cores to slapd, but it does not use more than 8. We have also increased the number of threads from 16 to 32, but that also does not seem to have an effect nor does it seem to allow slapd to use all 16 cores (slapd seems limited to 8 cores regardless of the number of threads defined).
The server has plenty of memory available and configured the db cache to use as much as in needs, but that does not seem to improve matters.
Can you offer any guidance? Thanks.
3 years, 5 months
Re: [EXT] Re: syncrepl does not work as expected
by kumar rahul
Hi Quanah
During the installation configure script was run like this
./configure --enable-bdb=no --enable-hdb=no --enable-ipv6=yes
I just added following option to enable all overlays
./configure --enable-bdb=no --enable-hdb=no --enable-ipv6=yes
*--enable-overlays=yes*
Will this fix the problem?
Thanks
Rahul
On Wed, Jul 1, 2020 at 1:38 PM Quanah Gibson-Mount <quanah(a)symas.com> wrote:
> --On Wednesday, July 1, 2020 11:09 AM -0400 kumar rahul
> <rahul2002mit(a)gmail.com> wrote:
>
> > I am seeing following ERROR
>
> I have no idea how your slapd was built, etc. But essentially the
> accesslog overlay must be loaded into slapd to be of use. It looks like
> at
> least some of the modules in your system are compiled statically, which is
> likely why you currently do not have a module{0} section for loading
> modules. You'll also have to verify where on disk the accesslog overlay
> exists so that the moduleload statement pulls from the right directory.
>
> Regards,
> Quanah
>
>
> --
>
> Quanah Gibson-Mount
> Product Architect
> Symas Corporation
> Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
> <http://www.symas.com>
>
3 years, 5 months
Re: [EXT] Re: syncrepl does not work as expected
by kumar rahul
Thank you for the pointers. I will setup delta syncrepl and test to verify
if I see the issue or not.
Thanks
Rahul
On Mon, Jun 29, 2020 at 4:02 PM Quanah Gibson-Mount <quanah(a)symas.com>
wrote:
> --On Monday, June 29, 2020 4:20 PM -0400 kumar rahul
> <rahul2002mit(a)gmail.com> wrote:
>
> > Thank you for creating the bug. I have added myself as CC. Based on
> > the configuration information I have provided, can you provide a set of
> > guidelines to configure my setup to use delta-syncrepl.
>
> The admin guide already provides information the configuration bits
> necessary to set up delta-syncrepl. Generally:
>
> a) You need a secondary DB to store the accesslog data from the accesslog
> overlay.
>
> b) You need to reconfigure the olcSyncrepl config to make use of the
> accesslog db.
>
> <https://www.openldap.org/doc/admin24/replication.html#Delta-syncrepl>
>
> And a blog post I wrote that gives some example configs:
>
> <
> https://mishikal.wordpress.com/2019/04/23/configuring-mmr-using-delta-syn...
> >
>
> Regards,
> Quanah
>
> --
>
> Quanah Gibson-Mount
> Product Architect
> Symas Corporation
> Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
> <http://www.symas.com>
>
3 years, 5 months