From lm5@ualberta.ca Sat Apr  6 02:53:04 2013
From: lm5@ualberta.ca
To: openldap-bugs@openldap.org
Subject: Re: (ITS#7566) ldapadd slower on Linux than BSD
Date: Sat, 06 Apr 2013 02:53:04 +0000
Message-ID: <201304060253.r362r4oh008134@boole.openldap.org>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============8312452461665149848=="

--===============8312452461665149848==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

--047d7b414c2ebdcec404d9a84c9d
Content-Type: text/plain; charset=3DISO-8859-1

Hi Quanah,

I have started doing tests with Gentoo Linux running openldap 2.4.35, glibc
2.16 and linux kernel 3.4, 3.8 and 3.9-rc5. I have tried ext2, ext4,
reiserfs and jfs. Ldapadd is still very slow compared to BSD regardless of
the openldap backend.

Also a correction to the initial report: using a memory based file system,
ldapadd the whole database took 22 min.

Leo


On Fri, Apr 5, 2013 at 5:48 PM, Quanah Gibson-Mount <quanah(a)zimbra.com>wrot=
e:

> --On Friday, April 05, 2013 11:46 PM +0000 quanah(a)zimbra.com wrote:
>
>  --On Friday, April 05, 2013 11:36 PM +0000 lm5(a)ualberta.ca wrote:
>>
>>  Full_Name: Leo Mocofan
>>> Version: 2.4.31
>>> OS: Debian Testing
>>> URL: ftp://ftp.openldap.org/**incoming/<ftp://ftp.openldap.org/incoming/>
>>> Submission from: (NULL) (129.128.11.107)
>>>
>>
>> If you are going to test back-mdb, then you need to use a current
>> OpenLDAP  release (2.4.35).
>>
>> In any case, I don't see a bug report here?  It sounds more like you're
>> asking for tuning advice?  I would ask what filesystem you are using
>> (ext2?  ext4?) etc.  For ext4, I had to modify dirty_bytes to keep the
>> Debian/Ubuntu flush process from killing load performance.
>>
>
> Oh, one other note -- I advise avoiding the debian/ubuntu build versions
> of BDB, if that is what you are using.  They do not build BDB with the
> correct configure options, seriously impacting performance.
>
>
> --Quanah
>
> --
>
> Quanah Gibson-Mount
> Sr. Member of Technical Staff
> Zimbra, Inc
> A Division of VMware, Inc.
> --------------------
> Zimbra ::  the leader in open source messaging and collaboration
>
>

--047d7b414c2ebdcec404d9a84c9d
Content-Type: text/html; charset=3DISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D3D"ltr"><div><div>Hi Quanah,<br><br></div>I have started doing tes=
=3D
ts with Gentoo Linux running openldap 2.4.35, glibc 2.16 and linux kernel 3=3D
.4, 3.8 and 3.9-rc5. I have tried ext2, ext4, reiserfs and jfs. Ldapadd is =3D
still very slow compared to BSD regardless of the openldap backend. <br>
<br></div><div>Also a correction to the initial report: using a memory base=3D
d file system, ldapadd the whole database took 22 min.<br></div><div><br></=3D
div>Leo<br></div><div class=3D3D"gmail_extra"><br><br><div class=3D3D"gmail_q=
uo=3D
te">
On Fri, Apr 5, 2013 at 5:48 PM, Quanah Gibson-Mount <span dir=3D3D"ltr">&lt;<=
=3D
a href=3D3D"mailto:quanah(a)zimbra.com" target=3D3D"_blank">quanah(a)zimbra.c=
om</a>=3D
&gt;</span> wrote:<br><blockquote class=3D3D"gmail_quote" style=3D3D"margin:0=
 0=3D
 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class=3D3D"im">--On Friday, April 05, 2013 11:46 PM +0000 <a href=3D3D"m=
ai=3D
lto:quanah(a)zimbra.com" target=3D3D"_blank">quanah(a)zimbra.com</a> wrote:<b=
r>
<br>
</div><div class=3D3D"im"><blockquote class=3D3D"gmail_quote" style=3D3D"marg=
in:0=3D
 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
--On Friday, April 05, 2013 11:36 PM +0000 <a href=3D3D"mailto:lm5(a)ualberta=
.c=3D
a" target=3D3D"_blank">lm5(a)ualberta.ca</a> wrote:<br>
<br>
<blockquote class=3D3D"gmail_quote" style=3D3D"margin:0 0 0 .8ex;border-left:=
1p=3D
x #ccc solid;padding-left:1ex">
Full_Name: Leo Mocofan<br>
Version: 2.4.31<br>
OS: Debian Testing<br>
URL: <a href=3D3D"ftp://ftp.openldap.org/incoming/" target=3D3D"_blank">ftp:/=
/f=3D
tp.openldap.org/<u></u>incoming/</a><br>
Submission from: (NULL) (129.128.11.107)<br>
</blockquote>
<br>
If you are going to test back-mdb, then you need to use a current<br>
OpenLDAP =3DA0release (2.4.35).<br>
<br>
In any case, I don&#39;t see a bug report here? =3DA0It sounds more like you&=
=3D
#39;re<br>
asking for tuning advice? =3DA0I would ask what filesystem you are using<br>
(ext2? =3DA0ext4?) etc. =3DA0For ext4, I had to modify dirty_bytes to keep th=
e<=3D
br>
Debian/Ubuntu flush process from killing load performance.<br>
</blockquote>
<br></div>
Oh, one other note -- I advise avoiding the debian/ubuntu build versions of=3D
 BDB, if that is what you are using. =3DA0They do not build BDB with the corr=
=3D
ect configure options, seriously impacting performance.<div class=3D3D"HOEnZb=
=3D
">
<div class=3D3D"h5"><br>
<br>
--Quanah<br>
<br>
--<br>
<br>
Quanah Gibson-Mount<br>
Sr. Member of Technical Staff<br>
Zimbra, Inc<br>
A Division of VMware, Inc.<br>
--------------------<br>
Zimbra :: =3DA0the leader in open source messaging and collaboration<br>
<br>
</div></div></blockquote></div><br></div>

--047d7b414c2ebdcec404d9a84c9d--



--===============8312452461665149848==--