priit(a)ww.ee wrote:
> Full_Name: Priit Oorn
> Version: no idea
> OS: Manjaro KDE stable
> URL: https://bugsfiles.kde.org/attachment.cgi?id=123175
> Submission from: (NULL) (2001:7d0:8240:e600:7a6:c9cf:974a:2e6e)
>
>
> STEPS TO REPRODUCE
> 1. reboot system
> 2. journalctl -p3
>
> OBSERVED RESULT
> KDE baloo_file and baloo_file_extr serial crashing due to LMDB crashing.
>
> EXPECTED RESULT
> no services crashing obviously.
>
> SOFTWARE/OS VERSIONS
> Linux/KDE Plasma: Manjaro Linux KDE stable
> KDE Plasma Version: 5.16.5
> KDE Frameworks Version: 5.62.0
> Qt Version: 5.13.1
> LBDM version: no idea... that comes with Manjaro KDE stable default install +
> all updates. the crashing thing has been there forever though over several
> versions.
>
> reported the bug to KDE initially, but they say it's your fault... :P
> https://bugs.kde.org/show_bug.cgi?id=412925
The stack traces you provided there https://bugsfiles.kde.org/attachment.cgi?id=123175 would
indicate a crash in LMDB, but without providing version info we have nothing to go on. Nor
do we have any insight into how KDE integrated LMDB and whether they used its API correctly.
--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/
Full_Name: Priit Oorn
Version: no idea
OS: Manjaro KDE stable
URL: https://bugsfiles.kde.org/attachment.cgi?id=123175
Submission from: (NULL) (2001:7d0:8240:e600:7a6:c9cf:974a:2e6e)
STEPS TO REPRODUCE
1. reboot system
2. journalctl -p3
OBSERVED RESULT
KDE baloo_file and baloo_file_extr serial crashing due to LMDB crashing.
EXPECTED RESULT
no services crashing obviously.
SOFTWARE/OS VERSIONS
Linux/KDE Plasma: Manjaro Linux KDE stable
KDE Plasma Version: 5.16.5
KDE Frameworks Version: 5.62.0
Qt Version: 5.13.1
LBDM version: no idea... that comes with Manjaro KDE stable default install +
all updates. the crashing thing has been there forever though over several
versions.
reported the bug to KDE initially, but they say it's your fault... :P
https://bugs.kde.org/show_bug.cgi?id=412925
Decoded we have:
"I have changed back-meta to the back-ldap, and it resolved this problem."
--On Tuesday, September 24, 2019 11:59 AM +0000 I.Harbuz(a)A1.by wrote:
--
Quanah Gibson-Mount
Product Architect
Symas Corporation
Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
<http://www.symas.com>
Full_Name: Howard Chu
Version: 2.4
OS: Linux
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (84.203.26.174)
Submitted by: hyc
In back-mdb the entry reindexer operates in batches of 500 entries at a time.
(I.e., it commits one LMDB txn for every 500 entries.) But a final txn_commit is
missing in tool_entry_close() to flush out the last few entries that were
operated on.
--On Wednesday, October 9, 2019 9:38 AM +0000 gihanridal8(a)gmail.com wrote:
> Full_Name: Gihan De Silva
> Version: 2.4.44
> OS: 7.5
> URL: ftp://ftp.openldap.org/incoming/
> Submission from: (NULL) (123.231.119.138)
Hello,
The OpenLDAP bug tracking system is for bug reports only. Usage questions
should be directed to the OpenLDAP Technical discussion list:
<https://www.openldap.org/lists/mm/listinfo/openldap-technical>
If you have an urgent support need, then I suggest contacting one of the
listed 3rd party support providers at:
<https://www.openldap.org/support/>
This ITS will be closed.
Regards,
Quanah
--
Quanah Gibson-Mount
Product Architect
Symas Corporation
Packaged, certified, and supported LDAP solutions powered by OpenLDAP:
<http://www.symas.com>
Full_Name: Gihan De Silva
Version: 2.4.44
OS: 7.5
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (123.231.119.138)
Dear Sir/ Madam,
We are having two OpenLDAP servers on production with master master data
synchronization. We are facing an incident where both servers consume memory
upto 99% and LDAP server2 leads to not responding state.
As a workaround we have restart both OpenLDAP nodes. However after few days the
memory goes high at its peak.
There are about 100k+ requests for one LDAP server per day. where both servers
are identical in terms of 16 GB RAM, 4 CPUs, CentOS7 OS and LDAP server 2.4.44.
We didnt observe any suspiciuos errors in the logs as well.
Appreciate your valued consultation and recomendations on this incident for a
RCA and a solution.
Thank You
Regards,
Gihan.
Full_Name: Gihan De Silva
Version: 2.4.44
OS: 7.5
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (123.231.119.138)
Dear Sir/ Madam,
We are having two OpenLDAP servers on production with master master data
synchronization. We are facing an incident where both servers consume memory
upto 99% and LDAP server2 leads to not responding state.
As a workaround we have restart both OpenLDAP nodes. However after few days the
memory goes high at its peak.
There are about 100k+ requests for one LDAP server per day. where both servers
are identical in terms of 16 GB RAM, 4 CPUs, CentOS7 OS and LDAP server 2.4.44.
We didnt observe any suspiciuos errors in the logs as well.
Appreciate your valued consultation and recomendations on this incident for a
RCA and a solution.
Thank You
Regards,
Gihan.
Full_Name: Gihan De Silva
Version: 2.4.44
OS: 7.5
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (123.231.119.138)
Dear Sir/ Madam,
We are having two OpenLDAP servers on production with master master data
synchronization. We are facing an incident where both servers consume memory
upto 99% and LDAP server2 leads to not responding state.
As a workaround we have restart both OpenLDAP nodes. However after few days the
memory goes high at its peak.
There are about 100k+ requests for one LDAP server per day. where both servers
are identical in terms of 16 GB RAM, 4 CPUs, CentOS7 OS and LDAP server 2.4.44.
We didnt observe any suspiciuos errors in the logs as well.
Appreciate your valued consultation and recomendations on this incident for a
RCA and a solution.
Thank You
Regards,
Gihan.
Full_Name: Maxime Besson
Version: 2.4.48
OS: Linux
URL: ftp://ftp.openldap.org/incoming/
Submission from: (NULL) (77.193.139.162)
I am attempting to implement the following disaster recovery process:
* rm all previous data
* run a configuration script (puppet) to recreate a bare-bones LDAP server and
DIT
* restore a backed-up slapcat dump on top of the freshly installed OpenLDAP
server, ignoring duplicates already inserted by Puppet
But it seems that when skipping over the existing objects, something goes wrong
and causes attributes to get mixed up. But only when certain attributes are
present in the existing objects. Here is how to reproduce:
slapd.conf:
===
include /etc/ldap/schema/core.schema
include /etc/ldap/schema/cosine.schema
include /etc/ldap/schema/inetorgperson.schema
moduleload back_mdb
database mdb
maxsize 1073741824
suffix "dc=example,dc=com"
directory /tmp
===
puppet_init.ldif
===
dn: dc=example,dc=com
objectClass: domain
dc: example
===
backup.ldif
===
dn: dc=example,dc=com
objectClass: domain
dc: example
contextCSN: 20190909094705.796552Z#000000#001#000000
dn: uid=ttully,dc=example,dc=com
objectClass: inetOrgPerson
uid: ttully
userPassword:: c2Nob29uZXI=
facsimileTelephoneNumber: +1 408 555 0111
givenName: Torrey
cn: Torrey Tully
telephoneNumber: +1 408 555 2274
sn: Tully
roomNumber: 3924
mail: ttully(a)example.com
l: Sunnyvale
ou: Human Resources
ou: People
===
When running the following commands:
===
rm -f /tmp/*.mdb
slapadd -f slapd.conf puppet_init.ldif
slapadd -f slapd.conf -c backup.ldif
===
The redundant root object in backup.ldif gets skipped as -c should do, but the
attributes from my "ttully" user (and every following object in the ldif dump)
end up all mixed up:
===
slapcat -f slapd.conf
...
dn: uid=ttully,dc=example,dc=com
objectClass: inetOrgPerson
userPassword:: dHR1bGx5
facsimileTelephoneNumber: schooner
givenName: +1 408 555 0111
cn: Torrey
telephoneNumber: Torrey Tully
sn: +1 408 555 2274
roomNumber: Tully
mail: 3924
l: ttully(a)example.com
ou: Sunnyvale
ou: Human Resources
ou: People
...
===
This mixup does NOT happen if:
* I import backup.ldif into an empty database
* OR I remove "contextCSN" from the backup ldif
* OR I use BDB instead of MDB
So it seems that my issue is caused by a combination of MDB, skipping existing
entries, and having special attributes (contextCSN) in the skipped objects.
I was able to reproduce this behavior:
* On Debian Buster (OpenLDAP 2.4.47)
* On RHEL7 + LTB project RPMs 2.4.48
* Using a git snapshot (3be82f40d5cd4ca050e10859ecb961f28c807c41) with no
particular config options
* Using cn=config rather than slapd.conf
* On a real production system, rather than the simplified version presented
here.
* Using another "special" attribute such as pwdAccountLockedTime instead of
"contextCSN"