(ITS#7401) OpenLDAP 2.4.32 - deadlock issues

Full_Name: Venkatesh Baglodi Version: 2.4.32 OS: Red Hat Enterprise Linux Server release 5.5 URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (144.160.226.53)

We have been facing occasional deadlock issues when using OpenLDAP in multi-master mode (4 servers). It looks like deadlocks are occuring on objectClass index (eq). We have been using OpenLDAP 2.4.32 with hdb backend (BerkelyDB v5.3.21) on Red Hat Enterprise Linux Server release 5.5 (Tikanga). We tried to upload the DB stat reports on ftp.openldap.org/incoming/, but looks like the server is out of disk space. Some of the traces are provided below:

db_stat -CA =========== Default locking region information: 254 Last allocated locker ID 0x7fffffff Current maximum unused locker ID 9 Number of lock modes 2400 Initial number of locks allocated 0 Initial number of lockers allocated 2400 Initial number of lock objects allocated 0 Maximum number of locks possible 0 Maximum number of lockers possible 0 Maximum number of lock objects possible 2400 Current number of locks allocated 188 Current number of lockers allocated 2400 Current number of lock objects allocated 480 Number of lock object partitions 4099 Size of object hash table 91 Number of current locks 7765 Maximum number of locks at any one time 88 Maximum number of locks in any one bucket 248550 Maximum number of locks stolen by for an empty partition 665 Maximum number of locks stolen for any one partition 79 Number of current lockers 185 Maximum number of lockers at any one time 33 Number of current lock objects 1779 Maximum number of lock objects at any one time 4 Maximum number of lock objects in any one bucket 15 Maximum number of objects stolen by for an empty partition 2 Maximum number of objects stolen for any one partition 1175M Total number of locks requested (1175730771) 1174M Total number of locks released (1174938911) 0 Total number of locks upgraded 163 Total number of locks downgraded 1058324 Lock requests not available due to conflicts, for which we waited 459038 Lock requests not available due to conflicts, for which we did not wait 84153 Number of deadlocks 0 Lock timeout value 0 Number of locks that have timed out 0 Transaction timeout value 0 Number of transactions that have timed out 3MB 336KB Region size 5804758 The number of partition locks that required waiting (0%) 50948 The maximum number of times any partition lock was waited for (0%) 701 The number of object queue operations that required waiting (0%) 1703227 The number of locker allocations that required waiting (0%) 243743 The number of region locks that required waiting (0%) 5 Maximum hash bucket length =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Lock REGINFO information: Environment Region type 1 Region ID /opt/app/aft/scldldap/var/data/o=scld,dc=att,dc=com/__db.001 Region name 0x2b9be30d3000 Region address 0x2b9be30d30a0 Region allocation head 0x2b9be32d35b0 Region primary address 0 Region maximum allocation 0 Region allocated Region allocations: 30466493 allocations, 0 failures, 30465357 frees, 10 longest Allocations by power-of-two sizes: 1KB 30466479 2KB 3 4KB 4 8KB 3 16KB 0 32KB 0 64KB 1 128KB 1 256KB 0 512KB 1 1024KB 1 REGION_SHARED Region flags =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Lock region parameters: 2 Lock region region mutex [243743/281M 0% 27451/47948529212608] <wakeups 0/15779> 257 locker table size 4099 object table size 2099280 obj_off 2567960 locker_off 0 need_dd =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Lock conflict matrix: =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Locks grouped by lockers: Locker Mode Count Status ----------------- Object --------------- 81b47648 dd=43 locks held 0 write locks 0 pid/thread 27448/1165564224 flags 0 priority 100 81b47648 READ 1 WAIT objectClass.bdb page 3 81b3bf98 dd=67 locks held 0 write locks 0 pid/thread 27448/1106815296 flags 0 priority 100 81b3bf98 READ 1 WAIT objectClass.bdb page 3 81b84f43 dd=10 locks held 0 write locks 0 pid/thread 27448/1425738048 flags 0 priority 100 81b84f43 READ 1 WAIT objectClass.bdb page 3 81b3c4be dd=57 locks held 0 write locks 0 pid/thread 27448/1140386112 flags 0 priority 100 81b3c4be READ 1 WAIT objectClass.bdb page 3 81b84f46 dd= 9 locks held 0 write locks 0 pid/thread 27448/1434130752 flags 0 priority 100 81b84f46 READ 1 WAIT objectClass.bdb page 3 81b84f49 dd= 8 locks held 0 write locks 0 pid/thread 27448/1442523456 flags 0 priority 100 81b84f49 READ 1 WAIT objectClass.bdb page 3 81b71512 dd=38 locks held 0 write locks 0 pid/thread 27448/1190742336 flags 0 priority 100 81b71512 READ 1 WAIT objectClass.bdb page 3 81b71515 dd=37 locks held 0 write locks 0 pid/thread 27448/1199135040 flags 0 priority 100 81b71515 READ 1 WAIT objectClass.bdb page 3 81b71518 dd=36 locks held 0 write locks 0 pid/thread 27448/1207527744 flags 0 priority 100 81b71518 READ 1 WAIT objectClass.bdb page 3 81b84f52 dd= 7 locks held 0 write locks 0 pid/thread 27448/1450916160 flags 0 priority 100 81b84f52 READ 1 WAIT objectClass.bdb page 3 81b84f55 dd= 6 locks held 0 write locks 0 pid/thread 27448/1459308864 flags 0 priority 100 81b84f55 READ 1 WAIT objectClass.bdb page 3 81b7151d dd=35 locks held 0 write locks 0 pid/thread 27448/1215920448 flags 0 priority 100 81b7151d READ 1 WAIT objectClass.bdb page 3 81b84f58 dd= 5 locks held 0 write locks 0 pid/thread 27448/1467701568 flags 0 priority 100 81b84f58 READ 1 WAIT objectClass.bdb page 3 81b71520 dd=34 locks held 0 write locks 0 pid/thread 27448/1224313152 flags 0 priority 100 81b71520 READ 1 WAIT objectClass.bdb page 3 81b71521 dd=33 locks held 1 write locks 1 pid/thread 27448/1232705856 flags 0 priority 100 81b71521 WRITE 1 HELD objectClass.bdb page 3 81b84f5b dd= 4 locks held 0 write locks 0 pid/thread 27448/1476094272 flags 0 priority 100 81b84f5b READ 1 WAIT objectClass.bdb page 3 81b3c4d5 dd=56 locks held 0 write locks 0 pid/thread 27448/1148778816 flags 0 priority 100 81b3c4d5 READ 1 WAIT objectClass.bdb page 3 81b71524 dd=32 locks held 0 write locks 0 pid/thread 27448/1241098560 flags 0 priority 100 81b71524 READ 1 WAIT objectClass.bdb page 3 81b84f5e dd= 3 locks held 0 write locks 0 pid/thread 27448/1484486976 flags 0 priority 100 81b84f5e READ 1 WAIT objectClass.bdb page 3 81b84f5f dd= 2 locks held 0 write locks 0 pid/thread 27448/1492879680 flags 0 priority 100 81b84f5f READ 1 WAIT objectClass.bdb page 3 81b71529 dd=31 locks held 0 write locks 0 pid/thread 27448/1249491264 flags 0 priority 100 81b71529 READ 1 WAIT objectClass.bdb page 3 81b7152a dd=30 locks held 0 write locks 0 pid/thread 27448/1257883968 flags 0 priority 100 81b7152a READ 1 WAIT objectClass.bdb page 3 81b7152d dd=29 locks held 0 write locks 0 pid/thread 27448/1266276672 flags 0 priority 100 81b7152d READ 1 WAIT objectClass.bdb page 3 81b71530 dd=28 locks held 0 write locks 0 pid/thread 27448/1274669376 flags 0 priority 100 81b71530 READ 1 WAIT objectClass.bdb page 3 81b71533 dd=27 locks held 0 write locks 0 pid/thread 27448/1283062080 flags 0 priority 100 81b71533 READ 1 WAIT objectClass.bdb page 3 81b71536 dd=26 locks held 0 write locks 0 pid/thread 27448/1291454784 flags 0 priority 100 81b71536 READ 1 WAIT objectClass.bdb page 3 81b3c0e5 dd=66 locks held 0 write locks 0 pid/thread 27448/1115208000 flags 0 priority 100 81b3c0e5 READ 1 WAIT objectClass.bdb page 3 81b71539 dd=25 locks held 0 write locks 0 pid/thread 27448/1299847488 flags 0 priority 100 81b7153c dd=24 locks held 0 write locks 0 pid/thread 27448/1308240192 flags 0 priority 100 81b7153c READ 1 WAIT objectClass.bdb page 3 81b7153f dd=23 locks held 0 write locks 0 pid/thread 27448/1316632896 flags 0 priority 100 81b7153f READ 1 WAIT objectClass.bdb page 3 81b55581 dd=42 locks held 0 write locks 0 pid/thread 27448/1173956928 flags 0 priority 100 81b55581 READ 1 WAIT objectClass.bdb page 3 81b71542 dd=22 locks held 0 write locks 0 pid/thread 27448/1325025600 flags 0 priority 100 81b71542 READ 1 WAIT objectClass.bdb page 3 81b71545 dd=21 locks held 0 write locks 0 pid/thread 27448/1333418304 flags 0 priority 100 81b71545 READ 1 WAIT objectClass.bdb page 3 81b71548 dd=20 locks held 0 write locks 0 pid/thread 27448/1341811008 flags 0 priority 100 81b71548 READ 1 WAIT objectClass.bdb page 3 81b3ca00 dd=55 locks held 0 write locks 0 pid/thread 27448/1157171520 flags 0 priority 100 81b3ca00 READ 1 WAIT objectClass.bdb page 3 81b7154b dd=19 locks held 0 write locks 0 pid/thread 27448/1350203712 flags 0 priority 100 81b7154b READ 1 WAIT objectClass.bdb page 3 81b7154e dd=18 locks held 0 write locks 0 pid/thread 27448/1358596416 flags 0 priority 100 81b7154e READ 1 WAIT objectClass.bdb page 3 81b71551 dd=17 locks held 0 write locks 0 pid/thread 27448/1366989120 flags 0 priority 100 81b71551 READ 1 WAIT objectClass.bdb page 3 81b71554 dd=16 locks held 0 write locks 0 pid/thread 27448/1375381824 flags 0 priority 100 81b71554 READ 1 WAIT objectClass.bdb page 3 81b71559 dd=15 locks held 0 write locks 0 pid/thread 27448/1383774528 flags 0 priority 100 81b71559 READ 1 WAIT objectClass.bdb page 3 81c57cb3 dd= 0 locks held 2 write locks 0 pid/thread 27448/1232705856 flags 0 priority 100 81c57cb3 READ 1 HELD 0x27a480 len: 9 data: 718c00000000000000 81c57cb3 READ 1 HELD 0x283700 len: 9 data: 90bd05000000000000 81b7155a dd=14 locks held 0 write locks 0 pid/thread 27448/1392167232 flags 0 priority 100 81b7155a READ 1 WAIT objectClass.bdb page 3 81c57cb4 dd= 0 locks held 16 write locks 8 pid/thread 27448/1232705856 flags 0 priority 100 81c57cb4 READ 1 WAIT objectClass.bdb page 3 81c57cb4 WRITE 2 HELD objectClass.bdb page 129 81c57cb4 READ 2 HELD objectClass.bdb page 129 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 1453 81c57cb4 READ 2 HELD scRouteOffer.bdb page 1453 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 2462 81c57cb4 READ 2 HELD scRouteOffer.bdb page 2462 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 2242 81c57cb4 READ 2 HELD scRouteOffer.bdb page 2242 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 14 81c57cb4 READ 2 HELD scRouteOffer.bdb page 14 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 12 81c57cb4 READ 2 HELD scRouteOffer.bdb page 12 81c57cb4 WRITE 2 HELD dn2id.bdb page 8834 81c57cb4 WRITE 2 HELD dn2id.bdb page 2281 81c57cb4 READ 1 HELD dn2id.bdb page 2281 81c57cb4 READ 2 HELD dn2id.bdb page 8834 81b7155d dd=13 locks held 0 write locks 0 pid/thread 27448/1400559936 flags 0 priority 100 81b7155d READ 1 WAIT objectClass.bdb page 3 81b71560 dd=12 locks held 0 write locks 0 pid/thread 27448/1408952640 flags 0 priority 100 81b71560 READ 1 WAIT objectClass.bdb page 3 81b71563 dd=11 locks held 0 write locks 0 pid/thread 27448/1417345344 flags 0 priority 100 81b71563 READ 1 WAIT objectClass.bdb page 3 81b557ba dd=41 locks held 0 write locks 0 pid/thread 27448/1182349632 flags 0 priority 100 81b557ba READ 1 WAIT objectClass.bdb page 3 81b3cd43 dd=54 locks held 0 write locks 0 pid/thread 27448/1086777664 flags 0 priority 100 81b3cd43 READ 1 WAIT objectClass.bdb page 3 81b3bf42 dd=73 locks held 0 write locks 0 pid/thread 27448/47802396722192 flags 0 priority 100 81b3bf43 dd=72 locks held 0 write locks 0 pid/thread 27448/47802396722192 flags 0 priority 100 81b3bf44 dd=71 locks held 0 write locks 0 pid/thread 27448/1123600704 flags 0 priority 100 81b3bf44 READ 1 WAIT objectClass.bdb page 3 81c564f7 dd= 1 locks held 2 write locks 0 pid/thread 27448/1299847488 flags 0 priority 100 81c564f7 READ 1 HELD 0x2c5710 len: 9 data: b3c005000000000000 81c564f7 READ 1 HELD 0x28fb78 len: 9 data: 92ce05000000000000 81c564f8 dd= 1 locks held 4 write locks 2 pid/thread 27448/1299847488 flags 0 priority 100 81c564f8 READ 1 WAIT objectClass.bdb page 3 81c564f8 WRITE 2 HELD dn2id.bdb page 7794 81c564f8 READ 1 HELD dn2id.bdb page 7794 81c564f8 WRITE 2 HELD dn2id.bdb page 9612 81c564f8 READ 1 HELD dn2id.bdb page 9612 81b3bf69 dd=68 locks held 0 write locks 0 pid/thread 27448/1131993408 flags 0 priority 100 81b3bf69 READ 1 WAIT objectClass.bdb page 3 e3 dd=76 locks held 1 write locks 0 pid/thread 27448/47802396722192 flags 10 priority 100 e3 READ 1 HELD id2entry.bdb handle 0 e4 dd=75 locks held 1 write locks 0 pid/thread 27448/47802396722192 flags 10 priority 100 e4 READ 1 HELD dn2id.bdb handle 0 e5 dd=74 locks held 0 write locks 0 pid/thread 27448/47802396722192 flags 0 priority 100 e6 dd=70 locks held 1 write locks 0 pid/thread 27448/1123600704 flags 10 priority 100 e6 READ 1 HELD entryUUID.bdb handle 0 e7 dd=69 locks held 1 write locks 0 pid/thread 27448/1123600704 flags 10 priority 100 e7 READ 1 HELD entryCSN.bdb handle 0 e8 dd=65 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 e8 READ 1 HELD scRouteOffer.bdb handle 0 e9 dd=64 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 e9 READ 1 HELD objectClass.bdb handle 0 ea dd=63 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 ea READ 1 HELD scHostAddress.bdb handle 0 eb dd=62 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 eb READ 1 HELD scListenPort.bdb handle 0 ec dd=61 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 ec READ 1 HELD scLRMDN.bdb handle 0 ed dd=60 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 ed READ 1 HELD scPID.bdb handle 0 ee dd=59 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 ee READ 1 HELD scContainerInstanceName.bdb handle 0 ef dd=58 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 ef READ 1 HELD scPatchVersion.bdb handle 0 f0 dd=53 locks held 1 write locks 0 pid/thread 27448/1086777664 flags 10 priority 100 f0 READ 1 HELD scContainerInstanceDN.bdb handle 0 f1 dd=52 locks held 0 write locks 0 pid/thread 27448/1115208000 flags 0 priority 100 f2 dd=51 locks held 0 write locks 0 pid/thread 27448/1157171520 flags 0 priority 100 f3 dd=50 locks held 0 write locks 0 pid/thread 27448/1224313152 flags 0 priority 100 f4 dd=49 locks held 0 write locks 0 pid/thread 27448/1182349632 flags 0 priority 100 f5 dd=48 locks held 0 write locks 0 pid/thread 27448/1131993408 flags 0 priority 100 f6 dd=47 locks held 0 write locks 0 pid/thread 27448/1131993408 flags 0 priority 100 f7 dd=46 locks held 1 write locks 0 pid/thread 27448/1157171520 flags 10 priority 100 f7 READ 1 HELD scManagedResourceName.bdb handle 0 f8 dd=45 locks held 1 write locks 0 pid/thread 27448/1123600704 flags 10 priority 100 f8 READ 1 HELD scServiceDefinitionName.bdb handle 0 f9 dd=44 locks held 1 write locks 0 pid/thread 27448/1148778816 flags 10 priority 100 f9 READ 1 HELD scContainerDefinitionName.bdb handle 0 fa dd=40 locks held 1 write locks 0 pid/thread 27448/1131993408 flags 10 priority 100 fa READ 1 HELD scServiceVersionDefinitionName.bdb handle 0 fb dd=39 locks held 1 write locks 0 pid/thread 27448/1157171520 flags 10 priority 100 fb READ 1 HELD scContainerVersionDefinitionName.bdb handle 0 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Locks grouped by object: Locker Mode Count Status ----------------- Object --------------- ee READ 1 HELD scContainerInstanceName.bdb handle 0

81c564f7 READ 1 HELD 0x28fb78 len: 9 data: 92ce05000000000000

ea READ 1 HELD scHostAddress.bdb handle 0

81c57cb3 READ 1 HELD 0x27a480 len: 9 data: 718c00000000000000

81c564f8 READ 1 HELD dn2id.bdb page 9612 81c564f8 WRITE 2 HELD dn2id.bdb page 9612

e7 READ 1 HELD entryCSN.bdb handle 0

81c57cb4 READ 2 HELD objectClass.bdb page 129 81c57cb4 WRITE 2 HELD objectClass.bdb page 129

f9 READ 1 HELD scContainerDefinitionName.bdb handle 0

ed READ 1 HELD scPID.bdb handle 0

e9 READ 1 HELD objectClass.bdb handle 0

81b71521 WRITE 1 HELD objectClass.bdb page 3 81c564f8 READ 1 WAIT objectClass.bdb page 3 81b3c4d5 READ 1 WAIT objectClass.bdb page 3 81b84f49 READ 1 WAIT objectClass.bdb page 3 81b7154b READ 1 WAIT objectClass.bdb page 3 81b71560 READ 1 WAIT objectClass.bdb page 3 81b7155d READ 1 WAIT objectClass.bdb page 3 81b3c4be READ 1 WAIT objectClass.bdb page 3 81b557ba READ 1 WAIT objectClass.bdb page 3 81b84f46 READ 1 WAIT objectClass.bdb page 3 81b7153f READ 1 WAIT objectClass.bdb page 3 81b71518 READ 1 WAIT objectClass.bdb page 3 81b71536 READ 1 WAIT objectClass.bdb page 3 81b71542 READ 1 WAIT objectClass.bdb page 3 81b71533 READ 1 WAIT objectClass.bdb page 3 81b71548 READ 1 WAIT objectClass.bdb page 3 81b3cd43 READ 1 WAIT objectClass.bdb page 3 81b7152d READ 1 WAIT objectClass.bdb page 3 81b71559 READ 1 WAIT objectClass.bdb page 3 81b84f52 READ 1 WAIT objectClass.bdb page 3 81b3c0e5 READ 1 WAIT objectClass.bdb page 3 81b71545 READ 1 WAIT objectClass.bdb page 3 81b3bf69 READ 1 WAIT objectClass.bdb page 3 81b84f43 READ 1 WAIT objectClass.bdb page 3 81b47648 READ 1 WAIT objectClass.bdb page 3 81b71520 READ 1 WAIT objectClass.bdb page 3 81b3bf98 READ 1 WAIT objectClass.bdb page 3 81b3ca00 READ 1 WAIT objectClass.bdb page 3 81b84f5e READ 1 WAIT objectClass.bdb page 3 81b7154e READ 1 WAIT objectClass.bdb page 3 81b84f5f READ 1 WAIT objectClass.bdb page 3 81b7151d READ 1 WAIT objectClass.bdb page 3 81b71530 READ 1 WAIT objectClass.bdb page 3 81b7152a READ 1 WAIT objectClass.bdb page 3 81b84f55 READ 1 WAIT objectClass.bdb page 3 81b7155a READ 1 WAIT objectClass.bdb page 3 81b71551 READ 1 WAIT objectClass.bdb page 3 81b7153c READ 1 WAIT objectClass.bdb page 3 81b71554 READ 1 WAIT objectClass.bdb page 3 81b55581 READ 1 WAIT objectClass.bdb page 3 81b71563 READ 1 WAIT objectClass.bdb page 3 81b84f58 READ 1 WAIT objectClass.bdb page 3 81b71515 READ 1 WAIT objectClass.bdb page 3 81b3bf44 READ 1 WAIT objectClass.bdb page 3 81b71529 READ 1 WAIT objectClass.bdb page 3 81b84f5b READ 1 WAIT objectClass.bdb page 3 81b71524 READ 1 WAIT objectClass.bdb page 3 81b71512 READ 1 WAIT objectClass.bdb page 3 81c57cb4 READ 1 WAIT objectClass.bdb page 3

e6 READ 1 HELD entryUUID.bdb handle 0

81c57cb4 READ 1 HELD dn2id.bdb page 2281 81c57cb4 WRITE 2 HELD dn2id.bdb page 2281

f7 READ 1 HELD scManagedResourceName.bdb handle 0

81c57cb3 READ 1 HELD 0x283700 len: 9 data: 90bd05000000000000

ec READ 1 HELD scLRMDN.bdb handle 0

fa READ 1 HELD scServiceVersionDefinitionName.bdb handle 0

81c57cb4 READ 2 HELD scRouteOffer.bdb page 2462 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 2462

81c564f8 READ 1 HELD dn2id.bdb page 7794 81c564f8 WRITE 2 HELD dn2id.bdb page 7794

81c57cb4 READ 2 HELD scRouteOffer.bdb page 2242 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 2242

f8 READ 1 HELD scServiceDefinitionName.bdb handle 0

fb READ 1 HELD scContainerVersionDefinitionName.bdb handle 0

81c57cb4 READ 2 HELD dn2id.bdb page 8834 81c57cb4 WRITE 2 HELD dn2id.bdb page 8834

81c57cb4 READ 2 HELD scRouteOffer.bdb page 1453 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 1453

81c564f7 READ 1 HELD 0x2c5710 len: 9 data: b3c005000000000000

e4 READ 1 HELD dn2id.bdb handle 0

e3 READ 1 HELD id2entry.bdb handle 0

ef READ 1 HELD scPatchVersion.bdb handle 0

eb READ 1 HELD scListenPort.bdb handle 0

e8 READ 1 HELD scRouteOffer.bdb handle 0

81c57cb4 READ 2 HELD scRouteOffer.bdb page 12 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 12

81c57cb4 READ 2 HELD scRouteOffer.bdb page 14 81c57cb4 WRITE 2 HELD scRouteOffer.bdb page 14

f0 READ 1 HELD scContainerInstanceDN.bdb handle 0

db_stat -t ==========

23078/6225330 File/offset for last checkpoint LSN Tue Sep 25 00:41:24 2012 Checkpoint timestamp 0x81c57cb4 Last transaction ID allocated 144 Maximum number of active transactions configured 0 Initial number of transactions configured 54 Active transactions 146 Maximum active transactions 29M Number of transactions begun (29719732) 170765 Number of transactions aborted 29M Number of transactions committed (29548913) 0 Snapshot transactions 0 Maximum snapshot transactions 0 Number of transactions restored 3MB 336KB Region size 243743 The number of region locks that required waiting (0%) Active transactions: 81b3bf42: running; xa_status xa idle; pid/thread 27448/47802396722192; begin LSN: file/offset 0/0; priority: 0 81b3bf43: running; xa_status xa idle; pid/thread 27448/47802396722192; begin LSN: file/offset 0/0; priority: 0 81b3bf44: running; xa_status xa idle; pid/thread 27448/1123600704; begin LSN: file/offset 0/0; priority: 0 81b3bf69: running; xa_status xa idle; pid/thread 27448/1131993408; begin LSN: file/offset 0/0; priority: 0 81b3bf98: running; xa_status xa idle; pid/thread 27448/1106815296; begin LSN: file/offset 0/0; priority: 0 81b3c0e5: running; xa_status xa idle; pid/thread 27448/1115208000; begin LSN: file/offset 0/0; priority: 0 81b3c4be: running; xa_status xa idle; pid/thread 27448/1140386112; begin LSN: file/offset 0/0; priority: 0 81b3c4d5: running; xa_status xa idle; pid/thread 27448/1148778816; begin LSN: file/offset 0/0; priority: 0 81b3ca00: running; xa_status xa idle; pid/thread 27448/1157171520; begin LSN: file/offset 0/0; priority: 0 81b3cd43: running; xa_status xa idle; pid/thread 27448/1086777664; begin LSN: file/offset 0/0; priority: 0 81b47648: running; xa_status xa idle; pid/thread 27448/1165564224; begin LSN: file/offset 0/0; priority: 0 81b55581: running; xa_status xa idle; pid/thread 27448/1173956928; begin LSN: file/offset 0/0; priority: 0 81b557ba: running; xa_status xa idle; pid/thread 27448/1182349632; begin LSN: file/offset 0/0; priority: 0 81b71512: running; xa_status xa idle; pid/thread 27448/1190742336; begin LSN: file/offset 0/0; priority: 0 81b71515: running; xa_status xa idle; pid/thread 27448/1199135040; begin LSN: file/offset 0/0; priority: 0 81b71518: running; xa_status xa idle; pid/thread 27448/1207527744; begin LSN: file/offset 0/0; priority: 0 81b7151d: running; xa_status xa idle; pid/thread 27448/1215920448; begin LSN: file/offset 0/0; priority: 0 81b71520: running; xa_status xa idle; pid/thread 27448/1224313152; begin LSN: file/offset 0/0; priority: 0 81b71521: running; xa_status xa idle; pid/thread 27448/1232705856; begin LSN: file/offset 23077/7253030; priority: 0 81b71524: running; xa_status xa idle; pid/thread 27448/1241098560; begin LSN: file/offset 0/0; priority: 0 81b71529: running; xa_status xa idle; pid/thread 27448/1249491264; begin LSN: file/offset 0/0; priority: 0 81b7152a: running; xa_status xa idle; pid/thread 27448/1257883968; begin LSN: file/offset 0/0; priority: 0 81b7152d: running; xa_status xa idle; pid/thread 27448/1266276672; begin LSN: file/offset 0/0; priority: 0 81b71530: running; xa_status xa idle; pid/thread 27448/1274669376; begin LSN: file/offset 0/0; priority: 0 81b71533: running; xa_status xa idle; pid/thread 27448/1283062080; begin LSN: file/offset 0/0; priority: 0 81b71536: running; xa_status xa idle; pid/thread 27448/1291454784; begin LSN: file/offset 0/0; priority: 0 81b71539: running; xa_status xa idle; pid/thread 27448/1299847488; begin LSN: file/offset 0/0; priority: 0 81b7153c: running; xa_status xa idle; pid/thread 27448/1308240192; begin LSN: file/offset 0/0; priority: 0 81b7153f: running; xa_status xa idle; pid/thread 27448/1316632896; begin LSN: file/offset 0/0; priority: 0 81b71542: running; xa_status xa idle; pid/thread 27448/1325025600; begin LSN: file/offset 0/0; priority: 0 81b71545: running; xa_status xa idle; pid/thread 27448/1333418304; begin LSN: file/offset 0/0; priority: 0 81b71548: running; xa_status xa idle; pid/thread 27448/1341811008; begin LSN: file/offset 0/0; priority: 0 81b7154b: running; xa_status xa idle; pid/thread 27448/1350203712; begin LSN: file/offset 0/0; priority: 0 81b7154e: running; xa_status xa idle; pid/thread 27448/1358596416; begin LSN: file/offset 0/0; priority: 0 81b71551: running; xa_status xa idle; pid/thread 27448/1366989120; begin LSN: file/offset 0/0; priority: 0 81b71554: running; xa_status xa idle; pid/thread 27448/1375381824; begin LSN: file/offset 0/0; priority: 0 81b71559: running; xa_status xa idle; pid/thread 27448/1383774528; begin LSN: file/offset 0/0; priority: 0 81b7155a: running; xa_status xa idle; pid/thread 27448/1392167232; begin LSN: file/offset 0/0; priority: 0 81b7155d: running; xa_status xa idle; pid/thread 27448/1400559936; begin LSN: file/offset 0/0; priority: 0 81b71560: running; xa_status xa idle; pid/thread 27448/1408952640; begin LSN: file/offset 0/0; priority: 0 81b71563: running; xa_status xa idle; pid/thread 27448/1417345344; begin LSN: file/offset 0/0; priority: 0 81b84f43: running; xa_status xa idle; pid/thread 27448/1425738048; begin LSN: file/offset 0/0; priority: 0 81b84f46: running; xa_status xa idle; pid/thread 27448/1434130752; begin LSN: file/offset 0/0; priority: 0 81b84f49: running; xa_status xa idle; pid/thread 27448/1442523456; begin LSN: file/offset 0/0; priority: 0 81b84f52: running; xa_status xa idle; pid/thread 27448/1450916160; begin LSN: file/offset 0/0; priority: 0 81b84f55: running; xa_status xa idle; pid/thread 27448/1459308864; begin LSN: file/offset 0/0; priority: 0 81b84f58: running; xa_status xa idle; pid/thread 27448/1467701568; begin LSN: file/offset 0/0; priority: 0 81b84f5b: running; xa_status xa idle; pid/thread 27448/1476094272; begin LSN: file/offset 0/0; priority: 0 81b84f5e: running; xa_status xa idle; pid/thread 27448/1484486976; begin LSN: file/offset 0/0; priority: 0 81b84f5f: running; xa_status xa idle; pid/thread 27448/1492879680; begin LSN: file/offset 0/0; priority: 0 81c564f7: running; xa_status xa idle; pid/thread 27448/1299847488; begin LSN: file/offset 23077/7253106; priority: 0 81c564f8: running; xa_status xa idle; pid/thread 27448/1299847488; begin LSN: file/offset 0/0; parent: 81c564f7; priority: 0 81c57cb3: running; xa_status xa idle; pid/thread 27448/1232705856; begin LSN: file/offset 23078/6289581; priority: 0 81c57cb4: running; xa_status xa idle; pid/thread 27448/1232705856; begin LSN: file/offset 0/0; parent: 81c57cb3; priority: 0

pstack trace: =============

Thread 50 (Thread 0x41789940 (LWP 27463)): #0 0x00000038c7ad4358 in epoll_wait () from /lib64/libc.so.6 #1 0x000000000043a8c4 in ?? () #2 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #3 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 49 (Thread 0x41f8a940 (LWP 27464)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 48 (Thread 0x4278b940 (LWP 27465)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 47 (Thread 0x42f8c940 (LWP 27466)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 46 (Thread 0x4378d940 (LWP 27467)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 45 (Thread 0x43f8e940 (LWP 27512)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 44 (Thread 0x4478f940 (LWP 27513)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 43 (Thread 0x44f90940 (LWP 27599)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 42 (Thread 0x40c6e940 (LWP 27656)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 41 (Thread 0x45791940 (LWP 3074)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 40 (Thread 0x45f92940 (LWP 5033)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 39 (Thread 0x46793940 (LWP 5416)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 38 (Thread 0x46f94940 (LWP 10803)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 37 (Thread 0x47795940 (LWP 10804)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 36 (Thread 0x47f96940 (LWP 10805)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 35 (Thread 0x48797940 (LWP 10806)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 34 (Thread 0x48f98940 (LWP 10807)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 33 (Thread 0x49799940 (LWP 10808)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de015813 in hdb_idl_delete_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a4c6 in hdb_key_change () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de009401 in indexer () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de009882 in index_at_values () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de009a13 in hdb_index_values () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de009e98 in hdb_index_entry () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79ddffcd89 in hdb_delete () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf243 in ?? () #24 0x00000000004c0d78 in ?? () #25 0x00000000004b9c17 in ?? () #26 0x00000000004ba51e in ?? () #27 0x00000000004f4739 in ?? () #28 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #29 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 32 (Thread 0x49f9a940 (LWP 10814)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x4a79b940 (LWP 10818)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6

Thread 30 (Thread 0x4af9c940 (LWP 10821)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x4b79d940 (LWP 10822)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x4bf9e940 (LWP 10824)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x4c79f940 (LWP 10825)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x4cfa0940 (LWP 10826)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x4d7a1940 (LWP 10827)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de015813 in hdb_idl_delete_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a4c6 in hdb_key_change () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de009401 in indexer () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de009882 in index_at_values () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de009a13 in hdb_index_values () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de009e98 in hdb_index_entry () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79ddffcd89 in hdb_delete () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf243 in ?? () #24 0x000000000046139d in fe_op_delete () #25 0x0000000000461046 in do_delete () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 ... ...

Thread 2 (Thread 0x58fb8940 (LWP 26982)): #0 0x00000038c820aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002b79dc19aab9 in __db_pthread_mutex_condwait () from /opt/app/aft/scldldap/lib/libdb-5.3.so #2 0x00002b79dc19a810 in __db_hybrid_mutex_suspend () from /opt/app/aft/scldldap/lib/libdb-5.3.so #3 0x00002b79dc199ee1 in __db_tas_mutex_lock_int () from /opt/app/aft/scldldap/lib/libdb-5.3.so #4 0x00002b79dc199b36 in __db_tas_mutex_lock () from /opt/app/aft/scldldap/lib/libdb-5.3.so #5 0x00002b79dc2909f2 in __lock_get_internal () from /opt/app/aft/scldldap/lib/libdb-5.3.so #6 0x00002b79dc28e167 in __lock_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #7 0x00002b79dc2d3345 in __db_lget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #8 0x00002b79dc1c6727 in __bam_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #9 0x00002b79dc1ac1b0 in __bamc_search () from /opt/app/aft/scldldap/lib/libdb-5.3.so #10 0x00002b79dc1a6de1 in __bamc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #11 0x00002b79dc2b57dd in __dbc_iget () from /opt/app/aft/scldldap/lib/libdb-5.3.so #12 0x00002b79dc2b51dd in __dbc_get () from /opt/app/aft/scldldap/lib/libdb-5.3.so #13 0x00002b79dc2cd579 in __dbc_get_pp () from /opt/app/aft/scldldap/lib/libdb-5.3.so #14 0x00002b79de0141f6 in hdb_idl_fetch_key () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #15 0x00002b79de00a1bd in hdb_key_read () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #16 0x00002b79de00ca5d in equality_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #17 0x00002b79de00b14c in hdb_filter_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #18 0x00002b79de0039a9 in search_aliases () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #19 0x00002b79de006eed in search_candidates () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #20 0x00002b79de005093 in hdb_search () from /opt/app/aft/scldldap/libexec/back_hdb-2.4.so.2 #21 0x00000000004ceebe in overlay_op_walk () #22 0x00000000004cf0c1 in ?? () #23 0x00000000004cf18f in ?? () #24 0x0000000000442670 in fe_op_search () #25 0x0000000000441f4f in do_search () #26 0x000000000043e98c in ?? () #27 0x000000000043ef11 in ?? () #28 0x00000000004f4739 in ?? () #29 0x00000038c820673d in start_thread () from /lib64/libpthread.so.0 #30 0x00000038c7ad3f6d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x2b79dce04410 (LWP 27448)): #0 0x00000038c8207b35 in pthread_join () from /lib64/libpthread.so.0 #1 0x00000000004f5c0b in ldap_pvt_thread_join () #2 0x000000000043ba60 in slapd_daemon () #3 0x0000000000419bd3 in main ()

Thanks,

Venkatesh