Re: (ITS#8115) Adding passwd hash schemes
by michael＠stroeder.com
This is a cryptographically signed message in MIME format.
--------------ms080402030704010800040907
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: quoted-printable
bruno_haleblian(a)carrefour.com wrote:
> My goal is to import millions of accounts from a drupal DB to OpenLDAP.=
> preserving existing passwords. I plan to write a SQL to ldif script for=
that.
> Problem :
> These accounts come with a non-standard passwd hash scheme. I've attach=
ed drupal
> link to source code in PHP.
> Although it uses standard SHA512 and base64, the algo is a variant of m=
ultiple
> sha512 + salt iterations. Looks like there's no way to convert to {SSHA=
512} or
> something standard.
> Supposing I can translate it to C, what is the best and cleanest way to=
> integrate this specific scheme?
> Is there an "overlay way" to do this?
> Do I Have to hack into passwd.c in lutils?
> Has this kind of work already been done?
>
> Goal : getting userPassword=3D{DRUP7}$S$DNbBTrkalsPChLsqajHUQS18pBBxzST=
QW0310SzivTy7HDQ.zgyG
> to be supported
1. The password hash looks a bit like a crypt(3) hashing scheme. You shou=
ld=20
consult the crypt(3) man page on this system. There are {crypt} schemes w=
hich=20
uses several rounds.
2. You will find several such password modules in the source distribution=
in=20
directory contrib/slapd-modules/passwd/
Ciao, Michael.
--------------ms080402030704010800040907
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature
MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC
DIEwggY0MIIEHKADAgECAgEeMA0GCSqGSIb3DQEBBQUAMH0xCzAJBgNVBAYTAklMMRYwFAYD
VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0
ZSBTaWduaW5nMSkwJwYDVQQDEyBTdGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTAe
Fw0wNzEwMjQyMTAxNTVaFw0xNzEwMjQyMTAxNTVaMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UE
ChMNU3RhcnRDb20gTHRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUg
U2lnbmluZzE4MDYGA1UEAxMvU3RhcnRDb20gQ2xhc3MgMSBQcmltYXJ5IEludGVybWVkaWF0
ZSBDbGllbnQgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDHCYPMzi3YGrEp
pC4Tq5a+ijKDjKaIQZZVR63UbxIP6uq/I0fhCu+cQhoUfE6ERKKnu8zPf1Jwuk0tsvVCk6U9
b+0UjM0dLep3ZdE1gblK/1FwYT5Pipsu2yOMluLqwvsuz9/9f1+1PKHG/FaR/wpbfuIqu54q
zHDYeqiUfsYzoVflR80DAC7hmJ+SmZnNTWyUGHJbBpA8Q89lGxahNvuryGaC/o2/ceD2uYDX
9U8Eg5DpIpGQdcbQeGarV04WgAUjjXX5r/2dabmtxWMZwhZna//jdiSyrrSMTGKkDiXm6/3/
4ebfeZuCYKzN2P8O2F/Xe2AC/Y7zeEsnR7FOp+uXAgMBAAGjggGtMIIBqTAPBgNVHRMBAf8E
BTADAQH/MA4GA1UdDwEB/wQEAwIBBjAdBgNVHQ4EFgQUU3Ltkpzg2ssBXHx+ljVO8tS4UYIw
HwYDVR0jBBgwFoAUTgvvGqRAW6UXaYcwyjRoQ9BBrvIwZgYIKwYBBQUHAQEEWjBYMCcGCCsG
AQUFBzABhhtodHRwOi8vb2NzcC5zdGFydHNzbC5jb20vY2EwLQYIKwYBBQUHMAKGIWh0dHA6
Ly93d3cuc3RhcnRzc2wuY29tL3Nmc2NhLmNydDBbBgNVHR8EVDBSMCegJaAjhiFodHRwOi8v
d3d3LnN0YXJ0c3NsLmNvbS9zZnNjYS5jcmwwJ6AloCOGIWh0dHA6Ly9jcmwuc3RhcnRzc2wu
Y29tL3Nmc2NhLmNybDCBgAYDVR0gBHkwdzB1BgsrBgEEAYG1NwECATBmMC4GCCsGAQUFBwIB
FiJodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9wb2xpY3kucGRmMDQGCCsGAQUFBwIBFihodHRw
Oi8vd3d3LnN0YXJ0c3NsLmNvbS9pbnRlcm1lZGlhdGUucGRmMA0GCSqGSIb3DQEBBQUAA4IC
AQAKgwh9eKssBly4Y4xerhy5I3dNoXHYfYa8PlVLL/qtXnkFgdtY1o95CfegFJTwqBBmf8py
TUnFsukDFUI22zF5bVHzuJ+GxhnSqN2sD1qetbYwBYK2iyYA5Pg7Er1A+hKMIzEzcduRkIMm
CeUTyMyikfbUFvIBivtvkR8ZFAk22BZy+pJfAoedO61HTz4qSfQoCRcLN5A0t4DkuVhTMXIz
uQ8CnykhExD6x4e6ebIbrjZLb7L+ocR0y4YjCl/Pd4MXU91y0vTipgr/O75CDUHDRHCCKBVm
z/Rzkc/b970MEeHt5LC3NiWTgBSvrLEuVzBKM586YoRD9Dy3OHQgWI270g+5MYA8GfgI/EPT
5G7xPbCDz+zjdH89PeR3U4So4lSXur6H6vp+m9TQXPF3a0LwZrp8MQ+Z77U1uL7TelWO5lAp
sbAonrqASfTpaprFVkL4nyGH+NHST2ZJPWIBk81i6Vw0ny0qZW2Niy/QvVNKbb43A43ny076
khXO7cNbBIRdJ/6qQNq9Bqb5C0Q5nEsFcj75oxQRqlKf6TcvGbjxkJh8BYtv9ePsXklAxtm8
J7GCUBthHSQgepbkOexhJ0wP8imUkyiPHQ0GvEnd83129fZjoEhdGwXV27ioRKbj/cIq7JRX
un0NbeY+UdMYu9jGfIpDLtUUGSgsg2zMGs5R4jCCBkUwggUtoAMCAQICAwtNUDANBgkqhkiG
9w0BAQUFADCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNV
BAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25pbmcxODA2BgNVBAMTL1N0YXJ0
Q29tIENsYXNzIDEgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xpZW50IENBMB4XDTE0MDkyMzIw
NDc1NVoXDTE1MDkyNDIyMDUxOFowXzEZMBcGA1UEDRMQNk0yWTdpOXpEdGU2alV3MDEdMBsG
A1UEAwwUbWljaGFlbEBzdHJvZWRlci5jb20xIzAhBgkqhkiG9w0BCQEWFG1pY2hhZWxAc3Ry
b2VkZXIuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAynIH09fU597v4fg4
uwqFJDPUxQHV9qxrfM/c3veStPyYl0JorqKHrD+hfCNZ+Toy65NN9f9vO26WnnLoDF+FE2Dk
Qi61iTgK5jZTr5dJG1WQkk698UNWO87lUWBRYYiUM7wC3ek2E0rzR99qIxE4dG9wws19F3KK
JvNN8tMTyoPw5Vkw4qx2SW54WEBMx7oCXBIZPPDD8ovled6vDVweVSaYXFUbkxbKJR87Msih
34Ba+cM5SAHQNQ11jaSJjFeqbQnXjf0nESnvo0XIckc9w240w3jcgu6b5SIQBI2vv5TaIv7v
KqNk0o+cGc9NnCw5/xD/OAB9Aj/qDca6NheHCQIDAQABo4IC2jCCAtYwCQYDVR0TBAIwADAL
BgNVHQ8EBAMCBLAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMB0GA1UdDgQWBBTj
z1BhELZO3zEJfmZQ4I+c6NCXIjAfBgNVHSMEGDAWgBRTcu2SnODaywFcfH6WNU7y1LhRgjAf
BgNVHREEGDAWgRRtaWNoYWVsQHN0cm9lZGVyLmNvbTCCAUwGA1UdIASCAUMwggE/MIIBOwYL
KwYBBAGBtTcBAgMwggEqMC4GCCsGAQUFBwIBFiJodHRwOi8vd3d3LnN0YXJ0c3NsLmNvbS9w
b2xpY3kucGRmMIH3BggrBgEFBQcCAjCB6jAnFiBTdGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1
dGhvcml0eTADAgEBGoG+VGhpcyBjZXJ0aWZpY2F0ZSB3YXMgaXNzdWVkIGFjY29yZGluZyB0
byB0aGUgQ2xhc3MgMSBWYWxpZGF0aW9uIHJlcXVpcmVtZW50cyBvZiB0aGUgU3RhcnRDb20g
Q0EgcG9saWN5LCByZWxpYW5jZSBvbmx5IGZvciB0aGUgaW50ZW5kZWQgcHVycG9zZSBpbiBj
b21wbGlhbmNlIG9mIHRoZSByZWx5aW5nIHBhcnR5IG9ibGlnYXRpb25zLjA2BgNVHR8ELzAt
MCugKaAnhiVodHRwOi8vY3JsLnN0YXJ0c3NsLmNvbS9jcnR1MS1jcmwuY3JsMIGOBggrBgEF
BQcBAQSBgTB/MDkGCCsGAQUFBzABhi1odHRwOi8vb2NzcC5zdGFydHNzbC5jb20vc3ViL2Ns
YXNzMS9jbGllbnQvY2EwQgYIKwYBBQUHMAKGNmh0dHA6Ly9haWEuc3RhcnRzc2wuY29tL2Nl
cnRzL3N1Yi5jbGFzczEuY2xpZW50LmNhLmNydDAjBgNVHRIEHDAahhhodHRwOi8vd3d3LnN0
YXJ0c3NsLmNvbS8wDQYJKoZIhvcNAQEFBQADggEBAAfByd9CEZ5pYuRa3XuE5xeJoIpDol22
A1mIGuRqxaBFIummmDoYr/tVgFod/3evQJO+ad8T5wpooY422HkHN4a1UI7ujCKcU/PrQSxm
v28AAsl4Fo/InY1nSFjMy8Ywj3EG+Edj1ZpCkzTRNGZjBa6Uj7UY7UW71kYcSdCBe8vc9Zi3
6OnHGkXROWIii3wBKLDEZqxknw0Cj9TTy5lyllYzyHku4aXLDPhiYrTzhWiwgYmweaLvW/yq
YVsHRpW8udzqOr6xvUVcuRmfMTENM7RSlRZVw2+5+I+zn7jqOrrULO1FP7Lo5cPilsMpSMOw
oJnPLQgNZvXOPFO6VaDCOboxggPtMIID6QIBATCBlDCBjDELMAkGA1UEBhMCSUwxFjAUBgNV
BAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRl
IFNpZ25pbmcxODA2BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDEgUHJpbWFyeSBJbnRlcm1lZGlh
dGUgQ2xpZW50IENBAgMLTVAwDQYJYIZIAWUDBAIBBQCgggIpMBgGCSqGSIb3DQEJAzELBgkq
hkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE1MDQyODE0NDIxMVowLwYJKoZIhvcNAQkEMSIE
IL8TDseT/devnjkz2gAIs7YDwtLRWVTSaQWUUBMLiUYNMGwGCSqGSIb3DQEJDzFfMF0wCwYJ
YIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYI
KoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwgaUGCSsGAQQBgjcQBDGBlzCB
lDCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNl
Y3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25pbmcxODA2BgNVBAMTL1N0YXJ0Q29tIENs
YXNzIDEgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xpZW50IENBAgMLTVAwgacGCyqGSIb3DQEJ
EAILMYGXoIGUMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UEChMNU3RhcnRDb20gTHRkLjErMCkG
A1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUgU2lnbmluZzE4MDYGA1UEAxMvU3Rh
cnRDb20gQ2xhc3MgMSBQcmltYXJ5IEludGVybWVkaWF0ZSBDbGllbnQgQ0ECAwtNUDANBgkq
hkiG9w0BAQEFAASCAQB3ev7x7TOAo5Uo1WsZdCw/m7Ixd1+pXVVYwOXZ0KBQ/p2xyEqyA/A2
ag92TnXYA3F7BYe07X+nlEtF0ZNDC7HIv33Y36sHR2TxRAHTk+cM9wKdEuYOPMMvpDyoolys
wgt4JrdY6O9TB+oJ0DUNG7QEHIOTYMe4jxs9u+XvaNBwXxGGDVc2VnvMaU219cm3X0QF3UaZ
fSHrcTcyi19KHTIbfBWftKZAL9tHp0UBppkxfCVE8FMfpaa9zgRS9UStw+Ih0p8nhL344ODt
/IpXbjY5rBPpDRKRJ4ND3XQysdjrGiH21IXKKeQmMybzjL9CNGbVqAYL7T2A/cLKhnYLiw0f
AAAAAAAA
--------------ms080402030704010800040907--
6 years, 7 months
(ITS#8115) Adding passwd hash schemes
by bruno_haleblian＠carrefour.com
Full_Name: Bruno HALEBLIAN
Version: 2.4.40 >
OS: RH/CentOS 6.x
URL: https://api.drupal.org/api/drupal/includes!password.inc/function/_passwor...
Submission from: (NULL) (195.154.81.10)
Hi,
My goal is to import millions of accounts from a drupal DB to OpenLDAP.
preserving existing passwords. I plan to write a SQL to ldif script for that.
Problem :
These accounts come with a non-standard passwd hash scheme. I've attached drupal
link to source code in PHP.
Although it uses standard SHA512 and base64, the algo is a variant of multiple
sha512 + salt iterations. Looks like there's no way to convert to {SSHA512} or
something standard.
Supposing I can translate it to C, what is the best and cleanest way to
integrate this specific scheme?
Is there an "overlay way" to do this?
Do I Have to hack into passwd.c in lutils?
Has this kind of work already been done?
Goal : getting userPassword={DRUP7}$S$DNbBTrkalsPChLsqajHUQS18pBBxzSTQW0310SzivTy7HDQ.zgyG
to be supported
Regards,
BHa.
6 years, 7 months
Re: (ITS#8105) [PATCH] slaptest doesn't convert perlModuleConfig lines
by jsynacek＠redhat.com
--=-=-=
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable
Howard Chu <hyc(a)symas.com> writes:
> Jan Synacek wrote:
>> Howard Chu <hyc(a)symas.com> writes:
>>
>>> Jan Synacek wrote:
>>>> Howard Chu <hyc(a)symas.com> writes:
>>>>
>>>>> jsynacek(a)redhat.com wrote:
>>>>>> Full_Name: Jan Synacek
>>>>>> Version: master
>>>>>> OS: GNU/Linux
>>>>>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150415-ba=
ck-perl-correctly-convert-perlModuleConfig.patch
>>>>>> Submission from: (NULL) (213.175.37.10)
>>>>>>
>>>>>>
>>>>>> When using the perl backend, slaptest doesn't convert perlModuleConf=
ig lines
>>>>>> from slapd.conf to slapd.d.
>>>>>>
>>>>>> A simple reproducer can be found at
>>>>>> https://jsynacek.fedorapeople.org/openldap/back-perl.sh
>>>>>>
>>>>>>
>>>>> Thanks, added to git master
>>>>
>>>> I misunderstood the semantics of perlModuleConfig when given multiple
>>>> arguments, so the patch isn't quite correct. I'm sorry for the
>>>> confusion. The fix can be found at:
>>>>
>>>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150424-More=
-for-ITS-8105.patch
>>>>
>>>> Please note that I'm not aware of any internal functions that I can use
>>>> to flatten a list of strings. If there are some, or if there is a bett=
er
>>>> way to fix the issue, please advice, I'll simplify the patch.
>>>>
>>> Hi Jan, there's no need to muck with the list of strings, just use
>>> c->line instead of c->argv.
>>
>> Thank you for your advice! I've simplified the patch (url stays the same=
).
>
> Looks OK. One minor nit - we discourage using strlen() (or most of the=20
> libc str* functions, really). We particularly discourage runtime=20
> calculations on compile-time constants (including string constants) -=20
> use the STRLENOF() macro instead.
Done.
=2D-=20
Jan Synacek
Software Engineer, Red Hat
--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
iQIcBAEBAgAGBQJVPgvMAAoJEL3BmMJQOtjBC/cQAK3bicCb/k7Y47Jwt8hgIp7A
2+jHmMtIwVdA7sK7f26dPlwATUxtYXdXwewTJF8+t+wUg99cNEmgF0c/7clpEVJn
7lwOTdM5aJj5WDarXLYBpOnVoXNCP9aHTigAAe6wuRCHxeIclbqf5yd8wxEELDkl
piM6KkdWKqKlBY/hybD6+JI+hbXSFsHJfIdSudq+uVZwyDLjdjy3SPjoNiSZxSUi
S+h7CAt+d384KXX8aEGq9hUe5K2vvr3Yr83Gelm6w6xN4/aDFQZ75SHumsMPXrAe
j5mGNDb1Y8mMcrzJ0Qc/6JT8JCbhHJEaHKLUxLeYOH1NFylqNFUA2kgYI5jsjVUE
eMSXbb+pyKeWMbqUERNH6/tNS2t9rk/awJCj4o+xsRoK8DluUnP7tkSpTaDe4UqO
itgxNhKCV9NPm5Ar3MbBJOVK+dBIgOM9VM+t5ju+MdpiDTuytnUgIvvaixWfP7Bg
t8Q4t9U8u3gHoWyBdBnLVmwx7qq/BtPxqAt5uDv8mv9MyM9eeoDb4eaRhOe7sl2y
5s3bpBvOADks4dX5RpQ/SGUU5s/Fh/b2rAUrXqVxEkw5PipbTOBhx2LwKNVPnGhm
SoLjQzm7fDEODFS7/jAWbzYsxQ6m8engNUpSi1rMt1PJbLzVrW2vaU6+1UG5eiaS
IhBsZnx4E+WCfGoaUzxt
=23Ho
-----END PGP SIGNATURE-----
--=-=-=--
6 years, 7 months
Re: (ITS#8105) [PATCH] slaptest doesn't convert perlModuleConfig lines
by hyc＠symas.com
Jan Synacek wrote:
> Howard Chu <hyc(a)symas.com> writes:
>
>> Jan Synacek wrote:
>>> Howard Chu <hyc(a)symas.com> writes:
>>>
>>>> jsynacek(a)redhat.com wrote:
>>>>> Full_Name: Jan Synacek
>>>>> Version: master
>>>>> OS: GNU/Linux
>>>>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150415-back-perl-co...
>>>>> Submission from: (NULL) (213.175.37.10)
>>>>>
>>>>>
>>>>> When using the perl backend, slaptest doesn't convert perlModuleConfig lines
>>>>> from slapd.conf to slapd.d.
>>>>>
>>>>> A simple reproducer can be found at
>>>>> https://jsynacek.fedorapeople.org/openldap/back-perl.sh
>>>>>
>>>>>
>>>> Thanks, added to git master
>>>
>>> I misunderstood the semantics of perlModuleConfig when given multiple
>>> arguments, so the patch isn't quite correct. I'm sorry for the
>>> confusion. The fix can be found at:
>>>
>>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150424-More-for-ITS...
>>>
>>> Please note that I'm not aware of any internal functions that I can use
>>> to flatten a list of strings. If there are some, or if there is a better
>>> way to fix the issue, please advice, I'll simplify the patch.
>>>
>> Hi Jan, there's no need to muck with the list of strings, just use
>> c->line instead of c->argv.
>
> Thank you for your advice! I've simplified the patch (url stays the same).
Looks OK. One minor nit - we discourage using strlen() (or most of the
libc str* functions, really). We particularly discourage runtime
calculations on compile-time constants (including string constants) -
use the STRLENOF() macro instead.
--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/
6 years, 7 months
Re: (ITS#8105) [PATCH] slaptest doesn't convert perlModuleConfig lines
by jsynacek＠redhat.com
Howard Chu <hyc(a)symas.com> writes:
> Jan Synacek wrote:
>> Howard Chu <hyc(a)symas.com> writes:
>>
>>> jsynacek(a)redhat.com wrote:
>>>> Full_Name: Jan Synacek
>>>> Version: master
>>>> OS: GNU/Linux
>>>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150415-back-perl-co...
>>>> Submission from: (NULL) (213.175.37.10)
>>>>
>>>>
>>>> When using the perl backend, slaptest doesn't convert perlModuleConfig lines
>>>> from slapd.conf to slapd.d.
>>>>
>>>> A simple reproducer can be found at
>>>> https://jsynacek.fedorapeople.org/openldap/back-perl.sh
>>>>
>>>>
>>> Thanks, added to git master
>>
>> I misunderstood the semantics of perlModuleConfig when given multiple
>> arguments, so the patch isn't quite correct. I'm sorry for the
>> confusion. The fix can be found at:
>>
>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150424-More-for-ITS...
>>
>> Please note that I'm not aware of any internal functions that I can use
>> to flatten a list of strings. If there are some, or if there is a better
>> way to fix the issue, please advice, I'll simplify the patch.
>>
> Hi Jan, there's no need to muck with the list of strings, just use
> c->line instead of c->argv.
Thank you for your advice! I've simplified the patch (url stays the same).
Cheers,
--
Jan Synacek
Software Engineer, Red Hat
6 years, 7 months
(ITS#8114) [WIP] WiredTiger Backend for OpenLDAP
by hamano＠osstech.co.jp
Full_Name: HAMANO Tsukasa
Version: master
OS: Linux
URL: https://www.osstech.co.jp/download/hamano/openldap/0001-OpenLDAP-WiredTig...
Submission from: (NULL) (183.77.250.155)
The attached patch file is derived from OpenLDAP Software. All of the
modifications to OpenLDAP Software represented in the following
patch(es) were developed by HAMANO Tsukasa <hamano(a)osstech.co.jp>. I
have not assigned rights and/or interest in this work to any party.
Copyright 2015 HAMANO Tsukasa <hamano(a)osstech.co.jp>
Redistribution and use in source and binary forms, with or without
modification, are permitted only as authorized by the OpenLDAP Public
License.
6 years, 7 months
Re: (ITS#8089) LMDB hangs on mdb_txn_renew0 if MDB_NOSYNC flag is used
by hyc＠symas.com
Pavel Kraynyukhov wrote:
> Hello Howard,
> Please accept my apologies, the issue was not related to LMDB. There
> have been a data race in my code that was only triggered by fast writes.
> Sorry for late answer, - your e-mail landed into the spam-folder, and I
> just found it.
>
> With best regards,
> Pavel.
OK, thanks for the reply, closing this ITS.
--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/
6 years, 7 months
Re: (ITS#8089) LMDB hangs on mdb_txn_renew0 if MDB_NOSYNC flag is used
by pk＠dbic.pro
--90e6ba3fd5fbb4dffe05148bbe0e
Content-Type: text/plain; charset=UTF-8
Hello Howard,
Please accept my apologies, the issue was not related to LMDB. There have
been a data race in my code that was only triggered by fast writes.
Sorry for late answer, - your e-mail landed into the spam-folder, and I
just found it.
With best regards,
Pavel.
2015-04-16 8:04 GMT+06:00 Howard Chu <hyc(a)symas.com>:
> pk(a)dbic.pro wrote:
>
>> Full_Name: Pavel Kraynyukhov
>> Version: only LMDB from git and lmdb-0.9.14
>> OS: Gentoo Linux
>> URL: ftp://ftp.openldap.org/incoming/
>> Submission from: (NULL) (37.99.47.171)
>>
>>
>> Hello there, I have ran into an issue with LMDB, which I can reproduce at
>> will,
>> but it seems a specific one. The git commit is
>> 3368d1f5e243225cba4d730fba19ff600798ebe3
>> And this commit and my issue seems to be related.
>>
>> 1. I use MDB_NOTLS flag on environment open.
>> 2. if I use MDB_NOSYNC flag for LMDB environment, the writer thread is
>> stuck
>> after several transactions (writer thread backtrace):
>>
>
> P.S. tested against system provided lmdb version 0.9.14 and result is the
>> same.
>> So this maybe not related to latest commit in git.
>>
>
> If you're having this problem in 0.9.14 then it is certainly not related
> to 3368d1f5e243225cba4d730fba19ff600798ebe3.
>
> You confirm that the issue does not occur in 0.9.13? Can you upload a test
> case demonstrating the problem?
>
> --
> -- Howard Chu
> CTO, Symas Corp. http://www.symas.com
> Director, Highland Sun http://highlandsun.com/hyc/
> Chief Architect, OpenLDAP http://www.openldap.org/project/
>
--90e6ba3fd5fbb4dffe05148bbe0e
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div><div><div><div>Hello Howard,<br></div>Please accept m=
y apologies, the issue was not related to LMDB. There have been a data race=
in my code that was only triggered by fast writes.<br></div>Sorry for late=
answer, - your e-mail landed into the spam-folder, and I just found it.<br=
><br></div>With best regards,<br></div>Pavel.<br><div><div><div><div><div c=
lass=3D"gmail_extra"><br><div class=3D"gmail_quote">2015-04-16 8:04 GMT+06:=
00 Howard Chu <span dir=3D"ltr"><<a href=3D"mailto:hyc@symas.com" target=
=3D"_blank">hyc(a)symas.com</a>></span>:<br><blockquote class=3D"gmail_quo=
te" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"=
><a href=3D"mailto:pk@dbic.pro" target=3D"_blank">pk(a)dbic.pro</a> wrote:<br=
>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
Full_Name: Pavel Kraynyukhov<br>
Version: only LMDB from git and lmdb-0.9.14<br>
OS: Gentoo Linux<br>
URL: <a href=3D"ftp://ftp.openldap.org/incoming/" target=3D"_blank">ftp://f=
tp.openldap.org/incoming/</a><br>
Submission from: (NULL) (37.99.47.171)<br>
<br>
<br>
Hello there, I have ran into an issue with LMDB, which I can reproduce at w=
ill,<br>
but it seems a specific one. The git commit is<br>
3368d1f5e243225cba4d730fba19ff600798ebe3<br>
And this commit and my issue seems to be related.<br>
<br>
1. I use MDB_NOTLS flag on environment open.<br>
2. if=C2=A0 I use MDB_NOSYNC flag for LMDB environment, the writer thread i=
s stuck<br>
after several transactions (writer thread backtrace):<br>
</blockquote>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
P.S. tested against system provided lmdb version 0.9.14 and result is the s=
ame.<br>
So this maybe not related to latest commit in git.<br>
</blockquote>
<br>
If you're having this problem in 0.9.14 then it is certainly not relate=
d to 3368d1f5e243225cba4d730fba19ff600798ebe3.<br>
<br>
You confirm that the issue does not occur in 0.9.13? Can you upload a test =
case demonstrating the problem?<span class=3D"HOEnZb"><font color=3D"#88888=
8"><br>
<br>
-- <br>
=C2=A0 -- Howard Chu<br>
=C2=A0 CTO, Symas Corp.=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0<a href=3D"=
http://www.symas.com" target=3D"_blank">http://www.symas.com</a><br>
=C2=A0 Director, Highland Sun=C2=A0 =C2=A0 =C2=A0<a href=3D"http://highland=
sun.com/hyc/" target=3D"_blank">http://highlandsun.com/hyc/</a><br>
=C2=A0 Chief Architect, OpenLDAP=C2=A0 <a href=3D"http://www.openldap.org/p=
roject/" target=3D"_blank">http://www.openldap.org/project/</a><br>
</font></span></blockquote></div><br><br></div></div></div></div></div></di=
v>
--90e6ba3fd5fbb4dffe05148bbe0e--
6 years, 7 months
Re: (ITS#8105) [PATCH] slaptest doesn't convert perlModuleConfig lines
by hyc＠symas.com
Jan Synacek wrote:
> Howard Chu <hyc(a)symas.com> writes:
>
>> jsynacek(a)redhat.com wrote:
>>> Full_Name: Jan Synacek
>>> Version: master
>>> OS: GNU/Linux
>>> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150415-back-perl-co...
>>> Submission from: (NULL) (213.175.37.10)
>>>
>>>
>>> When using the perl backend, slaptest doesn't convert perlModuleConfig lines
>>> from slapd.conf to slapd.d.
>>>
>>> A simple reproducer can be found at
>>> https://jsynacek.fedorapeople.org/openldap/back-perl.sh
>>>
>>>
>> Thanks, added to git master
>
> I misunderstood the semantics of perlModuleConfig when given multiple
> arguments, so the patch isn't quite correct. I'm sorry for the
> confusion. The fix can be found at:
>
> URL: https://jsynacek.fedorapeople.org/openldap/jsynacek-20150424-More-for-ITS...
>
> Please note that I'm not aware of any internal functions that I can use
> to flatten a list of strings. If there are some, or if there is a better
> way to fix the issue, please advice, I'll simplify the patch.
>
Hi Jan, there's no need to muck with the list of strings, just use
c->line instead of c->argv.
--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/
6 years, 7 months
