i’ll look into that, though i’m most interested if there’s any way to avoid rebuilding indexes with the architecture switch, by making the configuration match the amd64 defaults

Sent from Outlook for iOS

From: Quanah Gibson-Mount <quanah@fast-mail.org>
Sent: Friday, July 21, 2023 3:38:13 PM
To: Maud Parratt <Maud.Parratt@bjss.com>; openldap-technical@openldap.org <openldap-technical@openldap.org>
Subject: Re: slapindex a 60GB mdb in reasonable time
 


--On Friday, July 21, 2023 3:32 PM +0000 Maud Parratt
<Maud.Parratt@bjss.com> wrote:

>
>
>
> why? to be clear I'm experimenting on a smaller ephemeral test instance
> with non prod data, so there's no risk to trying things.

The man page spells it out pretty clearly:

     index_hash64 { on | off }
              Use a 64 bit hash for indexing. The default is  to  use  32
bit
              hashes.   These  hashes  are  used  for  equality  and
substring
              indexing. The 64 bit  version  may  be  needed  to  avoid
index
              collisions  when  the  number  of  indexed  values  exceeds
~64
              million. (Note that substring indexing generates multiple
index
              values  per  actual attribute value.)  Indices generated with
32
              bit hashes are incompatible with the 64 bit  version,  and
vice
              versa.  Any  existing  databases  must  be  fully  reloaded
when
              changing this setting. This directive is only  supported  on
64
              bit CPUs.

I'm assuming that you have substring indices, and given the large size of
your database you may start having hash collissions.

You most likely also want to configure olcBkMdbIdlExp, sortvals, and
multival if you haven't.

--Quanah

The information included in this email and any files transmitted with it may contain information that is confidential and it must not be used by, or its contents or attachments copied or disclosed to, persons other than the intended addressee. If you have received this email in error, please notify BJSS. In the absence of written agreement to the contrary BJSS' relevant standard terms of contract for any work to be undertaken will apply. Please carry out virus or such other checks as you consider appropriate in respect of this email. BJSS does not accept responsibility for any adverse effect upon your system or data in relation to this email or any files transmitted with it. BJSS Limited, a company registered in England and Wales (Company Number 2777575), VAT Registration Number 613295452, Registered Office Address, 1 Whitehall Quay, Leeds, LS1 4HR