Can you be more specific? In general, overlays that cannot be configured on the frontend database should complain somehow, but some checks might be missing. Feel free to file an ITS for specific bugs.
I isolated the problem to memberof overlay, reported as: http://www.openldap.org/its/index.cgi?findid=7249
Jan