syncrepl rid=3 provider=ldap://10.1.1.69:636 type=refreshOnly interval=00:00:01:00 searchbase="o=test" filter="(objectClass=*)" scope=sub schemachecking=off bindmethod=simple binddn="cn=root DN, o=test" credentials=xxxxxxxxx
[and]
syncrepl rid=2 provider=ldap://10.1.1.82:636 type=refreshOnly interval=00:00:01:00 searchbase="o=test" filter="(objectClass=*)" scope=sub schemachecking=off bindmethod=simple binddn="cn=root DN, o=test" credentials=xxxxxxx
You wrote that "it doesn't use the retry setting" but you don't have one? I mean, really...
Maybe try adding
retry="120 +"
and see if you get retries to go? They're not expected to work if they're not configured. (Of course you'll read slapd.conf(5) man page to see what I'm having you do before adding something blindly?)