imap authentication failure.

[danger-trouble]

Describe the bug
imap 2FA fails to see new email containing 2FA code for MANY attempts before finding email then crashing.

To Reproduce
Regular imap setup with zohomail (specifically for LSA login via imap)
Confirmed 2FA emails are arriving in zoho mailbox

early log show normal connectivity:
Arlo Camera Plugin: loaded @scrypted/arlo
[Arlo Provider]: Trying connect to IMAP (attempt 1)
[Arlo Provider]: Connected to IMAP
[Arlo Provider]: Starting IMAP refresh loop 140372816749792
[Arlo Provider]: Performing IMAP login flow
[Arlo Provider]: Trying to initialize Arlo client...
[Arlo]: Using primary authentication host
[Arlo Provider]: Initialized Arlo client, waiting for MFA code
[Arlo Provider]: Checking IMAP for MFA codes (attempt 1)
[Arlo Provider]: No new emails found, will sleep and retry

Expected behavior
login success functionality like a manual 2FA

Logs
[Arlo Provider]: Checking IMAP for MFA codes (attempt 155)
[Arlo Provider]: Found MFA code
[Arlo Provider]: Completing Arlo MFA...
[Arlo Provider]: Unrecoverable login error
Traceback (most recent call last):
File "/data/scrypted_data/plugins/@scrypted/arlo/zip/unzipped/arlo_plugin/provider.py", line 450, in imap_relogin_loop
_ = self.arlo
^^^^^^^^^
File "/data/scrypted_data/plugins/@scrypted/arlo/zip/unzipped/arlo_plugin/provider.py", line 215, in arlo
self._arlo_mfa_complete_auth(self._arlo_mfa_code)
File "/data/scrypted_data/plugins/@scrypted/arlo/zip/unzipped/arlo_plugin/arlo/arlo_async.py", line 273, in complete_auth
raise Exception("Could not complete 2FA, maybe invalid token? If the error persists, please try reloading the plugin and logging in again.")
Exception: Could not complete 2FA, maybe invalid token? If the error persists, please try reloading the plugin and logging in again.
[Arlo Provider]: Will request a plugin restart
Arlo Camera Plugin: plugin restart was requested

the amount attempts before finding the email before a crash is consistently in the hundreds but not the same every time.

Server:

HAOS in UTM virtual Machine in macOS Monterey

[bjia56]

Are you using an email forwarder to deliver the MFA codes? What is the sender address used by the emails?

[danger-trouble]

Thanks for the fast reply!
I am not using a mail forwarder. The address is just the standard do_not_reply@arlo.com. it has dawned on me that perhaps zohomail is taking its time to make emails available via imap even though they pop up immediately in the web browser?

I left it to run and it appears it did eventually connect but not before filling my mailbox up with literally hundreds of 2FA codes. it stayed online long enough to trigger a late night HKSV motion recording but it appears to be offline again. (different issue I'm sure)

I see there is an update. I'll update and play around some more.

[bjia56]

I see this issue in a related project: twrecked/pyaarlo#169
We use a similar search which may be related to this issue.

[danger-trouble]

Yeah bummer. Earlier drafted up a python script which sends an email with a unique id and then uses imaplib in a similar way to look for that email while measuring the latency. It consistently took longer than 5 minutes.

on your suggestion of the issue being related to the one at pyaarlo, I just ran a test similar what they were talking about in that thread where rather than relying on the email servers index to search messages, just get the most recent messages and search them locally and was able to send and retrieve an email in less than 3 seconds. let me see if I can punch something up that functions in the same way but can be applied to scryptedap/arlo

[bjia56]

An option has been added to the latest plugin to fetch all emails instead of relying on the imap server's index.

[danger-trouble]

That is beautiful and works great. I was really stretching my skills trying to implement a solution locally 😅. I just started switching from HomeBridge to HomeAssistant and Scrypted a few days ago because I got a new Arlo camera. Also, I was fine coding a proof of concept in python to test the difference in time to retrieve between the two email methods but I was in over my head in the provider.py. I learned a lot though! and the solution is functional! Thanks!