Reolink doorbell two-way talk via neolink (MUCH lower delay) #11924
Replies: 15 comments 44 replies
-
|
Your go2rtc release is amd64 but your neolink release is arm64, is that correct? |
Beta Was this translation helpful? Give feedback.
-
|
nope, that's a typo from when I was testing on an arm system. Thanks for pointing it out, I've edited the post. |
Beta Was this translation helpful? Give feedback.
-
|
@bezmi I was able to get the above working on my frigate docker compose. First issue I had was that go2rtc was in '/usr/local/go2rtc/bin/go2rtc' for me, so I have move the newer version there. The second issue I had was that I needed to add the following to /config/neolink/neolink_talk.sh Otherwise it would not find the config file |
Beta Was this translation helpful? Give feedback.
-
|
also it seem to work better for me by using pcm rather than opus in the frigate config. |
Beta Was this translation helpful? Give feedback.
-
|
Interesting - I followed the frigate docs which say that any go2rtc executable included in the |
Beta Was this translation helpful? Give feedback.
-
|
Does this overcome the 2way audio not working issue introduced in firmware v3.0.0.3215_2401262240? |
Beta Was this translation helpful? Give feedback.
-
|
I'm not sure, probably not as it uses the same protocol as reolink stuff. Might be worth a shot. If you're reasonably adept with linux, I can help you test by sending an mp3 to the doorbell from the commandline. This will give confirmation on whether it will work before you go through the hassle of doing the frigate config. |
Beta Was this translation helpful? Give feedback.
-
|
If you follow the install instructions above, simply execute |
Beta Was this translation helpful? Give feedback.
-
|
Attempting to get this to run but receiving nothing but a loading screen when trying to start 2-way talk, if I try to run neolink_talk.sh within the container I get this: 
Config and neolink_talk.sh match yours exactly minus the username/password/ip address |
Beta Was this translation helpful? Give feedback.
-
|
Looks like you tried to run a shell script through the python interpreter. The "| ./neolink ... " part may not work. I used a full path for the executable /config/neolink/neolink and the config file /config/neolink/config.toml. Or do what @x-cimo suggested above and add "cd /config/neolink" near the top of the script. |
Beta Was this translation helpful? Give feedback.
-
|
Ok changed the script to: Config is: (I played around with the address, adding http://) |
Beta Was this translation helpful? Give feedback.
-
|
try this inside the neolink folder: It should play some words (about 10 sec) on the camera speaker. |
Beta Was this translation helpful? Give feedback.
-
|
I'll try and update to the latest beta and post my setup for that sometime over the weekend. I'm not sure if it'll work with the bind = "0.0.0.0"
# not sure if this is needed when not using the rtsp in neolink
# but I have it in my config and haven't tested without.
bind_port = 1554
# camera config, obviously change to your values
[[cameras]]
name = "Doorbell"
username = "admin"
password = "password"
address = "192.168.8.61:9000" |
Beta Was this translation helpful? Give feedback.
-
|
Further: if you're on |
Beta Was this translation helpful? Give feedback.
-
|
I tried to get the neolink 2 way audio working on my Reolink doorbell. I'm able to play the audio using the command But when i try and use the mic button in home assistant app no 2 way audio come out, also I notice that my stream is not as fast when using neolink. here is my config `root@frigate:/config/neolink# cat config.toml [[cameras]] `root@frigate:/config/neolink# cat neolink_talk.sh ffmpeg -fflags nobuffer -f alaw -ar 8000 -i - -f wav - | /config/neolink/neolink talk front_door -c config.toml --volume=1.0 -m -i "fdsrc fd=0"` |
Beta Was this translation helpful? Give feedback.
-
|
Okay so I did some more testing and the RC version is very slow and delayed with voice. I got both versions working but 6.2 is faster response time Thanks |
Beta Was this translation helpful? Give feedback.
-
|
more testing shows that 2 way audio works using the old method when not on the local network but not with neolink. It may be do to not installing ssl package. I'll try testing it out in the near feature |
Beta Was this translation helpful? Give feedback.
-
|
Any idea if this is still possible with the latest frigate 0.14 release? It appears as though I no longer have a /config folder in my docker container: |
Beta Was this translation helpful? Give feedback.
-
|
That is the |
Beta Was this translation helpful? Give feedback.
-
|
The volume is a little low for me. What is the maximum that I can safely put for volume in the neolink script? Also, I have a frigate container with integrated neolink. It's on docker hub at My repo is here: https://github.com/BEFH/docker_frigate/ In order to configure, you can use the scripts and config files in the repo, changing IP addresses and passwords. Instructions are in the repo. |
Beta Was this translation helpful? Give feedback.
-
|
@bezmi I don't know if you want to take a look at this, but it should avoid having to rerun the package installation every time the container restarts. |
Beta Was this translation helpful? Give feedback.
-
|
@BEFH where are you seeing the MIC icon. im connected to HA via HTTPS, i did everything you did above. im showing the video, i can hear. but i dont have a mic enable icon. my firmware is : my model # is DB_566128M5MP_P |
Beta Was this translation helpful? Give feedback.
-
|
@JoshuaSeidel are you using my example YAML for the lovelace card? If so, there might be a problem with the streams. Did the test script work for talking? Did you look at the frigate logs? edit: you are also using the latest firmware whereas I am using not the previous one but the one before that. |
Beta Was this translation helpful? Give feedback.
-
root@1ba4c0ac64a7:/opt/frigate# ffmpeg -i https://rhasspy.github.io/piper-samples/samples/en/en_US/lessac/high/speaker_0.mp3 -f alaw -ar 8000 -f wav - | ./neolink talk front_door -c config.toml --volume=1.0 -m -i "fdsrc fd=0"
bash: ./neolink: No such file or directory
ffmpeg version n5.1-2-g915ef932a3-20220731 Copyright (c) 2000-2022 the FFmpeg developers
built with gcc 12.1.0 (crosstool-NG 1.25.0.55_3defb7b)
configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-libxml2 --enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-libdav1d --enable-libdavs2 --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-mbedtls --enable-librist --enable-libtheora --enable-libvpx --enable-libwebp --enable-lv2 --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-ldexeflags=-pie --extra-libs='-ldl -lgomp' --extra-version=20220731
libavutil 57. 28.100 / 57. 28.100
libavcodec 59. 37.100 / 59. 37.100
libavformat 59. 27.100 / 59. 27.100
libavdevice 59. 7.100 / 59. 7.100
libavfilter 8. 44.100 / 8. 44.100
libswscale 6. 7.100 / 6. 7.100
libswresample 4. 7.100 / 4. 7.100
libpostproc 56. 6.100 / 56. 6.100
Input #0, mp3, from 'https://rhasspy.github.io/piper-samples/samples/en/en_US/lessac/high/speaker_0.mp3':
Metadata:
encoder : Lavf58.45.100
Duration: 00:00:09.53, start: 0.050113, bitrate: 65 kb/s
Stream #0:0: Audio: mp3, 22050 Hz, mono, fltp, 65 kb/s
Stream mapping:
Stream #0:0 -> #0:0 (mp3 (mp3float) -> pcm_s16le (native))
Press [q] to stop, [?] for help
Output #0, wav, to 'pipe:':
Metadata:
ISFT : Lavf59.27.100
Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 8000 Hz, mono, s16, 128 kb/s
Metadata:
encoder : Lavc59.37.100 pcm_s16le
av_interleaved_write_frame(): Broken pipeN/A speed= 0x
Error writing trailer of pipe:: Broken pipe
size= 0kB time=00:00:00.02 bitrate= 151.8kbits/s speed=13.2x
video:0kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 18.571428%
Error closing file pipe:: Broken pipe
Conversion failed! |
Beta Was this translation helpful? Give feedback.
-
|
@BEFH @bezmi ok i got that script to work. but still dont see the mic option in HA or frigate |
Beta Was this translation helpful? Give feedback.
-
|
@bezmi where are you seeing the MIC icon. im connected to HA via HTTPS, i did everything you did above. im showing the video, i can hear. but i dont have a mic enable icon. my firmware is : my model # is DB_566128M5MP_P |
Beta Was this translation helpful? Give feedback.
-
|
@JoshuaSeidel Make sure you have the microphone menu button enabled within the frigate card configuration. Other than that, I'm not sure how to help. Sorry :( |
Beta Was this translation helpful? Give feedback.
-
|
Gday everyoe. the sample test works fine, but i jsut cnat speak to it. Everytime i try the micbutton it errors with this below. UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 31: ordinal not in range(128) my go2rtc line: |
Beta Was this translation helpful? Give feedback.
-
|
also is there a way to avoid re-installing the dependencies each time frigate is restarted? |
Beta Was this translation helpful? Give feedback.
-
|
okay fixed. If i change my line to be: with emphasis on the audio=copy |
Beta Was this translation helpful? Give feedback.
-
|
i see the repo that someone above posted, but it wont run my config file. I'm using openvino and is complaining about and i dont know what to do, `reating yolov7-320.cfg and yolov7-320.weights Done. Generating yolov7-320.trt. This may take a few minutes. Traceback (most recent call last): |
Beta Was this translation helpful? Give feedback.
-
|
ah. now's a good time to learn how to build my own docker based on your copy of his but with stable only. yay i learnt dockerfile tonight |
Beta Was this translation helpful? Give feedback.
-
|
The GitHub actions were the hard part of the repo. Don’t forget to set your
secrets!
…On Fri, Aug 30, 2024 at 10:20 AM PetePeter ***@***.***> wrote:
ah. now's a good time to learn how to build my own docker based on your
copy of his but with stable only. yay i learnt dockerfile tonight
—
Reply to this email directly, view it on GitHub
<#11924 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAZ2Z2E7IDNJ6TSR7EJN4DLZUB5TZAVCNFSM6AAAAABJHODVQWVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTANBZHE4DCNA>
.
You are receiving this because you were mentioned.Message ID:
***@***.***
com>
|
Beta Was this translation helpful? Give feedback.
-
|
I have updated https://github.com/BEFH/docker_frigate/ with a matrix strategy so that it stays up-to-date with |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for this! I'll give it a shot when I have time. |
Beta Was this translation helpful? Give feedback.
-
|
A few months in, have you noticed any issues running libcairo2 as 1.16.0-5? What are the errors you're getting? |
Beta Was this translation helpful? Give feedback.
-
|
has anyone experienced homeasistant/go2rtc/neolink causing the mic to stay on and the camera getting stuck and doing no more 2way audio? |
Beta Was this translation helpful? Give feedback.
-
|
okay thank you. |
Beta Was this translation helpful? Give feedback.
-
|
No need to rebuild the docker. The config folder should be mapped to a folder outside you docker on your server. I have the stable, tensorrt, and arm64 versions in my Docker Hub. |
Beta Was this translation helpful? Give feedback.
-
I think I have actually experienced this. The LED colour which indicates "two-way talk active" remained on and I found no way to fix it without restarting the doorbell or manually exiting the neolink processes in the docker container. I haven't used two-way audio in a while (it's easier to check who's at the door and just walk up to it as the small delay of neolink is still a little too much for our small house) but if I do, I'll update go2rtc and see if the problem recurs. |
Beta Was this translation helpful? Give feedback.
-
|
Yes that's what I experienced. My frigate laptop is up again. But on HA I dont always see the mic icon anymore. weird. I'll have to do some testing when i get time tomorrow. I havent yet tried the new go2rtc but it is loaded in. And yes I ended up using Befh's docker repo since mine wouldnt work anymore. weird. i need to reimage this computer into a faster one. this one's ethernet is dying too - so it's on wifi right now |
Beta Was this translation helpful? Give feedback.
-
|
I give up. Ive moved back to frigate 13, where i do not get unable-to-keep-up with something errors. I'll try again once v14 is stable. |
Beta Was this translation helpful? Give feedback.
-
|
Give this a try: |
Beta Was this translation helpful? Give feedback.
-
|
Yes, from what I can tell. |
Beta Was this translation helpful? Give feedback.
-
|
We can open an issue in the neolink repo to ask for the feature, seems like it would be a reasonable addition. You can also put the timeout to a long interval. We know that neolink can have multiple processes running. It's a hack job for now, but may be usable. |
Beta Was this translation helpful? Give feedback.
-
|
lodged: QuantumEntangledAndy/neolink#318 |
Beta Was this translation helpful? Give feedback.
-
|
After testing some more, it seems to me (as in a hypothesis) that go2rtc is causing issues. neolink is timing out and being killed, but I notice after 4 attempts of go2rtc starting neolink after the timeout, the stream freezes and the container needs a reboot. I set the timeout to 10s, and after 50s, that specific stream will die. I can still view the doorbell on other apps without audio, its just the stream that the frigate card is pulling in that freezes and needs a container restart. Ive been testing all sorts of variations to try and play nice with go2rtc. At one point the timeout was working and go2rtc was catching it (the go2rtc logs will show that the exit code is 124, use I have several terminal panes open and am running example config/neolink/loggo2rtc output |
Beta Was this translation helpful? Give feedback.
-
|
there is definitely a go2rtc not terminating some consumer/producer. I've experienced it when trying out 2way audio. I've posted on a pr there to see if maybe they can fix it. Basically, i think once it works for 2 way audio it might work for this better. Nevertheless, TTS via HA for the doorbell works quite reliably (with a delay, and NOT this neolink) with this config, on go2rtc 1.9.4: i may just live without 2 way audio. At the end of the day the doorbell only needs to tell people: |
Beta Was this translation helpful? Give feedback.
-
|
I'm using Neolink talk command with a non-doorbell reolink camera. The test command works, But I am now trying to get my frigate hass card with the microphone button working. |
Beta Was this translation helpful? Give feedback.
-
Extending my comment which was originally posted on the go2rtc issue
Here are some detailed instructions to get reolink doorbell two-way talk working via QuantumEntangledAndy/neolink which offers much lower latency than the rtsp backchannel. It's pretty much the same latency as the reolink app. Obviously, this is highly experimental and might break things so use at your own risk!
First, some commands to install neolink and deps in the frigate docker container. see footnote
Make sure you enter the frigate container first:
docker exec -it frigate bashNow create the file
/config/neolink/config.toml:and the file
/config/neolink/neolink_talk.shMake it executable
Finally, edit the go2rtc streams section in your frigate config file,
/config/config.yml:The first entry is the regular stream, second entry
exec:...is the backchannel magic.note: I remove libcairo2 and install a different version to make gstreamer happy. I think this might be the cause of some errors in the frigate log, but I haven't noticed anything actually going wrong. Use at your own risk.
edit: use the full path to neolink executable in
neolink_talk.shBeta Was this translation helpful? Give feedback.
All reactions