[Camera Support]: Reolink Poe Doorbell unstable in 0.15.beta2

[daernsinstantfortress]

Describe the problem you are having

Reolink doorbell crashes ffmpeg as follows:

Configured to use hwaccel_args: preset-vaapi

Crashes pretty much continuously:

2024-11-27 09:06:36.708238845  [2024-11-27 09:06:36] watchdog.front_doorbell        ERROR   : Ffmpeg process crashed unexpectedly for front_doorbell.
2024-11-27 09:06:36.708604249  [2024-11-27 09:06:36] watchdog.front_doorbell        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-11-27 09:06:36.708614367  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : libva info: VA-API version 1.22.0
2024-11-27 09:06:36.711248660  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
2024-11-27 09:06:36.711470118  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : libva info: Found init function __vaDriverInit_1_22
2024-11-27 09:06:36.712087837  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : libva info: va_openDriver() returns 0
2024-11-27 09:06:36.712248253  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] video_get_buffer: image parameters invalid
2024-11-27 09:06:36.729761164  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] get_buffer() failed
2024-11-27 09:06:36.730747373  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Decoding error: Invalid argument
2024-11-27 09:06:36.731256693  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] video_get_buffer: image parameters invalid
2024-11-27 09:06:36.731367569  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] get_buffer() failed
2024-11-27 09:06:36.734901458  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Decoding error: Invalid argument
2024-11-27 09:06:36.734912360  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] video_get_buffer: image parameters invalid
2024-11-27 09:06:36.734918750  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] get_buffer() failed
2024-11-27 09:06:36.734925881  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Decoding error: Invalid argument
2024-11-27 09:06:36.734932350  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] video_get_buffer: image parameters invalid
2024-11-27 09:06:36.734938042  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] get_buffer() failed
<snip>
2024-11-27 09:06:36.741699514  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [h264_qsv @ 0x5570e903b4c0] Too many errors when draining, this is a bug. Stop draining and force EOF.
2024-11-27 09:06:36.741706114  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Decoding error: Internal bug, should not have happened
2024-11-27 09:06:36.741712658  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Decode error rate 1 exceeds maximum 0.666667
2024-11-27 09:06:36.741719877  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Task finished with error code: -1145393733 (Error number -1145393733 occurred)
2024-11-27 09:06:36.741726769  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vist#0:0/h264 @ 0x5570e90193c0] [dec:h264_qsv @ 0x5570e9020600] Terminating thread with return code -1145393733 (Error number -1145393733 occurred)
2024-11-27 09:06:36.741733156  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [vost#0:0/rawvideo @ 0x5570e9028800] No filtered frames for output stream, trying to initialize anyway.
2024-11-27 09:06:36.741739692  [2024-11-27 09:06:36] ffmpeg.front_doorbell.detect   ERROR   : [out#0/rawvideo @ 0x5570e92c7fc0] Output file is empty, nothing was encoded(check -ss / -t / -frames parameters if used)

Configured to use hwaccel_args: preset-intel-qsv-h264
Crashes less frequently, but perhaps every 15 mins:

2024-11-27 11:58:50.131447755  [2024-11-27 11:58:50] watchdog.front_doorbell        ERROR   : Ffmpeg process crashed unexpectedly for front_doorbell.
2024-11-27 11:58:50.131602468  [2024-11-27 11:58:50] watchdog.front_doorbell        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-11-27 11:58:50.131685952  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [AVHWFramesContext @ 0x7fa4a406f9c0] Failed to sync surface 0xb: 1 (operation failed).
2024-11-27 11:58:50.131846691  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [hwdownload @ 0x7fa4a8003980] Failed to download frame: -5.
2024-11-27 11:58:50.132578094  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [vf#0:0 @ 0x562cf71cdc00] Error while filtering: Input/output error
2024-11-27 11:58:50.132731387  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [vf#0:0 @ 0x562cf71cdc00] Task finished with error code: -5 (Input/output error)
2024-11-27 11:58:50.132882797  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [vf#0:0 @ 0x562cf71cdc00] Terminating thread with return code -5 (Input/output error)

Is stable with hwaccel_args: preset-vaapi and path: "5.0" (i.e. old ffmpeg)

Version

0.15.0-beta2

What browser(s) are you using?

No response

Frigate config file

mqtt:
  host: 192.168.1.94
  port: 1883
  user: <username>
  password: <password>
ffmpeg:
  hwaccel_args: preset-vaapi
#  hwaccel_args: preset-intel-qsv-h264
#  path: "5.0"

detectors:
  coral1:
    type: edgetpu
    device: pci:0

record:
  enabled: true
  alerts:
    retain:
      days: 10
  detections:
    retain:
      days: 10
objects:
  track:
    - person
    - bird
    - cat
  filters:
    person:
      min_area: 3000
      max_area: 100000
      max_ratio: 0.7
    bird:
      threshold: 0.5
    cat:
      threshold: 0.6
      min_area: 1000
motion:
  threshold: 15

go2rtc:
  streams:
    front_doorbell_camera:
      - ffmpeg:http://192.168.16.11/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=<password>#video=copy#audio=copy#audio=opus
    front_doorbell_camera_sub:
      - ffmpeg:http://192.168.16.11/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=admin&password=<password>

    driveway_med:
      - rtsp://admin:<password>@192.168.254.12:554/Streaming/Channels/103

cameras:

  front_doorbell:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/front_doorbell_camera?video=copy&audio=aac
          hwaccel_args: preset-vaapi
          # hwaccel_args: preset-intel-qsv-h264
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/front_doorbell_camera_sub?video=copy
          hwaccel_args: preset-vaapi
          # hwaccel_args: preset-intel-qsv-h264
          input_args: preset-rtsp-restream
          roles:
            - detect

    detect:
      width: 896
      height: 672
      enabled: true
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: false
      required_zones:
        - lower_garden
    mqtt:
      required_zones:
        - lower_garden
    objects:
      track:
        - person
    zones:
      lower_garden:
        inertia: 2
        coordinates: 896,672,896,362,707,387,554,424,60,436,0,672
        objects:
          - person
    motion:
      mask:
        - 450,0,450,50,0,50,0,0

    review:
      alerts:
        required_zones:
          - lower_garden
  driveway:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/driveway_med
          roles:
            - detect
            - record
          hwaccel_args: preset-intel-qsv-h264

    detect:
      width: 1280
      height: 720
      enabled: true
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: false
      required_zones:
        - lower_drive
    motion:
      mask:
        - 407,49,404,0,22,0,22,52
    mqtt:
      required_zones:
        - lower_drive
    objects:
      track:
        - person
        - cat
    zones:
      lower_drive:
        coordinates: 1280,720,1280,314,969,267,685,250,326,258,226,340,0,344,0,720
        inertia: 2
        objects:
          - person
          - cat
      road:
        coordinates: 1280,0,1280,314,969,267,685,250,326,258,226,340,0,344,0,0
        inertia: 3

    review:
      alerts:
        required_zones:
          - lower_drive
  back_door:
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.254.14:554/Streaming/Channels/103
          roles:
            - detect
            - record
          hwaccel_args: preset-intel-qsv-h264

    detect:
      width: 1280
      height: 720
      enabled: true
    snapshots:
      enabled: true
      required_zones:
        - upper_drive
    mqtt:
      required_zones:
        - upper_drive
    motion:
      mask:
        - 407,72,407,32,22,34,27,76
    objects:
      track:
        - person
        - cat
    zones:
      upper_drive:
        coordinates: 
          1280,720,1280,622,1063,293,965,188,910,425,739,114,559,109,560,0,336,0,136,83,70,106,0,160,0,720
        inertia: 2
        objects:
          - person
          - cat
        filters:
          person:
            mask:
              - 770,120,770,0,992,0,916,394
    review:
      alerts:
        required_zones:
          - upper_drive
  patio:
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.254.11:554/Streaming/Channels/103
          roles:
            - detect
            - record
          hwaccel_args: preset-intel-qsv-h264

    detect:
      width: 1280
      height: 720
      enabled: true
    snapshots:
      enabled: true
    motion:
      mask:
        - 407,49,404,0,22,0,22,52
    objects:
      filters:
        person:
          threshold: 0.76
          mask:
            - 1280,720,1110,720,1113,349,1280,246
      track:
        - person
        - cat
    zones:
      lower_garden:
        inertia: 2
        coordinates: 0,720,1280,720,1280,0,0,0

  garage_door:
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.254.15:554/Streaming/Channels/102
          roles:
            - detect
            - record
          hwaccel_args: preset-intel-qsv-h264
    detect:
      width: 640
      height: 480
      enabled: true
    snapshots:
      enabled: true
    motion:
      mask:
        - 218,24,220,48,24,49,26,21
    zones:
      passage:
        inertia: 2
        coordinates: 0,0,0,480,640,480,640,0
  back_garden:
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.254.6:554/Streaming/Channels/102
          roles:
            - detect
            - record
          hwaccel_args: preset-intel-qsv-h264
    detect:
      width: 640
      height: 480
      enabled: true
    snapshots:
      enabled: true
    motion:
      mask:
        - 22,44,220,40,219,21,23,21
    objects:
      track:
        - person
        - cat
    zones:
      middle_garden:
        inertia: 2
        coordinates: 0,480,640,480,640,0,0,0
  garage:
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.254.16:554/Streaming/Channels/102
          roles:
            - detect
            - record
          hwaccel_args: preset-intel-qsv-h264
    detect:
      width: 640
      height: 480
      enabled: true
    snapshots:
      enabled: true
    zones:
      garage_inside:
        coordinates: 0,0,0,480,640,480,640,0
        inertia: 1

version: 0.15-0

Relevant Frigate log output

2024-11-27 09:09:52.037823936  [2024-11-27 09:09:52] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-11-27 09:09:52.279725373  2024/11/27 09:09:52 [error] 182#182: *6 connect() failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "127.0.0.1:5000"
2024-11-27 09:09:52.279737636  2024/11/27 09:09:52 [error] 182#182: *6 auth request unexpected status: 502 while sending to client, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", host: "127.0.0.1:5000"
2024-11-27 09:09:52.284027294  [2024-11-27 09:09:52] frigate.util.config            INFO    : frigate config does not need migration...
2024-11-27 09:09:52.325540881  [INFO] Starting go2rtc healthcheck service...
2024-11-27 09:09:52.615717509  [2024-11-27 09:09:52] frigate.app                    INFO    : Starting Frigate (0.15.0-e76f4e9)
2024-11-27 09:09:52.616499716  [2024-11-27 09:09:52] frigate.app                    INFO    : Creating directory: /tmp/cache
2024-11-27 09:09:52.693026057  [2024-11-27 09:09:52] peewee_migrate.logs            INFO    : Starting migrations
2024-11-27 09:09:52.694161643  [2024-11-27 09:09:52] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-11-27 09:09:52.726094700  [2024-11-27 09:09:52] frigate.app                    INFO    : Recording process started: 368
2024-11-27 09:09:52.726753105  [2024-11-27 09:09:52] frigate.app                    INFO    : Review process started: 369
2024-11-27 09:09:52.736268232  [2024-11-27 09:09:52] frigate.app                    INFO    : go2rtc process pid: 98
2024-11-27 09:09:52.778482032  [2024-11-27 09:09:52] detector.coral1                INFO    : Starting detection process: 384
2024-11-27 09:09:52.792739485  [2024-11-27 09:09:52] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as pci:0
2024-11-27 09:09:52.812230360  [2024-11-27 09:09:52] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-11-27 09:09:52.818941975  [2024-11-27 09:09:52] frigate.app                    INFO    : Output process started: 415
2024-11-27 09:09:53.034650593  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for front_doorbell: 465
2024-11-27 09:09:53.059130190  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for driveway: 473
2024-11-27 09:09:53.080624881  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for back_door: 482
2024-11-27 09:09:53.097131398  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for patio: 496
2024-11-27 09:09:53.121995586  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for garage_door: 505
2024-11-27 09:09:53.122546629  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for back_garden: 520
2024-11-27 09:09:53.140525742  2024/11/27 09:09:53 [error] 183#183: *8 connect() failed (111: Connection refused) while connecting to upstream, client: 172.30.32.1, server: , request: "GET /api/driveway/latest.jpg HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "ccab4aaf-frigate-fa-beta:5000"
2024-11-27 09:09:53.140538915  2024/11/27 09:09:53 [error] 183#183: *8 auth request unexpected status: 502 while sending to client, client: 172.30.32.1, server: , request: "GET /api/driveway/latest.jpg HTTP/1.1", host: "ccab4aaf-frigate-fa-beta:5000"
2024-11-27 09:09:53.140546334  172.30.32.1 - - [27/Nov/2024:09:09:53 +0000] "GET /api/driveway/latest.jpg HTTP/1.1" 500 177 "-" "HomeAssistant/2024.11.3 aiohttp/3.10.11 Python/3.12" "-"
2024-11-27 09:09:53.144704657  [2024-11-27 09:09:53] frigate.app                    INFO    : Camera processor started for garage: 528
2024-11-27 09:09:53.219659425  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for front_doorbell: 541
2024-11-27 09:09:53.257738135  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for driveway: 545
2024-11-27 09:09:53.314509048  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for back_door: 553
2024-11-27 09:09:53.356306197  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for patio: 560
2024-11-27 09:09:53.407182487  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for garage_door: 565
2024-11-27 09:09:53.447720779  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for back_garden: 570
2024-11-27 09:09:53.492094251  [2024-11-27 09:09:53] frigate.app                    INFO    : Capture process started for garage: 575
2024-11-27 09:09:53.584320332  [2024-11-27 09:09:53] frigate.api.fastapi_app        INFO    : Starting FastAPI app
2024-11-27 09:09:54.091098842  [2024-11-27 09:09:54] frigate.api.fastapi_app        INFO    : FastAPI started

Camera crash:

2024-11-27 11:58:47.427977341  [2024-11-27 11:58:47] frigate.video                  ERROR   : front_doorbell: Unable to read frames from ffmpeg process.
2024-11-27 11:58:47.428430578  [2024-11-27 11:58:47] frigate.video                  ERROR   : front_doorbell: ffmpeg process is not running. exiting capture thread...
2024-11-27 11:58:48.302441862  127.0.0.1 - - [27/Nov/2024:11:58:48 +0000] "" 400 0 "-" "-" "-"
2024-11-27 11:58:50.131447755  [2024-11-27 11:58:50] watchdog.front_doorbell        ERROR   : Ffmpeg process crashed unexpectedly for front_doorbell.
2024-11-27 11:58:50.131602468  [2024-11-27 11:58:50] watchdog.front_doorbell        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-11-27 11:58:50.131685952  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [AVHWFramesContext @ 0x7fa4a406f9c0] Failed to sync surface 0xb: 1 (operation failed).
2024-11-27 11:58:50.131846691  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [hwdownload @ 0x7fa4a8003980] Failed to download frame: -5.
2024-11-27 11:58:50.132578094  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [vf#0:0 @ 0x562cf71cdc00] Error while filtering: Input/output error
2024-11-27 11:58:50.132731387  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [vf#0:0 @ 0x562cf71cdc00] Task finished with error code: -5 (Input/output error)
2024-11-27 11:58:50.132882797  [2024-11-27 11:58:50] ffmpeg.front_doorbell.detect   ERROR   : [vf#0:0 @ 0x562cf71cdc00] Terminating thread with return code -5 (Input/output error)

Relevant go2rtc log output

2024-11-27 10:52:38.426809879  [INFO] Preparing new go2rtc config...
2024-11-27 10:52:38.568218589  [INFO] Got IP address from supervisor: 192.168.1.94
2024-11-27 10:52:38.721231908  [INFO] Got WebRTC port from supervisor: 8555
2024-11-27 10:52:40.153856607  [INFO] Starting go2rtc...
2024-11-27 10:52:40.614221698  10:52:40.613 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-11-27 10:52:40.614234097  10:52:40.614 INF config path=/dev/shm/go2rtc.yaml
2024-11-27 10:52:40.615632230  10:52:40.615 INF [rtsp] listen addr=:8554
2024-11-27 10:52:40.615641003  10:52:40.615 INF [api] listen addr=:1984
2024-11-27 10:52:40.616203055  10:52:40.616 INF [webrtc] listen addr=:8555/tcp
2024-11-27 10:52:48.445391454  [INFO] Starting go2rtc healthcheck service...

FFprobe output from your camera

[{"return_code":0,"stderr":"","stdout":{"programs":[],"stream_groups":[],"streams":[{"codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","width":2560,"height":1920,"avg_frame_rate":"20/1"},{"codec_long_name":"AAC (Advanced Audio Coding)","avg_frame_rate":"0/0"}]}},{"return_code":0,"stderr":"","stdout":{"programs":[],"stream_groups":[],"streams":[{"codec_long_name":"H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10","width":896,"height":672,"avg_frame_rate":"0/0"}]}}]

Frigate stats

No response

Operating system

HassOS

Install method

HassOS Addon

Object Detector

Coral

Network connection

Wired

Camera make and model

Hikvision PoE Doorbell

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

No response

[NickM-27]

The reolink doorbell has been particularly problematic. Some users have found it worked using preset-vaapi, otherwise may be best to just keep using ffmpeg 5.0

[daernsinstantfortress]

Thanks Nick. For me, with this config, preset-vaapi is an immediate "booom!", but it's still pretty rotten with preset-intel-qsv-h264. Do you plan to leave ffmpeg 5.0 in long-term for this sort of situation?

[NickM-27]

The logs you labeled as vaapi were qsv so I think you have that reversed. And yes there are no plans currently to remove the 5.0 support