Reolink camera stream artifacts

[Plyn1x]

Hi, I’m experiencing issues with my Reolink Duo 2 cameras over PoE. The RTSP stream seems to break up despite several adjustments. I’ve configured the stream to use the fluent (low-bandwidth) profile, set CBR (Constant Bitrate) mode, and adjusted the interframe spacing to 1. I’ve also prioritized fluency over quality with the “Fluency First” option, but the issue persists only in Frigate.

Any ideas or suggestions for resolving this would be greatly appreciated.
Here is also my Frigate Config:

mqtt:
  host: homeassistant.local
  port: 1883
  user: <your-mqtt-username>
  password: <your-mqtt-password>  # Replace with your MQTT password

ffmpeg:
  hwaccel_args: preset-intel-qsv-h264
  output_args:
    record: preset-record-generic-audio-aac  # Enable audio support

cameras:
  Einfahrt:
    ffmpeg:
      hwaccel_args:
        - -hwaccel
        - vaapi
        - -hwaccel_device
        - /dev/dri/renderD128
        - -hwaccel_output_format
        - yuv420p
      inputs:
        - path: rtsp://<camera-username>:<camera-password>@192.168.178.52:8554/h264Preview_01_main
          roles:
            - detect
            - record
            - audio
    detect:
      fps: 5
      enabled: true
      stationary:
        interval: 50
        threshold: 100
        max_frames:
          default: 500
          objects:
            car: 500
    record:
      enabled: true
      retain:
        days: 5
        mode: motion
      events:
        retain:
          default: 5
        pre_capture: 60
        post_capture: 60
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      crop: true
      retain:
        default: 5
    objects:
      track:
        - person
        - car
        - dog
        - cat
        - parcel  # Parcel tracking limited to Einfahrt
      filters:
        car:
          min_area: 5000
          max_area: 100000
          min_score: 0.7
          threshold: 0.8
        parcel:
          min_area: 3000
          max_area: 50000
          min_score: 0.75
          threshold: 0.85
    motion:
      mask:
        - 0.796,0.638,1,0.724,1,0.638
        - 0.822,0,0.823,0.08,1,0.086,1,0

  3D-Drucker:
    ffmpeg:
      hwaccel_args:
        - -hwaccel
        - vaapi
        - -hwaccel_device
        - /dev/dri/renderD128
        - -hwaccel_output_format
        - yuv420p
      inputs:
        - path: rtsp://<camera-username>:<camera-password>@192.168.178.55:8554/h264Preview_01_main
          roles:
            - detect
            - record
            - audio
    detect:
      fps: 5
      enabled: true
      stationary:
        interval: 50
        threshold: 100
        max_frames:
          default: 500
    record:
      enabled: true
      retain:
        days: 5
        mode: motion
      events:
        retain:
          default: 5
        pre_capture: 60
        post_capture: 60
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      crop: true
      retain:
        default: 5
    objects:
      track:
        - person
        - dog  # No parcel tracking in 3D-Drucker camera
      mask: 
        0.237,0,0.307,0.387,0.346,0.452,0.529,0.536,0.667,0.58,0.836,0.625,1,0,0.707,0,0.446,0,0.456,0.139,0.372,0.194,0.348,0,0.309,0,0.294,0,0.26,0
    motion:
      mask:
        - 0.705,0.004,0.707,0.031,1,0.037,0.998,0.005

  Vor-Garage:
    ffmpeg:
      hwaccel_args:
        - -hwaccel
        - vaapi
        - -hwaccel_device
        - /dev/dri/renderD128
        - -hwaccel_output_format
        - yuv420p
      inputs:
        - path: rtsp://<camera-username>:<camera-password>@192.168.178.88:8554/h264Preview_01_main
          roles:
            - detect
            - record
            - audio
    detect:
      fps: 5
      enabled: true
      stationary:
        interval: 50
        threshold: 100
        max_frames:
          default: 500
    record:
      enabled: true
      retain:
        days: 5
        mode: motion
      events:
        retain:
          default: 5
        pre_capture: 60
        post_capture: 60
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      crop: true
      retain:
        default: 5
    objects:
      track:
        - person
        - dog
        - cat

audio:
  enabled: true
  listen:
    - bark
    - fire_alarm
    - scream
    - speech
    - yell
    - siren
    - glass
  filters:
    bark:
      threshold: 0.7
    fire_alarm:
      threshold: 0.7
    scream:
      threshold: 0.7
    speech:
      threshold: 0.7
    yell:
      threshold: 0.7
    siren:  # Custom threshold for sirens
      threshold: 0.7
    alarm:  # Custom threshold for alarms
      threshold: 0.7
    glass:
      threshold: 0.7

detectors:
  coral:
    type: edgetpu
    device: usb

logger:
  default: debug

version: 0.14

Could it be that my Intel NUC is running into its limits I have nearly 100% usage with Coral Edge TPU (high FFMPEG usage)

[hawkeye217]

You're setting a qsv hwaccel preset globally then you are using manual arguments for hwaccel in each camera. You should try using preset-vaapi and removing the manual arguments.

Can you post screenshots of your system metrics pages? Do the frigate logs show any errors?

[Plyn1x]

Hi,

It only shows these Errors

but this isnt the affected Camera.

[Plyn1x]

2024-12-10 12:51:48.378655486 [2024-12-10 13:51:48] peewee DEBUG : ('SELECT "t1"."id", "t1"."camera" FROM "event" AS "t1" WHERE (((("t1"."camera" = ?) AND ("t1"."start_time" < ?)) AND ("t1"."label" = ?)) AND ("t1"."retain_indefinitely" = ?))', ['Vor-Garage', 1733403108.377056, 'fire_alarm', False]) 2024-12-10 12:51:48.380375949 [2024-12-10 13:51:48] peewee DEBUG : ('SELECT "t1"."id", "t1"."camera" FROM "event" AS "t1" WHERE (((("t1"."camera" = ?) AND ("t1"."start_time" < ?)) AND ("t1"."label" = ?)) AND ("t1"."retain_indefinitely" = ?))', ['Vor-Garage', 1733403108.378946, 'speech', False]) 2024-12-10 12:51:48.382211204 [2024-12-10 13:51:48] peewee DEBUG : ('SELECT "t1"."id", "t1"."camera" FROM "event" AS "t1" WHERE (((("t1"."camera" = ?) AND ("t1"."start_time" < ?)) AND ("t1"."label" = ?)) AND ("t1"."retain_indefinitely" = ?))', ['Vor-Garage', 1733403108.380907, 'dog', False]) 2024-12-10 12:51:48.385265355 [2024-12-10 13:51:48] peewee DEBUG : ('SELECT "t1"."id", "t1"."camera" FROM "event" AS "t1" WHERE (((("t1"."camera" = ?) AND ("t1"."start_time" < ?)) AND ("t1"."label" = ?)) AND ("t1"."retain_indefinitely" = ?))', ['Vor-Garage', 1733403108.382657, 'bark', False]) 2024-12-10 12:51:48.395987522 [2024-12-10 13:51:48] peewee DEBUG : ('SELECT "t1"."id", "t1"."camera" FROM "event" AS "t1" WHERE (((("t1"."camera" = ?) AND ("t1"."start_time" < ?)) AND ("t1"."label" = ?)) AND ("t1"."retain_indefinitely" = ?))', ['Vor-Garage', 1733403108.387813, 'siren', False]) 2024-12-10 12:51:48.403938318 [2024-12-10 13:51:48] peewee.sqliteq DEBUG : received query UPDATE "event" SET "has_snapshot" = ? WHERE (0 = 1) 2024-12-10 12:51:48.404903850 [2024-12-10 13:51:48] peewee DEBUG : ('UPDATE "event" SET "has_snapshot" = ? WHERE (0 = 1)', [False]) 2024-12-10 12:51:48.408641433 [2024-12-10 13:51:48] peewee.sqliteq DEBUG : received query DELETE FROM "event" WHERE (("event"."has_clip" = ?) AND ("event"."has_snapshot" = ?)) 2024-12-10 12:51:48.408890267 [2024-12-10 13:51:48] peewee DEBUG : ('DELETE FROM "event" WHERE (("event"."has_clip" = ?) AND ("event"."has_snapshot" = ?))', [False, False]) 2024-12-10 12:51:50.073939850 [2024-12-10 13:51:50] asyncio DEBUG : Using selector: EpollSelector 2024-12-10 12:51:50.345090354 [2024-12-10 13:51:50] frigate.record.maintainer DEBUG : Copied /media/frigate/recordings/2024-12-10/12/Einfahrt/51.37.mp4 in 0.1801290512084961 seconds. 2024-12-10 12:51:50.359948035 [2024-12-10 13:51:50] peewee.sqliteq DEBUG : received query INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) 2024-12-10 12:51:50.365359481 [2024-12-10 13:51:50] peewee DEBUG : ('INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)', ['1733835097.0-28zits', 'Einfahrt', '/media/frigate/recordings/2024-12-10/12/Einfahrt/51.37.mp4', 1733835097.0, 1733835107.306456, 10.306455555555555, 0, 0, -23, 3.7, 0]) 2024-12-10 12:51:51.009856417 [2024-12-10 13:51:51] frigate.record.cleanup DEBUG : Checking preview /tmp/cache/preview_3D-Drucker_1733833005.058947-1733833045.618227.mp4. 2024-12-10 12:51:51.010077735 [2024-12-10 13:51:51] frigate.record.cleanup DEBUG : Checking preview /tmp/cache/preview_3D-Drucker_1733832427.533935-1733832534.898367.mp4. 2024-12-10 12:51:51.011960689 [2024-12-10 13:51:51] frigate.record.cleanup DEBUG : Checking preview /tmp/cache/preview_Einfahrt_1733832342.320229-1733832374.380548.mp4. 2024-12-10 12:51:52.062925001 [2024-12-10 13:51:52] frigate.events.audio DEBUG : Vor-Garage heard wind with a score of 0.5 2024-12-10 12:51:55.082476461 [2024-12-10 13:51:55] asyncio DEBUG : Using selector: EpollSelector 2024-12-10 12:51:55.677424629 [2024-12-10 13:51:55] frigate.record.maintainer DEBUG : Copied /media/frigate/recordings/2024-12-10/12/Vor-Garage/51.43.mp4 in 0.5096831321716309 seconds. 2024-12-10 12:51:55.700894545 [2024-12-10 13:51:55] peewee.sqliteq DEBUG : received query INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) 2024-12-10 12:51:55.700903196 [2024-12-10 13:51:55] peewee DEBUG : ('INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)', ['1733835103.0-6lewo4', 'Vor-Garage', '/media/frigate/recordings/2024-12-10/12/Vor-Garage/51.43.mp4', 1733835103.0, 1733835111.954833, 8.954833333333333, 85, 0, -25, 6.8, 69]) 2024-12-10 12:51:58.598227025 [2024-12-10 13:51:58] frigate.stats.emitter DEBUG : Starting stats collection 2024-12-10 12:51:58.598814177 [2024-12-10 13:51:58] asyncio DEBUG : Using selector: EpollSelector 2024-12-10 12:51:59.878325163 [2024-12-10 13:51:59] frigate.events.audio DEBUG : Vor-Garage heard heartbeat with a score of 0.73828125 2024-12-10 12:52:00.110288490 [2024-12-10 13:52:00] asyncio DEBUG : Using selector: EpollSelector 2024-12-10 12:52:00.179063560 [2024-12-10 13:52:00] frigate.stats.emitter DEBUG : Finished stats collection 2024-12-10 12:52:00.318463370 [2024-12-10 13:52:00] frigate.record.maintainer DEBUG : Copied /media/frigate/recordings/2024-12-10/12/Einfahrt/51.47.mp4 in 0.14320802688598633 seconds. 2024-12-10 12:52:00.325479077 [2024-12-10 13:52:00] peewee.sqliteq DEBUG : received query INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) 2024-12-10 12:52:00.325487471 [2024-12-10 13:52:00] peewee DEBUG : ('INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)', ['1733835107.0-8ijz60', 'Einfahrt', '/media/frigate/recordings/2024-12-10/12/Einfahrt/51.47.mp4', 1733835107.0, 1733835117.093222, 10.093222222222222, 0, 0, -24, 3.7, 0]) 2024-12-10 12:52:02.595149144 [2024-12-10 13:52:02] frigate.video ERROR : 3D-Drucker: Unable to read frames from ffmpeg process. 2024-12-10 12:52:02.603991206 [2024-12-10 13:52:02] frigate.video ERROR : 3D-Drucker: Unable to read frames from ffmpeg process. 2024-12-10 12:52:02.613133576 [2024-12-10 13:52:02] frigate.video ERROR : 3D-Drucker: Unable to read frames from ffmpeg process. 2024-12-10 12:52:02.614144517 [2024-12-10 13:52:02] frigate.video ERROR : 3D-Drucker: ffmpeg process is not running. exiting capture thread... 2024-12-10 12:52:05.087640168 [2024-12-10 13:52:05] asyncio DEBUG : Using selector: EpollSelector 2024-12-10 12:52:05.208604159 [mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fd2c40de0c0] moov atom not found 2024-12-10 12:52:05.281576942 [2024-12-10 13:52:05] frigate.record.maintainer DEBUG : Copied /media/frigate/recordings/2024-12-10/12/Vor-Garage/51.52.mp4 in 0.14803814888000488 seconds. 2024-12-10 12:52:05.290606248 [2024-12-10 13:52:05] frigate.record.maintainer WARNING : Failed to probe corrupt segment /tmp/cache/3D-Drucker@20241210135154+0100.mp4 2024-12-10 12:52:05.291264838 [2024-12-10 13:52:05] frigate.record.maintainer WARNING : Discarding a corrupt recording segment: /tmp/cache/3D-Drucker@20241210135154+0100.mp4 2024-12-10 12:52:05.305972113 [2024-12-10 13:52:05] peewee.sqliteq DEBUG : received query INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) 2024-12-10 12:52:05.307820934 [2024-12-10 13:52:05] peewee DEBUG : ('INSERT INTO "recordings" ("id", "camera", "path", "start_time", "end_time", "duration", "motion", "objects", "dBFS", "segment_size", "regions") VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)', ['1733835112.0-476k66', 'Vor-Garage', '/media/frigate/recordings/2024-12-10/12/Vor-Garage/51.52.mp4', 1733835112.0, 1733835122.021233, 10.021233333333333, 125, 0, -20, 8.3, 91])

[hawkeye217]

You might consider using a substream for detection to reduce your load.

[Plyn1x]

I use a coral TPU, the detection seems fine or is it causing that large ffmpeg load ?

[NickM-27]

the ffmpeg load is caused by the decoding and processing of the stream, that load is unrelated to detection