[Config Support]: Horrible Object Detection Accuracy #15419

luckylinux · 2024-12-09T19:27:30Z

luckylinux
Dec 9, 2024

Describe the problem you are having

I am faced with a VERY inaccurate Detections off my several Hikvisions 4K and one 4MP Camera.

I am currently using the Hailo-8L Detector on 2 different Systems, with Image Tag 833cdcb-h8l (ghcr.io/blakeblackshear/frigate:833cdcb-h8l).

Some Examples include:

No detection at all of me going out with my Dog in the Evening
Small movements of Brushes (Plants) during Wind are interpreted as "Person"

CPU Usage is very low (5%-10%) in both Cases which is very good.

The Systems are configured as following:
A. System A

ASUS P9D WS Motherboard
Intel Xeon E3-1245 v3
Proxmox VE with latest Updates applied prior to reboot (pve-manager/8.3.1/fb48e850ef9dde27 (running kernel: 6.8.12-3-pve)) - Kernel 6.8.12-4-pve caused issues, that's why I'm using a slightly older one
Podman (5.3.1) installed from Source using my Script
3 x Hailo-8L M.2 Detectors in PCIe-to-M.2 Adapter

B. System B

ASUS ROG STRIX B550-A GAMING Motherboard
AMD Ryzen 5950x
Proxmox VE with latest Updates applied prior to reboot (pve-manager/8.3.1/fb48e850ef9dde27 (running kernel: 6.8.12-3-pve)) - Kernel 6.8.12-4-pve caused issues, that's why I'm using a slightly older one
Podman (5.3.1) installed from Source using my Script
2 x Hailo-8L M.2 Detectors in PCIe-to-M.2 Adapter

Podman Configuration is essentially Frigate behind a Caddy Proxy using IPv6 mainly with snid IPv4 Fallback for IPv4-only Clients (and to access 1 Camera that I didn't set up with IPv6 yet).

There's probably something VERY wrong with the Configuration.

Hikvision Camera Substream Settings are as follorws: Resolution 1280x720p, Variable Bit Rate, Medium Picture Quality, 10 Video Frame Rate, 4096 kbps max Bit Rate, Video Encoding H.264, Profile Medium, I-Frame Interval 10, SVC Off, Smoothing 50

Version

0.15.0-833cdcb

Frigate config file

# Reference: https://docs.frigate.video/configuration/reference/
mqtt:
  host: 192.168.A.B
  port: 1883

# Logger Configuration
#logger:
#  # Optional: default log level (default: shown below)
#  default: info
#  # Optional: module by module log level configuration
#  logs:
#    frigate.mqtt: error


# TLS Configuration
#tls:
#  enabled: False

# Optional: Authentication configuration
#auth:
#  # Optional: Enable authentication
#  enabled: False
#  # Optional: Reset the admin user password on startup (default: shown below)
#  # New password is printed in the logs
#  reset_admin_password: False
#  # Optional: Cookie to store the JWT token for native auth (default: shown below)
#  #cookie_name: frigate_token
#  # Optional: Set secure flag on cookie. (default: shown below)
#  # NOTE: This should be set to True if you are using TLS
#  cookie_secure: False
#  # Optional: Session length in seconds (default: shown below)
#  session_length: 86400 # 24 hours
#  # Optional: Refresh time in seconds (default: shown below)
#  # When the session is going to expire in less time than this setting,
#  # it will be refreshed back to the session_length.
#  refresh_time: 43200 # 12 hours
#  # Optional: Rate limiting for login failures to help prevent brute force
#  # login attacks (default: shown below)
#  # See the docs for more information on valid values
#  #failed_login_rate_limit: None
#  failed_login_rate_limit: "10/second;60/minute;3600/hour"
#  # Optional: Trusted proxies for determining IP address to rate limit
#  # NOTE: This is only used for rate limiting login attempts and does not bypass
#  # authentication. See the authentication docs for more details.
#  trusted_proxies: []
#  #  - 192.168.E.F/32
#  #  - 2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0002/128
#
#  # Optional: Number of hashing iterations for user passwords
#  # As of Feb 2023, OWASP recommends 600000 iterations for PBKDF2-SHA256
#  # NOTE: changing this value will not automatically update password hashes, you
#  #       will need to change each user password for it to apply
#  hash_iterations: 600000
#  #mode: proxy
#  #proxy:
#  #  authentication_method: None # defaults to None and available options are None and shared_secret
#  #  shared_secret: XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX # it needs to be possible to pass this with a docker secret or env var
#  #  #header_map:
#  #  #  user: x-forwarded-user
#  #  logout_url: /api/logout

#proxy:
#  auth_secret: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"

# Optional: birdseye configuration
# NOTE: Can (enabled, mode) be overridden at the camera level
birdseye:
  # Optional: Enable birdseye view (default: shown below)
  enabled: true
  # Optional: Restream birdseye via RTSP (default: shown below)
  # NOTE: Enabling this will set birdseye to run 24/7 which may increase CPU usage somewhat.
  restream: false
  # Optional: Width of the output resolution (default: shown below)
  width: 1280
  # Optional: Height of the output resolution (default: shown below)
  height: 720
  # Optional: Encoding quality of the mpeg1 feed (default: shown below)
  # 1 is the highest quality, and 31 is the lowest. Lower quality feeds utilize less CPU resources.
  quality: 8
  # Optional: Mode of the view. Available options are: objects, motion, and continuous
  #   objects - cameras are included if they have had a tracked object within the last 30 seconds
  #   motion - cameras are included if motion was detected in the last 30 seconds
  #   continuous - all cameras are included always
  mode: continuous
  # Optional: Threshold for camera activity to stop showing camera (default: shown below)
  inactivity_threshold: 300
  # Optional: Configure the birdseye layout
  layout:
    # Optional: Scaling factor for the layout calculator, range 1.0-5.0 (default: shown below)
    scaling_factor: 2.0
    # Optional: Maximum number of cameras to show at one time, showing the most recent (default: show all cameras)
    max_cameras: 999

record:
  enabled: true
  retain:
    days: 30
    mode: motion
  alerts:
    retain:
      days: 365
    pre_capture: 60
    post_capture: 60
  detections:
    retain:
      days: 365
    pre_capture: 60
    post_capture: 60
detect:
  # Desired fps for your camera for the input with the detect role (default: shown below)
  # NOTE: Recommended value of 5. Ideally, try and reduce your FPS on the camera.
  fps: 5

  # Optional: enables detection for the camera (default: True)
  enabled: true

  # Optional: Number of consecutive detection hits required for an object to be initialized in the tracker. (default: 1/2 the frame rate)
  min_initialized: 10

  # Optional: Number of frames without a detection before Frigate considers an object to be gone. (default: 5x the frame rate)
  max_disappeared: 250

  # Optional: Configuration for stationary object tracking
  stationary:
    # Optional: Frequency for confirming stationary objects (default: same as threshold)
    # When set to 1, object detection will run to confirm the object still exists on every frame.
    # If set to 10, object detection will run to confirm the object still exists on every 10th frame.
    interval: 50
    # Optional: Number of frames without a position change for an object to be considered stationary (default: 10x the frame rate or 10s)
    threshold: 50
    # Optional: Define a maximum number of frames for tracking a stationary object (default: not set, track forever)
    # This can help with false positives for objects that should only be stationary for a limited amount of time.
    # It can also be used to disable stationary object tracking. For example, you may want to set a value for person, but leave
    # car at the default.
    # WARNING: Setting these values overrides default behavior and disables stationary object tracking.
    #          There are very few situations where you would want it disabled. It is NOT recommended to
    #          copy these values from the example config into your config unless you know they are needed.
    #max_frames:
    #  # Optional: Default for all object types (default: not set, track forever)
    #  default: 3000
    #  # Optional: Object specific values
    #  objects:
    #    person: 1000
  # Optional: Milliseconds to offset detect annotations by (default: shown below).
  # There can often be latency between a recording and the detect process,
  # especially when using separate streams for detect and record.
  # Use this setting to make the timeline bounding boxes more closely align
  # with the recording. The value can be positive or negative.
  # TIP: Imagine there is an event clip with a person walking from left to right.
  #      If the event timeline bounding box is consistently to the left of the person
  #      then the value should be decreased. Similarly, if a person is walking from
  #      left to right and the bounding box is consistently ahead of the person
  #      then the value should be increased.
  # TIP: This offset is dynamic so you can change the value and it will update existing
  #      events, this makes it easy to tune.
  # WARNING: Fast moving objects will likely not have the bounding box align.
  #annotation_offset: 0

# Optional: Object configuration
# NOTE: Can be overridden at the camera level
objects:
  track:
    - person
    - dog
    - cat
    - car
    - bicycle
    - mice

go2rtc:
#  rtsp:
  srtp:
    username: frigate
    password: MY_GO2RTC_PASSWORD
  streams:
    garage-camera-01:
      #- rtsp://192.168.C.D/Streaming/Channels/101
      #- rtsp://192.168.C.D/Streaming/Channels/101
      #- rtsp://frigate:[email protected]/Streaming/Channels/101
      #- srtp://frigate:[email protected]:554/Streaming/Channels/101
      #- srtp://frigate:[email protected]:554/Streaming/Channels/101
      #- rtsp://frigate:[email protected]:8860/Streaming/Channels/101
      #- srtp://frigate:[email protected]:18862/Streaming/Channels/101

      # Works (IPv4)
      - rtsp://frigate:[email protected]:554/Streaming/Channels/101

      #- Works (IPv6)
      # ...

    west-camera-01:
      # Works (IPv6)
      - rtsp://frigate:PASSWORD[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0011]:554/Streaming/Channels/101

    south-camera-01:
      # Works (IPv6)
      - rtsp://frigate:PASSWORD@[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0021]:554/Streaming/Channels/101

    east-camera-01:
      # Works (IPv6)
      - rtsp://frigate:PASSWORD@[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0031]:554/Streaming/Channels/101

    north-camera-01:
      # Works (IPv6)
      - rtsp://frigate:PASSWORD@[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0041]:554/Streaming/Channels/101

cameras:
  garage-camera-01:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
#        - path: rtsp://192.168.C.D
#        - path: srsp://192.168.C.D:18862/Streaming/channels/101
#        - path: rtsp://192.168.C.D:10554/Streaming/channels/101
#        - path: rtsp://frigate:[email protected]:8860/Streaming/channels/101
          #  - detect

        - path: rtsp://127.0.0.1:8554/garage-camera-01
          input_args: preset-rtsp-restream
          roles:
            - record
#            - rtmp
        #- path: srtp://frigate:[email protected]:18868/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:8866/Streaming/Channels/102
        - path: rtsp://frigate:[email protected]:554/Streaming/Channels/102
          roles:
            - detect

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
      fps: 5
    objects:
      track:
        - person
        - dog
        - cat
        - car
        - bicycle
    motion: {}
    snapshots:
      enabled: true
#      required_zones:
#        - drive_steps
    record:
      enabled: true
      #events:
      #  retain:
      #    default: 10
    live:
      stream_name: stream-garage-camera-01
#      width: # <- optional, by default Frigate tries to automatically detect resolution
#      height: # <- optional, by default Frigate tries to automatically detect resolution
#    detect:
#      width: 1280
#      height: 800
    review:
      alerts:
        required_zones:
          - zone_garage_camera_01

    zones:
      zone_garage_camera_01:
        coordinates: 0, 0, 0, 100, 100, 100, 100, 0



  west-camera-01:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
#        - path: rtsp://192.168.C.D
#        - path: srsp://192.168.C.D:18862/Streaming/channels/101
#        - path: rtsp://192.168.C.D:10554/Streaming/channels/101
#        - path: rtsp://frigate:[email protected]:8860/Streaming/channels/101
          #  - detect

        - path: rtsp://127.0.0.1:8554/west-camera-01
          input_args: preset-rtsp-restream
          roles:
            - record
#            - rtmp
        #- path: srtp://frigate:[email protected]:18868/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:8866/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:554/Streaming/Channels/102
        - path: 
            rtsp://frigate:PASSWORD[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0011]:554/Streaming/Channels/102
          roles:
            - detect

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
      fps: 5
    objects:
      track:
        - person
        - dog
        - cat
        - car
        - bicycle
    motion: {}
    snapshots:
      enabled: true
#      required_zones:
#        - drive_steps
    record:
      enabled: true
      #events:
      #  retain:
      #    default: 10
    live:
      stream_name: stream-west-camera-01
#      width: # <- optional, by default Frigate tries to automatically detect resolution
#      height: # <- optional, by default Frigate tries to automatically detect resolution
#    detect:
#      width: 1280
#      height: 800
    review:
      alerts:
        required_zones:
          - zone_west_camera_01

    zones:
      zone_west_camera_01:
        coordinates: 0, 0, 0, 100, 100, 100, 100, 0


  south-camera-01:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
#        - path: rtsp://192.168.C.D
#        - path: srsp://192.168.C.D:18862/Streaming/channels/101
#        - path: rtsp://192.168.C.D:10554/Streaming/channels/101
#        - path: rtsp://frigate:[email protected]:8860/Streaming/channels/101
          #  - detect

        - path: rtsp://127.0.0.1:8554/south-camera-01
          input_args: preset-rtsp-restream
          roles:
            - record
#            - rtmp
        #- path: srtp://frigate:[email protected]:18868/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:8866/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:554/Streaming/Channels/102
        - path: 
            rtsp://frigate:PASSWORD@[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0021]:554/Streaming/Channels/102
          roles:
            - detect

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
      fps: 5
    objects:
      track:
        - person
        - dog
        - cat
        - car
        - bicycle
    motion: {}
    snapshots:
      enabled: true
#      required_zones:
#        - drive_steps
    record:
      enabled: true
      #events:
      #  retain:
      #    default: 10
    live:
      stream_name: stream-south-camera-01
#      width: # <- optional, by default Frigate tries to automatically detect resolution
#      height: # <- optional, by default Frigate tries to automatically detect resolution
#    detect:
#      width: 1280
#      height: 800
    review:
      alerts:
        required_zones:
          - zone_south_camera_01

    zones:
      zone_south_camera_01:
        coordinates: 0, 0, 0, 100, 100, 100, 100, 0


  east-camera-01:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
#        - path: rtsp://192.168.C.D
#        - path: srsp://192.168.C.D:18862/Streaming/channels/101
#        - path: rtsp://192.168.C.D:10554/Streaming/channels/101
#        - path: rtsp://frigate:[email protected]:8860/Streaming/channels/101
          #  - detect

        - path: rtsp://127.0.0.1:8554/east-camera-01
          input_args: preset-rtsp-restream
          roles:
            - record
#            - rtmp
        #- path: srtp://frigate:[email protected]:18868/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:8866/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:554/Streaming/Channels/102
        - path: 
            rtsp://frigate:PASSWORD@[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0031]:554/Streaming/Channels/102
          roles:
            - detect

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
      fps: 5
    objects:
      track:
        - person
        - dog
        - cat
        - car
        - bicycle
    motion: {}
    snapshots:
      enabled: true
#      required_zones:
#        - drive_steps
    record:
      enabled: true
      #events:
      #  retain:
      #    default: 10
    live:
      stream_name: stream-east-camera-01
#      width: # <- optional, by default Frigate tries to automatically detect resolution
#      height: # <- optional, by default Frigate tries to automatically detect resolution
#    detect:
#      width: 1280
#      height: 800
    review:
      alerts:
        required_zones:
          - zone_east_camera_01

    zones:
      zone_east_camera_01:
        coordinates: 0, 0, 0, 100, 100, 100, 100, 0

  north-camera-01:
    ffmpeg:
      hwaccel_args: preset-vaapi
      inputs:
#        - path: rtsp://192.168.C.D
#        - path: srsp://192.168.C.D:18862/Streaming/channels/101
#        - path: rtsp://192.168.C.D:10554/Streaming/channels/101
#        - path: rtsp://frigate:[email protected]:8860/Streaming/channels/101
          #  - detect

        - path: rtsp://127.0.0.1:8554/north-camera-01
          input_args: preset-rtsp-restream
          roles:
            - record
#            - rtmp
        #- path: srtp://frigate:[email protected]:18868/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:8866/Streaming/Channels/102
        #- path: rtsp://frigate:[email protected]:554/Streaming/Channels/102
        - path: 
            rtsp://frigate:PASSWORD@[2aXX:XXXX:XXXX:ZZZZ:0000:0000:0000:0041]:554/Streaming/Channels/102
          roles:
            - detect

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
#      width: 640 # <---- update for your camera's resolution
#      height: 480 # <---- update for your camera's resolution
      fps: 5
    objects:
      track:
        - person
        - dog
        - cat
        - car
        - bicycle
    motion:
      mask: 0,0.051,1,0.185,1,0,0,0
    snapshots:
      enabled: true
#      required_zones:
#        - drive_steps
    record:
      enabled: true
      #events:
      #  retain:
      #    default: 10
    live:
      stream_name: stream-north-camera-01
#      width: # <- optional, by default Frigate tries to automatically detect resolution
#      height: # <- optional, by default Frigate tries to automatically detect resolution
#    detect:
#      width: 1280
#      height: 800
    review:
      alerts:
        required_zones:
          - zone_north_camera_01

    zones:
      zone_north_camera_01:
        coordinates: 0, 0, 0, 100, 100, 100, 100, 0



# Detectors Configuration
detectors:
#  coral1:
#    type: edgetpu
#    device: pci
#  cpu1:
#    type: cpu
#    num_threads: 4
#  ov:
#    type: openvino
#    device: AUTO
#  ov:
#    type: openvino
#    device: CPU
#  ov:
#    type: openvino
#    device: GPU
  hailo0:
    type: hailo8l
    device: PCIe
    model:
      path: /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef
  hailo1:
    type: hailo8l
    device: PCIe
    model:
      path: /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef
  hailo2:
    type: hailo8l
    device: PCIe
    model:
      path: /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef

# Hailo-8L Model
model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  model_type: ssd

# Generic OpenVino Model
#model:
#  width: 300
#  height: 300
#  input_tensor: nhwc
#  input_pixel_format: bgr
#  path: /openvino-model/ssdlite_mobilenet_v2.xml
#  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

# Global Settings
review:
  alerts:
    required_zones: []


# Version Information
version: 0.15-0

Relevant Frigate log output

2024-12-09 10:00:29.982781357  [INFO] Preparing Frigate...
2024-12-09 10:00:30.014307178  [INFO] Starting Frigate...
2024-12-09 10:00:33.073524484  [2024-12-09 10:00:33] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-12-09 10:00:33.133981789  [2024-12-09 10:00:33] frigate.util.config            INFO    : frigate config does not need migration...
2024-12-09 10:00:34.323306454  [2024-12-09 10:00:34] frigate.util.services          INFO    : Automatically detected vaapi hwaccel for video decoding
2024-12-09 10:00:48.987589393  [2024-12-09 10:00:48] frigate.config.config          WARNING : Customizing more than a detector model path is unsupported.
2024-12-09 10:00:49.009908894  [2024-12-09 10:00:49] frigate.config.config          WARNING : Customizing more than a detector model path is unsupported.
2024-12-09 10:00:49.030184416  [2024-12-09 10:00:49] frigate.config.config          WARNING : Customizing more than a detector model path is unsupported.
2024-12-09 10:00:49.048712651  [2024-12-09 10:00:49] frigate.app                    INFO    : Starting Frigate (0.15.0-833cdcb)
2024-12-09 10:00:49.068875372  [2024-12-09 10:00:49] peewee_migrate.logs            INFO    : Starting migrations
2024-12-09 10:00:49.069170745  [2024-12-09 10:00:49] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-12-09 10:00:49.091957502  [2024-12-09 10:00:49] frigate.app                    INFO    : Recording process started: 477
2024-12-09 10:00:49.092277549  [2024-12-09 10:00:49] frigate.app                    INFO    : Review process started: 479
2024-12-09 10:00:49.095202579  [2024-12-09 10:00:49] frigate.app                    INFO    : go2rtc process pid: 93
2024-12-09 10:00:49.116766738  [2024-12-09 10:00:49] detector.hailo0                INFO    : Starting detection process: 493
2024-12-09 10:00:49.116862595  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : Initializing Hailo device as PCIe
2024-12-09 10:00:49.254005253  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : A model file already exists at /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef not downloading one.
2024-12-09 10:00:49.261109348  [2024-12-09 10:00:49] detector.hailo2                INFO    : Starting detection process: 497
2024-12-09 10:00:49.306259749  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : Initializing Hailo device as PCIe
2024-12-09 10:00:49.335790196  [2024-12-09 10:00:49] detector.hailo1                INFO    : Starting detection process: 495
2024-12-09 10:00:49.353791513  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : Initializing Hailo device as PCIe
2024-12-09 10:00:49.354132450  [2024-12-09 10:00:49] frigate.app                    INFO    : Output process started: 513
2024-12-09 10:00:49.359099796  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : A model file already exists at /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef not downloading one.
2024-12-09 10:00:49.371915626  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : A model file already exists at /config/model_cache/h8l_cache/ssd_mobilenet_v1.hef not downloading one.
2024-12-09 10:00:49.372398664  [2024-12-09 10:00:49] frigate.app                    INFO    : Camera processor started for garage-camera-01: 534
2024-12-09 10:00:49.372439558  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : Hailo device initialized successfully
2024-12-09 10:00:49.372486463  [2024-12-09 10:00:49] frigate.app                    INFO    : Camera processor started for west-camera-01: 535
2024-12-09 10:00:49.372536961  [2024-12-09 10:00:49] frigate.app                    INFO    : Camera processor started for south-camera-01: 545
2024-12-09 10:00:49.372604053  [2024-12-09 10:00:49] frigate.app                    INFO    : Camera processor started for east-camera-01: 555
2024-12-09 10:00:49.372667427  [2024-12-09 10:00:49] frigate.app                    INFO    : Camera processor started for north-camera-01: 567
2024-12-09 10:00:49.372731733  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : Hailo device initialized successfully
2024-12-09 10:00:49.372785607  [2024-12-09 10:00:49] frigate.app                    INFO    : Capture process started for garage-camera-01: 595
2024-12-09 10:00:49.372831860  [2024-12-09 10:00:49] frigate.app                    INFO    : Capture process started for west-camera-01: 603
2024-12-09 10:00:49.372877096  [2024-12-09 10:00:49] frigate.app                    INFO    : Capture process started for south-camera-01: 611
2024-12-09 10:00:49.372922540  [2024-12-09 10:00:49] frigate.app                    INFO    : Capture process started for east-camera-01: 631
2024-12-09 10:00:49.372975548  [2024-12-09 10:00:49] frigate.app                    INFO    : Capture process started for north-camera-01: 642
2024-12-09 10:00:49.395608581  [2024-12-09 10:00:49] frigate.detectors.plugins.hailo8l INFO    : Hailo device initialized successfully
2024-12-09 10:00:49.556924777  [2024-12-09 10:00:49] frigate.api.fastapi_app        INFO    : Starting FastAPI app
2024-12-09 10:00:49.688923683  [2024-12-09 10:00:49] frigate.api.fastapi_app        INFO    : FastAPI started
2024-12-09 10:00:49.808457325  [2024-12-09 10:00:49] frigate.util.services          ERROR   : Unable to poll intel GPU stats: Failed to initialize PMU! (Permission denied)
2024-12-09 10:00:49.808461054  
2024-12-09 10:00:49.833668265  [2024-12-09 10:00:49] frigate.util.services          ERROR   : Unable to poll intel GPU stats: Failed to initialize PMU! (Permission denied)
2024-12-09 10:00:49.833673346

Relevant go2rtc log output

2024-12-09 10:00:29.979671452  [INFO] Preparing new go2rtc config...
2024-12-09 10:00:30.587723039  [INFO] Starting go2rtc...
2024-12-09 10:00:30.685853115  10:00:30.685 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-12-09 10:00:30.685868688  10:00:30.685 INF config path=/dev/shm/go2rtc.yaml
2024-12-09 10:00:30.686500358  10:00:30.686 INF [api] listen addr=:1984
2024-12-09 10:00:30.686760649  10:00:30.686 INF [rtsp] listen addr=:8554
2024-12-09 10:00:30.687069896  10:00:30.687 INF [webrtc] listen addr=:8555/tcp
2024-12-09 10:00:39.982834821  [INFO] Starting go2rtc healthcheck service...

Frigate stats

No response

Operating system

Proxmox

Install method

Docker Compose

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate-caddy:
    image: caddy:latest
    pull_policy: "missing"
    container_name: frigate-caddy
    restart: "unless-stopped"
    env_file:
      - ".env"
    security_opt:
      - no-new-privileges=true
    # Ports Section (DISABLE if using the Pasta Extended Line)
    ports:
      # IPv6 Addresses
      - target: 80
        host_ip: "[${APPLICATION_IPV6_ADDRESS}]"
        published: 80
        protocol: tcp
      - target: 443
        host_ip: "[${APPLICATION_IPV6_ADDRESS}]"
        published: 443
        protocol: tcp
      - target: 443
        host_ip: "[${APPLICATION_IPV6_ADDRESS}]"
        published: 443
        protocol: udp
      # IPv4 Addresses
      - target: 80
        host_ip: "${APPLICATION_IPV4_ADDRESS}"
        published: 80
        protocol: tcp
      - target: 443
        host_ip: "${APPLICATION_IPV4_ADDRESS}"
        published: 443
        protocol: tcp
      - target: 443
        host_ip: "${APPLICATION_IPV4_ADDRESS}"
        published: 443
        protocol: udp
    # Pasta Minimal Line (ENABLE the Normal Ports Section above if using this Method)
    network_mode: "pasta"
    # Pasta Extended Line (DISABLE the Normal Ports Section above if using this Method)
    #network_mode: "pasta:--ipv6-only,-t,${APPLICATION_IPV6_ADDRESS}/80,-t,${APPLICATION_IPV6_ADDRESS}/443,-u,${APPLICATION_IPV6_ADDRESS}/443"
    volumes:
      - ./Caddyfile:/etc/caddy/Caddyfile:ro,z
      - ~/containers/data/frigate-caddy:/data:rw,z
      - ~/containers/log/frigate-caddy:/var/log:rw,z
      - ~/containers/config/frigate-caddy:/config:rw,z
      - ~/containers/certificates/letsencrypt:/certificates:ro,z
    environment:
      - CADDY_DOCKER_CADDYFILE_PATH=/etc/caddy/Caddyfile

  frigate-server:
    container_name: frigate-server
    pull_policy: "missing"
    privileged: true # this may not be necessary for all setups
    restart: "unless-stopped"
    network_mode: "service:frigate-caddy"
    # Stable
    #image: ghcr.io/blakeblackshear/frigate:stable
    # Dev
    image: ghcr.io/blakeblackshear/frigate:833cdcb-h8l
    shm_size: "2048mb" # update for your cameras based on calculation above

    devices:
      - /dev/dri/renderD128:/dev/dri/renderD128
      - /dev/dri/card0:/dev/dri/card0
      - /dev/hailo0:/dev/hailo0
      - /dev/hailo1:/dev/hailo1
      - /dev/hailo2:/dev/hailo2
    volumes:
      - /etc/localtime:/etc/localtime
      - ~/containers/config/frigate-server:/config:rw,z
      - ~/containers/data/frigate-server:/media/frigate:rw,z

      # Force NGINX to use IPv6
      - ~/containers/config/frigate-server/nginx/templates/listen.gotmpl:/usr/local/nginx/templates/listen.gotmpl:ro,z

      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000

    cap_add:
      - CAP_PERFMON
      - SYS_ADMIN
      - CAP_SYS_ADMIN
      - PERFMON

    annotations:
      - run.oci.keep_original_groups=1
    security_opt:
      - no-new-privileges=true
      - label=disable

    environment:
      - FRIGATE_RTSP_PASSWORD="XXXXXXXXXXXXXXXXXXXXXXXXXXXXX"

Object Detector

Other

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

No response

luckylinux · 2024-12-09T19:30:03Z

luckylinux
Dec 9, 2024
Author

Since when I tried to submit this the 1st Time, Github threw an Error that the Body exceeded 65536 Characters (and DELETED everything I filled in the Form - thankfully I always save everything as a TXT file offline before sending 🤣) I need to put this in a separate Message/Comment

Any other information that may be helpful

I had several Issues setting up Frigate in a (unprivileged) LXC Container under Proxmox, with the LXC Container refusing to start completely when I started playing with UID Mappings (which didn't really work anyways).

Thus I installed Podman from source using my own Script and I am running Podman directly on the Proxmox VE Host as an UNPRIVILEGED User (user = podman).

There are mainly 3 Things that are not working well, besides the absolutely bad Detection Accuracy:

Overall I find it always frustrating that the only way to get Frigate working is to copy-paste the same thing over and over again. No matter what I did, it always refused to start whenever I tried to put some Settings on the "Top Level". The Error Messages are quite cryptic and it's not clear at all where Configuration Issues are in the Config File.
Another annoyance is that it's not possible to have both Hailo 8L detector as well as AMD ROCM for GPU Transcoding in the same Image (at least, I couldn't find any): I assume therefore that the Way to go is therefore to have 1 Frigate Container for GO2RTC doing the Transcoding using a rocm Image and another 1 Frigate Container for Object Detection using the h8l Image.
These 10s Clips, which only trigger maybe 10% of the Time (the other 90% of the Motion is not properly getting detected), is just too short and unreliable unfortunately to record the full Event (when it FINALLY managed to trigger the Motion) 😞.

There's probably lots of stuff I copied from the Example Configuration from the Documentation (what is NOT recommended, but given that I couldn't find much else ...).

I hope there is something very obvious and wrong with my Configuration that's relatively easy to fix, because as it is now, the System is even less reliable than the Hikvision object Detection sending an Email 😢.

Thank you for your Insights 🙏.

0 replies

NickM-27 · 2024-12-09T19:44:57Z

NickM-27
Dec 9, 2024
Collaborator Sponsor

the best way to debug detection accuracy is to use the debug live view. This will allow you to watch with bounding and motion boxes to see what Frigate is seeing. You can also screen record this so you can share it with us and we may able able to provide insights to what is going on.

Another annoyance is that it's not possible to have both Hailo 8L detector as well as AMD ROCM for GPU Transcoding in the same Image (at least, I couldn't find any): I assume therefore that the Way to go is therefore to have 1 Frigate Container for GO2RTC doing the Transcoding using a rocm Image and another 1 Frigate Container for Object Detection using the h8l Image.

you seem to be misunderstanding. Transcoding and object detection are two entirely different things. rocm is for object detection. If you just want to do transcoding then you can do that with your AMD GPU in any of the frigate docker images.

15 replies

NickM-27 Dec 10, 2024
Collaborator Sponsor

like I've said multiple times now there is no way to know why something like that happened except to look at the debug live view which will show exactly what Frigate is seeing. In this case, it is clear that your detect fps was too high for the hardware leading to some overloading at times which might explain part of the issue.

You are also using the default COCO models which are not trained on IR cameras (or any security cameras at all), so night detection performance is not as good as a purpose built model that is trained on security camera images

luckylinux Dec 10, 2024
Author

Which Model would you suggest then 😉 ? IIRC I chose that one based on some Issues I found here specifically for the Hailo-8L.

NickM-27 Dec 10, 2024
Collaborator Sponsor

I don't have much experience working with hailo8 models so not sure what options are out there. Some Frigate users say that yolov8 works well but I believe it is still trained on the same COCO dataset

luckylinux Dec 10, 2024
Author

I thought you were using the Hailo-8L yourself though 😮. Alright ...

NickM-27 Dec 10, 2024
Collaborator Sponsor

I have a test frigate instance with the hailo-8 that I use for testing, I do not use it on my primary frigate instance

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Config Support]: Horrible Object Detection Accuracy #15419

{{title}}

Replies: 2 comments 15 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Config Support]: Horrible Object Detection Accuracy #15419

luckylinux Dec 9, 2024

Describe the problem you are having

Version

Frigate config file

Relevant Frigate log output

Relevant go2rtc log output

Frigate stats

Operating system

Install method

docker-compose file or Docker CLI command

Object Detector

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 2 comments · 15 replies

luckylinux Dec 9, 2024 Author

Any other information that may be helpful

NickM-27 Dec 9, 2024 Collaborator Sponsor

NickM-27 Dec 10, 2024 Collaborator Sponsor

luckylinux Dec 10, 2024 Author

NickM-27 Dec 10, 2024 Collaborator Sponsor

luckylinux Dec 10, 2024 Author

NickM-27 Dec 10, 2024 Collaborator Sponsor

luckylinux
Dec 9, 2024

Replies: 2 comments 15 replies

luckylinux
Dec 9, 2024
Author

NickM-27
Dec 9, 2024
Collaborator Sponsor

NickM-27 Dec 10, 2024
Collaborator Sponsor

luckylinux Dec 10, 2024
Author

NickM-27 Dec 10, 2024
Collaborator Sponsor

luckylinux Dec 10, 2024
Author

NickM-27 Dec 10, 2024
Collaborator Sponsor