[Support]: Unable to keep up with recording / Found old frames and other errors #11392
Answered
by
NickM-27
markv9401
asked this question in
General Support
-
Describe the problem you are havingHi, The server is running the newest Proxmox, Frigate is inside an LXC container, running Docker.
LXC specs running Frigate:
The relevant error log ouput is really, really shortened. I have an extremely long, hours long version saved if required. It appears to me that some time it starts "Finding old frames" and then some more and even more and eventually it reaches the "Unable to keep up" state which only gets progressively worse. Please help me debug this & find the culprit as I really do like Frigate (subscribed and using Frigate+) and do want to continue using it but won't be able if it can't keep running indefinitely without errors. Let me know if any further trial & errors, logs or information is required. Version0.13.2-6476f8a Frigate config file# logging settings
logger:
logs:
frigate.record.maintainer: debug
# go2rtc streams - all input streams defined here
go2rtc:
streams:
driveway:
- rtsp://admin:<redactedpw>@<redactedsubnet>101:554/Streaming/Channels/101
driveway_sub:
- rtsp://admin:<redactedpw>@<redactedsubnet>101:554/Streaming/Channels/102
Szabadka_str_side:
- rtsp://admin:<redactedpw>@<redactedsubnet>102:554/Streaming/Channels/101
Szabadka_str_side_sub:
- rtsp://admin:<redactedpw>@<redactedsubnet>102:554/Streaming/Channels/102
Drava_str_side:
- rtsp://admin:<redactedpw>@<redactedsubnet>103:554/Streaming/Channels/101
Drava_str_side_sub:
- rtsp://admin:<redactedpw>@<redactedsubnet>103:554/Streaming/Channels/102
porch:
- rtsp://admin:<redactedpw>@<redactedsubnet>104:554/Streaming/Channels/101
porch_sub:
- rtsp://admin:<redactedpw>@<redactedsubnet>104:554/Streaming/Channels/102
webrtc:
candidates:
- <redactedsubnet>100:8555
- stun:8555
# cameras' definitions - inputs are used from go2rtc
cameras:
driveway:
enabled: true
birdseye:
order: 1
ui:
order: 1
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/driveway
roles: [record]
- path: rtsp://127.0.0.1:8554/driveway
roles: [detect]
motion:
mask:
- 0,70,0,0,369,0,374,69
porch:
enabled: true
birdseye:
order: 2
ui:
order: 2
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/porch
roles: [record]
- path: rtsp://127.0.0.1:8554/porch
roles: [detect]
motion:
mask:
- 0,70,0,0,369,0,374,69
Szabadka_str_side:
enabled: true
birdseye:
order: 3
ui:
order: 3
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/Szabadka_str_side
roles: [record]
- path: rtsp://127.0.0.1:8554/Szabadka_str_side
roles: [detect]
motion:
mask:
- 0,720,475,720,410,522,343,184,334,78,0,79
- 0,72,366,72,369,0,0,0
Drava_str_side:
enabled: true
birdseye:
order: 4
ui:
order: 4
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/Drava_str_side
roles: [record]
- path: rtsp://127.0.0.1:8554/Drava_str_side
roles: [detect]
motion:
mask:
- 837,290,762,720,1280,720,1280,0,844,0
- 0,80,368,73,378,0,0,0
##########################################################################################################################
# AMD iGPU acceleration
ffmpeg:
hwaccel_args: preset-vaapi
# AI Detection type
# Google Coral
detectors:
coral:
type: edgetpu
device: usb
# Frigate+ model
model:
path: plus://<redactedplusmodelhash>
# detection settings
detect:
enabled: true
width: 2560
height: 1440
fps: 5
min_initialized: 5
# Optional: Number of frames without a detection before Frigate considers an object to be gone. (default: 5x the frame rate)
max_disappeared: 50
# Optional: Configuration for stationary object tracking
stationary:
# Optional: Frequency for confirming stationary objects (default: same as threshold)
# When set to 1, object detection will run to confirm the object still exists on every frame.
# If set to 10, object detection will run to confirm the object still exists on every 10th frame.
interval: 100
# Optional: Number of frames without a position change for an object to be considered stationary (default: 10x the frame rate or 10s)
threshold: 100
objects:
track:
- person
- cat
- dog
# Frigate+ recommended settings as per https://docs.frigate.video/plus/first_model/#step-4-adjust-your-object-filters-for-higher-scores
filters:
dog:
min_score: .7
threshold: .9
cat:
min_score: .65
threshold: .8
face:
min_score: .7
package:
min_score: .65
threshold: .9
license_plate:
min_score: .6
amazon:
min_score: .75
ups:
min_score: .75
fedex:
min_score: .75
person:
min_score: .65
threshold: .85
car:
min_score: .65
threshold: .85
# MQTT (for HomeAssistant)
mqtt:
enabled: true
host: <redactedip>
user: frigate
password: <redactedpw>
# Birdseye, live and UI settings
birdseye:
enabled: true
mode: continuous
quality: 1
height: 720
restream: true
live:
height: 1440
quality: 1
ui:
live_mode: mse
# recording settings
record:
enabled: true
# Optional: Number of minutes to wait between cleanup runs (default: shown below)
# This can be used to reduce the frequency of deleting recording segments from disk if you want to minimize i/o
expire_interval: 60
# Optional: Sync recordings with disk on startup and once a day (default: shown below).
sync_recordings: true
# Optional: Retention settings for recording
retain:
# Optional: Number of days to retain recordings regardless of events (default: shown below)
# NOTE: This should be set to 0 and retention should be defined in events section below
# if you only want to retain recordings of events.
days: 7
# Optional: Mode for retention. Available options are: all, motion, and active_objects
# all - save all recording segments regardless of activity
# motion - save all recordings segments with any detected motion
# active_objects - save all recording segments with active/moving objects
# NOTE: this mode only applies when the days setting above is greater than 0
mode: all
# Optional: Recording Export Settings
export:
# Optional: Timelapse Output Args (default: shown below).
# NOTE: The default args are set to fit 24 hours of recording into 1 hour playback.
# See https://stackoverflow.com/a/58268695 for more info on how these args work.
# As an example: if you wanted to go from 24 hours to 30 minutes that would be going
# from 86400 seconds to 1800 seconds which would be 1800 / 86400 = 0.02.
# The -r (framerate) dictates how smooth the output video is.
# So the args would be -vf setpts=0.02*PTS -r 30 in that case.
timelapse_args: -vf setpts=0.0007*PTS -r 30
# Optional: Event recording settings
events:
# Optional: Number of seconds before the event to include (default: shown below)
pre_capture: 5
# Optional: Number of seconds after the event to include (default: shown below)
post_capture: 5
# Optional: Objects to save recordings for. (default: all tracked objects)
#objects:
# - person
# Optional: Restrict recordings to objects that entered any of the listed zones (default: no required zones)
#required_zones: []
# Optional: Retention settings for recordings of events
retain:
# Required: Default retention days (default: shown below)
default: 30
# Optional: Mode for retention. (default: shown below)
# all - save all recording segments for events regardless of activity
# motion - save all recordings segments for events with any detected motion
# active_objects - save all recording segments for event with active/moving objects
#
# NOTE: If the retain mode for the camera is more restrictive than the mode configured
# here, the segments will already be gone by the time this mode is applied.
# For example, if the camera retain mode is "motion", the segments without motion are
# never stored, so setting the mode to "all" here won't bring them back.
mode: all
# Optional: Per object retention days
#objects:
# person: 15
# snapshots config
snapshots:
# Optional: Enable writing jpg snapshot to /media/frigate/clips (default: shown below)
enabled: true
# Optional: save a clean PNG copy of the snapshot image (default: shown below)
clean_copy: true
# Optional: print a timestamp on the snapshots (default: shown below)
timestamp: false
# Optional: draw bounding box on the snapshots (default: shown below)
bounding_box: true
# Optional: crop the snapshot (default: shown below)
crop: false
# Optional: height to resize the snapshot to (default: original size)
#height: 175
# Optional: Restrict snapshots to objects that entered any of the listed zones (default: no required zones)
#required_zones: []
# Optional: Camera override for retention settings (default: global values)
retain:
# Required: Default retention days (default: shown below)
default: 30
# Optional: Per object retention days
#objects:
#person: 15
# Optional: quality of the encoded jpeg, 0-100 (default: shown below)
quality: 100
# telemetry settings
telemetry:
stats:
amd_gpu_stats: true
network_bandwidth: trueRelevant log outputFFprobe output from your cameraffprobe version n5.1-2-g915ef932a3-20220731 Copyright (c) 2007-2022 the FFmpeg developers
built with gcc 12.1.0 (crosstool-NG 1.25.0.55_3defb7b)
configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-libxml2 --enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-lzma --enable-fontconfig --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-libdav1d --enable-libdavs2 --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-mbedtls --enable-librist --enable-libtheora --enable-libvpx --enable-libwebp --enable-lv2 --enable-libmfx --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-ldflags=-pthread --extra-ldexeflags=-pie --extra-libs='-ldl -lgomp' --extra-version=20220731
libavutil 57. 28.100 / 57. 28.100
libavcodec 59. 37.100 / 59. 37.100
libavformat 59. 27.100 / 59. 27.100
libavdevice 59. 7.100 / 59. 7.100
libavfilter 8. 44.100 / 8. 44.100
libswscale 6. 7.100 / 6. 7.100
libswresample 4. 7.100 / 4. 7.100
libpostproc 56. 6.100 / 56. 6.100
[rtsp @ 0x5ef0f0b43140] max delay reached. need to consume packet
[rtsp @ 0x5ef0f0b43140] RTP: missed 65 packets
[h264 @ 0x5ef0f0b480c0] concealing 4514 DC, 4514 AC, 4514 MV errors in I frame
Input #0, rtsp, from 'rtsp://admin:<redacted>@<redacted>.101:554/Streaming/Channels/101':
Metadata:
title : Media Presentation
Duration: N/A, start: 0.050000, bitrate: N/A
Stream #0:0: Video: h264 (High), yuvj420p(pc, bt709, progressive), 2560x1440, 20 fps, 20 tbr, 90k tbnFrigate stats{
"bandwidth_usages": {
"89": {
"bandwidth": 2158.1
}
},
"cameras": {
"Drava_str_side": {
"audio_dBFS": 0,
"audio_rms": 0,
"camera_fps": 5,
"capture_pid": 636,
"detection_enabled": 1,
"detection_fps": 33,
"ffmpeg_pid": 652,
"pid": 619,
"process_fps": 5,
"skipped_fps": 0
},
"Szabadka_str_side": {
"audio_dBFS": 0,
"audio_rms": 0,
"camera_fps": 5,
"capture_pid": 630,
"detection_enabled": 1,
"detection_fps": 33.1,
"ffmpeg_pid": 651,
"pid": 617,
"process_fps": 5,
"skipped_fps": 0
},
"driveway": {
"audio_dBFS": 0,
"audio_rms": 0,
"camera_fps": 5.1,
"capture_pid": 621,
"detection_enabled": 1,
"detection_fps": 1.8,
"ffmpeg_pid": 626,
"pid": 604,
"process_fps": 5,
"skipped_fps": 0
},
"porch": {
"audio_dBFS": 0,
"audio_rms": 0,
"camera_fps": 5,
"capture_pid": 625,
"detection_enabled": 1,
"detection_fps": 5.2,
"ffmpeg_pid": 632,
"pid": 605,
"process_fps": 5,
"skipped_fps": 0
}
},
"cpu_usages": {
"1": {
"cmdline": "/package/admin/s6/command/s6-svscan -d4 -- /run/service",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"15": {
"cmdline": "s6-supervise s6-linux-init-shutdownd",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"18": {
"cmdline": "/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"24": {
"cmdline": "s6-supervise s6rc-fdholder",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"25": {
"cmdline": "s6-supervise go2rtc",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"26": {
"cmdline": "s6-supervise nginx",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"27": {
"cmdline": "s6-supervise s6rc-oneshot-runner",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"28": {
"cmdline": "s6-supervise nginx-log",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"29": {
"cmdline": "s6-supervise frigate",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"30": {
"cmdline": "s6-supervise go2rtc-log",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"31": {
"cmdline": "s6-supervise frigate-log",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"32": {
"cmdline": "s6-supervise go2rtc-healthcheck",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"41": {
"cmdline": "/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"42": {
"cmdline": "/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"80": {
"cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"81": {
"cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"82": {
"cmdline": "s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"89": {
"cmdline": "/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml",
"cpu": "6.8",
"cpu_average": "6",
"mem": "0.1"
},
"97": {
"cmdline": "bash ./run.user go2rtc-healthcheck",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"99": {
"cmdline": "python3 -u -m frigate",
"cpu": "0.9",
"cpu_average": "3",
"mem": "0.4"
},
"119": {
"cmdline": "nginx: master process nginx",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"145": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"146": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"147": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"151": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"160": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"175": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"197": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"220": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"238": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"248": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"251": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"252": {
"cmdline": "nginx: worker process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"253": {
"cmdline": "nginx: cache manager process",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"571": {
"cmdline": "frigate.logger ",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.2"
},
"573": {
"cmdline": "frigate.recording_manager",
"cpu": "1.5",
"cpu_average": "2",
"mem": "0.2"
},
"581": {
"cmdline": "/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(53)",
"cpu": "0.1",
"cpu_average": "0",
"mem": "0.0"
},
"582": {
"cmdline": "frigate.detector.coral",
"cpu": "5.0",
"cpu_average": "5",
"mem": "0.2"
},
"584": {
"cmdline": "frigate.output ",
"cpu": "10.8",
"cpu_average": "10",
"mem": "0.2"
},
"590": {
"cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -f mpegts -s 2560x1440 -codec:v mpeg1video -q 1 -bf 0 pipe:",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"591": {
"cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -f mpegts -s 2560x1440 -codec:v mpeg1video -q 1 -bf 0 pipe:",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"592": {
"cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -f mpegts -s 2560x1440 -codec:v mpeg1video -q 1 -bf 0 pipe:",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"593": {
"cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 2560x1440 -i pipe: -f mpegts -s 2560x1440 -codec:v mpeg1video -q 1 -bf 0 pipe:",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
},
"603": {
"cmdline": "ffmpeg -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -f mpegts -s 1280x720 -codec:v mpeg1video -q 1 -bf 0 pipe:",
"cpu": "2.9",
"cpu_average": "2",
"mem": "0.1"
},
"604": {
"cmdline": "frigate.process:driveway",
"cpu": "2.1",
"cpu_average": "4",
"mem": "0.2"
},
"605": {
"cmdline": "frigate.process:porch",
"cpu": "3.9",
"cpu_average": "5",
"mem": "0.2"
},
"617": {
"cmdline": "frigate.process:Szabadka_str_side",
"cpu": "16.7",
"cpu_average": "18",
"mem": "0.2"
},
"619": {
"cmdline": "frigate.process:Drava_str_side",
"cpu": "19.0",
"cpu_average": "22",
"mem": "0.2"
},
"621": {
"cmdline": "frigate.capture:driveway",
"cpu": "3.2",
"cpu_average": "2",
"mem": "0.2"
},
"625": {
"cmdline": "frigate.capture:porch",
"cpu": "3.1",
"cpu_average": "2",
"mem": "0.2"
},
"626": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/driveway -r 5 -vf fps=5,scale_vaapi=w=2560:h=1440:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
"cpu": "6.3",
"cpu_average": "6",
"mem": "0.2"
},
"630": {
"cmdline": "frigate.capture:Szabadka_str_side",
"cpu": "3.3",
"cpu_average": "2",
"mem": "0.2"
},
"632": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/porch -r 5 -vf fps=5,scale_vaapi=w=2560:h=1440:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
"cpu": "6.3",
"cpu_average": "5",
"mem": "0.2"
},
"636": {
"cmdline": "frigate.capture:Drava_str_side",
"cpu": "2.6",
"cpu_average": "2",
"mem": "0.2"
},
"644": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/driveway -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/driveway@%Y%m%d%H%M%S%z.mp4",
"cpu": "0.4",
"cpu_average": "0",
"mem": "0.0"
},
"651": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Szabadka_str_side -r 5 -vf fps=5,scale_vaapi=w=2560:h=1440:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
"cpu": "5.8",
"cpu_average": "5",
"mem": "0.2"
},
"652": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Drava_str_side -r 5 -vf fps=5,scale_vaapi=w=2560:h=1440:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:",
"cpu": "5.6",
"cpu_average": "5",
"mem": "0.2"
},
"655": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/porch -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/porch@%Y%m%d%H%M%S%z.mp4",
"cpu": "0.5",
"cpu_average": "0",
"mem": "0.0"
},
"658": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Szabadka_str_side -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/Szabadka_str_side@%Y%m%d%H%M%S%z.mp4",
"cpu": "0.4",
"cpu_average": "0",
"mem": "0.0"
},
"659": {
"cmdline": "ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.13.2-6476f8a -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://127.0.0.1:8554/Drava_str_side -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy -an /tmp/cache/Drava_str_side@%Y%m%d%H%M%S%z.mp4",
"cpu": "0.4",
"cpu_average": "0",
"mem": "0.0"
},
"2043": {
"cmdline": "sleep 30s",
"cpu": "0.0",
"cpu_average": "0",
"mem": "0.0"
}
},
"detection_fps": 73.1,
"detectors": {
"coral": {
"detection_start": 1715835707.852672,
"inference_speed": 4.71,
"pid": 582
}
},
"gpu_usages": {
"amd-vaapi": {
"gpu": "5.83%",
"mem": "96.16%"
}
},
"processes": {
"go2rtc": {
"pid": 89
},
"logger": {
"pid": 571
},
"recording": {
"pid": 573
}
},
"service": {
"last_updated": 1715835712,
"latest_version": "0.13.2",
"storage": {
"/dev/shm": {
"free": 487.1,
"mount_type": "tmpfs",
"total": 512,
"used": 24.9
},
"/media/frigate/clips": {
"free": 2936536.9,
"mount_type": "zfs",
"total": 3584000,
"used": 647463.1
},
"/media/frigate/recordings": {
"free": 2936536.9,
"mount_type": "zfs",
"total": 3584000,
"used": 647463.1
},
"/tmp/cache": {
"free": 953.7,
"mount_type": "tmpfs",
"total": 953.7,
"used": 0
}
},
"temperatures": {},
"uptime": 254,
"version": "0.13.2-6476f8a"
}
}Operating systemProxmox Install methodDocker Compose Coral versionUSB Network connectionWired Camera make and model4x Hikvision DS-2CD1043G2-I Any other information that may be helpfulNo response |
Beta Was this translation helpful? Give feedback.
Answered by
NickM-27
May 20, 2024
Replies: 1 comment 19 replies
-
|
What do the logs show when these messages first start appearing? |
Beta Was this translation helpful? Give feedback.
19 replies
-
|
looks like the problem starts with the coral process getting stuck, that reconnects but then the ffmpeg processes are not stable and won't die. All of this points to some type of host instability, you may want to look at |
Beta Was this translation helpful? Give feedback.
-
|
Nothing stands out. I increased the iGPU (that's in use) shared memory, removed the iGPU share from Jellyfin (so now Frigate gets 100% of it, pretty much), downloaded and even newer (few days old bios), reset the fresh bios (I have had some TPU and temperature limits set.. I don't know at this point, really..). Let's see how it goes.. thx |
Beta Was this translation helpful? Give feedback.
-
|
I think I found something very relevant. Could you help me interpret it / suggest what it really means and how to circumvent it? Please see the whole relevant dmesg in this message (the very same "No frames received.. " and then "Unable to keep up.." and freezing up happened the same time, this cannot be a coincidence, especially that it's about the iGPU) |
Beta Was this translation helpful? Give feedback.
-
|
we can see memory issues with the amd gpu, until it fully resets (which makes sense why all of the camera processes get stuck) but it seems it fails. In general this is an issue with hardware / software below frigate in the stack. Difficult to make specific suggestions as none of the maintainers use proxmox. In general this is why we recommend running in docker on bare metal, to avoid so many layers of software that must work together to not have problems. |
Beta Was this translation helpful? Give feedback.
Answer selected by
markv9401
-
|
Well, I mean "bare metal" and "docker" don't really belong in the same sentence imo. As in, soon as you're running a container, namely docker, it should really also mean it doesn't matter at all wherever and whenever you're running it (portable and ephemeral some of the main concepts). |
Beta Was this translation helpful? Give feedback.
-
|
I didn't say running the container on bare metal, I said running docker on bare metal. This of course does make sense, you can run docker on top of a native linux host (bare metal) or you can run docker inside of a proxmox lxc, VM, etc. Whatever docker is running in needs to provide a stable and solid interface for access to the underlying hardware, however many layers deep it goes. |
Beta Was this translation helpful? Give feedback.
-
|
Agreed of course on needing a stable and solid basis and interface but that's not really different than any other production application or environment. What I was trying to say is once you go containerized it really shouldn't be (imho) a recommendation to run it in any specific way other than the stable and solid basis / interface, whatever and wherever it may be. Anway, I did find the solution, will leave it here for anyone encountering something similar: it was the proprietary AMDGPU driver. Don't ever try using that, it's clearly useless and very unstable. Stick to the open source community one! |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
we can see memory issues with the amd gpu, until it fully resets (which makes sense why all of the camera processes get stuck) but it seems it fails. In general this is an issue with hardware / software below frigate in the stack. Difficult to make specific suggestions as none of the maintainers use proxmox.
In general this is why we recommend running in docker on bare metal, to avoid so many layers of software that must work together to not have problems.