Rebuilding the Frigate UI for 0.14 #11136
Replies: 169 comments 681 replies
-
This is awesome! |
Beta Was this translation helpful? Give feedback.
-
Amazing work! Looking forward to this. 👏🏼 |
Beta Was this translation helpful? Give feedback.
-
Oh man, I can't wait to jump on that beta! I'm excited about the alerts function and scrubbing!! Outstanding work guys! Edit: When you say you plan to release the beta soon... you mean like in a few hours, right? lol |
Beta Was this translation helpful? Give feedback.
-
Awesome stuff, really looking forward to it!
? |
Beta Was this translation helpful? Give feedback.
-
looks very promising. Will there be a version optimized for mobile devices? |
Beta Was this translation helpful? Give feedback.
-
Looks very impressive and looking forward to the beta. It looks like your revenue from Frigate+ was well spent and I will gladly support you with this effort... I am one of those that completely dumped my proprietary NVR system and adopted Frigate. |
Beta Was this translation helpful? Give feedback.
-
When I saw the title I thought "oh they are finally making it possible for non-experts to configure Frigate. Maybe I will never have to type 'nano config.yml' again because I entered one wrong character and now Frigate won't start". |
Beta Was this translation helpful? Give feedback.
-
No, the answer is obviously that Frigate is difficult to configure properly and not well documented. Let me be clear that this is NOT a complaint. I'm just stating my opinion that a camera viewing GUI is low-priority compared to a configuration UI. That's it. |
Beta Was this translation helpful? Give feedback.
-
This is awesome to see, we might fully drop Blue Iris when this launches if it solves all of our needs |
Beta Was this translation helpful? Give feedback.
-
I did that nearly two years ago. |
Beta Was this translation helpful? Give feedback.
-
I have been checking in on progress/using a dev build every few weeks the past few weeks and I was always wondering/waiting for the Debug view for the camera I just started using the latest dev build and wow, you guys have done a great job! I was blind and missing the Settings page and it is really great! Nice work, especially @hawkeye217 and @NickM-27, I know you guys have been busy! |
Beta Was this translation helpful? Give feedback.
-
Great job. That looks amazing so far. Are there any configuration changes that need to be made before switching from v0.13 to 0.14 dev? |
Beta Was this translation helpful? Give feedback.
-
This looks awesome. I would like to see a password protected UI just to keep people from casually getting into the config or camera feed. |
Beta Was this translation helpful? Give feedback.
-
With the Home Assistant/MQTT Integration, will there be different events published for an "alert" as opposed to a "detection" and "motion" events? |
Beta Was this translation helpful? Give feedback.
-
Firstly thanks so much for being constantly active here and listening to your needs. I guess I will have to eat the dog shit like I promised! lol. One thing: I absolutely love that I can scroll through the timeline and see all the events from all the cameras in sync. But what I really, really need (since I don't use events) is a timeline with a playhead where I can set the playhead at a specific place on the timeline and ALL the cameras will sync up to that specific point, then I want to press Play All and see all the cameras play in sync together. Please please please please I beg you to implement this. As I explained in a previous post, I live in Europe and it's very common to live in townhouses where your doorstep is level with the sidewalk and just have a meter of distance between your front porch and the sidewalk, with people walking by the detections are moot because an urban neighborhood of townhouses will see hundreds of people walking past the door every day just to go to work etc. So as you can imagine, in situations like that when the timeline is saturated with motion events that are merely people walking past the camera, it becomes totally irrelevant and the relevancy is more about being able to quickly play all sources in sync and without stuttering. One thing I suffer with is the stuttering when the player moves from one 10s segment to another. Every time it moves from segment A to segment B to segment C and so on, I get a half-second stutter. The more you increase the playback scale, the more stuttering. It's like a buffering effect. And if you play at 16x kiss bye bye to your sanity! As you will see is incessant stuttering as the player cannot move to the next segment seamlessly. Please for the love of almighty Jesus Christ address this major issue. It's during playback/review that any NVR shines... All NVRs can record, indeed my cameras will happily let me throw all the raw footage into a simple NFS mount. But it is the reviewing itself to find the crucial moments that makes a NVR special. I know you guys focus on detections but seriously your NVR can't be touched in terms of development speed and I sincerely hope you listen to my plight and do it 🙏🏻 God bless. PS. I was just thinking I forgot to mention how exporting easily is equally as important as finding the relevant event in question. Currently I have to use dropdowns to select camera, whether it's live or a timelapse, and then use date/time fields. I wish I could quickly use a timeline to set in/out points just like I can do in a video editing app... put the start handle at the beginning of where I want to export and the finish handle at the end of my export, then select cameras with checkboxes, click "export" and job done, the visual timeline would help a lot. But for those who want to still be exact please include a button to "enter date and time". |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
I've been on I'll probably revert back tomorrow morning (which is a shame as the UI is so much better!) but I thought I'd highlight it incase anyone has a solution before then. |
Beta Was this translation helpful? Give feedback.
-
Can someone confirm that the only way to see snapshots in 0.14, with some kind of date / camera filtering, is through the Media Explorer in HA? I don't see them in Review, only in Frigate+ view, and only if they were not categorized for false positive / negative. Snapshots are a nice way to save a lot of disk space with the ability to check for events longer in the past. Often, the video is not needed if you just want to check if a specific car was here, or the images of the persons who entered the building few days ago. They would still have their place in Review IMHO. |
Beta Was this translation helpful? Give feedback.
-
I'm on beta2 since 2 days and the new UI is great, even if bringing new "workflows". 3 questions to date :
Thanks ! |
Beta Was this translation helpful? Give feedback.
-
Really enjoying version 0.14...thanks for your work on this. I have a question about the UX of the Review screen. Currently you scroll the timeline, then click on timeframe you're interested and the preview grid is scrolled to match where you have clicked. Why not have the preview grid update as you are scrolling? With more than one screen's worth of alerts/detections, you have to scroll the timeline blindly (or hover and look at thumbnails) until you click to update the grid and see the snapshots for those different times. Could auto-scrolling be added in a future version? |
Beta Was this translation helpful? Give feedback.
-
Fair question. My desktop mouse doesn't have a scroll feature (the market for left-handed mice is small and lacks many options). Without scroll capability, I have to use the browser scroll bar, and that doesn't function the same as scrolling directly. |
Beta Was this translation helpful? Give feedback.
-
When using the history view and scrubbing through the timeline it's great to be able to see what is happening on each camera in sync with time - this is a super cool new feature. Is there a way to control which cameras apply to this? I ask because I have more cameras that comfortably fit on the screen. Ideally I would be able to select one of my already defined groups of cameras and scrub the video in sync for that group. In my case I have "outside" cameras and "inside" cameras. When reviewing events outside, I don't need to see the synchronized video from the inside cameras. It would be great if I could select the camera I want to review the timeline history for, and then chose a group that contains the camera (or chose the group then the camera). In this mode I would like to see the video from just the other cameras in the selected group be synchronized as I move through time. |
Beta Was this translation helpful? Give feedback.
-
Little bug: When I use the editor to reorganize my camera group view, if I forget to close it and switch to a different camera group view, it keeps the X instead of switching back to the icons, and nothing is draggable until you press the X and hit the edit button again |
Beta Was this translation helpful? Give feedback.
-
Not sure if I missed this, but I can't find a way to see any sub labels set in events ? |
Beta Was this translation helpful? Give feedback.
-
Unsure if need an updated FrigateProxy as on V1.5. However On an Apple iPad When using Review page launched via frigate within Home Assistant the clips only show 1st image and do not play. (Live mode is fine) When using review on iPad through safari http://192.168.60.69:8123/ccab4aaf_frigate-proxy/ingress then everything is fine. Is there a setting within Home Assistant or Frigate Proxy? |
Beta Was this translation helpful? Give feedback.
-
In Frigate+ view, rounding fails from time to time in the score picker. |
Beta Was this translation helpful? Give feedback.
-
On the review page, when I want to change the object filter, it only shows the currently enabled object(s), "All labels" and those that also appear in that set of events, but not the rest of labels. I assume this is due to the selection being narrowed down only to what is currently filtered.. I can't decide if that's logical or if it just adds an extra step to selecting a different label (that is not included in the current selection). |
Beta Was this translation helpful? Give feedback.
-
I am noticing there are events in the detection section showing "people" or "dog" and the video clearly isn't a person or a dog but there is no corresponding Frigate+ still image showing the bounding box for me to flag it as NOT what it detected it as according to the event side. This isn't ALWAYS the case but in some rare cases I have a detection level event but no corresponding still image to send to Frigate+ to train. I know from the video still image in the detection event section where the area was that was misclassified but if I use the new feature to send an image to Frigate+ I can ONLY mark it as a "good" if mark out the box and declare the label and can't tell Frigate+ this isn't X. |
Beta Was this translation helpful? Give feedback.
-
Is there a way to, or plans to implement, saving top menu bar selections like camera group or Review (Alerts/Detections/Motion) selections to bookmark them? The URL for the web GUI does reflect these selections, so I'm only able to bookmark the Live, Review, Export, and Frigate+ options from the left side menu and not anything from the top bar. My main use case is bookmarking a camera group for Motion review for my wife, but also so it doesn't take me so many clicks to get to a few frequently-visited views. I searched but couldn't find this mentioned anywhere; though I'm sure it's been addressed. Somewhat related, I've noticed I cannot exclude manually triggered events (via HTTP POST api/events) using the config option |
Beta Was this translation helpful? Give feedback.
-
Little UI bug I think: When in Frigate+ tab, when sorting descending snapshots show fine. But when sorting ascending (in both date or score) it tries to load but nothing shows up. It works fine when manually selecting a single camera though, so might be related to the amount of results? |
Beta Was this translation helpful? Give feedback.
-
TLDR: We have completely overhauled the UI for Frigate to focus on specific common user goals. It’s a big change and we hope you love it. This is just where we started, and the new UI isn’t entirely at feature parity with the current release yet.
Updated Documentation
Guided Demo of new UI
We plan to release the first beta soon.
Background
Frigate started as a stateless object detection pipeline for live video fees with information relayed over MQTT to be used in Home Assistant. Initially, I had no intention of building a UI for it. HomeAssistant was the UI. After a few years of releases in January 2021, a community contribution with a basic web UI was made as a part of version 0.8.0. Since then, the UI has always been treated as a basic interface to expose some of the backend information that Frigate was using to detect and track objects. As new features like clips and recordings were added the UI was updated to provide an interface to view them.
A new approach
As Frigate has become more mature, it has evolved from a real time object detection pipeline into an NVR. While it still lacks some of the customization and features from NVR solutions that have existed for longer, many users are migrating from those platforms and using Frigate as their primary NVR solution. However, Frigate’s UI was never designed around specific user goals, nor was any real thought put into the efficiency of accomplishing common tasks.
Frigate+ was created in part to help fund the future development of Frigate. While still in the early phases, the initial revenue from Frigate+ subscriptions created an opportunity to hire outside resources for revamping Frigate’s UI. After looking at various options, I decided to hire Jim Designs.
The Goals
I wanted to design the new UI around specific user goals with the intent to have a UI that allows accomplishing those goals as quickly and efficiently as possible. The following goals are where we started. I expect we will continue to find better ways of accomplishing these goals in the future as well as incorporate additional goals.
What is happening right now and/or what just happened?
The first use case centers around the need to quickly see what is happening or what just happened. Imagine you hear a sound outside, your dog barks, or the doorbell rings and you want to quickly be able to see your cameras.
The new home page for Frigate is intended to be a real time dashboard for your cameras. Recent alerts are represented by animated thumbnails in a filmstrip view above your camera feeds. Your camera images update once per minute when no detectable activity is occurring to conserve bandwidth and resources. As soon as any motion is detected, cameras seamlessly switch to a live stream. In addition, camera groups have been added so you can quickly switch between indoor and outdoor cameras.
Selecting a camera takes you to a new live view where the scroll wheel can be used to zoom in and out.
What happened last night (or the past 24 hours)?
A common use case for security cameras is reviewing last night’s footage for any concerning activity. The first step of that process is checking to see what Frigate detected. In the current UI, this is accomplished by scrolling through your events. Because events are simply low level tracked objects, their time ranges may overlap or still be in progress. This makes it difficult to review a timeline of video without jumping around or watching the same section of video multiple times. If a person walks by with their dog and a car drives by at the same time, you will end up with 3 separate events all with overlapping time ranges. It is difficult to reason about what periods of time you have and haven’t reviewed.
In order to switch to a more timeline oriented review process, we implemented a new area of the app for reviewing video footage. When reviewing, Frigate intelligently identifies parts of your timeline for review by leveraging the underlying data about motion and tracked objects. These time periods are mutually exclusive, so once you have reviewed a portion of the timeline for a camera, it is marked as reviewed.
The other primary focus was on efficiency. We wanted users to be able to review these segments as efficiently as possible. Rather than scrolling through a timeline and trying to align a single point with an indication of activity, we implemented a scrollable grid of thumbnails alongside a timeline. Hovering (or swiping on mobile) over the thumbnails will start a preview playback for the segment inline. You can also grab the progress bar to scrub through the segment.
After watching a segment, it is marked as reviewed.
Lastly, not all segments are created equal. Video of people who enter your property are a different priority than those walking by on the sidewalk. By default, all person and car objects are considered alerts. You can refine what ends up in the alert tab by configuring required zones for your events.
Was anything missed last night?
In the current release, there isn’t a way to see motion activity on a timeline and watch video at that time. The ability to scrub video for things Frigate missed has been one of the most common feature requests.
Within the Motion tab of review, you can now scrub through the timeline for all cameras simultaneously with a timeline showing relative motion activity.
In order to avoid scrubbing over time periods already included in alerts and detections, you can scrub in motion only mode.
Other Notable Improvements
Beta Was this translation helpful? Give feedback.
All reactions