Automations with Frigate AI person detection

I am giving away my favorite security camera! But before that, let me show you how to:
Setup Annke NC 400 in Home Assistant, using ONVIF (revisited from my initial review)
Frigate Add-on installation and setup
Setting up Frigate Integration with HACS
Setting up simple automation with Frigate
Advanced automation - finding a clip in the media library and uploading it to an FTP server using a shell command.
And there are plenty of resources:
Frigate Add-on URL: github.com/bla...
Frigate Integration URL: github.com/bla...
Link to Annke cameras for Amazon Prime Day: www.annke.com/...
Link to Annke NightChroma, PoE, and Wireless cameras with 25% discount: www.annke.com/... - use code 9UQCG62U
Annke NC 400 mount 3D model on Thingverse: www.thingivers...

[@honteemin]

#giveaway thank you for the video, will definitely try this add-on!

[@bruxy70]

🎉 Congratulations Andrei, you won the camera!!! 🎉 Send me a message on Instagram or Twitter or send me an email and add your address where I can send it. commentpicker.com/youtube.php?id=ycp_60d10a20e0826990

[@matejfoltyn]

Hi Václave, I can honestly thank you for the rest of us watching your videos for slowing down your explanations and go a little bit more into detail. I'm sure that code is very easy for you but for us noobs it's still hard. This was a huge step up, so don't stop! Děkujeme ;) #giveaway

[@thanasisbethanis]

Lots of Frigate videos out there but this is the first one showing how to copy your clips off the server. Nice! There's also a very clever Frigate blueprint for sending notification on your phone #giveaway

[@wysspatrik3550]

Hi great video thx. But I do not understand motion mask right I guess. Why is the light turned on/off when she was entering. I thought because of the motion mask there will not be detected any movement.

[@czi2011]

thank you very much, you answered many(but not all) of my questions. I will need to follow along in slow motion. I am testing Frigate in combination with Double Take and Exadel Compreface. And my goal is persons not only to detect but to also recognize. If this setup recognizes a match with a known (trained) person I aim to delete the recorded video from Frigate‘s database as well as from the storage space. Let‘s say 5 cameras and 5 family members can create a lot of useless video footage and bring the Virtualbox storage space of my Home Assistant installation to its limits. Subscribed your channel in the hope to get more answers.

[@theshazman]

Wonder what I am missing here. I have Frigate running, it is integrated into Home Assistant but I do not see the entities you have. I don't have an entity for person detect. I have person count, and person occupied. How do I get your "Person started detecting motion" entity?

[@bruxy70]

Did you configure person detection in Frigate?

[@theshazman]

@@bruxy70 It was mqtt.. soon as I checked logs I saw the problem. Once I got mqtt running, and mqtt integration configured in HA everything just worked.

[@harunvanmaurik228]

I’m using the Reolinks as security cameras right now. Also without the useless infrared lights for in the dark unfortunately. Maybe I Will give the Annky a try. Your video was published in my birthday, so the #giveaway would be extra nice! 🥳

[@oscarhormazabal679]

Great tutorial. Thanks mate! I will deploy on my house :)

[@stevez182]

I am playing around with Frigate a couple of weeks now and it is quite impressive . Thanks for sharing the tips regarding the media folder and notifications. Just one note. If you can get a Colar usb accelerator buy one. You can massively unload your CPU with this little inexpensive thing. Mine is working great and I am hosting my HA in a Raspberry Pi #giveaway

[@PWSteald]

Thank you for sharing your HA tips! Person detection takes home security to next level, frigate seems nice. Surprised I'm the first one to comment #giveaway

[@JDAPCPK01]

Ahoj. S automatizací teprve začínám. Hraju si s HA už půl roku a tento kanál je pro mě velkým přínosem. Jsou tu velice užitečná a srozumitelná videa. Děkuji za ně! #giveaway

[@ve2tax]

Thank you for this very informative video!

[@apz9022]

Great video… thank you for sharing!

[@mikemannox4191]

I enjoy the level of detail in your videos - keep them coming, thank you #giveaway

[@TheRealAnthony_real]

Does this work with hikvision ? If yes .. Do I need to basically disconnect these from the NVR ? As for some reason I can't add them in hikvision via onvif ..

[@Matte_olo]

How many cpu frigate will use when recognise people?

[@vaughanza]

Hi Vaclav, thanks for a great video, please could you do a updated video as I don't see clips anymore, thanks, Also why would my events and recoding only be under Media and not visiable on Frigate ? For some reason is not seeing the Media folder, thanks ?

[@GrimSpec]

Great video. I'm using Frigate for a while and I love it. Have you tried out feeding mulicast stream to frigate ?

[@bruxy70]

Not yet!

[@monte8176]

Hi, I have HomeAssistant OS on Raspberry PI4 64bit. I bought Google Coral USB to use it with Frigate. I edited the frigate.yaml file but the images are always captured at 5fps (maximum), I was expecting something more. Do I need to install other libraries? I tried to install TensorFlow but I can't. Can you help me?

[@bruxy70]

5fps is recommended to use for detection, but the clips should be recorded in the fps of the video stream - at least it works for me. Make sure the camera stream is configured for a higher fps. In my case, I use teh low res/low fps substream for detection, and high res high for main stream for clips.

[@monte8176]

@@bruxy70 thank you very much

[@cawolfspirit]

Can you show how to create an automation to restart the frigate if anything wrong in the log. I am not using Google Coral Accelerator, and I have to restart frigate at least once a day to clean the error. thanks. Awesome video.

[@bruxy70]

I am not sure if there is a service for that, since Frigate is Add-on, and not part of the HA core. But You should be able to script the `ha addons restart ccab4aaf_frigate` (or whatever the slug of the addon is) - the same way I did the ftp - but simpler.

[@cawolfspirit]

@@bruxy70 Yes, there is HA service to restart a addon, I've create a schedule job to restart frigate. But just want to create an other automation to monitor the frigate log error to restart frigate, as the frigate watch dog process is not able to catch those errors.

[@vento3232]

if my Frigate is on Ubuntu, and it sends the file already to a network drive, but I want to post the clip to my Telegram bot using CURL, is that possible? the parameters with "{{" I'm assuming it's for HA only? maybe an alternative would be with batch script since the network drive is on a windows machine?

[@bruxy70]

The parameter within {{ }} is a Ninja expression. If the file is accessible via an URL, you can just send that URL I suppose?

[@vento3232]

@@bruxy70 I'll take a look into this. Thanks for the quick response!! Love your videos!

[@MikeCheung]

Thank you for this useful video,but how can I made an automatio to copy or move the clip to /config/www,thx

[@gjurriens]

Nice video. I'm looking to try out Frigate and already bought a Google Coral device for processing. Still need a camera tough... oh, well... maybe I will get one with the Amazon Prime days coming up. Thank you for your time creating this video. #giveaway

[@LuisPeris]

Hi Vaclav, you videos are awesome! specially i like the latest list you did about auotmations. My question is not about this video... I have all the lights automations build with Node-red because of the previous deficiencies of HA automations. Now I would like to begin migrating node-red autoamtions to HA Automations, the first the one that turns on a relay to turn on lights of batthroom when a motion sensor detects presence. What I do is to turn on relay, then wait 60 seconds (delay) and if not other presence is detected I turn off relay; but if detect a presence during this 60 seconds I reset 60 seconds of the delay and start again the 60 seconds. How do I could build something similar with HA automations? Could you make a video about it or just give me a tip? Thanks in advance Vaclav!

[@bruxy70]

I will be making one soon, but about Aquara FP1. And I combine it with door sensor. Anyhow. What you want to do, it look as simple as...if it stops detecting motion for 60 seconds, turn off the lights....

[@LuisPeris]

@@bruxy70 yes, its another point of view, i will focus on that way. Thanks! By the way i have heard about this aqara fp1, difficult to get one in Spain by now. I have Aqara p1 2nd gen and hue Philips motion sensors. Its me or the aqara motion sensors have small open range to detect?

[@bernisworlds]

Q: could it be that Clips is no longer working? I run into an error.

[@Денис-щ7ю6ы]

How to solve these problems? Error while parsing configuration: additional keys not allowed @ data ['cameras'] ['front'] ['objects'] ['trackt']

[@bruxy70]

Fix the typo (trackt vs track)

[@Денис-щ7ю6ы]

@@bruxy70 Super!

[@Денис-щ7ю6ы]

@@bruxy70 New problem - frigate.app WARNING: Camera zaezd has rtmp enabled, but rtmp is not assigned to an input.

[@Денис-щ7ю6ы]

@@bruxy70 ffmpeg.zaezd.clips ERROR : [segment @ 0x55ada50c7840] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly

[@Денис-щ7ю6ы]

@@bruxy70 in VLC RTSP link works

[@osdmontu]

Hello, thanks for your videos, my query is in yml file, do you create the template sensor?

[@bruxy70]

No, I do not have any template sensors for the frigate. The sensors are provided by the integration.

[@osdmontu]

@@bruxy70 I am sorry I wrote it wrong. My question is, in which yml file do you create the sensor?

[@bruxy70]

@@osdmontu It is created by the Frigate Integration, that is added via user interface via Configuiration/Integrations . I do not configure it in any yml file.

[@osdmontu]

@@bruxy70 Excuse me for not understanding well, but what I want to know is where you put this code: template: - trigger: - platform: mqtt topic: frigate/events sensor: - name: "Frigate clip" state: "{{ trigger.payload_json['after']['camera'] }}-{{ trigger.payload_json['after']['id'] }}.mp4 Again, thank you very much for your video, it helped me a lot.

[@bruxy70]

@@osdmontu configuration.yaml

[@samuellaguardabalado4850]

Hello! How do you create the frigate_clip sensor? I am unable to get it.

[@bruxy70]

It is ceated by the Frigate integration. I do not create any additional sensors

[@samuellaguardabalado4850]

@@bruxy70 I don't have that sensor. I don't know what happen.

[@ricksdunnn]

is there a strategy for using Frigate as detector and NVR with enough storage to be a useable NVR??

[@bruxy70]

You can use both in paralel. I have the cameras also connected to Synology that serves as NVR. The video quality is good, and it has got a calendar with a timeline to search for videos. And you can watch more video streams that happened at the same time. But If you have more cameras, you have to buy extra license. And it records every movement, regardless of the AI. Then, I have HA on NUC, with 1TB SSD. It was cheap, so I have got more storage I need, but when I got Frigate later, it allowed me to store clips in it. What is nice about that is, it has a video for each event - that is a real person detected. OTOH, if it fails to detect the person, it might miss the video. So I guess it is up to you to create a strategy, based on your needs :)

[@ricksdunnn]

@@bruxy70 thanks for the info... unfortunately I run HassOS as a VM and that limits my disk capacity for storing videos to integrate and use frigate as an NVR. I also use Synology as NVR. Guess I am looking for a modular way to use HassOS VM and a place for Frigate to analyze and be able store video with detection back into HA...

[@michaels7828]

Another great video, Vaclav! I really enjoyed your videos because of perfect level of details and good pace of conveying information. Thank you #giveaway

[@iulianch]

@Vaclav Chaloupka I made the same like in your example but I don't receive the image in the notification on the iphone. Can you please help me? Thank you very much! PS Great video!!!!!!

[@bruxy70]

I do not have an iPhone, so I do not have a set-up to share. Sorry.

[@thorstenth3bug175]

Thanks for the video What kind of PC are you using for HA? I have doubt, that my T620 might be to slow to react and turn on a light that quick

[@bruxy70]

It is Intel NUC. But I think the Coral AI USB card does most of the job. And yes, I was lucky to buy it when it was available.

[@bliblablo22]

Very very well explained!!! Would it make sense to run frigate on e.g. a NAS and integrate that into HA…? My HA runs on a Raspberry, so I guess reducing io on the sd card would be good?!? Oh… and of course #giveaway 🤓

[@drpainnuk3d]

Great vid thanks!

[@arnowaldus]

Thanks for this excellent tutorial. I'm using the coral USB accelerator together with my Hikbision camera. The night mode (infrared) is pretty useless in my case. Thanks for bringing up this good alternative! #giveaway

[@loyd1432]

Neplánujete videa i v CZ pro českou komunitu?

[@bruxy70]

Neplanuji. Zkousel jsem to, na to jak je to specificka problematika, je tu na to malo lidi (a ja to delam pro lidi, jinak mam problem se motivivat na tom travit cas).

[@loyd1432]

@@bruxy70 Dobře. To docela chápu. V ČR většina lidí ani o domácí automatizaci neuvažuje. Pro mě je ta výhoda že já ano a aj umím 😀. Díky za odpověď.

[@FeriBeke]

Thanks for another great HA video! Dakujem! Len tak dalej :) #giveaway

[@Petersoniq]

Thanks Vaclav. Good idea to improve home security. #giveaway

[@stephendorrity]

Iv been using frigate for a couple of weeks now, I'm loving it. Great video. Would love to see something on openpose. #giveaway

[@matejkotnik9675]

#giveaway Awesome video Vaslav! Even though i am a seasoned OpenHab user your automations brought my exitement for HomeAsiatant again.

[@ArjenSterenborg]

Another great video Vaclav! Really enjoyed it and I want to start with security camera's around my house. Thank you #giveaway

[@JonatanCastro-secondary]

Wondering if it's possible to improve the speed by using a faster CPU/GPU? #giveaway

[@richardhlavna]

Skvelé video. Nad Coralom ste nerozmyslali?

[@bruxy70]

Jasně že mám :) Dnes ho ale prý není lehké sehnat

[@richardhlavna]

@@bruxy70 ved práve to, že ho neviem zohnat.

[@richardhlavna]

@@bruxy70 dnes sa neda zohnat vobec.

[@jonaslewin]

Super helpful, also with your github project. Thank you so much for sharing. #giveaway

[@sahni73]

Thanks for this video tutorial. I'll try to use Frigate with my Reolink RLC-510WA camera. For that it would be fantastic if you can make the code snippets available in the description for easy copy and paste. #giveaway

[@michalbarton1572]

Does Frigate works with reolink as well? #giveaway

[@bruxy70]

If you can integrate the camera to HA (and if it has low-res substream), then yes. Most cameras do.

[@nodinosaur]

Really enjoy your tutorials, very nice integrations & automations. #giveaway

[@theogriffioen3890]

Thank you for your Home Assistant tutorials. #giveaway

[@brian.hanifin]

#giveaway I appreciate the technical detail you included in your videos.

[@JDAPCPK01]

Díky za výborné video. Nezkoušel jste u této kamery zprovoznit ve frigate.yml HW akceleraci pomocí hwaccel_args: ? Pokud ano a jede vám to, má to vliv na vytížení procesoru u RPi?

[@bruxy70]

Nezkousel. Navic nemam RPi. A pouzivam Google Coral TPU (a vim ze dnes se uz neda sehnat).

[@JDAPCPK01]

@@bruxy70 Coral mám také. Na různých fórech jsem se dočetl, že HW akcelerace videa významně sníží zátěž procesoru RPi a pak funguje Coral ještě lépe. Může pak zpracovávat i vyšší rozlišení. Nárůst výkonu Coralu se má poznat snížením jeho hodnoty inference speed, pokud jsem to pochopil správně.

[@irtibatkisileri222]

Thanks for this good tutorial. I wish I'd knew this channel before. #givefaraway :)

[@RichardvanderVen]

I enjoyed your video on Frigate with HA. I recognize the overrated IR light during the night. Would be nice to test the night color mode #giveaway

[@ziiluduz]

With Dahua cameras, I have the on-camera AI detection events available in HA. But Frigate could be better, will have to check it out. #giveaway

[@michalduda4674]

Keeping my fingers crossed. 😜 #giveaway

[@grbansen]

Love your videos always clear and concise. Thanks. #giveaway

[@philippelejeune8586]

#giveaway Great tutorial like all the others. Continue and take care, Philippe

[@romd87]

Super video, len tak dalej 🙂 #giveaway

[@vojtechforman134]

#giveaway Time to add security cameras to my HA, thanks for nice how to.

[@marcelachternaam9249]

Very nice video! Just what I was looking for! #giveaway

[@akitoueu]

Thank you for another amazing share!! #giveaway

[@wilddiode]

Thanks mate, another great video! #giveaway

[@vkoloss]

Frigate is very promising but still under active development in the beginning. You may also consider Shinobi, which capable of MQTT as well and ... well and also lacks things as of now... Which limits of the only stable option - Blue Iris, which is soooo windows-oriented, I am sick of. Using Frigate tight now, LOL. #giveaway

[@jreid90]

#giveaway Great video. Well explained. Will have to experiment with it myself.

[@kripny]

My favourite home assistant youtube nerd :-). #giveaway

[@EdgardMello]

#giveaway Great video. Liked the FTP idea.

[@pauliusk855]

your automations are creative :) keep on sharing. #giveaway

[@mumus8311]

Thanks for these great HA videos. #giveaway

#giveaway Super content. Tesim sa ked si zacnem setupovat svoj smarthome.

[@rutgerkoebrugge2067]

Again an awesome video. Hope to win this camera so I can start playing with it :-D #giveaway

[@hshah1903]

Excellent work on this one. please help prepare more videos and information on H.A #giveaway

[@dieterberckmans2936]

can we use the coral.aiaccelerator with frigat ? #giveaway

[@bruxy70]

Definitely. I got one myself, but did not use it in the video to make it more general.

[@jeanalbrecq8460]

Best home assistant channel #giveaway

[@rostislavkandilarov7649]

Great tutorial, Vaclav! #giveaway

[@1binlids]

Fantastic video, very informative #giveaway

[@ciprian-nedelcu]

Very nice video, thanks! #giveaway

[@costenalolek973]

#giveaway nice vid like always... but light came up, when Your daughter were in masked zone ;-)

[@bruxy70]

Yes, it did come up earlier than I expected. But it is what happened, i did not cheat :)

[@costenalolek973]

@@bruxy70 I didn't even suspect it for a moment. ;-) But this puts the credibility of the solution into question a bit.

#giveaway Thanks for another helpful home automation video!

[@MrGracias70]

#giveaway skvělá videa!

[@krzysztofpliszka79]

Check frigate speed after using coral, works much faster #giveaway

[@s9550110]

#giveaway great video thank you for your detailed instructions ;-)

[@CristiCojita]

Great content, as usual! :) #giveaway

[@Amor1Alus]

#giveaway great video, as always.

[@SteveODNL]

#giveaway Great video as always!

[@Drogfild]

#giveaway and thanks for good video!

[@CampanFlaviu]

great tutorial! #giveaway

[@mariusz1358]

Great video mate! #giveaway

[@antoninnosek5637]

#giveaway díky za skvělé video

[@jparkan]

#giveaway I would like to use better camera instead of rpi camera.

[@NoRzYeah]

helpful video thanks. #giveaway

[@galeforce1745]

Great video as usual, #giveaway

[@aaryanpour]

#giveaway and thank you!

[@markgrootobbink9340]

Great video! #giveaway

[@GungleJeorge]

Nice! #giveaway

[@martinsestak836]

Great video. #giveaway

[@dartfrogdk]

i want to do the frigate detection #giveaway

[@jjiikkrraa]

Hi. Nice video. Congrats. #giveaway Jirka

[@AsafMatan]

#giveaway thanks!

[@MegaSpoz]

#giveaway great video :D

[@eduardoalmontemieses4842]

#giveaway !!!

[@sdasda72]

#giveaway

[@TheGuru56]

Thank you for a great video! #giveaway