How to Configure Traffic Monitoring with ntopng on pfsense

[@usaevo8]

Tom, you are a super star. My main goto for opensource recommendations and guides. So clear and concise.

[@d00dEEE]

Man, it took me two hours to watch this video! Every time you'd do something, I'd have to check it out on my end, which took me off on a couple of tangents each time. Keep up these great tutorials...

[@YouJustEnvyMe]

Tom, I never really comment, subscribe or like videos but your videos have taught a lot in a very intuitive way and because of that you're one of the few that I do follow. I've learned a lot from your videos ranging from pfSense to the NAS videos you've put out. I'm curious if you could do a video explaining and using TNSR software. As a company we've been considering moving to it, but we simply don't know enough about it yet. Thanks for all you do!

[@EViL3666]

It's been about 10 years since I last played with NTOP, its comes an incredibly long way in that time, I'll definitely have to have another play with it.

[@LAWRENCESYSTEMS]

How To Setup pfsense OpenVPN Policy Routing With Kill Switch Using A Privacy VPN kzbin.info/www/bejne/q521mJiZr5WIqbM Configuring pfsense Firewall Rules For Home kzbin.info/www/bejne/mJvVYaWjbpiojKM Our pfsense tutorials lawrence.technology/pfsense/ Open Source Logging: Getting Started with Graylog Tutorial kzbin.info/www/bejne/qKXJm2mNar1jj6M ⏱ Timestamps ⏱ 00:00 pfsense ntopng 01:22 insatlling and configuring ntopng 03:32 ntopng settings 06:24 ntopng network discovery 07:02 how to use ntopng

[@ryanstrom8866]

You have a strange but very welcome talent for making videos in perfect time with my interest in things. I find cool thing I want to use or want to delve deeper in something and boom you post a video on said thing. I love it

[@grim.reaper]

I have been waiting for this, thank you!! 🤗

[@sawlhung]

You’re amazing man!!

[@Adam-g8s8q]

What an awesome video and overview. Just installing ntopng right now.

[@Noyoustupidfuck]

Huh, I was JUST looking into this functionality yesterday! Perfect timing :o

[@mclogikal]

Tom, thanks for all the info you share with the community. You are the reason I started using pfsense. Anytime I lookup something pfsense related, your videos popup in google search. You've definitely earned me as a sub. Thank you for all the walkthrough videos and clear explainations.

[@karsh001]

I was just looking for a way to get an overview of my network traffic. Lo and behold a Tom Lawrence vid just appeared in my google search! Great vid, thanks!

[@mysticsilent]

Very interesting tooling. Didn't know it existed for pfSense :) thanks again Tom

[@h4X0r99221]

Thanks for the the review! Amazing as always.

[@benricok]

Awesome showcase!

[@realzeti]

Another great video by LS, thank you very much. I have noticed that there is an update to ntopng (v.4.2.0), but it seem it needs to be installed manually; is it possible for you to show us how to do that? Thanks again

[@DavidBrownSC]

I want to know how to disable the popup or how to install it manually.

[@TomZ23]

Tom, Please show us how to update it.

[@00kevin20]

Yup......fairly new to pfSense myself but I'm looking for the answer to that as well!!!

[@Darkk6969]

I ended up creating a VM with NTOP installed so I can keep it updated. Also, since it's a VM I was able to give it plenty of storage for logging.

[@michaeljaques77]

Another banger of a video! Thank you Tom!

[@notta3d]

Great video. Very little out there about this application so this is very useful. Thanks.

[@blazorax]

Thank you so much Tom - help me big time with my pfsense.

[@jeffm2787]

Be aware that ntopng does a lot of disk writes. Just something to consider if using a low end SSD.

[@aot2002]

I believe it now uses redis so that should not be an issue. I'd be concerned about cpu usage though

[@jeffm2787]

@@aot2002 I'm referring to the version that uses redis. I install the latest stable builds as the pfsense version is always way behind. Takes about 5 mins.

[@aot2002]

@@jeffm2787 Gotcha. You could just use a ramdisk which writes to memory. Problem is you lose data on reboot.

[@MatthewHill]

How do you get rid of that super-annoying "A new ntopng stable version (v.4.2.0) is available for download: please upgrade" message that shows up on every page? I see it on mine, too--and I can click the "x" to close it, but it just immediately comes back the next time I click on _anything_ in the interface! I don't really want to mess around with upgrading it manually beyond what's in the plugin repository.

[@sparky46er]

Thanks for another informative video!

[@RyouConcord]

I LOVE your videos. Very informative. Can't wait to install this myself. Hard to believe you guys are Detroiters too!

[@LAWRENCESYSTEMS]

Thanksa and I think we need more tech in Detroit and MI.

[@okoromahchuck4622]

Wonderful, and thank you

[@pageb018]

Tom, how did you update to the 4.x version? I seem to be stuck on 3.x and there doesn't seem to be an update from the available packages in pfsense. I cna manually install and update from cli, but I don't think you had to do that....

[@taiiiiiiiiii]

Great feature! I'm definitely going to try it out. I have a NAC tool that I want to send this type of data to, is it possible to mirror ports to send to my security appliances?

[@Elliot9874]

Thank you for the video. How can I use ntopng to keep track of how much data I have used on my WAN. So my can audit Comcast usage data?

[@DavidBrownSC]

So I see you are running 4.2 but on my 2.5.2 pfsense when I go through packages I get 3.4 can you point in the right direction to allow me to upgrade to 4.2 thank you

[@CampRusso]

Just installed this. Looks awesome so far. I getting the below alert. Should I flip it? =\ This interface is monitoring DHCP hosts. Please consider changing the Local Broadcast Domain Hosts Identifier preference to "MAC Address".

[@thomaskessler4204]

I've seen some folks post that you are able to use the - F switch and have flow data pushed to a ClickHouse or ElasticSearch server. But ntopng docs have an asterisk such functionality is not possible on Debian/pfsense. So I'm wondering which one is correct. What I'm looking to do is aggregate total bytes sent and received by host on my network for longer term historical reporting. I'll go watch your greylog video to see if that's a good option for me. Haven't moved to pfsense yet as I'm trying to see if I can make all this work. Thanks!

[@mind1296]

Great content. How much disk space and memory ntopng needs? How to prevent filling the whole disk? Thx.

[@jonharrison7160]

In pfSense diagnostic, ntopng settings, at bottom of screen there is a 'delete data' choice. Be sure to save settings tho. I find that on my SG-5100 I have out of space issues. I find I have to periodically delete the data and because of this do not leave it running.

[@SteelWolf13]

Once you get PFsence and all the addon installed and setup the way you like it, is there a way to back it up or export the settings?

[@BryanGreffin]

I ran into an issue with the PFsense Ntopng package. PFsense 2.5 community edition on Qotom 4 port Core I3 box. Anytime I clicked on a host it would throw an error message, making it unusable for host specific stats. After some digging I found it is a somewhat known issue that hasn't been patched in the PFsense repo. So I ended up installing Ntopng from the command line/official repo and it's been working fine. This also gets rid of the annoying "update to 2.4" message that keeps popping up.

[@stevecorbin9102]

Can you show host names instead of IP addresses?

[@FrankGraffagnino]

this is interesting. maybe you can help with a suggestion: I'm interested in using something like this with pfsense in order to monitor for when a client is "active" - active meaning it has throughput above some level for a period of time. Basically, something I can hit over an API and then send an MQTT message that Home Assistant can pick up to understand when clients have active network communication going on and thus trigger events on it. If someone sits down and starts using a computer and thus network bandwidth, I could detect that event and trigger automations. Also I could monitor and log what time of day that computer is being used. I'm wondering if the API for ntopng would be good for this and then possibly write an a Home Assistant integration to talk to that API.

[@LAWRENCESYSTEMS]

It has an API

[@scjohnson243]

Love the content so far, Just jumped into this, I feel like something is bogging my network down and I'd love a tool to be able to see how much traffic each device is using (LAN and wifi) - I have a 1 GB pipe and from the router itself I get great speedtests, but when I'm on my network at times I get super slow speeds at the same time. I assume one of my kids is gotone of the devices really hammering away... Would PfSense/ntopng help find where these devices are taking a ton of data? I work from home and sometimes the slowdown is so bad my VPN keeps disconnecting! I assume my kids are downloading/streaming/watching something all at once. :) If this tool does NOT do it, could you recommend one?

[@jumpieva]

can you force resolution or name mapping to hosts?

[@LAWRENCESYSTEMS]

Not sure.

[@hoterychannel]

Any news about when it will be upgraded from 3 to version 4?

[@techguy404]

Is it normal to see "two" connections on the WAN side? I have em1 (LAN) and em0 for my interfaces. em0 for WAN shows my IP to my pfsense box, and a Cisco. I don't have a Cisco connected between pfsense and my cable modem... Unless Arris runs something apart of Cisco... Can it be possible to somehow see my ISP's router? As it gives a MAC address, and it's not my cable modem.

[@LAWRENCESYSTEMS]

You may be seeing something upstream from your ISP.

[@JosephCarl-nu7go]

sir can you make a tutorial on how to reject or block udp and tcp ports in pfsense. thanks

[@LAWRENCESYSTEMS]

Inbound ports are blocked by defualt.

[@oneito947]

how can someone limit the speed of network traffic per ip inside the local network

[@gmenelau]

Does this pass the USG and discover all the network the switches?

[@LAWRENCESYSTEMS]

pfsense is a firewall, I would not use it with the USG

[@gmenelau]

@@LAWRENCESYSTEMS thank for the replay,

[@gmenelau]

@@LAWRENCESYSTEMS thanks for replay

[@bartbatenburg]

Does anyone know if this can show ipv6 vs v4 traffic?

[@ilyaskhan-ek8ik]

how to go back to the previous version of pfsense

[@LAWRENCESYSTEMS]

reload the system

[@SuperLuckykid10]

Why does my ntopng keep making my internet connection disconnect? i can't figure out why it's happening.

[@LAWRENCESYSTEMS]

Maybe your system is too slow to run it

[@SuperLuckykid10]

@LAWRENCESYSTEMS I enabled Active Network Discovery and it kept turning of my internet i reset ntopng and the issue disappeared any idea why it was happening? Is there a port conflict going on? i have the VP2420 - 4x 2.5G Port Intel Celeron J6412 with 1gb fiber internet both up and down the machine does not even struggle using ntopng

[@lolololowbx280]

How about zenarmor?

[@BOSSKARTY]

I just had to spend a few hours troubleshooting this. Active Network Discovery completely fucks up my internet every 15 minutes and I have to reboot my modem.... ugh...

[@crusader8403]

Same issue here, please help me with this.

[@n.l3880]

Why a PIA VPN to Switzerland (my country)? Because it's legal to pirate movies here ;) ? Great Video!

[@LAWRENCESYSTEMS]

I have never been there physically so being there virtually seems like the next best thing!

[@Derbauer]

"..... Different ISO's for different Linux distributions.. " 🤣🤣🤣👍

[@kc0eks]

Be careful with this if you enable it on the lower end netgate devices. It will fill the drive and it will crash pfsense.

[@SlothTechTV]

Lawrence -- I love your videos! Do a similar video on Elastiflow!! :) Elastiflow > ntopng

[@LAWRENCESYSTEMS]

I don't use it so not likely.

[@SlothTechTV]

@@LAWRENCESYSTEMS awwwwwwww I understand. Give it a try it and I bet you won't regret it :) Thanks for the great content, sir.

[@HomeBudgetComputing]

Wow, pfSense installs version 3.4.0 and the latest is v4.2.0 - with no way to upgrade through the panel. Seems odd.

[@j.c.5011]

I'm on 5.0

[@padraics]

When do you guys actually use pfsense? When I worked in a data center that obviously never would have never ever happened and when I worked for msp it would have been a nightmare to manage

[@LAWRENCESYSTEMS]

In data centers & at many businesses.

[@Mikesco3]

Make sure the password is only latin upper and lower-case letters and numbers (no symbols) that threw me off for a bit

[@xFrozenxSnowx]

ntopng killed my SSD with all the writes in a month 😭

[@TechySpeaking]

First

[@bartekr5372]

russia should be pinged with something more than icmp ;)