Fiddler tutorial to help Webscraping & API calls / Monitor the Network traffic

In this Fiddler tutorial, you'll learn how to monitor your network traffic and improve Webscraping and API calls with WinHTTPRequest and XML Requests.
I've used Fiddler in other tutorials but I realized I didn't have a stand-alone walk through of using it. This tutorial is a quick overview of how to monitor your network traffic. This comes in super handy when you're doing things like Webscraping or connecting to APIs.
It can allow you to see what your browser / programs are doing and then you can re-create it in AutoHotkey (and then monitor exactly what your AutoHotkey script is doing to ensure it matches up perfectly.
You can download Fiddler here: www.telerik.com/download/fiddler
Here is a link to using Fiddler to monitor network traffic on my site: the-automator.com/use-fiddler...
If you're new to API calls check out this page: the-automator.com/webservice-...
If you're new to Webscraping check out this page: the-automator.com/web-scrapin...
TLDR: Fiddler is a powerful tool for customizing web requests and analyzing network traffic.
1. 00:00 🔎 Fiddler is a great tool for monitoring traffic and working with APIs.
1.1 Fiddler is a useful tool for working with APIs and replicating requests with Autohotkey.
1.2 Fiddler can be used to monitor traffic and APIs are more stable, faster, and deal with smaller traffic than web browsers.
2. 01:29 🔎 Customize Fiddler to view requests, headers, and responses.
2.1 Customize columns to view different types of requests, headers sent and returned, and response in Fiddler.
3. 02:42 🔍 View raw data, parse strings, and view form data from requests.
3.1 You can view the raw data, parse JSON and XML strings, and view form data returned from a request.
4. 03:32 🔍 Viewed web page headers, cookies, parameters, and methods.
4.1 I loaded a web page and showed how to view the headers, cookies, parameters, and methods.
5. 04:27 🔍 Add a line to the API call and drag the browser to the filter to filter traffic from a specific browser with Autohotkey.
5.1 To filter traffic from a specific browser, drag the browser to the filter and add a line to the API call to view API traffic with Autohotkey.
6. 05:39 🎉 API call successful, returning 200 status code.
6.1 API call was successful, returning a 200 status code.
7. 06:43 🔧 Fiddler is a useful tool for customizing your web experience.
7.1 Fiddler is a helpful tool that allows you to do what you want to do, with a nice balance of complexity.
8. 07:55 🔎 Use Fiddler to view request and response headers and analyze network traffic to determine request methods.
8.1 In Chrome, you can view request and response headers, but Fiddler is more customizable and shows the request method in a column.
8.2 Network traffic can be analyzed using a free tool to determine if a request is a GET or POST.
Summary for • Fiddler tutorial to he... by www.eightify.app

[@JoeGlines-Automator]

Are you *new to AutoHotkey* and want to learn amazing *tips* & *tricks* ? Check this out: www.the-automator.com/Intro

[@jeffersonwillian4144]

Very useful video, thanks for sharing!

[@nidalfikri3445]

Amazing video! Thanks

[@JoeGlines-Automator]

Glad you liked it!

[@Nikronius]

amazing as always, yes!

[@alexanders3482]

Hello! Please, tell me: how to set a breakpoint (catch the request) and how to make a substitution a request in the feedler?

[@JoeGlines-Automator]

Sorry, I don't know any of that.

[@manojaggarwal2880]

Hi dear joe glines... when i open fiddler, it captures no network traffic at all. Please tell do i have to configure fiddler with chrome browser first?

[@JoeGlines-Automator]

It should be capturing all Network traffic from browsers automatically

[@jalaljanami5718]

hi, how can we use this for soap requests? i can capture rest api but not the soap

[@JoeGlines-Automator]

It has been so long since I've done a soap request, I don't recall Having said that I don't remember there being any real difference between the two. Are you sure the traffic did not show up?

[@manojaggarwal2880]

Hello dear Joe Glines... you are really doing great... Please tell, do i have to download fiddler first to use it? if yes, then please provide me link to download it.

[@JoeGlines-Automator]

Yes. you need to download it. I've put the link in the general description. For your convenience here it is: www.telerik.com/download/fiddler

[@billjones3720]

Is Fiddler easier to use with AHK than with Wireshark?

[@JoeGlines-Automator]

For me there is absolutely NO COMPARISON. I've tried multiple times to follow Wireshark and just get lost! If you know a good video for me to watch to learn how to use it, let me know. While I think WireShark might be more powerful, It is so complex that I just get frustrated. So far Fiddler gives me everything I want. It is a little confusing at first, but not too bad. I don't know if you have to set the proxy for Wireshark but that is the only thing in Fiddler you need to remember to add to your script so the AutoHotkey traffic will be tracked.

[@billjones3720]

@@JoeGlines-Automator I couldn't find a tutorial related to AHK and Wireshark, but did find this > kzbin.info/www/bejne/ipymhKVpZbqioK8 and this > kzbin.info/www/bejne/qGHPkGhqqc2Gj7c Hope they help.

[@billjones3720]

@@JoeGlines-Automator Also found this @ autohotkey.com/board/topic/27757-packets-as-triggers/ if it's relevant?

[@fUjiMaNia]

hi is there a trick in using a regex in my custom fiddler script? can't make it to work

[@JoeGlines-Automator]

You're going to have to be more specific than that... I don't know how / where you're trying to use the RegEx

[@gauravuttarkar9682]

How do I change one single word on a website using fiddler?

[@JoeGlines-Automator]

Fiddler just monitors traffic (and allows you submit API calls). It's not something that "changes a website".

[@ich3aa]

Yes it can, in the interceptor tab you can change the response of a api call, I already played with it and works good

[@newalgo8084]

just do that with the inspect element on whatever web browser you are using

[@mustafadenizli6737]

Can we capture videos with this?

[@JoeGlines-Automator]

No, this just shows the traffic, it doesn't "save" it.

[@mustafadenizli6737]

@@JoeGlines-Automator but isnt there a way to save the video data they send?