Tutorial : Google Search Console API🚀using Python🐍 with Google Colab

[@robertodelgado1234]

Mihir, this was by far one of the best tutorials I have ever gone through. It was exactly what I needed to understand how to successfully call the GSC API, which is not at all easy to understand via the GSC documentation.

[@TheMihirNaik]

@@robertodelgado1234 glad you liked it and I very much appreciate you leaving this comment. 🥳

[@Letraslibres07]

You cannot imagine how valuable and insightful this video is, Mihir. Very detailed and a great resource for all the SEOs out there looking to improve their Python knowledge using GSC! Thank you!

[@tafnecristinaferreiracabra2332]

I don't have words to thank you enough for this tutorial. I've been trying to access the GSC API for ages, and I finally succeeded. Thank you!

[@TheMihirNaik]

Glad it helped!

[@NikolayBarbanov]

This is just fantastic! You asked for feedback - just go on! It is perfect for practical use - if I want to implement on the go

[@TheMihirNaik]

Noted. I will focus more on those going forward.

[@oddocid9734]

I come back here to learn more about seo with python and to refresh some ideas. Its good to see your content and in a simple way to explain it. Thanks

[@SreevathsaBV]

Hey @Mihir Naik This is an excellent video and it was worth a wait. Thanks for making it easy to follow. One suggestion is to improve the audio, sometimes it was clear and sometimes it was low (maybe it's just me). I always struggle to know which pages have issues in featured snippets and what from a technical SEO standpoint we can address. Could you make something about this? it would be helpful. Great video again and look forward to the next one. (Subscribed BTW :) )

[@TheMihirNaik]

Thanks, Sreevathsa! I got this feedback from multiple people. I will work on it in the next video.

[@SreevathsaBV]

@@TheMihirNaik Am sure! thanks!

[@trackandgrow]

We need real SEO knowledge and gem like to Mihir thank you for sharing

[@TheMihirNaik]

Thanks 😇

[@filipeschaab9433]

Great video, Mihir. Helped a lot, thanks!

[@jauresstyvekamenihomte3468]

Great! Thank you for this tutorial..... very helpful🙂

[@akarshhere]

in depth! literally spooon fed us! it was fantastic!

[@ARPakistani]

Thanks Mihir, this was really easy to follow video. I am always intimidated by the idea of using python in SEO for data analysis. it will be great if you can show the basics of this tool for data analysis in the beginning as well.

[@TheMihirNaik]

Glad it was helpful! Sure, I will try to cover.

[@AlanPreiti]

Excellent tutorial!

[@mugishajean7923]

Your english is very good brother! and the video is insightful

[@TheMihirNaik]

Glad to hear that!

[@ashwinikumaryadav7172]

Thanks a lot for this video Great work

[@TheMihirNaik]

So nice of you

[@gauravpatil5963]

Superb Video Mihir! Can you explain the bulk request indexing too from Google Colab?

[@TheMihirNaik]

Yes I will cover in upcoming videos.

[@lvlyprem9575]

Excellent tutorial! its Very Helpful, I want to learn Python, please suggest a good course I don't have any coding skills. any best python course for digital marketers?

[@TheMihirNaik]

Thank you! CS50 is a great course to start with. Then you can go deeper into python. cs50.harvard.edu/x/2023/

[@waqashussain7770]

Great video sir keep it up and kindly make video on console auto alerts using python and screaming frog.

[@TheMihirNaik]

Thanks! Can you please share more clearly what are you suggesting?

[@waqashussain7770]

​@@TheMihirNaik sorry i mix up both tasks are different 1st one is i daily received like 100's indexing error and i dont want to click on start validation again 1 by 1. i need automation for it using console api with python. 2nd usage of console and ga4 api with screaming frog for seo audits.

[@oddocid9734]

thanks for sharing this content!

[@dhaundiyalcp]

Thank You. It's going to be really helpful for many of us.

[@TheMihirNaik]

Glad! Please share your feedback or suggestions so I can improve!

[@dhaundiyalcp]

​@@TheMihirNaik Yes sure :)

[@user-pj4vk7bd9u]

Hey Mihir great tutorial. How to do the auth part without opening the popup in browser? I want to get the credentials programatically as the code will be running on server, there I cant open the google popup to generate the authorization code .

[@TheMihirNaik]

Google Search API documentation would be helpful. They have given an example of the flask application where you can see how you can do oauth for the same.

[@user-it1hd8zl6g]

Hello Mihir This video is quite helpful I want tips regarding my queries 1 I have 2 lakhs plus food item names in excel sheet which are not unique Now I want to correct those item names using google search and get data in excel So please suggest me how can I do this using Google APIs 2 Another one is I also want item name recipes from food APIs or any other sources from google How Can I use this method or any other suggested method to get the data from google Please help

[@roxxxxxy]

Man, Thank you very much, it helped a lot 💗

[@TheMihirNaik]

Glad it helped!

[@krutidesai18]

Well done!

[@m.tayyab871]

Thank you for sharing this amazing and value able content. It was very hard for me to understand by Google API documentation but you make possible. May I know how we can export 404 pages by Search Console API?

[@TheMihirNaik]

Thank you! Unfortunately GSC API doesn't allow exporting 404 pages.

[@CharliedeThibault_]

Amazing thank you!

[@TheMihirNaik]

You're very welcome!

[@sardarabdullahkhawar8487]

I want to deploy code in lambda function in AWS to fetch incremental data every day. Do i need to generate auth_code every time i run the code?

[@TheMihirNaik]

In that case, you should refer to the code GSC API have given for Server-side Webapps. That code works with oauth2 authentication architecture and it will give you access token and refresh token. you can keep using refresh token to generate a new access token. This code won't work the best.

[@sardarabdullahkhawar8487]

Thank you, @TheMihirNaik, for your response. This can be achieved by granting full owner access to the email address in Google Search Console from a service account in Google Cloud Platform (GCP).

[@sankarhana7155]

Hi very nice video.. i will say best video for GSC api in python - introduction.. i have one question.. can we filter using metrics like clicks, impression etc.. in search analytics? I understand that filtering using dimensions like page & queries are possible.. i wanted to know about metrics filtering.. thanks in advance

[@TheMihirNaik]

Thanks Sankar. I think this is a great question. It shows you are thinking in valuable direction. Its not possible to filter using metrics in API calls. But you can do that using Pandas. Pandas allow us lot of flexibility that we will explore going forward.

[@sankarhana7155]

@@TheMihirNaik Thank you for your clarification. Looking forward to more videos. Great start and keep rocking

[@fartyman]

Dear Mihir, thank you very much for this video! This data helps me a lot in understanding customer behaviour. Question: is it possible to automate these steps (i.e. runs this script every week automatically). Right now, there is still a manual procedure necessary: copy and pasting the Auth Code.

[@TheMihirNaik]

I think you could automate it for sure, it just needs a different way of authentication. You could check the documentation here for the authentication. developers.google.com/webmaster-tools/v1/how-tos/authorizing I don't mean to sell myself unnecessarily here but I could help you with custom script. www.mihirnaik.com/google-search-console-api-consultant/ The custom script will be a Google Cloud Function(may be). It will autorun or run on a ping, it will scrape the data, transform it to a CSV and you will receive a mail. You can create as many cloud functions as you would like.

[@kirubakaranknagaraj6922]

Thanks Mihr for great videos, I'm following the queries, but getting the following error "SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)", can you help me?

[@TheMihirNaik]

I'm not sure why this issue is coming up. Try to put the code in ChatGPT with this error, it might be able to solve.

[@IqraKhan-p6l]

Sir yi Direct URL kaha sa aya.???

[@lavanyakommana719]

Hey @mihir naik , is there any api through which the search console api is enabled without doing manually

[@TheMihirNaik]

Sorry Lavanya, I'm not sure I'm getting your question.

[@rohitojha7975]

sir, it has been, 1.7 years in SEO, so should I go for python seo, or i should learn GSC and GA completely first

[@TheMihirNaik]

Learning GSC and GA4 first would be helpful.

[@iagainstiification]

When I re-run this script, I will be asked to enter auth code again. I must be a bit confused about how to set this up so that it’s a one time thing.

[@TheMihirNaik]

Google Colab loses the state once the runtime is disconnected. To make it a set and forgot thing, you will have to transform them into a web application and save your credentials in a database. On every request to API, the web app will check if it has active credential in database, and if not it will use refresh token to create new access token.

[@lucianomelofarias]

Great job, Mihir! Do you know if it's possible to use the GSC API to extract the number of indexed pages peer day of a domain?

[@TheMihirNaik]

Yes, I think you could Sitemap API and URL Inspection API to arrive at that number. The only limit is 2000 per day per site in Inspection API. This is just a guess, I will have to confirm.

[@lucianomelofarias]

@@TheMihirNaik I got it. I’ve tried to use the API, but the only information that I’ve got are clicks, CTR and impressions. If you find a way to do that, I will really appreciate.

[@user-rr5sr9yu9d]

Hello Mihir, i get the following error when going to my authorize_url: You can't sign in to this app because it doesn't comply with Google's OAuth 2.0 policy for keeping apps secure. What can i do? Thanks

[@TheMihirNaik]

You will have to use your own credentials. And then add your email as a test email then you should be fine.

[@ArbabUsmani]

thank you bhaiya

[@TheMihirNaik]

Thanks a lot!

[@jakubszarecki8214]

I have an issue at step Generate Authorization URL. I see this error: "You can’t sign in because GSC API sent an invalid request. You can try again later, or contact the developer about this issue. Learn more about this error If you are a developer of GSC API, see error details. Error 400: invalid_request". How can I solve this?

[@TheMihirNaik]

You are not putting your own Credentials. You are using the ones I have given may be?

[@jakubszarecki8214]

@@TheMihirNaik I used my own client id and client secret but I copied yours redirect uri (I dont know where its from)

[@jakubszarecki8214]

Ok, it works. Do you plan to continue this series? It's very interesting

[@lucasxavier1732]

Hey Mihir! Can you help me? I've been trying to run the "Generate Authorization URL" code, but i just can't get it.

[@TheMihirNaik]

Can you share the error are you getting?

[@seifjaber3728]

Hi Mihir. where can I find my redirect URI?

[@TheMihirNaik]

The redirect URI is the same for everyone. The one I have given in the code.

[@wojciechurban1162]

How to get data from many GSC websites in one script?

[@TheMihirNaik]

It's not possible because of how GSC API is structured. You could fetch them from multiple properties separately and then join them in one dataframe.

[@RohitSinghal-o1i]

Thanks

[@TheMihirNaik]

Welcome

[@salmanmehmood180]

@TheMihirNaik Hi, I've done some keyword tracking through PyTrends library so far for free but when I go with more keyword tracking I track like 5000 keywords daily So there might exceed the free limit and and I have to buy the API or it works for free?. Please let me know What will be the cost to buy API and from where to buy API and how it works?

[@TheMihirNaik]

Hi Salman, When you say keyword tracking, do you want to check where does your website rank for a specific keyword? I mean to ask, are you talking about Rank Tracking?

[@salmanmehmood180]

​@@TheMihirNaik Hello bro, I want to track 5000 keywords so it could be as simple as ranking. I need to know their performances. Please help me how to do this . I reached out semrush API but it is very expensive.

[@salmanmehmood180]

​@@TheMihirNaik hello sir, I really need your help. Tell me how to contact you in person for detailed discussion.

[@hubertcombomarketing2693]

Very interesting, but I can barely hear you.

[@TheMihirNaik]

Sorry about that. I tried to do better with other videos.

[@hubertcombomarketing2693]

@@TheMihirNaik I I got myself some good quality headphones and I don't have a problem anymore. Great content, I will find it very useful in my work. It's good that you are here. Sending thanks from Poland.

[@Canadaswing]

Mihir sir Please I need your mentorship. This is really important for me. Kindly reply me. Your guidance is important for me in my carrier .

[@TheMihirNaik]

Hi there, how can I help?

[@Canadaswing]

@@TheMihirNaik Sir I need to learn about SEO and what should I learn this time to get a job. I need your mentor ship

[@TheMihirNaik]

@@Canadaswing I don’t do 1:1 mentoring. I think learningseo.io is a great way to learn SEO.

[@kunalmishra1443]

Hi everyone I've one question can anyone please explain Why does the data in Google search console doesn't match with the data coming from google search console api Why the result coming from api has more number as compared to web ui?

[@TheMihirNaik]

GSC Web UI only shows 1000 rows of data, while API allows you to extract everything they have except Anonymized data.

[@lautarogomezdunaevsky5552]

@@TheMihirNaikHi, Thanks for the video, really helpful. In my case, the data from the API is less than the data shown directly in GSC. Do you have any clue why this can happen?

[@TheMihirNaik]

@@lautarogomezdunaevsky5552 You might not be selecting correct dimensions.

[@mosa5x198]

Hey, I tried to get the data as pandas df but I couldn't

[@TheMihirNaik]

Were you able to connect to GSC API? Where are you stuck? What errors are you seeing?

[@RehanKhan-ln6db]

what is default quota of google indexing api for a day

[@TheMihirNaik]

I think 200 a day.

[@RehanKhan-ln6db]

@@TheMihirNaik bahut din baad aya 😅

[@manjugumpula]

Voice is too low.

[@TheMihirNaik]

Yes, that's right. I have corrected in the second video.

[@IqraKhan-p6l]

Plz quickly response sir??

[@babistanworld]

bro your voice is two low

[@TheMihirNaik]

Yes I have corrected the same in the following videos.