Databricks API Calls for Job Runs From a Notebook (Hands on Demo!)

[@rashmitakarak6053]

I am providing the token and other details yet my code returns a 404 error. What should i be doing?

[@harithareddy687]

When I am using above api call it is giving me the partial result suppose if we 20 jobs ran it giving me only 10 jobs result and not giving the deatils about other jobs ex :job a ,job b , job c ran but it is giving me results for job a and job c it is skipping job b results

[@mithunkumar7063]

I am able to list only maximum of 100 jobs,,how to get details of all the jobs running in the workspace

[@CoopmanGreg]

You will need to investigate the page_token, epand_tasks, start_time_from, and start_time_to paramaters in the api documentation. Those need to be configured in the payload then used in a loop to get 100 at a time. Hope this helps.

[@mithunkumar7063]

@@CoopmanGreg Thanks

[@myselfandpesit]

Why do you want to run API in databricks when you can see the jobs inside workflows ?

[@CoopmanGreg]

Lets say your company has 4000 jobs and you are assigned to find all the jobs that do not have Tags setup for some Category, but almost all of the jobs already have the tags populated. And you have to do this monthly. Well, if you have to open every one of the 4000 jobs and try to eyeball it. It would take you days. By using (automating with) the api, you can program the api output to be put into a database and you can then easily query in seconds to find all the jobs that are missing the category value. There are 100s of APIs with Databricks which you can get information from. But, of course if you have a small number of objects, you would be wasting your time to use APIs for automation (because it takes a lot of time and programming skill). I hope this gives you an idea how APIs maybe used. Thanks for watching.