Web Scraping Using Python | Create your own JOB ASSISTANT | Beautifulsoup

Want to learn one new skill?
Join Vishwa Mohan, CIO - PhysicsWallah, scrape any website or search engine. Vishwa shows you how to build your own job assistant using Python's Beautiful Soup.
Still confused to choose the right CAREER path? Fill the form, you will get the call from our Senior Academic Counsellor: bit.ly/495UNgC
📲 PW App/Website: physicswallah.onelink.me/ZAZB...
🌐 PW Skills Website: pwskills.com/
📚 PW Store: physicswallah.onelink.me/ZAZB...
-------------------------------------------------------
📌 𝐏𝐖 𝐒𝐤𝐢𝐥𝐥𝐬 𝐓𝐞𝐜𝐡 𝐒𝐎𝐂𝐈𝐀𝐋 𝐌𝐄𝐃𝐈𝐀 -
🌐 Telegram: t.me/SkillsPW
🌐 Instagram: / pw.skills
-------------------------------------------------------
Topic Covered
00:00 - Introduction
00:40 - What is Web Scraping?
02:43 - Getting started with the Job Assistant project
04:42 - Python Beautifulsoup library and its usage in a dummy file for practice
30:50 - Using Requests and BeautifulSoup on a real website to fetch and scrape data
56:30 - Conclusion
📌 For any Queries or Complaints visit: bit.ly/PW_Queries OR give a Missed Call on 07019-243-492
-------------------------------------------------------
#WebScraping #Python #JobAssistance #Beautifulsoup #PWSkillsTech #PWSkills #PhysicsWallah #PythonWebScraping

[@divyanshuyadav3400]

Done ,Thank You, HARE KRISHNA

[@MohMaya13]

Quality Project, thank you sir. It was worth coding side by side with you!🙏✨

[@aarish22]

Completed Need more videos like this Sir make on end to end ml project

[@shubhamsharma-01-india]

please bring something including mchine learning and mlops also in end to end form sir completed this but having confusion why cant we parse it in html format insted of lxml

[@rajeshwaryadav4084]

Please make a dedicated video on web scraping from scratch please sir

[@jerrybritto1813]

Thank you sir

[@hariskhanhk5970]

sir bulk me kese fetch kre ge data

[@PWSkillsTech]

Upskill NOW with PW Skills Decode Decode Course in Java, Python and C++- bit.ly/3VMzyNM Explore Job Assistance Batches Data Analytics Course - bit.ly/3Jae5ai Full Stack Development Course - bit.ly/3VNdyST Data Science with Generative AI Course - bit.ly/3J5yXiK DevOps and Cloud Computing Course - bit.ly/3VNMR0x UI/UX Design Course - bit.ly/3vGAton Mastering the Power of Artificial Intelligence Course - bit.ly/3VLPGiA Still confused to choose the right CAREER path? Fill the form, you will get the call from our Senior Academic Counsellor: bit.ly/495UNgC

[@DevDebasis1]

PWSKILLS COURSES (MAXIMUM DISCOUNT) --------------------------------------- Decode Python with DSA Course ---> CPCA0734 (1000 Rs Less) Decode Java with DSA Course ---> CPCA0734 (1000 Rs Less) Decode C++ with DSA Course ---> CPCA0734 (1000 Rs Less)

[@krishmistry1422]

Cybersecurity course needed

[@nileshdiwakar3528]

Bhai kisike pass pw ka paid web development course h kisike pass? I want to know that how is it? How's the teaching style and content of course?

[@user-kv8ot7qp9f]

Windows laptop m bhi bana sakte hai ye sir

[@Akhoon_faheem]

it needs highest version of apple LINUX

[@Akhoon_faheem]

# importing necessary modules import urllib.request import urllib.error import ssl import time from bs4 import BeautifulSoup # setting url and ssl print('WELCOME TO JOB HUNT PROGRAM FOR IT PROFFESIONALS') print('---------------------------------------------------------------------------------------------') print() print(' WE RECCOMEND YOU TO USE DEFAULT URL BY PRESSING Y IF U DO NOT HAVE PRIOR KNOWLEDGE:') print() INP = input('press y to use default url and n to use your own url: ') inp =INP.strip().lower() if inp == 'y': url ='www.timesjobs.com/candidate/job-search.html?searchType=Home_Search&from=submit&asKey=OFF&txtKeywords=&cboPresFuncArea=35' if inp == 'n': url = input("Enter the url and press enter: ") ctx = ssl.create_default_context() ctx.check_hostname =False ctx.verify_mode = ssl.CERT_NONE req = urllib.request.Request(url, headers={'User-Agent' : 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:90.0) Gecko/20100101 Firefox/90.0'}) #your skils your_skill = input('enter your skill with comma separated and at the end press enter: ') your_skill = your_skill.lower() your_skill= your_skill.replace(" ","") your_skill = your_skill.split(',') print(f'Your skills are : {your_skill}') print( 'wait for few secs...') time.sleep(5) print() #opening page try: fhand = urllib.request.urlopen(req, context=ctx) page_data = fhand.read() #using soup for better soup = BeautifulSoup(page_data,'lxml') #itterater list_tag = soup.find_all('li',class_="clearfix job-bx wht-shd-bx") for tags in list_tag: Role = tags.find('header').find('h2').find('a').text.strip() lnk = tags.find('h3',class_="joblist-comp-name").text.strip() skills = tags.find('span',class_="srp-skills").text.replace(" ","").strip().split(",") date = tags.find("span",class_="sim-posted").text.strip() print() # matching of skills for elem in your_skill: if elem in skills: print(f''' ROLE IS : {Role.lower()} COMPANY NAME: {lnk.lower()} SKILLS REQUIRED: {skills} DATE : {date.lower()} ------------------------------------------------- ''') except urllib.error.URLError as e: print(f'failed to connect {e.reason}') except urllib.error.HTTPError as e: print(f"failed to process: {e.code} {e.reason}") finally: print() print('-------------------------------------') print('script completed') print('#############BY FAHEEM#################')