Skip to content

arnakoguzhan/YellowPages-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

YellowPages-Scraper

First

This is my first public python project.So I want to improve my coding skill. If you think some methods or etc. is bad please tell me and help me to change.

This project scraping all company data in Yellow Pages

What data include?

  • Name
  • Description
  • Address, postal code
  • Company Logo
  • Company Images
  • Company categories
  • Rating values (rating, review count, best rating, worst rating)
  • Telephone number
  • Website
  • Social Links (Facebook, Instagram, Twitter, Linkedin, Google+, Youtube)
  • Opening and closing hours
  • Geo information (latitude, longitude)

GetLinks.py

This class get all company links in categories you selected. Then save it to 'curl.txt'

getvalue.py

Bad news... I dont know how to add links to array in python class (maybe I didnt try :P). So you need to copy all data in 'curl.txt' and paste data array in this class

GetCompanyData.py

This class get all company information and save to sqlite database.(You can change save function)

About

YellowPages scraper

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages