A lazy programmer's guide to web scraping
Submitted by Pradhvan Bisht (@pradhvan) on Thursday, 10 August 2017
Technical level: Beginner
As the ever increasing data in the today’s world data can be used in various ways. Thus web scraping helps you obtain that data efficiently and also saves a ton of time by making the data collection an automated task.
Also the talk will go through some real world example codes to give the attendees a gist of what all it takes to successfully extract the data they require. At the end some scraping ethics will be mentioned so that one doesn’t end up putting anyone in trouble.
This is the basic outline of the talk which may have some changes when the final talk is delivered
1. What is web scraping ?
2. Why should you scrape ?
3. Things that might come handy
4. How it’s done
5. Comparing Parsers
6. Preserving the data
7. Code Examples
8. What to use when to use
9. Scraping Hacks
10. Ethics of Scraping
11. Q/A and General Discussion
1.Basic HTML and CSS knowledge.
2.Knowledge of HTTP methods GET and POST .
3.Familiarity with python language.
Hello world !
I am a web developer and an open source enthusiast, I am also a Python lover and use it to automate everything I can.
Being an open source developer I am an active member of the various local user group that supports and promote open source.
Recently I spoke at PyDelhi Conf 2017 about automation using python and my talk was titled as “A lazy programmer’s guide to automation”.