Crawl the Web With Python

Derek JensenJul 2, 2015Lessons: 7Length: 55 minutes

Python

Next lesson playing in 5 seconds

Cancel

Crawl the Web With Python

Introduction

05:42

In a recent business venture, I found it necessary to collect bulk data from different online sources in order to centralize it and make it easier for people to find and to make sense of. None of those sites had exposed public APIs, so I decided to try my hand at a little web crawling and scraping to obtain this metadata. After searching around for a while, I found that many people when faced with the same issue have turned to Python. After all, if it was good enough for Google, it's definitely good enough for me!

In this course I will share some of my findings and show you how you can go about creating your own basic web crawler and scraper.

Learn Python

Learn Python with our complete python tutorial guide, whether you're just getting started or you're a seasoned coder looking to learn new skills.

1.Introduction
2 lessons, 14:16

1.1
Introduction
05:42

1.2
Getting Set Up
08:34

2.Intro to Crawling and Scraping
4 lessons, 38:52

2.1
Where to Find the Data
06:05

2.2
Creating the Code Structure
07:51

2.3
Beginning to Extract Data
13:06

2.4
Crawling to Other Pages
11:50

3.Conclusion
1 lesson, 02:06

3.1
Next Steps
02:06

Derek Jensen

Derek Jensen is a lifetime nerd that calls the Chicagoland area home. He is your typical family man that loves activities with his wonderful wife and three amazing children. He is huge sports buff (both playing and coaching) and loves football, baseball and basketball. He loves just about any technology he can get his hands on but spends most of him time on the server side of the world. His day job consists of writing highly transactional backend web services, data access layers, and n-tier applications using the .NET Framework in C#. At night, when he's not spending time with his family, he enjoys authoring Tuts+ Courses and creating ASP.NET MVC web sites and mobile apps for clients.

kreatived

Crawl the Web With Python

Next lesson playing in 5 seconds

Crawl the Web With Python

Introduction

1.Introduction2 lessons, 14:16

1.1Introduction05:42

1.2Getting Set Up08:34

2.Intro to Crawling and Scraping4 lessons, 38:52

2.1Where to Find the Data06:05

2.2Creating the Code Structure07:51

2.3Beginning to Extract Data13:06

2.4Crawling to Other Pages11:50

3.Conclusion1 lesson, 02:06

3.1Next Steps02:06

1.Introduction
2 lessons, 14:16

1.1
Introduction
05:42

1.2
Getting Set Up
08:34

2.Intro to Crawling and Scraping
4 lessons, 38:52

2.1
Where to Find the Data
06:05

2.2
Creating the Code Structure
07:51

2.3
Beginning to Extract Data
13:06

2.4
Crawling to Other Pages
11:50

3.Conclusion
1 lesson, 02:06

3.1
Next Steps
02:06