HTML Web Scraping with Selenium

Learn the basics of Selenium browser automation by parsing and scraping the DOM of any HTML Webpage. We'll cover how to search for different HTML elements through various functions.

TECHNOLOGIES

Selenium

WATCH TIME

24 minutes

Lessons

Understanding the HTML DOM Structure

Learn how to read the HTML on any page, and understand how we can retrieve specific HTML elements to perform actions on.

4 min

Find Element by Name

Learn how to scrape and parse the HTML DOM with Selenium to find HTML elements by their name attribute.

3 min

Find Element by ID

Learn how to scrape and parse the HTML DOM to find HTML elements by their ID.

4 min

Find Element by Class Name

Learn how to scrape and parse the HTML DOM with Selenium and find elements by their Class Name.

3 min

Getting Started with Selenium

Learn what is Selenium, the intuition behind automating our browser, and finally how to install Selenium and its respective webdriver.

7 min

Find Element by XPath

Learn how to scrape and parse the HTML DOM with Selenium to find HTML elements by using their XPath.

5 min

Find Element by Link Text

Learn how to scrape and parse the HTML DOM with Selenium to find HTML elements by their link text.

2 min

Hey! I’m Avi, and I’ll teach you how to build!

I'm Avi, your new Python instructor and founder of The Codex.

Three years ago I was stuck. I wasn’t learning anything in my theory-filled CS classes, my friends took pictures of me sleeping in lecture, and I was questioning why I was even learning CS to begin with. I had ideas but I was clueless on execution.

After watching hours of webcasted YouTube videos, enrolling in course after course, and struggling to stay motivated, I finally obtained the skills to bring my ideas to life. I realized how lonely and gruesome this process was.

If you’re a student just like me, you know exactly what it’s like to be stuck in course hell. The best programmers of today learned by doing, not by reading syntax in a textbook.

Join The Codex. Become a creator.

Savvy Students ❤️ The Codex

The Codex has helped hundreds of students find jobs and build their dream projects.

“CS classes at UW were overwhelming and full of theory. Through The Codex, I realized the power of Python programming, built numerous projects for my resume and ultimately landed an internship at Amazon.“
Arjun Malhotra
University of Washington, 2022
SDE Internship, Amazon

Ready to dive in? Start learning today.