Summary

Interacting with forms is a necessary skill when scraping web pages. This chapter covered two approaches: first, analyzing the form to generate the expected POST request manually and utilizing browser sessions and cookies to stay logged in. Then, we were able to replicate those interactions using Selenium. We also covered some tips to follow when "humanizing" your scrapers.

In the following chapter, we will expand our form skillset and learn how to submit forms that require passing CAPTCHA image solving.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset