- What is web scrapping?
- What are the web crawlers?
- Can you scrape data behind a login page?
- Can you crawl Twitter?
- Is it possible to scrap the Java script pages? If yes, how?
- Title Page
- Copyright and Credits
- Dedication
- About Packt
- Contributors
- Preface
- Python Scripting Overview
- Technical requirements
- Why Python?
- Python syntax compared to other programming languages
- Python installation
- Python interpreter
- Strings
- Understanding lists
- Tuples
- Sets
- Dictionaries
- Parsing command-line arguments
- Decision making
- Loops
- Iterators
- Generators
- Functions
- Modules
- Summary
- Questions
- Further reading
- Debugging and Profiling Python Scripts
- Unit Testing - Introduction to the Unit Testing Framework
- Automating Regular Administrative Activities
- Accepting input by redirection, pipe, and input files
- Handling passwords at runtime in scripts
- Executing external commands and getting their output
- Capturing output using the subprocess module
- Prompting for passwords during runtime and validation
- Reading configuration files
- Adding logging and warning code to scripts
- Putting limits on CPU and memory usage
- Launching webbrowser
- Using the os module for handling directory and files
- Making backups (with rsync)
- Summary
- Questions
- Further reading
- Handling Files, Directories, and Data
- Using the os module to work with directories
- Copying, moving, renaming, and deleting data
- Working with paths
- Comparing data
- Merging data
- Pattern matching files and directories
- Metadata: data about data
- Compressing and restoring
- Using the tarfile module to create TAR archives
- Using a tarfile module to examine the contents of TAR files
- Summary
- Questions
- Further reading
- File Archiving, Encrypting, and Decrypting
- Text Processing and Regular Expressions
- Documentation and Reporting
- Working with Various Files
- Basic Networking - Socket Programming
- Handling Emails Using Python Scripting
- Remote Monitoring of Hosts Over Telnet and SSH
- Building Graphical User Interfaces
- Working with Apache and Other Log Files
- SOAP and REST API Communication
- Web Scraping - Extracting Useful Data from Websites
- Statistics Gathering and Reporting
- MySQL and SQLite Database Administrations
- Assessments
- Chapter 1, Python Scripting Overview
- Chapter 2, Debugging and Profiling Python Scripts
- Chapter 3, Unit Testing – Introduction to the Unit Testing Framework
- Chapter 4, Automating Regular Administrative Activities
- Chapter 5, Handling Files, Directories, and Data
- Chapter 6, File Archiving, Encrypting, and Decrypting
- Chapter 7, Text Processing and Regular Expressions
- Chapter 8, Documentation and Reporting
- Chapter 9, Working with Various Files
- Chapter 10, Basic Networking – Socket Programming
- Chapter 11, Handling Emails Using Python Scripting
- Chapter 12, Remote Monitoring of Hosts Over Telnet and SSH
- Chapter 13, Building Graphical User Interfaces
- Chapter 14, Working with Apache and Other Log Files
- Chapter 15, SOAP and REST API Communication
- Chapter 16, Web Scraping – Extracting Useful Data from Websites
- Chapter 17, Statistics Gathering and Reporting
- Chapter 18, MySQL and SQLite Database Administrations
- Other Books You May Enjoy
Questions
-
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click here login for view all page.