Current location - Quotes Website - Personality signature - Learn python crawler from scratch (8): selenium data extraction and other usage methods
Learn python crawler from scratch (8): selenium data extraction and other usage methods

Knowledge point:

Knowledge point: Understand the common properties and methods of the driver object

Note: The latest version of selenium has canceled this format and replaced it with It is:

You need to import first:

Then:

Knowledge point: Master the method of driver object positioning tag element to obtain tag object

< p> Code implementation, as follows, obtains the content of the news tag on the Tencent News homepage.

Knowledge point: Master the operation method of element object

Reference code example:

Knowledge point: Master the switching of selenium control tabs

Knowledge point: Master the switching of frame tags controlled by selenium

Knowledge point: Master the method of using selenium to obtain cookies

Knowledge point: Master the method of selenium controlling the execution of js code in the browser

p>

Knowledge point: Master the manual implementation of page waiting

Knowledge point: Master selenium to enable interfaceless mode

Knowledge point: Understand selenium's use of proxy IP

Knowledge point: Understand selenium replaces user-agent