Introduction to the use of Youtube Data API

This article is suitable for developers who want to write Youtube interactive programs, and can quickly understand the usage of Youtube Data API interface Youtube has a large number of videos. How to quickly retrieve the desired videos is very important It is found that google has provided a Youtube developer website with the homepage as follow ...

Posted by ganlal on Tue, 24 May 2022 07:46:27 +0300

Crawl the mv download address of a website based on scratch

Scrapy is well-known. Seeing that the mv of a website is good, it's too troublesome to download it manually, so we use scrapy to grab it. The basic idea is to study the home page of the website, the list page of movies, and its playing page, obtain the formatted information in the page, the jump relationship from page to page, and finally obta ...

Posted by reyes99 on Sun, 22 May 2022 20:58:28 +0300

Chinese University mooc crawler notes

Getting Started with the Requests Library Seven main methods method illustrate requests.request() Construct a request that supports the underlying methods of the following methods requests.get() The main method for obtaining HTML pages, corresponding to HTTP GET requests.head() The method for obtaining the header information of HT ...

Posted by busin3ss on Sun, 22 May 2022 16:59:39 +0300

Beginner crawler (11) -- stock data analysis, crawler learning is temporarily over

  I finally wrote the last article, two days later than I said before. This series lasted about 23 days (not counting today). On average, except for this one, it basically conforms to the Flag I set up at the beginning. Although the actual learning time is less than half, such learning efficiency is still too low. My overall course progres ...

Posted by svan_rv on Wed, 18 May 2022 17:11:54 +0300

The written crawler program is interrupted due to website or network reasons. What if it is executed here and the previous data is crawled back to the database?

Incremental crawler The crawler can get the updated data of a website through the program. How to carry out incremental crawling: Judge whether the URL has been crawled before sending the request. After parsing the content, judge whether this part of the content has been crawled. When writing to the storage medium, judge whether the cont ...

Posted by lj11 on Tue, 17 May 2022 06:56:53 +0300

[2020-09-24] Zhihu simulated login -- selenium

Disclaimer: This article is only for study and research. It is prohibited to use it for illegal purposes. Otherwise, the consequences will be at your own risk. If there is any infringement, please inform and delete it, thank you! Project scene: This time I bring you the selenium automatic login of Zhihu, using the qq authorized login entran ...

Posted by navarre on Sat, 14 May 2022 19:44:23 +0300

Netease game login password encryption crack test

I’ve been too busy recently, and the update speed has been slow. Today, I have to surf the Internet for a while. On a whim, I opened the official website of the childhood game Dahua Westward Journey. When I was logging in, I couldn't help but pressed F12. As I thought, the password is indeed encrypted. Well, wait until I deduct the JS cod ...

Posted by Angry Lettuce on Wed, 11 May 2022 12:48:20 +0300

Python crawler js encryption crack, grab Netease cloud music comments to generate word cloud

js cracking process preface Skill points Interface Overview Static web page dynamic web page Page parsing step1: Find Parameters step2: analyze js function step3: analyze parameters step4: verify step5: convert to python code Write crawler Many people learn python and don't know where to start. After learning python and mastering the basic g ...

Posted by ds111 on Tue, 10 May 2022 10:10:57 +0300

Several processing methods of crawler verification code have been encapsulated into classes. There is source code at the end of the article!

In fact, there have been a lot of things recently. I played the Blue Bridge Cup and was still preparing for some certificate exams. Blogs about reptiles have been put aside for some time. I really stepped back a little. It's not right. In fact, I'm also thinking, in my junior year, whether I want to take the postgraduate entrance examinati ...

Posted by jay1318 on Tue, 10 May 2022 03:10:11 +0300

Climb the starting point novel monthly ticket list

Trample point First, enter the page of the starting monthly ticket list to step on the spot https://www.qidian.com/rank/yuepiao , after entering the interface, we need to know what we want to get. Here we extract the novel name, author, novel type, novel status, introduction, recent update, update time, and the number of monthly tickets. ...

Posted by JMJimmy on Mon, 09 May 2022 16:51:51 +0300