HiveSql interview question: continuous check-in and receive gold coins [Baidu - difficult questions - general solution]

catalogue 0 problem description 1 data preparation 2 problem analysis 3 Summary 0 problem description User behavior log table tb_user_log iduidartical_idin_timeout_timesign_in110102021-07-07 10:00:002021-07-07 10:00:091210102021-07-08 10:00:002021-07-08 10:00:091310102021-07-09 10:00:002021-07-09 10:00:42141010 2021-07-10 10:00:00 2021- ...

Posted by erika_web on Tue, 03 May 2022 21:59:16 +0300

mapreduce job submitted to yarn analysis

mapreduce job submitted to yarn analysis Related classes Configuration Configure the job. If not, the default configuration will be used. Job Encapsulates the running information of a job. Cluster An object representing the local connection between ResourceManager and file system; Internally encapsulates the file system information of Jo ...

Posted by grenouille on Tue, 03 May 2022 13:23:53 +0300

Big data development Hive common date function & & sql routine of date continuous questions

In the front is a summary of common date functions, followed by a continuous date sql problem and its solution routine. 1. Current date and time select current_timestamp -- 2020-12-05 19:16:29.284 2. Get the current date, which is 2020-12-05 SELECT current_date; ## OR SELECT current_date(); -- 2020-12-05 3. Obtain the timestamp under unix ...

Posted by jk11uk on Tue, 03 May 2022 06:12:50 +0300

Analyze what netizens of exciting offer2 are roast about?

Variety shows are not only a way to relax after a hard day, but also our talk after dinner. Looking at their favorite variety shows, time is beautiful enough. And "exciting offer" is a good variety choice. Some people say it makes me feel inferior, and I think it's very interesting. "Exciting offer" has been broadcast for t ...

Posted by dustbuster on Tue, 03 May 2022 03:38:30 +0300

MapReduce programming example

According to the source code of WordCount MapReduce program, we can draw the following conclusions: (1) The program has a main method to start the operation of the task, in which the job object stores the necessary information for the operation of the program, such as specifying Mapper class and Reducer class job.setMapperClass(TokenizerMapper ...

Posted by php_newB on Mon, 02 May 2022 12:43:15 +0300

[authoritative guide to hadoop 4th Edition] Chapter IV IO of hadoop [notes + code]

4.1 data integrity The common method to detect damaged data is to calculate the checksum of the data when entering the system for the first time. If the newly generated checksum after transmission does not completely match the original checksum, the data will be considered damaged. Note that the checksum may be wrong and the data is correct, ...

Posted by flash99 on Mon, 02 May 2022 12:03:14 +0300

Hive common window functions

1, Overview 1. Definition Window functions are a special set of functions Scan multiple input lines to calculate each output value, and generate a row structure for each row of data Complex calculation and aggregation can be realized through window functions By function, it can be divided into: sequence (sorting), aggregation and analys ...

Posted by fishdish on Mon, 02 May 2022 05:28:04 +0300

Xiaodi classroom - learning notes: do you know structural design mode, decorator + agent mode? Stay and talk

Vision: "make programming no longer difficult to learn and make technology and life more interesting" For more architecture courses, please visit xdclass net   catalogue Episode 1 design mode of adding wings to the tiger - Introduction to decorator design mode Episode 2 meet Lao Wang's refitting collocation - play with the desig ...

Posted by Russia on Sun, 01 May 2022 23:20:46 +0300

Loop of R language (solve the problem of slot machine diamond matching all symbols)

R cycle Loop is a method used by R to repeatedly complete a task. Let's use the score function to solve a practical problem. The slot machine program simulates a group of controversial slot machines in real life, which are believed to be suspected of cheating. The return rate of these slot machines seems to be 40 cents / dollar, but the manuf ...

Posted by nikky_d16 on Sun, 01 May 2022 13:42:31 +0300

Hadoop cluster deployment

In the previous article, the pseudo-distribution deployment of Hadoop clusters was introduced. Before reading this, it is recommended to read the previous article: Hadoop cluster deployment (1) In this article we will introduce the distributed deployment of Hadoop clusters. Deployment of Distributed Clusters Virtual machine preparation Distribu ...

Posted by jigaruu on Sun, 01 May 2022 08:36:38 +0300