Current location - Quotes Website - Collection of slogans - How does myeclipse on window configure hadoop?
How does myeclipse on window configure hadoop?
Objective: To configure hadoop in myeclipse.

Operating system? : Window system

Tools: myeclipse,? Hadoop-eclipse-plugin-1.2.1.jar package

Steps:

1) Put Hadoop-Eclipse-plugin-1.2.1.jar (provided in this article, you can download it yourself) in the dropins folder of MyEclipse installation directory, and restart MyEclipse. You will find that the DFS location appears under Project Explorer, indicating that MyEclipse has recognized the Hadoop-Eclipse-plugin-1.2.1.jar plug-in.

Note: Hadoop-Eclipse-plugin-1.2.1.jar This jar package cannot be found in the contrib directory of Hadoop- 1.2. 1 Need to download online or configure yourself.

2) Open the window-> First, discover the Hadoop Map/Reduce option, indicating that the plug-in is successfully installed, configure the Hadoop installation directory, and install the decompressed directory for local Hadoop. (Note: The premise is to download Hadoop- 1.2. 1 under the window and decompress it. )

3) select window->; Show view-> Others, use the elephant icon to select Map/Reduce to open the development environment of Map/Reduce, and there is a box with the location of Map/Reduce below.

The elephant linux in the picture is what I have equipped.

4) Select the Map/Reduced Location tab, click the elephant icon on the far right of the tab, that is, the elephant icon on the right of the gear icon to open the parameter setting page.

Note: The parameter set marked with red box must be correct. First, set the Location name as the hostname of linux, which can be viewed through the hostname. Host is the linux host user name. The port number of PortMapReduce on the left. The xml file for configuring Hadoop under linux has been configured. Just configure it according to the configured port number. On the right is the port number of hdfs. When the configuration is complete, click Finish.

5) Then click Advanced Parameters to find hadoop.tmp.dir and modify it to the value configured in Hadoop cluster core-site.xml.

6) Next, configure dfs.permssions in the advanced parameters, and modify it to false, which is consistent with the configuration in Hadoop cluster hdfs-site.xml; Change the value of dfs.replication to 1.

7) After the configuration is completed, if the following information appears in the project browser, the configuration is successful.