I changed the user to be admin and ran the task tracker manually.For one, hadoop DFS is so close to UNIX type systems in its usage, running it on Windows feels a lot more alien.Besides that, large Windows based clusters havent been tested yet, most probably for the aforementioned reason.So, after having used hadoop on a VM on my Vista box or using my MacBook, I took a heart and explored the necessary steps to run it on Vista (or any other of those Windows flavours).
This is an absolute requirment to overcome the alien part of the windows shell handling. Installing cygwin is easy, it has a set-up which lets you choose what, where and which ported packages you want to install. Make sure to choose the opensshd package in the Net grouping. Answer all with yes except for This script plans to use cygserver, Do you want to use a different name. The answer is no. The script will also prompt you for a CYGWIN env variable. It will install sshd as a service, i.e. Are you sure you want to continue connecting (yesno) yes Warning: Permanently added localhost (RSA) to the list of known hosts. For the sake of simplicity, well outline setting up a single instance installation. Hadoop is recommending Java 6, while it still can be run with Java 5. The next requirement is setting up private key based ssh access. For that youll need to generate keys which you publish as authorized keys in your.ssh directory. At the time of writing its 0.20.1. Unpack it in your windows on c somewhere handy. I put in C:Servers where I keep the other stuff like JBoss, Tomcat and such. ![]() If this is a comma-delimited list of directories then the name table is replicated in all of the directories, for redundancy. In your cygwin shell cd to the hadoop directory root and issue the following command. You can check if everything is running correctly by calling JPS. Please keep in mind that command line handling must be passed over the cygwin environment. If you plan to do some scripting or call your map reduce programs, you always have to use that intermediary. If youre looking for your windows files in cygwin, youll find all windows lettered drives under cygdrive.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |