Skip main navigation

Installation of a Linux Virtual Machine

We will use Linux Mint with the RHadoop virtual machine provided as a file on our server. In Week 5 you may get temporary account on HPC cluster too.
4.2
We will download Linux Mint with the RHadoop virtual machine provided as a file on our server. The single large file is split into several files that may be easier to download. However, they have to be combined into the single Open Virtual Appliance file, which is then imported into Virtual Box. Of course, VirtualBox needs be installed before you can import our RHadoop virtual machine. Please use the virtualbox.org web site to download the latest binaries for your host operating system. We do not need Extension Pack for our Linux Mint machine. VirtualBox machines can be run on a 64-bit host by Virtualization Technology (VTx) and Virtualization Technology Directed I/O (VTd). Usually these settings are disabled on the level of BIOS.
61.7
To enable VTx and VTd you have to change the corresponding settings in the BIOS. So, please check these settings if you have trouble installing and starting the RHadooop virtual machine.

We will be working with a custom-installed Hadoop in the Linux Mint operating system, which is based on the Ubuntu Linux platform, which is further based on the Debian Linux distribution. In this article presentation we will provide an illustrated, step-by-step guide to installing both the Oracle VM VirtualBox (virtualization software) and how to start an already pre-prepared OS with the Hadoop.

  1. The first thing you need to do is download the provided Linux Mint with the Hadoop. You will find it by following link. In the case of problems with a large file download, please use 7-Zip-splitted files in a subdirectory there.
  2. Once you have clicked on the link, left-click on the file named mint-hadoop.ova. It will start downloading into your Downloads folder or a pop-up window will appear. Save it to your hard drive, by making sure the option “Save File” is selected and then pressing “OK”.
  3. The .ova extention stands for “Open Virtual Appliance” and is basically the already prepared virtual-machine image, which now just needs to be loaded into the VM VirtualBox. So our next step is to install this program (we are assuming you do not have it installed yet, but in case you do, you can skip all the way down to the last two steps).
  4. Now it is time to first download the appropriate file Oracle VM VirtualBox packages and then install them. The easiest way to do this is just to click on the provided link. Now select the platform you are running your system on and then download the VM.
  5. Next, install the VM from the package you downloaded. Note that you may be prompted during the installation to provide permissions to install the VirtualBox package.
  6. Well done! Now you only need to find the mint-hadoop.ova that you previously downloaded and double left click on it. This will automatically run the image inside the VM. Once you do that, you should get something like that shown in the figure below. Installation of a Linux Virtual Machine Image 1
  7. Now before you press the button “Import”, you can customise the settings in the window entitled “Import Virtual Appliance”. The only settings we recommend changing are the ones for the number of available CPU cores, dubbed “CPU”, and the amount of the available RAM. We recommend at least 4GB of RAM and more than 1 available CPU core dedicated for the VM. After you do this, press “Import”. Processing the import will take a while. After the process is done you should see a result similar to the figure below. Installation of a Linux Virtual Machine Image 2
  8. Now press the “Start” button. Once the OS is loaded, select the “hduser”, and insert the password “hadoop”. Now continue to the Desktop and we are ready to go. If having problems with start please try to enable virtualisation in machine settings at boot.
  9. You may notice the following “software rendering” notice when you login. Installation of a Linux Virtual Machine Image 3 You may simply ignore the message as we will not be using graphics-intensive interface. Optionally, you may try to Enable 3D Acceleration under Machine -> Settings -> Display -> Screen -> Acceleration.
  10. If having problems in setting up a 64-bit host then check and enable Virtualization Technology (VTx) and Virtualization Technology Directed I/O (VTd) in BIOS.

Please join the discussion that follows and post any problems during the installation and initial tests so that we know and can help you to solve the problems.

This article is from the free online

Managing Big Data with R and Hadoop

Created by
FutureLearn - Learning For Life

Our purpose is to transform access to education.

We offer a diverse selection of courses from leading universities and cultural institutions from around the world. These are delivered one step at a time, and are accessible on mobile, tablet and desktop, so you can fit learning around your life.

We believe learning should be an enjoyable, social experience, so our courses offer the opportunity to discuss what you’re learning with others as you go, helping you make fresh discoveries and form new ideas.
You can unlock new opportunities with unlimited access to hundreds of online short courses for a year by subscribing to our Unlimited package. Build your knowledge with top universities and organisations.

Learn more about how FutureLearn is transforming access to education