Skip main navigation
We use cookies to give you a better experience, if that’s ok you can close this message and carry on browsing. For more info read our cookies policy.
We use cookies to give you a better experience. Carry on browsing if you're happy with this, or read our cookies policy for more information.
Screen starting DFS, YARN and Rstudio
Starting DFS, YARN and Rstudio

Starting Hadoop, R studio and Rhadoop

We need to quickly check if everything is working in our virtual machine and to get familiar with the environment we’ll be working with.

Open terminal by clicking on black icon on bottom left and type

start-dfs.sh
start-yarn.sh
hadoop fs -ls

Then type

rstudio

to open the Rstudio GUI where you may type basic RHadoop commands in Console directly

library(rhdfs)
hdfs.init()

You may see log and some warning messages but no filesystem errors while executing above commands. There may be some glyph rendering errors which we can simply ignore.

Try to quit and stop the Hadoop servers by using counterpart commands stop-yarn.sh and stop-dfs.sh in terminal.

Share this article:

This article is from the free online course:

Managing Big Data with R and Hadoop

Partnership for Advanced Computing in Europe (PRACE)

Contact FutureLearn for Support