Ganglia with a server and virtual hadoop client and hadoop benchmarks

After getting ganglia up and running on it’s own physical node, the node will end up being part of the Openstack cloud controller, ganglia is installed on the KVM virtual machine running Cloudera Hadoop (chadoop1). The cluster is called “camden cluster”, and Ganglia allows for views of the cluster and each individual node in the cluster. In out cluster we have 2 nodes, chadoop1 and the ganglia1 server itself. Scripts were run to generate I/O and and the generated data was copied from the chadoop1 server to the ganglia1 server to mildly stress the network. Our next piece of work is to utilize tools detailed by Hortonworks here:

http://hortonworks.com/blog/delivering-on-hadoop-next-benchmarking-performance/

Here are some screenshots of the cluster and node views: first the cluster view:

and the client view:

Advertisements

About johnnychipotle

cloud blogger
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s