{"id":190,"date":"2020-06-19T23:06:55","date_gmt":"2020-06-19T21:06:55","guid":{"rendered":"http:\/\/deleforterie.com\/wordpress\/?p=190"},"modified":"2023-01-18T08:53:11","modified_gmt":"2023-01-18T07:53:11","slug":"namenode-monitoring","status":"publish","type":"post","link":"https:\/\/deleforterie.com\/wordpress\/index.php\/2020\/06\/19\/namenode-monitoring\/","title":{"rendered":"Namenode monitoring"},"content":{"rendered":"\n<p>When having trouble with your Big Data cluster, it could be interesting to automatically generate some monitoring for your namenode.<\/p>\n<p><!--more--><\/p>\n<p>When you have some support from the editor, they give you some tricks that help to investigate what is the problem with your namenode.<\/p>\n<p>A little perl script could help you when you have some timeout during hdfs simple task.<\/p>\n<p>You can find this Perl script here <a href=\"https:\/\/github.com\/arp7\/HadoopTools\/blob\/master\/monitor-nn.pl\">monitor-nn.pl<\/a><\/p>\n<p>The usage is very simple, you can call this script every 5 minutes and set a timeout above which the script will dump the jmx thread in the .out log file.<\/p>\n<p>So you can have the status of each thread, analyze them or give it to the support team for having help to analyze.<\/p>\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"Shellscript\">$ .\/monitor-nn.pl 15 \/run\/hadoop\/namenode.pid<\/pre>\n<p>I recommend you to use it for helping to know better the namenode activity.<\/p>\n<p>\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When having trouble with your Big Data cluster, it could be interesting to automatically generate some monitoring for your namenode.<\/p>\n","protected":false},"author":2,"featured_media":170,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[4,14,15],"tags":[],"class_list":["post-190","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bigdata","category-hadoop","category-hortonworks"],"_links":{"self":[{"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/190","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/comments?post=190"}],"version-history":[{"count":1,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/190\/revisions"}],"predecessor-version":[{"id":191,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/190\/revisions\/191"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/media\/170"}],"wp:attachment":[{"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/media?parent=190"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/categories?post=190"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/deleforterie.com\/wordpress\/index.php\/wp-json\/wp\/v2\/tags?post=190"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}