Hdfs top users by actions

Hdfs top users by actions

29 June 2020 1 By Eric Deleforterie

Sometimes it could be difficult to identifying the activities that are stressing your namenodes.

Following is an article on how to have the top users by hdfs actions on your HDFS Cluster requesting the Namenode JMX

Using simple commands like a curl, you can request the jmx to give you what user is doing what on the hdfs FS.

  1. $ export NNURL="http://<your namenode hostname>:50070/"
  2. $ echo "25 minutes top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[1].ops[] | sort -t":" -n -k2 -r &&
  3. echo "5 minutes top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[0].ops[] | sort -t":" -n -k2 -r &&
  4. echo "1 minute top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[2].ops[] | sort -t":" -n -k2 -r 
$ export NNURL="http://<your namenode hostname>:50070/"
$ echo "25 minutes top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[1].ops[] | sort -t":" -n -k2 -r &&
echo "5 minutes top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[0].ops[] | sort -t":" -n -k2 -r &&
echo "1 minute top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[2].ops[] | sort -t":" -n -k2 -r 
$ export NNURL="http://<your namenode hostname>:50070/"
$ echo "25 minutes top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[1].ops[] | sort -t":" -n -k2 -r &&
echo "5 minutes top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[0].ops[] | sort -t":" -n -k2 -r &&
echo "1 minute top users" && curl --silent "$NNURL"jmx?qry=Hadoop:service=NameNode,name=FSNamesystemState | jq .beans[].TopUserOpCounts | sed 's/\\//g;s/.$//;s/^.//' | jq --compact-output .windows[2].ops[] | sort -t":" -n -k2 -r

This will give you the activity on your cluster by HDFS operation with the TopUsers and the TotalActions of the operation.

It could be helpfull when searching what action is slowing or hanging your cluster.

Below an example of the output from a Hortonworks sandbox on 1 minute after the start, try it on your real cluster you will find knowledge of operations that are made on your cluster and when something going wrong, good evidences of who is doing bad things.

  1. {
  2. "opType": "*",
  3. "topUsers": [
  4. {
  5. "user": "hdfs",
  6. "count": 332
  7. },
  8. {
  9. "user": "spark",
  10. "count": 117
  11. },
  12. {
  13. "user": "zeppelin",
  14. "count": 61
  15. },
  16. {
  17. "user": "oozie",
  18. "count": 52
  19. },
  20. {
  21. "user": "ambari-qa",
  22. "count": 20
  23. },
  24. {
  25. "user": "hive",
  26. "count": 17
  27. },
  28. {
  29. "user": "mapred",
  30. "count": 12
  31. },
  32. {
  33. "user": "yarn",
  34. "count": 9
  35. },
  36. {
  37. "user": "kafka",
  38. "count": 4
  39. },
  40. {
  41. "user": "livy",
  42. "count": 4
  43. }
  44. ],
  45. "totalCount": 628
  46. }
  47. {
  48. "opType": "setPermission",
  49. "topUsers": [
  50. {
  51. "user": "hdfs",
  52. "count": 8
  53. }
  54. ],
  55. "totalCount": 8
  56. }
  57. {
  58. "opType": "setOwner",
  59. "topUsers": [
  60. {
  61. "user": "hdfs",
  62. "count": 203
  63. }
  64. ],
  65. "totalCount": 203
  66. }
  67. {
  68. "opType": "open",
  69. "topUsers": [
  70. {
  71. "user": "zeppelin",
  72. "count": 22
  73. }
  74. ],
  75. "totalCount": 22
  76. }
  77. {
  78. "opType": "mkdirs",
  79. "topUsers": [
  80. {
  81. "user": "hive",
  82. "count": 4
  83. },
  84. {
  85. "user": "ambari-qa",
  86. "count": 4
  87. },
  88. {
  89. "user": "kafka",
  90. "count": 1
  91. },
  92. {
  93. "user": "hdfs",
  94. "count": 1
  95. },
  96. {
  97. "user": "livy",
  98. "count": 1
  99. }
  100. ],
  101. "totalCount": 11
  102. }
  103. {
  104. "opType": "listStatus",
  105. "topUsers": [
  106. {
  107. "user": "spark",
  108. "count": 29
  109. },
  110. {
  111. "user": "oozie",
  112. "count": 29
  113. },
  114. {
  115. "user": "hdfs",
  116. "count": 19
  117. },
  118. {
  119. "user": "mapred",
  120. "count": 10
  121. },
  122. {
  123. "user": "yarn",
  124. "count": 6
  125. },
  126. {
  127. "user": "zeppelin",
  128. "count": 2
  129. },
  130. {
  131. "user": "livy",
  132. "count": 2
  133. }
  134. ],
  135. "totalCount": 97
  136. }
  137. {
  138. "opType": "getfileinfo",
  139. "topUsers": [
  140. {
  141. "user": "hdfs",
  142. "count": 87
  143. },
  144. {
  145. "user": "zeppelin",
  146. "count": 37
  147. },
  148. {
  149. "user": "spark",
  150. "count": 30
  151. },
  152. {
  153. "user": "oozie",
  154. "count": 23
  155. },
  156. {
  157. "user": "ambari-qa",
  158. "count": 14
  159. },
  160. {
  161. "user": "hive",
  162. "count": 12
  163. },
  164. {
  165. "user": "yarn",
  166. "count": 3
  167. },
  168. {
  169. "user": "kafka",
  170. "count": 2
  171. },
  172. {
  173. "user": "mapred",
  174. "count": 2
  175. },
  176. {
  177. "user": "livy",
  178. "count": 1
  179. }
  180. ],
  181. "totalCount": 211
  182. }
  183. {
  184. "opType": "delete",
  185. "topUsers": [
  186. {
  187. "user": "spark",
  188. "count": 29
  189. },
  190. {
  191. "user": "hdfs",
  192. "count": 3
  193. },
  194. {
  195. "user": "ambari-qa",
  196. "count": 2
  197. },
  198. {
  199. "user": "hive",
  200. "count": 1
  201. }
  202. ],
  203. "totalCount": 35
  204. }
  205. {
  206. "opType": "create",
  207. "topUsers": [
  208. {
  209. "user": "spark",
  210. "count": 29
  211. },
  212. {
  213. "user": "hdfs",
  214. "count": 4
  215. },
  216. {
  217. "user": "kafka",
  218. "count": 1
  219. }
  220. ],
  221. "totalCount": 34
  222. }
  223. {
  224. "opType": "contentSummary",
  225. "topUsers": [
  226. {
  227. "user": "hdfs",
  228. "count": 7
  229. }
  230. ],
  231. "totalCount": 7
  232. }
{
    "opType": "*",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 332
        },
        {
            "user": "spark",
            "count": 117
        },
        {
            "user": "zeppelin",
            "count": 61
        },
        {
            "user": "oozie",
            "count": 52
        },
        {
            "user": "ambari-qa",
            "count": 20
        },
        {
            "user": "hive",
            "count": 17
        },
        {
            "user": "mapred",
            "count": 12
        },
        {
            "user": "yarn",
            "count": 9
        },
        {
            "user": "kafka",
            "count": 4
        },
        {
            "user": "livy",
            "count": 4
        }
    ],
    "totalCount": 628
}
{
    "opType": "setPermission",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 8
        }
    ],
    "totalCount": 8
}
{
    "opType": "setOwner",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 203
        }
    ],
    "totalCount": 203
}
{
    "opType": "open",
    "topUsers": [
        {
            "user": "zeppelin",
            "count": 22
        }
    ],
    "totalCount": 22
}
{
    "opType": "mkdirs",
    "topUsers": [
        {
            "user": "hive",
            "count": 4
        },
        {
            "user": "ambari-qa",
            "count": 4
        },
        {
            "user": "kafka",
            "count": 1
        },
        {
            "user": "hdfs",
            "count": 1
        },
        {
            "user": "livy",
            "count": 1
        }
    ],
    "totalCount": 11
}
{
    "opType": "listStatus",
    "topUsers": [
        {
            "user": "spark",
            "count": 29
        },
        {
            "user": "oozie",
            "count": 29
        },
        {
            "user": "hdfs",
            "count": 19
        },
        {
            "user": "mapred",
            "count": 10
        },
        {
            "user": "yarn",
            "count": 6
        },
        {
            "user": "zeppelin",
            "count": 2
        },
        {
            "user": "livy",
            "count": 2
        }
    ],
    "totalCount": 97
}
{
    "opType": "getfileinfo",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 87
        },
        {
            "user": "zeppelin",
            "count": 37
        },
        {
            "user": "spark",
            "count": 30
        },
        {
            "user": "oozie",
            "count": 23
        },
        {
            "user": "ambari-qa",
            "count": 14
        },
        {
            "user": "hive",
            "count": 12
        },
        {
            "user": "yarn",
            "count": 3
        },
        {
            "user": "kafka",
            "count": 2
        },
        {
            "user": "mapred",
            "count": 2
        },
        {
            "user": "livy",
            "count": 1
        }
    ],
    "totalCount": 211
}
{
    "opType": "delete",
    "topUsers": [
        {
            "user": "spark",
            "count": 29
        },
        {
            "user": "hdfs",
            "count": 3
        },
        {
            "user": "ambari-qa",
            "count": 2
        },
        {
            "user": "hive",
            "count": 1
        }
    ],
    "totalCount": 35
}
{
    "opType": "create",
    "topUsers": [
        {
            "user": "spark",
            "count": 29
        },
        {
            "user": "hdfs",
            "count": 4
        },
        {
            "user": "kafka",
            "count": 1
        }
    ],
    "totalCount": 34
}
{
    "opType": "contentSummary",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 7
        }
    ],
    "totalCount": 7
}
{
    "opType": "*",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 332
        },
        {
            "user": "spark",
            "count": 117
        },
        {
            "user": "zeppelin",
            "count": 61
        },
        {
            "user": "oozie",
            "count": 52
        },
        {
            "user": "ambari-qa",
            "count": 20
        },
        {
            "user": "hive",
            "count": 17
        },
        {
            "user": "mapred",
            "count": 12
        },
        {
            "user": "yarn",
            "count": 9
        },
        {
            "user": "kafka",
            "count": 4
        },
        {
            "user": "livy",
            "count": 4
        }
    ],
    "totalCount": 628
}
{
    "opType": "setPermission",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 8
        }
    ],
    "totalCount": 8
}
{
    "opType": "setOwner",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 203
        }
    ],
    "totalCount": 203
}
{
    "opType": "open",
    "topUsers": [
        {
            "user": "zeppelin",
            "count": 22
        }
    ],
    "totalCount": 22
}
{
    "opType": "mkdirs",
    "topUsers": [
        {
            "user": "hive",
            "count": 4
        },
        {
            "user": "ambari-qa",
            "count": 4
        },
        {
            "user": "kafka",
            "count": 1
        },
        {
            "user": "hdfs",
            "count": 1
        },
        {
            "user": "livy",
            "count": 1
        }
    ],
    "totalCount": 11
}
{
    "opType": "listStatus",
    "topUsers": [
        {
            "user": "spark",
            "count": 29
        },
        {
            "user": "oozie",
            "count": 29
        },
        {
            "user": "hdfs",
            "count": 19
        },
        {
            "user": "mapred",
            "count": 10
        },
        {
            "user": "yarn",
            "count": 6
        },
        {
            "user": "zeppelin",
            "count": 2
        },
        {
            "user": "livy",
            "count": 2
        }
    ],
    "totalCount": 97
}
{
    "opType": "getfileinfo",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 87
        },
        {
            "user": "zeppelin",
            "count": 37
        },
        {
            "user": "spark",
            "count": 30
        },
        {
            "user": "oozie",
            "count": 23
        },
        {
            "user": "ambari-qa",
            "count": 14
        },
        {
            "user": "hive",
            "count": 12
        },
        {
            "user": "yarn",
            "count": 3
        },
        {
            "user": "kafka",
            "count": 2
        },
        {
            "user": "mapred",
            "count": 2
        },
        {
            "user": "livy",
            "count": 1
        }
    ],
    "totalCount": 211
}
{
    "opType": "delete",
    "topUsers": [
        {
            "user": "spark",
            "count": 29
        },
        {
            "user": "hdfs",
            "count": 3
        },
        {
            "user": "ambari-qa",
            "count": 2
        },
        {
            "user": "hive",
            "count": 1
        }
    ],
    "totalCount": 35
}
{
    "opType": "create",
    "topUsers": [
        {
            "user": "spark",
            "count": 29
        },
        {
            "user": "hdfs",
            "count": 4
        },
        {
            "user": "kafka",
            "count": 1
        }
    ],
    "totalCount": 34
}
{
    "opType": "contentSummary",
    "topUsers": [
        {
            "user": "hdfs",
            "count": 7
        }
    ],
    "totalCount": 7
}

The complete output for 25, 5 and 1 minute

  1. 25 minutes top users
  2. {"opType":"*","topUsers":[{"user":"spark","count":84},{"user":"ambari-qa","count":10},{"user":"hive","count":9},{"user":"mapred","count":6},{"user":"yarn","count":5},{"user":"oozie","count":5}],"totalCount":119}
  3. {"opType":"mkdirs","topUsers":[{"user":"ambari-qa","count":2},{"user":"hive","count":2}],"totalCount":4}
  4. {"opType":"listStatus","topUsers":[{"user":"spark","count":21},{"user":"mapred","count":6},{"user":"yarn","count":5},{"user":"oozie","count":4}],"totalCount":36}
  5. {"opType":"getfileinfo","topUsers":[{"user":"spark","count":21},{"user":"ambari-qa","count":7},{"user":"hive","count":6}],"totalCount":34}
  6. {"opType":"delete","topUsers":[{"user":"spark","count":21},{"user":"ambari-qa","count":1},{"user":"hive","count":1}],"totalCount":23}
  7. {"opType":"create","topUsers":[{"user":"spark","count":21}],"totalCount":21}
  8. 5 minutes top users
  9. {"opType":"*","topUsers":[{"user":"spark","count":24},{"user":"yarn","count":1},{"user":"mapred","count":1},{"user":"oozie","count":1}],"totalCount":27}
  10. {"opType":"listStatus","topUsers":[{"user":"spark","count":6},{"user":"yarn","count":1},{"user":"mapred","count":1},{"user":"oozie","count":1}],"totalCount":9}
  11. {"opType":"getfileinfo","topUsers":[{"user":"spark","count":6}],"totalCount":6}
  12. {"opType":"delete","topUsers":[{"user":"spark","count":6}],"totalCount":6}
  13. {"opType":"create","topUsers":[{"user":"spark","count":6}],"totalCount":6}
  14. 1 minute top users
  15. {"opType":"*","topUsers":[{"user":"hdfs","count":332},{"user":"spark","count":313},{"user":"zeppelin","count":61},{"user":"oozie","count":60},{"user":"ambari-qa","count":40},{"user":"hive","count":35},{"user":"mapred","count":23},{"user":"yarn","count":17},{"user":"kafka","count":4},{"user":"livy","count":4}],"totalCount":889}
  16. {"opType":"setPermission","topUsers":[{"user":"hdfs","count":8}],"totalCount":8}
  17. {"opType":"setOwner","topUsers":[{"user":"hdfs","count":203}],"totalCount":203}
  18. {"opType":"open","topUsers":[{"user":"zeppelin","count":22}],"totalCount":22}
  19. {"opType":"mkdirs","topUsers":[{"user":"hive","count":8},{"user":"ambari-qa","count":8},{"user":"kafka","count":1},{"user":"hdfs","count":1},{"user":"livy","count":1}],"totalCount":19}
  20. {"opType":"listStatus","topUsers":[{"user":"spark","count":78},{"user":"oozie","count":37},{"user":"mapred","count":21},{"user":"hdfs","count":19},{"user":"yarn","count":14},{"user":"zeppelin","count":2},{"user":"livy","count":2}],"totalCount":173}
  21. {"opType":"getfileinfo","topUsers":[{"user":"hdfs","count":87},{"user":"spark","count":79},{"user":"zeppelin","count":37},{"user":"ambari-qa","count":28},{"user":"hive","count":24},{"user":"oozie","count":23},{"user":"yarn","count":3},{"user":"kafka","count":2},{"user":"mapred","count":2},{"user":"livy","count":1}],"totalCount":286}
  22. {"opType":"delete","topUsers":[{"user":"spark","count":78},{"user":"ambari-qa","count":4},{"user":"hdfs","count":3},{"user":"hive","count":3}],"totalCount":88}
  23. {"opType":"create","topUsers":[{"user":"spark","count":78},{"user":"hdfs","count":4},{"user":"kafka","count":1}],"totalCount":83}
  24. {"opType":"contentSummary","topUsers":[{"user":"hdfs","count":7}],"totalCount":7}
25 minutes top users
{"opType":"*","topUsers":[{"user":"spark","count":84},{"user":"ambari-qa","count":10},{"user":"hive","count":9},{"user":"mapred","count":6},{"user":"yarn","count":5},{"user":"oozie","count":5}],"totalCount":119}
{"opType":"mkdirs","topUsers":[{"user":"ambari-qa","count":2},{"user":"hive","count":2}],"totalCount":4}
{"opType":"listStatus","topUsers":[{"user":"spark","count":21},{"user":"mapred","count":6},{"user":"yarn","count":5},{"user":"oozie","count":4}],"totalCount":36}
{"opType":"getfileinfo","topUsers":[{"user":"spark","count":21},{"user":"ambari-qa","count":7},{"user":"hive","count":6}],"totalCount":34}
{"opType":"delete","topUsers":[{"user":"spark","count":21},{"user":"ambari-qa","count":1},{"user":"hive","count":1}],"totalCount":23}
{"opType":"create","topUsers":[{"user":"spark","count":21}],"totalCount":21}
5 minutes top users
{"opType":"*","topUsers":[{"user":"spark","count":24},{"user":"yarn","count":1},{"user":"mapred","count":1},{"user":"oozie","count":1}],"totalCount":27}
{"opType":"listStatus","topUsers":[{"user":"spark","count":6},{"user":"yarn","count":1},{"user":"mapred","count":1},{"user":"oozie","count":1}],"totalCount":9}
{"opType":"getfileinfo","topUsers":[{"user":"spark","count":6}],"totalCount":6}
{"opType":"delete","topUsers":[{"user":"spark","count":6}],"totalCount":6}
{"opType":"create","topUsers":[{"user":"spark","count":6}],"totalCount":6}
1 minute top users
{"opType":"*","topUsers":[{"user":"hdfs","count":332},{"user":"spark","count":313},{"user":"zeppelin","count":61},{"user":"oozie","count":60},{"user":"ambari-qa","count":40},{"user":"hive","count":35},{"user":"mapred","count":23},{"user":"yarn","count":17},{"user":"kafka","count":4},{"user":"livy","count":4}],"totalCount":889}
{"opType":"setPermission","topUsers":[{"user":"hdfs","count":8}],"totalCount":8}
{"opType":"setOwner","topUsers":[{"user":"hdfs","count":203}],"totalCount":203}
{"opType":"open","topUsers":[{"user":"zeppelin","count":22}],"totalCount":22}
{"opType":"mkdirs","topUsers":[{"user":"hive","count":8},{"user":"ambari-qa","count":8},{"user":"kafka","count":1},{"user":"hdfs","count":1},{"user":"livy","count":1}],"totalCount":19}
{"opType":"listStatus","topUsers":[{"user":"spark","count":78},{"user":"oozie","count":37},{"user":"mapred","count":21},{"user":"hdfs","count":19},{"user":"yarn","count":14},{"user":"zeppelin","count":2},{"user":"livy","count":2}],"totalCount":173}
{"opType":"getfileinfo","topUsers":[{"user":"hdfs","count":87},{"user":"spark","count":79},{"user":"zeppelin","count":37},{"user":"ambari-qa","count":28},{"user":"hive","count":24},{"user":"oozie","count":23},{"user":"yarn","count":3},{"user":"kafka","count":2},{"user":"mapred","count":2},{"user":"livy","count":1}],"totalCount":286}
{"opType":"delete","topUsers":[{"user":"spark","count":78},{"user":"ambari-qa","count":4},{"user":"hdfs","count":3},{"user":"hive","count":3}],"totalCount":88}
{"opType":"create","topUsers":[{"user":"spark","count":78},{"user":"hdfs","count":4},{"user":"kafka","count":1}],"totalCount":83}
{"opType":"contentSummary","topUsers":[{"user":"hdfs","count":7}],"totalCount":7}
25 minutes top users
{"opType":"*","topUsers":[{"user":"spark","count":84},{"user":"ambari-qa","count":10},{"user":"hive","count":9},{"user":"mapred","count":6},{"user":"yarn","count":5},{"user":"oozie","count":5}],"totalCount":119}
{"opType":"mkdirs","topUsers":[{"user":"ambari-qa","count":2},{"user":"hive","count":2}],"totalCount":4}
{"opType":"listStatus","topUsers":[{"user":"spark","count":21},{"user":"mapred","count":6},{"user":"yarn","count":5},{"user":"oozie","count":4}],"totalCount":36}
{"opType":"getfileinfo","topUsers":[{"user":"spark","count":21},{"user":"ambari-qa","count":7},{"user":"hive","count":6}],"totalCount":34}
{"opType":"delete","topUsers":[{"user":"spark","count":21},{"user":"ambari-qa","count":1},{"user":"hive","count":1}],"totalCount":23}
{"opType":"create","topUsers":[{"user":"spark","count":21}],"totalCount":21}
5 minutes top users
{"opType":"*","topUsers":[{"user":"spark","count":24},{"user":"yarn","count":1},{"user":"mapred","count":1},{"user":"oozie","count":1}],"totalCount":27}
{"opType":"listStatus","topUsers":[{"user":"spark","count":6},{"user":"yarn","count":1},{"user":"mapred","count":1},{"user":"oozie","count":1}],"totalCount":9}
{"opType":"getfileinfo","topUsers":[{"user":"spark","count":6}],"totalCount":6}
{"opType":"delete","topUsers":[{"user":"spark","count":6}],"totalCount":6}
{"opType":"create","topUsers":[{"user":"spark","count":6}],"totalCount":6}
1 minute top users
{"opType":"*","topUsers":[{"user":"hdfs","count":332},{"user":"spark","count":313},{"user":"zeppelin","count":61},{"user":"oozie","count":60},{"user":"ambari-qa","count":40},{"user":"hive","count":35},{"user":"mapred","count":23},{"user":"yarn","count":17},{"user":"kafka","count":4},{"user":"livy","count":4}],"totalCount":889}
{"opType":"setPermission","topUsers":[{"user":"hdfs","count":8}],"totalCount":8}
{"opType":"setOwner","topUsers":[{"user":"hdfs","count":203}],"totalCount":203}
{"opType":"open","topUsers":[{"user":"zeppelin","count":22}],"totalCount":22}
{"opType":"mkdirs","topUsers":[{"user":"hive","count":8},{"user":"ambari-qa","count":8},{"user":"kafka","count":1},{"user":"hdfs","count":1},{"user":"livy","count":1}],"totalCount":19}
{"opType":"listStatus","topUsers":[{"user":"spark","count":78},{"user":"oozie","count":37},{"user":"mapred","count":21},{"user":"hdfs","count":19},{"user":"yarn","count":14},{"user":"zeppelin","count":2},{"user":"livy","count":2}],"totalCount":173}
{"opType":"getfileinfo","topUsers":[{"user":"hdfs","count":87},{"user":"spark","count":79},{"user":"zeppelin","count":37},{"user":"ambari-qa","count":28},{"user":"hive","count":24},{"user":"oozie","count":23},{"user":"yarn","count":3},{"user":"kafka","count":2},{"user":"mapred","count":2},{"user":"livy","count":1}],"totalCount":286}
{"opType":"delete","topUsers":[{"user":"spark","count":78},{"user":"ambari-qa","count":4},{"user":"hdfs","count":3},{"user":"hive","count":3}],"totalCount":88}
{"opType":"create","topUsers":[{"user":"spark","count":78},{"user":"hdfs","count":4},{"user":"kafka","count":1}],"totalCount":83}
{"opType":"contentSummary","topUsers":[{"user":"hdfs","count":7}],"totalCount":7}

 

Please follow and like us:
error
fb-share-icon
Tweet
CategoryBigData Hadoop Hortonworks Non classé

1 Comment

Leave a Reply to Yann Cancel reply

Your email address will not be published. Required fields are marked *