{"id":589,"date":"2013-10-02T02:16:17","date_gmt":"2013-10-02T02:16:17","guid":{"rendered":"http:\/\/technicalelvis.com\/blog\/?p=589"},"modified":"2013-10-02T02:18:51","modified_gmt":"2013-10-02T02:18:51","slug":"json-output-mahout-clusterdump","status":"publish","type":"post","link":"https:\/\/technicalelvis.com\/blog\/2013\/10\/02\/json-output-mahout-clusterdump\/","title":{"rendered":"Added JSON output to mahout clusterdump"},"content":{"rendered":"

In a prior post<\/a>, I used\u00a0mahout<\/a> to cluster religious tweeters by bible books found in the tweets. The clusterdump<\/em> utility prints the kmeans cluster output in free text format. \u00a0I've submitted a patch <\/a>to mahout\u00a0that adds JSON output format to clusterdump<\/em>. JSON is machine readable and makes it easy for an application developed in another framework (like django) to read the clusters.<\/p>\n

The code lives in my mahout fork on github<\/a>. Run the commands below to build it.<\/p>\n

\r\ngit clone git@github.com:telvis07\/mahout.git\r\ncd mahout\r\nmvn compile package -DskipTests\r\n\r\n# to (optionally) run the unittest for this feature\r\nmvn -pl integration \\\r\n -Dtest=*.TestClusterDumper#testJsonClusterDumper test\r\n\r\n.\/bin\/mahout clusterdump -d dictionary -dt \\\r\n  text -i clusters\/clusters-*-final -p clusters\/clusteredPoints \\\r\n  -n 10 -o clusterdump.json -of JSON\r\n<\/pre>\n
The command produces output similar to this...<\/p>\n
\r\n{\r\n  "top_terms": [\r\n    {\r\n      "term": "proverbs",\r\n      "weight": 0.19125590817015531\r\n    },\r\n    {\r\n      "term": "romans",\r\n      "weight": 0.16306549628629305\r\n    }\r\n  ],\r\n  "points": [\r\n    {\r\n      "vector_name": "ssbo",\r\n      "weight": "1.0",\r\n      "point": "ssbo = [proverbs:1.000]"\r\n    },\r\n    {\r\n      "vector_name": "37_DC",\r\n      "weight": "1.0",\r\n      "point": "37_DC = [proverbs:1.000]"\r\n    },\r\n    {\r\n      "vector_name": "3HHHs",\r\n      "weight": "1.0",\r\n      "point": "3HHHs = [proverbs:1.000]"\r\n    },\r\n    {\r\n      "vector_name": "EPUBC",\r\n      "weight": "1.0",\r\n      "point": "EPUBC = [proverbs:1.000]"\r\n    },\r\n    {\r\n      "vector_name": "ILJ_4",\r\n      "weight": "1.0",\r\n      "point": "ILJ_4 = [romans:1.000]"\r\n    }\r\n  ],\r\n  "cluster_id": 10515,\r\n  "cluster": "VL-10515{n=5924 c=[genesis:0.000, exodus:0.009, ...]}"\r\n}\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"
In a prior post, I used\u00a0mahout to cluster religious tweeters by bible books found in the tweets. The clusterdump utility prints the kmeans cluster output in free text format. \u00a0I’ve submitted a patch to mahout\u00a0that adds JSON output format to clusterdump. JSON is machine readable and makes it easy for an application developed in another … Continue reading Added JSON output to mahout clusterdump<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[12],"tags":[],"class_list":["post-589","post","type-post","status-publish","format-standard","hentry","category-twitter_mining"],"_links":{"self":[{"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/posts\/589","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/comments?post=589"}],"version-history":[{"count":33,"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/posts\/589\/revisions"}],"predecessor-version":[{"id":624,"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/posts\/589\/revisions\/624"}],"wp:attachment":[{"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/media?parent=589"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/categories?post=589"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/technicalelvis.com\/blog\/wp-json\/wp\/v2\/tags?post=589"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}