Big Data Collection with Desktop version of loklak wok

A desktop version of loklak wok is now available. The goal of the wok is to enable users to collect and parse data from social services like twitter and enable users, citizen scientists and companies to analyze big data.

The origin of the project is a tweet by @Frank_gamefreak. Thank you!

Please join the development on GitHub: https://github.com/loklak/loklak_wok_desktop

desktop_wok_heap_up_display

How to compile and run

  • import required lib by running setup.sh
  • compile with mvn clean install -Pexecutable-jar
  • run artifact in target dircetory: java -jar wok-desktop-0.0.1-SNAPSHOT-jar-with-all-dependencies.jar
  • stop program with ESC key

To be done

  • The code has been hacked and butchered and is some kind of Frankenstein. It needs cleanup.
  • Font size is hardcoded. How ugly is that?
  • It would be cool to have a project for code shared between Android and Desktop version.
  • The only dependency which can not be resolved via Maven is loklakj. Wouldn’t it be cool to change that?
  • The used font does not seem to support Asian characters.
Big Data Collection with Desktop version of loklak wok

Elasticsearch node built into loklak

loklak has a built-in elasticsearch node, bit it can also connect as a transport client to a elasticsearch cluster. Here are some screenshots of elastic-hq of a 16-shard 8-disk 2-server 16-core loklak cluster.

elastic_plugin_hq_cluster_overview_screenshot

elastic_plugin_hq_node_diagnostic_graph_screenshot

elastic_plugin_head_cluster_screenshot

elastic_plugin_head_browser_screenshot

 

Elasticsearch node built into loklak

Data Collection and Parsing on Android with loklak wok

We now have a data parser to collect data, that you want to analyze. It is called loklak wok and runs on your android phone. The showcase collects tweet data for loklak.

Please check it out and test development!

Github: https://github.com/loklak/loklak_wok_android

android_wok_welcome_screenshot

Data Collection and Parsing on Android with loklak wok