Created question in FIWARE Q/A platform on 13-06-2014 at 14:06
Please, ANSWER this question AT https://stackoverflow.com/questions/24205480/fi-ware-bigdata-configuration

Question:
Fi-Ware Bigdata configuration

Description:
I'm reading a tutorial to Bigdata installationg over Fi-Ware.

https://github.com/telefonicaid/fiware-connectors/blob/develop/flume/README.md

I've completed susccesfully steps up to "Installing Cygnus and its dependencies". I've realized there is a new Cygnus version (0.3 instead of 0.2.1 used in the tutorial). I'd like to know if it is necesary to acomplish another step related to dependences installation.

I found in the tutorial the next paragraph

OrionCKANSink dependencies

These are the packages you will need to install under APACHE_FLUME_HOME/plugins.d/cygnus/libext if you did not included them in the Cygnus package:

json-simple-1.1.jar
OrionHDFSSink dependencies

These are the packages you will need to install under APACHE_FLUME_HOME/plugins.d/cygnus/libext if you did not included them in the Cygnus package:

hadoop-core-0.20.0.jar (or higher)
hive-exec-0.12.0.jar
hive-jdbc-0.12.0.jar
hive-metastore-0.12.0.jar
hive-service-0.12.0.jar
hive-common-0.12.0.jar
hive-shims-0.12.0.jar

These packages are not necessary to be installed since they are already included in the Flume bundle (they have been listed just for informative purposes):

httpclient-4.2.1.jar
httpcore-4.2.2.jar

In addition, as already said, remember to overwrite the APACHE_FLUME_HOME/lib/libthrift-0.7.0.jar package with this one:

libthrift-0.9.1.jar

Finally, if you are planning to use the OrionMySQLSink, include the latest MySQL connector in APACHE_FLUME_HOME/plugins.d/cygnus/libext:

mysql-connector-java-5.1.26-bin.jar

Is there an easier way to install and configure cygnus?? It seems to difficult to use Bigdata with fi-ware.

Thank you