Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-325

FIWARE.Request.Tech.Data.BigData-Analysis.Parquet

    Details

      Description

      Hello can you please direct this question to right person.
      Thank you.
      ---------- Forwarded message ----------
      From: Dave Watson <watson.dave@gmail.com>
      Date: Mon, Sep 29, 2014 at 7:07 PM
      Subject: Question re FIWARE COSMOS
      To: francisco.romerobueno@telefonica.com, frb@tid.es

      Hello Francisco:

      We attended FI-WARE meeting today in London and it was suggested we direct
      question to you.

      1) Do you support Parquet files in the HDFS? (Your documentation only shows
      example of CSV file)

      2) Will the version of Hadoop in Cosmos be upgraded so we can work with
      Spark and Drill?

      3) What is the memory configuration for nodes in the FIWARE Lab and Testbed
      instances?

      See below regarding Drill 0.5 version support:

      Drill now uses the Hadoop 2.4.1 APIs. This includes upgrading Parquet to
      use direct memory and the ability to write larger Parquet files

      https://blogs.apache.org/drill/entry/apache_drill_beta_release_see

      https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+0.5.0+Release+Notes

      Thanks for your help here.

      Dave

      Dave Watson
      +447741675325

      Dave Watson
      +447741675325

      _______________________________________________
      Fiware-tech-help mailing list
      Fiware-tech-help@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-tech-help

        Activity

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: