Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-325

FIWARE.Request.Tech.Data.BigData-Analysis.Parquet

    Details

      Description

      Hello can you please direct this question to right person.
      Thank you.
      ---------- Forwarded message ----------
      From: Dave Watson <watson.dave@gmail.com>
      Date: Mon, Sep 29, 2014 at 7:07 PM
      Subject: Question re FIWARE COSMOS
      To: francisco.romerobueno@telefonica.com, frb@tid.es

      Hello Francisco:

      We attended FI-WARE meeting today in London and it was suggested we direct
      question to you.

      1) Do you support Parquet files in the HDFS? (Your documentation only shows
      example of CSV file)

      2) Will the version of Hadoop in Cosmos be upgraded so we can work with
      Spark and Drill?

      3) What is the memory configuration for nodes in the FIWARE Lab and Testbed
      instances?

      See below regarding Drill 0.5 version support:

      Drill now uses the Hadoop 2.4.1 APIs. This includes upgrading Parquet to
      use direct memory and the ability to write larger Parquet files

      https://blogs.apache.org/drill/entry/apache_drill_beta_release_see

      https://cwiki.apache.org/confluence/display/DRILL/Apache+Drill+0.5.0+Release+Notes

      Thanks for your help here.

      Dave

      Dave Watson
      +447741675325

      Dave Watson
      +447741675325

      _______________________________________________
      Fiware-tech-help mailing list
      Fiware-tech-help@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-tech-help

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        To Do To Do In Progress In Progress
        4d 4h 16m 1 Francisco Romero 09/Oct/14 3:46 PM
        Done Done In Progress In Progress
        13d 6h 43m 1 Manuel Escriche 22/Oct/14 10:30 PM
        In Progress In Progress Done Done
        1m 38s 2 Manuel Escriche 22/Oct/14 10:31 PM
        Done Done Closed Closed
        446d 11h 36m 1 Manuel Escriche 12/Jan/16 9:08 AM

          People

          • Assignee:
            frb Francisco Romero
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: