Uploaded image for project: 'Help-Desk'
  1. Help-Desk
  2. HELP-2182

FIWARE.Request.Lab.UAT | 7 Regions tested: "create a VM" scenario.

    Details

    • Type: extRequest
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: 2021
    • Component/s: FIWARE-LAB-HELP
    • Labels:
      None

      Description

      Dear FIWARE teams,

      in terms of our survey for European Pioneers we have executed a User
      Acceptance Test nailed down to the most essential end-user scenario for 7
      regions listed below:

      „I want to be able to get a shell access with a public IP to an instance in
      a simple and straightforward way“.

      We are available that Terms of Usage are changing soon and ID verfication
      will be required to access public IPs, but this is not the issue here.

      We have tried today to create an instance in each region with the following
      results. (Account name for admins to look up the logs:
      christian.bonkowski@iais.fraunhofer.de
      <christian.bonkowski@iais.fraunhofer.de> , instance name: test-iais)
      Every time we expected that same steps are required to create a VM with a
      public IP and shell acccess. We assume also that not every potential
      customer with overall intermediate skill level has enough knowledge to
      manually configure a network.

      Typical error pattern in many cases was, there is a default network which
      cannot be used without an error, and custom network usage can also result in
      an error.

      Region

      Public IP allowed

      Manual

      Details

      UAT synopsis

      UAT: get IP+VM shell

      Lannion

      Yes

      Yes

      Manual 12 pages, not very straightforward.

      With manual acceptable but not competitive.

      PASS

      Spain

      Yes

      No

      No Networks/Router, auto-assign of int. IP

      Allocation of public IP easy.

      PASS

      Trento

      No

      No

      Much trial&error required

      Admin skills needed for network

      FAIL

      Waterford

      Yes

      No

      Manual network config

      Undefined error on IP assign.

      FAIL

      Berlin

      No

      No

      Manual network config

      No public IP available.

      FAIL

      Pragua

      Yes

      No

      As in Spain, no networks

      IP ok. Error on instance creation.

      FAIL

      Mexico

      Yes

      No

      Own network = no instance

      400 error on instance launch.

      FAIL

      We recommend a to implement a formal quality assurance process based on an
      audit so that all regions can implement same must-have common functionality
      at least for this one scenario, if possible. Think of McDonlads: you get
      identical Cola &BigMac offer everywhere but some regions have got their own
      food specials.

      Additionally, most successful regions like Spain might want to share their
      knowledge with other regions.

      Kind regards / viele Grüße & Servus

      Peter Muryshkin, M. Sc.

      Skype ID: peter_iais

      LinkedIn: http://de.linkedin.com/in/muryshkin

      ----------------------------------------------------------------------------
      ------

      NetMedia / B3-342

      Fraunhofer IAIS

      Schloss Birlinghoven 1

      53754 St. Augustin, Germany

      T: +49 2241 14 3413

      Email: <Peter.Muryshkin@iais.fraunhofer.de>
      Peter.Muryshkin@iais.fraunhofer.de

      _______________________________________________
      Fiware-lab-help mailing list
      Fiware-lab-help@lists.fi-ware.org
      https://lists.fi-ware.org/listinfo/fiware-lab-help

      [Created via e-mail received from: "Muryshkin, Peter" <Peter.Muryshkin@iais.fraunhofer.de>]

      1. image001.png
        20 kB
      2. prag_vm.png
        43 kB

        Activity

        Hide
        ffacca Federico Michele Facca added a comment -

        Dear Peter,
        Thanks for your feedbacks. There is an ongoing effort to make uniform as
        much as possible set-up across nodes (in term of naming conventions across
        network and access to shared / external networks).

        Still, things cannot be identical on each node for several reasons related
        to the ability of provide more advanced services to users. Spain uses a
        "dumb" service for the network, which has many limitations (sure it's
        bullet proof for any unskilled user): e.g. the network that is shared among
        all users, which means any vm in spain (regardless the tenant owning it)
        can reach transparently any other vm in spain (which is not very safe).

        We are going as well to free up resources, thanks to the application of new
        policies, that will as well reduce number of errors caused by the fact that
        a region is full. We are also establishing automatic functional testing
        over each node to be run daily to ensure that nodes behave as supposed.

        Regards,
        Federico

        On Thu, Feb 19, 2015 at 4:12 PM, Muryshkin, Peter <



        Future Internet is closer than you think!
        http://www.fiware.org

        Official Mirantis partner for OpenStack Training
        https://www.create-net.org/community/openstack-training


        Dr. Federico M. Facca

        CREATE-NET
        Via alla Cascata 56/D
        38123 Povo Trento (Italy)

        P +39 0461 312471
        M +39 334 6049758
        E federico.facca@create-net.org
        T @chicco785
        W www.create-net.org

        _______________________________________________
        Fiware-tech-help mailing list
        Fiware-tech-help@lists.fi-ware.org
        https://lists.fi-ware.org/listinfo/fiware-tech-help

        Show
        ffacca Federico Michele Facca added a comment - Dear Peter, Thanks for your feedbacks. There is an ongoing effort to make uniform as much as possible set-up across nodes (in term of naming conventions across network and access to shared / external networks). Still, things cannot be identical on each node for several reasons related to the ability of provide more advanced services to users. Spain uses a "dumb" service for the network, which has many limitations (sure it's bullet proof for any unskilled user): e.g. the network that is shared among all users, which means any vm in spain (regardless the tenant owning it) can reach transparently any other vm in spain (which is not very safe). We are going as well to free up resources, thanks to the application of new policies, that will as well reduce number of errors caused by the fact that a region is full. We are also establishing automatic functional testing over each node to be run daily to ensure that nodes behave as supposed. Regards, Federico On Thu, Feb 19, 2015 at 4:12 PM, Muryshkin, Peter < – – Future Internet is closer than you think! http://www.fiware.org Official Mirantis partner for OpenStack Training https://www.create-net.org/community/openstack-training – Dr. Federico M. Facca CREATE-NET Via alla Cascata 56/D 38123 Povo Trento (Italy) P +39 0461 312471 M +39 334 6049758 E federico.facca@create-net.org T @chicco785 W www.create-net.org _______________________________________________ Fiware-tech-help mailing list Fiware-tech-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-tech-help
        Hide
        ffacca Federico Michele Facca added a comment -

        Dear Peter,
        Thanks for your feedbacks. There is an ongoing effort to make uniform as
        much as possible set-up across nodes (in term of naming conventions across
        network and access to shared / external networks).

        Still, things cannot be identical on each node for several reasons related
        to the ability of provide more advanced services to users. Spain uses a
        "dumb" service for the network, which has many limitations (sure it's
        bullet proof for any unskilled user): e.g. the network that is shared among
        all users, which means any vm in spain (regardless the tenant owning it)
        can reach transparently any other vm in spain (which is not very safe).

        We are going as well to free up resources, thanks to the application of new
        policies, that will as well reduce number of errors caused by the fact that
        a region is full. We are also establishing automatic functional testing
        over each node to be run daily to ensure that nodes behave as supposed.

        Regards,
        Federico

        On Thu, Feb 19, 2015 at 4:12 PM, Muryshkin, Peter <



        Future Internet is closer than you think!
        http://www.fiware.org

        Official Mirantis partner for OpenStack Training
        https://www.create-net.org/community/openstack-training


        Dr. Federico M. Facca

        CREATE-NET
        Via alla Cascata 56/D
        38123 Povo Trento (Italy)

        P +39 0461 312471
        M +39 334 6049758
        E federico.facca@create-net.org
        T @chicco785
        W www.create-net.org

        _______________________________________________
        Fiware-lab-help mailing list
        Fiware-lab-help@lists.fi-ware.org
        https://lists.fi-ware.org/listinfo/fiware-lab-help

        Show
        ffacca Federico Michele Facca added a comment - Dear Peter, Thanks for your feedbacks. There is an ongoing effort to make uniform as much as possible set-up across nodes (in term of naming conventions across network and access to shared / external networks). Still, things cannot be identical on each node for several reasons related to the ability of provide more advanced services to users. Spain uses a "dumb" service for the network, which has many limitations (sure it's bullet proof for any unskilled user): e.g. the network that is shared among all users, which means any vm in spain (regardless the tenant owning it) can reach transparently any other vm in spain (which is not very safe). We are going as well to free up resources, thanks to the application of new policies, that will as well reduce number of errors caused by the fact that a region is full. We are also establishing automatic functional testing over each node to be run daily to ensure that nodes behave as supposed. Regards, Federico On Thu, Feb 19, 2015 at 4:12 PM, Muryshkin, Peter < – – Future Internet is closer than you think! http://www.fiware.org Official Mirantis partner for OpenStack Training https://www.create-net.org/community/openstack-training – Dr. Federico M. Facca CREATE-NET Via alla Cascata 56/D 38123 Povo Trento (Italy) P +39 0461 312471 M +39 334 6049758 E federico.facca@create-net.org T @chicco785 W www.create-net.org _______________________________________________ Fiware-lab-help mailing list Fiware-lab-help@lists.fi-ware.org https://lists.fi-ware.org/listinfo/fiware-lab-help
        Hide
        peter Peter Muryshkin added a comment -

        Dear Jan,

        thanks for your feedback and sorry for the glitch in my report!

        The VM is indeed running, but the UAT test fails for other reason, namely it

        was not possibe to assign a public IP.

        See also the global this test suite:

        http://fi-health.lab.fi-ware.eu/RegionSanityCheck/

        Here you can view, what is being tested (Python-based)

        <https://github.com/telefonicaid/fiware-health>
        https://github.com/telefonicaid/fiware-health

        Show
        peter Peter Muryshkin added a comment - Dear Jan, thanks for your feedback and sorry for the glitch in my report! The VM is indeed running, but the UAT test fails for other reason, namely it was not possibe to assign a public IP. See also the global this test suite: http://fi-health.lab.fi-ware.eu/RegionSanityCheck/ Here you can view, what is being tested (Python-based) < https://github.com/telefonicaid/fiware-health > https://github.com/telefonicaid/fiware-health

          People

          • Assignee:
            ffacca Federico Michele Facca
            Reporter:
            fw.ext.user FW External User
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: