Quantcast
Channel: Openstack RDO && KVM Hypervisor
Viewing all articles
Browse latest Browse all 331

Attempt to verify patch for "metadata service PicklingError" on TripleO QS Master (Pike)

$
0
0
Perform minimal overcloud deployment via TripleO QuickStart  Master (Pike) branch and login to Controller.  The next move is supposed be patching /usr/lib/python2.7/site-packages/nova/api/metadata/base.py as suggested in https://bugs.launchpad.net/nova/+bug/1694666
to avoid waiting for commit's appearance in Delorean RDO trunk for Master.


# cd /usr/lib/python2.7/site-packages/nova/api/metadata
Then aplly patches
1)
https://git.openstack.org/cgit/openstack/nova/patch/?id=2fee972bde4a04d398d32aa6c8b6d27819db697b
2)
https://review.openstack.org/gitweb?p=openstack/nova.git;a=patch;h=ced5b6a7f9e713d83915e9d832ada1eb61c4caf9

to base.py
****************************************************************************
After patching  the critical piece of code base.py should look like
Details here https://bugs.launchpad.net/nova/+bug/1694666
****************************************************************************
class InstanceMetadata(object):
    """Instance metadata."""

    def __init__(self, instance, address=None, content=None, extra_md=None,
                 network_info=None, vd_driver=None, network_metadata=None,
                 request_context=None):
        """Creation of this object should basically cover all time consuming
        collection.  Methods after that should not cause time delays due to
        network operations or lengthy cpu operations.

        The user should then get a single instance and make multiple method
        calls on it.
        """
        if not content:
            content = []

        ctxt = context.get_admin_context()
        instance.ec2_ids
        instance.keypairs
        instance.device_metadata
        instance = objects.Instance.obj_from_primitive(
             instance.obj_to_primitive())


# python -m py_compile base.py
# yum install openstack-utils -y
# openstack-service restart nova

Setup sshuttle connection [1] to external and ctlplane networks. Invoke dashoard
via VIP from overcloudrc.v3 (  password for root is there as well ) and attempt to launch an instance via prepared cinder's volume. Next step is verfication of
instance console log via dashboard either `openstack console log show` command and make sure that there are no longer issues with metadata access
during cloud instance booting up. The only problem I was experiencing was
assigning FIP via openstack CLI ( dashboard is not  quite tuned at the moment )



(overcloud) [root@overcloud-controller-0 ~]# openstack image list
+--------------------------------------+-------------------------+--------+
| ID                                   | Name                    | Status |
+--------------------------------------+-------------------------+--------+
| 3bbcaacc-37ed-47ba-920e-9fcae14d7007 | VF24Cloud-image         | active |
| 259dac07-a1df-4a43-995f-643efb0b1b68 | XenialServerCloud-image | active |
+--------------------------------------+-------------------------+--------+
(overcloud) [root@overcloud-controller-0 ~]# openstack volume create --image 259dac07-a1df-4a43-995f-643efb0b1b68 \
>    --size 5 --availability-zone nova XenialVolume05
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| attachments         | []                                   |
| availability_zone   | nova                                 |
| bootable            | false                                |
| consistencygroup_id | None                                 |
| created_at          | 2017-06-30T18:51:49.449418           |
| description         | None                                 |
| encrypted           | False                                |
| id                  | fb88fcc4-a3e0-4c8b-8e78-970dc994f4e8 |
| migration_status    | None                                 |
| multiattach         | False                                |
| name                | XenialVolume05                       |
| properties          |                                      |
| replication_status  | None                                 |
| size                | 5                                    |
| snapshot_id         | None                                 |
| source_volid        | None                                 |
| status              | creating                             |
| type                | None                                 |
| updated_at          | None                                 |
| user_id             | 1a1e200fa44146b5b57a1391a3f27524     |
+---------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack volume list
+--------------------------------------+----------------+-----------+------+-------------+
| ID                                   | Display Name   | Status    | Size | Attached to |
+--------------------------------------+----------------+-----------+------+-------------+
| fb88fcc4-a3e0-4c8b-8e78-970dc994f4e8 | XenialVolume05 | available |    5 |             |
+--------------------------------------+----------------+-----------+------+-------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack floating ip create ext-net
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| created_at          | 2017-06-30T19:00:59Z                 |
| description         |                                      |
| fixed_ip_address    | None                                 |
| floating_ip_address | 192.168.24.108                       |
| floating_network_id | 6111bc0f-9dfa-4183-8827-126a113ab203 |
| id                  | 1b43ddb0-fc21-40d6-a086-dd0f9bb3d4ec |
| name                | 192.168.24.108                       |
| port_id             | None                                 |
| project_id          | 58f03dba255d48b795adcfde91ad381f     |
| revision_number     | 0                                    |
| router_id           | None                                 |
| status              | DOWN                                 |
| updated_at          | 2017-06-30T19:00:59Z                 |
+---------------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+----------------+--------+------------+-------------+----------------------+
| ID                                   | Name           | Status | Task State | Power State | Networks             |
+--------------------------------------+----------------+--------+------------+-------------+----------------------+
| 66b57844-aff2-4c66-979c-56c6b4c8d628 | XenialServer01 | ACTIVE | -          | Running     | internal01=50.0.0.12 |
+--------------------------------------+----------------+--------+------------+-------------+----------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack server add floating ip XenialServer01  192.168.24.108
(overcloud) [root@overcloud-controller-0 ~]# nova list
+--------------------------------------+----------------+--------+------------+-------------+--------------------------------------+
| ID                                   | Name           | Status | Task State | Power State | Networks                             |
+--------------------------------------+----------------+--------+------------+-------------+--------------------------------------+
| 66b57844-aff2-4c66-979c-56c6b4c8d628 | XenialServer01 | ACTIVE | -          | Running     | internal01=50.0.0.12, 192.168.24.108 |
+--------------------------------------+----------------+--------+------------+-------------+--------------------------------------+
(overcloud) [root@overcloud-controller-0 ~]# openstack console log show XenialServer01

. . . . . . . . . . . . .

         Starting Initial cloud-init job (metadata service crawler)...
[   20.118966] cloud-init[852]: Cloud-init v. 0.7.9 running 'init' at Fri, 30 Jun 2017 18:54:09 +0000. Up 12.86 seconds.
[   20.128584] cloud-init[852]: ci-info: ++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
[   20.141078] cloud-init[852]: ci-info: +--------+------+------------------------------+---------------+-------+-------------------+
[   20.153095] cloud-init[852]: ci-info: | Device |  Up  |           Address            |      Mask     | Scope |     Hw-Address    |
[   20.165054] cloud-init[852]: ci-info: +--------+------+------------------------------+---------------+-------+-------------------+
[   20.177045] cloud-init[852]: ci-info: |   lo   | True |          127.0.0.1           |   255.0.0.0   |   .   |         .         |
[   20.187503] cloud-init[852]: ci-info: |   lo   | True |           ::1/128            |       .       |  host |         .         |[[0;32m  OK  [0m] Started Initial cloud-init job (metadata service crawler).

[   20.196791] cloud-init[852]: ci-info: |  ens3  | True |          50.0.0.12           | 255.255.255.0 |   .   | fa:16:3e:3a:8e:a2 |[[0;32m  OK  [0m] Reached target System Initialization.
[[0;32m  OK  [0m] Started Daily apt activities.
        
[   20.209068] cloud-init[852]: ci-info: |  ens3  | True | fe80::f816:3eff:fe3a:8ea2/64 |       .       |  link | fa:16:3e:3a:8e:a2 |Starting Socket activation for snappy daemon.
[[0;32m  OK  [0m
[   20.216581] cloud-init[852]: ci-info: +--------+------+------------------------------+---------------+-------+-------------------+] Listening on D-Bus System Message Bus Socket.
[[0;32m  OK  [0m]
[   20.225083] cloud-init[852]: ci-info: ++++++++++++++++++++++++++++++Route IPv4 info+++++++++++++++++++++++++++++++Started Timer to automatically refresh installed snaps.
[[0;32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[   20.233700] cloud-init[852]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
[[0;32m  OK  [0m] Reached target Timers.
[[0;32m  OK  [0m] Listening on ACPID Listen Socket.

[   20.244261] cloud-init[852]: ci-info: | Route |   Destination   | Gateway  |     Genmask     | Interface | Flags |         Starting LXD - unix socket.
[[0;32m  OK  [0m] Listening on UUID daemon activation socket.

[   20.255715] cloud-init[852]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
[[0;32m  OK  [0m] Started ACPI Events Check.
[[   20.264123] cloud-init[852]: ci-info: |   0   |     0.0.0.0     | 50.0.0.1 |     0.0.0.0     |    ens3   |   UG  |
[0;32m  OK  [0m] Reached target Paths.
[[0;32m  OK  [0m] Reached target Cloud-config availability.[   20.272806] cloud-init[852]: ci-info: |   1   |     50.0.0.0    | 0.0.0.0  |  255.255.255.0  |    ens3   |   U   |
[[0;32m  OK  [0m] Reached target Network is Online.

         Starting iSCSI initiator daemon (iscsid)...
[   20.284103] cloud-init[852]: ci-info: |   2   | 169.254.169.254 | 50.0.0.1 | 255.255.255.255 |    ens3   |  UGH  |[[0;32m  OK  [0m] Listening on Socket activation for snappy daemon.
[[0;32m  OK  [0m] Listening on LXD - unix socket.

[   20.300574] cloud-init[852]: ci-info: +-------+-----------------+----------+-----------------+-----------+-------+[[0;32m  OK  [0m] Reached target Sockets.
[   20.313364] cloud-init[852]:
[[0;32m  OK  [0m] Reached target Basic System.
Generating public/private rsa key pair.
[   20.322983] cloud-init[852]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key.
[   20.327571] cloud-init[852]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.
[[0;32m  OK  [0m] Started Regular background program processing daemon.[   20.340657] cloud-init[852]: The key fingerprint is:
[   20.344949] cloud-init[852]: SHA256:K9+a0hTUJkY8w5cdFEturqW0FFTg5rfhBO9+9ldygKY root@xenialserver01

[   20.350929] cloud-init[852]: The key's randomart image is:         Starting Pollinate to seed the pseudo random number generator...
[   20.358536] cloud-init
[[0;32m  OK  [0m] Started Deferred execution scheduler.
[852]:          Starting System Logging Service...+---[RSA 2048]----+
         Starting Login Service...
         Starting Accounts Service...
[
[   20.385453] [0;32m  OK  [0m] Started Unattended Upgrades Shutdown.
         Starting Apply the settings specified in cloud-config...cloud-init[852]: |       +..o**o   |
[   20.400313] cloud-init[852]:
         Starting /etc/rc.local Compatibility...
         Starting LXD - container startup/shutdown...
[[0;32m  OK  [0m] Started FUSE filesystem for LXC.
         |        Oo=o..   |
Starting LSB: Record successful boot for GRUB...
[[0;32m  OK  [0m] Started ACPI event daemon.[   20.440904] cloud-init[852]: |       o *= +.   |
[   20.443738]
[[0;32m  OK  [0m] Started D-Bus System Message Bus.
cloud-init[852]: |        .o *o .  |
[   20.476163] cloud-init[852]: |        S.+oB  . |
[   20.484491] cloud-init[852]: |        .+EX o. o|
[   20.494422] cloud-init[852]: |      .o. + +  o.|
[   20.508509] cloud-init[852]: |      .o.o .  o .|
[   20.516178] cloud-init[852]: |       .+.. .o .o|
[   20.525500] cloud-init[852]: +----[SHA256]-----+
[   20.541295] cloud-init[852]: Generating public/private dsa key pair.
[   20.561404] cloud-init[852]: Your identification has been saved in /etc/ssh/ssh_host_dsa_key.
[   20.577935] cloud-init[852]: Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.
[   20.596202] cloud-init[852]: The key fingerprint is:
[   20.606357] cloud-init[852]: SHA256:wKPizpw4irFw3PKc+2uDCHEsLO0iVoKqzGGpHq/QWCA root@xenialserver01         Starting LSB: MD monitoring daemon...

[   20.632081] cloud-init[852]: The key's randomart image is:
[   20.648380] cloud-init[852]: +---[DSA 1024]----+[[0;32m  OK  [0m] Started Snappy daemon.
         Starting Auto import assertions from block devices...

[[0;32m  OK  [0m] Started System Logging Service.
[[0;32m  OK  [0m] Started iSCSI initiator daemon (iscsid).
[[   20.677130] [0;32m  OK  [0m] Started /etc/rc.local Compatibility.
cloud-init[852]: |                 |
[   20.706940] cloud-init[852]: |     .           |
[[0;32m  OK  [0m] Started Auto import assertions from block devices.
[   20.727211] cloud-init[852]: |Eo    +          |
[   20.745835] cloud-init[852]: |*++. . o         |
[   20.778504] [[0;32m  OK  [0m] Started Login Service.
         Starting Authenticate and Authorize Users to Run Privileged Tasks...cloud-init[852]: |o=* .   S        |

         Starting Login to default iSCSI targets...[   20.799626] cloud-init[852]: |=@.o             |

[   20.822909] cloud-init[852]: |&+B...           |
[   20.841071] cloud-init[852]: |B@+=..o          |
[   20.851667] cloud-init[852]: |B+*.=+oo         |
[   20.866464] [[0;32m  OK  [0m] Started LSB: MD monitoring daemon.
cloud-init[852]: +----[SHA256]-----+
[   20.880884] cloud-init[[0;32m  OK  [0m] Started LSB: Record successful boot for GRUB.
[[0;32m  OK  [0m] Started Login to default iSCSI targets.[852]:
Generating public/private ecdsa key pair.[[0;32m  OK  [0m] Reached target Remote File Systems (Pre).
[[0;32m  OK  [0m
] Reached target Remote File Systems.
[   20.928704] cloud-init[852]: Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key.         Starting Permit User Sessions...
         Starting LSB: daemon to balance interrupts for SMP systems...
         Starting LSB: Set the CPU Frequency Scaling governor to "ondemand"...
         Starting LSB: automatic crash report generation...

[[0;32m  OK  [0m] Started Authenticate and Authorize Users to Run Privileged Tasks.[   20.970222] cloud-init[852]: Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub.
[[0;32m  OK  [0m] Started Permit User Sessions.
[[0;32m  OK  [0m] Started Accounts Service.

[   20.992936] cloud-init[852]: The key fingerprint is:
         Starting Hold until boot process finishes up...
         Starting Terminate Plymouth Boot Screen...
[   21.039936] [[0;32m  OK  [0m] cloud-init[852]: SHA256:4PGK4vsdb/U0kFsGDFPYhrfhPZRt8/l1HnWFJ/W3HFk root@xenialserver01Started LSB: Set the CPU Frequency Scaling governor to "ondemand".
[[0;32m  OK  [0m] Started Hold until boot process finishes up.
[[0;32m  OK  [0m] Started Terminate Plymouth Boot Screen.

[[0;32m  OK  [0m] [   21.077420] cloud-init[852]: Started LSB: daemon to balance interrupts for SMP systems.The key's randomart image is:
[[0;32m  OK  [0m] Started Getty on tty1.
[[0;32m  OK  [0m
] Started Serial Getty on ttyS0.[   21.120936]
[[0;32m  OK  [0m] Reached target Login Prompts.
         Starting Set console scheme...
cloud-init[852]: +---[ECDSA 256]---+[[0;32m  OK  [0m
] Started LSB: automatic crash report generation.
[   21.148558] cloud-init[852]: |        oB.  o oE|[[0;32m  OK  [0m] Started Set console scheme.

[   21.168415] cloud-init[852]: |        o.B o * B|
[[0;32m  OK  [0m] Started LXD - container startup/shutdown.
[   21.181499] cloud-init[852]: |      o  + B . B*|
[   21.197877] cloud-init[852]: |     . +  = = .oB|
[   21.208282] cloud-init[852]: |      . S  = . +=|
[   21.221142] cloud-init[852]: |     . .  o o   o|
[   21.232319] cloud-init[852]: |  . . o  . o .   |
[   21.239400] cloud-init[852]: | . . . o.   .    |
[   21.252569] cloud-init[852]: |  oo. ...        |
[   21.261086] cloud-init[852]: +----[SHA256]-----+
[   21.270913] cloud-init[852]: Generating public/private ed25519 key pair.
[   21.286352] cloud-init[852]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key.
[   21.301171] cloud-init[852]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub.
[   21.312379] cloud-init[852]: The key fingerprint is:
[   21.322844] cloud-init[852]: SHA256:WjUlPi/ZVop2qzkOmdQ5o2WeUdNEeoWKigaJX7euRJo root@xenialserver01
[   21.336191] cloud-init[852]: The key's randomart image is:
[   21.352596] cloud-init[852]: +--[ED25519 256]--+
[   21.364549] cloud-init[852]: |          . ..o..|
[   21.376204] cloud-init[852]: |         . o +.. |
[   21.388179] cloud-init[852]: |   . .    =.+.+  |
[   21.400348] cloud-init[852]: |  . o . .o.X.=   |
[   21.412671] cloud-init[852]: |   . o.oSo& *    |
[   21.423467] cloud-init[852]: |    .+o+oO O .   |
[   21.437699] cloud-init[852]: |    E.o.= o .    |
[   21.452982] cloud-init[852]: |     .  ...o     |
[   21.463025] cloud-init[852]: |      .. .+.     |
[   21.476154] cloud-init[852]: +----[SHA256]-----+
[   21.578103] cloud-init[981]: Generating locales (this might take a while)...
[[0;32m  OK  [0m] Started Pollinate to seed the pseudo random number generator.
         Starting OpenBSD Secure Shell server...
[[0;32m  OK  [0m] Started OpenBSD Secure Shell server.
[[0;32m  OK  [0m] Reached target Multi-User System.
[[0;32m  OK  [0m] Reached target Graphical Interface.
         Starting Update UTMP about System Runlevel Changes...
[[0;32m  OK  [0m] Started Update UTMP about System Runlevel Changes.
[   22.683777] cloud-init[981]:   en_US.UTF-8... done
[   22.689365] cloud-init[981]: Generation complete.

Ubuntu 16.04.2 LTS xenialserver01 ttyS0

xenialserver01 login: [   28.595827] cloud-init[981]: Cloud-init v. 0.7.9 running 'modules:config' at Fri, 30 Jun 2017 18:54:18 +0000. Up 21.44 seconds.
ci-info: ++++++++++Authorized keys from /home/ubuntu/.ssh/authorized_keys for user ubuntu+++++++++++
ci-info: +---------+-------------------------------------------------+---------+-------------------+
ci-info: | Keytype |                Fingerprint (md5)                | Options |      Comment      |
ci-info: +---------+-------------------------------------------------+---------+-------------------+
ci-info: | ssh-rsa | 3c:93:96:7e:8c:90:ab:16:f8:99:93:a9:75:95:71:c5 |    -    | Generated-by-Nova |
ci-info: +---------+-------------------------------------------------+---------+-------------------+
<14>Jun 30 18:54:25 ec2:
<14>Jun 30 18:54:25 ec2: #############################################################
<14>Jun 30 18:54:25 ec2: -----BEGIN SSH HOST KEY FINGERPRINTS-----
<14>Jun 30 18:54:25 ec2: 1024 SHA256:wKPizpw4irFw3PKc+2uDCHEsLO0iVoKqzGGpHq/QWCA root@xenialserver01 (DSA)
<14>Jun 30 18:54:25 ec2: 256 SHA256:4PGK4vsdb/U0kFsGDFPYhrfhPZRt8/l1HnWFJ/W3HFk root@xenialserver01 (ECDSA)
<14>Jun 30 18:54:25 ec2: 256 SHA256:WjUlPi/ZVop2qzkOmdQ5o2WeUdNEeoWKigaJX7euRJo root@xenialserver01 (ED25519)
<14>Jun 30 18:54:25 ec2: 2048 SHA256:K9+a0hTUJkY8w5cdFEturqW0FFTg5rfhBO9+9ldygKY root@xenialserver01 (RSA)
<14>Jun 30 18:54:25 ec2: -----END SSH HOST KEY FINGERPRINTS-----
<14>Jun 30 18:54:25 ec2: #############################################################
-----BEGIN SSH HOST KEY KEYS-----
ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHdu+VpVFZ+gv68Wt2fXr3tQetzXmvLu9ycJc1F4WvWr5+EYO8H+CiXmigezxXg2I3IiNaf84mxCBgx1H264OUc= root@xenialserver01
ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHRhg/UHXQdzf4Atu+4U2RtIXUqKzIslop9EvAcTq44+ root@xenialserver01
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqOsyex2lz8nK4G+Xb0Jq0VjiQuDhBGcuxWXEteeqXapqCYF9ofLm8whzOi1ecXGo5Z+wnaqRmicCr6w1bSRulPQQBTTYG+q1pOJcP3iSVxzcJVFRkO0PCIPGrQwAKOVYVIQPQAsdbLy8FYAaPX8IgUtGU6moB1MudE03KF+iVjxyifYhCLy1/oyZpk1wt4HUMBVnofz0GnEYhBPcmN9vrtFdM/WNfcmGTdRkCVbs6R0BosZvbeDM9ymYSFQOffc2krOzzWfIb2+MlvhuGCNUc5bg/l6HPz+FA/PtknixBUH6PJNuw8Ac0XwmdB2vH7dZHGS1hP5KYSzlO26f2cvTL root@xenialserver01
-----END SSH HOST KEY KEYS-----
[   28.971249] cloud-init[1216]: Cloud-init v. 0.7.9 running 'modules:final' at Fri, 30 Jun 2017 18:54:25 +0000. Up 28.82 seconds.
[   28.980324] cloud-init[1216]: Cloud-init v. 0.7.9 finished at Fri, 30 Jun 2017 18:54:25 +0000. Datasource DataSourceOpenStack [net,ver=2].  Up 28.96 seconds
 


See for details https://bugs.launchpad.net/nova/+bug/1694666

  



Viewing all articles
Browse latest Browse all 331

Trending Articles