Oneiric: Upgrade to 2.0.1+bzr1256 blocks

Bug #851611 reported by Torsten Spindler
16
This bug affects 2 people
Affects Status Importance Assigned to Milestone
eucalyptus (Ubuntu)
Fix Released
High
James Page

Bug Description

Today's upgrade to eucalyptus blocks on my system:

Setting up unity-lens-applications (0.4.6-0ubuntu1) ...
Setting up unity-lens-files (0.6.6-0ubuntu1) ...
Setting up compiz-fusion-plugins-main (1:0.9.5.94+bzr20110915-0ubuntu1) ...
Setting up eucalyptus-admin-tools (2.0.1+bzr1256-0ubuntu7) ...
Setting up eucalyptus-common (2.0.1+bzr1256-0ubuntu7) ...
eucalyptus start/running, process 17255
<hang>

Further eucalyptus cannot be stopped via the upstart job:
$ sudo stop eucalyptus
<hang>

The usual log files are being written too and in cloud-debug.log I see several connection refused messages, maybe because the node controller is currently not up:

08:26:05 DEBUG [ChannelUtil:New I/O client boss #2] java.net.ConnectException: Connection refused
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
        at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:351)
...
---
.etc.eucalyptus.eucalyptus.cc.conf: CC_NAME="Weberstrasse"
ApportVersion: 1.23-0ubuntu1
Architecture: amd64
DistroRelease: Ubuntu 11.10
InstallationMedia: Ubuntu 10.10 "Maverick Meerkat" - Release amd64 (20101007)
NonfreeKernelModules: nvidia
Package: eucalyptus (not installed)
ProcEnviron:
 PATH=(custom, no user)
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 3.0.0-11.18-generic 3.0.4
Tags: oneiric running-unity
Uname: Linux 3.0.0-11-generic x86_64
UpgradeStatus: Upgraded to oneiric on 2011-09-12 (3 days ago)
UserGroups: adm admin cdrom dialout libvirtd lpadmin plugdev sambashare

Related branches

Revision history for this message
Torsten Spindler (tspindler) wrote : EucalyptusAxis2cLog.gz

apport information

tags: added: apport-collected oneiric running-unity
description: updated
Revision history for this message
Torsten Spindler (tspindler) wrote : EucalyptusCCLog.gz

apport information

Revision history for this message
Torsten Spindler (tspindler) wrote : EucalyptusCloudDebugLog.gz

apport information

Revision history for this message
Torsten Spindler (tspindler) wrote : EucalyptusCloudOutputLog.gz

apport information

Revision history for this message
Torsten Spindler (tspindler) wrote : EucalyptusHTTPDErrorLog.gz

apport information

Revision history for this message
Torsten Spindler (tspindler) wrote : EucalyptusInstalledVersions.txt

apport information

Revision history for this message
Torsten Spindler (tspindler) wrote : eucalyptus.conf.txt

apport information

Revision history for this message
Torsten Spindler (tspindler) wrote : eucalyptus.local.conf.txt

apport information

Revision history for this message
James Page (james-page) wrote :

I think that I might be seeing the same issue on a fresh install;

In my case I can see "wget -q -T10 -t1 -O- --no-check-certificate https://192.168.1.52:8443/register" in the process listing - which appears to be what is causing the hang.

This is in the post-start upstart configuration for eucalyptus-cloud.

I can get a response from it manually either.

Revision history for this message
James Page (james-page) wrote :

/can/can't/

Revision history for this message
Torsten Spindler (tspindler) wrote : Re: [Bug 851611] Re: Oneiric: Upgrade to 2.0.1+bzr1256 blocks

I confirm James finding, I have the wget running as well.

Revision history for this message
Torsten Spindler (tspindler) wrote :

For the record, I killed the post instll script 'eucalyptus-common.postinst', leaving eucalyptus unconfigured to proceed working on the system.

Changed in eucalyptus (Ubuntu):
status: New → Confirmed
importance: Undecided → High
Revision history for this message
James Page (james-page) wrote :

This issue might be related:

  https://features.opensuse.org/311066

OpenSUSE have had compatibility issues between openssl 1.0 and eucalyptus - potentially related to bouncycastle.

  https://bugzilla.redhat.com/show_bug.cgi?id=663136

This would align with some of the behaviour I have seen - after a period of time I can connect to https://hostnane:8443 using a browser or using curl/wget on a natty install.

However wget/curl won't work on the euca install itself.

Revision history for this message
James Page (james-page) wrote :

Graziano

Any comment on #13 relating to compatibility between eucalyptus and openssl1.0?

Revision history for this message
graziano obertelli (graziano.obertelli) wrote :

Hello James,

indeed that rings a bell: OpenSUSE proposed a patch. I am looking for their page, but right now I cannot find it. I will update the ticket later on with the full link to it. But for now I seem to recall that using the option --secure-protocol= with wget may solve the problem.

Revision history for this message
graziano obertelli (graziano.obertelli) wrote :
Revision history for this message
graziano obertelli (graziano.obertelli) wrote :

James,

going through the bugs now, and I noticed that in 851900 you used curl. The patch here is for wget, but I assume you already know that with curl you could use the --sslv3 to force the use of a specific protocol.

Revision history for this message
James Page (james-page) wrote :

Hi Graziano

I hacked this into my broken install and it appears todo the trick.

I'll work on a update to the packaging.

James Page (james-page)
Changed in eucalyptus (Ubuntu):
assignee: nobody → James Page (james-page)
status: Confirmed → In Progress
James Page (james-page)
Changed in eucalyptus (Ubuntu):
milestone: none → ubuntu-11.10-beta-2
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package eucalyptus - 2.0.1+bzr1256-0ubuntu8

---------------
eucalyptus (2.0.1+bzr1256-0ubuntu8) oneiric; urgency=low

  * Fix compatibility issues with SSLv3 (LP: #851611):
    - d/patches/29-euca_conf-sslv3.patch: Use --secure-protocol=SSLv3
      with wget when communicating with CLC.
    - d/eucalyptus-cloud.upstart: Use --secure-protocol=SSLv3 with wget
      when checking for CLC startup complete.
  * d/patches/30-clock_drift.patch: Resolve issue with rampart blocking
    communication between CC and NC when time is fractionally in the
    future (LP: #854946):
 -- James Page <email address hidden> Wed, 21 Sep 2011 09:57:58 +0100

Changed in eucalyptus (Ubuntu):
status: In Progress → Fix Released
Revision history for this message
Torsten Spindler (tspindler) wrote :

I just updated and still have a hanging wget:

...
Setting up kdepim-runtime (4:4.7.1-0ubuntu3) ...
Setting up libcouchdb-glib-1.0-2 (0.7.4-0ubuntu2) ...
Setting up libdesktopcouch-glib-1.0-2 (0.7.4-0ubuntu2) ...
Setting up oneconf (0.2.6.4) ...
Setting up software-center (4.1.23.4) ...
Updating software catalog...this may take a moment.
Software catalog update was successful.
Setting up eucalyptus-admin-tools (2.0.1+bzr1256-0ubuntu8) ...
Setting up eucalyptus-common (2.0.1+bzr1256-0ubuntu8) ...
eucalyptus start/running, process 8050

$ ps aux | grep wget
root 8873 0.0 0.0 27720 2304 ? S 08:29 0:00 wget -q -T10 -t1 -O- --no-check-certificate https://192.168.1.122:8443/register
spindler 10716 0.0 0.0 12040 900 pts/2 S+ 10:00 0:00 grep --color=auto wget

Revision history for this message
Torsten Spindler (tspindler) wrote :

Unfortunately killing the wget in a loop is now not continuing the eucalyptus start job. Also calling 'sudo stop eucalyptus' failed to change anything, the eucalyptus start job is hanging.

Revision history for this message
graziano obertelli (graziano.obertelli) wrote :

It seems that the patch was not applied: wget should be called with --secure-protocol=SSLv3 and in your ps it didn't show.

Is any log produced?

Revision history for this message
Torsten Spindler (tspindler) wrote :

The error seems to have been transient. I killed the hanging eucalyptus postinst process and I got no further hang.

Revision history for this message
graziano obertelli (graziano.obertelli) wrote :

If you see it again, please check if logs are generated and if there are errors. I wonder if this is a race condition, so it would be interesting to see at which level is this happening.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.