Running one instance every ~60-seconds; after a while we started getting
FinishedVerify: Cannot mark address as allocating[unallocated.false->allocated.true] when it is assigned.true: [Address id=5 name=10.55.55.104 cluster=UEC-TEST1 userId=nobody instanceId=available instanceAddress=0.0.0.0 state=AtomicMarkableReference QUIESCENT= transition=[SplitTransition previous=assigned, transition=allocating, next=assigned, pending=true]]Cannot mark address as allocating[unallocated.false->allocated.true] when it is assigned.true: [Address id=5 name=10.55.55.104 cluster=UEC-TEST1 userId=nobody instanceId=available instanceAddress=0.0.0.0 state=AtomicMarkableReference QUIESCENT= transition=[SplitTransition previous=assigned, transition=allocating, next=assigned, pending=true]]
when trying to start an instance. This error happened 479 times in a total of 1,077 instance starts (then I cancelled the run).
In *all* 479 such errors, the IP address being targeted was 10.55.55.104. This IP was not (visibly) in use.
Full logs are at bzr+ssh://bazaar.launchpad.net/~hggdh2/%2Bjunk/uec-qa/
Pushed up to revision 26.
eucalyptus-cc 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
eucalyptus-cloud 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
eucalyptus-common 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
eucalyptus-gl 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
eucalyptus-java-common 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
eucalyptus-sc 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
eucalyptus-walrus 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
uec-component-listener 2.0~bzr1218-0ubuntu1 eucalyptus install ok installed
Had it again on the stress test. Once it happens, it keeps on happening. Upstream seems to have some fixes for IP address allocation, so we will wait for them.