All in? I think not.
The guy I threw under the bus, or out to California, called last night. Things were not 100%. So after a couple of calls last night we left it to today.
Instead of going right to my desk I went right over to our test loop and setup the system to exactly the same thing as what is going on in CA. Then I was able to exactly recreate the problem.
(lots of phone calls and false starts and working go here)
When I left today at 5pm they had run over 400 packages without an error or anomoly. So that implies that things are finally on the right track. If we do not hear from him again tonight and things are still OK tomorrow morning then we might be out of the woods.
I will not be betting any farms on this though.