Everything has blown up

davidsmalley's Avatar

davidsmalley

02 Jul, 2007 04:42 PM

Looks like the entire app has blown up, including your own ticket tracker...

I get the ninja error message on every single page I try to access on all the accounts I have access to.

  1. 1 Posted by Robby Russell on 02 Jul, 2007 04:46 PM

    Robby Russell's Avatar

    We're having the same problem here. Consider this my ticket.

    Can we get a status update?

  2. 2 Posted by Rick on 02 Jul, 2007 05:29 PM

    Rick's Avatar

    Sorry about that. Had a small deployment issue this morning and didn't notice it until I checked my email while getting lunch. We should be all good to go now.

    Our svn repo blew up over the weekend, so I had to rebuild my local working directory. Of course, I forgot to save my capistrano deploy.rb file, so I recreated it with the wrong rails revision.

    Update: Still had some issues. This time it didn't properly reset all of the mongrels on both slices.

  3. 3 Posted by davidsmalley on 02 Jul, 2007 08:35 PM

    davidsmalley's Avatar

    Cheers Rick - we were starting to panic for a minute there :)

  4. 4 Posted by Rick on 03 Jul, 2007 01:11 AM

    Rick's Avatar

    That sucks. I'm trying to work out a way so you guys (or better yet, some script that notices lots of errors in a short time) can ping me directly. I just feel weird about putting my cell # on here for calls/SMSs though. I'll have to figure something out though. I only caught this when I did because I was playing with my iphone while waiting in line to grab lunch.

  5. 5 Posted by Joe Van Dyk on 03 Jul, 2007 01:00 PM

    Joe Van Dyk's Avatar

    How about setting up nagios to monitor a couple key parts of the site? You can set up a script that logs in to your account, and maybe posts a ticket at a test account. If the script fails, you can have nagios complain to you via SMS or phone or IM or whatever.

Discussions are closed to public comments.
If you need help with Lighthouse please start a new discussion.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac