I am unsure who to contact as I have tried on numerous occasions today to contact you by phone, email and through your support system. Given the lack of response from your team I am understandably disappointed.
Let me say this first: I have had two websites that have been offline all day, during business hours. From 9am PDT to 8pm PDT. Actually, only one site is up and running at this time.
One of these sites is a client site, the other is a personal site.
Both of these issues are related to a server upgrade you had planned on your servers.
I received emails from you informing me of a server upgrade over a period of "24 to 72" hours and that my static IP address would be changed. This type of upgrade is pretty standard save for (1) the fact that it happened during business hours, (2) the fact that it happened during the week, (3) the fact that you provided no time when it would happen, and (4) the fact that you gave a 48 hour window over which the upgrade would happen.
However, I was assured that "While we do not anticipate any issues related to the upgrade, we are available to answer any questions that you may have once the move has been completed." This is a quote from the email you sent me.
As soon as I found out that my sites were down I immediately filed tickets through your new ticket system (which now requires me to login to my account v. just filing a ticket from the website).
I called at 10:11am to your new phone support system. I actually talked to someone who was friendly but suggested I file tickets through the support system. I had already opened one for one of my sites; he suggest I open a new one for the other site and he would get this into the queue with "priority."
I also updated my nameservers with the new information as I was instructed to do.
I checked the site during the day with little progress on the tickets.
I called back at 4pm PDT to check on the status of my tickets. There had been no progress. In one of my meetings during the afternoon I worked myself on trying to get the site up and running and updated the tickets as I uncovered more information.
Not only was the support rep unhelpful on this call he was entirely uncaring about my situation. I explained that I had a client website that had been down all day - no sympathy at all. No information he gave me that suggested he knew anything about the tickets in process - only that "one of the engineers is looking into the issue." Given that you had major hardware upgrades happening today your support staff fielding calls didn't seem to know anything about it.
Oh, I also attempted to contact you on twitter as well, no reply. It was interesting to see a litany of replies to you from very unsatisfied customers.
Sorry, time for a little tech talk. I do this to show that your migration was not well planned and so that I may document the steps I had to go through to get my application working.
While my tickets were "being looked at" I was able to SSH into my server and get my Rails application up and running. One of the features of your upgrade was to allow your hosting clients the ability to choose a specific version of Ruby with which to run their applications. I was previously on a Ruby 1.8.7 server. Naturally when I logged in my server was running 1.8.6. I got this all working according to the tutorial on your site (your engineers BTW had completely hacked a solution that did not work b/c they any existing mongrel process would never be stopped) but was shocked that my migration had not preserved the version of ruby I had previously been running.
This of course was not enough. Once my application was running I discovered that my database, while in existence, was empty. No data, no tables. Nada. When I logged into cPanel I was unable to see my database or any database user. I was thus stuck again.
I finally got an email reply from one of your "engineers" that told me they'd been having permissions issues and that "reassigning users to the database" should solve the problem. Clearly, they had not understood my ticket update - I could not see my database. I had attached an image just in case a visual would help.
Ultimately I solved this problem myself by restoring my development database into the production database. Fortunately this is a new website with very little in the way of dynamic content at this point and so I was able to reasonably restore the system. I figured based on the email response I had just received it would be several more hours before I was able to have my backed up database restored.
The punchline of course is that at 1:16 pm PDT I was notified that my server upgrade and migration had been completed.
During the day, because I had plenty of time to just twiddle my thumbs waiting on your support team, I did a little research and found out that you have recently been purchased by Jumpline. I don't know anything about Jumpline but if today's events are a result of your management then I am duly unimpressed.
Let me summarize this here for you:
- I have been a loyal customer to you for over two years. I have recommended many people to you for solid and inexpensive Ruby on Rails hosting.
- You used to have competent engineers that would resolve issues quickly and through email, not some arcane and unhelpful ticketing system.
- You used to have engineers that would take the initiative to resolve issues. Now you have engineers that throw support tickets back at clients that now have to resolve issues themselves.
- You used to resolve issues in a timely manner. Now apparently 12+ hours of downtime is perfectly acceptable.
I doubt there is anything you can do to maintain my business. I am actively shopping for new hosting providers. While I hope to find an organization that can exceed my expectations as a customer I most certainly can find one that offers far superior service than you.
Regards,
Jeff
