board is cranky at the moment...

This subforum contains questions and issues that have either been answered or addressed, or they are no longer applicable/have expired.

board is cranky at the moment...

Postby Elwing » Tue Dec 20, 2005 5:01 pm

...It was unavailable for most of monday. Fortunately it's back, but I still get server errors. Especially the "Today's Posts" page is hard to reach.
Anybody else experiencing problems?


Server Error
The following error occurred:

[code=SERVER_RESPONSE_CLOSE] The server closed the connection while reading the response. Contact your system administrator.
Please contact the administrator.
“You can’t buy happiness, but you can buy a bike and that’s pretty close”
User avatar
Elwing
Global Moderator
Global Moderator
 
Posts: 986
Joined: Thu Jun 27, 2002 4:35 pm
Location: Yurop
Title: Loquacious Llama

board is cranky at the moment...

Postby wsg » Tue Dec 20, 2005 7:27 pm

I know El it does get that way sometimes I hate it when it does that!Oh hey did ya get my sisters u2u?
"It's one o'clock bub! Time ta get yer face ripped off!"--Logan
User avatar
wsg
Bilge Rat
Bilge Rat
 
Posts: 93
Joined: Mon Oct 03, 2005 4:37 am
Location: "What's it to ya bub?"

board is cranky at the moment...

Postby Technical Administrator » Wed Dec 21, 2005 1:38 am

If anyone continues to have this problem, please U2U me with as much information as possible.

-Northstar
User avatar
Technical Administrator
Administrator
Administrator
 
Posts: 90
Joined: Thu Jan 01, 1970 12:00 am
Location: Nightscrawlers
Title: Rogue PHP Script

board is cranky at the moment...

Postby Northstars Love » Wed Dec 21, 2005 3:26 pm

Just to let everyone know that on Monday the HD which holds our file information was severly damaged according to Richard, Director of Operations.

The server hard drive is severely damaged, the server is being taken offline for urgent maintenance to try and save some data where possible. In addition to this our engineers at the datacenter are going to try and clone the hard drive to save all data/settings/configuration.

If a clone is not possible, a new HD will need to be installed, all data on the primary hard drive will be lost. If you are located on this server, please check your local PC for your last backup to allow us to restore your data.


However according to Ben only the HD that holds the files of the websites was damaged and not the sql database/information which is housed on another HD.

The datacenter are still attempting to clone the primary hard drive and extract data off of it. It does look likely that user data may be lost in this instance, however nothing has been confirmed to us at this moment in time.

I would like to mention that MySQL Databases are not on the primary hard-drive, so even if website files are lost, the information/data in the mysql databases will still be intact.


Some websites did lose file information but Nightscrawlers and The X Dream survived. There maybe problems here and there and bugs maybe being worked out but overall they got it up and running pretty quick with no file/information loss.
Northstars Love
Lookout
Lookout
 
Posts: 970
Joined: Mon Jul 28, 2003 7:10 am
Location: Pair A Dice Island

board is cranky at the moment...

Postby Bamfette » Wed Dec 21, 2005 11:02 pm

been getting this over the past week:
Unable to connect













Firefox can't establish a connection to the server at nightscrawlers.com.








* The site could be temporarily unavailable or too busy. Try again in a few
moments.

* If you are unable to load any pages, check your computer's network
connection.

* If your computer or network is protected by a firewall or proxy, make sure
that Firefox is permitted to access the Web.
User avatar
Bamfette
Dread Pirate
Dread Pirate
 
Posts: 3278
Joined: Wed Jun 26, 2002 9:41 pm
Location: Calgary

board is cranky at the moment...

Postby Technical Administrator » Wed Dec 21, 2005 11:57 pm

I would definitely say that this is due to maintenance on our host, then, and unavoidable. I really hope that it is fixed as soon as possible and hopefully our host will give us as much information about our current status as possible.
User avatar
Technical Administrator
Administrator
Administrator
 
Posts: 90
Joined: Thu Jan 01, 1970 12:00 am
Location: Nightscrawlers
Title: Rogue PHP Script

board is cranky at the moment...

Postby Saint Kurt » Thu Dec 22, 2005 2:33 am

I've looked at our server stats - everything is running well except for one partition (once again a host controlled issue.) I've made a complete backup of the site- mysql and all so even if soemthing does go wrong, we will be able to return gracefully.

Meanwhile, it looks like the host as on top of things right from the beginning:

Ashley Downtime Information

On 19th December 2005, the web server Ashley suffered a serious SCSI hard drive fault on the primary hard drive which contains 65% of the websites hosted on the server, as well as the operating systems and software.


Time Line

Our Network Operations Center became aware of a fault at 04:54am, and notified all responsible staff, including senior managers, and linux server engineers at 04:56, 2 minutes after the alert.

At 05:39am our datacenter engineers performed onsite diagnostics, at this stage the webserver was still online, however with email and cpanel/whm access offline.

At 05:58am our datacenter engineers removed the primary hard drive, and replaced it with a new SCSI drive, with an original RHEL 4 image, and cPanel.

At 06:27am our datacenter engineers replaced the hard drive, and completed the installation/setup of cpanel.

At 06:39am our third party disaster management company started to perform a server clone of all data and configuration files.

At 13:00pm the webserver was brought online with 90% of the data restored.

At 15:33pm the webserver was online with all data and configuration completed, all services at this stage had been restored including email, cpanel/whm, web server access and mysql database access.

Protection we had in place.

- Paid third party disaster management contracts
- 4 hard drives per server lowering chance of 100% loss
- Backup spare/blank hard drive in each server for quick restore
- Early warning fault detection systems


Hopefully - this was a one time deal.

Keep us posted if you get any additional unusual errors while trying to access the site. I'll try to keep us up to date with news from our host as well.

Thanks,
-e
Image
User avatar
Saint Kurt
Administrator
Administrator
 
Posts: 2150
Joined: Wed Jan 28, 2004 3:43 am
Location: Watch out for that cow pie!
Title: Derelict Landlord

board is cranky at the moment...

Postby Bamfette » Thu Dec 22, 2005 6:51 am

well, my problem wasn't a one time thing... it's been happening intermitently all week. it comes and goes. at its worst, it kept me from connecting to the site for 2 days but usually is back within an hour or so. it's just that's the first time i actually copy and pasted the error...
User avatar
Bamfette
Dread Pirate
Dread Pirate
 
Posts: 3278
Joined: Wed Jun 26, 2002 9:41 pm
Location: Calgary

board is cranky at the moment...

Postby Northstars Love » Thu Dec 22, 2005 3:22 pm

My members have complained about connecting to the site and errors before the HD was damaged. They don't seem to have a problem now. However, there are times that I cannot connect for periods of times. This is usually in the early hours of 2am-3am PST. Most likely maintenance in those cases.
Northstars Love
Lookout
Lookout
 
Posts: 970
Joined: Mon Jul 28, 2003 7:10 am
Location: Pair A Dice Island

board is cranky at the moment...

Postby Saint Kurt » Thu Dec 22, 2005 4:10 pm

Hi - yeah, I meant hopefully the drive breakdown and the events leading up to it were a one time deal. As in the server isn't like this permanently.

I recognise that there were multiple issues in the previous week regarding having proper access to the site, however what I posted was the log of them replacing the drive on Ashely (our server) on Dec 19th (Greenwich time).

As of about Dec. 20th you should be experiencing less and less problems accessing the site. If this isn't the case - please continue to post to this thread so we can inform the host.

Thanks
-e
Image
User avatar
Saint Kurt
Administrator
Administrator
 
Posts: 2150
Joined: Wed Jan 28, 2004 3:43 am
Location: Watch out for that cow pie!
Title: Derelict Landlord


Return to Resolved Issues

Who is online

Users browsing this forum: No registered users and 1 guest

cron