Tuesday, May 31, 2011

Li webtech hosting service down due to verizon contruction in nassau conty

Major verizon business service affected....

Started about 800am... still on going verizon wire/pipe cut .....

Will update page as service is restore......


6:30-8:00pm
Fiber Damage...Under construction...over night to restore T1 service...to my clients and Host Service.....Failed failover systems are down...as well..

updated... 6-1-11

Just got one of the servers up now. I will be working on it for the next few hours. I will know more later.

Around 9:15 am yesterday there was some kind of major cable cut in our area which killed a high capacity line (I am told it was an OC12) and it took down several hundred smallers circuits including ours. We were told at the time the repair would likely be done by the afternoon. Later in the day our upstream provider claimed it would be done later or overnight. We were told that due to so many circuits being knocked out that they would be working overnight to fix it.

I came in at 5am to check on things and called our upstream provider (Transbeam) who told me
that in fact Verizon stopped work last night and would be going back at 8am. I told them about
how I was told that they would work overnight and nobody is taking the blame for that lie.
So at 5:30am I ordered a couple of new servers to replace the ones here that handle our primary and secondary dns and am waiting for the provisioning of them to complete. Once they are done we
can put the dns live and most of the accounts should come back up. There are some older accounts
on servers here that will have to be moved to new servers, but we will have to see how much
comes up.

I wish I had an exact time line on all of this. Everyone seems to tell one story and then change it
later. We have had outtages before, but nothing ever like this. Even with cable cuts in the past
it was 4-5 hours, not a full day.

Some upset clients ...

Fios Forum News:
Hey,
has anyone noticed an outage throughout Nassau/North Bronx? Apparently, my dad's office has lost all internet connectivity, due to an outage on Verizon Business.

They said there was a major equipemnt down in bell harbor doint know if that wil effect u.

major outage since 10:08am ?
farmingdale, lindenhurst, babylon.
must be huge.

I have reports coming in from Roslyn, Westbury, Oceanside, Lynbrook (where I am) ALL OUT Totally.

Luckily we have Fios here as main ISP, but i am the only one using the Boost OOL, so i had to just swich my gateway ip over and im hot.. but Still this is a BIG TIME outage.

yeah.
I wonder what exploded at the noc center in hicksville, lol

No comments: