Omega Owners Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Please check the Forum Guidelines at the top of the Newbie section

Pages: 1 [2] 3  All   Go Down

Author Topic: OOF Outage  (Read 9695 times)

0 Members and 1 Guest are viewing this topic.

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107803
  • I Like Lockdown
    • Whatever Starts
Re: OOF Outage
« Reply #15 on: 09 October 2017, 17:56:31 »
Cough. That was over 4yrs ago. Ancient history. To be forgotten by all.
Logged
Grumpy old man

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
Re: OOF Outage
« Reply #16 on: 09 October 2017, 18:31:12 »
Quote from: TheBoy on 09 October 2017, 17:56:31
Cough. That was over 4yrs ago. Ancient history. To be forgotten by all.

Of course... I'll never mention it again. Or tree shaped air fresheners :-X ::) :D
Logged
Whatever it is... I didn't do it

Bigron

  • Omega Baron
  • *****
  • Offline Offline
  • Gender: Male
  • Witham, Essex
  • Posts: 4808
    • Omega 2.6 V6 Auto '51 Reg
Re: OOF Outage
« Reply #17 on: 09 October 2017, 18:39:45 »
???
Logged

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107803
  • I Like Lockdown
    • Whatever Starts
Re: OOF Outage
« Reply #18 on: 09 October 2017, 18:53:05 »
Quote from: Lazydocker on 09 October 2017, 18:31:12
Quote from: TheBoy on 09 October 2017, 17:56:31
Cough. That was over 4yrs ago. Ancient history. To be forgotten by all.

Of course... I'll never mention it again. Or tree shaped air fresheners :-X ::) :D
Punishment will be swift if you do...
Logged
Grumpy old man

biggriffin

  • Omega Lord
  • *****
  • Offline Offline
  • huntingdon, Hoof'land
  • Posts: 9853
    • It's Insignificant
Re: OOF Outage
« Reply #19 on: 09 October 2017, 20:53:43 »
Quote from: TheBoy on 09 October 2017, 18:53:05
Quote from: Lazydocker on 09 October 2017, 18:31:12
Quote from: TheBoy on 09 October 2017, 17:56:31
Cough. That was over 4yrs ago. Ancient history. To be forgotten by all.

Of course... I'll never mention it again. Or tree shaped air fresheners :-X ::) :D
Punishment will be swift if you do...
.

Mmm newbie docker again
Logged
Hoof'land storeman.

Lazydocker

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Woodbridge, Suffolk
  • Posts: 18848
  • Constantly Bullied by a certain Admin
Re: OOF Outage
« Reply #20 on: 09 October 2017, 22:34:43 »
Quote from: biggriffin on 09 October 2017, 20:53:43
Quote from: TheBoy on 09 October 2017, 18:53:05
Quote from: Lazydocker on 09 October 2017, 18:31:12
Quote from: TheBoy on 09 October 2017, 17:56:31
Cough. That was over 4yrs ago. Ancient history. To be forgotten by all.

Of course... I'll never mention it again. Or tree shaped air fresheners :-X ::) :D
Punishment will be swift if you do...
.

Mmm newbie docker again

Probably... Been a while :-X ::)  ;D
Logged
Whatever it is... I didn't do it

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107803
  • I Like Lockdown
    • Whatever Starts
Re: OOF Outage
« Reply #21 on: 11 October 2017, 18:08:50 »
Moving the webserver and primary database off the flash storage onto a traditional HDD raid 10 storage device.

There should be no outage (its moving right now), but obviously spinning media is slower than flash, so page load times may increase slightly.


This is to run diags on the flash storage that crashed at the weekend.
Logged
Grumpy old man

Shackeng

  • Omega Lord
  • *****
  • Offline Offline
  • Gender: Male
  • Ramsbury
  • Posts: 7763
    • 3.2 Elite 2.0 TitX Mondeo
Re: OOF Outage
« Reply #22 on: 11 October 2017, 18:29:45 »
^^^
Wot he said. ::) ::) ::)
Logged

Migv6 le Frog Fan

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • Essex / Suffolk border.
  • Posts: 13136
    • 3.2 Elite. Nissan Leaf.
Re: OOF Outage
« Reply #23 on: 11 October 2017, 18:33:34 »
I would have done exactly the same.  :y



 ;D ;D
Logged
Its weird being the same age as old people !

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107803
  • I Like Lockdown
    • Whatever Starts
Re: OOF Outage
« Reply #24 on: 16 October 2017, 14:18:50 »
Blimey, WTF is happening lately  >:(

One of the hypervisors has sorta crashed, following a minor health alert this morning.  What should happen is if the hardware health is suspect, all the load moves over to another, healthy hypervisor.  In this case its just shat it pants.  The VMs are still running, but unmanageable.

So, no choice but to power cycle the underlying hardware, which will ungracefully power cycle the VMs running on it.


From an OOF prespective, this includes the primary webserver, the primary database, and the secondary database (which affinity rules say should never be on same hypervisor as primary, so something else has gone wrong there).


I shall do this when I finish work today.
Logged
Grumpy old man

Entwood

  • Omega Queen
  • *****
  • Offline Offline
  • Gender: Male
  • North Wiltshire
  • Posts: 19566
  • My Old 3.2 V6 Elite (LPG)
    • Audi A6 Allroad 3.0 DTI
Re: OOF Outage
« Reply #25 on: 16 October 2017, 14:26:19 »
Quote from: TheBoy on 16 October 2017, 14:18:50
Blimey, WTF is happening lately  >:(

One of the hypervisors has sorta crashed, following a minor health alert this morning.  What should happen is if the hardware health is suspect, all the load moves over to another, healthy hypervisor.  In this case its just shat it pants.  The VMs are still running, but unmanageable.

So, no choice but to power cycle the underlying hardware, which will ungracefully power cycle the VMs running on it.


From an OOF prespective, this includes the primary webserver, the primary database, and the secondary database (which affinity rules say should never be on same hypervisor as primary, so something else has gone wrong there).


I shall do this when I finish work today.

Good luck, and thank you in advance   :y :y
Logged

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107803
  • I Like Lockdown
    • Whatever Starts
Re: OOF Outage
« Reply #26 on: 16 October 2017, 17:43:29 »
Panic over - managed to finally get sufficient control of the bastid hypervisor to allow all the VMs to be move gracefully, and then rebooted the hypervisor :)

No outage needed. Happy days.  Sometimes simple victories give me a real smile :)
Logged
Grumpy old man

Lizzie Zoom

  • Omega Lord
  • *****
  • Offline Offline
  • Gender: Female
  • South
  • Posts: 7664
    • Omega 3.2 V6 ELITE 2003
Re: OOF Outage
« Reply #27 on: 16 October 2017, 17:45:33 »
Quote from: TheBoy on 16 October 2017, 17:43:29
Panic over - managed to finally get sufficient control of the bastid hypervisor to allow all the VMs to be move gracefully, and then rebooted the hypervisor :)

No outage needed. Happy days.  Sometimes simple victories give me a real smile :)

Does that mean TB your cull is postponed?? :-\ :-\ ;D ;D ;)
Logged

TD

  • Omega Knight
  • *****
  • Offline Offline
  • Gender: Male
  • Swindon
  • Posts: 1235
    • Nowt!
Re: OOF Outage
« Reply #28 on: 16 October 2017, 17:49:46 »
Quote from: TheBoy on 16 October 2017, 17:43:29
Panic over - managed to finally get sufficient control of the bastid hypervisor to allow all the VMs to be move gracefully, and then rebooted the hypervisor :)

No outage needed. Happy days.  Sometimes simple victories give me a real smile :)

You need to upgrade from win95  ;) ;D ;D

Well done TB  :y
Logged

TheBoy

  • Administrator
  • *****
  • Offline Offline
  • Gender: Male
  • Brackley, Northants
  • Posts: 107803
  • I Like Lockdown
    • Whatever Starts
Re: OOF Outage
« Reply #29 on: 16 October 2017, 18:03:03 »
Quote from: Lizzie Zoom on 16 October 2017, 17:45:33
Quote from: TheBoy on 16 October 2017, 17:43:29
Panic over - managed to finally get sufficient control of the bastid hypervisor to allow all the VMs to be move gracefully, and then rebooted the hypervisor :)

No outage needed. Happy days.  Sometimes simple victories give me a real smile :)

Does that mean TB your cull is postponed?? :-\ :-\ ;D ;D ;)
No. I'll just be happier executing it.
Logged
Grumpy old man
Pages: 1 [2] 3  All   Go Up
« previous next »
 

Page created in 0.016 seconds with 16 queries.