Jump to content

Forum maintenance - 25th Jan @ 5PM - All Done


Recommended Posts

Posted

Its that time again! The forum software has an update out and is also a good time for me to apply any operating system updates while there. 

Changes are here for those that are interested: https://invisioncommunity.com/release-notes/

Nothing really exciting apart from general bug fixes.

My plan is to do it tomorrow and probably will take an hour all being well. If someone is happening to be doing a collection mission or need access to the forum, let me know and I can postpone it.

Another heads up that I'll need to do a much bigger operating system rebuild at some point soon as the current OS is coming to its absolute end-of-life in a few months time. I need set aside a day to properly sort and test this but hopefully most of it can be done in the background until I can flick the switch to move across. This may cause a bit more disruption but as always I'll try to keep that minimal.

Posted

Due to timings this evening, I'm going to have to move this forward an hour to 5pm today. Let me know if that's a problem.

  • SiC changed the title to Forum maintenance - 25th Jan @ 5PM (moved forward an hour)
Posted
21 minutes ago, grogee said:

It's not a problem. I'll just have to talk to Mrs Grogee instead. 

Harumph. 

My wife will say its very convenient that I'm still working while its "housework evening"... 😇

Posted

maintainence is cos slarti and sic will be doctoring the calendar so its all their photos in it :D

*runs IBTL :P

  • Haha 1
  • SiC changed the title to Forum maintenance - 25th Jan @ 5PM - All Done
Posted

It was sitting at nearly 50 days uptime so a reboot probably didn't go amiss. I have noticed the database server starts heavily hogging the CPU after 30 days. Shouldn't make any difference with time though, so I might have a look at some of the settings to see if there is something I can tweak (cache sizes and what it keeps in RAM mostly). May also get sorted when I get around to upgrading the fundamental base operating system too. 

Posted

Perfect timing from my POV, didn't even see it was down. Thanks again.

Posted

Thank you for your efforts.

Is this why site has been offline for good portions of last few days?

Posted
5 minutes ago, Bren said:

Thank you for your efforts.

Is this why site has been offline for good portions of last few days?

It hasn't and people have been posting a fair bit over the last few days! Have you not been able to access it recently?

Posted
22 minutes ago, SiC said:

It hasn't and people have been posting a fair bit over the last few days! Have you not been able to access it recently?

Yes. Could not connect - timed out.

Posted
2 hours ago, Bren said:

Yes. Could not connect - timed out.

No.problemz here

Posted

I assume you probably know, but the "unread content" feed and some other searches aren't working properly for me.  I have unread content from two hours ago, but stuff posted more recently than that isn't showing.  Elastic indexing issue?

Posted
1 hour ago, loserone said:

I assume you probably know, but the "unread content" feed and some other searches aren't working properly for me.  I have unread content from two hours ago, but stuff posted more recently than that isn't showing.  Elastic indexing issue?

Came to post the same thing - the unread content thing isn’t working. Mines showing posts from 3 hours ago but nothing more recent. 

Posted
1 hour ago, loserone said:

I assume you probably know, but the "unread content" feed and some other searches aren't working properly for me.  I have unread content from two hours ago, but stuff posted more recently than that isn't showing.  Elastic indexing issue?

 

8 minutes ago, JJ0063 said:

Came to post the same thing - the unread content thing isn’t working. Mines showing posts from 3 hours ago but nothing more recent. 

No I wasn't aware (I never use that feature). Perhaps I need to let it rebuild the search cache. Problem is, that literally takes days 😬

I'll have a poke around to see if there is anything else amiss. But I suspect its that.

Posted

Looks like the elasticsearch server has gone awry going by the amount of errors I'm seeing on it in the admin console. I haven't touched that apart from letting the OS update itself and rebooting it. I've given it a quick restart again and lets see how that goes. If not I'll hit rebuild on indexing but we might find that stuff like search and unread content is broken for a day or two until it finishes.

Posted
5 minutes ago, SiC said:

 

No I wasn't aware (I never use that feature). Perhaps I need to let it rebuild the search cache. Problem is, that literally takes days 😬

I'll have a poke around to see if there is anything else amiss. But I suspect its that.


Many thanks, it’s the feature I use most to be honest, otherwise I’d never keep track of Invacar posts everywhere!

Posted

Okay it looks like the search server is running out of space. Elasticsearch will stop writing any new data when its above 90% full, its currently hit 91%. For some reason this update has increased the search storage usage by a good 25%. Perhaps because its not pruned old data while putting new stuff in. I might hit rebuild as the search cache will be banjaxed anyway as its not been updating for the last 4 hours. 

Increasing storage isn't trival on the search server as I used the cheapest local storage option (also the quickest) as it was originally more than plentiful for this job. I need to get it back all on one server, but the current setup isn't easy to do that without using a tonne of resource. I may end up having to expede a new server build quicker than planned. 

  • Like 2
Posted

I've kicked off a full rebuild of the search cache. Will see how it holds up after flushing it out. It'll be a day or two before I can see how much it takes then. Also flushed the search system and crash logs as they had got to 2GB already which won't be helping things one bit.

Sorry for the inconvience with the search going AWOL for a day or two but hopefully should be all back to normal soon. Thanks for letting me know about the issue.

I'm off to bed now! 😂

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...