Okay, so things really went downhill fast during yesterdays planned server-maintenance. But, much of the systems are back on-line again.

The plan was to ensure all the servers and the underlying Linux (Debian) operating system was fully up-to-date before this weekend - since there are some events planned for Fistful of Frags (FoF).

While applying the latest updates to the underlying Linux operating system (Debian 11 "Bullseye" - the now old-stable release), the last update (a "kernel update") required a reboot. At the end of that reboot, the system went into an endless "boot-loop". So, obviously, something went wrong with applying that kernel update.

The entire VPS was re-installed from scratch, using the current stable Debian release (Debian 12 "Bookworm").

This necessitates rebuilding everything afterwards, including:

• Re-installing web-server (Apache) stuff.
  
• Setting-up the various web-sites (game-server back-end stuff, home-page, SourceBans, etc.)
  
• Setting-up the database for SourceBans.
  
• Re-installing various game-servers.
  
• Restoring game-server contents from backup (where available).
  
• Lots of troubleshooting custom content downloads in-game, etc.

Here is the functionality that is already restored:

• SourceBans (web-site and database) - including previous ban history.
  
• Back-end web-site that various games use for custom content.
  
• Default WeaselsLair.com web-site.
  
• Both HL1 game-servers.
  
• All three CS1 game-servers.
  
• The CS:S game-server.
  
• The TF2 game-server.
  
• The HLDM:S testing game-server.

Here is the functionality that is NOT yet restored:

• Various scheduled automation (backups, update-checks, etc.).
  
• All three FoF game-servers.

Unfortunately and somewhat ironically, the FoF servers are the ones that probably have the greatest need to get running, but are the only ones I was not able to easily restore from backups. I will be rebuilding at least one of them manually tomorrow to have it online for the up-coming FoF-related events this weekend.

All Weasel's Lair stuff (game-servers, back-end web-site, source-bans, etc.) will be down intermittently today while I perform various maintenance.

Not sure exactly what is going-on yet. But, the Weasel's Lair system is down at the moment, including games and back-end stuff. Investigating.

UPDATE: Found the problem, everything is back up again!

The folks over at AlliedModders[forums.alliedmods.net] the makers of SourceMod[www.sourcemod.net] have released fixes for the issues that the Valve updates yesterday broke. I have applied the updated and performed some basic testing on the servers. Both affected servers are now back online:

• The Team Fortress 2 (TF2) server: details here.

• The Counter-Strike:Source (CSS) server: details here.

The full list of our dedicated-game servers is available here - including TF2, CS:S, CS1 and HL1.

UPDATE: Fixes so far have not worked. TF2 is still crashing, etc.

The folks over at AlliedModders[forums.alliedmods.net] the makers of SourceMod[www.sourcemod.net] have released fixes for the issues that the Valve updates yesterday broke. I have applied the updated and performed some basic testing on the servers. Both affected servers are now back online:

• The Team Fortress 2 (TF2) server: details here.

• The Counter-Strike:Source (CSS) server: details here.

The full list of our dedicated-game servers is available here - including TF2, CS:S, CS1 and HL1.