

This still works great as a hot failover, though, which got tested in action this last Sunday when we had a system board failure on the master database server in Phoenix. Failing the entire site over to San Jose took only minutes, and the tech from HP showed up to swap the system board 4 hours later. The fun part was that I had only finished setting up this hot failover setup about a week prior, so the timing couldn’t have been any better for that system board failure. If it had happened any sooner we might have been down for a long time waiting for the server to get fixed. We have the entire site set up in two different datacenters (SJC1 is our San Jose datacenter, PHX1 is our Phoenix datacenter). Thanks to the load balancers taking care of the cross-datacenter connections for the master databases, it’s actually possible to run it from both sites concurrently to split the load. But because of the amount of traffic Bugzilla does to the master databases, and the latency in connection setup over that distance, it’s a little bit slow from whichever datacenter isn’t currently hosting the master, so we’ve been trying to keep DNS pointed at just one of them to keep it speedy.
BUGZILLA VW FULL
We have much cleaning up to do now, which probably includes a few trips to ‘ Elf Hospital‘, so whilst we do that there’s loads more for you to see of Michael’s brilliant ‘Bugzilla’ build – which includes a V6 engine, opening doors and hood, and a detailed interior too – at the Eurobricks discussion forum, with the complete image gallery available on Bricksafe.I recently did up a diagram of how our Bugzilla site was set up, mostly for the benefit of other sysadmins trying to find the various pieces of it. Several folks expressed interest in sharing it with the community just to show an example of how we were set up. So I cleaned it up a little, and here it is: Click the image for a full-size (readable) versionĪt first glance it looks somewhat excessive just for a Bugzilla, but since the Mozilla Project lives and dies by the content of this site, all work pretty much stops if it doesn’t work, so it’s one of our highest-priority sites to keep operating at all times for developer support. The actual hardware required to run the site at full capacity for the amount of users we get hitting it is a little less than half of what’s shown in the diagram.

Of course the Elf that found Michael’s creation was ecstatic about the whole event, which seeing as it’s likely a victim of multiple past smushings itself is probably understandable. The ‘opportunity’ arrived in the form of this, Michael217’s incredible Volkswagen Beetle monster truck ‘Bugzilla’, as featured in the video game ‘Wreckfest’.Īll-wheel-drive via a Buggy Motor, Servo steering, enormous suspension above even more enormous wheels, and a slew of body-mounted spikes give Michael’s creation almost mythical Elf-squashing abilities, which were used to full effect by the one at the controls.Īt least a dozen were flattened in the corridor with amusing cartoon tyre prints running down their lengths, a few were splatted against the skirting boards, and a handful were even impaled on ‘Bugzilla’ itself thanks to the spiky bricks mounted all over it.


Or maybe we’d simply forgotten this particular narrative, but whatever it was we were rudely and wholly reminded of the Elves’ propensity to smash one another to bits if given the opportunity. Maybe we thought the Elves had wised up to the threat of remote control creations. This morning has been a stressful one here in TLCB Towers.
