201-250 of 4664 results (3ms)
2009-11-09 §
17:04 <mark> OS-installed nfs2 [production]
16:40 <mark> Running restart of puppetd across the cluster [production]
16:35 <mark> Running backup of db20 /home [production]
16:28 <mark> Running dist-upgrade on locke [production]
16:00 <mark> fsck repaired /var/backup on mchenry, filesystem remounted [production]
15:55 <mark> Added tridge to the ALL node group [production]
15:49 <mark> dist-upgrade and reboot of tridge [production]
15:42 <mark> Running new fsck on mchenry while the system is up [production]
15:41 <mark> /var/backups filesystem on mchenry is corrupt [production]
15:22 <mark> Reset DRAC password of sanger [production]
15:18 <mark> Rebooting mchenry [production]
15:16 <mark> Running apt-get dist-upgrade on mchenry [production]
15:06 <mark> Rebooting sanger [production]
15:04 <mark> Running apt-get dist-upgrade on sanger [production]
14:41 <mark> Shutdown bart for decommissioning [production]
14:36 <mark> Deployed cron job to restart puppet daily [production]
14:35 <mark> Deployed automatic updating of GeoIP database across the cluster [production]
08:14 <brion> killed duplicate wikibugs irc bot connection, stopping double bug reporting in #mediawiki [production]
03:17 <Tim> updating SecurePoll to r58802 [production]
2009-11-08 §
22:10 <mark> Added the esams ganglia clusters to the Florida grid (why the hierarchy?) [production]
21:52 <domas> dropped one snapshot on ixia, other still up. [production]
21:52 <Andrew> domas says he did some magic with i/o on ixia, replag back to zero. [production]
21:51 <andrew> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Turning GlobalUsage back on' [production]
21:41 <mark> Experimentally installed unattended-upgrades on server sockpuppet [production]
21:41 <mark> Reboot srv156 [production]
21:38 <andrew> synchronized php-1.5/wmf-config/InitialiseSettings.php 'Deactivating GlobalUsage to check impact on ixia replag.' [production]
21:24 <Andrew> ixia still has huge replication lag, refreshGlobalImageLinks definitely not still running. [production]
18:31 <mark> Unmounted /home on thistle, ixia, lomaria, db1 and db11 [production]
17:26 <aaron> synchronized php-1.5/extensions/FlaggedRevs/specialpages/Stabilization_body.php 'deployed r58786' [production]
16:51 <brion> taking load off ixia to let it catch up; it's still lagged on GlobalUsage inserts [production]
16:51 <brion> synchronized php-1.5/wmf-config/db.php [production]
16:09 <Bryan> Correction: --start-image=Symbol_neutral_vote.svg --start-page=15088846 --maxlag=5 [production]
16:04 <Bryan> Parameters to restart refreshGlobalimagelinks.php with on enwiki: --start-image Symbol_neutral_vote.svg --start-page=15088846 --maxlag 5 [production]
16:02 <brion> stopped andrew's refreshGlobalimagelinks.php job on hume pending fixes and someone to babysit it [production]
15:58 <brion> ixia lag from GlobalUsage population script; Bryan poking at it to make it behave nicer [production]
15:55 <brion> commonswiki | Connect | 510 | NULL | INSERT /* GlobalUsage::setUsage */ INTO `globalimagelinks` (gil_wiki,gil_page,gil_page_namespace,g | [production]
15:50 <brion> circa 8 minutes replag on ixia :( [production]
15:30 <brion> adding missing 'zh' variant URL alias (used for default or something? there's a tab for it) [production]
15:25 <brion> updating all main.conf wiki entries w/ zh variant alias entries (most missing from all but wikipedia.org and wikisource.org) for [[bugzilla:19019]] [production]
13:32 <mark> Shutdown khaldun [production]
13:04 <brion_> restarted parser test loop on wikitech [fixme: make an init script] [production]
13:01 <brion_> parser tests not running since oct 27; looks like wikitech was rebooted then. checking.... [production]
10:24 <andrew> synchronized php-1.5/extensions/GlobalUsage/SpecialGlobalUsage.php 'Deploy r58752' [production]
10:21 <andrew> synchronized php-1.5/extensions/GlobalUsage/GlobalUsage_body.php 'Deploy r58752' [production]
09:50 <Andrew> Set up globalusage for all wikis [production]
09:48 <andrew> synchronized php-1.5/wmf-config/InitialiseSettings.php [production]
09:28 <apergos> cleaned out some space from /tmp and ran apt-get clean on srv218, these should probably become a cron job [production]
09:27 <andrew> synchronized php-1.5/includes/ImagePage.php 'Merge r58692' [production]
09:23 <Andrew> scapping to update GlobalUsage [production]
09:20 <brion> srv218: rsync: write failed on "/apache/common/php-1.5/wmf-config/InitialiseSettings.php": No space left on device (28) [production]