751-800 of 10000 results (21ms)
2013-10-08 §
09:39 <mutante> puppetstoredconflicean .. killiam williams.wikimedia.org .. done [production]
09:11 <mutante> installing package upgrades on calcium (cameras) [production]
07:52 <springle> synchronized wmf-config/db-eqiad.php 'warm up db1039 in s6' [production]
07:20 <ariel> synchronized wmf-config/db-eqiad.php 'depool db1040 for upgrade/conversion to mariadb' [production]
06:37 <apergos> fixed up salt on mw1046, mw1072, mw1173 [production]
03:30 <springle> synchronized wmf-config/db-eqiad.php 's6 db1015 to full steam' [production]
03:23 <springle> xtrabackup clone s6 db1039 to db1022 [production]
03:20 <springle> rmmod nf_conntrack on db1002 causing mass mysql connect failure [production]
02:36 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Oct 8 02:35:56 UTC 2013 [production]
02:31 <springle> start online optimize logging indexes s4 & s5 [production]
02:25 <LocalisationUpdate> completed (1.22wmf19) at Tue Oct 8 02:25:27 UTC 2013 [production]
02:13 <LocalisationUpdate> completed (1.22wmf20) at Tue Oct 8 02:13:54 UTC 2013 [production]
00:11 <LeslieCarr> all ams-ix traffic is now on cr2-esams [production]
2013-10-07 §
23:36 <LeslieCarr> turning up new ams-ix port on cr2-esams [production]
23:24 <LeslieCarr> traffic draining from ams-ix on cr2-knams [production]
23:22 <LeslieCarr> moving european traffic around [production]
20:46 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Oct 7 20:46:05 UTC 2013 [production]
20:33 <LocalisationUpdate> completed (1.22wmf19) at Mon Oct 7 20:33:53 UTC 2013 [production]
20:23 <LocalisationUpdate> completed (1.22wmf20) at Mon Oct 7 20:23:45 UTC 2013 [production]
20:05 <LocalisationUpdate> failed: git pull of extensions failed [production]
19:35 <reedy> synchronized wmf-config/ [production]
18:56 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: commonswiki back to 1.22wmf20, thumb.php fixed [production]
18:55 <reedy> synchronized php-1.22wmf20/thumb.php [production]
18:40 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: commonswiki back to 1.22wmf19 [production]
18:38 <ottomata> backporting python-docopt 0.6.1 for precise and including in our apt repo [production]
18:24 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: Everything non 'pedia to 1.22wmf20 [production]
18:17 <reedy> synchronized php-1.22wmf20/extensions/Wikibase [production]
17:43 <paravoid> changed ms-fe1/2's mgmt IPs, ip clash with nas1-a/b's e0M [production]
17:28 <mwalker> payments update from I3a09af2cbd8566bbeb431437c49e72c832b87304 to I61bc80f257c590c1abeb716145c23921b005e5a8 [production]
16:05 <krinkle> synchronized wmf-config/InitialiseSettings.php 'I59e2547002bac5' [production]
14:50 <RoanKattouw> Restarting Parsoid on wtp10[01-24] on request; load avg reaching 90% [production]
14:28 <Coren> Labstore4 Configuring; will bounce up and down over the next two days. [production]
12:57 <akosiaris> brought icinga back up, after manually running puppet on neon [production]
12:39 <hashar> gallium : restarting Zuul. [production]
12:37 <hashar> gallium / Zuul : cherry picked a change from OpenStack related to statsd metrics. Our change: {{gerrit|88063}} [production]
11:30 <mutante> new public mailing list for the Wikimania Steering Commitee - wikimania-com [production]
11:25 <hashar> gallium : zuul restarted and apparently starting statsd metrics. [production]
11:03 <hashar> gallium : killed a bunch of stalled jenkins/java threads [production]
11:02 <hashar> gallium : restarting Zuul to enable statsd reporting {{gerrit|86744}} [production]
10:41 <paravoid> rebooting labstore3, NFS lockupo [production]
10:18 <springle> synchronized wmf-config/db-eqiad.php 'depool db1021' [production]
10:10 <apergos> powercycling srv291 [production]
09:44 <springle> synchronized wmf-config/db-eqiad.php 'warm up db1015' [production]
03:19 <springle> xtrabackup clone db43 to db1022 [production]
02:04 <LocalisationUpdate> failed: git pull of extensions failed [production]
00:59 <springle> synchronized wmf-config/db-eqiad.php 'depool db1022 for upgrade' [production]
2013-10-06 §
02:07 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Oct 6 02:07:25 UTC 2013 [production]
02:02 <LocalisationUpdate> completed (1.22wmf20) at Sun Oct 6 02:02:50 UTC 2013 [production]
02:02 <LocalisationUpdate> completed (1.22wmf19) at Sun Oct 6 02:02:03 UTC 2013 [production]
2013-10-05 §
02:25 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Oct 5 02:25:46 UTC 2013 [production]