351-400 of 10000 results (30ms)
2018-04-24 ยง
12:51 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1109 (duration: 00m 58s) [production]
12:31 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Increase db1110 load (duration: 00m 58s) [production]
12:28 <elukey> cleanup /home/elukey/zookeeper backup files taken before the 3.4.9 migration [production]
12:13 <marostegui> Deploy schema change on db1098:3316 - T191519 T188299 T190148 [production]
12:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 for alter table (duration: 00m 58s) [production]
12:10 <elukey> reimage analytics106[34] to Debian Stretch [production]
12:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1088 after alter table (duration: 00m 58s) [production]
11:54 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1110 with low load (duration: 00m 59s) [production]
11:44 <moritzm> reimaging mw1241, mw1242, mw1243 (app servers) to stretch [production]
10:58 <moritzm> reimaging mw1224, mw1225, mw1226 (API servers) to stretch [production]
10:50 <elukey> reimage analytics106[56] to Debian Stretch [production]
10:49 <arturo> enable puppet in labtestcontrol2001 to sync with repo changes [production]
10:39 <akosiaris> starting a very slow rolling reboot of all VMs on codfw ganeti cluster T150532 [production]
10:39 <akosiaris> upgrade to qemu 2.8 on codfw ganeti cluster. T150532 [production]
10:31 <jynus> stop and reimage db1110 [production]
10:01 <apergos> reimaged snapshot1001 for testing with php7/stretch [production]
09:39 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1110 (duration: 00m 58s) [production]
09:28 <marostegui> Deploy schema change on db1088 - T191519 T188299 T190148 [production]
09:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1088 for alter table (duration: 00m 58s) [production]
09:25 <mobrovac@tin> Finished deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #3 - T192689 T190846 (duration: 04m 30s) [production]
09:23 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1093 after alter table (duration: 03m 06s) [production]
09:21 <moritzm> reimaging mw1221, mw1222, mw1223 (API servers) to stretch [production]
09:21 <mobrovac@tin> Started deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #3 - T192689 T190846 [production]
09:21 <moritzm> reimaging mw1221, mw1222, mw1223 (app servers) to stretch [production]
09:21 <mobrovac@tin> Finished deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #2 - T192689 T190846 (duration: 03m 03s) [production]
09:18 <mobrovac@tin> Started deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #2 - T192689 T190846 [production]
09:17 <mobrovac@tin> Finished deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points - T192689 T190846 (duration: 13m 13s) [production]
09:12 <moritzm> reimaging mw1273, mw1274, mw1275 (app servers) to stretch [production]
09:03 <mobrovac@tin> Started deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points - T192689 T190846 [production]
08:17 <hoo> Finished running populateSitesTable.php for all wikis (T192628, T192632, T192631, T192633) [production]
08:14 <elukey> upload druid_0.10.0-3~jessie1 (collection of druid packages) to jessie-wikimedia - T164008 [production]
08:05 <godog> power off restbase1010 for ssd replacement - T189822 [production]
07:50 <hoo> Started running populateSitesTable.php for all wikis (T192628, T192632, T192631, T192633) [production]
07:39 <marostegui> Rename user_old and user_temp tables on db1077 - T172664 [production]
07:28 <gehel> restarting blazegraph on wdqs1004 for jvm upgrade [production]
07:23 <marostegui> Reload haproxy on dbproxy1010 to depool labsdb1011 - T184446 [production]
07:16 <vgutierrez> Update puppet compiler facts [production]
06:56 <elukey> restart zookeeper on conf200[123] for openjdk upgrades [production]
06:41 <moritzm> installing poppler security updates [production]
06:35 <marostegui> Deploy schema change on db1093 - T191519 T188299 T190148 [production]
06:34 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 59s) [production]
05:21 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 after alter table (duration: 00m 59s) [production]
05:03 <_joe_> rebuilding the docker base images [production]
04:35 <mutante> repooled mw2224, reinstalling mw2225 through mw2228 [production]
03:08 <mutante> reinstalling mw2224.codfw.wmnet with wmf-auto-reimage [production]
02:55 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.30) (duration: 10m 37s) [production]
01:55 <cwd> payments, civi, and alerts re-enabled [production]
01:11 <ejegg> re-enabled fundraising jobs [production]
01:09 <ejegg> updated fundraising python tools from f3ed1d05b8 to 3754f32ab6 [production]
00:18 <mutante> removing travel@ and travelapproval@ exim aliases, moving to OIT/Google (T127549) [production]