|
2018-04-24
§
|
| 12:28 |
<elukey> |
cleanup /home/elukey/zookeeper backup files taken before the 3.4.9 migration |
[production] |
| 12:13 |
<marostegui> |
Deploy schema change on db1098:3316 - T191519 T188299 T190148 |
[production] |
| 12:11 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 for alter table (duration: 00m 58s) |
[production] |
| 12:10 |
<elukey> |
reimage analytics106[34] to Debian Stretch |
[production] |
| 12:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1088 after alter table (duration: 00m 58s) |
[production] |
| 11:54 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1110 with low load (duration: 00m 59s) |
[production] |
| 11:44 |
<moritzm> |
reimaging mw1241, mw1242, mw1243 (app servers) to stretch |
[production] |
| 10:58 |
<moritzm> |
reimaging mw1224, mw1225, mw1226 (API servers) to stretch |
[production] |
| 10:50 |
<elukey> |
reimage analytics106[56] to Debian Stretch |
[production] |
| 10:49 |
<arturo> |
enable puppet in labtestcontrol2001 to sync with repo changes |
[production] |
| 10:39 |
<akosiaris> |
starting a very slow rolling reboot of all VMs on codfw ganeti cluster T150532 |
[production] |
| 10:39 |
<akosiaris> |
upgrade to qemu 2.8 on codfw ganeti cluster. T150532 |
[production] |
| 10:31 |
<jynus> |
stop and reimage db1110 |
[production] |
| 10:01 |
<apergos> |
reimaged snapshot1001 for testing with php7/stretch |
[production] |
| 09:39 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1110 (duration: 00m 58s) |
[production] |
| 09:28 |
<marostegui> |
Deploy schema change on db1088 - T191519 T188299 T190148 |
[production] |
| 09:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 for alter table (duration: 00m 58s) |
[production] |
| 09:25 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #3 - T192689 T190846 (duration: 04m 30s) |
[production] |
| 09:23 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1093 after alter table (duration: 03m 06s) |
[production] |
| 09:21 |
<moritzm> |
reimaging mw1221, mw1222, mw1223 (API servers) to stretch |
[production] |
| 09:21 |
<mobrovac@tin> |
Started deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #3 - T192689 T190846 |
[production] |
| 09:21 |
<moritzm> |
reimaging mw1221, mw1222, mw1223 (app servers) to stretch |
[production] |
| 09:21 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #2 - T192689 T190846 (duration: 03m 03s) |
[production] |
| 09:18 |
<mobrovac@tin> |
Started deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points, take #2 - T192689 T190846 |
[production] |
| 09:17 |
<mobrovac@tin> |
Finished deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points - T192689 T190846 (duration: 13m 13s) |
[production] |
| 09:12 |
<moritzm> |
reimaging mw1273, mw1274, mw1275 (app servers) to stretch |
[production] |
| 09:03 |
<mobrovac@tin> |
Started deploy [restbase/deploy@1661f69]: Increase the deletion probability to 50% and expose the CSS end points - T192689 T190846 |
[production] |
| 08:17 |
<hoo> |
Finished running populateSitesTable.php for all wikis (T192628, T192632, T192631, T192633) |
[production] |
| 08:14 |
<elukey> |
upload druid_0.10.0-3~jessie1 (collection of druid packages) to jessie-wikimedia - T164008 |
[production] |
| 08:05 |
<godog> |
power off restbase1010 for ssd replacement - T189822 |
[production] |
| 07:50 |
<hoo> |
Started running populateSitesTable.php for all wikis (T192628, T192632, T192631, T192633) |
[production] |
| 07:39 |
<marostegui> |
Rename user_old and user_temp tables on db1077 - T172664 |
[production] |
| 07:28 |
<gehel> |
restarting blazegraph on wdqs1004 for jvm upgrade |
[production] |
| 07:23 |
<marostegui> |
Reload haproxy on dbproxy1010 to depool labsdb1011 - T184446 |
[production] |
| 07:16 |
<vgutierrez> |
Update puppet compiler facts |
[production] |
| 06:56 |
<elukey> |
restart zookeeper on conf200[123] for openjdk upgrades |
[production] |
| 06:41 |
<moritzm> |
installing poppler security updates |
[production] |
| 06:35 |
<marostegui> |
Deploy schema change on db1093 - T191519 T188299 T190148 |
[production] |
| 06:34 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 59s) |
[production] |
| 05:21 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1096:3316 after alter table (duration: 00m 59s) |
[production] |
| 05:03 |
<_joe_> |
rebuilding the docker base images |
[production] |
| 04:35 |
<mutante> |
repooled mw2224, reinstalling mw2225 through mw2228 |
[production] |
| 03:08 |
<mutante> |
reinstalling mw2224.codfw.wmnet with wmf-auto-reimage |
[production] |
| 02:55 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.30) (duration: 10m 37s) |
[production] |
| 01:55 |
<cwd> |
payments, civi, and alerts re-enabled |
[production] |
| 01:11 |
<ejegg> |
re-enabled fundraising jobs |
[production] |
| 01:09 |
<ejegg> |
updated fundraising python tools from f3ed1d05b8 to 3754f32ab6 |
[production] |
| 00:18 |
<mutante> |
removing travel@ and travelapproval@ exim aliases, moving to OIT/Google (T127549) |
[production] |