2151-2200 of 10000 results (68ms)
2018-08-20 §
12:02 <zeljkof> EU SWAT finished [production]
12:01 <arturo> T202261 extend icinga downtime 1D for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet neutron not properly syncing with agents [production]
11:56 <zfilipin@deploy1001> Synchronized static/images/project-logos/: SWAT: [[gerrit:453383|Adding Chinese Wikiversitys logos (T202127)]] (duration: 00m 50s) [production]
11:50 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:453693|Use HD logos for lfnwiki (T202228)]] (duration: 00m 50s) [production]
11:41 <zfilipin@deploy1001> Synchronized static/images/project-logos/: SWAT: [[gerrit:453692|Upload HD logos for lfnwiki (T202228)]] (duration: 00m 50s) [production]
11:36 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:451823|Enable Rollbacker User Group at ru.wikiquote (T200201)]] (duration: 00m 53s) [production]
11:25 <arturo> T202261 icinga downtime 1h for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet previous to patch merge [production]
11:07 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:450450|Allow all bureaucrats to remove interface-admin]] (duration: 00m 54s) [production]
11:01 <arturo> T202261 disabled puppet in cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet [production]
10:31 <moritzm> rebooting mw1261 for kernel update/some tests [production]
10:23 <moritzm> rebooting mw2234 for some kernel tests [production]
10:07 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf2 to apt.wikimedia.org [production]
09:31 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf2+jessie to apt.wikimedia.org [production]
08:50 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request (duration: 06m 29s) [production]
08:43 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request [production]
08:43 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request - T201974 (duration: 18m 17s) [production]
08:42 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1100 (duration: 00m 50s) [production]
08:31 <moritzm> installing systemd updates from stretch 9.5 point release [production]
08:25 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request - T201974 [production]
08:24 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request (duration: 06m 02s) [production]
08:18 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request [production]
08:16 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request - T201974 (duration: 04m 16s) [production]
08:15 <marostegui> Deploy schema change on db1100 to check for regressions [production]
08:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 00m 50s) [production]
08:12 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request - T201974 [production]
08:03 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db1100 (duration: 01m 02s) [production]
07:29 <gehel> resetting management card on elastic1022 [production]
06:57 <volans> reset-failed debmonitor failed session on ms-be2024 ^^^^ [production]
02:47 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Mon Aug 20 02:47:17 UTC 2018 (duration 10m 22s) [production]
02:36 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.16) (duration: 14m 23s) [production]
2018-08-17 §
16:24 <gehel> disabling systemd state check for elastic eqiad until T202120 is fixed [production]
14:38 <moritzm> rebooting elnath for some kernel tests [production]
13:02 <jynus> stopping db2084 for upgrade [production]
12:49 <imarlier@deploy1001> Finished deploy [performance/coal@aff3793]: (no justification provided) (duration: 01m 06s) [production]
12:48 <imarlier@deploy1001> Started deploy [performance/coal@aff3793]: (no justification provided) [production]
12:46 <gehel> rebooting relforge for JVM and kernel upgrade [production]
12:36 <moritzm> installing openjdk-8 security updates on elastic* in codfw (eqiad already has it via the recent reimage to stretch) [production]
12:30 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097 (duration: 00m 53s) [production]
12:07 <gehel> repooling wdqs2003, catched up on updates [production]
10:58 <moritzm> rebooting mw2152-mw2162 for kernel security update (also bundling wikidiff and apache updates) [production]
10:35 <moritzm> powercycling mw2286 [production]
09:47 <moritzm> rebooting mw2243-mw2290 for kernel security update (also bundling wikidiff and apache updates) [production]
09:03 <gehel> depool wdqs2003 to catch up on updates [production]
08:29 <jynus> stopping db2073 for upgrade [production]
08:13 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097 (duration: 00m 54s) [production]
08:06 <gehel> silencing systemd check as mjolnir is flapping [production]
07:59 <gehel> restarting mjolnir on all elastic / cirrus nodes [production]
07:42 <jynus> stopping db2085 for upgrade [production]
07:41 <moritzm> rebooting mw2220-mw2242 for kernel security update (also bundling wikidiff and apache updates) [production]
00:42 <krinkle@deploy1001> Synchronized wmf-config/: rm StartProfiler.php / Ia83751695f35def / T201782 (duration: 00m 50s) [production]