2651-2700 of 10000 results (46ms)
2018-08-20 §
18:32 <jforrester@deploy1001> Synchronized wmf-config/throttle.php: SWAT T202003 Add throttle exemption for 24 August (duration: 00m 51s) [production]
18:31 <volans> restarted ircecho on einsteinium [production]
18:26 <gehel@deploy1001> Started deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater [production]
18:25 <gehel@deploy1001> Finished deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (wdqs1009 only) (duration: 00m 32s) [production]
18:24 <gehel@deploy1001> Started deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (wdqs1009 only) [production]
18:05 <volans> restarting icinga, re-occurrence of T196336 [production]
17:44 <chasemp> install iotop on stat1004 [production]
17:08 <XenoRyet> updated payments-wiki from 360bea8331 to 268539c2bd [production]
16:59 <ppchelko@deploy1001> Finished deploy [cpjobqueue/deploy@4989231]: Create metrics to track the actual concurrent job executions T202107 (duration: 00m 55s) [production]
16:58 <ppchelko@deploy1001> Started deploy [cpjobqueue/deploy@4989231]: Create metrics to track the actual concurrent job executions T202107 [production]
14:14 <moritzm> rolling upgrade of scb in codfw to latest nodejs security update [production]
13:46 <moritzm> installing jetty9 security updates [production]
13:00 <marostegui> Increase max_connections from 500 to 800 on db1073 to triage issues - T188589 [production]
12:51 <jynus> reload dbproxy1005 [production]
12:29 <moritzm> upgrading scb2006 to latest nodejs along with rolling restarts of node-based services [production]
12:02 <zeljkof> EU SWAT finished [production]
12:01 <arturo> T202261 extend icinga downtime 1D for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet neutron not properly syncing with agents [production]
11:56 <zfilipin@deploy1001> Synchronized static/images/project-logos/: SWAT: [[gerrit:453383|Adding Chinese Wikiversitys logos (T202127)]] (duration: 00m 50s) [production]
11:50 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:453693|Use HD logos for lfnwiki (T202228)]] (duration: 00m 50s) [production]
11:41 <zfilipin@deploy1001> Synchronized static/images/project-logos/: SWAT: [[gerrit:453692|Upload HD logos for lfnwiki (T202228)]] (duration: 00m 50s) [production]
11:36 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:451823|Enable Rollbacker User Group at ru.wikiquote (T200201)]] (duration: 00m 53s) [production]
11:25 <arturo> T202261 icinga downtime 1h for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet previous to patch merge [production]
11:07 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:450450|Allow all bureaucrats to remove interface-admin]] (duration: 00m 54s) [production]
11:01 <arturo> T202261 disabled puppet in cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet [production]
10:31 <moritzm> rebooting mw1261 for kernel update/some tests [production]
10:23 <moritzm> rebooting mw2234 for some kernel tests [production]
10:07 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf2 to apt.wikimedia.org [production]
09:31 <moritzm> uploaded nodejs 6.11.0~dfsg-1+wmf2+jessie to apt.wikimedia.org [production]
08:50 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request (duration: 06m 29s) [production]
08:43 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request [production]
08:43 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request - T201974 (duration: 18m 17s) [production]
08:42 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1100 (duration: 00m 50s) [production]
08:31 <moritzm> installing systemd updates from stretch 9.5 point release [production]
08:25 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3]: Remove contentmodel from MW API revision request - T201974 [production]
08:24 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request (duration: 06m 02s) [production]
08:18 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request [production]
08:16 <mobrovac@deploy1001> Finished deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request - T201974 (duration: 04m 16s) [production]
08:15 <marostegui> Deploy schema change on db1100 to check for regressions [production]
08:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1100 (duration: 00m 50s) [production]
08:12 <mobrovac@deploy1001> Started deploy [restbase/deploy@a3ae0d3] (dev-cluster): Remove contentmodel from MW API revision request - T201974 [production]
08:03 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db1100 (duration: 01m 02s) [production]
07:29 <gehel> resetting management card on elastic1022 [production]
06:57 <volans> reset-failed debmonitor failed session on ms-be2024 ^^^^ [production]
02:47 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Mon Aug 20 02:47:17 UTC 2018 (duration 10m 22s) [production]
02:36 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.16) (duration: 14m 23s) [production]
2018-08-17 §
16:24 <gehel> disabling systemd state check for elastic eqiad until T202120 is fixed [production]
14:38 <moritzm> rebooting elnath for some kernel tests [production]
13:02 <jynus> stopping db2084 for upgrade [production]
12:49 <imarlier@deploy1001> Finished deploy [performance/coal@aff3793]: (no justification provided) (duration: 01m 06s) [production]
12:48 <imarlier@deploy1001> Started deploy [performance/coal@aff3793]: (no justification provided) [production]