|
2018-08-21
§
|
| 05:09 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 (duration: 00m 51s) |
[production] |
| 04:54 |
<marostegui> |
Set max_connections back from 800 to 500 on db1073 - T188589 |
[production] |
| 02:47 |
<krinkle@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: rm unused Id5f5295d (duration: 00m 50s) |
[production] |
| 02:43 |
<krinkle@deploy1001> |
Synchronized wmf-config/CommonSettings.php: rm unused I741b16452 (duration: 00m 56s) |
[production] |
| 02:39 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Tue Aug 21 02:39:12 UTC 2018 (duration 10m 18s) |
[production] |
| 02:28 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.16) (duration: 08m 32s) |
[production] |
| 01:35 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Enable broadcasted mcrouter operations for all wikis (duration: 00m 51s) |
[production] |
| 00:07 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@9fbf9fa]: Don't clean up the queue size counters (duration: 00m 46s) |
[production] |
| 00:07 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@9fbf9fa]: Don't clean up the queue size counters |
[production] |
|
2018-08-20
§
|
| 23:09 |
<twentyafterfour> |
Finished evening SWAT |
[production] |
| 23:08 |
<twentyafterfour@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/454083/ Phab Task: T202065 (duration: 00m 51s) |
[production] |
| 23:06 |
<twentyafterfour> |
https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/454083/ deployed to mwdebug1001 |
[production] |
| 22:53 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@c947567]: Use timing for queue sizes as a workaround to grafana not plotting gauges (duration: 00m 45s) |
[production] |
| 22:52 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@c947567]: Use timing for queue sizes as a workaround to grafana not plotting gauges |
[production] |
| 22:29 |
<eileen> |
civicrm revision changed from 3f6dd6c9a6 to 8910c34502, config revision is d787269882 |
[production] |
| 22:27 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@541932a]: Make the queue sized report stats once a second T202107 (duration: 00m 46s) |
[production] |
| 22:26 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@541932a]: Make the queue sized report stats once a second T202107 |
[production] |
| 22:13 |
<mutante> |
ganeti1001 - creating 3 new VMs for analytics-tools |
[production] |
| 21:08 |
<eileen> |
civicrm revision is 3f6dd6c9a6, config revision is d787269882 |
[production] |
| 21:07 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@f59ce0c]: deploying changes to virtualpageview spam site filtering (duration: 10m 17s) |
[production] |
| 20:56 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@f59ce0c]: deploying changes to virtualpageview spam site filtering |
[production] |
| 20:43 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Set "cluster" parameter for mcrouter broadcast routing prefixes (duration: 00m 50s) |
[production] |
| 20:36 |
<arlolra> |
Updated Parsoid to 129d71f (T130224, T199926) |
[production] |
| 20:35 |
<mbsantos@deploy1001> |
Finished deploy [mobileapps/deploy@cae24fe]: Update mobileapps to 95e976d (T202105) (duration: 06m 19s) |
[production] |
| 20:29 |
<mbsantos@deploy1001> |
Started deploy [mobileapps/deploy@cae24fe]: Update mobileapps to 95e976d (T202105) |
[production] |
| 20:26 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@44aa5e8]: Updating Parsoid to 129d71f (duration: 11m 29s) |
[production] |
| 20:14 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@44aa5e8]: Updating Parsoid to 129d71f |
[production] |
| 19:35 |
<jforrester@deploy1001> |
Finished scap: i18n sync for WikimediaMessages clean-up following T202095 (duration: 31m 12s) |
[production] |
| 19:03 |
<jforrester@deploy1001> |
Started scap: i18n sync for WikimediaMessages clean-up following T202095 |
[production] |
| 19:00 |
<jforrester@deploy1001> |
Synchronized php-1.32.0-wmf.16/extensions/WikimediaMessages/: SWAT T202095 Reinstate "Rename global OTRS-member group to otrs-member" (will need scap sync later) (duration: 00m 49s) |
[production] |
| 18:56 |
<jforrester@deploy1001> |
Synchronized php-1.32.0-wmf.16/extensions/TimedMediaHandler/: SWAT T202208Fix regression: double-reg of file types and incorrect mp4 (duration: 00m 52s) |
[production] |
| 18:44 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT T201783 T202014 Add Contact link to footers of fr,ruwiki (duration: 00m 50s) |
[production] |
| 18:36 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (duration: 10m 25s) |
[production] |
| 18:32 |
<jforrester@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT T202003 Add throttle exemption for 24 August (duration: 00m 51s) |
[production] |
| 18:31 |
<volans> |
restarted ircecho on einsteinium |
[production] |
| 18:26 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater |
[production] |
| 18:25 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (wdqs1009 only) (duration: 00m 32s) |
[production] |
| 18:24 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (wdqs1009 only) |
[production] |
| 18:05 |
<volans> |
restarting icinga, re-occurrence of T196336 |
[production] |
| 17:44 |
<chasemp> |
install iotop on stat1004 |
[production] |
| 17:08 |
<XenoRyet> |
updated payments-wiki from 360bea8331 to 268539c2bd |
[production] |
| 16:59 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@4989231]: Create metrics to track the actual concurrent job executions T202107 (duration: 00m 55s) |
[production] |
| 16:58 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@4989231]: Create metrics to track the actual concurrent job executions T202107 |
[production] |
| 14:14 |
<moritzm> |
rolling upgrade of scb in codfw to latest nodejs security update |
[production] |
| 13:46 |
<moritzm> |
installing jetty9 security updates |
[production] |
| 13:00 |
<marostegui> |
Increase max_connections from 500 to 800 on db1073 to triage issues - T188589 |
[production] |
| 12:51 |
<jynus> |
reload dbproxy1005 |
[production] |
| 12:29 |
<moritzm> |
upgrading scb2006 to latest nodejs along with rolling restarts of node-based services |
[production] |
| 12:02 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:01 |
<arturo> |
T202261 extend icinga downtime 1D for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet neutron not properly syncing with agents |
[production] |