|
2018-08-20
ยง
|
| 23:09 |
<twentyafterfour> |
Finished evening SWAT |
[production] |
| 23:08 |
<twentyafterfour@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/454083/ Phab Task: T202065 (duration: 00m 51s) |
[production] |
| 23:06 |
<twentyafterfour> |
https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/454083/ deployed to mwdebug1001 |
[production] |
| 22:53 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@c947567]: Use timing for queue sizes as a workaround to grafana not plotting gauges (duration: 00m 45s) |
[production] |
| 22:52 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@c947567]: Use timing for queue sizes as a workaround to grafana not plotting gauges |
[production] |
| 22:29 |
<eileen> |
civicrm revision changed from 3f6dd6c9a6 to 8910c34502, config revision is d787269882 |
[production] |
| 22:27 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@541932a]: Make the queue sized report stats once a second T202107 (duration: 00m 46s) |
[production] |
| 22:26 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@541932a]: Make the queue sized report stats once a second T202107 |
[production] |
| 22:13 |
<mutante> |
ganeti1001 - creating 3 new VMs for analytics-tools |
[production] |
| 21:08 |
<eileen> |
civicrm revision is 3f6dd6c9a6, config revision is d787269882 |
[production] |
| 21:07 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@f59ce0c]: deploying changes to virtualpageview spam site filtering (duration: 10m 17s) |
[production] |
| 20:56 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@f59ce0c]: deploying changes to virtualpageview spam site filtering |
[production] |
| 20:43 |
<aaron@deploy1001> |
Synchronized wmf-config/mc.php: Set "cluster" parameter for mcrouter broadcast routing prefixes (duration: 00m 50s) |
[production] |
| 20:36 |
<arlolra> |
Updated Parsoid to 129d71f (T130224, T199926) |
[production] |
| 20:35 |
<mbsantos@deploy1001> |
Finished deploy [mobileapps/deploy@cae24fe]: Update mobileapps to 95e976d (T202105) (duration: 06m 19s) |
[production] |
| 20:29 |
<mbsantos@deploy1001> |
Started deploy [mobileapps/deploy@cae24fe]: Update mobileapps to 95e976d (T202105) |
[production] |
| 20:26 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@44aa5e8]: Updating Parsoid to 129d71f (duration: 11m 29s) |
[production] |
| 20:14 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@44aa5e8]: Updating Parsoid to 129d71f |
[production] |
| 19:35 |
<jforrester@deploy1001> |
Finished scap: i18n sync for WikimediaMessages clean-up following T202095 (duration: 31m 12s) |
[production] |
| 19:03 |
<jforrester@deploy1001> |
Started scap: i18n sync for WikimediaMessages clean-up following T202095 |
[production] |
| 19:00 |
<jforrester@deploy1001> |
Synchronized php-1.32.0-wmf.16/extensions/WikimediaMessages/: SWAT T202095 Reinstate "Rename global OTRS-member group to otrs-member" (will need scap sync later) (duration: 00m 49s) |
[production] |
| 18:56 |
<jforrester@deploy1001> |
Synchronized php-1.32.0-wmf.16/extensions/TimedMediaHandler/: SWAT T202208Fix regression: double-reg of file types and incorrect mp4 (duration: 00m 52s) |
[production] |
| 18:44 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT T201783 T202014 Add Contact link to footers of fr,ruwiki (duration: 00m 50s) |
[production] |
| 18:36 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (duration: 10m 25s) |
[production] |
| 18:32 |
<jforrester@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT T202003 Add throttle exemption for 24 August (duration: 00m 51s) |
[production] |
| 18:31 |
<volans> |
restarted ircecho on einsteinium |
[production] |
| 18:26 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater |
[production] |
| 18:25 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (wdqs1009 only) (duration: 00m 32s) |
[production] |
| 18:24 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@df2da41]: new version of wdqs GUI and updater (wdqs1009 only) |
[production] |
| 18:05 |
<volans> |
restarting icinga, re-occurrence of T196336 |
[production] |
| 17:44 |
<chasemp> |
install iotop on stat1004 |
[production] |
| 17:08 |
<XenoRyet> |
updated payments-wiki from 360bea8331 to 268539c2bd |
[production] |
| 16:59 |
<ppchelko@deploy1001> |
Finished deploy [cpjobqueue/deploy@4989231]: Create metrics to track the actual concurrent job executions T202107 (duration: 00m 55s) |
[production] |
| 16:58 |
<ppchelko@deploy1001> |
Started deploy [cpjobqueue/deploy@4989231]: Create metrics to track the actual concurrent job executions T202107 |
[production] |
| 14:14 |
<moritzm> |
rolling upgrade of scb in codfw to latest nodejs security update |
[production] |
| 13:46 |
<moritzm> |
installing jetty9 security updates |
[production] |
| 13:00 |
<marostegui> |
Increase max_connections from 500 to 800 on db1073 to triage issues - T188589 |
[production] |
| 12:51 |
<jynus> |
reload dbproxy1005 |
[production] |
| 12:29 |
<moritzm> |
upgrading scb2006 to latest nodejs along with rolling restarts of node-based services |
[production] |
| 12:02 |
<zeljkof> |
EU SWAT finished |
[production] |
| 12:01 |
<arturo> |
T202261 extend icinga downtime 1D for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet neutron not properly syncing with agents |
[production] |
| 11:56 |
<zfilipin@deploy1001> |
Synchronized static/images/project-logos/: SWAT: [[gerrit:453383|Adding Chinese Wikiversitys logos (T202127)]] (duration: 00m 50s) |
[production] |
| 11:50 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:453693|Use HD logos for lfnwiki (T202228)]] (duration: 00m 50s) |
[production] |
| 11:41 |
<zfilipin@deploy1001> |
Synchronized static/images/project-logos/: SWAT: [[gerrit:453692|Upload HD logos for lfnwiki (T202228)]] (duration: 00m 50s) |
[production] |
| 11:36 |
<zfilipin@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:451823|Enable Rollbacker User Group at ru.wikiquote (T200201)]] (duration: 00m 53s) |
[production] |
| 11:25 |
<arturo> |
T202261 icinga downtime 1h for cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet previous to patch merge |
[production] |
| 11:07 |
<tgr@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:450450|Allow all bureaucrats to remove interface-admin]] (duration: 00m 54s) |
[production] |
| 11:01 |
<arturo> |
T202261 disabled puppet in cloudcontrol1003.wikimedia.org, cloudcontrol1004.wikimedia.org, clounet1003.eqiad.wmnet, cloudnet1004.eqiad.wmnet |
[production] |
| 10:31 |
<moritzm> |
rebooting mw1261 for kernel update/some tests |
[production] |
| 10:23 |
<moritzm> |
rebooting mw2234 for some kernel tests |
[production] |