2022-05-10
§
|
07:48 |
<awight@deploy1002> |
Synchronized wmf-config: Config: [[gerrit:786289|Watch for mapdata cache misses in production (T304813 T300712)]] (duration: 00m 50s) |
[production] |
07:46 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti6001.drmrs.wmnet |
[production] |
07:39 |
<mvernon@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2040.codfw.wmnet |
[production] |
07:23 |
<mvernon@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host ms-be2040.codfw.wmnet |
[production] |
07:17 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Naray-ctr out of all services on: 1223 hosts |
[production] |
07:16 |
<jmm@cumin2002> |
START - Cookbook sre.idm.logout Logging Naray-ctr out of all services on: 1223 hosts |
[production] |
07:16 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Naray-ctr out of all services on: 531 hosts |
[production] |
07:15 |
<jmm@cumin2002> |
START - Cookbook sre.idm.logout Logging Naray-ctr out of all services on: 531 hosts |
[production] |
06:56 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
06:56 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
06:56 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
06:56 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
06:51 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM bast3005.wikimedia.org |
[production] |
06:47 |
<jmm@cumin2002> |
START - Cookbook sre.ganeti.reboot-vm for VM bast3005.wikimedia.org |
[production] |
05:18 |
<marostegui> |
Rename revision_actor_temp on db2109 T307906 |
[production] |
05:18 |
<marostegui> |
dbmaint s3@codfw T307906 |
[production] |
05:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27775 and previous config saved to /var/cache/conftool/dbconfig/20220510-051429-marostegui.json |
[production] |
04:33 |
<eileen> |
revision changed from 852c1969 to 6d85f1cc |
[production] |
02:31 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
02:31 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
02:30 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
02:30 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
02:05 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
02:04 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
02:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
02:03 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
2022-05-09
§
|
21:58 |
<jhathaway@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx2001.wikimedia.org with reason: new kernel round deux |
[production] |
21:58 |
<jhathaway@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on mx2001.wikimedia.org with reason: new kernel round deux |
[production] |
21:56 |
<jhathaway@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx1001.wikimedia.org with reason: new kernel, round deux |
[production] |
21:56 |
<jhathaway@cumin1001> |
START - Cookbook sre.hosts.downtime for 1:00:00 on mx1001.wikimedia.org with reason: new kernel, round deux |
[production] |
21:21 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
21:20 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
21:20 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
21:19 |
<cjming> |
end of UTC late backport & config window |
[production] |
21:19 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
21:18 |
<cjming@deploy1002> |
Synchronized php-1.39.0-wmf.10/extensions/GrowthExperiments: Backport: [[gerrit:790406|Newcomer tasks: deploy AND topic selection to pilot wikis (T305399)]] (duration: 00m 54s) |
[production] |
21:14 |
<cjming@deploy1002> |
Synchronized php-1.39.0-wmf.10/extensions/GrowthExperiments/includes/NewcomerTasks/CampaignConfig.php: Backport: [[gerrit:790336|CampaignConfig: Avoid array_push() error]] (duration: 00m 51s) |
[production] |
21:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
21:13 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
21:13 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
21:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
21:02 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
21:02 |
<cjming@deploy1002> |
Synchronized php-1.39.0-wmf.10/skins/Vector/resources: Backport: [[gerrit:790426|Adjust table of contents margins at 1000-1200 breakpoint (T307004)]] (duration: 00m 53s) |
[production] |
21:02 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
21:02 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
21:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
20:36 |
<cjming@deploy1002> |
Synchronized wmf-config/ProductionServices.php: Config: [[gerrit:790408|cirrus: Enable DeprecationLoggedHttps (T218994)]] (duration: 00m 51s) |
[production] |
20:32 |
<cjming@deploy1002> |
Synchronized php-1.39.0-wmf.10/extensions/Kartographer/modules/box: Backport: [[gerrit:790329|Refresh MediaWiki globals when loading mapdata (T307650)]] (duration: 00m 52s) |
[production] |
20:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
20:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |