|
2020-07-16
ยง
|
| 13:35 |
<akosiaris@cumin1001> |
conftool action : set/weight=8; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 13:30 |
<XioNoX> |
deactivate BGP groups IX/Transit/PyBal on cr3-eqsin - T257154 |
[production] |
| 13:27 |
<moritzm> |
installing an-tool1008 |
[production] |
| 13:23 |
<XioNoX> |
depool eqsin for cr3 replacement - T257154 |
[production] |
| 13:13 |
<volans@deploy1001> |
Finished deploy [homer/deploy@fcf4332]: Force deploy of the homer plugin (duration: 01m 27s) |
[production] |
| 13:12 |
<volans@deploy1001> |
Started deploy [homer/deploy@fcf4332]: Force deploy of the homer plugin |
[production] |
| 13:04 |
<kormat> |
restarting tendril to pick up new mariadb config T257816 |
[production] |
| 13:02 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.41 |
[production] |
| 13:02 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 10% T218733 |
[production] |
| 13:01 |
<akosiaris@cumin1001> |
conftool action : set/weight=24; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 12:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1092', diff saved to https://phabricator.wikimedia.org/P11926 and previous config saved to /var/cache/conftool/dbconfig/20200716-125643-marostegui.json |
[production] |
| 12:56 |
<ayounsi@deploy1001> |
Finished deploy [homer/deploy@fcf4332]: CR607011 (duration: 04m 32s) |
[production] |
| 12:52 |
<ayounsi@deploy1001> |
Started deploy [homer/deploy@fcf4332]: CR607011 |
[production] |
| 12:42 |
<ayounsi@deploy1001> |
Finished deploy [homer/deploy@fcf4332]: CR607011 (duration: 03m 42s) |
[production] |
| 12:38 |
<ayounsi@deploy1001> |
Started deploy [homer/deploy@fcf4332]: CR607011 |
[production] |
| 12:38 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 12:36 |
<akosiaris@cumin1001> |
conftool action : set/weight=50; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 12:35 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 5% T218733 |
[production] |
| 12:35 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 5% |
[production] |
| 12:34 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 12:22 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 12:12 |
<jmm@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 12:12 |
<jmm@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 12:12 |
<jmm@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 12:12 |
<jmm@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 12:12 |
<jmm@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 12:08 |
<jayme> |
updated envoyproxy to 1.14.4-1 on mw-canary and restbase-canary |
[production] |
| 11:44 |
<XioNoX> |
remove BGP to AS396253 in eqdfw (peer left the IX) |
[production] |
| 11:26 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.41/extensions/UrlShortener/includes/UrlShortenerUtils.php: T258134 Fix config variables regex concatenation (duration: 01m 05s) |
[production] |
| 11:23 |
<addshore@deploy1001> |
Synchronized wmf-config/Wikibase.php: T254315 [[gerrit:612670]] Wikibase: remove wmgWikibaseLocalEntitySourceName (duration: 01m 05s) |
[production] |
| 11:18 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T254315 T257266 [[gerrit:609988]] Wikidata client wikis: Define entity sources configuration (take 3) (duration: 01m 08s) |
[production] |
| 10:17 |
<jbond42> |
upgrade to hiera5 |
[production] |
| 10:08 |
<jbond42> |
disable puppet for hiera5 deployment |
[production] |
| 09:37 |
<jayme> |
updated envoyproxy to 1.14.4-1 on mw1325.eqiad.wmnet and restbase1026.eqiad.wmnet |
[production] |
| 09:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:30 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:22 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:21 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:17 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:15 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:15 |
<jmm@cumin2001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) |
[production] |
| 09:15 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:15 |
<moritzm> |
rebooting flowspec1001 |
[production] |
| 08:52 |
<jayme> |
updated envoyproxy to 1.14.4-1 on mwdebug1001.eqiad.wmnet |
[production] |
| 08:41 |
<moritzm> |
installing sqlite3 security updates |
[production] |
| 08:39 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db2081', diff saved to https://phabricator.wikimedia.org/P11924 and previous config saved to /var/cache/conftool/dbconfig/20200716-083954-marostegui.json |
[production] |
| 08:35 |
<XioNoX> |
Remove PIM/IGMP related CR stanza (acls) - T257573 |
[production] |
| 08:33 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:33 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 08:33 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |