|
2020-07-16
ยง
|
| 14:43 |
<jayme@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'mathoid' for release 'production' . |
[production] |
| 14:31 |
<jayme@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'mathoid' for release 'staging' . |
[production] |
| 14:15 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 14:12 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:12 |
<moritzm> |
rebooting webperf hosts in eqiad for kernel update |
[production] |
| 14:09 |
<XioNoX> |
upgrade junos on cr3-eqsin - T257154 |
[production] |
| 14:03 |
<jayme> |
published image docker-registry.discovery.wmnet/envoy:1.14.4-1 |
[production] |
| 13:47 |
<XioNoX> |
remove nonstop-bridging from asw1-eqsin |
[production] |
| 13:36 |
<XioNoX> |
power-off cr3-eqsin - T257154 |
[production] |
| 13:36 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 25% T218733 |
[production] |
| 13:35 |
<akosiaris@cumin1001> |
conftool action : set/weight=8; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 13:30 |
<XioNoX> |
deactivate BGP groups IX/Transit/PyBal on cr3-eqsin - T257154 |
[production] |
| 13:27 |
<moritzm> |
installing an-tool1008 |
[production] |
| 13:23 |
<XioNoX> |
depool eqsin for cr3 replacement - T257154 |
[production] |
| 13:13 |
<volans@deploy1001> |
Finished deploy [homer/deploy@fcf4332]: Force deploy of the homer plugin (duration: 01m 27s) |
[production] |
| 13:12 |
<volans@deploy1001> |
Started deploy [homer/deploy@fcf4332]: Force deploy of the homer plugin |
[production] |
| 13:04 |
<kormat> |
restarting tendril to pick up new mariadb config T257816 |
[production] |
| 13:02 |
<jforrester@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.41 |
[production] |
| 13:02 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 10% T218733 |
[production] |
| 13:01 |
<akosiaris@cumin1001> |
conftool action : set/weight=24; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 12:56 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1092', diff saved to https://phabricator.wikimedia.org/P11926 and previous config saved to /var/cache/conftool/dbconfig/20200716-125643-marostegui.json |
[production] |
| 12:56 |
<ayounsi@deploy1001> |
Finished deploy [homer/deploy@fcf4332]: CR607011 (duration: 04m 32s) |
[production] |
| 12:52 |
<ayounsi@deploy1001> |
Started deploy [homer/deploy@fcf4332]: CR607011 |
[production] |
| 12:42 |
<ayounsi@deploy1001> |
Finished deploy [homer/deploy@fcf4332]: CR607011 (duration: 03m 42s) |
[production] |
| 12:38 |
<ayounsi@deploy1001> |
Started deploy [homer/deploy@fcf4332]: CR607011 |
[production] |
| 12:38 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 12:36 |
<akosiaris@cumin1001> |
conftool action : set/weight=50; selector: dc=codfw,service=mobileapps,name=scb.* |
[production] |
| 12:35 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 5% T218733 |
[production] |
| 12:35 |
<akosiaris> |
increase codfw mobileapps kubernetes traffic to 5% |
[production] |
| 12:34 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 12:22 |
<jmm@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 12:12 |
<jmm@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 12:12 |
<jmm@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 12:12 |
<jmm@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 12:12 |
<jmm@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 12:12 |
<jmm@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 12:08 |
<jayme> |
updated envoyproxy to 1.14.4-1 on mw-canary and restbase-canary |
[production] |
| 11:44 |
<XioNoX> |
remove BGP to AS396253 in eqdfw (peer left the IX) |
[production] |
| 11:26 |
<jforrester@deploy1001> |
Synchronized php-1.35.0-wmf.41/extensions/UrlShortener/includes/UrlShortenerUtils.php: T258134 Fix config variables regex concatenation (duration: 01m 05s) |
[production] |
| 11:23 |
<addshore@deploy1001> |
Synchronized wmf-config/Wikibase.php: T254315 [[gerrit:612670]] Wikibase: remove wmgWikibaseLocalEntitySourceName (duration: 01m 05s) |
[production] |
| 11:18 |
<addshore@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T254315 T257266 [[gerrit:609988]] Wikidata client wikis: Define entity sources configuration (take 3) (duration: 01m 08s) |
[production] |
| 10:17 |
<jbond42> |
upgrade to hiera5 |
[production] |
| 10:08 |
<jbond42> |
disable puppet for hiera5 deployment |
[production] |
| 09:37 |
<jayme> |
updated envoyproxy to 1.14.4-1 on mw1325.eqiad.wmnet and restbase1026.eqiad.wmnet |
[production] |
| 09:32 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:30 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:22 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:21 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:17 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:15 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |