|
2022-10-12
ยง
|
| 13:21 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:829563|Move wmgSiteLogoWordmark and wmgSiteLogoTagline to logos.php (T307705)]] (duration: 07m 06s) |
[production] |
| 13:18 |
<jmm@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:14 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.decommission for hosts d-i-test.eqiad.wmnet |
[production] |
| 13:14 |
<urbanecm@deploy1002> |
urbanecm and stang: Backport for [[gerrit:829563|Move wmgSiteLogoWordmark and wmgSiteLogoTagline to logos.php (T307705)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet |
[production] |
| 13:14 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:829563|Move wmgSiteLogoWordmark and wmgSiteLogoTagline to logos.php (T307705)]] |
[production] |
| 13:13 |
<urbanecm@deploy1002> |
Finished scap: Backport for [[gerrit:841854|Enable show nearby feature on a small group of wikis (T316782)]] (duration: 07m 03s) |
[production] |
| 13:12 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2157', diff saved to https://phabricator.wikimedia.org/P35430 and previous config saved to /var/cache/conftool/dbconfig/20221012-131232-ladsgroup.json |
[production] |
| 13:09 |
<moritzm> |
draining ganeti1007 T320419 |
[production] |
| 13:06 |
<urbanecm@deploy1002> |
urbanecm and wmde-fisch: Backport for [[gerrit:841854|Enable show nearby feature on a small group of wikis (T316782)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet |
[production] |
| 13:06 |
<urbanecm@deploy1002> |
Started scap: Backport for [[gerrit:841854|Enable show nearby feature on a small group of wikis (T316782)]] |
[production] |
| 13:05 |
<urbanecm@deploy1002> |
backport aborted: (duration: 00m 09s) |
[production] |
| 13:04 |
<urbanecm@deploy1002> |
Backport cancelled. |
[production] |
| 12:57 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2157 (T318955)', diff saved to https://phabricator.wikimedia.org/P35429 and previous config saved to /var/cache/conftool/dbconfig/20221012-125725-ladsgroup.json |
[production] |
| 12:32 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2157 (T318955)', diff saved to https://phabricator.wikimedia.org/P35428 and previous config saved to /var/cache/conftool/dbconfig/20221012-123223-ladsgroup.json |
[production] |
| 12:32 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2157.codfw.wmnet with reason: Maintenance |
[production] |
| 12:32 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db2157.codfw.wmnet with reason: Maintenance |
[production] |
| 12:32 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2137:3315 (T318955)', diff saved to https://phabricator.wikimedia.org/P35427 and previous config saved to /var/cache/conftool/dbconfig/20221012-123201-ladsgroup.json |
[production] |
| 12:28 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1002.eqiad.wmnet with reason: host reimage |
[production] |
| 12:25 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1002.eqiad.wmnet with reason: host reimage |
[production] |
| 12:16 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2137:3315', diff saved to https://phabricator.wikimedia.org/P35426 and previous config saved to /var/cache/conftool/dbconfig/20221012-121655-ladsgroup.json |
[production] |
| 12:12 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reimage for host sretest1002.eqiad.wmnet with OS buster |
[production] |
| 12:01 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2137:3315', diff saved to https://phabricator.wikimedia.org/P35425 and previous config saved to /var/cache/conftool/dbconfig/20221012-120148-ladsgroup.json |
[production] |
| 11:51 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on ganeti1005.eqiad.wmnet with reason: Remove from cluster for eventual decom |
[production] |
| 11:51 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.downtime for 2 days, 0:00:00 on ganeti1005.eqiad.wmnet with reason: Remove from cluster for eventual decom |
[production] |
| 11:51 |
<cgoubert@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=eventstreams,name=eqiad |
[production] |
| 11:50 |
<claime> |
repooling eventstreams in eqiad - T310721 |
[production] |
| 11:46 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2137:3315 (T318955)', diff saved to https://phabricator.wikimedia.org/P35424 and previous config saved to /var/cache/conftool/dbconfig/20221012-114642-ladsgroup.json |
[production] |
| 11:46 |
<oblivian@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/eventstreams: apply |
[production] |
| 11:45 |
<oblivian@deploy1002> |
helmfile [eqiad] START helmfile.d/services/eventstreams: apply |
[production] |
| 11:44 |
<claime> |
redeploying eventstreams eqiad - T310721 |
[production] |
| 11:24 |
<cgoubert@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=eventstreams,name=eqiad |
[production] |
| 11:24 |
<claime> |
depooling eventstreams in eqiad - T310721 |
[production] |
| 11:21 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Depooling db2137:3315 (T318955)', diff saved to https://phabricator.wikimedia.org/P35423 and previous config saved to /var/cache/conftool/dbconfig/20221012-112146-ladsgroup.json |
[production] |
| 11:21 |
<ladsgroup@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2137.codfw.wmnet with reason: Maintenance |
[production] |
| 11:21 |
<ladsgroup@cumin1001> |
START - Cookbook sre.hosts.downtime for 8:00:00 on db2137.codfw.wmnet with reason: Maintenance |
[production] |
| 11:21 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2128 (T318955)', diff saved to https://phabricator.wikimedia.org/P35422 and previous config saved to /var/cache/conftool/dbconfig/20221012-112124-ladsgroup.json |
[production] |
| 11:11 |
<moritzm> |
installing bind9 security updates on buster (client side tools/libs) |
[production] |
| 11:07 |
<jgiannelos@deploy1002> |
Finished deploy [restbase/deploy@0474832]: Update restbase to 1a02cdfb (duration: 25m 48s) |
[production] |
| 11:06 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2128', diff saved to https://phabricator.wikimedia.org/P35421 and previous config saved to /var/cache/conftool/dbconfig/20221012-110617-ladsgroup.json |
[production] |
| 11:02 |
<claime> |
repooled eventstreams in codfw - T310721 |
[production] |
| 11:01 |
<cgoubert@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=eventstreams,name=codfw |
[production] |
| 10:58 |
<oblivian@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/eventstreams: apply |
[production] |
| 10:58 |
<oblivian@deploy1002> |
helmfile [codfw] START helmfile.d/services/eventstreams: apply |
[production] |
| 10:57 |
<claime> |
redeploying eventstreams codfw - T310721 |
[production] |
| 10:55 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1001.eqiad.wmnet with OS bullseye |
[production] |
| 10:51 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2128', diff saved to https://phabricator.wikimedia.org/P35420 and previous config saved to /var/cache/conftool/dbconfig/20221012-105111-ladsgroup.json |
[production] |
| 10:49 |
<moritzm> |
installing dbus security updates |
[production] |
| 10:41 |
<jgiannelos@deploy1002> |
Started deploy [restbase/deploy@0474832]: Update restbase to 1a02cdfb |
[production] |
| 10:39 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1001.eqiad.wmnet with reason: host reimage |
[production] |
| 10:36 |
<ladsgroup@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2128 (T318955)', diff saved to https://phabricator.wikimedia.org/P35419 and previous config saved to /var/cache/conftool/dbconfig/20221012-103604-ladsgroup.json |
[production] |