|
2024-04-24
§
|
| 08:51 |
<jmm@cumin2002> |
START - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas rolling restart_daemons on A:schema-eqiad |
[production] |
| 08:47 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas (exit_code=0) rolling restart_daemons on A:schema-codfw |
[production] |
| 08:46 |
<jmm@cumin2002> |
START - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas rolling restart_daemons on A:schema-codfw |
[production] |
| 08:39 |
<arnaudb@cumin1002> |
START - Cookbook sre.hosts.reimage for host db1248.eqiad.wmnet with OS bookworm |
[production] |
| 08:37 |
<arnaudb@cumin1002> |
dbctl commit (dc=all): 'Depool db1248', diff saved to https://phabricator.wikimedia.org/P61130 and previous config saved to /var/cache/conftool/dbconfig/20240424-083736-arnaudb.json |
[production] |
| 08:36 |
<arnaudb@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1248.eqiad.wmnet with reason: T362746 |
[production] |
| 08:36 |
<arnaudb@cumin1002> |
START - Cookbook sre.hosts.downtime for 2:00:00 on db1248.eqiad.wmnet with reason: T362746 |
[production] |
| 08:08 |
<filippo@deploy1002> |
helmfile [aux-k8s-eqiad] DONE helmfile.d/aus-k8s-eqiad-services/jaeger: apply |
[production] |
| 08:08 |
<filippo@deploy1002> |
helmfile [aux-k8s-eqiad] START helmfile.d/aus-k8s-eqiad-services/jaeger: apply |
[production] |
| 06:17 |
<moritzm> |
installing glibc security updates |
[production] |
| 04:52 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db2152 (T352010)', diff saved to https://phabricator.wikimedia.org/P61129 and previous config saved to /var/cache/conftool/dbconfig/20240424-045230-ladsgroup.json |
[production] |
| 04:52 |
<ladsgroup@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2152.codfw.wmnet with reason: Maintenance |
[production] |
| 04:52 |
<ladsgroup@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2152.codfw.wmnet with reason: Maintenance |
[production] |
| 00:14 |
<zabe@deploy1002> |
Finished scap: Backport for [[gerrit:1023550|Set timezones for new wikis (T360310 T360303 T363263 T363256 T363250 T363243 T363270)]], [[gerrit:1023528|Update interwiki cache]] (duration: 13m 56s) |
[production] |
| 00:04 |
<zabe@deploy1002> |
zabe: Continuing with sync |
[production] |
| 00:03 |
<zabe@deploy1002> |
zabe: Backport for [[gerrit:1023550|Set timezones for new wikis (T360310 T360303 T363263 T363256 T363250 T363243 T363270)]], [[gerrit:1023528|Update interwiki cache]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 00:01 |
<zabe@deploy1002> |
Started scap: Backport for [[gerrit:1023550|Set timezones for new wikis (T360310 T360303 T363263 T363256 T363250 T363243 T363270)]], [[gerrit:1023528|Update interwiki cache]] |
[production] |
|
2024-04-23
§
|
| 23:58 |
<eileen> |
config revision changed from 75af3eb6 to dc53becd |
[production] |
| 23:57 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=kawikisource --cluster=all 2>&1 | tee /tmp/kawikisource.UpdateSearchIndexConfig.log # T363085 |
[production] |
| 23:56 |
<zabe@deploy1002> |
Finished scap: Creating kawikisource (T363085) (duration: 14m 40s) |
[production] |
| 23:45 |
<zabe@deploy1002> |
zabe: Continuing with sync |
[production] |
| 23:44 |
<zabe@deploy1002> |
zabe: Creating kawikisource (T363085) synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 23:42 |
<zabe@deploy1002> |
Started scap: Creating kawikisource (T363085) |
[production] |
| 23:41 |
<zabe> |
create Wikisource Georgian # T363085 |
[production] |
| 23:39 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=mswikisource --cluster=all 2>&1 | tee /tmp/mswikisource.UpdateSearchIndexConfig.log # T363039 |
[production] |
| 23:38 |
<zabe@deploy1002> |
Finished scap: Creating mswikisource (T363039) (duration: 15m 00s) |
[production] |
| 23:34 |
<eileen> |
config revision changed from 974afe9c to 75af3eb6 |
[production] |
| 23:27 |
<zabe@deploy1002> |
zabe: Continuing with sync |
[production] |
| 23:26 |
<zabe@deploy1002> |
zabe: Creating mswikisource (T363039) synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 23:23 |
<zabe@deploy1002> |
Started scap: Creating mswikisource (T363039) |
[production] |
| 23:23 |
<zabe> |
create Wikisource Malay # T363039 |
[production] |
| 23:22 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=kaawiktionary --cluster=all 2>&1 | tee /tmp/kaawiktionary.UpdateSearchIndexConfig.log # T362135 |
[production] |
| 23:20 |
<zabe@deploy1002> |
Finished scap: Creating kaawiktionary (T362135) (duration: 13m 34s) |
[production] |
| 23:19 |
<ladsgroup@cumin1002> |
dbctl commit (dc=all): 'Depooling db2145 (T352010)', diff saved to https://phabricator.wikimedia.org/P61128 and previous config saved to /var/cache/conftool/dbconfig/20240423-231923-ladsgroup.json |
[production] |
| 23:19 |
<ladsgroup@cumin1002> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
| 23:19 |
<ladsgroup@cumin1002> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2145.codfw.wmnet with reason: Maintenance |
[production] |
| 23:10 |
<zabe@deploy1002> |
zabe: Continuing with sync |
[production] |
| 23:09 |
<zabe@deploy1002> |
zabe: Creating kaawiktionary (T362135) synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 23:07 |
<zabe@deploy1002> |
Started scap: Creating kaawiktionary (T362135) |
[production] |
| 23:06 |
<zabe> |
create Wiktionary Karakalpak # T362135 |
[production] |
| 23:06 |
<eevans@cumin1002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host aqs1013.eqiad.wmnet |
[production] |
| 23:04 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=iglwiki --cluster=all 2>&1 | tee /tmp/iglwiki.UpdateSearchIndexConfig.log # T361644 |
[production] |
| 23:03 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=iglwiki --cluster=all 2>&1 | tee /tmp/iglwiki.UpdateSearchIndexConfig.log # T362135 |
[production] |
| 23:03 |
<zabe@deploy1002> |
Finished scap: Creating iglwiki (T361644) (duration: 13m 32s) |
[production] |
| 23:00 |
<eevans@cumin1002> |
START - Cookbook sre.hosts.reboot-single for host aqs1013.eqiad.wmnet |
[production] |
| 22:52 |
<zabe@deploy1002> |
zabe: Continuing with sync |
[production] |
| 22:52 |
<zabe@deploy1002> |
zabe: Creating iglwiki (T361644) synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) |
[production] |
| 22:49 |
<zabe@deploy1002> |
Started scap: Creating iglwiki (T361644) |
[production] |
| 22:49 |
<zabe> |
create Wikipedia Igala # T361644 |
[production] |
| 22:47 |
<zabe> |
zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=mywikisource --cluster=all 2>&1 | tee /tmp/mywikisource.UpdateSearchIndexConfig.log # T361085 |
[production] |