8951-9000 of 10000 results (105ms)
2024-03-12 ยง
14:14 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
14:12 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db2146 (re)pooling @ 25%: Maint over', diff saved to https://phabricator.wikimedia.org/P58772 and previous config saved to /var/cache/conftool/dbconfig/20240312-141255-ladsgroup.json [production]
14:00 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1246.eqiad.wmnet with reason: db1246 depooled [production]
14:00 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1246.eqiad.wmnet with reason: db1246 depooled [production]
13:58 <Lucas_WMDE> UTC afternoon backport+config window done [production]
13:57 <ladsgroup@cumin1002> dbctl commit (dc=all): 'db2146 (re)pooling @ 10%: Maint over', diff saved to https://phabricator.wikimedia.org/P58770 and previous config saved to /var/cache/conftool/dbconfig/20240312-135750-ladsgroup.json [production]
13:57 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Finished scap: Backport for [[gerrit:1002639|Enable native math rendering options by default (T358803)]] (duration: 15m 05s) [production]
13:57 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Down', diff saved to https://phabricator.wikimedia.org/P58769 and previous config saved to /var/cache/conftool/dbconfig/20240312-135715-ladsgroup.json [production]
13:55 <arnaudb@cumin1002> dbctl commit (dc=all): 'Depooling db1246', diff saved to https://phabricator.wikimedia.org/P58768 and previous config saved to /var/cache/conftool/dbconfig/20240312-135537-arnaudb.json [production]
13:52 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:52 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:47 <logmsgbot> lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and physikerwelt: Continuing with sync [production]
13:45 <logmsgbot> lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and physikerwelt: Backport for [[gerrit:1002639|Enable native math rendering options by default (T358803)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:42 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Started scap: Backport for [[gerrit:1002639|Enable native math rendering options by default (T358803)]] [production]
13:39 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:39 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:38 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Finished scap: Backport for [[gerrit:1009729|Add `suppressredirect` right to pagemover and filemover user groups in azwiki (T359614)]] (duration: 14m 13s) [production]
13:35 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:35 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:30 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:30 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:27 <logmsgbot> lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and mdsshakil: Continuing with sync [production]
13:26 <logmsgbot> lucaswerkmeister-wmde@deploy2002 lucaswerkmeister-wmde and mdsshakil: Backport for [[gerrit:1009729|Add `suppressredirect` right to pagemover and filemover user groups in azwiki (T359614)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:24 <logmsgbot> lucaswerkmeister-wmde@deploy2002 Started scap: Backport for [[gerrit:1009729|Add `suppressredirect` right to pagemover and filemover user groups in azwiki (T359614)]] [production]
13:23 <isaranto@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'readability' for release 'main' . [production]
13:09 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:09 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:36 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:36 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:30 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:30 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:26 <eoghan@cumin1002> START - Cookbook sre.gitlab.failover Failover of gitlab from gitlab1004.wikimedia.org to gitlab1003.wikimedia.org [production]
12:19 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:19 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:07 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:07 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
12:03 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
12:02 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
11:59 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:58 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
11:54 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:54 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
11:16 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
11:16 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
10:41 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2211 (re)pooling @ 100%: Post clone', diff saved to https://phabricator.wikimedia.org/P58765 and previous config saved to /var/cache/conftool/dbconfig/20240312-104056-arnaudb.json [production]
10:40 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2210 (re)pooling @ 100%: Post clone', diff saved to https://phabricator.wikimedia.org/P58764 and previous config saved to /var/cache/conftool/dbconfig/20240312-104056-arnaudb.json [production]
10:40 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2209 (re)pooling @ 100%: Post clone', diff saved to https://phabricator.wikimedia.org/P58763 and previous config saved to /var/cache/conftool/dbconfig/20240312-104055-arnaudb.json [production]
10:25 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2211 (re)pooling @ 75%: Post clone', diff saved to https://phabricator.wikimedia.org/P58762 and previous config saved to /var/cache/conftool/dbconfig/20240312-102551-arnaudb.json [production]
10:25 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2210 (re)pooling @ 75%: Post clone', diff saved to https://phabricator.wikimedia.org/P58761 and previous config saved to /var/cache/conftool/dbconfig/20240312-102551-arnaudb.json [production]
10:25 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2209 (re)pooling @ 75%: Post clone', diff saved to https://phabricator.wikimedia.org/P58760 and previous config saved to /var/cache/conftool/dbconfig/20240312-102550-arnaudb.json [production]