201-250 of 10000 results (39ms)
2022-05-09 §
07:32 <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27764 and previous config saved to /var/cache/conftool/dbconfig/20220509-073200-marostegui.json [production]
07:31 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:30 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:20 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
07:16 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1172 with minimal weight to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27763 and previous config saved to /var/cache/conftool/dbconfig/20220509-070430-marostegui.json [production]
06:23 <Amir1> start of updateRestrictions.php on s5 (T218446) [production]
05:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1172 with minimal weight to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27762 and previous config saved to /var/cache/conftool/dbconfig/20220509-054823-marostegui.json [production]
05:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1172', diff saved to https://phabricator.wikimedia.org/P27761 and previous config saved to /var/cache/conftool/dbconfig/20220509-051426-marostegui.json [production]
05:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
05:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
05:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
05:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:56 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
04:53 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: Revert: [[gerrit:790021|Set arwiki to read new in templatelinks migration (T306673)]] (duration: 05m 03s) [production]
04:52 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
04:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
04:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:47 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 05m 04s) [production]
04:40 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790020|Stop writing to rev_actor_temp table in group1 (T275246)]] (duration: 05m 06s) [production]
04:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
04:37 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
04:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
04:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:31 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790021|Set arwiki to read new in templatelinks migration (T306673)]] (duration: 05m 10s) [production]
2022-05-08 §
07:16 <godog> silence probedown for thumbor:8800 until monday [production]
2022-05-07 §
21:29 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 04m 04s) [production]
21:25 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
21:11 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 05m 51s) [production]
21:05 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
15:53 <taavi@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 (duration: 01m 14s) [production]
15:52 <taavi@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 [production]
15:49 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) (duration: 00m 17s) [production]
15:49 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) [production]
15:49 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) (duration: 00m 05s) [production]
15:48 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) [production]
15:38 <taavi@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 (duration: 00m 33s) [production]
15:38 <taavi@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 [production]
15:29 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 10m 55s) [production]
15:18 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
15:17 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 10m 55s) [production]
15:06 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
04:15 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1016.eqiad.wmnet [production]
04:13 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
04:07 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
04:03 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts cloudvirt1016.eqiad.wmnet [production]
2022-05-06 §
19:16 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-airflow1002.eqiad.wmnet [production]
19:11 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-airflow1002.eqiad.wmnet [production]