5701-5750 of 10000 results (70ms)
2022-05-09 §
05:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1172', diff saved to https://phabricator.wikimedia.org/P27761 and previous config saved to /var/cache/conftool/dbconfig/20220509-051426-marostegui.json [production]
05:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
05:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
05:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
05:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:56 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
04:53 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: Revert: [[gerrit:790021|Set arwiki to read new in templatelinks migration (T306673)]] (duration: 05m 03s) [production]
04:52 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
04:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
04:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:47 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 05m 04s) [production]
04:40 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790020|Stop writing to rev_actor_temp table in group1 (T275246)]] (duration: 05m 06s) [production]
04:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
04:37 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
04:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
04:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:31 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790021|Set arwiki to read new in templatelinks migration (T306673)]] (duration: 05m 10s) [production]
2022-05-08 §
07:16 <godog> silence probedown for thumbor:8800 until monday [production]
2022-05-07 §
21:29 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 04m 04s) [production]
21:25 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
21:11 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 05m 51s) [production]
21:05 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
15:53 <taavi@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 (duration: 01m 14s) [production]
15:52 <taavi@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 [production]
15:49 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) (duration: 00m 17s) [production]
15:49 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) [production]
15:49 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) (duration: 00m 05s) [production]
15:48 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): (no justification provided) [production]
15:38 <taavi@deploy1002> Finished deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 (duration: 00m 33s) [production]
15:38 <taavi@deploy1002> Started deploy [horizon/deploy@9d02cd6] (dev): testing scapping to cloudweb2002 [production]
15:29 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 10m 55s) [production]
15:18 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
15:17 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 10m 55s) [production]
15:06 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
04:15 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudvirt1016.eqiad.wmnet [production]
04:13 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
04:07 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
04:03 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts cloudvirt1016.eqiad.wmnet [production]
2022-05-06 §
19:16 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-airflow1002.eqiad.wmnet [production]
19:11 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-airflow1002.eqiad.wmnet [production]
19:02 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-airflow1001.eqiad.wmnet [production]
18:56 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-airflow1001.eqiad.wmnet [production]
18:39 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host stat1008.eqiad.wmnet [production]
18:28 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host stat1008.eqiad.wmnet [production]
18:24 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1010.eqiad.wmnet [production]
18:18 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-tool1010.eqiad.wmnet [production]
18:16 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1009.eqiad.wmnet [production]
18:12 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-tool1009.eqiad.wmnet [production]
18:11 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-tool1008.eqiad.wmnet [production]
18:07 <razzi@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-tool1008.eqiad.wmnet [production]