3501-3550 of 10000 results (91ms)
2023-06-15 ยง
13:54 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
13:54 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
13:54 <jgiannelos@deploy1002> helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply [production]
13:54 <lucaswerkmeister-wmde@deploy1002> reedy and lucaswerkmeister-wmde: Backport for [[gerrit:924567|Revert "Temporarily disable UCoC link from non tech wikis" (T280886)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
13:54 <jgiannelos@deploy1002> helmfile [codfw] START helmfile.d/services/wikifeeds: apply [production]
13:53 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
13:53 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
13:53 <lucaswerkmeister-wmde@deploy1002> Started scap: Backport for [[gerrit:924567|Revert "Temporarily disable UCoC link from non tech wikis" (T280886)]] [production]
13:51 <moritzm> installing ruby2.5 security updates [production]
13:49 <fabfur> reboot cp5024 and cp5032 for kernel upgrade (T335835) [production]
13:49 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5024.eqsin.wmnet [production]
13:49 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5032.eqsin.wmnet [production]
13:48 <samtar@deploy1002> Finished scap: Backport for [[gerrit:930531|Section images: Fix scrolling to placeholder (T335209)]], [[gerrit:930535|Section images: update rtl asset with flipped question mark (T335207)]] (duration: 09m 40s) [production]
13:40 <samtar@deploy1002> kharlan and samtar: Backport for [[gerrit:930531|Section images: Fix scrolling to placeholder (T335209)]], [[gerrit:930535|Section images: update rtl asset with flipped question mark (T335207)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
13:39 <samtar@deploy1002> Started scap: Backport for [[gerrit:930531|Section images: Fix scrolling to placeholder (T335209)]], [[gerrit:930535|Section images: update rtl asset with flipped question mark (T335207)]] [production]
13:28 <elukey@cumin1001> END (PASS) - Cookbook sre.ores.roll-restart-workers (exit_code=0) for ORES codfw cluster: Roll restart of ORES's daemons. [production]
13:24 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5031.eqsin.wmnet [production]
13:24 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5023.eqsin.wmnet [production]
13:21 <daniel@deploy1002> Finished scap: Backport for [[gerrit:929364|Switch VisualEditor to bypass RESTbase on all wikis. (T320529)]] (duration: 11m 48s) [production]
13:14 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hadoop.roll-restart-masters (exit_code=0) restart masters for Hadoop analytics cluster: Restart of jvm daemons. [production]
13:13 <fabfur> reboot cp5023 and cp5031 for kernel upgrade (T335835) [production]
13:13 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5031.eqsin.wmnet [production]
13:13 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5023.eqsin.wmnet [production]
13:10 <daniel@deploy1002> daniel: Backport for [[gerrit:929364|Switch VisualEditor to bypass RESTbase on all wikis. (T320529)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
13:09 <daniel@deploy1002> Started scap: Backport for [[gerrit:929364|Switch VisualEditor to bypass RESTbase on all wikis. (T320529)]] [production]
13:08 <jgiannelos@deploy1002> helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply [production]
13:08 <elukey@cumin1001> START - Cookbook sre.ores.roll-restart-workers for ORES codfw cluster: Roll restart of ORES's daemons. [production]
13:07 <jgiannelos@deploy1002> helmfile [codfw] START helmfile.d/services/wikifeeds: apply [production]
13:05 <elukey@cumin1001> END (PASS) - Cookbook sre.ores.roll-restart-workers (exit_code=0) for ORES eqiad cluster: Roll restart of ORES's daemons. [production]
12:59 <jgiannelos@deploy1002> helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply [production]
12:58 <jgiannelos@deploy1002> helmfile [eqiad] START helmfile.d/services/wikifeeds: apply [production]
12:57 <jgiannelos@deploy1002> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
12:57 <jgiannelos@deploy1002> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
12:53 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5022.eqsin.wmnet [production]
12:51 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5030.eqsin.wmnet [production]
12:48 <stevemunene@cumin1001> START - Cookbook sre.hadoop.roll-restart-masters restart masters for Hadoop analytics cluster: Restart of jvm daemons. [production]
12:45 <elukey@cumin1001> START - Cookbook sre.ores.roll-restart-workers for ORES eqiad cluster: Roll restart of ORES's daemons. [production]
12:40 <fabfur> reboot cp5022 and cp5030 for kernel upgrade (T335835) [production]
12:40 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5022.eqsin.wmnet [production]
12:40 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5030.eqsin.wmnet [production]
12:35 <moritzm> installing ffmpeg security updates [production]
12:34 <joal@deploy1002> Finished deploy [airflow-dags/analytics@d458338]: (no justification provided) (duration: 00m 09s) [production]
12:34 <joal@deploy1002> Started deploy [airflow-dags/analytics@d458338]: (no justification provided) [production]
12:27 <moritzm> installing containerd security updates [production]
12:18 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5029.eqsin.wmnet [production]
12:17 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5021.eqsin.wmnet [production]
12:14 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudservices2004-dev.codfw.wmnet with reason: host reimage [production]
12:11 <aborrero@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudservices2004-dev.codfw.wmnet with reason: host reimage [production]
12:07 <fabfur> reboot cp5021 and cp5029 for kernel upgrade (T335835) [production]
12:06 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host cp5021.eqsin.wmnet [production]