6501-6550 of 10000 results (76ms)
2023-07-25 ยง
20:44 <zabe@deploy1002> Started scap: T335216 [production]
20:42 <zabe> create Wiktionary Mandailing # T335216 [production]
20:33 <taavi@deploy1002> Finished scap: Backport for [[gerrit:941423|Fix text showing on icon only buttons]] (duration: 12m 08s) [production]
20:23 <taavi@deploy1002> taavi and bwang: Backport for [[gerrit:941423|Fix text showing on icon only buttons]] synced to the testservers mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
20:21 <taavi@deploy1002> Started scap: Backport for [[gerrit:941423|Fix text showing on icon only buttons]] [production]
18:24 <dwisehaupt@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:24 <dwisehaupt@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: * - dwisehaupt@cumin1001" [production]
18:23 <dwisehaupt@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: * - dwisehaupt@cumin1001" [production]
18:21 <dwisehaupt@cumin1001> START - Cookbook sre.dns.netbox [production]
18:21 <sukhe> dummy authdns-update returns [production]
18:11 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns4003.wikimedia.org [production]
18:06 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host dns4003.wikimedia.org [production]
17:56 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns4004.wikimedia.org [production]
17:51 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host dns4004.wikimedia.org [production]
16:56 <sukhe> dummy authdns-update [production]
16:51 <hnowlan@deploy1002> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
16:51 <hnowlan@deploy1002> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
16:49 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns6002.wikimedia.org [production]
16:45 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host dns6002.wikimedia.org [production]
16:41 <fabfur> end rebooting lvs5005 (T335835) [production]
16:41 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs5005.eqsin.wmnet [production]
16:40 <elukey@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-main-eqiad cluster: Roll restart of jvm daemons. [production]
16:37 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host lvs5005.eqsin.wmnet [production]
16:30 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns6001.wikimedia.org [production]
16:26 <sukhe@cumin2002> START - Cookbook sre.hosts.reboot-single for host dns6001.wikimedia.org [production]
16:19 <fabfur> begin rebooting lvs5005 (T335835) [production]
15:57 <dancy@deploy1002> Finished deploy [releng/jenkins-deploy@97b4674] (releasing): (no justification provided) (duration: 33m 26s) [production]
15:36 <fabfur> lvs5004 restarted and services are reactivating (T335835) [production]
15:28 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs5004.eqsin.wmnet [production]
15:26 <isaranto@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
15:25 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host lvs5004.eqsin.wmnet [production]
15:25 <fabfur@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host lvs5004.eqsin.wmnet [production]
15:25 <fabfur@cumin1001> START - Cookbook sre.hosts.reboot-single for host lvs5004.eqsin.wmnet [production]
15:25 <isaranto@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
15:24 <isaranto@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
15:23 <dancy@deploy1002> Started deploy [releng/jenkins-deploy@97b4674] (releasing): (no justification provided) [production]
15:22 <isaranto@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
15:21 <isaranto@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
15:17 <_joe_> removing all tags for docker image openjdk-8-jre T341115 [production]
15:16 <zabe@deploy1002> Finished scap: Backport for [[gerrit:941417|Add namespace translations for Mandailing (btm) (T335217)]], [[gerrit:941416|Add namespace translations for Mandailing (btm) (T335217)]] (duration: 07m 51s) [production]
15:14 <_joe_> removing all tags for docker image openjdk-8-jdk T341115 [production]
15:10 <zabe@deploy1002> zabe: Backport for [[gerrit:941417|Add namespace translations for Mandailing (btm) (T335217)]], [[gerrit:941416|Add namespace translations for Mandailing (btm) (T335217)]] synced to the testservers mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, and mw-debug kubernetes deployment (accessible via k8s-experimental XWD option) [production]
15:09 <isaranto@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
15:08 <zabe@deploy1002> Started scap: Backport for [[gerrit:941417|Add namespace translations for Mandailing (btm) (T335217)]], [[gerrit:941416|Add namespace translations for Mandailing (btm) (T335217)]] [production]
14:59 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
14:59 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
14:59 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
14:58 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . [production]
14:58 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-main-eqiad cluster: Roll restart of jvm daemons. [production]
14:58 <isaranto@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]