7651-7700 of 10000 results (93ms)
2023-07-05 ยง
22:23 <mutante> registry1003 - sudo systemctl start build-hompage [production]
22:17 <denisse@cumin1001> START - Cookbook sre.hosts.decommission for hosts xhgui1002 [production]
21:23 <bking@cumin1001> START - Cookbook sre.wdqs.data-transfer [production]
21:04 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:935809|Optimize SVG wordmarks, enable Wikimania wordmark, fix techconduct (T338162)]] (duration: 08m 22s) [production]
20:57 <urbanecm@deploy1002> jdlrobson and urbanecm: Backport for [[gerrit:935809|Optimize SVG wordmarks, enable Wikimania wordmark, fix techconduct (T338162)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet [production]
20:55 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:935809|Optimize SVG wordmarks, enable Wikimania wordmark, fix techconduct (T338162)]] [production]
20:55 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:933691|Update various logos where SVGs are available (T338162)]] (duration: 11m 10s) [production]
20:45 <urbanecm@deploy1002> jdlrobson and urbanecm: Backport for [[gerrit:933691|Update various logos where SVGs are available (T338162)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:43 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:933691|Update various logos where SVGs are available (T338162)]] [production]
20:31 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:935791|Add language button at the top of the Main page of Italian Wikivoyage (T337666)]] (duration: 12m 38s) [production]
20:20 <urbanecm@deploy1002> jdlrobson and urbanecm: Backport for [[gerrit:935791|Add language button at the top of the Main page of Italian Wikivoyage (T337666)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
20:19 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:935791|Add language button at the top of the Main page of Italian Wikivoyage (T337666)]] [production]
20:17 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:935790|Disable the Nearby feature on some sister projects (T341133)]] (duration: 13m 12s) [production]
20:05 <urbanecm@deploy1002> urbanecm and jdlrobson: Backport for [[gerrit:935790|Disable the Nearby feature on some sister projects (T341133)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet [production]
20:04 <urbanecm@deploy1002> Started scap: Backport for [[gerrit:935790|Disable the Nearby feature on some sister projects (T341133)]] [production]
18:36 <sukhe> re-enable puppet in A:dns-rec to finish merging CR 933497 and run-agent: T340479 [production]
18:25 <denisse> disable puppet on webperf1003 to test PHP memory changes for XHGui [production]
18:25 <denisse> disable puppet on webperf1003 [production]
18:20 <sukhe> disable puppet on A:dns-rec to merge CR 933497 [production]
17:40 <jelto@cumin1001> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: GitLab minor version upgrade [production]
17:07 <kharlan@deploy1002> helmfile [staging] DONE helmfile.d/services/ipoid: apply [production]
17:07 <kharlan@deploy1002> helmfile [staging] START helmfile.d/services/ipoid: apply [production]
17:03 <kharlan@deploy1002> helmfile [staging] DONE helmfile.d/services/ipoid: apply [production]
17:02 <kharlan@deploy1002> helmfile [staging] START helmfile.d/services/ipoid: apply [production]
16:33 <jelto@cumin1001> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: GitLab minor version upgrade [production]
16:25 <pt1979@cumin2002> START - Cookbook sre.hosts.dhcp for host an-test-worker1003.eqiad.wmnet [production]
16:25 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host an-test-worker1003.eqiad.wmnet [production]
16:06 <jelto@cumin1001> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: GitLab minor version upgrade [production]
15:55 <fabfur> re-enabled puppet in all cp- hosts (done @2023-07-05 14:22:57 UTC) [production]
15:38 <mlitn@deploy1002> Finished deploy [airflow-dags/platform_eng@a97da10]: (no justification provided) (duration: 00m 25s) [production]
15:38 <mlitn@deploy1002> Started deploy [airflow-dags/platform_eng@a97da10]: (no justification provided) [production]
15:29 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1025.eqiad.wmnet [production]
15:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1025.eqiad.wmnet [production]
15:26 <sukhe> reprepro -C component/dnsdist include bullseye-wikimedia dnsdist_1.8.0-1+wmf11u1_amd64.changes [production]
15:23 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1025.eqiad.wmnet [production]
15:23 <aikochou@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
15:10 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1025.eqiad.wmnet [production]
15:09 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti1024.eqiad.wmnet [production]
15:09 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1024.eqiad.wmnet [production]
15:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1023.eqiad.wmnet [production]
15:06 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1023.eqiad.wmnet [production]
15:05 <pt1979@cumin2002> START - Cookbook sre.hosts.dhcp for host an-test-worker1003.eqiad.wmnet [production]
15:00 <jelto@cumin1001> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: GitLab minor version upgrade [production]
15:00 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1023.eqiad.wmnet [production]
14:52 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1023.eqiad.wmnet [production]
14:48 <btullis@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-jumbo-eqiad cluster: Roll restart of jvm daemons. [production]
14:44 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs2013.codfw.wmnet [production]
14:44 <vgutierrez@cumin1001> START - Cookbook sre.hosts.remove-downtime for lvs2013.codfw.wmnet [production]
14:42 <sukhe> re-enable puppet and start pybal on lvs2013 [production]
14:40 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1022.eqiad.wmnet [production]