3951-4000 of 10000 results (52ms)
2023-11-02 §
09:25 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on ldap-rw[1001,2001].wikimedia.org with reason: setup in progress [production]
09:13 <jayme> published image php7.4-fpm-multiversion-base:7.4.33-6 now based on icu67 php packages - T345561 [production]
09:06 <zabe@deploy2002> Finished scap: Backport for [[gerrit:970762|Update Netskope IP ranges (T350199)]] (duration: 07m 25s) [production]
09:05 <moritzm> installing krb5 security updates on buster/bullseye/bookworm [production]
09:04 <moritzm> installing krb5 security updates on bullseye [production]
09:01 <zabe@deploy2002> zabe: Continuing with sync [production]
09:00 <zabe@deploy2002> zabe: Backport for [[gerrit:970762|Update Netskope IP ranges (T350199)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:59 <zabe@deploy2002> Started scap: Backport for [[gerrit:970762|Update Netskope IP ranges (T350199)]] [production]
08:57 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on dbproxy1017.eqiad.wmnet with reason: decomissionning via T348956 [production]
08:57 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on dbproxy1017.eqiad.wmnet with reason: decomissionning via T348956 [production]
08:48 <jmm@cumin2002> END (PASS) - Cookbook sre.debmonitor.remove-hosts (exit_code=0) for 1 hosts: cloudcontrol2006-dev.codfw.wmnet [production]
08:48 <jmm@cumin2002> START - Cookbook sre.debmonitor.remove-hosts for 1 hosts: cloudcontrol2006-dev.codfw.wmnet [production]
08:12 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Downtime as we setup the new WMDE Airflow instance [production]
08:12 <stevemunene@cumin1001> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on an-airflow1007.eqiad.wmnet with reason: Downtime as we setup the new WMDE Airflow instance [production]
07:28 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
07:27 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
07:05 <jelto@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host vrts1001.eqiad.wmnet [production]
07:01 <jelto@cumin1001> START - Cookbook sre.hosts.reboot-single for host vrts1001.eqiad.wmnet [production]
05:38 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) (348643) [admin]
03:48 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node (348643) [admin]
03:47 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.ceph.osd.drain_node (exit_code=97) (348643) [admin]
03:43 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node (348643) [admin]
03:13 <eileen> civicrm upgraded from 86b620ef to 84ec2957 [production]
03:03 <eileen> civicrm upgraded from bcfd8a7e to 86b620ef [production]
02:27 <eileen> civicrm upgraded from 60bdd8d3 to bcfd8a7e [production]
02:18 <eileen> civicrm upgraded from 770b114c to 60bdd8d3 [production]
00:13 <wm-bot> <anticomposite> Deploy 52376119 [tools.fedi-share]
2023-11-01 §
23:13 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.drain_node (exit_code=99) (348643) [admin]
22:39 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:970758|Revert "Add খসড়া as draft namespace alias on bnwiki" and add "খসড়া" by copy-paste from wiki page]] (duration: 06m 44s) [production]
22:32 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:970758|Revert "Add খসড়া as draft namespace alias on bnwiki" and add "খসড়া" by copy-paste from wiki page]] [production]
22:18 <bking@cumin2002> END (PASS) - Cookbook sre.wdqs.data-reload (exit_code=0) [production]
22:18 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
22:18 <bking@cumin2002> END (ERROR) - Cookbook sre.wdqs.data-reload (exit_code=97) [production]
22:16 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
22:15 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
22:15 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
22:14 <bking@cumin2002> END (FAIL) - Cookbook sre.wdqs.data-reload (exit_code=99) [production]
22:13 <bking@cumin2002> START - Cookbook sre.wdqs.data-reload [production]
22:06 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:970757|Add খসড়া as draft namespace alias on bnwiki]] (duration: 09m 34s) [production]
22:00 <urbanecm@deploy2002> mdsshakil and urbanecm: Continuing with sync [production]
21:57 <urbanecm@deploy2002> mdsshakil and urbanecm: Backport for [[gerrit:970757|Add খসড়া as draft namespace alias on bnwiki]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:56 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:970757|Add খসড়া as draft namespace alias on bnwiki]] [production]
21:49 <wm-bot> <urbanecm> tools.phabbot:~/phabbot$ git remote set-url origin https://gitlab.wikimedia.org/ladsgroup/Phabricator-maintenance-bot.git # repository moved to gitlab, but toolforge still had github url [tools.phabbot]
21:29 <taavi> re-enable puppet on cloudcontrol2006-dev.codfw.wmnet which has fallen off of puppetdb [admin]
21:15 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node (348643) [admin]
21:15 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) (348643) [admin]
21:15 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.drain_node (348643) [admin]
21:14 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.osd.drain_node (exit_code=0) (348643) [admin]
21:14 <topranks> adjust BGP policy out to L3 switches on remaining CRs T344547 [production]
20:51 <urbanecm> mwmaint2002: mwscript namespaceDupes.php bnwiki --fix --add-prefix BROKEN [production]