4051-4100 of 10000 results (129ms)
2024-09-10 ยง
14:10 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2442.codfw.wmnet [production]
14:10 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript cleanupTitles mswiki | tee T363538-mswiki-cleanupTitles [production]
14:10 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes mswiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-prefix=T363538/ --fix | tee T363538-mswiki-namespaceDupes [production]
14:09 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2442.codfw.wmnet [production]
14:09 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2440.codfw.wmnet [production]
14:09 <arnaudb@cumin1002> dbctl commit (dc=all): 'Cloning db2137 in db2237 for T373579', diff saved to https://phabricator.wikimedia.org/P68792 and previous config saved to /var/cache/conftool/dbconfig/20240910-140918-arnaudb.json [production]
14:09 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2440.codfw.wmnet [production]
14:09 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubernetes2058.codfw.wmnet [production]
14:09 <arnaudb@cumin1002> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2227.codfw.wmnet onto db2127.codfw.wmnet [production]
14:08 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host kubernetes2058.codfw.wmnet [production]
14:08 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubernetes2041.codfw.wmnet [production]
14:08 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2237.codfw.wmnet with reason: provisionning db2237.codfw.wmnet - T373579 [production]
14:08 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2237.codfw.wmnet with reason: provisionning db2237.codfw.wmnet - T373579 [production]
14:08 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2137.codfw.wmnet with reason: provisionning db2237.codfw.wmnet - T373579 [production]
14:07 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host kubernetes2041.codfw.wmnet [production]
14:07 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubernetes2040.codfw.wmnet [production]
14:07 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2137.codfw.wmnet with reason: provisionning db2237.codfw.wmnet - T373579 [production]
14:07 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host kubernetes2040.codfw.wmnet [production]
14:06 <jayme@cumin1002> START - Cookbook sre.dns.netbox [production]
14:06 <claime> Depooling kubernetes2040.codfw.wmnet kubernetes2041.codfw.wmnet kubernetes2058.codfw.wmnet mw2440.codfw.wmnet mw2442.codfw.wmnet mw2443.codfw.wmnet parse2011.codfw.wmnet parse2012.codfw.wmnet parse2013.codfw.wmnet wikikube-worker2039.codfw.wmnet - T373097 [production]
14:06 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript cleanupTitles jawiki | tee T363538-jawiki-cleanupTitles [production]
14:06 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes jawiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-prefix=T363538/ --fix | tee T363538-jawiki-namespaceDupes [production]
14:01 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1184 (T371742)', diff saved to https://phabricator.wikimedia.org/P68788 and previous config saved to /var/cache/conftool/dbconfig/20240910-140141-ladsgroup.json [production]
14:01 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript cleanupTitles idwiki | tee T363538-idwiki-cleanupTitles [production]
14:01 <jayme@cumin1002> START - Cookbook sre.hosts.decommission for hosts kafka-main2002.codfw.wmnet [production]
14:01 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes idwiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-prefix=T363538/ --fix | tee T363538-idwiki-namespaceDupes [production]
13:59 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript cleanupTitles dagwiki | tee T363538-dagwiki-cleanupTitles [production]
13:58 <sukhe> sudo cumin -b11 "A:cp" 'run-puppet-agent --enable "merging CRs 1065283"' [production]
13:57 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes dagwiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-prefix=T363538/ --fix | tee T363538-dagwiki-namespaceDupes [production]
13:52 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript cleanupTitles bnwiki | tee T363538-bnwiki-cleanupTitles [production]
13:51 <jebe@deploy1003> Finished deploy [analytics/refinery@464c114] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@464c114d] (duration: 03m 43s) [production]
13:51 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes bnwiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-suffix=/T363538 --fix | tee T363538-bnwiki-namespaceDupes [production]
13:50 <sukhe> sudo cumin "A:cp" 'disable-puppet "merging CRs 1065283"' [production]
13:48 <jebe@deploy1003> Started deploy [analytics/refinery@464c114] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@464c114d] [production]
13:47 <jebe@deploy1003> Finished deploy [analytics/refinery@464c114] (thin): Regular analytics weekly train THIN [analytics/refinery@464c114d] (duration: 04m 58s) [production]
13:43 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript cleanupTitles aswiki | tee T363538-aswiki-cleanupTitles [production]
13:42 <jebe@deploy1003> Started deploy [analytics/refinery@464c114] (thin): Regular analytics weekly train THIN [analytics/refinery@464c114d] [production]
13:42 <jebe@deploy1003> Finished deploy [analytics/refinery@464c114]: Regular analytics weekly train [analytics/refinery@464c114d] (duration: 07m 22s) [production]
13:42 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes.php aswiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --add-prefix=T363538/ --fix | tee T363538-aswiki-namespaceDupes-prefix [production]
13:38 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ mwscript namespaceDupes.php aswiki --source-pseudo-namespace MOS --dest-namespace 126 --move-talk --fix | tee T363538-aswiki-namespaceDupes # crashed, DBQueryError [production]
13:35 <jebe@deploy1003> Started deploy [analytics/refinery@464c114]: Regular analytics weekly train [analytics/refinery@464c114d] [production]
13:35 <logmsgbot> lucaswerkmeister-wmde@deploy1003 Finished scap sync-world: Backport for [[gerrit:1070975|Elevate pseudo-namespace MOS to a real namespace on most wikis which use it (T363538)]] (duration: 13m 45s) [production]
13:30 <logmsgbot> lucaswerkmeister-wmde@deploy1003 lucaswerkmeister-wmde, cscott: Continuing with sync [production]
13:28 <logmsgbot> lucaswerkmeister-wmde@deploy1003 lucaswerkmeister-wmde, cscott: Backport for [[gerrit:1070975|Elevate pseudo-namespace MOS to a real namespace on most wikis which use it (T363538)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:23 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc2017.codfw.wmnet,pc1017.eqiad.wmnet with reason: T374355 [production]
13:23 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc2017.codfw.wmnet,pc1017.eqiad.wmnet with reason: T374355 [production]
13:21 <logmsgbot> lucaswerkmeister-wmde@deploy1003 Started scap sync-world: Backport for [[gerrit:1070975|Elevate pseudo-namespace MOS to a real namespace on most wikis which use it (T363538)]] [production]
13:18 <logmsgbot> lucaswerkmeister-wmde@deploy1003 Finished scap sync-world: Backport for [[gerrit:1071708|Support new heading layout (T373039 T374377)]] (duration: 12m 11s) [production]
13:14 <logmsgbot> lucaswerkmeister-wmde@deploy1003 lucaswerkmeister-wmde, jdlrobson: Continuing with sync [production]
13:10 <logmsgbot> lucaswerkmeister-wmde@deploy1003 lucaswerkmeister-wmde, jdlrobson: Backport for [[gerrit:1071708|Support new heading layout (T373039 T374377)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]