401-450 of 10000 results (41ms)
2021-03-15 ยง
16:38 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2232.codfw.wmnet [production]
16:38 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2231.codfw.wmnet [production]
16:29 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt-wdqs1002.eqiad.wmnet [production]
16:28 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt-wdqs1003.eqiad.wmnet [production]
16:27 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt-wdqs1001.eqiad.wmnet [production]
16:23 <aborrero@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudvirt-wdqs1003.eqiad.wmnet [production]
16:23 <aborrero@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudvirt-wdqs1002.eqiad.wmnet [production]
16:14 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2010.codfw.wmnet [production]
16:08 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host ganeti2010.codfw.wmnet [production]
16:06 <aborrero@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudvirt-wdqs1001.eqiad.wmnet [production]
16:05 <moritzm> draining ganeti2010 [production]
16:04 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2009.codfw.wmnet [production]
15:58 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host ganeti2009.codfw.wmnet [production]
15:48 <moritzm> draining ganeti2009 [production]
15:47 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2007.codfw.wmnet [production]
15:41 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host ganeti2007.codfw.wmnet [production]
15:33 <moritzm> draining ganeti2007 [production]
15:27 <aborrero@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudgw2001-dev.codfw.wmnet with reason: REIMAGE [production]
15:24 <aborrero@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudgw2001-dev.codfw.wmnet with reason: REIMAGE [production]
15:16 <marostegui@cumin1001> dbctl commit (dc=all): 'db1074 (re)pooling @ 100%: Repool db1074', diff saved to https://phabricator.wikimedia.org/P14858 and previous config saved to /var/cache/conftool/dbconfig/20210315-151648-root.json [production]
15:16 <aborrero@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudgw2002-dev.codfw.wmnet with reason: REIMAGE [production]
15:14 <aborrero@cumin2001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudgw2002-dev.codfw.wmnet with reason: REIMAGE [production]
15:08 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1162.eqiad.wmnet with reason: REIMAGE [production]
15:06 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on db1162.eqiad.wmnet with reason: REIMAGE [production]
15:01 <marostegui@cumin1001> dbctl commit (dc=all): 'db1074 (re)pooling @ 75%: Repool db1074', diff saved to https://phabricator.wikimedia.org/P14857 and previous config saved to /var/cache/conftool/dbconfig/20210315-150144-root.json [production]
14:46 <marostegui@cumin1001> dbctl commit (dc=all): 'db1074 (re)pooling @ 50%: Repool db1074', diff saved to https://phabricator.wikimedia.org/P14856 and previous config saved to /var/cache/conftool/dbconfig/20210315-144641-root.json [production]
14:36 <kharlan@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
14:36 <kharlan@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
14:32 <kharlan@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'external' . [production]
14:32 <kharlan@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'linkrecommendation' for release 'production' . [production]
14:31 <marostegui@cumin1001> dbctl commit (dc=all): 'db1074 (re)pooling @ 25%: Repool db1074', diff saved to https://phabricator.wikimedia.org/P14855 and previous config saved to /var/cache/conftool/dbconfig/20210315-143137-root.json [production]
14:28 <kharlan@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . [production]
14:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1074', diff saved to https://phabricator.wikimedia.org/P14854 and previous config saved to /var/cache/conftool/dbconfig/20210315-140809-marostegui.json [production]
14:04 <dcausse> re-pooling wdqs1005 [production]
13:54 <marostegui@cumin1001> dbctl commit (dc=all): 'db1105:3312 (re)pooling @ 100%: Repool db1105:3312', diff saved to https://phabricator.wikimedia.org/P14853 and previous config saved to /var/cache/conftool/dbconfig/20210315-135426-root.json [production]
13:39 <marostegui@cumin1001> dbctl commit (dc=all): 'db1105:3312 (re)pooling @ 75%: Repool db1105:3312', diff saved to https://phabricator.wikimedia.org/P14852 and previous config saved to /var/cache/conftool/dbconfig/20210315-133921-root.json [production]
13:25 <Urbanecm> Deploy security patch for T152394 [production]
13:24 <marostegui@cumin1001> dbctl commit (dc=all): 'db1105:3312 (re)pooling @ 50%: Repool db1105:3312', diff saved to https://phabricator.wikimedia.org/P14851 and previous config saved to /var/cache/conftool/dbconfig/20210315-132418-root.json [production]
13:09 <marostegui@cumin1001> dbctl commit (dc=all): 'db1105:3312 (re)pooling @ 25%: Repool db1105:3312', diff saved to https://phabricator.wikimedia.org/P14849 and previous config saved to /var/cache/conftool/dbconfig/20210315-130914-root.json [production]
12:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1105:3312', diff saved to https://phabricator.wikimedia.org/P14848 and previous config saved to /var/cache/conftool/dbconfig/20210315-123930-marostegui.json [production]
12:32 <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.34/extensions/MobileFrontend/: 41a2aaac8c7b6ee5ec05af6d051d541614eaba30: Revert "Rewite MoveLeadParagraphTransform based on mobile apps approach" (T277302) (duration: 00m 58s) [production]
12:31 <Lucas_WMDE> maintenance scripts for T270249 completed successfully, no more terms for deleted items found on stat1007 [production]
12:30 <urbanecm@deploy1002> Synchronized php-1.36.0-wmf.34/extensions/GrowthExperiments/: fa2abfab23c7030402336f8908d0988f37d8133b: Manual submodule update of GrowthExperiments repository (T276966) (duration: 00m 59s) [production]
12:29 <Lucas_WMDE> RemoveDeletedItemsFromTermStore.php finished in 5m39s [production]
12:23 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n 5555,9593p T270249.ids | tr '\n' ',' | sed 's/,$//')" # T270249, remaining 4039 items [production]
12:22 <Lucas_WMDE> RemoveDeletedItemsFromTermStore.php finished in 8min [production]
12:19 <_joe_> depooled mw1347 for testing [production]
12:13 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n 555,5554p T270249.ids | tr '\n' ',' | sed 's/,$//')" # T270249, 5000 items [production]
12:12 <Lucas_WMDE> finished in 43s [production]
12:11 <Lucas_WMDE> lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript extensions/Wikibase/repo/maintenance/RemoveDeletedItemsFromTermStore.php wikidatawiki --itemIds "$(sed -n 55,554p T270249.ids | tr '\n' ',' | sed 's/,$//')" # T270249, 500 items [production]