4001-4050 of 10000 results (36ms)
2021-09-02 ยง
13:14 <jbond> reimage sretest1002 (not sretest1001) [production]
13:14 <marostegui@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 50%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17169 and previous config saved to /var/cache/conftool/dbconfig/20210902-131441-root.json [production]
13:14 <jbond> reimage sretest1001 [production]
12:59 <marostegui@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 25%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17168 and previous config saved to /var/cache/conftool/dbconfig/20210902-125937-root.json [production]
12:55 <jbond> disable puppet fleet wide to roll out 715728 [production]
12:44 <marostegui@cumin1001> dbctl commit (dc=all): 'db2119 (re)pooling @ 10%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17167 and previous config saved to /var/cache/conftool/dbconfig/20210902-124434-root.json [production]
12:42 <marostegui> Upgrade db2119 [production]
12:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2119 for upgrade', diff saved to https://phabricator.wikimedia.org/P17166 and previous config saved to /var/cache/conftool/dbconfig/20210902-124102-marostegui.json [production]
12:28 <marostegui@cumin1001> dbctl commit (dc=all): 'db2106 (re)pooling @ 100%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17165 and previous config saved to /var/cache/conftool/dbconfig/20210902-122826-root.json [production]
12:13 <marostegui@cumin1001> dbctl commit (dc=all): 'db2106 (re)pooling @ 75%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17164 and previous config saved to /var/cache/conftool/dbconfig/20210902-121323-root.json [production]
11:58 <marostegui@cumin1001> dbctl commit (dc=all): 'db2106 (re)pooling @ 50%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17163 and previous config saved to /var/cache/conftool/dbconfig/20210902-115819-root.json [production]
11:43 <marostegui@cumin1001> dbctl commit (dc=all): 'db2106 (re)pooling @ 25%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17162 and previous config saved to /var/cache/conftool/dbconfig/20210902-114315-root.json [production]
11:28 <marostegui@cumin1001> dbctl commit (dc=all): 'db2106 (re)pooling @ 10%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17161 and previous config saved to /var/cache/conftool/dbconfig/20210902-112812-root.json [production]
11:26 <urbanecm@deploy1002> Synchronized README: testing scap (duration: 01m 06s) [production]
11:22 <jmm@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=mw2264.codfw.wmnet [production]
11:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2106 for upgrade', diff saved to https://phabricator.wikimedia.org/P17160 and previous config saved to /var/cache/conftool/dbconfig/20210902-111843-marostegui.json [production]
11:07 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:05 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 3ce5d80eb6f8ad720b5d9c0b6ad7840dd869735e: dewiki: Enable Growth features for 30% of newcomers (T288420) (duration: 01m 58s) [production]
11:05 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:04 <urbanecm> metawiki: Server-side page move from VRT -> Volunteer Response Team (T290083) [production]
11:00 <marostegui@cumin1001> dbctl commit (dc=all): 'db2073 (re)pooling @ 100%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17158 and previous config saved to /var/cache/conftool/dbconfig/20210902-110022-root.json [production]
10:45 <marostegui@cumin1001> dbctl commit (dc=all): 'db2073 (re)pooling @ 75%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17155 and previous config saved to /var/cache/conftool/dbconfig/20210902-104518-root.json [production]
10:38 <mbsantos> REINDEX database gis in maps1009 while it's in depooled state [production]
10:30 <marostegui@cumin1001> dbctl commit (dc=all): 'db2073 (re)pooling @ 50%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17152 and previous config saved to /var/cache/conftool/dbconfig/20210902-103014-root.json [production]
10:24 <mvolz@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
10:23 <mvolz@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'zotero' for release 'production' . [production]
10:19 <mvolz@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'zotero' for release 'staging' . [production]
10:15 <marostegui@cumin1001> dbctl commit (dc=all): 'db2073 (re)pooling @ 25%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17150 and previous config saved to /var/cache/conftool/dbconfig/20210902-101511-root.json [production]
10:00 <marostegui@cumin1001> dbctl commit (dc=all): 'db2073 (re)pooling @ 10%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17147 and previous config saved to /var/cache/conftool/dbconfig/20210902-100007-root.json [production]
09:57 <marostegui> Upgrade db2073 [production]
09:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2073 for upgrade', diff saved to https://phabricator.wikimedia.org/P17145 and previous config saved to /var/cache/conftool/dbconfig/20210902-095601-marostegui.json [production]
09:56 <hashar@deploy1002> Finished deploy [integration/docroot@973ac8a]: Support listing files on index pages - T289196 (duration: 00m 07s) [production]
09:55 <hashar@deploy1002> Started deploy [integration/docroot@973ac8a]: Support listing files on index pages - T289196 [production]
09:20 <marostegui@cumin1001> dbctl commit (dc=all): 'db2140 (re)pooling @ 100%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17142 and previous config saved to /var/cache/conftool/dbconfig/20210902-092026-root.json [production]
09:05 <marostegui@cumin1001> dbctl commit (dc=all): 'db2140 (re)pooling @ 75%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17141 and previous config saved to /var/cache/conftool/dbconfig/20210902-090523-root.json [production]
08:55 <marostegui> Remove flaggedrevs_stats2 and flaggedrevs_stats from eowiki,idwiki,plwiki,trwiki - T289050 [production]
08:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db2140 (re)pooling @ 50%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17140 and previous config saved to /var/cache/conftool/dbconfig/20210902-085019-root.json [production]
08:35 <marostegui@cumin1001> dbctl commit (dc=all): 'db2140 (re)pooling @ 25%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17138 and previous config saved to /var/cache/conftool/dbconfig/20210902-083515-root.json [production]
08:20 <marostegui@cumin1001> dbctl commit (dc=all): 'db2140 (re)pooling @ 10%: Slowly repool after reimage T288803', diff saved to https://phabricator.wikimedia.org/P17136 and previous config saved to /var/cache/conftool/dbconfig/20210902-082012-root.json [production]
08:14 <marostegui> Upgrade db2140 [production]
08:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2140 for upgrade', diff saved to https://phabricator.wikimedia.org/P17135 and previous config saved to /var/cache/conftool/dbconfig/20210902-081436-marostegui.json [production]
07:57 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1064.eqiad.wmnet [production]
07:51 <filippo@cumin1001> START - Cookbook sre.hosts.reboot-single for host ms-be1064.eqiad.wmnet [production]
07:44 <marostegui> Remove flaggedrevs_stats2 and flaggedrevs_stats on huwiki - T289050 [production]
07:44 <marostegui> Remove flaggedrevs_stats2 and flaggedrevs_stats on arwiki - T289050 [production]
07:06 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
07:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
07:00 <marostegui> Stop mariadb on pc2007 before decommissioning T289112 [production]
06:59 <marostegui@deploy1002> Synchronized wmf-config/ProductionServices.php: Remove pc2007 T289112 (duration: 01m 06s) [production]
06:13 <eileen> civicrm revision changed from ad37f21a7d to 7ac13753c7, config revision is 5f004d94d7 [production]