3201-3250 of 10000 results (44ms)
2021-03-17 §
11:30 <marostegui@cumin1001> dbctl commit (dc=all): 'db1109 (re)pooling @ 75%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14929 and previous config saved to /var/cache/conftool/dbconfig/20210317-113057-root.json [production]
11:20 <jayme> switch restbase-async back to codfw (the newly initialized cluster) [production]
11:17 <jayme@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=restbase-async,name=codfw [production]
11:17 <jayme@cumin1001> conftool action : set/pooled=false; selector: dnsdisc=restbase-async,name=eqiad [production]
11:15 <marostegui@cumin1001> dbctl commit (dc=all): 'db1109 (re)pooling @ 50%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14928 and previous config saved to /var/cache/conftool/dbconfig/20210317-111553-root.json [production]
11:09 <moritzm> restarting tomcat on idp.wikimedia.org [production]
11:00 <marostegui@cumin1001> dbctl commit (dc=all): 'db1109 (re)pooling @ 25%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14927 and previous config saved to /var/cache/conftool/dbconfig/20210317-110050-root.json [production]
09:59 <moritzm> imported PHP 5.6.40 to thirdparty/php56 T224589 [production]
09:47 <vgutierrez> restart varnish-fe on cp5011 [production]
09:24 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1109 for schema change', diff saved to https://phabricator.wikimedia.org/P14926 and previous config saved to /var/cache/conftool/dbconfig/20210317-092443-marostegui.json [production]
09:23 <marostegui@cumin1001> dbctl commit (dc=all): 'db1114 (re)pooling @ 100%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14925 and previous config saved to /var/cache/conftool/dbconfig/20210317-092357-root.json [production]
09:08 <marostegui@cumin1001> dbctl commit (dc=all): 'db1114 (re)pooling @ 75%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14924 and previous config saved to /var/cache/conftool/dbconfig/20210317-090853-root.json [production]
09:04 <jayme@cumin1001> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=recommendation-api [production]
09:04 <jayme@cumin1001> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=cxserver [production]
09:04 <jayme@cumin1001> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=citoid [production]
09:01 <marostegui@cumin1001> dbctl commit (dc=all): 'db1082 (re)pooling @ 100%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14923 and previous config saved to /var/cache/conftool/dbconfig/20210317-090108-root.json [production]
08:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1084 T276302', diff saved to https://phabricator.wikimedia.org/P14922 and previous config saved to /var/cache/conftool/dbconfig/20210317-085852-marostegui.json [production]
08:53 <marostegui@cumin1001> dbctl commit (dc=all): 'db1114 (re)pooling @ 50%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14921 and previous config saved to /var/cache/conftool/dbconfig/20210317-085350-root.json [production]
08:46 <marostegui@cumin1001> dbctl commit (dc=all): 'db1082 (re)pooling @ 75%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14920 and previous config saved to /var/cache/conftool/dbconfig/20210317-084605-root.json [production]
08:38 <marostegui@cumin1001> dbctl commit (dc=all): 'db1114 (re)pooling @ 25%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14919 and previous config saved to /var/cache/conftool/dbconfig/20210317-083846-root.json [production]
08:31 <marostegui@cumin1001> dbctl commit (dc=all): 'db1082 (re)pooling @ 50%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14918 and previous config saved to /var/cache/conftool/dbconfig/20210317-083101-root.json [production]
08:15 <marostegui@cumin1001> dbctl commit (dc=all): 'db1082 (re)pooling @ 25%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14917 and previous config saved to /var/cache/conftool/dbconfig/20210317-081557-root.json [production]
07:50 <godog> swift eqiad-prod: less weight for ms-be[1019-1026] - T272836 [production]
07:34 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1114 for schema change', diff saved to https://phabricator.wikimedia.org/P14916 and previous config saved to /var/cache/conftool/dbconfig/20210317-073403-marostegui.json [production]
07:30 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 100%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14915 and previous config saved to /var/cache/conftool/dbconfig/20210317-073024-root.json [production]
07:15 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 75%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14914 and previous config saved to /var/cache/conftool/dbconfig/20210317-071520-root.json [production]
07:00 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 50%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14913 and previous config saved to /var/cache/conftool/dbconfig/20210317-070017-root.json [production]
06:52 <marostegui> Stop MySQL on db1082 to clone db1161 (lag will appear on s5 on wikireplicas) - T258361 [production]
06:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1082 to clone db1161 T258361', diff saved to https://phabricator.wikimedia.org/P14911 and previous config saved to /var/cache/conftool/dbconfig/20210317-065146-marostegui.json [production]
06:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2150 into s7 T275633', diff saved to https://phabricator.wikimedia.org/P14910 and previous config saved to /var/cache/conftool/dbconfig/20210317-064606-marostegui.json [production]
06:45 <marostegui@cumin1001> dbctl commit (dc=all): 'db1111 (re)pooling @ 25%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14909 and previous config saved to /var/cache/conftool/dbconfig/20210317-064513-root.json [production]
06:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db2150 to s7, depooled T275633', diff saved to https://phabricator.wikimedia.org/P14908 and previous config saved to /var/cache/conftool/dbconfig/20210317-060358-marostegui.json [production]
05:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1111 for schema change', diff saved to https://phabricator.wikimedia.org/P14907 and previous config saved to /var/cache/conftool/dbconfig/20210317-054206-marostegui.json [production]
02:25 <eileen> civicrm revision changed from 8c137b94f0 to 99bf1c9210, config revision is ef2767ab91 [production]
01:55 <eileen> civicrm revision changed from 550be50105 to 8c137b94f0, config revision is ef2767ab91 [production]
2021-03-16 §
23:56 <krinkle@deploy1002> Synchronized php-1.36.0-wmf.35/includes/Revision/: I8619ab9e92b, T277362, T275531 (duration: 00m 58s) [production]
23:51 <krinkle@deploy1002> Synchronized php-1.36.0-wmf.34/extensions/Scribunto/: I84e8732d8d - tmp logging (duration: 00m 58s) [production]
23:47 <Krinkle> There is an uncommitted dirty diff in /srv/mediawiki-staging/php-1.36.0-wmf.34/extensions/WikimediaMaintenance/createExtensionTables.php [production]
23:31 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: I1ca4f30c2, T262612 (duration: 00m 57s) [production]
23:22 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Icd6635cb302cc, T277332 (duration: 00m 58s) [production]
23:07 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: I8d8c94d95c6 (duration: 00m 59s) [production]
23:03 <twentyafterfour> applied hotfix to phabricator/src/infrastructure/customfield/storage/PhabricatorCustomFieldStorage.php and restarted php-fpm [production]
23:02 <krinkle@deploy1002> Synchronized wmf-config/CommonSettings.php: I4097cbcb1d5 (duration: 00m 59s) [production]
22:59 <krinkle@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Ie24eb2077 (duration: 00m 58s) [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2232.codfw.wmnet [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2231.codfw.wmnet [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=inactive; selector: name=mw2230.codfw.wmnet [production]
20:49 <andrew@deploy1002> Finished deploy [horizon/deploy@e4fd934]: tiny horizon patch to support flavor deprecation (duration: 03m 44s) [production]
20:45 <andrew@deploy1002> Started deploy [horizon/deploy@e4fd934]: tiny horizon patch to support flavor deprecation [production]
20:15 <XioNoX> remove DMZ zone from pfw3-eqiad - T174203 [production]