|
2021-03-17
§
|
| 12:10 |
<jayme@cumin1001> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=eventgate-main |
[production] |
| 11:49 |
<marostegui> |
Deploy schema change on s8, lag will appear on wiki replicas T276150 T276156 |
[production] |
| 11:47 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1087 for schema change', diff saved to https://phabricator.wikimedia.org/P14931 and previous config saved to /var/cache/conftool/dbconfig/20210317-114746-marostegui.json |
[production] |
| 11:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1109 (re)pooling @ 100%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14930 and previous config saved to /var/cache/conftool/dbconfig/20210317-114601-root.json |
[production] |
| 11:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1109 (re)pooling @ 75%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14929 and previous config saved to /var/cache/conftool/dbconfig/20210317-113057-root.json |
[production] |
| 11:20 |
<jayme> |
switch restbase-async back to codfw (the newly initialized cluster) |
[production] |
| 11:17 |
<jayme@cumin1001> |
conftool action : set/pooled=true; selector: dnsdisc=restbase-async,name=codfw |
[production] |
| 11:17 |
<jayme@cumin1001> |
conftool action : set/pooled=false; selector: dnsdisc=restbase-async,name=eqiad |
[production] |
| 11:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1109 (re)pooling @ 50%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14928 and previous config saved to /var/cache/conftool/dbconfig/20210317-111553-root.json |
[production] |
| 11:09 |
<moritzm> |
restarting tomcat on idp.wikimedia.org |
[production] |
| 11:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1109 (re)pooling @ 25%: Slowly repool db1109', diff saved to https://phabricator.wikimedia.org/P14927 and previous config saved to /var/cache/conftool/dbconfig/20210317-110050-root.json |
[production] |
| 09:59 |
<moritzm> |
imported PHP 5.6.40 to thirdparty/php56 T224589 |
[production] |
| 09:47 |
<vgutierrez> |
restart varnish-fe on cp5011 |
[production] |
| 09:24 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1109 for schema change', diff saved to https://phabricator.wikimedia.org/P14926 and previous config saved to /var/cache/conftool/dbconfig/20210317-092443-marostegui.json |
[production] |
| 09:23 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1114 (re)pooling @ 100%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14925 and previous config saved to /var/cache/conftool/dbconfig/20210317-092357-root.json |
[production] |
| 09:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1114 (re)pooling @ 75%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14924 and previous config saved to /var/cache/conftool/dbconfig/20210317-090853-root.json |
[production] |
| 09:04 |
<jayme@cumin1001> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=recommendation-api |
[production] |
| 09:04 |
<jayme@cumin1001> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=cxserver |
[production] |
| 09:04 |
<jayme@cumin1001> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=citoid |
[production] |
| 09:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1082 (re)pooling @ 100%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14923 and previous config saved to /var/cache/conftool/dbconfig/20210317-090108-root.json |
[production] |
| 08:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1084 T276302', diff saved to https://phabricator.wikimedia.org/P14922 and previous config saved to /var/cache/conftool/dbconfig/20210317-085852-marostegui.json |
[production] |
| 08:53 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1114 (re)pooling @ 50%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14921 and previous config saved to /var/cache/conftool/dbconfig/20210317-085350-root.json |
[production] |
| 08:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1082 (re)pooling @ 75%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14920 and previous config saved to /var/cache/conftool/dbconfig/20210317-084605-root.json |
[production] |
| 08:38 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1114 (re)pooling @ 25%: Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P14919 and previous config saved to /var/cache/conftool/dbconfig/20210317-083846-root.json |
[production] |
| 08:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1082 (re)pooling @ 50%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14918 and previous config saved to /var/cache/conftool/dbconfig/20210317-083101-root.json |
[production] |
| 08:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1082 (re)pooling @ 25%: Slowly repool db1082', diff saved to https://phabricator.wikimedia.org/P14917 and previous config saved to /var/cache/conftool/dbconfig/20210317-081557-root.json |
[production] |
| 07:50 |
<godog> |
swift eqiad-prod: less weight for ms-be[1019-1026] - T272836 |
[production] |
| 07:34 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1114 for schema change', diff saved to https://phabricator.wikimedia.org/P14916 and previous config saved to /var/cache/conftool/dbconfig/20210317-073403-marostegui.json |
[production] |
| 07:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1111 (re)pooling @ 100%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14915 and previous config saved to /var/cache/conftool/dbconfig/20210317-073024-root.json |
[production] |
| 07:15 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1111 (re)pooling @ 75%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14914 and previous config saved to /var/cache/conftool/dbconfig/20210317-071520-root.json |
[production] |
| 07:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1111 (re)pooling @ 50%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14913 and previous config saved to /var/cache/conftool/dbconfig/20210317-070017-root.json |
[production] |
| 06:52 |
<marostegui> |
Stop MySQL on db1082 to clone db1161 (lag will appear on s5 on wikireplicas) - T258361 |
[production] |
| 06:51 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1082 to clone db1161 T258361', diff saved to https://phabricator.wikimedia.org/P14911 and previous config saved to /var/cache/conftool/dbconfig/20210317-065146-marostegui.json |
[production] |
| 06:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Pool db2150 into s7 T275633', diff saved to https://phabricator.wikimedia.org/P14910 and previous config saved to /var/cache/conftool/dbconfig/20210317-064606-marostegui.json |
[production] |
| 06:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1111 (re)pooling @ 25%: Slowly repool db1111', diff saved to https://phabricator.wikimedia.org/P14909 and previous config saved to /var/cache/conftool/dbconfig/20210317-064513-root.json |
[production] |
| 06:03 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Add db2150 to s7, depooled T275633', diff saved to https://phabricator.wikimedia.org/P14908 and previous config saved to /var/cache/conftool/dbconfig/20210317-060358-marostegui.json |
[production] |
| 05:42 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1111 for schema change', diff saved to https://phabricator.wikimedia.org/P14907 and previous config saved to /var/cache/conftool/dbconfig/20210317-054206-marostegui.json |
[production] |
| 02:25 |
<eileen> |
civicrm revision changed from 8c137b94f0 to 99bf1c9210, config revision is ef2767ab91 |
[production] |
| 01:55 |
<eileen> |
civicrm revision changed from 550be50105 to 8c137b94f0, config revision is ef2767ab91 |
[production] |
|
2021-03-16
§
|
| 23:56 |
<krinkle@deploy1002> |
Synchronized php-1.36.0-wmf.35/includes/Revision/: I8619ab9e92b, T277362, T275531 (duration: 00m 58s) |
[production] |
| 23:51 |
<krinkle@deploy1002> |
Synchronized php-1.36.0-wmf.34/extensions/Scribunto/: I84e8732d8d - tmp logging (duration: 00m 58s) |
[production] |
| 23:47 |
<Krinkle> |
There is an uncommitted dirty diff in /srv/mediawiki-staging/php-1.36.0-wmf.34/extensions/WikimediaMaintenance/createExtensionTables.php |
[production] |
| 23:31 |
<krinkle@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: I1ca4f30c2, T262612 (duration: 00m 57s) |
[production] |
| 23:22 |
<krinkle@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Icd6635cb302cc, T277332 (duration: 00m 58s) |
[production] |
| 23:07 |
<krinkle@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: I8d8c94d95c6 (duration: 00m 59s) |
[production] |
| 23:03 |
<twentyafterfour> |
applied hotfix to phabricator/src/infrastructure/customfield/storage/PhabricatorCustomFieldStorage.php and restarted php-fpm |
[production] |
| 23:02 |
<krinkle@deploy1002> |
Synchronized wmf-config/CommonSettings.php: I4097cbcb1d5 (duration: 00m 59s) |
[production] |
| 22:59 |
<krinkle@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Ie24eb2077 (duration: 00m 58s) |
[production] |
| 20:59 |
<dzahn@cumin1001> |
conftool action : set/pooled=inactive; selector: name=mw2232.codfw.wmnet |
[production] |
| 20:59 |
<dzahn@cumin1001> |
conftool action : set/pooled=inactive; selector: name=mw2231.codfw.wmnet |
[production] |