2201-2250 of 10000 results (46ms)
2021-05-17 ยง
11:55 <marostegui> Deploy schema change on s8 codfw, lag will appear in codfw T266486 T268392 T273360 [production]
11:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db1158 (re)pooling @ 25%: Repool db1158', diff saved to https://phabricator.wikimedia.org/P15996 and previous config saved to /var/cache/conftool/dbconfig/20210517-115037-root.json [production]
11:50 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript namespaceDupes.php --wiki=mswikibooks --fix [production]
11:50 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript namespaceDupes.php --wiki=mswiki --fix [production]
11:49 <Urbanecm> 11:49:22 Synchronized wmf-config/InitialiseSettings.php: a73fe2d: Make the Malaysian talk namespaces names consistent (duration: 01m 08s) [production]
11:27 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on aqs1012.eqiad.wmnet with reason: Testing removing from new AQS cluster [production]
11:27 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on aqs1012.eqiad.wmnet with reason: Testing removing from new AQS cluster [production]
11:24 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 1e06f83293be63bd32703731ef1386e63d4ae94a: Enable SandboxLink at azwiki (T282954) (duration: 01m 08s) [production]
11:22 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 32e43439c88147439109403ea2805da648fef97f: urwiki: Grant `editprotected` to eliminators (T281274) (duration: 01m 08s) [production]
11:17 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 36d29a667bacebc880632c6a6a3614f4b1f5aa2e: Enable NewUserMessage on ptwikinews (T282845) (duration: 01m 09s) [production]
11:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1158', diff saved to https://phabricator.wikimedia.org/P15995 and previous config saved to /var/cache/conftool/dbconfig/20210517-111343-marostegui.json [production]
11:07 <Urbanecm> Purge https://en.wikipedia.org/static/images/project-logos/{bnwiki,bnwiki-1.5x,bnwiki-2x}.png (T282886) [production]
11:07 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on aqs1012.eqiad.wmnet with reason: Testing removing from new AQS cluster [production]
11:07 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 0:30:00 on aqs1012.eqiad.wmnet with reason: Testing removing from new AQS cluster [production]
11:06 <urbanecm@deploy1002> Synchronized static/images/project-logos/: b1da7aa0517074cfa74c52c3889e4b185828d5c8: Update bnwiki project logo (T282886) (duration: 01m 42s) [production]
11:03 <Urbanecm> [urbanecm@mwmaint1002 ~/uploads]$ mwscript importImages.php --wiki=commonswiki --comment-ext=txt --sleep=3600 --user=Lusccasdeutsch . # T278856 [production]
10:38 <marostegui@cumin1001> dbctl commit (dc=all): 'db1127 (re)pooling @ 100%: Repool db1127', diff saved to https://phabricator.wikimedia.org/P15994 and previous config saved to /var/cache/conftool/dbconfig/20210517-103823-root.json [production]
10:37 <jdrewniak@deploy1002> Synchronized portals: Wikimedia Portals Update: [[gerrit:692281| Bumping portals to master (T128546)]] (duration: 01m 07s) [production]
10:36 <jdrewniak@deploy1002> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:692281| Bumping portals to master (T128546)]] (duration: 01m 08s) [production]
10:30 <moritzm> installing postgresql-11 security updates [production]
10:23 <marostegui@cumin1001> dbctl commit (dc=all): 'db1127 (re)pooling @ 75%: Repool db1127', diff saved to https://phabricator.wikimedia.org/P15993 and previous config saved to /var/cache/conftool/dbconfig/20210517-102319-root.json [production]
10:08 <marostegui@cumin1001> dbctl commit (dc=all): 'db1127 (re)pooling @ 50%: Repool db1127', diff saved to https://phabricator.wikimedia.org/P15992 and previous config saved to /var/cache/conftool/dbconfig/20210517-100815-root.json [production]
09:53 <marostegui@cumin1001> dbctl commit (dc=all): 'db1127 (re)pooling @ 25%: Repool db1127', diff saved to https://phabricator.wikimedia.org/P15991 and previous config saved to /var/cache/conftool/dbconfig/20210517-095312-root.json [production]
09:43 <hashar> Restarted CI Jenkins to update the instant-messaging and ircbot plugins # T271122 [production]
09:33 <moritzm> installing libimage-exiftool-perl security updates [production]
09:29 <topranks> push CR691140 to eqiad and codfw core routers - T282809 [production]
09:18 <hashar> Restarting CI Jenkins to upgrade the Gearman plugin # T281737 [production]
09:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1127', diff saved to https://phabricator.wikimedia.org/P15990 and previous config saved to /var/cache/conftool/dbconfig/20210517-091636-marostegui.json [production]
09:16 <marostegui@cumin1001> dbctl commit (dc=all): 'db1170:3317 (re)pooling @ 100%: Repool db1170:3317', diff saved to https://phabricator.wikimedia.org/P15989 and previous config saved to /var/cache/conftool/dbconfig/20210517-091604-root.json [production]
09:06 <ema> cp_eqsin: run confd-reload-vcl manually to fix /var/run/reload-vcl-state T282880 [production]
09:01 <marostegui@cumin1001> dbctl commit (dc=all): 'db1170:3317 (re)pooling @ 75%: Repool db1170:3317', diff saved to https://phabricator.wikimedia.org/P15988 and previous config saved to /var/cache/conftool/dbconfig/20210517-090101-root.json [production]
08:52 <vgutierrez> pool cp5016 [production]
08:45 <marostegui@cumin1001> dbctl commit (dc=all): 'db1170:3317 (re)pooling @ 50%: Repool db1170:3317', diff saved to https://phabricator.wikimedia.org/P15987 and previous config saved to /var/cache/conftool/dbconfig/20210517-084557-root.json [production]
08:45 <vgutierrez> depool cp5016 [production]
08:30 <marostegui@cumin1001> dbctl commit (dc=all): 'db1170:3317 (re)pooling @ 25%: Repool db1170:3317', diff saved to https://phabricator.wikimedia.org/P15986 and previous config saved to /var/cache/conftool/dbconfig/20210517-083053-root.json [production]
08:28 <Urbanecm> wikiadmin@10.64.48.109(centralauth)> delete from global_group_restrictions where ggr_group="Indic_Bots"; # T282968 [production]
08:26 <urbanecm@deploy1002> Synchronized wmf-config/logos.php: 93e61f7: Use svwiki 20th anniversary logos (T282389) (duration: 01m 08s) [production]
08:24 <urbanecm@deploy1002> Synchronized static/images/project-logos/: 0f356a3: Add svwiki 20th anniversary logos (T282389) (duration: 01m 12s) [production]
06:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1170:3317', diff saved to https://phabricator.wikimedia.org/P15985 and previous config saved to /var/cache/conftool/dbconfig/20210517-061232-marostegui.json [production]
06:01 <kormat> restarting mariadb on db1131 to pick up report_host T266483 [production]
05:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1124 (re)pooling @ 100%: Repool db1124', diff saved to https://phabricator.wikimedia.org/P15984 and previous config saved to /var/cache/conftool/dbconfig/20210517-055556-root.json [production]
05:42 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db1079.eqiad.wmnet [production]
05:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1124 (re)pooling @ 75%: Repool db1124', diff saved to https://phabricator.wikimedia.org/P15983 and previous config saved to /var/cache/conftool/dbconfig/20210517-054053-root.json [production]
05:32 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission for hosts db1079.eqiad.wmnet [production]
05:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1124 (re)pooling @ 50%: Repool db1124', diff saved to https://phabricator.wikimedia.org/P15982 and previous config saved to /var/cache/conftool/dbconfig/20210517-052549-root.json [production]
05:17 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove db1079 from dbctl T282079', diff saved to https://phabricator.wikimedia.org/P15981 and previous config saved to /var/cache/conftool/dbconfig/20210517-051728-marostegui.json [production]
05:13 <kormat@cumin1001> dbctl commit (dc=all): 'Depool db1131 until it's reimaged to buster T282124', diff saved to https://phabricator.wikimedia.org/P15980 and previous config saved to /var/cache/conftool/dbconfig/20210517-051312-kormat.json [production]
05:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1124 (re)pooling @ 25%: Repool db1124', diff saved to https://phabricator.wikimedia.org/P15979 and previous config saved to /var/cache/conftool/dbconfig/20210517-051045-root.json [production]
05:07 <kormat@cumin1001> dbctl commit (dc=all): 'Promote db1173 to s6 master and set section read-write T282124', diff saved to https://phabricator.wikimedia.org/P15978 and previous config saved to /var/cache/conftool/dbconfig/20210517-050740-kormat.json [production]
05:05 <kormat@cumin1001> dbctl commit (dc=all): 'Set s6 eqiad as read-only for maintenance - T282124', diff saved to https://phabricator.wikimedia.org/P15977 and previous config saved to /var/cache/conftool/dbconfig/20210517-050526-kormat.json [production]