4301-4350 of 10000 results (31ms)
2020-07-20 §
11:34 <urbanecm@deploy1001> sync-file aborted: (no justification provided) (duration: 00m 01s) [production]
11:25 <Urbanecm> mwscript namespaceDupes.php --wiki=kowikiquote --fix (T255031) [production]
11:24 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 3719668511231589b4fc6a723ccdfa772068ad5f: Add NamespaceAliases for kowikiquote (T255031) (duration: 00m 57s) [production]
11:22 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: bc5671a90c65b66989e470fc41225986b2ec9fb5: Add media.farsnews.ir to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T253800) (duration: 00m 57s) [production]
11:18 <Urbanecm> Run mwscript updateCollation.php --wiki=bswiktionary --previous-collation=uppercase in a tmux session at mwmaint1002 (T258346) [production]
11:17 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 0c784784d75c2bbfb570495a6a097d4c44cbe6b3: Set $wgCategoryCollation to uca-bs-u-kn on Bosnian Wiktionary (T258346) (duration: 00m 58s) [production]
11:13 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 6830723b0ad5031e67062ba838f09cd07c2b97a1: Convert ukwikisource ns:250 and ns:251 to have subpages (T255930) (duration: 00m 57s) [production]
11:10 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 1c7a6215d06aff6cb0a75701292d8147f006d9e4: Create closer group at itwikinews (T257927) (duration: 00m 57s) [production]
10:55 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
10:51 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
10:50 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
10:48 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
10:48 <moritzm> rebooting releases* hosts for kernel security update [production]
10:35 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:614698| Bumping portals to master (614698)]] (duration: 00m 56s) [production]
10:34 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:614698| Bumping portals to master (614698)]] (duration: 00m 59s) [production]
10:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1114', diff saved to https://phabricator.wikimedia.org/P11962 and previous config saved to /var/cache/conftool/dbconfig/20200720-103058-marostegui.json [production]
09:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P11961 and previous config saved to /var/cache/conftool/dbconfig/20200720-094609-marostegui.json [production]
09:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P11960 and previous config saved to /var/cache/conftool/dbconfig/20200720-093154-marostegui.json [production]
09:25 <godog> update compiler facts [production]
09:17 <jayme> updating envoyproxy to 1.14.4-1 on all eqiad hosts [production]
09:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1114', diff saved to https://phabricator.wikimedia.org/P11959 and previous config saved to /var/cache/conftool/dbconfig/20200720-091119-marostegui.json [production]
09:04 <jayme> updating envoyproxy to 1.14.4-1 on all codfw hosts [production]
07:54 <moritzm> installing libopenmpt security updates [production]
07:51 <jayme> updating envoyproxy to 1.14.4-1 on all non mw and restbase hosts [production]
07:29 <marostegui> Move m1-master from dbproxy1012 to dbproxy1014 - T255408 [production]
07:19 <marostegui> Drop non used reviewdb database - T255715 [production]
06:55 <elukey> restart matomo1002's mariadb to pick up new TLS settings [production]
06:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1114', diff saved to https://phabricator.wikimedia.org/P11958 and previous config saved to /var/cache/conftool/dbconfig/20200720-065438-marostegui.json [production]
06:15 <tstarling@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/Score/includes/Score.php: reverting Reedy's temporary patch for hardcoding the lilypond version (duration: 00m 57s) [production]
06:07 <tstarling@deploy1001> Finished scap: fixing missing message from previous sync-dir (duration: 29m 57s) [production]
05:56 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1082 after a crash T258336', diff saved to https://phabricator.wikimedia.org/P11957 and previous config saved to /var/cache/conftool/dbconfig/20200720-055614-marostegui.json [production]
05:47 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1082 after a crash T258336', diff saved to https://phabricator.wikimedia.org/P11956 and previous config saved to /var/cache/conftool/dbconfig/20200720-054747-marostegui.json [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1082 after a crash T258336', diff saved to https://phabricator.wikimedia.org/P11955 and previous config saved to /var/cache/conftool/dbconfig/20200720-053816-marostegui.json [production]
05:37 <tstarling@deploy1001> Started scap: fixing missing message from previous sync-dir [production]
05:30 <tstarling@deploy1001> scap sync-l10n completed (1.35.0-wmf.41) (duration: 02m 44s) [production]
05:25 <marostegui> Deploy MCR schema change on enwiki on db1119 - T238966 [production]
05:24 <tstarling@deploy1001> Synchronized wmf-config/CommonSettings.php: disable lilypond with better error message (duration: 00m 57s) [production]
05:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1082 after a crash T258336', diff saved to https://phabricator.wikimedia.org/P11953 and previous config saved to /var/cache/conftool/dbconfig/20200720-051846-marostegui.json [production]
05:18 <tstarling@deploy1001> Synchronized php-1.35.0-wmf.41/extensions/Score: better error message for disabling of Score (duration: 01m 10s) [production]
2020-07-19 §
19:16 <marostegui> Upgrade and reboot db1085 T258360 [production]
18:57 <marostegui> Start mysql on db1082 T258336 [production]
18:51 <marostegui> Upgrade and reboot db1082 T258336 [production]
18:45 <cdanis@cumin1001> dbctl commit (dc=all): 'db1085 also crashed', diff saved to https://phabricator.wikimedia.org/P11952 and previous config saved to /var/cache/conftool/dbconfig/20200719-184511-cdanis.json [production]
18:06 <Urbanecm> Run mwscript emptyUserGroup.php --wiki=testwiki contestadmin (T256555) [production]
2020-07-18 §
21:41 <shdubsh> restart logstash on logstash200[456] [production]
21:14 <shdubsh> bounce logstash on logstash1007 [production]
21:10 <shdubsh> bounce logstash on logstash1008 [production]
21:06 <shdubsh> bounce logstash on logstash1009 [production]
20:52 <marostegui> Due to db1082 crash there will be replication lag on s5 on labsdb hosts - T258336 [production]
20:37 <cdanis@cumin1001> dbctl commit (dc=all): 'depool db1082, it crashed', diff saved to https://phabricator.wikimedia.org/P11951 and previous config saved to /var/cache/conftool/dbconfig/20200718-203704-cdanis.json [production]