751-800 of 10000 results (26ms)
2021-01-25 §
15:10 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.change-distro-from-cdh-clients (exit_code=0) for Hadoop test cluster: Change Hadoop distribution - elukey@cumin1001 [production]
15:09 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro-from-cdh-clients for Hadoop test cluster: Change Hadoop distribution - elukey@cumin1001 [production]
14:37 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Remove 2 Remove migrated EventLoggingSchemas overrides - T259163, T267352 (duration: 00m 56s) [production]
14:35 <akosiaris@cumin1001> START - Cookbook sre.dns.netbox [production]
14:33 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:33 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:31 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
14:28 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:28 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:26 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:25 <akosiaris@cumin1001> START - Cookbook sre.dns.netbox [production]
12:47 <urbanecm@deploy1001> Synchronized static/images/project-logos/: 6a4cbe662655edaa4f6c36e69877766a6a48d828: Revert "Switch fiwiki to their 500k temporary logo!": delete temporary logo files (duration: 00m 57s) [production]
12:41 <urbanecm@deploy1001> Synchronized wmf-config/MetaContactPages.php: 7a6a60fcaa635a8f891a6d09f3611f8620490497: Create Contact page for Ombuds commission at Meta-Wiki (T271828) (duration: 01m 00s) [production]
12:41 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript namespaceDupes.php --wiki=arbcom_ruwiki --fix # T272292 [production]
12:37 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 833833385f1cf02a4578edb9b5108d173bdf30bd: Adding namespace aliases on arbcom-ruwiki (T272292) (duration: 00m 57s) [production]
12:30 <Urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript updateCollation.php --wiki=trwikivoyage --previous-collation=uppercase # T272783 [production]
12:29 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: bcc7ad7acf721a5e0521bbecfe6df8671ac1822c: Set $wgCategoryCollation = uca-tr on trwikivoyage (T272783) (duration: 00m 57s) [production]
12:27 <urbanecm@deploy1001> Synchronized static/images/project-logos/: d34cb3205a58d5ac50800f2f218af6213f74f5e7: Resize the logo of Turkish Wikivoyage (T272784) (duration: 00m 54s) [production]
12:23 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 177339d96616b5941dbeb2c90ca6aa0be90e3b5a: Defining wgSitename for trwikivoyage (T272779) (duration: 01m 00s) [production]
12:19 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 89d072378e16b0410d963deca2fd766c1406b5b6: Enable SandboxLink on Turkish Wikivoyage (T272780) (duration: 01m 05s) [production]
12:15 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 75aa32fd5aee1feebe8a97360068da55cbcf06d8: frwiki: Change back to normal logo (T272700) (duration: 01m 07s) [production]
12:07 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 693eaec20a24620c2a709c8bac707c0d7af3436b: Add bidgee.id.au to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T272202) (duration: 01m 01s) [production]
11:40 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:658242| Bumping portals to master (T128546)]] (duration: 00m 55s) [production]
11:39 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:658242| Bumping portals to master (T128546)]] (duration: 00m 58s) [production]
11:35 <elukey@cumin1001> END (PASS) - Cookbook sre.hadoop.change-distro-from-cdh-clients (exit_code=0) for Hadoop test cluster: Change Hadoop distribution - elukey@cumin1001 [production]
11:33 <elukey@cumin1001> START - Cookbook sre.hadoop.change-distro-from-cdh-clients for Hadoop test cluster: Change Hadoop distribution - elukey@cumin1001 [production]
11:11 <godog> thanos delete old orphaned blocks with replica=unset label [production]
10:58 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host scandium.eqiad.wmnet [production]
10:52 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host scandium.eqiad.wmnet [production]
10:44 <godog> swift decrease weight for ms-be20[16,18,20,22] - T272837 [production]
10:00 <moritzm> installing imagemagick security updates on stretch [production]
09:55 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader1002.wikimedia.org [production]
09:52 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host urldownloader1002.wikimedia.org [production]
09:49 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader2002.wikimedia.org [production]
09:48 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host urldownloader2002.wikimedia.org [production]
09:40 <godog> bounce apache2 on logstash1024, stuck on high cpu [production]
09:21 <marostegui@deploy1001> Synchronized wmf-config/etcd.php: Add x2 to the mapping array T269324 (duration: 00m 58s) [production]
09:17 <moritzm> installing samba security updates on stretch [production]
09:15 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Add x2 to the mapping array T269324 (duration: 01m 01s) [production]
09:06 <ema> cp3054: install varnish 6.0.1-1wm2 -- 6.0.1 without https://github.com/varnishcache/varnish-cache/pull/2705 T264398 [production]
08:47 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 100%: After upgrading its kernel', diff saved to https://phabricator.wikimedia.org/P13944 and previous config saved to /var/cache/conftool/dbconfig/20210125-084715-root.json [production]
08:32 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 75%: After upgrading its kernel', diff saved to https://phabricator.wikimedia.org/P13943 and previous config saved to /var/cache/conftool/dbconfig/20210125-083211-root.json [production]
08:17 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 50%: After upgrading its kernel', diff saved to https://phabricator.wikimedia.org/P13942 and previous config saved to /var/cache/conftool/dbconfig/20210125-081708-root.json [production]
08:02 <marostegui@cumin1001> dbctl commit (dc=all): 'db1142 (re)pooling @ 25%: After upgrading its kernel', diff saved to https://phabricator.wikimedia.org/P13941 and previous config saved to /var/cache/conftool/dbconfig/20210125-080204-root.json [production]
07:33 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1142 for kernel upgrade', diff saved to https://phabricator.wikimedia.org/P13940 and previous config saved to /var/cache/conftool/dbconfig/20210125-073322-marostegui.json [production]
06:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Add x2 eqiad to dbctl T269324', diff saved to https://phabricator.wikimedia.org/P13939 and previous config saved to /var/cache/conftool/dbconfig/20210125-064419-marostegui.json [production]
06:43 <marostegui@cumin1001> dbctl commit (dc=all): 'Populate x2 eqiad hosts into dbctl T269324', diff saved to https://phabricator.wikimedia.org/P13938 and previous config saved to /var/cache/conftool/dbconfig/20210125-064305-marostegui.json [production]
2021-01-23 §
22:21 <volker-e@deploy1001> Finished deploy [design/style-guide@63e39e7]: Deploy design/style-guide: 63e39e7 “Components”: Amend button groups states SVG font stack (#427) (duration: 00m 06s) [production]
22:21 <volker-e@deploy1001> Started deploy [design/style-guide@63e39e7]: Deploy design/style-guide: 63e39e7 “Components”: Amend button groups states SVG font stack (#427) [production]
04:05 <ryankemper> Depooled `wdqs1013` (it has ~50 mins of lag to catch up on, and also the bad gateway above) [production]