4551-4600 of 10000 results (41ms)
2021-10-27 §
17:34 <otto@deploy1002> Started deploy [analytics/refinery@0d79e18] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@0d79e18] [production]
17:29 <otto@deploy1002> Finished deploy [analytics/refinery@0d79e18] (thin): Regular analytics weekly train THIN [analytics/refinery@0d79e18] (duration: 00m 07s) [production]
17:29 <otto@deploy1002> Started deploy [analytics/refinery@0d79e18] (thin): Regular analytics weekly train THIN [analytics/refinery@0d79e18] [production]
16:42 <otto@deploy1002> Finished deploy [analytics/refinery@0d79e18]: Regular analytics weekly train [analytics/refinery@0d79e18] (duration: 20m 30s) [production]
16:29 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
16:29 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:21 <otto@deploy1002> Started deploy [analytics/refinery@0d79e18]: Regular analytics weekly train [analytics/refinery@0d79e18] [production]
15:36 <ejegg> updated payments-wiki from 6e810fb401 to 5b9fdd0fe1 [production]
15:28 <volans> deployed new prefixes for drmrs in modules/network/data/data.yaml - T282787 [production]
15:12 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:08 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
15:07 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:03 <volans@cumin2002> START - Cookbook sre.dns.netbox [production]
14:56 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:51 <volans@cumin2002> START - Cookbook sre.dns.netbox [production]
14:00 <marostegui> Replace m5-master so it points to dbproxy1017 - T288093 [production]
13:58 <elukey> removed /var/run/confd-template/.inference*.err files from puppetmaster2001 (backup saved in /home/elukey just in case) [production]
10:53 <jbond> enable puppet fleet wide post gerrit:734937 [production]
10:43 <jbond> disable puppet fleet wide to deploy a puppetmaster change gerrit:734937 [production]
10:43 <jbond> disable puppet fleet wide to deploy a puppetmaster change [production]
10:21 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:11 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.6/extensions/GrowthExperiments/: 305e97a, b9eaa20: GrowthExperiments backports (T293434, T294386) (duration: 01m 04s) [production]
10:10 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.5/extensions/GrowthExperiments/: 305e97a, 667a4be: GrowthExperiments backports (T293434, T294386) (duration: 01m 04s) [production]
10:04 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:02 <urbanecm> [urbanecm@mwdebug1001 /srv/mediawiki/php]$ mwscript extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki=cswiki --dbshard=s2 --verbose # testing 734752 [production]
10:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:01 <urbanecm> [urbanecm@mwmaint1002 /srv/mediawiki/php]$ mwscript extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki=cswiki --dbshard=s2 --verbose # testing 734752 [production]
09:25 <godog> another run of backfill on graphite1004 - T294355 [production]
09:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove watchlist replicas from s6 eqiad T263127', diff saved to https://phabricator.wikimedia.org/P17615 and previous config saved to /var/cache/conftool/dbconfig/20211027-092043-marostegui.json [production]
09:09 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:04 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:50 <topranks> Enabling Telxius circuit from cr1-eqiad to asw1-b12-drmrs with homer. [production]
07:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Contributions replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17614 and previous config saved to /var/cache/conftool/dbconfig/20211027-074935-marostegui.json [production]
07:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove watchlist replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17613 and previous config saved to /var/cache/conftool/dbconfig/20211027-072546-marostegui.json [production]
06:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove recentchanges and recentchangeslinked replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17612 and previous config saved to /var/cache/conftool/dbconfig/20211027-060634-marostegui.json [production]
05:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove logpager replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17611 and previous config saved to /var/cache/conftool/dbconfig/20211027-053104-marostegui.json [production]
2021-10-26 §
22:59 <legoktm> uploaded python-logstash to buster-wikimedia for T294393 [production]
21:29 <cmjohnson@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcephosd1021.eqiad.wmnet with OS bullseye [production]
21:15 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:13 <cmjohnson@cumin1001> START - Cookbook sre.hosts.reimage for host cloudcephosd1021.eqiad.wmnet with OS bullseye [production]
21:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:04 <reedy@deploy1002> Synchronized php-1.38.0-wmf.5/tests/phpunit/includes/api/query/ApiQueryImageInfoTest.php: T293783 (duration: 01m 02s) [production]
21:03 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:03 <reedy@deploy1002> Synchronized php-1.38.0-wmf.6/tests/phpunit/includes/api/query/ApiQueryImageInfoTest.php: T293783 (duration: 01m 02s) [production]
21:01 <reedy@deploy1002> Synchronized php-1.38.0-wmf.6/includes/api/ApiQueryImageInfo.php: T293783 (duration: 01m 03s) [production]
21:00 <reedy@deploy1002> Synchronized php-1.38.0-wmf.5/includes/api/ApiQueryImageInfo.php: T293783 (duration: 01m 03s) [production]
21:00 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:23 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
20:15 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]