2021-10-27
§
|
17:29 |
<otto@deploy1002> |
Finished deploy [analytics/refinery@0d79e18] (thin): Regular analytics weekly train THIN [analytics/refinery@0d79e18] (duration: 00m 07s) |
[production] |
17:29 |
<otto@deploy1002> |
Started deploy [analytics/refinery@0d79e18] (thin): Regular analytics weekly train THIN [analytics/refinery@0d79e18] |
[production] |
16:42 |
<otto@deploy1002> |
Finished deploy [analytics/refinery@0d79e18]: Regular analytics weekly train [analytics/refinery@0d79e18] (duration: 20m 30s) |
[production] |
16:29 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
16:29 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
16:21 |
<otto@deploy1002> |
Started deploy [analytics/refinery@0d79e18]: Regular analytics weekly train [analytics/refinery@0d79e18] |
[production] |
15:36 |
<ejegg> |
updated payments-wiki from 6e810fb401 to 5b9fdd0fe1 |
[production] |
15:28 |
<volans> |
deployed new prefixes for drmrs in modules/network/data/data.yaml - T282787 |
[production] |
15:12 |
<cmooney@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
15:08 |
<cmooney@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
15:07 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
15:03 |
<volans@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
14:56 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
14:51 |
<volans@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
14:00 |
<marostegui> |
Replace m5-master so it points to dbproxy1017 - T288093 |
[production] |
13:58 |
<elukey> |
removed /var/run/confd-template/.inference*.err files from puppetmaster2001 (backup saved in /home/elukey just in case) |
[production] |
10:53 |
<jbond> |
enable puppet fleet wide post gerrit:734937 |
[production] |
10:43 |
<jbond> |
disable puppet fleet wide to deploy a puppetmaster change gerrit:734937 |
[production] |
10:43 |
<jbond> |
disable puppet fleet wide to deploy a puppetmaster change |
[production] |
10:21 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:13 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:11 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.6/extensions/GrowthExperiments/: 305e97a, b9eaa20: GrowthExperiments backports (T293434, T294386) (duration: 01m 04s) |
[production] |
10:10 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/GrowthExperiments/: 305e97a, 667a4be: GrowthExperiments backports (T293434, T294386) (duration: 01m 04s) |
[production] |
10:04 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:02 |
<urbanecm> |
[urbanecm@mwdebug1001 /srv/mediawiki/php]$ mwscript extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki=cswiki --dbshard=s2 --verbose # testing 734752 |
[production] |
10:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:01 |
<urbanecm> |
[urbanecm@mwmaint1002 /srv/mediawiki/php]$ mwscript extensions/GrowthExperiments/maintenance/updateMenteeData.php --wiki=cswiki --dbshard=s2 --verbose # testing 734752 |
[production] |
09:25 |
<godog> |
another run of backfill on graphite1004 - T294355 |
[production] |
09:20 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Remove watchlist replicas from s6 eqiad T263127', diff saved to https://phabricator.wikimedia.org/P17615 and previous config saved to /var/cache/conftool/dbconfig/20211027-092043-marostegui.json |
[production] |
09:09 |
<oblivian@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:04 |
<oblivian@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
08:50 |
<topranks> |
Enabling Telxius circuit from cr1-eqiad to asw1-b12-drmrs with homer. |
[production] |
07:49 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Contributions replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17614 and previous config saved to /var/cache/conftool/dbconfig/20211027-074935-marostegui.json |
[production] |
07:26 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Remove watchlist replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17613 and previous config saved to /var/cache/conftool/dbconfig/20211027-072546-marostegui.json |
[production] |
06:06 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Remove recentchanges and recentchangeslinked replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17612 and previous config saved to /var/cache/conftool/dbconfig/20211027-060634-marostegui.json |
[production] |
05:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Remove logpager replicas from s6.codfw T263127', diff saved to https://phabricator.wikimedia.org/P17611 and previous config saved to /var/cache/conftool/dbconfig/20211027-053104-marostegui.json |
[production] |
2021-10-26
§
|
22:59 |
<legoktm> |
uploaded python-logstash to buster-wikimedia for T294393 |
[production] |
21:29 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcephosd1021.eqiad.wmnet with OS bullseye |
[production] |
21:15 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:13 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host cloudcephosd1021.eqiad.wmnet with OS bullseye |
[production] |
21:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:04 |
<reedy@deploy1002> |
Synchronized php-1.38.0-wmf.5/tests/phpunit/includes/api/query/ApiQueryImageInfoTest.php: T293783 (duration: 01m 02s) |
[production] |
21:03 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:03 |
<reedy@deploy1002> |
Synchronized php-1.38.0-wmf.6/tests/phpunit/includes/api/query/ApiQueryImageInfoTest.php: T293783 (duration: 01m 02s) |
[production] |
21:01 |
<reedy@deploy1002> |
Synchronized php-1.38.0-wmf.6/includes/api/ApiQueryImageInfo.php: T293783 (duration: 01m 03s) |
[production] |
21:00 |
<reedy@deploy1002> |
Synchronized php-1.38.0-wmf.5/includes/api/ApiQueryImageInfo.php: T293783 (duration: 01m 03s) |
[production] |
21:00 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
20:23 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
20:15 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
20:00 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |