2951-3000 of 10000 results (25ms)
2020-05-27 ยง
19:03 <joal@deploy1001> Started deploy [analytics/refinery@8a3dcb3] (thin): Analytics regular weekly train THIN [8a3dcb3] [production]
19:03 <joal@deploy1001> Finished deploy [analytics/refinery@8a3dcb3]: Analytics regular weekly train [8a3dcb3] (duration: 21m 20s) [production]
18:41 <joal@deploy1001> Started deploy [analytics/refinery@8a3dcb3]: Analytics regular weekly train [8a3dcb3] [production]
18:06 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable DiscussionTools as beta on mediawiki.org, part II T251208 (duration: 01m 05s) [production]
17:56 <jayme> updated tiller to 2.16.7-wmf1 for all services in kubernetes cluster: eqiad [production]
17:53 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable DiscussionTools as beta on mediawiki.org T251208 (duration: 01m 05s) [production]
17:42 <gehel@cumin1001> START - Cookbook sre.postgresql.postgres-init [production]
17:40 <gehel> repool maps2003 [production]
17:32 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.34/extensions/Translate/: Deploy https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Translate/+/599027/ to wmf.34 refs T253748 and T253022 (duration: 01m 07s) [production]
16:55 <hnowlan@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
16:53 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
16:52 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
16:26 <hnowlan@deploy1001> Finished deploy [cpjobqueue/deploy@c8c653e]: Disabling ThumbnailRender as a test of k8s cpjobqueue (duration: 01m 57s) [production]
16:24 <hnowlan@deploy1001> Started deploy [cpjobqueue/deploy@c8c653e]: Disabling ThumbnailRender as a test of k8s cpjobqueue [production]
16:10 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
16:09 <hnowlan@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . [production]
16:06 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:52 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Stop defining wmgUsePerformanceInspector, unread T253689 (duration: 01m 04s) [production]
15:52 <gehel@cumin1001> END (PASS) - Cookbook sre.postgresql.postgres-init (exit_code=0) [production]
15:52 <jayme> updated tiller to 2.16.7-wmf1 for all services in kubernetes cluster: codfw [production]
15:49 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Stop loading PerformanceInspector on any wiki T253689 (duration: 01m 06s) [production]
15:18 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . [production]
15:02 <godog> eqiad-prod: decom ms-be101[678] - T252008 [production]
14:58 <jayme> updated tiller to 2.16.7-wmf1 for all services in cluster: staging [production]
14:58 <volans@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
14:56 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:56 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:54 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
14:52 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:51 <cdanis> cumin1001: upgrading python3-conftool and python3-conftool-dbctl [production]
14:50 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:50 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:46 <cdanis> cumin2001: upgrading python3-conftool and python3-conftool-dbctl [production]
14:43 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
14:43 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
14:40 <cdanis> reprepro: upload conftool_1.3.1-1{,+deb10u1} to {stretch,buster}-wikimedia [production]
14:36 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:36 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:32 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:32 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
14:30 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:16 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1146:3312, db1146:3314 and db1103:3312, db1103:3314', diff saved to https://phabricator.wikimedia.org/P11318 and previous config saved to /var/cache/conftool/dbconfig/20200527-141635-marostegui.json [production]
14:13 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
14:13 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
14:07 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
14:07 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
14:04 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
14:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1146:3312, db1146:3314 and db1103:3312, db1103:3314', diff saved to https://phabricator.wikimedia.org/P11317 and previous config saved to /var/cache/conftool/dbconfig/20200527-140442-marostegui.json [production]
14:03 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
14:03 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]