5101-5150 of 10000 results (51ms)
2020-08-07 §
06:51 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
06:34 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1092 for upgrade', diff saved to https://phabricator.wikimedia.org/P12191 and previous config saved to /var/cache/conftool/dbconfig/20200807-063431-marostegui.json [production]
2020-08-06 §
23:21 <catrope@deploy1001> Synchronized php-1.36.0-wmf.3/extensions/GrowthExperiments/: Fixes for WelcomeSurvey language question (T232410) (duration: 00m 59s) [production]
23:04 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Change GrowthExperiments mentor list on fawiki (T253291) (duration: 00m 59s) [production]
21:43 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:41 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:40 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:39 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
21:39 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
21:35 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
21:33 <brennen@deploy1001> Synchronized php-1.36.0-wmf.3/vendor: [[gerrit:618850|Update git submodules (vendor)]] (T259832) (duration: 01m 08s) [production]
21:32 <mholloway-shell@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
20:51 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
20:51 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
20:47 <shdubsh> restart logstash -- pipeline appears stuck [production]
20:38 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
20:38 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
20:19 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
20:19 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
20:19 <brennen> manually updating the vendor submodule on 1.36.0 for T259832 [production]
20:15 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
20:15 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
19:48 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
19:47 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
19:45 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - wgEventStreams - fix another typo in eventgate stream config - T251935 (duration: 00m 58s) [production]
19:40 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - wgEventStreams - fix typo in eventgate stream config - T251935 (duration: 00m 59s) [production]
19:26 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
19:26 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
19:04 <brennen@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.3 [production]
18:58 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
18:57 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
18:29 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
18:29 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
18:21 <Urbanecm> Morning B&C window was completed [production]
18:20 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.3/extensions/GrowthExperiments/modules/: fb4a80830d7d915479e097cc82c681c5fb03d51b: Fix "Ask mentor" help panel button styling (T250235) (duration: 01m 07s) [production]
18:11 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
18:11 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
18:10 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 9db96595695b5ec1144c078e8961b3c04e8983cf: Remove temporary logging for mediamoderation (T259742) (duration: 01m 07s) [production]
18:07 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 9695811a30de30471a81b6ad05aa5e625f52caf1: : Enable DiscussionTools as a beta feature on 8 more wikis ("phase 1") (T259574) (duration: 01m 06s) [production]
17:42 <brennen@deploy1001> Synchronized php: group1 wikis to 1.36.0-wmf.3 (duration: 01m 06s) [production]
17:41 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.36.0-wmf.3 [production]
17:37 <brennen> train 1.36.0-wmf.3: proceeding to group1 [production]
17:36 <brennen@deploy1001> Synchronized php-1.36.0-wmf.3/extensions/WikibaseMediaInfo/src/View/MediaInfoEntityTermsView.php: Backport: [[gerrit:618582|Fix array unpacking as argument list]] (T259745) (duration: 01m 07s) [production]
16:32 <chrisalbon@deploy1001> Finished deploy [ores/deploy@f3c44be]: T258435 (duration: 14m 12s) [production]
16:18 <dpifke@deploy1001> Finished deploy [performance/arc-lamp@7838c88]: Deploying fixes for T259167 (duration: 00m 05s) [production]
16:18 <dpifke@deploy1001> Started deploy [performance/arc-lamp@7838c88]: Deploying fixes for T259167 [production]
16:18 <chrisalbon@deploy1001> Started deploy [ores/deploy@f3c44be]: T258435 [production]
15:40 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'canary' . [production]
15:40 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . [production]
15:10 <fdans@deploy1001> Finished deploy [analytics/refinery@97a02a3]: Regular analytics weekly train [analytics/refinery@97a02a3 (duration: 20m 01s) [production]