101-150 of 10000 results (68ms)
2020-02-07 §
03:40 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
01:27 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
01:25 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
01:24 <robh> eqsin pdu work ongoing starting now. ps1-603 swapping per T242250 [production]
00:13 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
00:11 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
00:09 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
00:08 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
2020-02-06 §
23:44 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:42 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
23:37 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:35 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
23:25 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T244133 [cswikisource] Enable VisualEditor in the Edice namespace (duration: 01m 07s) [production]
23:22 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T159711 T161365 T164435 [nlwiki] Enable VisualEditor in the Project namespace (duration: 01m 08s) [production]
23:21 <pt1979@cumin2001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
23:19 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
23:15 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
23:13 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
23:10 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T244405 Don't trying to assign to if it's unset (duration: 01m 07s) [production]
22:50 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.18/extensions/VisualEditor: T242184 Change tags method so anon edits will go through (duration: 01m 08s) [production]
22:42 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:40 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:39 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
22:38 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
22:18 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
22:15 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
22:13 <mutante> turning mw2271 and mw2163 into canary appservers for codfw, this adds mediawiki-testers shell users and removes scap sql scripts, rest stays as is (T242606) [production]
21:54 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:52 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
21:40 <twentyafterfour> train blocked due to serious incident related to deploying the latest branch. Incident documentation: https://wikitech.wikimedia.org/wiki/Incident_documentation/20200206-mediawiki refs T233866 [production]
21:30 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:27 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
21:05 <pt1979@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
21:03 <pt1979@cumin2001> START - Cookbook sre.hosts.downtime [production]
20:52 <akosiaris> restart all wikifeeds pods [production]
20:48 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
20:45 <akosiaris> restart restbase on restbase1027 [production]
20:32 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: (no justification provided) [production]
20:30 <twentyafterfour> sync-wikiversions --force [production]
20:30 <twentyafterfour@deploy1001> Scap failed!: 9/11 canaries failed their endpoint checks(http://en.wikipedia.org) [production]
20:25 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.18 refs T233866 [production]
19:45 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T244405 Set wgLogoHD before adding wordmark (duration: 01m 06s) [production]
19:36 <bblack> re-pool cp1075 (eqiad text) [production]
19:33 <addshore> SWAT done! [production]
19:32 <addshore@deploy1001> Synchronized php-1.35.0-wmf.18/extensions/WikibaseLexemeCirrusSearch: T244479 Update namespace for PrefetchingTermLookup & fix tests (duration: 01m 06s) [production]
19:31 <bblack> depool cp1075 (eqiad text) for minor experimentation [production]
19:29 <addshore@deploy1001> Synchronized php-1.35.0-wmf.16/extensions/Babel/includes/Babel.php: T243713 Timeout for meta api call from 10 to 2 seconds. (duration: 01m 07s) [production]
19:28 <addshore@deploy1001> Synchronized php-1.35.0-wmf.18/extensions/Babel/includes/Babel.php: T243713 Timeout for meta api call from 10 to 2 seconds. (duration: 01m 07s) [production]
19:25 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Fix incorrect spellings of "RESTBase" in config variables (2/2) 2.IS (duration: 01m 06s) [production]
19:23 <addshore@deploy1001> Synchronized wmf-config/CommonSettings.php: Fix incorrect spellings of "RESTBase" in config variables (2/2) 1.CS (duration: 01m 07s) [production]