751-800 of 10000 results (63ms)
2020-03-19 §
12:33 <XioNoX> push frack fw policies T248004 [production]
11:43 <Lucas_WMDE> EU SWAT done [production]
11:40 <lucaswerkmeister-wmde@deploy1001> Synchronized php-1.35.0-wmf.24/includes/OutputPage.php: SWAT: [[gerrit:581245|OutputPage: Fix warning when setting wgUserNewMsgRevisionId (T248049)]] (duration: 01m 08s) [production]
11:15 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: e277d29: trwiki: Grant interface editors editprotected & editsemiprotected (T247672; take II) (duration: 01m 08s) [production]
11:13 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: e277d29: trwiki: Grant interface editors editprotected & editsemiprotected (T247672) (duration: 01m 07s) [production]
10:47 <ema> upload atskafka 0.4 to buster-wikimedia T237993 [production]
10:24 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.24/skins/Vector/skin.json: [[gerrit:581248|skins.vector.styles.legacy needs to define legacy feature (T247566)]] (duration: 01m 08s) [production]
10:01 <ema> cp: rolling ats-tls-restart to apply log format changes T248067 T237993 [production]
09:26 <marostegui> m2 maintenance window done T246098 [production]
09:03 <akosiaris> restart gerrit on gerrit1001 T246098 [production]
09:02 <akosiaris> restart otrs-daemon, apache on mendelevium T246098 [production]
09:01 <akosiaris> restart recommendation-api on scb T246098 [production]
09:00 <marostegui> Restart m2 primary database master - T246098 [production]
08:48 <dcausse> depooling wdqs1006 to help catching up lag [production]
08:43 <dcausse> restarting blazegraph on wdqs1006 (T242453) [production]
07:54 <moritzm> installing cups updates from Stretch point release [production]
07:48 <moritzm> installing libjaxen-java security updates from Stretch point release [production]
07:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Update pc1008 spare situation T247787 (duration: 01m 09s) [production]
06:49 <elukey> execute 'sudo rm /etc/logrotate.d/ceph-common' on cloudvirt-dev and cloudcontrol-dev to stop daily cronspam [production]
06:46 <marostegui> Deploy schema change on testcommonswiki.globalimagelinks (empty table) on the s4 master T243987 [production]
06:33 <marostegui> Upgrade db1132 without restarting T246098 [production]
00:39 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: group0 wikiws to 1.35.0-wmf.24 refs T233872 [production]
00:31 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.24/skins/Vector/includes/templates/index.mustache: deploy https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/581116 which reverts https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/581054 refs T248010 (duration: 01m 07s) [production]
00:18 <eileen> civicrm revision changed from a1b2cbeac1 to 1c477ff07f, config revision is 37232d8460 [production]
2020-03-18 §
23:31 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.23/includes/TemplateParser.php: sync https://gerrit.wikimedia.org/r/c/mediawiki/core/+/581114/ refs T248010 (duration: 01m 07s) [production]
23:26 <twentyafterfour@deploy1001> Synchronized php-1.35.0-wmf.24/includes/TemplateParser.php: sync https://gerrit.wikimedia.org/r/c/mediawiki/core/+/581115/ (duration: 01m 08s) [production]
22:22 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
22:18 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
21:56 <Krinkle> krinkle@mw1385: scap pull # clean up AdHoc debugging for T248010 [production]
21:16 <brennen@deploy1001> Synchronized php-1.35.0-wmf.24/skins/Vector/includes/templates/index.mustache: [[gerrit:581054|Change master template to force cache invalidation of partials]] (duration: 01m 06s) [production]
21:11 <brennen@deploy1001> Synchronized php-1.35.0-wmf.23/skins/Vector/includes/templates/index.mustache: [[gerrit:581054|Change master template to force cache invalidation of partials]] (duration: 01m 15s) [production]
20:04 <volans@cumin1001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
19:58 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
19:49 <hashar@deploy1001> rebuilt and synchronized wikiversions files: Ensure fleet wide consistency [production]
19:21 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
19:21 <mutante> shutting down (decom cookbook) elnath.codfw.wmnet (T188544) [production]
19:20 <dzahn@cumin1001> START - Cookbook sre.hosts.decommission [production]
19:15 <fdans@deploy1001> Finished deploy [analytics/refinery@549f6a4]: deploying analytics refinery (duration: 15m 02s) [production]
19:11 <hashar> 1.35.0-wmf.24 is on hold: too many blockers [production]
19:00 <fdans@deploy1001> Started deploy [analytics/refinery@549f6a4]: deploying analytics refinery [production]
18:32 <Lucas_WMDE> Morning SWAT done [production]
18:30 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
18:27 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:579018|Update linter whitelist w/ parsoid11's IP address (T246833)]] (beta-only) (duration: 01m 04s) [production]
18:20 <Lucas_WMDE> scap pull on mwdebug1001, attempting to fix mismatched wikiversions alert [production]
18:14 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:580373|Add beta configuration for Wikibase reference formatting (T247416)]] (duration: 01m 08s) [production]
18:13 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
18:13 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:580373|Add beta configuration for Wikibase reference formatting (T247416)]], take II (duration: 01m 07s) [production]
18:11 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
18:11 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/Wikibase.php: SWAT: [[gerrit:580373|Add beta configuration for Wikibase reference formatting (T247416)]] (duration: 01m 07s) [production]
16:43 <mutante> wtp1025 - Icinga alerted it's running out of disk - 'apt-get clean' lowered disk usage from 97% to 91% [production]