2201-2250 of 10000 results (58ms)
2020-03-11 ยง
23:52 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Enable depicts counter (T244974) (Simon says) (duration: 01m 07s) [production]
23:51 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Enable depicts counter (T244974) (duration: 01m 07s) [production]
23:51 <cdanis@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
23:51 <cdanis@cumin1001> START - Cookbook sre.network.cf [production]
23:42 <mholloway-shell@deploy1001> Synchronized php-1.35.0-wmf.22/extensions/WikimediaEditorTasks: Fix revert counting for non-language-specific counters (duration: 01m 08s) [production]
23:40 <mholloway-shell@deploy1001> Synchronized php-1.35.0-wmf.23/extensions/WikimediaEditorTasks: Fix revert counting for non-language-specific counters (duration: 01m 11s) [production]
23:18 <krinkle@deploy1001> Synchronized multiversion/MWConfigCacheGenerator.php: I91b3a18317af (duration: 01m 08s) [production]
22:39 <volans@cumin2001> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
22:39 <volans@cumin2001> START - Cookbook sre.dns.netbox [production]
22:28 <mutante> depooled mw2167 through mw2172 - rack C3 (T247018) [production]
22:27 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw217[012].codfw.wmnet [production]
22:26 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw216[789].codfw.wmnet [production]
22:16 <James_F> Purged trwiki logos from ATS/Varnish for T247445 [production]
22:15 <jforrester@deploy1001> Synchronized static/images/project-logos/: [trwiki] Restore pre-unblocking celebration logo versions T247445 (duration: 01m 09s) [production]
21:42 <ebernhardson> stop all mjolnir-kafka-bulk-daemons in eqiad except 1 to assist debugging [production]
21:33 <ebernhardson@deploy1001> Finished deploy [search/mjolnir/deploy@2726268]: Downgrade kafka_python to 1.4.3 (duration: 05m 45s) [production]
21:27 <ebernhardson@deploy1001> Started deploy [search/mjolnir/deploy@2726268]: Downgrade kafka_python to 1.4.3 [production]
20:53 <cdanis@cumin2001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
20:52 <cdanis@cumin2001> START - Cookbook sre.hosts.decommission [production]
20:26 <brennen@deploy1001> Synchronized php: group1 wikis to 1.35.0-wmf.23 (duration: 01m 03s) [production]
20:25 <brennen@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.23 [production]
20:09 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:06 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
20:03 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:00 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:53 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
18:36 <ejegg> updated payments-wiki from 03765b53de to 86ce0361f9 [production]
18:36 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:33 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:25 <volans> temporary disabled puppet on A:dns-auth to deploy g/578506 T233183 [production]
18:24 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Touch and secondary sync of IS for cache-busting (duration: 01m 07s) [production]
18:22 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Stop setting wmgParsoidVariant, no longer read T229015 (duration: 01m 07s) [production]
18:21 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Stop using wmgParsoidVariant, no longer varied T229015 (duration: 01m 08s) [production]
17:53 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventstreams' for release 'canary' . [production]
16:53 <moritzm> removed cas-2020-03-09.log and cas-2020-03-10.log on idp2001 (huge logs due to some debug log level for tracking down a performance issue) [production]
16:36 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
16:25 <liw> restarting Zuul to clear queues (in collab with James F) [production]
14:49 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
14:41 <volans> installed spicerack to 0.0.32-1 on cumin[12]001 [production]
14:25 <akosiaris@deploy1001> Synchronized wmf-config/ProductionServices.php: (no justification provided) (duration: 01m 11s) [production]
14:24 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
14:23 <akosiaris@deploy1001> sync aborted: wmf-config/ProductionServices.php (duration: 02m 42s) [production]
14:22 <volans> uploaded spicerack_0.0.32-1_amd64.deb to apt.wikimedia.org stretch-wikimedia [production]
14:21 <akosiaris> switch mediawiki to talk to eventgate-analytics via envoy [production]
14:21 <akosiaris@deploy1001> Started scap: wmf-config/ProductionServices.php [production]
14:20 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:18 <cmjohnson@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:09 <akosiaris> T239779 upload apertium-swe-nor_0.3.1-1+wmf1 to apt.wikimedia.org jessie-wikimedia/main [production]
14:08 <akosiaris> T239779 upload apertium-swe-dan_0.8.1-1+wmf1 to apt.wikimedia.org jessie-wikimedia/main [production]
14:08 <akosiaris> T239779 upload apertium-nno-nob_1.3.0-1+wmf1 to apt.wikimedia.org jessie-wikimedia/main [production]