601-650 of 10000 results (59ms)
2022-09-07 ยง
21:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:01 <TheresNoTime> extending UTC late backport window [production]
20:58 <samtar@deploy1002> samtar and zabe: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:58 <samtar@deploy1002> Started scap: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] [production]
20:56 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] (duration: 05m 54s) [production]
20:56 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:55 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:55 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:51 <samtar@deploy1002> samtar and jdlrobson: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
20:50 <samtar@deploy1002> Started scap: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] [production]
20:49 <samtar@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:830312|Wikidata has a wordmark (T315572)]] (duration: 03m 44s) [production]
20:44 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:44 <samtar@deploy1002> Synchronized static/images/mobile/copyright/wikidata-en.svg: Config: [[gerrit:830312|Wikidata has a wordmark (T315572)]] (duration: 03m 45s) [production]
20:43 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:43 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:42 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:37 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:36 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:36 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:35 <samtar@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:830600|Revert "Enable wgDiscussionToolsEnablePermalinksBackend on all wikis"]] (duration: 03m 42s) [production]
20:21 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830687|Enable wgDiscussionToolsEnablePermalinksBackend on all wikis (T315353)]] (duration: 06m 57s) [production]
20:20 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:18 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:14 <samtar@deploy1002> samtar and matmarex: Backport for [[gerrit:830687|Enable wgDiscussionToolsEnablePermalinksBackend on all wikis (T315353)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:14 <samtar@deploy1002> Started scap: Backport for [[gerrit:830687|Enable wgDiscussionToolsEnablePermalinksBackend on all wikis (T315353)]] [production]
20:12 <mutante> pcc-worker1003 - rm of /srv/jenkins/puppet-compiler/output/36713 and 37153 - /srv is back to 58% usage again [production]
20:10 <mutante> integration.wikimedia.org - clicked to delete builds 36713 and 37153 because they were several GB in size [production]
20:08 <TheresNoTime> running `extensions/WikimediaMaintenance/createExtensionTables.php discussiontools` on mwmaint1002 [production]
20:08 <mutante> puppet compiler out of disk space, (pcc-worker1003): identified build 37153 as huge compared to others in the filesystem, then clicked to delete it via integration.wm.org web UI [production]
19:26 <herron@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-logging-eqiad cluster: Roll restart of jvm daemons. [production]
18:34 <dduvall@deploy1002> Finished deploy [phabricator/deployment@a7616e6]: testing deployment to phab2001 (inactive) (duration: 00m 35s) [production]
18:33 <dduvall@deploy1002> Started deploy [phabricator/deployment@a7616e6]: testing deployment to phab2001 (inactive) [production]
18:26 <herron@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-logging-eqiad cluster: Roll restart of jvm daemons. [production]
18:25 <herron@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-brokers (exit_code=0) for Kafka A:kafka-logging-codfw cluster: Roll restart of jvm daemons. [production]
17:24 <herron@cumin1001> START - Cookbook sre.kafka.roll-restart-brokers for Kafka A:kafka-logging-codfw cluster: Roll restart of jvm daemons. [production]
16:56 <ejegg> restarted fundraising scheduled jobs [production]
16:34 <ejegg> fundraising civicrm upgraded from 2fcd3bb4 to c1f0e041 [production]
16:32 <xcollazo@deploy1002> Finished deploy [airflow-dags/platform_eng@9e4ed94]: Update platform_eng Airflow to latest (duration: 00m 10s) [production]
16:31 <xcollazo@deploy1002> Started deploy [airflow-dags/platform_eng@9e4ed94]: Update platform_eng Airflow to latest [production]
16:31 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) [production]
16:30 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) [production]
16:22 <moritzm> installing twisted security updates on bullseye [production]
16:22 <cparle@deploy1002> Finished deploy [airflow-dags/platform_eng@9e4ed94]: (no justification provided) (duration: 00m 17s) [production]
16:21 <cparle@deploy1002> Started deploy [airflow-dags/platform_eng@9e4ed94]: (no justification provided) [production]
16:16 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.prepare-upgrade (exit_code=0) [production]
16:00 <ejegg> fundraising civicrm upgraded from 5aa1309d to 2fcd3bb4 [production]