551-600 of 10000 results (67ms)
2022-09-15 ยง
20:25 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:832526|Increase coverage of Research Incentive Survey on idwiki (T316466)]] (duration: 07m 06s) [production]
20:18 <thcipriani@deploy1002> thcipriani and dani: Backport for [[gerrit:832526|Increase coverage of Research Incentive Survey on idwiki (T316466)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
20:18 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:832526|Increase coverage of Research Incentive Survey on idwiki (T316466)]] [production]
20:15 <thcipriani@deploy1002> Finished scap: Backport for [[gerrit:832323|Revert "cirrus: Handle transition to elasticsearch 7.10" (T308676)]] (duration: 07m 39s) [production]
20:08 <thcipriani@deploy1002> thcipriani and dcausse: Backport for [[gerrit:832323|Revert "cirrus: Handle transition to elasticsearch 7.10" (T308676)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
20:07 <thcipriani@deploy1002> Started scap: Backport for [[gerrit:832323|Revert "cirrus: Handle transition to elasticsearch 7.10" (T308676)]] [production]
19:26 <ebernhardson> pool'd wdqs2001, some blockers before reload can start T316236 [production]
18:45 <dancy@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.40.0-wmf.1 refs T314190 [production]
18:39 <dancy@deploy1002> Finished scap: Backport for [[gerrit:832547|Use more permissive match for TOC_PLACEHOLDER in parser output (T317857)]] (duration: 09m 53s) [production]
18:38 <cwhite> restart thanos-compact (thanos-fe2001) and swift_ring_manager (thanos-fe1001) [production]
18:29 <dancy@deploy1002> dancy and cscott: Backport for [[gerrit:832547|Use more permissive match for TOC_PLACEHOLDER in parser output (T317857)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
18:29 <dancy@deploy1002> Started scap: Backport for [[gerrit:832547|Use more permissive match for TOC_PLACEHOLDER in parser output (T317857)]] [production]
18:17 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe2003.codfw.wmnet on all recursors [production]
18:17 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe2003.codfw.wmnet on all recursors [production]
18:17 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe2002.codfw.wmnet on all recursors [production]
18:17 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe2002.codfw.wmnet on all recursors [production]
18:17 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe2001.codfw.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe2001.codfw.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe1003.eqiad.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe1003.eqiad.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe1002.eqiad.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe1002.eqiad.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe1001.eqiad.wmnet on all recursors [production]
18:16 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe1001.eqiad.wmnet on all recursors [production]
18:15 <ebernhardson> depool wcqs2001 for T316236 [production]
18:15 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:13 <cwhite@cumin2002> START - Cookbook sre.dns.netbox [production]
18:07 <godog> restart envoyproxy on thanos-fe* [production]
18:06 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) thanos-fe2002.codfw.wmnet on all recursors [production]
18:06 <cwhite@cumin2002> START - Cookbook sre.dns.wipe-cache thanos-fe2002.codfw.wmnet on all recursors [production]
17:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
17:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
16:17 <andrew@cumin1001> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging BryanDavis out of all services on: 2047 hosts [production]
16:16 <andrew@cumin1001> START - Cookbook sre.idm.logout Logging BryanDavis out of all services on: 2047 hosts [production]
15:39 <cwhite@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:37 <cwhite@cumin2002> START - Cookbook sre.dns.netbox [production]
15:28 <hnowlan@puppetmaster1001> conftool action : set/pooled=true; selector: dnsdisc=sessionstore,name=eqiad [production]
15:27 <hnowlan@deploy1002> helmfile [eqiad] DONE helmfile.d/services/sessionstore: sync [production]
15:27 <hnowlan@deploy1002> helmfile [eqiad] START helmfile.d/services/sessionstore: sync [production]
15:22 <hnowlan> starting cassandra on sessionstore1001-a [production]
15:18 <hnowlan@puppetmaster1001> conftool action : set/pooled=false; selector: dnsdisc=sessionstore,name=eqiad [production]
15:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1190 (T314041)', diff saved to https://phabricator.wikimedia.org/P34792 and previous config saved to /var/cache/conftool/dbconfig/20220915-151131-ladsgroup.json [production]
14:56 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1190', diff saved to https://phabricator.wikimedia.org/P34791 and previous config saved to /var/cache/conftool/dbconfig/20220915-145625-ladsgroup.json [production]
14:41 <moritzm> installing libtirpc security updates [production]
14:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1190', diff saved to https://phabricator.wikimedia.org/P34790 and previous config saved to /var/cache/conftool/dbconfig/20220915-144118-ladsgroup.json [production]
14:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1190 (T314041)', diff saved to https://phabricator.wikimedia.org/P34789 and previous config saved to /var/cache/conftool/dbconfig/20220915-142612-ladsgroup.json [production]
14:01 <sukhe> retarting bird.service on A:dns-auth for zlib update [production]
14:00 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 6b9784a0708cf1e7762034ccfba7e5604b2f6dc2: Enable the Vue version of the mentee overview in pilot wikis (T300532) (duration: 03m 45s) [production]
13:58 <aqu@deploy1002> Finished deploy [airflow-dags/analytics@b9be20d]: Regular analytics weekly train [airflow-dags@b9be20d] (duration: 00m 09s) [production]
13:58 <aqu@deploy1002> Started deploy [airflow-dags/analytics@b9be20d]: Regular analytics weekly train [airflow-dags@b9be20d] [production]