201-250 of 10000 results (50ms)
2022-08-08 §
12:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
12:56 <urbanecm@deploy1002> Synchronized wmf-config/CommonSettings.php: 77fd5abdd7d9462869259e1511bbcf2d7ce62246: Growth: Add new rights to wgAvailableRights (duration: 03m 24s) [production]
12:30 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1102.eqiad.wmnet [production]
12:09 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
12:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
12:06 <urbanecm@deploy1002> Synchronized php-1.39.0-wmf.23/extensions/GrowthExperiments/: 3eaf155678b7313c55dcca0cd39ab29f73eead37: MentorTools: Do not use MentorWeightManager (T314362) (duration: 03m 31s) [production]
12:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
11:43 <btullis@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-worker1102.eqiad.wmnet [production]
11:21 <jelto@cumin1001> conftool action : set/pooled=yes; selector: name=kubernetes2022.codfw.wmnet [production]
11:21 <jelto> kubectl uncordon kubernetes2022.codfw.wmnet [production]
10:43 <Amir1> Removing db2079 from orchestrator (T313885) [production]
10:39 <Amir1> Removing db2079 from zarcillo (T313885) [production]
10:35 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2079.codfw.wmnet [production]
10:35 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:30 <ladsgroup@cumin1001> START - Cookbook sre.dns.netbox [production]
10:25 <ladsgroup@cumin1001> START - Cookbook sre.hosts.decommission for hosts db2079.codfw.wmnet [production]
10:18 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 12:00:00 on db2079.codfw.wmnet with reason: Decom [production]
10:17 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 2 days, 12:00:00 on db2079.codfw.wmnet with reason: Decom [production]
08:41 <jbond> deploy libtirpc update [production]
07:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1144:3314 (T312863)', diff saved to https://phabricator.wikimedia.org/P32310 and previous config saved to /var/cache/conftool/dbconfig/20220808-075723-ladsgroup.json [production]
07:57 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1144.eqiad.wmnet with reason: Maintenance [production]
07:57 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1144.eqiad.wmnet with reason: Maintenance [production]
07:57 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142 (T312863)', diff saved to https://phabricator.wikimedia.org/P32309 and previous config saved to /var/cache/conftool/dbconfig/20220808-075702-ladsgroup.json [production]
07:53 <godog> grow sda/sdb 3 by 100G on thanos-be2001 - T314275 [production]
07:50 <godog> grow sda/sdb 3 by 100G on thanos-be1004 - T314275 [production]
07:41 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142', diff saved to https://phabricator.wikimedia.org/P32308 and previous config saved to /var/cache/conftool/dbconfig/20220808-074156-ladsgroup.json [production]
07:32 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:27 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:26 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142', diff saved to https://phabricator.wikimedia.org/P32307 and previous config saved to /var/cache/conftool/dbconfig/20220808-072650-ladsgroup.json [production]
07:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:22 <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:820815|trwikivoyage: Create rollbacker user group (T314678)]] (duration: 03m 17s) [production]
07:18 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:17 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:17 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:11 <elukey> restart rsyslog on ml-serve2007 [production]
07:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:11 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1142 (T312863)', diff saved to https://phabricator.wikimedia.org/P32306 and previous config saved to /var/cache/conftool/dbconfig/20220808-071144-ladsgroup.json [production]
07:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:09 <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:820261|Enable SectionTranslation on 10 Wikipedias where ContentTranslation is default (T308829)]] (duration: 03m 15s) [production]
07:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:06 <XioNoX> add CSP headers to Netbox - T296356 [production]
07:05 <elukey> restart rsyslog on ml-serve-ctrl2001 [production]
2022-08-07 §
19:58 <taavi> taavi@mwmaint1002 ~ $ echo "https://upload.wikimedia.org/wikipedia/commons/1/15/Keep_tidy_ask.svg" | mwscript purgeList.php --wiki enwiki # T314712 [production]
13:52 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Depooling db1142 (T312863)', diff saved to https://phabricator.wikimedia.org/P32305 and previous config saved to /var/cache/conftool/dbconfig/20220807-135204-ladsgroup.json [production]
13:51 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1142.eqiad.wmnet with reason: Maintenance [production]
13:51 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1142.eqiad.wmnet with reason: Maintenance [production]
13:51 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1141 (T312863)', diff saved to https://phabricator.wikimedia.org/P32304 and previous config saved to /var/cache/conftool/dbconfig/20220807-135143-ladsgroup.json [production]