2901-2950 of 10000 results (80ms)
2022-05-09 §
08:43 <hashar@deploy1002> Started deploy [gerrit/gerrit@94c5028]: Update Zuul plugin - T307621 [production]
08:42 <hashar> Restarting Gerrit on replica gerrit2001.wikimedia.org to update the Zuul plugin # T307621 [production]
08:41 <hashar@deploy1002> Finished deploy [gerrit/gerrit@94c5028]: Update Zuul plugin - T307621 (duration: 00m 09s) [production]
08:41 <hashar@deploy1002> Started deploy [gerrit/gerrit@94c5028]: Update Zuul plugin - T307621 [production]
08:41 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM prometheus5001.eqsin.wmnet [production]
08:41 <ladsgroup@cumin1001> conftool action : set/pooled=no; selector: name=elastic2033.codfw.wmnet [production]
08:40 <ladsgroup@cumin1001> conftool action : set/pooled=no; selector: name=ores2002.codfw.wmnet [production]
08:40 <ladsgroup@cumin1001> conftool action : set/pooled=no; selector: name=mw2412.codfw.wmnet [production]
08:30 <dcausse> restarting blazegraph on wdqs1004 (BlazegraphFreeAllocatorsDecreasingRapidly) [production]
08:26 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM prometheus4001.ulsfo.wmnet [production]
08:22 <Amir1> restarting confd on puppetmaster100[12] [production]
08:21 <jmm@cumin2002> START - Cookbook sre.ganeti.reboot-vm for VM prometheus4001.ulsfo.wmnet [production]
08:09 <godog> temp stop tegola-swift-container delete - T307184 [production]
08:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27765 and previous config saved to /var/cache/conftool/dbconfig/20220509-080521-marostegui.json [production]
08:03 <ladsgroup@cumin1001> conftool action : set/pooled=inactive; selector: name=mw1415.eqiad.wmnet [production]
08:02 <ladsgroup@cumin1001> conftool action : set/pooled=no; selector: name=mw1415.eqiad.wmnet [production]
07:51 <oblivian@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=codfw [production]
07:50 <oblivian@puppetmaster1001> conftool action : set/pooled=yes; selector: cluster=api-appserver,dc=codfw [production]
07:37 <kartik@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790016|Fix display issue of Timeline in cdo, gan, hak, wuu, yue and zh_classical (T188997)]] (duration: 05m 13s) [production]
07:32 <marostegui@cumin1001> dbctl commit (dc=all): 'Increase traffic on db1172 to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27764 and previous config saved to /var/cache/conftool/dbconfig/20220509-073200-marostegui.json [production]
07:31 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:30 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:30 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:20 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
07:16 <elukey@deploy1002> helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
07:04 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1172 with minimal weight to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27763 and previous config saved to /var/cache/conftool/dbconfig/20220509-070430-marostegui.json [production]
06:23 <Amir1> start of updateRestrictions.php on s5 (T218446) [production]
05:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1172 with minimal weight to test 10.6 T307546', diff saved to https://phabricator.wikimedia.org/P27762 and previous config saved to /var/cache/conftool/dbconfig/20220509-054823-marostegui.json [production]
05:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1172', diff saved to https://phabricator.wikimedia.org/P27761 and previous config saved to /var/cache/conftool/dbconfig/20220509-051426-marostegui.json [production]
05:11 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
05:10 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
05:10 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
05:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:56 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
04:53 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: Revert: [[gerrit:790021|Set arwiki to read new in templatelinks migration (T306673)]] (duration: 05m 03s) [production]
04:52 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
04:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
04:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:47 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: (no justification provided) (duration: 05m 04s) [production]
04:40 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790020|Stop writing to rev_actor_temp table in group1 (T275246)]] (duration: 05m 06s) [production]
04:38 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
04:37 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
04:37 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
04:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
04:31 <ladsgroup@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:790021|Set arwiki to read new in templatelinks migration (T306673)]] (duration: 05m 10s) [production]
2022-05-08 §
07:16 <godog> silence probedown for thumbor:8800 until monday [production]
2022-05-07 §
21:29 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 04m 04s) [production]
21:25 <andrew@deploy1002> Started deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 [production]
21:11 <andrew@deploy1002> Finished deploy [horizon/deploy@9d02cd6]: seeking consistency between codfw1dev and eqiad1 (duration: 05m 51s) [production]