401-450 of 10000 results (67ms)
2022-09-08 §
05:49 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Pooling back db2140', diff saved to https://phabricator.wikimedia.org/P34130 and previous config saved to /var/cache/conftool/dbconfig/20220908-054921-ladsgroup.json [production]
05:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Add db1202 to s7, depooled, T316342', diff saved to https://phabricator.wikimedia.org/P34129 and previous config saved to /var/cache/conftool/dbconfig/20220908-054429-marostegui.json [production]
05:10 <ladsgroup@cumin1001> dbctl commit (dc=all): 'Set db1123 with weight 0 T316622', diff saved to https://phabricator.wikimedia.org/P34128 and previous config saved to /var/cache/conftool/dbconfig/20220908-051043-ladsgroup.json [production]
05:10 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 23 hosts with reason: Primary switchover s3 T316622 [production]
05:09 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on 23 hosts with reason: Primary switchover s3 T316622 [production]
02:04 <pt1979@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host kafka-logging1005: [production]
02:04 <pt1979@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host kafka-logging1005: [production]
02:02 <pt1979@cumin1001> END (ERROR) - Cookbook sre.network.configure-switch-interfaces (exit_code=97) for host db2169 [production]
02:02 <pt1979@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host db2169 [production]
02:01 <pt1979@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
01:59 <pt1979@cumin1001> START - Cookbook sre.dns.netbox [production]
01:56 <ejegg> re-enabled recurring charge job [production]
01:48 <ejegg> updated fundraising civicrm from c1f0e041 to efbbcb57 [production]
01:26 <ejegg> disabled recurring charge job [production]
00:33 <ejegg> updated standalone Smashpig from 11ba0a1b to 88e5e9bb [production]
2022-09-07 §
22:12 <bd808> Attempting to migrate all remaining Striker managed git repos from Diffusion to GitLab (T315706) [production]
21:27 <TheresNoTime> closing UTC late backport window, +27m [production]
21:26 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830602|Respect skin's TOC option (T316947)]] (duration: 08m 02s) [production]
21:25 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:24 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:24 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:23 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:19 <samtar@deploy1002> samtar and jdlrobson: Backport for [[gerrit:830602|Respect skin's TOC option (T316947)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
21:18 <samtar@deploy1002> Started scap: Backport for [[gerrit:830602|Respect skin's TOC option (T316947)]] [production]
21:14 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830601|Respect skin's TOC option (T316947)]] (duration: 07m 06s) [production]
21:13 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:12 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:07 <samtar@deploy1002> samtar and jdlrobson: Backport for [[gerrit:830601|Respect skin's TOC option (T316947)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
21:07 <samtar@deploy1002> Started scap: Backport for [[gerrit:830601|Respect skin's TOC option (T316947)]] [production]
21:06 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
21:02 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] (duration: 04m 36s) [production]
21:02 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
21:02 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
21:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
21:01 <TheresNoTime> extending UTC late backport window [production]
20:58 <samtar@deploy1002> samtar and zabe: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:58 <samtar@deploy1002> Started scap: Backport for [[gerrit:830641|beta: Remove deployment-parsoid11 from wgLinterSubmitterWhitelist]] [production]
20:56 <samtar@deploy1002> Finished scap: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] (duration: 05m 54s) [production]
20:56 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:55 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
20:55 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
20:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
20:51 <samtar@deploy1002> samtar and jdlrobson: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
20:50 <samtar@deploy1002> Started scap: Backport for [[gerrit:830313|Enable Extension:Nearby on wikidata (T246493)]] [production]
20:49 <samtar@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:830312|Wikidata has a wordmark (T315572)]] (duration: 03m 44s) [production]
20:44 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
20:44 <samtar@deploy1002> Synchronized static/images/mobile/copyright/wikidata-en.svg: Config: [[gerrit:830312|Wikidata has a wordmark (T315572)]] (duration: 03m 45s) [production]
20:43 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]