3951-4000 of 10000 results (95ms)
2024-05-07 §
07:31 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host install7001.wikimedia.org with OS bullseye [production]
04:04 <mwpresync@deploy1002> Pruned MediaWiki: 1.43.0-wmf.1, 1.43.0-wmf.2 (duration: 04m 50s) [production]
00:47 <denisse> Reverting debug changes to their previous state - T364354 [production]
00:42 <denisse> Writing output to `/tmp/benthos_output.txt` shows that the grok processor's output is being parsed correctly - T364354 [production]
00:17 <denisse> Adding a logger processor to the `parse_ncredir_log_format` on `ncredir2001` to examine the JSON structure - T364354 [production]
2024-05-06 §
22:22 <dzahn@deploy1002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
22:20 <dzahn@deploy1002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
22:20 <dzahn@deploy1002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
22:18 <dzahn@deploy1002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
22:14 <dzahn@deploy1002> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
22:13 <dzahn@deploy1002> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
21:29 <dancy@deploy1002> Installation of scap version "4.82.0" completed for 320 hosts [production]
21:28 <dancy@deploy1002> Installing scap version "4.82.0" for 320 hosts [production]
20:47 <jdrewniak@deploy1002> Finished scap: Backport for [[gerrit:1028522|[Vector 2022] Deploy larger font-size and appearance menu to pilot wikis (T362147)]] (duration: 15m 10s) [production]
20:34 <jdrewniak@deploy1002> jdrewniak: Continuing with sync [production]
20:34 <jdrewniak@deploy1002> jdrewniak: Backport for [[gerrit:1028522|[Vector 2022] Deploy larger font-size and appearance menu to pilot wikis (T362147)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:32 <jdrewniak@deploy1002> Started scap: Backport for [[gerrit:1028522|[Vector 2022] Deploy larger font-size and appearance menu to pilot wikis (T362147)]] [production]
20:27 <jdrewniak@deploy1002> Finished scap: Backport for [[gerrit:1028571|Revert "Revert "Release DT visual enhancements to all except Wikipedia/Commons/Wikidata"" (T352087)]] (duration: 21m 33s) [production]
20:14 <jdrewniak@deploy1002> esanders and jdrewniak: Continuing with sync [production]
20:09 <jdrewniak@deploy1002> esanders and jdrewniak: Backport for [[gerrit:1028571|Revert "Revert "Release DT visual enhancements to all except Wikipedia/Commons/Wikidata"" (T352087)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:05 <jdrewniak@deploy1002> Started scap: Backport for [[gerrit:1028571|Revert "Revert "Release DT visual enhancements to all except Wikipedia/Commons/Wikidata"" (T352087)]] [production]
19:46 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s7 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 [production]
19:25 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s5 userOptions.php --delete rcenhancedfilters-seen-highlight-button-counter # T364269 [production]
19:23 <urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript userOptions.php --wiki=enwiki --delete wlenhancedfilters-seen-tour # T364269 [production]
19:21 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s6 userOptions.php --delete rcenhancedfilters-seen-highlight-button-counter # T364269 [production]
19:17 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s6 userOptions.php --delete rcenhancedfilters-tried-highlight # T364269 [production]
19:17 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s5 userOptions.php --delete rcenhancedfilters-tried-highlight # T364269 [production]
19:15 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s3 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 [production]
18:20 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s6 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 [production]
18:20 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s5 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 [production]
18:20 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s4 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 [production]
18:20 <urbanecm> [urbanecm@mwmaint1002 ~]$ foreachwikiindblist s2 userOptions.php --delete wlenhancedfilters-seen-tour # T364269 [production]
18:18 <urbanecm> [urbanecm@mwmaint1002 ~]$ mwscript userOptions.php --wiki=loginwiki --delete wlenhancedfilters-seen-tour # T364269 [production]
18:17 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216 (T361627)', diff saved to https://phabricator.wikimedia.org/P61979 and previous config saved to /var/cache/conftool/dbconfig/20240506-181706-marostegui.json [production]
18:01 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P61978 and previous config saved to /var/cache/conftool/dbconfig/20240506-180158-marostegui.json [production]
17:46 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P61977 and previous config saved to /var/cache/conftool/dbconfig/20240506-174651-marostegui.json [production]
17:31 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2216 (T361627)', diff saved to https://phabricator.wikimedia.org/P61976 and previous config saved to /var/cache/conftool/dbconfig/20240506-173143-marostegui.json [production]
17:21 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2216 (T361627)', diff saved to https://phabricator.wikimedia.org/P61975 and previous config saved to /var/cache/conftool/dbconfig/20240506-172126-marostegui.json [production]
17:21 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2216.codfw.wmnet with reason: Maintenance [production]
17:21 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2216.codfw.wmnet with reason: Maintenance [production]
17:21 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2212 (T361627)', diff saved to https://phabricator.wikimedia.org/P61974 and previous config saved to /var/cache/conftool/dbconfig/20240506-172103-marostegui.json [production]
17:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2212', diff saved to https://phabricator.wikimedia.org/P61973 and previous config saved to /var/cache/conftool/dbconfig/20240506-170556-marostegui.json [production]
16:52 <sukhe> sudo cumin 'A:ncredir' 'run-puppet-agent --enable "merging CR 1028514"' [production]
16:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2212', diff saved to https://phabricator.wikimedia.org/P61972 and previous config saved to /var/cache/conftool/dbconfig/20240506-165048-marostegui.json [production]
16:45 <sukhe> disable puppet on A:ncredir to merge CR 1028514 [production]
16:38 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for mw2382.codfw.wmnet [production]
16:38 <jayme@cumin1002> START - Cookbook sre.hosts.remove-downtime for mw2382.codfw.wmnet [production]
16:37 <jayme@cumin1002> conftool action : set/pooled=yes; selector: name=mw2382.codfw.wmnet [production]
16:35 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2212 (T361627)', diff saved to https://phabricator.wikimedia.org/P61971 and previous config saved to /var/cache/conftool/dbconfig/20240506-163540-marostegui.json [production]
16:25 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2212 (T361627)', diff saved to https://phabricator.wikimedia.org/P61970 and previous config saved to /var/cache/conftool/dbconfig/20240506-162528-marostegui.json [production]