4801-4850 of 10000 results (23ms)
2020-08-12 §
10:55 <_joe_> rebooting mw1361 [production]
10:51 <jayme> rebooting mw1356 [production]
10:49 <_joe_> rebooting mw1378 [production]
09:45 <_joe_> repooling mw1377 [production]
09:40 <_joe_> rebooting mw1377 [production]
09:22 <_joe_> depool mw1357 tool [production]
09:14 <_joe_> depooling mw1377 for inspection [production]
09:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1110', diff saved to https://phabricator.wikimedia.org/P12220 and previous config saved to /var/cache/conftool/dbconfig/20200812-091211-marostegui.json [production]
09:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1110', diff saved to https://phabricator.wikimedia.org/P12219 and previous config saved to /var/cache/conftool/dbconfig/20200812-090831-marostegui.json [production]
08:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1110', diff saved to https://phabricator.wikimedia.org/P12218 and previous config saved to /var/cache/conftool/dbconfig/20200812-085021-marostegui.json [production]
08:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1110', diff saved to https://phabricator.wikimedia.org/P12217 and previous config saved to /var/cache/conftool/dbconfig/20200812-083548-marostegui.json [production]
07:49 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:46 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:31 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1110 for reimage', diff saved to https://phabricator.wikimedia.org/P12215 and previous config saved to /var/cache/conftool/dbconfig/20200812-073130-marostegui.json [production]
04:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1126 for MCR change', diff saved to https://phabricator.wikimedia.org/P12214 and previous config saved to /var/cache/conftool/dbconfig/20200812-045157-marostegui.json [production]
2020-08-11 §
23:41 <Urbanecm> Evening B&C window completed [production]
23:39 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 0f238f71c95c7bd7534c28abfac759fbb47f674f: Update wgMFRemovableClasses (T231160) (duration: 01m 03s) [production]
23:36 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.3/extensions/MobileFrontend/extension.json: c22d65ff9b2439f484ab8ccffed87b00e78c3ad2: Hide vertical nav-boxes on mobile domain (T231160) (duration: 01m 03s) [production]
23:34 <urbanecm@deploy1001> Synchronized php-1.36.0-wmf.4/extensions/MobileFrontend/extension.json: 81d54b0ec82d0b78f723f9400031e918a4a143aa: Hide vertical nav-boxes on mobile domain (T231160) (duration: 01m 05s) [production]
23:07 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: 28faa279dacf6a4d6f0a663844e913738c2fa142: Switching to updated license definition (duration: 01m 04s) [production]
21:52 <krinkle@deploy1001> Synchronized php-1.36.0-wmf.3/includes/skins/SkinMustache.php: Ibe1f07346, T259872, T259858 (duration: 01m 04s) [production]
19:40 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
19:40 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
19:35 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - Add streams for eventgate-main - T251935 (duration: 01m 04s) [production]
19:21 <ejegg> updated payments-wiki from f199c071c3 to 77ff5d70fc [production]
18:55 <otto@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
18:48 <otto@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
18:44 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . [production]
18:44 <otto@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . [production]
18:28 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Grant investigate right to checkuser group on frwiki (T260171) (duration: 01m 04s) [production]
18:18 <ppchelko@deploy1001> Synchronized wmf-config/CommonSettings-labs.php: Beta-only: Configured additional settings for API Portal beta wiki gerrit:619339 (duration: 01m 03s) [production]
18:05 <catrope@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Direct GrowthExperiments help panel questions to mentors on cswiki (T250235) (duration: 01m 03s) [production]
17:56 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventStreamConfig - Remove extraneous mediawiki.api-request stream - T251935 (duration: 01m 01s) [production]
17:53 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
17:53 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
17:43 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
17:43 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'nontls' . [production]
17:38 <mholloway-shell@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
17:36 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:33 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
17:31 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
17:28 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
17:25 <mholloway-shell@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'proton' for release 'production' . [production]
17:04 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:58 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
16:53 <hashar@deploy1001> Synchronized php-1.36.0-wmf.4/skins/MinervaNeue/: Revert "ServiceWiring: Avoid usage of deprecated Title::getSubjectPage()" - T260155 (duration: 01m 06s) [production]
16:12 <herron> migrating lists.wikimedia.org services from fermium to lists1001 T224586 [production]
15:36 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.36.0-wmf.4 [production]
15:27 <hashar@deploy1001> Finished scap: (no justification provided) (duration: 30m 51s) [production]
14:59 <marostegui> Deploy MCR change on db1116:3318 [production]