1501-1550 of 10000 results (44ms)
2022-05-16 §
10:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:02 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:58 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:58 <urbanecm> UTC morning B&C window done [production]
07:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:54 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: e9a00e8: GrowthExperiments: Update campaigns configuration (T305443, T305659, T307521) (duration: 00m 50s) [production]
07:49 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:49 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: dc82dfa8: ptwikinews: Enable extension MediaSearch (T299872) (duration: 00m 48s) [production]
07:48 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:44 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 57d4a9c: thwikibooks: Enable quiz extension (T308377) (duration: 00m 48s) [production]
07:42 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
07:41 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 3e04f86: thwikibooks: Add more namespaces to wgNamespacesToBeSearchedDefault (T308373) (duration: 00m 48s) [production]
07:39 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
07:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
07:38 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
07:36 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 67ce6ce: zhwikisource: Add NS100 to wgNamespacesToBeSearchedDefault (T308393) (duration: 00m 50s) [production]
07:18 <dcausse> restarting blazegraph on wdqs1007 (BlazegraphFreeAllocatorsDecreasingRapidly) [production]
2022-05-15 §
21:47 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) (duration: 00m 07s) [production]
21:46 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) [production]
21:42 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) (duration: 00m 07s) [production]
21:42 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) [production]
21:39 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) (duration: 00m 08s) [production]
21:39 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) [production]
21:30 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) (duration: 00m 08s) [production]
21:30 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) [production]
21:14 <aqu@deploy1002> Finished deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) (duration: 00m 08s) [production]
21:14 <aqu@deploy1002> Started deploy [airflow-dags/analytics_test@378e7ca]: (no justification provided) [production]
2022-05-14 §
08:34 <jynus@cumin1001> dbctl commit (dc=all): 'Depool db1172', diff saved to https://phabricator.wikimedia.org/P27830 and previous config saved to /var/cache/conftool/dbconfig/20220514-083421-jynus.json [production]
00:53 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on an-tool1005.eqiad.wmnet with reason: Server need to be downgraded to stretch, on monday [production]
00:53 <razzi@cumin1001> START - Cookbook sre.hosts.downtime for 3 days, 0:00:00 on an-tool1005.eqiad.wmnet with reason: Server need to be downgraded to stretch, on monday [production]
2022-05-13 §
23:42 <razzi@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on an-tool1007.eqiad.wmnet with reason: Upgrade turnilo [production]
23:42 <razzi@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on an-tool1007.eqiad.wmnet with reason: Upgrade turnilo [production]
23:14 <razzi@deploy1002> Finished deploy [analytics/turnilo/deploy@bf60521]: Staging deployment of turnilo 1.35 (duration: 00m 08s) [production]
23:13 <razzi@deploy1002> Started deploy [analytics/turnilo/deploy@bf60521]: Staging deployment of turnilo 1.35 [production]
17:37 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudservices1003.wikimedia.org [production]
17:31 <andrew@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudservices1003.wikimedia.org [production]
17:30 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudservices1004.wikimedia.org [production]
17:24 <andrew@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudservices1004.wikimedia.org [production]
17:24 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host cloudservices1004.wikimedia.org [production]
17:24 <andrew@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudservices1004.wikimedia.org [production]
15:57 <_joe_> uploading conftool 2.2.0 to buster, bullseye T305824 T305582 T305607 T305638 T307905 T308100 [production]
12:38 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
12:38 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply [production]
12:37 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply [production]
12:37 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/services/eventgate-analytics-external: apply [production]
12:18 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2140 after on-site maintenance', diff saved to https://phabricator.wikimedia.org/P27824 and previous config saved to /var/cache/conftool/dbconfig/20220513-121832-marostegui.json [production]
12:09 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply [production]