1251-1300 of 10000 results (82ms)
2022-10-06 ยง
10:16 <moritzm> installing ruby-rack security updates [production]
10:11 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for all remaining wikis [production]
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging NOkafor out of all services on: 1213 hosts [production]
10:07 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging NOkafor out of all services on: 1213 hosts [production]
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging NOkafor out of all services on: 799 hosts [production]
10:06 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging NOkafor out of all services on: 799 hosts [production]
10:06 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Jmads out of all services on: 799 hosts [production]
10:05 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Jmads out of all services on: 799 hosts [production]
10:03 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:03 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:02 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:02 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Disable UnconnectedPagePagePropMigrationLegacyFormat for all wikis (duration: 03m 39s) [production]
10:01 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Jmads out of all services on: 1213 hosts [production]
10:00 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Jmads out of all services on: 1213 hosts [production]
09:57 <moritzm> installing glib2.0 security updates on buster [production]
09:52 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for itwiki, arzwiki, ptwiki [production]
09:41 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet1005.eqiad.wmnet [production]
09:34 <aborrero@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudnet1005.eqiad.wmnet [production]
09:32 <moritzm> installing python-oslo.utils security updates [production]
09:28 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for viwiki, metawiki, frwiktionary [production]
09:22 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for nlwiktionary, ruwiki, jawiki [production]
09:21 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
09:21 <_joe_> installed the upgraded php package to mw1414, T318918 [production]
09:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
09:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
09:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
09:18 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Disable UnconnectedPagePagePropMigrationLegacyFormat for nine wikis (duration: 03m 41s) [production]
09:05 <topranks> re-pooling esams after cr2-esams line card reboot [production]
09:04 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for cebwiki [production]
09:04 <hoo> Ran extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for specieswiki [production]
09:04 <hoo> Ran extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for ruwiktionary [production]
09:04 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:59 <_joe_> uploaded new php 7.4 packages T318918 [production]
08:58 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:58 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:57 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:54 <topranks> rebooting line card fpc 0 on cr2-esams (T318783) [production]
08:53 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Disable UnconnectedPagePagePropMigrationLegacyFormat for three wikis (duration: 04m 03s) [production]
08:52 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
08:51 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
08:51 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
08:50 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
08:48 <moritzm> installing jetty9 security updates [production]
08:42 <moritzm> installing rails security updates [production]
08:37 <moritzm> installing puma security updates [production]
08:27 <topranks> disabling OSPF on cr2-esams [production]
08:24 <cmooney@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on cr2-esams,cr2-esams IPv6,re0.cr2-esams.mgmt with reason: line card reboot [production]
08:24 <cmooney@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on cr2-esams,cr2-esams IPv6,re0.cr2-esams.mgmt with reason: line card reboot [production]
08:21 <topranks> disabling external BGP sessions on cr2-esams prior to line card reboot [production]