1301-1350 of 10000 results (72ms)
2022-10-06 ยง
12:39 <cmooney@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:36 <cmooney@cumin1001> START - Cookbook sre.dns.netbox [production]
12:34 <aborrero@cumin1001> START - Cookbook sre.hosts.reimage for host cloudnet1006.eqiad.wmnet with OS bullseye [production]
12:31 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1029.eqiad.wmnet [production]
12:24 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts aqs1005.eqiad.wmnet [production]
12:24 <btullis@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:21 <btullis@cumin1001> START - Cookbook sre.dns.netbox [production]
12:15 <btullis@cumin1001> START - Cookbook sre.hosts.decommission for hosts aqs1005.eqiad.wmnet [production]
12:09 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti1012.eqiad.wmnet to cluster eqiad and group C [production]
11:32 <btullis@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts aqs1004.eqiad.wmnet [production]
11:32 <btullis@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:28 <jbond> enable puppet post deploy puppetdb change 814824 [production]
11:27 <jbond> switch puppetdb replication to use replications slots [production]
11:27 <btullis@cumin1001> START - Cookbook sre.dns.netbox [production]
11:27 <btullis> cold-reset the BMC on analytics1076 [production]
11:22 <btullis@cumin1001> START - Cookbook sre.hosts.decommission for hosts aqs1004.eqiad.wmnet [production]
10:58 <jbond> disable puppet temporarily to deploy a puppetdb change 814824 [production]
10:51 <_joe_> installing the upgraded php package everywhere, T318918 [production]
10:30 <elukey> restart kafka on kafka-logging1003 to reload the conifg (cleanup old super.users related to past keystore) [production]
10:16 <moritzm> installing ruby-rack security updates [production]
10:11 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for all remaining wikis [production]
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging NOkafor out of all services on: 1213 hosts [production]
10:07 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging NOkafor out of all services on: 1213 hosts [production]
10:07 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging NOkafor out of all services on: 799 hosts [production]
10:06 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging NOkafor out of all services on: 799 hosts [production]
10:06 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Jmads out of all services on: 799 hosts [production]
10:05 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Jmads out of all services on: 799 hosts [production]
10:03 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
10:03 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
10:03 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
10:02 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
10:02 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Disable UnconnectedPagePagePropMigrationLegacyFormat for all wikis (duration: 03m 39s) [production]
10:01 <jmm@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Jmads out of all services on: 1213 hosts [production]
10:00 <jmm@cumin2002> START - Cookbook sre.idm.logout Logging Jmads out of all services on: 1213 hosts [production]
09:57 <moritzm> installing glib2.0 security updates on buster [production]
09:52 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for itwiki, arzwiki, ptwiki [production]
09:41 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudnet1005.eqiad.wmnet [production]
09:34 <aborrero@cumin1001> START - Cookbook sre.hosts.reboot-single for host cloudnet1005.eqiad.wmnet [production]
09:32 <moritzm> installing python-oslo.utils security updates [production]
09:28 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for viwiki, metawiki, frwiktionary [production]
09:22 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for nlwiktionary, ruwiki, jawiki [production]
09:21 <mwdebug-deploy@deploy1002> helmfile [codfw] DONE helmfile.d/services/mwdebug: apply [production]
09:21 <_joe_> installed the upgraded php package to mw1414, T318918 [production]
09:20 <mwdebug-deploy@deploy1002> helmfile [codfw] START helmfile.d/services/mwdebug: apply [production]
09:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply [production]
09:19 <mwdebug-deploy@deploy1002> helmfile [eqiad] START helmfile.d/services/mwdebug: apply [production]
09:18 <hoo@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Disable UnconnectedPagePagePropMigrationLegacyFormat for nine wikis (duration: 03m 41s) [production]
09:05 <topranks> re-pooling esams after cr2-esams line card reboot [production]
09:04 <hoo> Running extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for cebwiki [production]
09:04 <hoo> Ran extensions/Wikibase/client/maintenance/populateUnexpectedUnconnectedPagePageProp.php for specieswiki [production]