901-950 of 10000 results (79ms)
2023-06-01 ยง
16:55 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:55 <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: revert: Remove undeeded wgEventBusStreamNamesMap override setting. Recent EventBus changes are not deployed yet? - T336817 (duration: 07m 24s) [production]
16:55 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:53 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
16:53 <aborrero@cumin2002> END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
16:52 <aborrero@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - aborrero@cumin2002" [production]
16:44 <otto@deploy1002> Synchronized wmf-config/InitialiseSettings.php: no-op: Remove undeeded wgEventBusStreamNamesMap override setting - T336817 (duration: 08m 18s) [production]
16:42 <bblack> lvs2* (codfw): upgrade pybal to 1.15.13 - T334703 [production]
16:40 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:40 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1002.eqiad.wmnet with OS bullseye [production]
16:35 <bblack> lvs5* (eqsin): upgrade pybal to 1.15.13 - T334703 [production]
16:32 <bblack> lvs400[89]: upgrade pybal to 1.15.13 - T334703 (round 2!) [production]
16:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
16:23 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:22 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
16:10 <aborrero@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcontrol2004-dev.codfw.wmnet with reason: host reimage [production]
16:07 <aborrero@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcontrol2004-dev.codfw.wmnet with reason: host reimage [production]
16:07 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudswift1001.eqiad.wmnet with reason: host reimage [production]
16:06 <mutante> gerrit - set repo wikimedia/annualreport to readonly (from active) - T337041 [production]
16:04 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudswift1001.eqiad.wmnet with reason: host reimage [production]
16:01 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
16:00 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
15:59 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
15:57 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
15:45 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
15:44 <aborrero@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
15:33 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
15:33 <aborrero@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
15:21 <fabfur> running run-puppet-agent on cp6010.drmrs.wmnet to fix icinga check from cookbook [production]
15:15 <bblack> lvs400[89]: upgrade pybal to 1.15.13 - T334703 [production]
15:11 <sukhe> reprepro -C component/pybal bullseye-wikimedia pybal_1.15.13_source.changes [production]
15:00 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mwlog1002.eqiad.wmnet with OS bullseye [production]
14:59 <moritzm> installing python-sqlparse security updates [production]
14:56 <ayounsi@cumin1001> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox [production]
14:56 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
14:55 <aborrero@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
14:55 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host cloudswift1001.eqiad.wmnet with OS bullseye [production]
14:53 <moritzm> installing jackson-databind security updates [production]
14:49 <ayounsi@cumin1001> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox [production]
14:45 <fabfur> running run-puppet-agent on cp6009.drmrs.wmnet to fix icinga check from cookbook [production]
14:44 <herron@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mwlog1002.eqiad.wmnet with reason: host reimage [production]
14:41 <herron@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mwlog1002.eqiad.wmnet with reason: host reimage [production]
14:40 <fabfur@cumin1001> START - Cookbook sre.cdn.run-puppet-restart-varnish rolling custom on A:cp-upload_drmrs and A:cp [production]
14:39 <ayounsi@cumin1001> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary [production]
14:39 <ayounsi@cumin1001> START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary [production]
14:36 <fabfur@cumin1001> START - Cookbook sre.cdn.run-puppet-restart-varnish rolling custom on A:cp-text_drmrs and A:cp [production]
14:34 <aborrero@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcontrol2004-dev.codfw.wmnet with OS bullseye [production]
14:29 <moritzm> installing imagemagick security updates on buster [production]
14:16 <herron@cumin1001> START - Cookbook sre.hosts.reimage for host mwlog1002.eqiad.wmnet with OS bullseye [production]
14:14 <fabfur> Disabled puppet on A:cp-drmrs for T323557 [production]