8901-8950 of 10000 results (100ms)
2023-06-21 §
10:57 <jnuche@deploy1002> Finished deploy [releng/jenkins-deploy@0c82f2d] (releasing): (no justification provided) (duration: 00m 48s) [production]
10:57 <jnuche@deploy1002> Started deploy [releng/jenkins-deploy@0c82f2d] (releasing): (no justification provided) [production]
10:51 <volans> uploaded spicerack_7.2.1 to apt.wikimedia.org bullseye-wikimedia [production]
10:37 <dcausse@deploy1002> Finished deploy [airflow-dags/search@29d9615]: search: schedule cirrus_consistency_check (take 2) (duration: 00m 10s) [production]
10:37 <dcausse@deploy1002> Started deploy [airflow-dags/search@29d9615]: search: schedule cirrus_consistency_check (take 2) [production]
10:24 <ladsgroup@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db[1124,1133].eqiad.wmnet with reason: Testing cloning [production]
10:24 <ladsgroup@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db[1124,1133].eqiad.wmnet with reason: Testing cloning [production]
09:59 <dcausse@deploy1002> Finished deploy [airflow-dags/search@9c03845]: search: schedule cirrus_consistency_check (duration: 00m 18s) [production]
09:58 <dcausse@deploy1002> Started deploy [airflow-dags/search@9c03845]: search: schedule cirrus_consistency_check [production]
09:38 <klausman@deploy1002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . [production]
09:21 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:20 <jnuche@deploy1002> Finished deploy [releng/jenkins-deploy@0c82f2d] (releasing): (no justification provided) (duration: 01m 14s) [production]
09:20 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:19 <jnuche@deploy1002> Started deploy [releng/jenkins-deploy@0c82f2d] (releasing): (no justification provided) [production]
09:18 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:17 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:17 <jbond@cumin1001> END (ERROR) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=97) generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:16 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:15 <jbond@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:14 <jbond@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "test sync - jbond@cumin1001" [production]
09:06 <jbond> disable puppet on R:git::clone to deploy gerrit:927750 [production]
08:36 <vgutierrez> disable puppet on A:cp before merging Ie84c15ebe3d85c5140f8b3dc25d13086c9f34041 [production]
08:35 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host krb2002.codfw.wmnet [production]
08:30 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host krb2002.codfw.wmnet [production]
07:23 <jelto@deploy1002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
07:22 <jelto@deploy1002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
07:21 <jelto@deploy1002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
07:21 <jelto@deploy1002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
07:13 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dumpsdata1003.eqiad.wmnet with OS bullseye [production]
06:44 <jelto@deploy1002> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
06:44 <jelto@deploy1002> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
06:40 <hashar@deploy1002> Finished deploy [integration/docroot@51d2552]: Add TimedMediaHandler to docroot - T338458 (duration: 00m 11s) [production]
06:40 <hashar@deploy1002> Started deploy [integration/docroot@51d2552]: Add TimedMediaHandler to docroot - T338458 [production]
06:07 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dumpsdata1003.eqiad.wmnet with reason: host reimage [production]
06:04 <ariel@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on dumpsdata1003.eqiad.wmnet with reason: host reimage [production]
06:03 <ariel@cumin1001> START - Cookbook sre.hosts.reimage for host dumpsdata1003.eqiad.wmnet with OS bullseye [production]
00:20 <tzatziki> removing one file for legal compliance [production]
00:13 <tzatziki> removing 2files for legal compliance [production]
00:11 <tzatziki> removing one file for legal compliancee [production]
2023-06-20 §
23:33 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dbproxy1023.eqiad.wmnet with OS bullseye [production]
22:47 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs2021.codfw.wmnet with OS buster [production]
22:37 <jclark@cumin1001> START - Cookbook sre.hosts.reimage for host dbproxy1023.eqiad.wmnet with OS bullseye [production]
22:23 <jclark@cumin1001> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dbproxy1023.eqiad.wmnet with OS bullseye [production]
22:19 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs2021.codfw.wmnet with reason: host reimage [production]
22:16 <bking@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs2021.codfw.wmnet with reason: host reimage [production]
22:13 <tgr_> UTC late backports done [production]
22:11 <tgr@deploy1002> Finished scap: Backport for [[gerrit:931084|Section images: Fix ve.scrollIntoView override (T339900 T335209)]], [[gerrit:931685|Backport translations from master (T339225)]] (duration: 22m 30s) [production]
22:01 <tgr@deploy1002> tgr and kharlan: Backport for [[gerrit:931084|Section images: Fix ve.scrollIntoView override (T339900 T335209)]], [[gerrit:931685|Backport translations from master (T339225)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
21:59 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on A:cp-text_esams [production]
21:59 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host wdqs2021.codfw.wmnet with OS buster [production]