3801-3850 of 10000 results (110ms)
2023-05-23 §
05:35 <marostegui@cumin1001> dbctl commit (dc=all): 'db2124 (re)pooling @ 3%: Repooling after maintenance', diff saved to https://phabricator.wikimedia.org/P48464 and previous config saved to /var/cache/conftool/dbconfig/20230523-053519-root.json [production]
05:20 <marostegui@cumin1001> dbctl commit (dc=all): 'db2124 (re)pooling @ 1%: Repooling after maintenance', diff saved to https://phabricator.wikimedia.org/P48463 and previous config saved to /var/cache/conftool/dbconfig/20230523-052014-root.json [production]
03:54 <mwpresync@deploy1002> Pruned MediaWiki: 1.41.0-wmf.8 (duration: 02m 17s) [production]
03:51 <mwpresync@deploy1002> Finished scap: testwikis wikis to 1.41.0-wmf.10 refs T330216 (duration: 49m 04s) [production]
03:02 <mwpresync@deploy1002> Started scap: testwikis wikis to 1.41.0-wmf.10 refs T330216 [production]
02:57 <eileen> civicrm upgraded from 3329155a to 6642b602 [production]
02:22 <eileen> civicrm upgraded from 7eae24d5 to 3329155a [production]
2023-05-22 §
23:29 <eileen> civicrm upgraded from cc9593d0 to 7eae24d5 [production]
23:16 <zabe@deploy1002> Finished scap: Backport for [[gerrit:921614|Enable VE on new wikis]] (duration: 06m 58s) [production]
23:11 <zabe@deploy1002> zabe: Backport for [[gerrit:921614|Enable VE on new wikis]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
23:09 <zabe@deploy1002> Started scap: Backport for [[gerrit:921614|Enable VE on new wikis]] [production]
21:38 <sbassett> Deployed security mitigations for T333140 and T336027 [production]
20:55 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts labstore1004.eqiad.wmnet [production]
20:54 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:54 <andrew@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: labstore1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" [production]
20:53 <andrew@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: labstore1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" [production]
20:51 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
20:45 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts labstore1004.eqiad.wmnet [production]
20:44 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts labstore1005.eqiad.wmnet [production]
20:44 <andrew@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:44 <andrew@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: labstore1005.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" [production]
20:43 <andrew@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: labstore1005.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin1001" [production]
20:40 <andrew@cumin1001> START - Cookbook sre.dns.netbox [production]
20:33 <andrew@cumin1001> START - Cookbook sre.hosts.decommission for hosts labstore1005.eqiad.wmnet [production]
20:27 <TheresNoTime> close UTC late backport window [production]
20:24 <samtar@deploy1002> Finished scap: Backport for [[gerrit:921765|[kaawiki] Enable SandboxLink extension (T336648)]] (duration: 07m 47s) [production]
20:17 <samtar@deploy1002> samtar and superpes: Backport for [[gerrit:921765|[kaawiki] Enable SandboxLink extension (T336648)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
20:16 <samtar@deploy1002> Started scap: Backport for [[gerrit:921765|[kaawiki] Enable SandboxLink extension (T336648)]] [production]
20:14 <samtar@deploy1002> Finished scap: Backport for [[gerrit:921764|[ruwiki] Add 'abusefilter log/view private' flags to ArbCom (T336625)]] (duration: 08m 22s) [production]
20:11 <bking@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs[2010-2011].codfw.wmnet [production]
20:09 <bking@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs[2010-2011].codfw.wmnet [production]
20:08 <samtar@deploy1002> superpes and samtar: Backport for [[gerrit:921764|[ruwiki] Add 'abusefilter log/view private' flags to ArbCom (T336625)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet [production]
20:06 <samtar@deploy1002> Started scap: Backport for [[gerrit:921764|[ruwiki] Add 'abusefilter log/view private' flags to ArbCom (T336625)]] [production]
19:22 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:22 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:20 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:20 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:18 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:18 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:18 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:18 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
17:04 <mfossati@deploy1002> Finished deploy [airflow-dags/platform_eng@5ee7a62]: (no justification provided) (duration: 00m 17s) [production]
17:03 <mfossati@deploy1002> Started deploy [airflow-dags/platform_eng@5ee7a62]: (no justification provided) [production]
16:58 <XioNoX> push mgmt_junos to all L2 switches [production]
16:35 <bking@cumin1001> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs2009.codfw.wmnet [production]
16:35 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2009.codfw.wmnet [production]
15:57 <bking@cumin1001> START - Cookbook sre.hosts.reboot-single for host wdqs2009.codfw.wmnet [production]
15:56 <bking@cumin1001> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs2009.codfw.wmnet [production]
15:32 <ayounsi@cumin1001> END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling update on A:netbox [production]
15:26 <ayounsi@cumin1001> START - Cookbook sre.netbox.update-extras rolling update on A:netbox [production]