3751-3800 of 10000 results (34ms)
2024-06-20 §
22:33 <zabe@deploy1002> Synchronized wmf-config/InitialiseSettings.php: T361041 T363825 T366649 (duration: 09m 55s) [production]
15:04 <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching sessionstore100[4-6].eqiad.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002 [production]
14:46 <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching sessionstore100[4-6].eqiad.wmnet: Upgrade to Java 11 — T350567 - eevans@cumin1002 [production]
14:25 <elukey@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Update wmf-plugin for K8s ml-staging - elukey@cumin1002 [production]
14:13 <elukey@cumin1002> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Update wmf-plugin for K8s ml-staging - elukey@cumin1002 [production]
13:24 <reedy@deploy1002> Synchronized wmf-config/: T368003 (duration: 10m 39s) [production]
08:16 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.43.0-wmf.10 refs T361404 [production]
2024-06-19 §
16:15 <ayounsi@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox-dev to netbox-dev2003.codfw.wmnet with reason: Netbox 4 on netbox-dev2003 - ayounsi@cumin1002 - T336275 [production]
16:02 <ayounsi@cumin1002> START - Cookbook sre.deploy.python-code netbox-dev to netbox-dev2003.codfw.wmnet with reason: Netbox 4 on netbox-dev2003 - ayounsi@cumin1002 - T336275 [production]
15:55 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.deploy.python-code (exit_code=99) netbox-dev to netbox-dev2003.codfw.wmnet with reason: Netbox 4 on netbox-dev2003 - ayounsi@cumin1002 - T336275 [production]
15:55 <ayounsi@cumin1002> START - Cookbook sre.deploy.python-code netbox-dev to netbox-dev2003.codfw.wmnet with reason: Netbox 4 on netbox-dev2003 - ayounsi@cumin1002 - T336275 [production]
08:18 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.43.0-wmf.10 refs T361404 [production]
2024-06-18 §
18:44 <swfrench-wmf> updated conftool to 3.0.0 on hosts (cp,ncredir) in esams for T365123 [production]
18:38 <swfrench-wmf> updated conftool to 3.0.0 on hosts (cp,ncredir) in eqsin for T365123 [production]
18:33 <swfrench-wmf> updated conftool to 3.0.0 on hosts (cp,ncredir) in drmrs for T365123 [production]
18:27 <swfrench-wmf> updated conftool to 3.0.0 on hosts (cp,ncredir) in magru for T365123 [production]
18:17 <swfrench-wmf> updated conftool to 3.0.0 on hosts (cp,ncredir) in ulsfo for T365123 [production]
17:37 <swfrench-wmf> updated conftool to 3.0.0 on bullseye hosts in eqiad for T365123 [production]
17:35 <swfrench-wmf> updated conftool to 3.0.0 on bookworm hosts in eqiad for T365123 [production]
17:34 <swfrench-wmf> updated conftool to 3.0.0 on buster hosts in eqiad for T365123 [production]
17:16 <swfrench-wmf> updated conftool to 3.0.0 on remaining bullseye hosts in codfw for T365123 [production]
17:14 <swfrench-wmf> updated conftool to 3.0.0 on remaining bookworm hosts in codfw for T365123 [production]
17:12 <swfrench-wmf> updated conftool to 3.0.0 on remaining buster hosts in codfw for T365123 [production]
16:42 <swfrench-wmf> conftool on puppetmaster2001 updated to 3.0.0 for T365123 [production]
16:39 <swfrench-wmf> validated dbctl 3.0.0 on cumin2002 (noop edit to note: on parsercache spare pc2014) for T365123 [production]
16:29 <swfrench-wmf> conftool on cumin2002 updated to 3.0.0 for T365123 [production]
16:23 <swfrench-wmf> depooled / pooled mw2441.codfw.wmnet to smoke-test python3-conftool for T365123 [production]
15:47 <swfrench-wmf> included conftool 3.0.0 into buster/bullseye/bookworm-wikimedia on apt.w.o for T365123 [production]
14:40 <klausman@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on ml-serve2001.codfw.wmnet with reason: Hardware maintenance for memory errors [production]
14:40 <klausman@cumin2002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on ml-serve2001.codfw.wmnet with reason: Hardware maintenance for memory errors [production]
14:09 <swfrench-wmf> included conftool 3.0.0 into buster-wikimedia on apt.w.o for T365123 [production]
08:53 <jnuche@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.43.0-wmf.10 refs T361404 [production]
07:56 <moritzm> uploaded python-irc 8.5.3+dfsg-4+wmf1 to apt.wikimedia.org T331702 [production]
04:02 <mwpresync@deploy1002> Pruned MediaWiki: 1.43.0-wmf.7 (duration: 02m 50s) [production]
04:01 <mwpresync@deploy1002> Finished scap: testwikis wikis to 1.43.0-wmf.10 refs T361404 (duration: 58m 57s) [production]
03:03 <mwpresync@deploy1002> Started scap: testwikis wikis to 1.43.0-wmf.10 refs T361404 [production]
2024-06-17 §
14:12 <cgoubert@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Fix AAAA records for 4 mw servers - cgoubert@cumin1002" [production]
14:11 <cgoubert@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Fix AAAA records for 4 mw servers - cgoubert@cumin1002" [production]
13:03 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cloudvirt1036.eqiad.wmnet with reason: reimage and move to OVS [production]
13:03 <taavi@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cloudvirt1036.eqiad.wmnet with reason: reimage and move to OVS [production]
11:13 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cloudvirt1035.eqiad.wmnet with reason: reimage and move to OVS [production]
11:13 <taavi@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cloudvirt1035.eqiad.wmnet with reason: reimage and move to OVS [production]
2024-06-14 §
13:22 <taavi@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cloudvirt1034.eqiad.wmnet with reason: reimage and move to OVS [production]
13:22 <taavi@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on cloudvirt1034.eqiad.wmnet with reason: reimage and move to OVS [production]
08:44 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Long schema change [production]
08:44 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Long schema change [production]
07:07 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Long schema change [production]
07:07 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Long schema change [production]
2024-06-13 §
18:29 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.43.0-wmf.9 refs T361403 [production]
18:16 <brennen> 1.43.0-wmf.9 train (T361403): no current blockers, rolling to group2 [production]