5501-5550 of 10000 results (106ms)
2024-06-18 §
00:18 <zabe@deploy1002> Finished scap: Update interwiki cache (duration: 14m 03s) [production]
00:13 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2204', diff saved to https://phabricator.wikimedia.org/P65124 and previous config saved to /var/cache/conftool/dbconfig/20240618-001316-ladsgroup.json [production]
00:10 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp4044.ulsfo.wmnet with OS bullseye [production]
00:10 <brett@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4044.ulsfo.wmnet with OS bullseye [production]
00:05 <zabe> zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=u4cwiki --cluster=all 2>&1 | tee /tmp/u4c.UpdateSearchIndexConfig.log # T366649 [production]
00:04 <zabe@deploy1002> Started scap: Update interwiki cache [production]
00:02 <zabe@deploy1002> Finished scap: T366649 (duration: 15m 16s) [production]
00:00 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp4044.ulsfo.wmnet with OS bullseye [production]
2024-06-17 §
23:58 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2204', diff saved to https://phabricator.wikimedia.org/P65123 and previous config saved to /var/cache/conftool/dbconfig/20240617-235809-ladsgroup.json [production]
23:52 <zabe@deploy1002> zabe: Continuing with sync [production]
23:52 <brett@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp4044.ulsfo.wmnet [production]
23:51 <zabe@deploy1002> zabe: T366649 synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:48 <zabe> zabe@mwmaint1002:~$ mwscript extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=arbcom_itwiki --cluster=all 2>&1 | tee /tmp/arbcom_it.UpdateSearchIndexConfig.log # T363825 [production]
23:47 <zabe@deploy1002> Started scap: T366649 [production]
23:46 <zabe> Create an 'Universal Code of Conduct Coordinating Committee (U4C)' private wiki # T366649 [production]
23:44 <zabe@deploy1002> Finished scap: T363825 (duration: 15m 00s) [production]
23:43 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2204 (T352010)', diff saved to https://phabricator.wikimedia.org/P65122 and previous config saved to /var/cache/conftool/dbconfig/20240617-234302-ladsgroup.json [production]
23:34 <zabe@deploy1002> zabe: Continuing with sync [production]
23:34 <zabe@deploy1002> zabe: T363825 synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:29 <zabe@deploy1002> Started scap: T363825 [production]
23:29 <zabe> create private wiki for itwiki arbcom # T363825 [production]
23:23 <cdobbins@cumin1002> conftool action : set/pooled=yes; selector: name=cp4043.ulsfo.wmnet [production]
23:14 <cdobbins@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp4043.ulsfo.wmnet with OS bullseye [production]
22:52 <cdobbins@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp4043.ulsfo.wmnet with reason: host reimage [production]
22:49 <cdobbins@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp4043.ulsfo.wmnet with reason: host reimage [production]
22:42 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1041.eqiad.wmnet with OS bookworm [production]
22:30 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T352010)', diff saved to https://phabricator.wikimedia.org/P65121 and previous config saved to /var/cache/conftool/dbconfig/20240617-223010-ladsgroup.json [production]
22:28 <cdobbins@cumin1002> START - Cookbook sre.hosts.reimage for host cp4043.ulsfo.wmnet with OS bullseye [production]
22:26 <cdobbins@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp4043.ulsfo.wmnet with OS bullseye [production]
22:25 <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching cassandra-dev200[2-3].codfw.wmnet: Apply Cassandra upgrade to 4.1.5 — T354970 - eevans@cumin1002 [production]
22:15 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1041.eqiad.wmnet with reason: host reimage [production]
22:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P65120 and previous config saved to /var/cache/conftool/dbconfig/20240617-221503-ladsgroup.json [production]
22:12 <andrew@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1041.eqiad.wmnet with reason: host reimage [production]
22:11 <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching cassandra-dev200[2-3].codfw.wmnet: Apply Cassandra upgrade to 4.1.5 — T354970 - eevans@cumin1002 [production]
22:05 <eevans@cumin1002> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching cassandra-dev2001.codfw.wmnet: Apply Cassandra upgrade to 4.1.5 — T354970 - eevans@cumin1002 [production]
21:59 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P65119 and previous config saved to /var/cache/conftool/dbconfig/20240617-215956-ladsgroup.json [production]
21:58 <eevans@cumin1002> START - Cookbook sre.cassandra.roll-restart for nodes matching cassandra-dev2001.codfw.wmnet: Apply Cassandra upgrade to 4.1.5 — T354970 - eevans@cumin1002 [production]
21:55 <andrew@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1041.eqiad.wmnet with OS bookworm [production]
21:44 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1206 (T352010)', diff saved to https://phabricator.wikimedia.org/P65118 and previous config saved to /var/cache/conftool/dbconfig/20240617-214449-ladsgroup.json [production]
21:41 <cdobbins@cumin1002> START - Cookbook sre.hosts.reimage for host cp4043.ulsfo.wmnet with OS bullseye [production]
21:20 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1040.eqiad.wmnet with OS bookworm [production]
21:09 <cdobbins@cumin1002> conftool action : set/pooled=no; selector: name=cp4043.ulsfo.wmnet [production]
21:09 <cdobbins@cumin1002> conftool action : set/pooled=no; selector: name=4043.ulsfo.wmnet [production]
21:05 <jforrester@deploy1002> Finished scap: Backport for [[gerrit:1046767|Fix styles for new heading HTML (T367468)]] (duration: 18m 57s) [production]
20:59 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db1174 (T364069)', diff saved to https://phabricator.wikimedia.org/P65117 and previous config saved to /var/cache/conftool/dbconfig/20240617-205955-marostegui.json [production]
20:59 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1174.eqiad.wmnet with reason: Maintenance [production]
20:59 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1174.eqiad.wmnet with reason: Maintenance [production]
20:55 <jforrester@deploy1002> jforrester: Continuing with sync [production]
20:52 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1040.eqiad.wmnet with reason: host reimage [production]
20:50 <jforrester@deploy1002> jforrester: Backport for [[gerrit:1046767|Fix styles for new heading HTML (T367468)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]