5551-5600 of 10000 results (98ms)
2024-03-31 §
11:47 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P59033 and previous config saved to /var/cache/conftool/dbconfig/20240331-114736-ladsgroup.json [production]
11:32 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1227 (T352010)', diff saved to https://phabricator.wikimedia.org/P59032 and previous config saved to /var/cache/conftool/dbconfig/20240331-113228-ladsgroup.json [production]
00:01 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1227 (T352010)', diff saved to https://phabricator.wikimedia.org/P59031 and previous config saved to /var/cache/conftool/dbconfig/20240331-000134-ladsgroup.json [production]
00:01 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1227.eqiad.wmnet with reason: Maintenance [production]
00:01 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1227.eqiad.wmnet with reason: Maintenance [production]
00:01 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1202 (T352010)', diff saved to https://phabricator.wikimedia.org/P59030 and previous config saved to /var/cache/conftool/dbconfig/20240331-000112-ladsgroup.json [production]
2024-03-30 §
23:46 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P59029 and previous config saved to /var/cache/conftool/dbconfig/20240330-234604-ladsgroup.json [production]
23:30 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P59028 and previous config saved to /var/cache/conftool/dbconfig/20240330-233056-ladsgroup.json [production]
23:15 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1202 (T352010)', diff saved to https://phabricator.wikimedia.org/P59027 and previous config saved to /var/cache/conftool/dbconfig/20240330-231549-ladsgroup.json [production]
13:31 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1202 (T352010)', diff saved to https://phabricator.wikimedia.org/P59026 and previous config saved to /var/cache/conftool/dbconfig/20240330-133129-ladsgroup.json [production]
13:31 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1202.eqiad.wmnet with reason: Maintenance [production]
13:31 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1202.eqiad.wmnet with reason: Maintenance [production]
13:31 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1194 (T352010)', diff saved to https://phabricator.wikimedia.org/P59025 and previous config saved to /var/cache/conftool/dbconfig/20240330-133116-ladsgroup.json [production]
13:16 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P59024 and previous config saved to /var/cache/conftool/dbconfig/20240330-131609-ladsgroup.json [production]
13:01 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P59023 and previous config saved to /var/cache/conftool/dbconfig/20240330-130102-ladsgroup.json [production]
12:45 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1194 (T352010)', diff saved to https://phabricator.wikimedia.org/P59022 and previous config saved to /var/cache/conftool/dbconfig/20240330-124554-ladsgroup.json [production]
05:19 <TimStarling> on releases1003 uploaded mediawiki 1.19.0 - 1.19.8, 1.20.0 - 1.20.6 T190369 [production]
02:28 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1194 (T352010)', diff saved to https://phabricator.wikimedia.org/P59021 and previous config saved to /var/cache/conftool/dbconfig/20240330-022801-ladsgroup.json [production]
02:27 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1194.eqiad.wmnet with reason: Maintenance [production]
02:27 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1194.eqiad.wmnet with reason: Maintenance [production]
02:27 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1191 (T352010)', diff saved to https://phabricator.wikimedia.org/P59020 and previous config saved to /var/cache/conftool/dbconfig/20240330-022738-ladsgroup.json [production]
02:12 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P59019 and previous config saved to /var/cache/conftool/dbconfig/20240330-021231-ladsgroup.json [production]
01:57 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P59018 and previous config saved to /var/cache/conftool/dbconfig/20240330-015723-ladsgroup.json [production]
01:42 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1191 (T352010)', diff saved to https://phabricator.wikimedia.org/P59017 and previous config saved to /var/cache/conftool/dbconfig/20240330-014215-ladsgroup.json [production]
2024-03-29 §
22:24 <amastilovic@deploy1002> Finished deploy [airflow-dags/analytics@67eaa50]: (no justification provided) (duration: 00m 29s) [production]
22:23 <amastilovic@deploy1002> Started deploy [airflow-dags/analytics@67eaa50]: (no justification provided) [production]
22:12 <tzatziki> removing 1 file for legal compliance [production]
21:56 <tzatziki> removing 4 files for legal compliance [production]
20:30 <tzatziki> removing 4 files for legal compliance [production]
20:00 <tzatziki> removing 1 file for legal compliance [production]
19:53 <tzatziki> removing 1 file for legal compliance [production]
16:51 <amastilovic@deploy1002> Finished deploy [airflow-dags/analytics@e6892f4]: (no justification provided) (duration: 00m 26s) [production]
16:51 <amastilovic@deploy1002> Started deploy [airflow-dags/analytics@e6892f4]: (no justification provided) [production]
16:14 <andrewbogott> updated wikitech-static to 1.41.1 [production]
16:07 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depooling db1191 (T352010)', diff saved to https://phabricator.wikimedia.org/P59016 and previous config saved to /var/cache/conftool/dbconfig/20240329-160707-ladsgroup.json [production]
16:07 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1191.eqiad.wmnet with reason: Maintenance [production]
16:06 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1191.eqiad.wmnet with reason: Maintenance [production]
16:06 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1174 (T352010)', diff saved to https://phabricator.wikimedia.org/P59015 and previous config saved to /var/cache/conftool/dbconfig/20240329-160644-ladsgroup.json [production]
15:51 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P59014 and previous config saved to /var/cache/conftool/dbconfig/20240329-155137-ladsgroup.json [production]
15:36 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1174', diff saved to https://phabricator.wikimedia.org/P59013 and previous config saved to /var/cache/conftool/dbconfig/20240329-153629-ladsgroup.json [production]
15:21 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db1174 (T352010)', diff saved to https://phabricator.wikimedia.org/P59012 and previous config saved to /var/cache/conftool/dbconfig/20240329-152122-ladsgroup.json [production]
14:00 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on restbase1027.eqiad.wmnet with reason: Decommissioning — T354561 [production]
14:00 <eevans@cumin1002> START - Cookbook sre.hosts.downtime for 30 days, 0:00:00 on restbase1027.eqiad.wmnet with reason: Decommissioning — T354561 [production]
13:32 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in search_codfw [production]
13:32 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in search_codfw [production]
09:30 <filippo@cumin2002> END (PASS) - Cookbook sre.puppet.migrate-host (exit_code=0) for host alert1001.wikimedia.org [production]
09:24 <filippo@cumin2002> START - Cookbook sre.puppet.migrate-host for host alert1001.wikimedia.org [production]
09:22 <filippo@cumin2002> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host alert1001.wikimedia.org [production]
09:21 <filippo@cumin2002> START - Cookbook sre.puppet.migrate-host for host alert1001.wikimedia.org [production]
09:18 <filippo@cumin2002> END (FAIL) - Cookbook sre.puppet.migrate-host (exit_code=99) for host alert1001.wikimedia.org [production]