|
2023-09-24
§
|
| 23:05 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2122 (T343198)', diff saved to https://phabricator.wikimedia.org/P52595 and previous config saved to /var/cache/conftool/dbconfig/20230924-230515-arnaudb.json |
[production] |
| 23:05 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2122.codfw.wmnet with reason: Maintenance |
[production] |
| 23:04 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2122.codfw.wmnet with reason: Maintenance |
[production] |
| 23:04 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121 (T343198)', diff saved to https://phabricator.wikimedia.org/P52594 and previous config saved to /var/cache/conftool/dbconfig/20230924-230443-arnaudb.json |
[production] |
| 22:49 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121', diff saved to https://phabricator.wikimedia.org/P52593 and previous config saved to /var/cache/conftool/dbconfig/20230924-224936-arnaudb.json |
[production] |
| 22:34 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121', diff saved to https://phabricator.wikimedia.org/P52592 and previous config saved to /var/cache/conftool/dbconfig/20230924-223430-arnaudb.json |
[production] |
| 22:19 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2121 (T343198)', diff saved to https://phabricator.wikimedia.org/P52591 and previous config saved to /var/cache/conftool/dbconfig/20230924-221923-arnaudb.json |
[production] |
| 18:35 |
<btullis> |
restarted archiva to see if it clears some temp files. |
[analytics] |
| 15:39 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) |
[admin] |
| 15:37 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack |
[admin] |
| 15:35 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) |
[admin] |
| 15:32 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.restart_openstack |
[admin] |
| 13:35 |
<wm-bot> |
<lucaswerkmeister> deployed e5ae3295bb (Babel language code of Aragonese, to silence log warnings) |
[tools.lexeme-forms] |
| 13:29 |
<wm-bot> |
<lucaswerkmeister> deployed 45aa8fe43b (Danish proper nouns) |
[tools.lexeme-forms] |
| 10:28 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2121 (T343198)', diff saved to https://phabricator.wikimedia.org/P52590 and previous config saved to /var/cache/conftool/dbconfig/20230924-102809-arnaudb.json |
[production] |
| 10:28 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2121.codfw.wmnet with reason: Maintenance |
[production] |
| 10:27 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2121.codfw.wmnet with reason: Maintenance |
[production] |
| 10:27 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120 (T343198)', diff saved to https://phabricator.wikimedia.org/P52589 and previous config saved to /var/cache/conftool/dbconfig/20230924-102747-arnaudb.json |
[production] |
| 10:12 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P52588 and previous config saved to /var/cache/conftool/dbconfig/20230924-101241-arnaudb.json |
[production] |
| 09:57 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120', diff saved to https://phabricator.wikimedia.org/P52587 and previous config saved to /var/cache/conftool/dbconfig/20230924-095734-arnaudb.json |
[production] |
| 09:42 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2120 (T343198)', diff saved to https://phabricator.wikimedia.org/P52586 and previous config saved to /var/cache/conftool/dbconfig/20230924-094227-arnaudb.json |
[production] |
|
2023-09-23
§
|
| 22:27 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2120 (T343198)', diff saved to https://phabricator.wikimedia.org/P52585 and previous config saved to /var/cache/conftool/dbconfig/20230923-222721-arnaudb.json |
[production] |
| 22:27 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2120.codfw.wmnet with reason: Maintenance |
[production] |
| 22:27 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2120.codfw.wmnet with reason: Maintenance |
[production] |
| 22:27 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108 (T343198)', diff saved to https://phabricator.wikimedia.org/P52584 and previous config saved to /var/cache/conftool/dbconfig/20230923-222659-arnaudb.json |
[production] |
| 22:11 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108', diff saved to https://phabricator.wikimedia.org/P52583 and previous config saved to /var/cache/conftool/dbconfig/20230923-221152-arnaudb.json |
[production] |
| 21:56 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108', diff saved to https://phabricator.wikimedia.org/P52582 and previous config saved to /var/cache/conftool/dbconfig/20230923-215646-arnaudb.json |
[production] |
| 21:41 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db2108 (T343198)', diff saved to https://phabricator.wikimedia.org/P52581 and previous config saved to /var/cache/conftool/dbconfig/20230923-214139-arnaudb.json |
[production] |
| 10:14 |
<arnaudb@cumin1001> |
dbctl commit (dc=all): 'Depooling db2108 (T343198)', diff saved to https://phabricator.wikimedia.org/P52580 and previous config saved to /var/cache/conftool/dbconfig/20230923-101423-arnaudb.json |
[production] |
| 10:14 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2108.codfw.wmnet with reason: Maintenance |
[production] |
| 10:14 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2108.codfw.wmnet with reason: Maintenance |
[production] |
| 08:40 |
<taavi> |
restart keystone |
[admin] |
| 08:28 |
<taavi> |
update updatetools.py to gracefully handle NotADirectoryError |
[tools.admin] |
|
2023-09-22
§
|
| 22:56 |
<arnaudb@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2100.codfw.wmnet with reason: Maintenance |
[production] |
| 22:56 |
<arnaudb@cumin1001> |
START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2100.codfw.wmnet with reason: Maintenance |
[production] |
| 19:41 |
<Krinkle> |
Reconfigure https://packagist.org/packages/wikimedia/metrics-platform soure from GitLab back to github.com to fix absence of "dist" source when rebuilding mediawiki-vendor. Reef https://gerrit.wikimedia.org/r/c/mediawiki/vendor/+/960127 |
[releng] |
| 17:32 |
<bearloga@deploy2002> |
Finished deploy [airflow-dags/analytics_product@a30e944]: (no justification provided) (duration: 00m 09s) |
[production] |
| 17:32 |
<bearloga@deploy2002> |
Started deploy [airflow-dags/analytics_product@a30e944]: (no justification provided) |
[production] |
| 17:22 |
<fnegri@cloudcumin1001> |
END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance mcrouter |
[packaging] |
| 17:22 |
<fnegri@cloudcumin1001> |
START - Cookbook wmcs.vps.remove_instance for instance mcrouter |
[packaging] |
| 16:55 |
<wm-bot> |
<lucaswerkmeister> deployed 72c20b3b3e (l10n updates: cs, kai [new, with temporary hacks], tr, zh ⇒ zh-hans) |
[tools.lexeme-forms] |
| 15:46 |
<jhancock@cumin2002> |
START - Cookbook sre.hosts.provision for host ganeti-test2004.mgmt.codfw.wmnet with reboot policy FORCED |
[production] |
| 15:45 |
<bking@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/rdf-streaming-updater: apply |
[production] |
| 15:45 |
<bking@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/rdf-streaming-updater: apply |
[production] |
| 15:44 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 15:44 |
<jhancock@cumin2002> |
END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding ganeti-test server to codfw - jhancock@cumin2002" |
[production] |
| 15:43 |
<jhancock@cumin2002> |
START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Adding ganeti-test server to codfw - jhancock@cumin2002" |
[production] |
| 15:41 |
<jhancock@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:31 |
<bking@deploy2002> |
helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/rdf-streaming-updater: apply |
[production] |
| 15:30 |
<bking@deploy2002> |
helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/rdf-streaming-updater: apply |
[production] |