2651-2700 of 10000 results (44ms)
2023-12-05 ยง
21:43 <jforrester@deploy2002> ksarabia and jforrester and cjming: Backport for [[gerrit:977785|Define the corresponding stream for scroll (T350883)]], [[gerrit:978947|Add stream config for *webuiactions via Metrics Platform (T351298)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:43 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2112.codfw.wmnet with reason: Maintenance [production]
21:43 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2112.codfw.wmnet with reason: Maintenance [production]
21:42 <jforrester@deploy2002> Started scap: Backport for [[gerrit:977785|Define the corresponding stream for scroll (T350883)]], [[gerrit:978947|Add stream config for *webuiactions via Metrics Platform (T351298)]] [production]
21:40 <jforrester@deploy2002> Finished scap: Backport for [[gerrit:979704|[Zebra] Make .vector-column-start cache compatible (T347712 T351830)]], [[gerrit:980467|Fix nonzebra sticky container scrolling behavior and scrollable indicator (T352464)]] (duration: 12m 50s) [production]
21:35 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2102.codfw.wmnet with reason: Maintenance [production]
21:34 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db2102.codfw.wmnet with reason: Maintenance [production]
21:34 <jforrester@deploy2002> jdlrobson and jforrester and jdrewniak: Continuing with sync [production]
21:30 <jforrester@deploy2002> jdlrobson and jforrester and jdrewniak: Backport for [[gerrit:979704|[Zebra] Make .vector-column-start cache compatible (T347712 T351830)]], [[gerrit:980467|Fix nonzebra sticky container scrolling behavior and scrollable indicator (T352464)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:29 <hashar> Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/979998 # T352681 [releng]
21:27 <jforrester@deploy2002> Started scap: Backport for [[gerrit:979704|[Zebra] Make .vector-column-start cache compatible (T347712 T351830)]], [[gerrit:980467|Fix nonzebra sticky container scrolling behavior and scrollable indicator (T352464)]] [production]
21:27 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
21:27 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on dbstore1003.eqiad.wmnet with reason: Maintenance [production]
21:27 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1219 (T348183)', diff saved to https://phabricator.wikimedia.org/P54208 and previous config saved to /var/cache/conftool/dbconfig/20231205-212707-arnaudb.json [production]
21:27 <jforrester@deploy2002> Finished scap: Backport for [[gerrit:980028|Deploy VectorClientPreferences to beta on pl,fr,ca,fa,tr wikis (T351339)]] (duration: 13m 44s) [production]
21:19 <jforrester@deploy2002> bwang and jforrester: Continuing with sync [production]
21:13 <jforrester@deploy2002> Started scap: Backport for [[gerrit:980028|Deploy VectorClientPreferences to beta on pl,fr,ca,fa,tr wikis (T351339)]] [production]
21:12 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P54207 and previous config saved to /var/cache/conftool/dbconfig/20231205-211200-arnaudb.json [production]
21:11 <jforrester@deploy2002> Finished scap: Backport for [[gerrit:972263|Revert "Do not try to use Thumbor on beta" (T344605)]], [[gerrit:980009|nlwikivoyage: Drop Listings extension (T352696)]], [[gerrit:980047|Drop Listings extension from Wikivoyages where unused (T352719)]] (duration: 08m 45s) [production]
21:09 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) [tools]
21:09 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors [tools]
21:08 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) [toolsbeta]
21:07 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors [toolsbeta]
21:07 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) [toolsbeta]
21:07 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors [toolsbeta]
21:04 <jforrester@deploy2002> tgr and jforrester: Continuing with sync [production]
21:04 <jforrester@deploy2002> tgr and jforrester: Backport for [[gerrit:972263|Revert "Do not try to use Thumbor on beta" (T344605)]], [[gerrit:980009|nlwikivoyage: Drop Listings extension (T352696)]], [[gerrit:980047|Drop Listings extension from Wikivoyages where unused (T352719)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
21:02 <jforrester@deploy2002> Started scap: Backport for [[gerrit:972263|Revert "Do not try to use Thumbor on beta" (T344605)]], [[gerrit:980009|nlwikivoyage: Drop Listings extension (T352696)]], [[gerrit:980047|Drop Listings extension from Wikivoyages where unused (T352719)]] [production]
20:58 <inflatador> bking@prometheus1006 disable puppet for troubleshooting T347355 [production]
20:56 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P54206 and previous config saved to /var/cache/conftool/dbconfig/20231205-205654-arnaudb.json [production]
20:53 <inflatador> bking@prometheus1006 reload prometheus-blackbox service T347355 [production]
20:41 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1219 (T348183)', diff saved to https://phabricator.wikimedia.org/P54205 and previous config saved to /var/cache/conftool/dbconfig/20231205-204147-arnaudb.json [production]
20:31 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1219 (T348183)', diff saved to https://phabricator.wikimedia.org/P54204 and previous config saved to /var/cache/conftool/dbconfig/20231205-203158-arnaudb.json [production]
20:31 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1219.eqiad.wmnet with reason: Maintenance [production]
20:31 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1219.eqiad.wmnet with reason: Maintenance [production]
20:31 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1218 (T348183)', diff saved to https://phabricator.wikimedia.org/P54203 and previous config saved to /var/cache/conftool/dbconfig/20231205-203136-arnaudb.json [production]
20:16 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P54202 and previous config saved to /var/cache/conftool/dbconfig/20231205-201629-arnaudb.json [production]
20:01 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P54201 and previous config saved to /var/cache/conftool/dbconfig/20231205-200123-arnaudb.json [production]
19:46 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1218 (T348183)', diff saved to https://phabricator.wikimedia.org/P54200 and previous config saved to /var/cache/conftool/dbconfig/20231205-194616-arnaudb.json [production]
19:40 <wm-bot> <lucaswerkmeister> deployed 95ee032c68 (l10n updates: ca, hno, io, it, pnb, sl, tr; i18n test improvements and fixes) [tools.lexeme-forms]
19:36 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1218 (T348183)', diff saved to https://phabricator.wikimedia.org/P54199 and previous config saved to /var/cache/conftool/dbconfig/20231205-193627-arnaudb.json [production]
19:36 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1218.eqiad.wmnet with reason: Maintenance [production]
19:36 <arnaudb@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on db1218.eqiad.wmnet with reason: Maintenance [production]
19:36 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1207 (T348183)', diff saved to https://phabricator.wikimedia.org/P54198 and previous config saved to /var/cache/conftool/dbconfig/20231205-193604-arnaudb.json [production]
19:20 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1207', diff saved to https://phabricator.wikimedia.org/P54197 and previous config saved to /var/cache/conftool/dbconfig/20231205-192057-arnaudb.json [production]
19:16 <andrewbogott> rebooting tools-sgeweblight-10-26.tools.eqiad1.wikimedia.cloud; can't log in even with root key [tools]
19:05 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1207', diff saved to https://phabricator.wikimedia.org/P54196 and previous config saved to /var/cache/conftool/dbconfig/20231205-190551-arnaudb.json [production]
18:50 <arnaudb@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db1207 (T348183)', diff saved to https://phabricator.wikimedia.org/P54195 and previous config saved to /var/cache/conftool/dbconfig/20231205-185044-arnaudb.json [production]
18:41 <arnaudb@cumin1001> dbctl commit (dc=all): 'Depooling db1207 (T348183)', diff saved to https://phabricator.wikimedia.org/P54194 and previous config saved to /var/cache/conftool/dbconfig/20231205-184108-arnaudb.json [production]
18:41 <arnaudb@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1207.eqiad.wmnet with reason: Maintenance [production]