6251-6300 of 10000 results (103ms)
2023-03-13 ยง
16:17 <bd808@deploy2002> helmfile [codfw] DONE helmfile.d/services/developer-portal: apply [production]
16:17 <bd808@deploy2002> helmfile [codfw] START helmfile.d/services/developer-portal: apply [production]
16:17 <bd808@deploy2002> helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply [production]
16:16 <bd808@deploy2002> helmfile [eqiad] START helmfile.d/services/developer-portal: apply [production]
16:16 <bd808@deploy2002> helmfile [staging] DONE helmfile.d/services/developer-portal: apply [production]
16:16 <bd808@deploy2002> helmfile [staging] START helmfile.d/services/developer-portal: apply [production]
16:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103', diff saved to https://phabricator.wikimedia.org/P45782 and previous config saved to /var/cache/conftool/dbconfig/20230313-161337-marostegui.json [production]
16:11 <dancy@deploy2002> Started scap: testing [production]
16:06 <jdrewniak@deploy2002> Synchronized portals: Wikimedia Portals Update: [[gerrit:897915| Bumping portals to master (T128546)]] (duration: 06m 15s) [production]
16:00 <moritzm> imported xdebug 3.0.3+2.9.8+2.8.1+2.5.5-0+deb11u1+wmf1+buster1+icu67u1 T329491 [production]
16:00 <jdrewniak@deploy2002> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:897915| Bumping portals to master (T128546)]] (duration: 06m 43s) [production]
15:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2103 (T329260)', diff saved to https://phabricator.wikimedia.org/P45781 and previous config saved to /var/cache/conftool/dbconfig/20230313-155830-marostegui.json [production]
15:46 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2103 (T329260)', diff saved to https://phabricator.wikimedia.org/P45780 and previous config saved to /var/cache/conftool/dbconfig/20230313-154641-marostegui.json [production]
15:46 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2103.codfw.wmnet with reason: Maintenance [production]
15:46 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2103.codfw.wmnet with reason: Maintenance [production]
15:38 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2102.codfw.wmnet with reason: Maintenance [production]
15:37 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2102.codfw.wmnet with reason: Maintenance [production]
15:35 <moritzm> imported php-yaml 2.2.1+2.1.0+2.0.4+1.3.2-2+wmf1~buster1+icu67u1 T329491 [production]
15:31 <dancy@deploy2002> Finished scap: testing T329857 (duration: 10m 08s) [production]
15:29 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
15:29 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2097.codfw.wmnet with reason: Maintenance [production]
15:25 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2118.codfw.wmnet with reason: Maintenance [production]
15:24 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2118.codfw.wmnet with reason: Maintenance [production]
15:21 <dancy@deploy2002> Started scap: testing T329857 [production]
15:06 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/thumbor: sync [production]
15:05 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/thumbor: sync [production]
15:05 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T329260)', diff saved to https://phabricator.wikimedia.org/P45779 and previous config saved to /var/cache/conftool/dbconfig/20230313-150523-marostegui.json [production]
15:03 <hnowlan@deploy2002> helmfile [staging] DONE helmfile.d/services/thumbor: sync [production]
14:53 <hnowlan@deploy2002> helmfile [staging] START helmfile.d/services/thumbor: sync [production]
14:51 <hnowlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/thumbor: sync [production]
14:51 <hnowlan@deploy2002> helmfile [codfw] START helmfile.d/services/thumbor: sync [production]
14:51 <hnowlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/thumbor: sync [production]
14:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P45778 and previous config saved to /var/cache/conftool/dbconfig/20230313-145016-marostegui.json [production]
14:50 <hnowlan@deploy2002> helmfile [eqiad] START helmfile.d/services/thumbor: sync [production]
14:38 <jbond> disable puppet fleet wide to debug strange issue [production]
14:35 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P45777 and previous config saved to /var/cache/conftool/dbconfig/20230313-143510-marostegui.json [production]
14:23 <claime> switch noc.wikimedia.org from eqiad to codfw - T331634 [production]
14:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2182 (T329260)', diff saved to https://phabricator.wikimedia.org/P45776 and previous config saved to /var/cache/conftool/dbconfig/20230313-142004-marostegui.json [production]
14:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db2182 (T329260)', diff saved to https://phabricator.wikimedia.org/P45774 and previous config saved to /var/cache/conftool/dbconfig/20230313-141409-marostegui.json [production]
14:14 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2182.codfw.wmnet with reason: Maintenance [production]
14:13 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 12:00:00 on db2182.codfw.wmnet with reason: Maintenance [production]
14:13 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2169:3317 (T329260)', diff saved to https://phabricator.wikimedia.org/P45773 and previous config saved to /var/cache/conftool/dbconfig/20230313-141348-marostegui.json [production]
14:00 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
13:59 <gmodena@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
13:58 <marostegui@cumin1001> dbctl commit (dc=all): 'Repooling after maintenance db2169:3317', diff saved to https://phabricator.wikimedia.org/P45772 and previous config saved to /var/cache/conftool/dbconfig/20230313-135842-marostegui.json [production]
13:50 <lucaswerkmeister-wmde@deploy2002> helmfile [codfw] DONE helmfile.d/services/termbox: apply [production]
13:49 <lucaswerkmeister-wmde@deploy2002> helmfile [codfw] START helmfile.d/services/termbox: apply [production]
13:48 <lucaswerkmeister-wmde@deploy2002> helmfile [eqiad] DONE helmfile.d/services/termbox: apply [production]
13:48 <milimetric@deploy2002> Finished deploy [airflow-dags/analytics@4696eff]: Deploying analytics dags from origin/main_airflow_2.5 [airflow-dags@4f393e6] (duration: 00m 11s) [production]
13:48 <milimetric@deploy2002> Started deploy [airflow-dags/analytics@4696eff]: Deploying analytics dags from origin/main_airflow_2.5 [airflow-dags@4f393e6] [production]