4051-4100 of 10000 results (20ms)
2025-08-28 ยง
09:52 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2148 (T401906)', diff saved to https://phabricator.wikimedia.org/P81982 and previous config saved to /var/cache/conftool/dbconfig/20250828-095240-fceratto.json [production]
09:52 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2148.codfw.wmnet with reason: Maintenance [production]
09:50 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P81981 and previous config saved to /var/cache/conftool/dbconfig/20250828-095019-ladsgroup.json [production]
09:35 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P81980 and previous config saved to /var/cache/conftool/dbconfig/20250828-093511-ladsgroup.json [production]
09:20 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2193 (T402925)', diff saved to https://phabricator.wikimedia.org/P81979 and previous config saved to /var/cache/conftool/dbconfig/20250828-092004-ladsgroup.json [production]
09:17 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db2193 (T402925)', diff saved to https://phabricator.wikimedia.org/P81978 and previous config saved to /var/cache/conftool/dbconfig/20250828-091750-ladsgroup.json [production]
09:17 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2193.codfw.wmnet with reason: Maintenance [production]
09:17 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T402925)', diff saved to https://phabricator.wikimedia.org/P81977 and previous config saved to /var/cache/conftool/dbconfig/20250828-091727-ladsgroup.json [production]
09:02 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P81975 and previous config saved to /var/cache/conftool/dbconfig/20250828-090219-ladsgroup.json [production]
08:48 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [tools]
08:47 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2180', diff saved to https://phabricator.wikimedia.org/P81974 and previous config saved to /var/cache/conftool/dbconfig/20250828-084711-ladsgroup.json [production]
08:46 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-reverted' for release 'main' . [production]
08:42 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [tools]
08:42 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [toolsbeta]
08:42 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-goodfaith' for release 'main' . [production]
08:37 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-editquality-damaging' for release 'main' . [production]
08:37 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component components-api [toolsbeta]
08:32 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2180 (T402925)', diff saved to https://phabricator.wikimedia.org/P81973 and previous config saved to /var/cache/conftool/dbconfig/20250828-083204-ladsgroup.json [production]
08:31 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-drafttopic' for release 'main' . [production]
08:30 <stevemunene@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on dse-k8s-worker2001.codfw.wmnet with reason: Bootstrapping new dse-k8s-codfw-cluster [production]
08:30 <stevemunene@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on dse-k8s-worker2002.codfw.wmnet with reason: Bootstrapping new dse-k8s-codfw-cluster [production]
08:29 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db2180 (T402925)', diff saved to https://phabricator.wikimedia.org/P81972 and previous config saved to /var/cache/conftool/dbconfig/20250828-082951-ladsgroup.json [production]
08:29 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2180.codfw.wmnet with reason: Maintenance [production]
08:29 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2169 (T402925)', diff saved to https://phabricator.wikimedia.org/P81971 and previous config saved to /var/cache/conftool/dbconfig/20250828-082928-ladsgroup.json [production]
08:29 <stevemunene@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on dse-k8s-ctrl2002.codfw.wmnet with reason: Bootstrapping new dse-k8s-codfw-cluster [production]
08:28 <stevemunene@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on dse-k8s-ctrl2001.codfw.wmnet with reason: Bootstrapping new dse-k8s-codfw-cluster [production]
08:27 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]
08:20 <wmbot~dcaro@acme> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T402521) [catalyst-dev]
08:20 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.quota_increase (T402521) [catalyst-dev]
08:20 <wmbot~dcaro@acme> END (FAIL) - Cookbook wmcs.openstack.quota_increase (exit_code=99) (T402521) [catalyst-dev]
08:20 <wmbot~dcaro@acme> START - Cookbook wmcs.openstack.quota_increase (T402521) [catalyst-dev]
08:19 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articletopic' for release 'main' . [production]
08:14 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P81970 and previous config saved to /var/cache/conftool/dbconfig/20250828-081420-ladsgroup.json [production]
08:12 <aklapper@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.45.0-wmf.16 refs T396377 [production]
08:07 <kevinbazira@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
07:59 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2169', diff saved to https://phabricator.wikimedia.org/P81969 and previous config saved to /var/cache/conftool/dbconfig/20250828-075912-ladsgroup.json [production]
07:44 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2169 (T402925)', diff saved to https://phabricator.wikimedia.org/P81967 and previous config saved to /var/cache/conftool/dbconfig/20250828-074404-ladsgroup.json [production]
07:27 <dcausse> T271776: reindexing all lexemes in wikidatawiki [production]
07:27 <dcausse> T271776: reindexing all lexemes in testwikidatawiki [production]
07:25 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db2169 (T402925)', diff saved to https://phabricator.wikimedia.org/P81966 and previous config saved to /var/cache/conftool/dbconfig/20250828-072553-ladsgroup.json [production]
07:25 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2169.codfw.wmnet with reason: Maintenance [production]
07:25 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2158 (T402925)', diff saved to https://phabricator.wikimedia.org/P81965 and previous config saved to /var/cache/conftool/dbconfig/20250828-072530-ladsgroup.json [production]
07:10 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2158', diff saved to https://phabricator.wikimedia.org/P81964 and previous config saved to /var/cache/conftool/dbconfig/20250828-071022-ladsgroup.json [production]
07:06 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.osd.depool_and_destroy [admin]
07:06 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) [admin]
06:55 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2158', diff saved to https://phabricator.wikimedia.org/P81963 and previous config saved to /var/cache/conftool/dbconfig/20250828-065515-ladsgroup.json [production]
06:40 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2158 (T402925)', diff saved to https://phabricator.wikimedia.org/P81962 and previous config saved to /var/cache/conftool/dbconfig/20250828-064007-ladsgroup.json [production]
06:21 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db2158 (T402925)', diff saved to https://phabricator.wikimedia.org/P81961 and previous config saved to /var/cache/conftool/dbconfig/20250828-062149-ladsgroup.json [production]
06:21 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2158.codfw.wmnet with reason: Maintenance [production]
06:21 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2151 (T402925)', diff saved to https://phabricator.wikimedia.org/P81960 and previous config saved to /var/cache/conftool/dbconfig/20250828-062127-ladsgroup.json [production]