1951-2000 of 10000 results (29ms)
2025-04-07 §
08:58 <daniel@deploy1003> daniel: Backport for [[gerrit:1134400|EventIngress: use getDeletedPage instead of getPageStateBefore (T388588 T391051)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
08:53 <daniel@deploy1003> Started scap sync-world: Backport for [[gerrit:1134400|EventIngress: use getDeletedPage instead of getPageStateBefore (T388588 T391051)]] [production]
08:44 <ayounsi@cumin1002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host atlas1001.wikimedia.org [production]
08:44 <ayounsi@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM atlas1001.wikimedia.org - ayounsi@cumin1002" [production]
08:44 <ayounsi@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM atlas1001.wikimedia.org - ayounsi@cumin1002" [production]
08:44 <ayounsi@cumin1002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) atlas1001.wikimedia.org on all recursors [production]
08:44 <ayounsi@cumin1002> START - Cookbook sre.dns.wipe-cache atlas1001.wikimedia.org on all recursors [production]
08:44 <ayounsi@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
08:44 <ayounsi@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM atlas1001.wikimedia.org - ayounsi@cumin1002" [production]
08:43 <ayounsi@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM atlas1001.wikimedia.org - ayounsi@cumin1002" [production]
08:41 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli [tools]
08:39 <ayounsi@cumin1002> START - Cookbook sre.dns.netbox [production]
08:39 <ayounsi@cumin1002> START - Cookbook sre.ganeti.makevm for new host atlas1001.wikimedia.org [production]
08:29 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [tools]
08:28 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli [toolsbeta]
08:18 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [toolsbeta]
08:12 <daniel@deploy1003> Started scap sync-world: Backport for [[gerrit:1134400|EventIngress: use getDeletedPage instead of getPageStateBefore (T388588 T391051)]] [production]
08:10 <fabfur> deploying https://gerrit.wikimedia.org/r/c/operations/puppet/+/1133897 on A:cp-codfw (T384227) [production]
08:10 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db[2160,2234].codfw.wmnet with reason: Maintenance [production]
08:09 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2230.codfw.wmnet,db1176.eqiad.wmnet with reason: Maintenance [production]
08:06 <fabfur> disable puppet on A:cp-codfw to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/1133897 (T384227) [production]
07:59 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
07:47 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
07:45 <dcausse> T391122: reconciled 14 wikidata items (lost EventBus/eventgate events) [production]
07:45 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
07:34 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
07:11 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
06:59 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
06:40 <daniel@deploy1003> Started scap sync-world: Backport for [[gerrit:1134400|EventIngress: use getDeletedPage instead of getPageStateBefore (T388588 T391051)]] [production]
05:42 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli [tools]
05:31 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [tools]
04:15 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-cli [toolsbeta]
04:04 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-cli [toolsbeta]
2025-04-06 §
02:20 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [admin]
02:18 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
02:12 <andrewbogott> truncating large logfiles on tools nfs [tools]
2025-04-04 §
21:18 <inflatador> bking@apt1002 publish-wmf-opensearch-search-plugins_1.3.20-4 to component/opensearch13 bullseye-wikimedia 1134285 [production]
20:22 <urandom> starting `nodetool garbage collect -j 2`, sessionstore Cassandra [production]
19:48 <wmbot~lucaswerkmeister@tools-bastion-13> deployed a377a0be8c (remove unneeded CSS) [tools.lexeme-forms]
19:42 <wmbot~lucaswerkmeister@tools-bastion-13> deployed 79c8ebeac5 (Bootstrap 5.3 and better RTL support) [tools.ranker]
19:15 <mforns> reran commons_impact_metrics_monthly for 2025-03 after an allow list update [analytics]
19:03 <akosiaris@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-wikifunctions: apply [production]
19:03 <akosiaris@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-wikifunctions: apply [production]
18:57 <akosiaris@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-wikifunctions: apply [production]
18:56 <akosiaris@deploy1003> helmfile [codfw] START helmfile.d/services/mw-wikifunctions: apply [production]
18:49 <jhancock@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ganeti2045.codfw.wmnet with OS bookworm [production]
18:44 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti2046.codfw.wmnet with OS bookworm [production]
18:34 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti2045.codfw.wmnet with OS bookworm [production]
18:28 <mutante> - deleting instance codesearch. replace by instance sourcebot1 in project codesearch [devtools]
17:12 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]