7651-7700 of 10000 results (24ms)
2023-03-20 §
13:41 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.reimage (exit_code=0) for host cuminunpriv1001.eqiad.wmnet with OS bullseye [production]
13:39 <samtar@deploy2002> aleksandar and samtar: Backport for [[gerrit:900675|SITENAME change of Serbo-Croatian Wikipedia (T332468)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2001.codfw.wmnet [production]
13:39 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by taavi@runko [tools]
13:38 <samtar@deploy2002> Started scap: Backport for [[gerrit:900675|SITENAME change of Serbo-Croatian Wikipedia (T332468)]] [production]
13:37 <samtar@deploy2002> Finished scap: Backport for [[gerrit:900689|kuwiktionary: Add wordmark (T326067)]], [[gerrit:900742|trwikivoyage: Update wordmark (T332439)]] (duration: 08m 46s) [production]
13:35 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on lvs2008.codfw.wmnet with reason: rebooting for kernel updates [production]
13:35 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on lvs2008.codfw.wmnet with reason: rebooting for kernel updates [production]
13:34 <sukhe@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on lvs3005.esams.wmnet with reason: rebooting for kernel updates [production]
13:34 <sukhe@cumin2002> START - Cookbook sre.hosts.downtime for 0:30:00 on lvs3005.esams.wmnet with reason: rebooting for kernel updates [production]
13:30 <awight@deploy2002> Finished deploy [kartotherian/deploy@906be32] (eqiad): Update kartotherian to a6e9843 (duration: 01m 30s) [production]
13:29 <samtar@deploy2002> stang and samtar: Backport for [[gerrit:900689|kuwiktionary: Add wordmark (T326067)]], [[gerrit:900742|trwikivoyage: Update wordmark (T332439)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet [production]
13:29 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cuminunpriv1001.eqiad.wmnet with reason: host reimage [production]
13:29 <awight@deploy2002> Started deploy [kartotherian/deploy@906be32] (eqiad): Update kartotherian to a6e9843 [production]
13:28 <samtar@deploy2002> Started scap: Backport for [[gerrit:900689|kuwiktionary: Add wordmark (T326067)]], [[gerrit:900742|trwikivoyage: Update wordmark (T332439)]] [production]
13:28 <kharlan@deploy2002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:26 <awight@deploy2002> Finished deploy [kartotherian/deploy@906be32] (codfw): Update kartotherian to a6e9843 (duration: 01m 39s) [production]
13:26 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cuminunpriv1001.eqiad.wmnet with reason: host reimage [production]
13:24 <awight@deploy2002> Started deploy [kartotherian/deploy@906be32] (codfw): Update kartotherian to a6e9843 [production]
13:18 <samtar@deploy2002> Finished scap: Backport for [[gerrit:900537|bewiki: Remove group "autoeditor", "reviewer" (T326012)]], [[gerrit:900690|slwiki: Create Draft namespace (T332351)]] (duration: 11m 36s) [production]
13:18 <jmm@cumin2002> START - Cookbook sre.ganeti.reimage for host cuminunpriv1001.eqiad.wmnet with OS bullseye [production]
13:17 <kharlan@deploy2002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:17 <kharlan@deploy2002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:15 <kharlan@deploy2002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:14 <kharlan@deploy2002> helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:14 <kharlan@deploy2002> helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:12 <Rook> move paws to k8s 1.23 b1d0daeb20cfeb6981653d65e44cf6175eded539 T328489 [paws]
13:08 <samtar@deploy2002> stang and samtar: Backport for [[gerrit:900537|bewiki: Remove group "autoeditor", "reviewer" (T326012)]], [[gerrit:900690|slwiki: Create Draft namespace (T332351)]] synced to the testservers: mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet [production]
13:06 <samtar@deploy2002> Started scap: Backport for [[gerrit:900537|bewiki: Remove group "autoeditor", "reviewer" (T326012)]], [[gerrit:900690|slwiki: Create Draft namespace (T332351)]] [production]
11:35 <krinkle@deploy2002> Synchronized php-1.40.0-wmf.27/includes/libs/rdbms/: (no justification provided) (duration: 15m 28s) [production]
10:57 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by arturo@endurance [tools]
09:57 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 36692 [production]
09:56 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 36692 [production]
09:56 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 12956 [production]
09:56 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 12956 [production]
09:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 141082 [production]
09:55 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 141082 [production]
09:55 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 58655 [production]
09:54 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 58655 [production]
09:54 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 2552 [production]
09:54 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'email' for AS: 2552 [production]
09:51 <wm-bot> <urbanecm> Deploy d95dac4ea26 [tools.stewardbots]
09:21 <claime> Repooling parse2004 - T332119 [production]
08:18 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'show' for AS: 138915 [production]
08:18 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'show' for AS: 138915 [production]
08:15 <ayounsi@cumin1001> END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 138915 [production]
08:00 <ayounsi@cumin1001> START - Cookbook sre.network.peering with action 'configure' for AS: 138915 [production]
00:53 <Krinkle> Add Majavah to https://toolsadmin.wikimedia.org/tools/id/guc [tools.guc]
2023-03-19 §
22:34 <TheresNoTime> (beta) `samtar@deployment-kafka-logging01:~$ sudo systemctl restart kafka.service`, noticed beta-logs wasn't showing logs from ~14:00UTC in T332507 [releng]
22:10 <TheresNoTime> (beta) `GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, REFERENCES, INDEX, ALTER, CREATE TEMPORARY TABLES, LOCK TABLES, EXECUTE, CREATE VIEW, SHOW VIEW, CREATE ROUTINE, ALTER ROUTINE, EVENT, TRIGGER ON mainstash.* TO 'wikiadmin'@'172.16.%';` T322469 [releng]
21:40 <wm-bot> <lucaswerkmeister> deployed cf1e031a43 (l10n updates: fi, tt) [tools.lexeme-forms]