1-50 of 10000 results (52ms)
2019-12-18 §
23:44 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.11/includes/libs/objectcache/MemcachedPeclBagOStuff.php: Iacbc9ebda681 (duration: 01m 01s) [production]
23:27 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.11/includes/resourceloader/ResourceLoaderFileModule.php: I3fe9f0a9ddc (duration: 01m 02s) [production]
23:17 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: If465c0ef cleanup (duration: 01m 01s) [production]
21:33 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@9dd8227]: Update mobileapps to cf2bb3b (duration: 05m 51s) [production]
21:27 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@9dd8227]: Update mobileapps to cf2bb3b [production]
21:22 <halfak@deploy1001> Finished deploy [ores/deploy@80b1e62]: T240725 (duration: 22m 05s) [production]
21:01 <ppchelko@deploy1001> Finished deploy [cpjobqueue/deploy@7e68510]: Return low_traffic_jobs concurrency to normal after T240518 (duration: 01m 03s) [production]
21:00 <halfak@deploy1001> Started deploy [ores/deploy@80b1e62]: T240725 [production]
21:00 <ppchelko@deploy1001> Started deploy [cpjobqueue/deploy@7e68510]: Return low_traffic_jobs concurrency to normal after T240518 [production]
20:50 <ppchelko@deploy1001> Finished deploy [restbase/deploy@6e24349]: Disable all parsoid-php vs parsoid-js special cases T229015 (duration: 13m 56s) [production]
20:36 <ppchelko@deploy1001> Started deploy [restbase/deploy@6e24349]: Disable all parsoid-php vs parsoid-js special cases T229015 [production]
20:04 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Enable banner on Special:Block for selected wikis - T240300 (duration: 01m 01s) [production]
19:59 <niharika29@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/WikimediaMessages/includes/WikimediaMessagesHooks.php: Remove messagebox class from partial block banner - T240300 (duration: 01m 02s) [production]
19:47 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@4b174fd]: glent: Explicitly pass previous partition to m2run (duration: 00m 10s) [production]
19:47 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@4b174fd]: glent: Explicitly pass previous partition to m2run [production]
19:27 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Bump Parsoid/PHP cluster memory_limit - T239806, T236833 (duration: 01m 01s) [production]
18:58 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . [production]
18:56 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . [production]
18:51 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@20e4c16]: Update glent to spark 2.4.4 (duration: 00m 29s) [production]
18:51 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@20e4c16]: Update glent to spark 2.4.4 [production]
18:18 <jynus> disable puppet on backup1001, dbprov1001 to test special backup recovery [production]
18:15 <cdanis@deploy1001> Synchronized wmf-config/db-eqiad.php: remove dbctl-obsoleted hostsByName entries 🔧 7d20965f5 T240991 T229676 (duration: 01m 01s) [production]
18:13 <cdanis@deploy1001> Synchronized wmf-config/db-codfw.php: remove dbctl-obsoleted hostsByName entries 🔧 7d20965f5 T240991 T229676 (duration: 01m 01s) [production]
18:00 <cdanis@deploy1001> Synchronized wmf-config/etcd.php: use hostsByName from etcd 96df9c004 T229676 T240991 (duration: 01m 01s) [production]
17:58 <cdanis@deploy1001> Synchronized wmf-config/CommonSettings.php: use hostsByName from etcd 96df9c004 T229676 T240991 (duration: 01m 01s) [production]
17:52 <jynus> reload dbproxy1017 dbproxy1021 [production]
17:34 <jforrester@deploy1001> Finished scap: Full scap for extra AHT i18n (duration: 14m 09s) [production]
17:33 <ppchelko@deploy1001> Finished deploy [restbase/deploy@c9d8ef1]: Parsoid-PHP: mirror 100% of all traffic T229015 (duration: 16m 00s) [production]
17:20 <jforrester@deploy1001> Started scap: Full scap for extra AHT i18n [production]
17:18 <ppchelko@deploy1001> Started deploy [restbase/deploy@c9d8ef1]: Parsoid-PHP: mirror 100% of all traffic T229015 [production]
16:30 <akosiaris@cumin1001> conftool action : set/weight=10; selector: dc=codfw,service=echostore [production]
16:29 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . [production]
16:25 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
16:21 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
16:21 <akosiaris> remove kubestagetcd100{1,2,3} from the fleet T239835 [production]
16:19 <akosiaris@cumin1001> conftool action : set/weight=10; selector: name=kubernetes2002.codfw.wmnet,service=echostore [production]
16:18 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
15:58 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: train: Rolling Wikitech foward to 1.35.0-wmf.11 T233859 T241059 [production]
15:55 <addshore> addshore@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildPropertyTerms.php --wiki=wikidatawiki --batch-size=1 --from-id=14546856 # T237984 (will run to completion) [production]
15:42 <otto@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
15:34 <otto@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
15:31 <otto@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'eventgate-logging-external' for release 'logging-external' . [production]
15:21 <bblack> cr[23]-esams: ns2 authdns static routing: route to both of dns300[12] w/ ECMP (was just dns3001) [production]
15:07 <akosiaris> repool all codfw k8s services. T239835 [production]
15:06 <akosiaris@cumin1001> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=(eventgate.*|mathoid|citoid|restrouter|sessionstore|echostore|zotero|termbox|wikifeeds|cxserver|blubberoid) [production]
14:49 <jforrester@deploy1001> rebuilt and synchronized wikiversions files: train: Rolling Commons foward to 1.35.0-wmf.11 T233859 T241057 [production]
14:45 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.11/extensions/Wikibase: [[gerrit:559064|Fix DatabaseEntityInfoBuilder on federated repos (T241057)]] (duration: 01m 07s) [production]
14:38 <jbond42> restart apache on phab [production]
14:37 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
14:37 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]