51-100 of 10000 results (60ms)
2019-05-25 §
09:20 <mobrovac> decommission restbase1011-b - T223976 [production]
04:56 <ariel@deploy1001> Finished deploy [dumps/dumps@61114e0]: add namespaces param only once for abstracts with lang variants (duration: 00m 07s) [production]
04:56 <ariel@deploy1001> Started deploy [dumps/dumps@61114e0]: add namespaces param only once for abstracts with lang variants [production]
00:30 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.6/extensions/VisualEditor/modules/ve-mw/init/ve.init.mw.ArticleTarget.js: Hot-deploy T224319 for VisualEditor switching and auto-restore (duration: 00m 50s) [production]
2019-05-24 §
23:38 <bstorm_> T224062 clouddb1002 is now free of postgresql services and the volume is reclaimed for toolsdb use [clouddb-services]
23:06 <bstorm_> T224318 cloudb-wikilabels-02 is now a replica of clouddb-wikilabels-01! [clouddb-services]
21:56 <urandom> decommissioning restbase1011-a -- T223976 [production]
21:54 <legoktm> maintenance to reduce disk space [codesearch]
21:00 <bstorm_> T224062 Moved wikilabels postgres db to clouddb-wikilabels-01 [clouddb-services]
21:00 <zhuyifei1999_> masked uwsgi service on quarry-web-01 to prevent future mess-ups [quarry]
20:59 <zhuyifei1999_> reenabled puppet on quarry-web-01, should use uwsgi-quarry-web service not uwsgi service [quarry]
20:51 <zhuyifei1999_> disabled puppet on quarry-web-01 because it wants uwsgi dead [quarry]
16:34 <XioNoX> add routinator package to reprepro/APT - T220669 [production]
15:44 <urandom> decommissioning restbase1010-c -- T223976 [production]
15:30 <XioNoX> disable bgp to telia on cr1-codfw for X-connect investigation - T222967 [production]
15:01 <jbond42> upload python{,3}-statsd.3.2.1-2 to jessie-wikimedia [production]
14:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.6/includes/libs/objectcache/: d262078b1 / T220470 (duration: 01m 06s) [production]
11:49 <arturo> T224273 create `toolsbeta-k8s-master-arturo` puppet prefix in horizon [toolsbeta]
11:45 <arturo> T224273 create toolsbeta-k8s-master-arturo-[12] stretch VMs [toolsbeta]
11:45 <hoo> Updated the Wikidata property suggester with data from the 2019-05-13 JSON dump and applied the T132839 workarounds [production]
11:32 <jbond42> [actully] rebooting prometheous1004 now [production]
11:32 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:32 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:25 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:25 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:23 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <jbond@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
11:23 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:23 <jbond42> rebooting prometheous1004 [production]
11:17 <arturo> install by hand some openstack client packages that puppet would refuse to install in toolsbeta-k8s-master-01 [toolsbeta]
11:12 <arturo> mangle sources.list to handle some apt warnings related to missing repos, etc in toolsbeta-k8s-master-01: [toolsbeta]
11:12 <arturo> mangle sources.list to handle some apt warnings related to missing repos, etc [toolsbeta]
10:56 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:56 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:56 <jbond42> rebooting prometheous2003 [production]
10:25 <jbond42> rebooting prometheous2004 [production]
10:25 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:25 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:09 <mobrovac> decommission restbase1010-b - T223976 [production]
07:33 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:33 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
07:32 <moritzm> rebooting labweb* for kernel security update [production]
07:05 <mobrovac> restbase-dev1006 force-stop the cassandra instances, fsync exception during decomm - T224260 [production]
06:47 <moritzm> bounced ferm on mw2286, wasn't correctly started after reboot [production]
06:45 <mobrovac> restbase-dev1006 decommission cass-b - T224260 [production]
06:43 <_joe_> disable notifications in icinga for restbase-dev1006 T224260 [production]
06:40 <mobrovac> restbase-dev1006 decommission cass-a - T224260 [production]
06:39 <mobrovac> restbase-dev1006 stop restbase - T224260 [production]
06:38 <mobrovac> restbase-dev1006 puppet disabled - T224260 [production]