501-550 of 10000 results (57ms)
2019-09-21 §
00:48 <mutante> aqs1005 - systemctl restart aqs [production]
00:46 <shdubsh> restarting logstash on logstash1008 without udp-localhost-eqiad/codfw configs [production]
00:39 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp1088.eqiad.wmnet [production]
00:38 <bblack> depooling confctl things in rack D2 [production]
00:38 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp1087.eqiad.wmnet [production]
2019-09-20 §
21:30 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.22/extensions/CheckUser: fix T233453 (duration: 00m 56s) [production]
21:29 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/CheckUser: fix T233453 (duration: 00m 58s) [production]
19:26 <XioNoX> update eqsin firewall filters - T233268 [production]
16:35 <krinkle@deploy1001> Synchronized vendor/: ead70240892e9 (duration: 00m 59s) [production]
16:14 <XioNoX> update eqiad firewall filters - T233268 [production]
16:11 <XioNoX> update esams firewall filters - T233268 [production]
15:17 <Urbanecm> mwscript extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=bgwiki --logwiki=metawiki 'Newrdkter' 'NRdk' (T233313) [production]
15:03 <XioNoX> remove AS-PATH prepending in ams [production]
11:29 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:22 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:22 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:22 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:16 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
11:15 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
10:17 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) [production]
10:17 <jbond@cumin1001> Updating IPMI password on 1 hosts - jbond@cumin1001 [production]
10:17 <jbond@cumin1001> START - Cookbook sre.hosts.ipmi-password-reset [production]
10:17 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) [production]
10:17 <jbond@cumin1001> Updating IPMI password on 1 hosts - jbond@cumin1001 [production]
10:17 <jbond@cumin1001> START - Cookbook sre.hosts.ipmi-password-reset [production]
10:17 <jbond@cumin1001> END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) [production]
10:17 <jbond@cumin1001> START - Cookbook sre.hosts.ipmi-password-reset [production]
09:31 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.ipmi-password-reset (exit_code=0) [production]
09:31 <jbond@cumin1001> Updating IPMI password on 1 hosts - jbond@cumin1001 [production]
09:31 <jbond@cumin1001> START - Cookbook sre.hosts.ipmi-password-reset [production]
09:30 <jbond@cumin1001> END (ERROR) - Cookbook sre.hosts.ipmi-password-reset (exit_code=97) [production]
09:30 <jbond@cumin1001> START - Cookbook sre.hosts.ipmi-password-reset [production]
09:30 <jbond@cumin1001> END (FAIL) - Cookbook sre.hosts.ipmi-password-reset (exit_code=99) [production]
09:30 <jbond@cumin1001> START - Cookbook sre.hosts.ipmi-password-reset [production]
08:52 <jynus> creating new database on m1 "bacula9" T229209 [production]
08:28 <hashar> Killed zuul-server process on contint2001 which was establishing connections to Gerrit and filling the pool of allowed ssh connections # T233390 [production]
08:23 <hashar> CI in default since it is somehow no more able to fetch from Gerrit T233390 [production]
08:20 <hashar> contint1001: upgrade zuul to 2.5.1-wmf10 # T203846 [production]
08:12 <hashar> contint2001: upgrade zuul to 2.5.1-wmf10 # T203846 [production]
07:46 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
07:46 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:46 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
07:45 <jmm@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:29 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
07:28 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:14 <godog> eqiad-prod: start ms-be1027 decom - T233289 [production]
05:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove db1089 from logpager and contributions after testing, repool back with normal weight on main traffic T223151', diff saved to https://phabricator.wikimedia.org/P9136 and previous config saved to /var/cache/conftool/dbconfig/20190920-052902-marostegui.json [production]
05:27 <marostegui> Analyze table enwiki.logging on db2102 - T223151 [production]
05:07 <marostegui> Remove temporary index on hiwikisource views T219374 [production]
05:07 <marostegui> Remove temporary index on hiwikisource views /usr/local/sbin/maintain-views --databases $a --replace-all --clean [production]