201-250 of 10000 results (77ms)
2019-11-11 §
08:28 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Remove db2048 from config T237913 (duration: 00m 51s) [production]
08:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db2048 from config T237913 (duration: 00m 54s) [production]
08:21 <marostegui> Remove db2048 from tendril and zarcillo T237913 [production]
06:56 <elukey> delete /etc/logrotate.d/wdqs-reload-categories from wdqs* as attempt to reduce cronspam [production]
06:44 <marostegui> Delete globalblocks table from napwikisource T230055 [production]
05:27 <vgutierrez> Switch from nginx to ats-tls on cp3058 - T231627 [production]
2019-11-09 §
20:25 <reedy@deploy1001> Synchronized langlist-labs: T237823 (duration: 00m 54s) [production]
02:39 <volker-e@deploy1001> Finished deploy [design/style-guide@d2bfc09]: Deploy design/style-guide: (duration: 00m 07s) [production]
02:39 <volker-e@deploy1001> Started deploy [design/style-guide@d2bfc09]: Deploy design/style-guide: [production]
01:07 <volker-e@deploy1001> Finished deploy [design/style-guide@ef82b69]: Deploy design/style-guide: (duration: 00m 07s) [production]
01:07 <volker-e@deploy1001> Started deploy [design/style-guide@ef82b69]: Deploy design/style-guide: [production]
01:06 <volker-e@deploy1001> Finished deploy [design/style-guide@97fb3ee]: Deploy design/style-guide: (duration: 00m 09s) [production]
01:06 <volker-e@deploy1001> Started deploy [design/style-guide@97fb3ee]: Deploy design/style-guide: [production]
2019-11-08 §
20:26 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Delay annotation request jobs by 5 mins for testing (duration: 00m 52s) [production]
16:54 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:52 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:19 <jeh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:15 <jeh@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:15 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Revert "MachineVision: Enable testers-only mode on testcommonswiki for debugging" (duration: 00m 54s) [production]
15:57 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118, db1106 at 100%', diff saved to https://phabricator.wikimedia.org/P9582 and previous config saved to /var/cache/conftool/dbconfig/20191108-155700-jynus.json [production]
15:37 <herron> beginning rolling service restarts on logstash hosts for java security updates [production]
15:13 <mholloway-shell@deploy1001> Synchronized wmf-config/InitialiseSettings.php: MachineVision: Enable testers-only mode on testcommonswiki for debugging (duration: 00m 52s) [production]
14:56 <volans@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
14:55 <volans@cumin1001> START - Cookbook sre.hosts.decommission [production]
14:50 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 50%', diff saved to https://phabricator.wikimedia.org/P9581 and previous config saved to /var/cache/conftool/dbconfig/20191108-145028-jynus.json [production]
14:42 <volans@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:40 <volans@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:40 <jynus> stop and upgrade percona-server on test host db1114 [production]
13:27 <elukey@cumin1001> END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) [production]
13:12 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 20%', diff saved to https://phabricator.wikimedia.org/P9580 and previous config saved to /var/cache/conftool/dbconfig/20191108-131257-jynus.json [production]
13:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ee2027c: Change the language of Votewiki back to English (en) (T230614) (duration: 00m 54s) [production]
12:34 <elukey@cumin1001> START - Cookbook sre.cassandra.roll-restart [production]
12:14 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 10%', diff saved to https://phabricator.wikimedia.org/P9578 and previous config saved to /var/cache/conftool/dbconfig/20191108-121444-jynus.json [production]
12:02 <jynus> update and restart db1118 [production]
12:01 <jynus@cumin1001> dbctl commit (dc=all): 'Depool db1118 fully', diff saved to https://phabricator.wikimedia.org/P9577 and previous config saved to /var/cache/conftool/dbconfig/20191108-120138-jynus.json [production]
11:55 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 20%', diff saved to https://phabricator.wikimedia.org/P9576 and previous config saved to /var/cache/conftool/dbconfig/20191108-115553-jynus.json [production]
11:27 <jynus@cumin1001> dbctl commit (dc=all): 'Pool db1118 at 50%', diff saved to https://phabricator.wikimedia.org/P9575 and previous config saved to /var/cache/conftool/dbconfig/20191108-112733-jynus.json [production]
11:25 <jynus@cumin1001> dbctl commit (dc=all): 'repool db2130', diff saved to https://phabricator.wikimedia.org/P9574 and previous config saved to /var/cache/conftool/dbconfig/20191108-112503-jynus.json [production]
11:12 <jynus> update and restart db2130 [production]
11:11 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db2116, depool db2130', diff saved to https://phabricator.wikimedia.org/P9573 and previous config saved to /var/cache/conftool/dbconfig/20191108-111125-jynus.json [production]
10:58 <Amir1> running rebuildItemTerms on 8028 items (T234329) [production]
10:51 <jynus> update and restart db2116 [production]
10:50 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db2103, depool db2116', diff saved to https://phabricator.wikimedia.org/P9572 and previous config saved to /var/cache/conftool/dbconfig/20191108-105013-jynus.json [production]
10:38 <jynus> update and restart db2103 [production]
10:34 <jeh> enable IPMI `racadm set iDRAC.IPMILan.Enable 1` on cloudcephmon[1-3] T228102 [production]
10:33 <jeh> enable IPMI `racadm set iDRAC.IPMILan.Enable 1` on cloudcephosd[1-3] T224188 [production]
10:32 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db2092, depool db2103', diff saved to https://phabricator.wikimedia.org/P9571 and previous config saved to /var/cache/conftool/dbconfig/20191108-103218-jynus.json [production]
10:19 <jynus> update and restart db2092 [production]
10:18 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db2071, depool db2092', diff saved to https://phabricator.wikimedia.org/P9570 and previous config saved to /var/cache/conftool/dbconfig/20191108-101759-jynus.json [production]
10:09 <elukey> restart jvm-based hadoop daemons on an-master100[1,2] to pick up the new openjdk version [production]