6851-6900 of 10000 results (66ms)
2018-01-16 ยง
17:45 <herron> disabled puppet agents troubleshooting T184444 [production]
17:31 <andrewbogott> rebooting labvirt1004 [production]
17:11 <andrewbogott> upgrading and rebooting labvirt1002 [production]
17:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1092 original weight (duration: 01m 12s) [production]
16:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1092 (duration: 01m 12s) [production]
16:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1092 (duration: 01m 12s) [production]
16:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1092 - T174569 (duration: 01m 08s) [production]
16:16 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1101:3317 (duration: 01m 12s) [production]
16:11 <oblivian@neodymium> conftool action : set/pooled=no; selector: cluster=api_appserver,name=mw120[1-8]\.eqiad\.wmnet [production]
16:10 <_joe_> depooling mw1201-1208 from the API cluster, T185004 [production]
16:09 <moritzm> rebooting praseodymium for kernel security update [production]
16:08 <godog> bootstrap cassandra-c on restbase1018 [production]
16:04 <chasemp> add arturo to acl*operations-team [production]
16:03 <moritzm> rebooting labweb* hosts for kernel security update [production]
15:57 <andrewbogott> rebooting labvirt1001 [production]
15:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase weight for db1101:3317 after kernel upgrade (duration: 01m 12s) [production]
15:44 <elukey> reboot druid1003 for kernel upgrades [production]
15:41 <moritzm> rebooting achernar for kernel security update [production]
15:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1101:3317 after kernel upgrade (duration: 01m 12s) [production]
15:31 <moritzm> rebooting acamar for kernel security update [production]
15:30 <marostegui> Deploy schema change on db1101:3318 - T174569 [production]
15:11 <marostegui> Upgrade mariadb and kernel on db1101 [production]
15:10 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1101:3317 db1101:3318 for schema change, mariadb upgrade and kernel upgrade - T162807 (duration: 01m 12s) [production]
14:59 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1105:3311 - T162807 (duration: 01m 09s) [production]
14:52 <moritzm> rebooting graphite1001 for kernel security update [production]
14:35 <moritzm> rebooting graphite1003 for kernel security update [production]
14:25 <moritzm> powercycling labtestservices2003, stuck in reboot [production]
14:18 <moritzm> powercycling labtestservices2001, stuck in reboot [production]
14:13 <zeljkof> EU SWAT finished [production]
14:12 <elukey> reboot druid100[56] for kernel upgrades [production]
14:11 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:403571|Revert "Restrict sending mails to new users" config change (T184470)]] (duration: 01m 13s) [production]
14:09 <godog> bootstrap cassandra-b on restbase1018 [production]
14:01 <moritzm> rebooting labtest* hosts for kernel security update [production]
13:56 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=druid1004.*.wmnet [production]
13:54 <moritzm> rebooting graphite1002 for kernel security update [production]
13:52 <elukey> reboot druid1004 for kernel upgrades [production]
13:46 <elukey@puppetmaster1001> conftool action : set/pooled=no; selector: name=druid1004.*.wmnet [production]
13:46 <elukey@puppetmaster1001> conftool action : set/pooled=no; selector: name=druid1004*.wmnet [production]
13:44 <moritzm> rebooting graphite2002 for kernel security update [production]
13:31 <oblivian@neodymium> conftool action : set/weight=25; selector: cluster=api_appserver,name=mw134[3-8[B]\.eqiad\.wmnet [production]
13:28 <moritzm> rebooting graphite2001 for kernel security update [production]
13:20 <oblivian@neodymium> conftool action : set/pooled=yes; selector: cluster=api_appserver,name=mw134[3-7]\.eqiad\.wmnet [production]
12:56 <elukey> reboot kafka100[23] for kernel upgrades [production]
11:59 <ariel@tin> Finished deploy [dumps/dumps@c165ca0]: enable 7z prefetch files for page content dumps (duration: 00m 04s) [production]
11:59 <ariel@tin> Started deploy [dumps/dumps@c165ca0]: enable 7z prefetch files for page content dumps [production]
11:51 <moritzm> rebooting mc2* hosts for kernel security update [production]
11:27 <elukey> reboot kafka1001 for kernel upgrades [production]
11:12 <moritzm> reboot maerlant for kernel security update [production]
11:08 <moritzm> uploaded HHVM 3.18.7 for stretch-wikimedia to apt.wikimedia.org [production]
10:59 <godog> roll-restart swift object server - T167400 [production]