6851-6900 of 10000 results (64ms)
2017-04-11 §
13:49 <godog> roll-upgrade swift to 2.2.0 across eqiad machines - T162609 [production]
13:45 <hashar> Updating all Jenkins jobs using the git plugin due to JJB change cdfeb7bf66b0eacfed3eaf2a77813d65ab0e29f2 - https://phabricator.wikimedia.org/T162674 [production]
13:39 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:345965|Add autopatrolled group to svwiktionary (T161919)]] (duration: 00m 39s) [production]
13:34 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:347436|Increase default image thumbnail size on Finnish Wikipedia to 250px (T162376)]] (duration: 00m 39s) [production]
13:10 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:347166|Give sysops ability to promote users to eliminator at fawiki (T162396)]] (duration: 00m 39s) [production]
13:01 <godog> roll-upgrade swift to 2.2.0 across codfw machines - T162609 [production]
12:55 <moritzm> powercycling wtp2013, stuck during reboot [production]
12:47 <elukey> reimage mw2246 (Debian codfw videoscaler) to Trusty [production]
12:46 <marostegui> Deploy schema change on db1069 (s7 instance) - T160390 [production]
11:42 <ema> upgrade cache_misc to linux 4.9 T162029 [production]
11:33 <elukey> resume reboot of analytics1040->1050 for kernel upgrades [production]
11:27 <moritzm> wtp2* to Linux 4.9 [production]
11:27 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: NOOP (Beta file only) - [[gerrit:347592|Remove redundant wmgUseRevisionSlider in InitialiseSettings-labs]] (duration: 00m 38s) [production]
11:09 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: NOOP - [[gerrit:347584|Remove redundant testwiki from wmgUseLinter (already has group0)]] (duration: 00m 39s) [production]
11:02 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: NOOP (Beta file only) - Fix some tabs (duration: 00m 39s) [production]
10:46 <moritzm> upgrading wtp1020-wtp1024 to Linux 4.9 [production]
10:13 <moritzm> upgrading wtp1010-wtp1019 to Linux 4.9 [production]
09:17 <moritzm> install remaining pam updates from jessie point update [production]
09:11 <godog> upgrade swift to 2.2.0 on ms-be2001 - T162609 [production]
06:58 <moritzm> restarted cassandra-a on restbase2004, crashed with "out of heap memory" [production]
06:50 <marostegui> Deploy alter table enwiki.revision dbstore1002 - T132416 [production]
06:48 <moritzm> installing jasper security updates [production]
06:30 <elukey> restart hhvm on mw1299 - dump debug in /tmp/hhvm.84379.bt [production]
06:28 <marostegui> Deploy alter table enwiki.revision db1072 - T132416 [production]
06:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1072 - T132416 (duration: 00m 43s) [production]
06:07 <marostegui> Deploy schema change on db1041 (eqiad master) (s7) - T160390 [production]
06:02 <marostegui> Deploy schema change labsdb1003 (s7) - T160390 [production]
06:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1073 - T132416 (duration: 00m 39s) [production]
02:59 <bblack> jessie recdns software upgrades complete [production]
02:52 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=maerlant.wikimedia.org,service=pdns_recursor [production]
02:51 <bblack> upgrading maerlant to pdns-recursor 4.x [production]
02:50 <bblack@neodymium> conftool action : set/pooled=no; selector: name=maerlant.wikimedia.org,service=pdns_recursor [production]
02:48 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Apr 11 02:48:56 UTC 2017 (duration 5m 43s) [production]
02:43 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.19) (duration: 07m 16s) [production]
02:37 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=chromium.wikimedia.org,service=pdns_recursor [production]
02:32 <bblack> upgrading chromium to pdns-recursor 4.x [production]
02:31 <bblack@neodymium> conftool action : set/pooled=no; selector: name=chromium.wikimedia.org,service=pdns_recursor [production]
02:23 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.18) (duration: 07m 47s) [production]
02:16 <bblack@puppetmaster1001> conftool action : set/pooled=yes; selector: service=pdns_recursor,name=nescio.wikimedia.org [production]
02:13 <bblack> upgrading nescio to pdns-recursor 4.x [production]
02:06 <bblack> jessie-recdns: unpausing upgrade process... [production]
2017-04-10 §
23:43 <bblack> jessie-recdns: upgrade to pdns-recursor 4.x paused - hydrogen updated and in-service; chromium/nescio/maerlant still puppet-disabled. Going to leave things in this state for a while. If something seems amiss, hydrogen can be re-depooled via confctl: confctl select name=hydrogen.wikimedia.org,service=pdns_recursor set/pooled=no [production]
23:34 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=hydrogen.wikimedia.org,service=pdns_recursor [production]
23:33 <bblack> upgrading hydrogen to pdns-recursor 4.x [production]
23:25 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Set ORES thresholds for fawiki, ruwiki, trwiki (duration: 00m 39s) [production]
23:18 <bblack@neodymium> conftool action : set/pooled=no; selector: name=hydrogen.wikimedia.org,service=pdns_recursor [production]
23:04 <bblack> puppet disabled on jessie recdns (maerlant, nescio, hydrogen, chromium) for complex upgrade process ( https://gerrit.wikimedia.org/r/#/c/346937/ ) [production]
22:45 <dapatrick> Deployed patch for T162621 to wmf18 and wmf19 [production]
22:04 <ejegg> updated CiviCRM from b6c8f3e28ffbd202b1b4221ac07ebc2b44a39069 to 908b9c1ff7c9eaff3670928805c2acf3cbb86906 [production]
21:37 <ejegg> updated payments-wiki from b5bcfa1fdb361f7dc2c491c66124ae89666039be to 0b396a397272ed36325fcd944a3d0ba3625c212c [production]