3551-3600 of 10000 results (45ms)
2017-02-08 §
14:30 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2007.codfw.wmnet [production]
14:30 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2006.codfw.wmnet [production]
14:29 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2005.codfw.wmnet [production]
14:26 <elukey> restarting nutcracker in all the codfw mw servers to pick up the new shards [production]
14:23 <ema> cp2022 stuck rebooting, power-cycled [production]
14:23 <gehel> drain shards from elastic20(09|10|11|12) in preparation for reimage - T151326 [production]
14:17 <jynus> upgrading and restarting db1026 T111654 [production]
13:46 <elukey> replacing the codfw memcached/redis shards 12->16 [production]
13:41 <marostegui> Start replication on db1064 - T153743 [production]
13:40 <marostegui> Enable replication between db1095 and db1064 - T153743 [production]
13:39 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1026 for maintenance (duration: 00m 41s) [production]
13:10 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2008.codfw.wmnet [production]
13:10 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2007.codfw.wmnet [production]
13:09 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2006.codfw.wmnet [production]
13:09 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2005.codfw.wmnet [production]
12:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1073 - T156126 (duration: 00m 40s) [production]
12:38 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1037 after maintenance (duration: 00m 41s) [production]
12:17 <jynus> upgrading and restarting db1037 T111654 [production]
12:16 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1037 for maintenance (duration: 00m 40s) [production]
12:01 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1045 after maintenance (duration: 00m 42s) [production]
10:39 <jynus> upgrading and restarting db1045 T111654 [production]
10:38 <moritzm> upgrading openssl, libgd, lcms, gnutls, sqlite, libxpm and glibc in codfw mediawiki cluster (so get get effected by the restart during the HHVM upgrade) [production]
10:11 <moritzm> upgrading hhvm on codfw mediawiki cluster [production]
09:55 <hoo> Updated the Wikidata property suggester with data from last Monday's JSON dump and applied the T132839 workarounds [production]
09:44 <elukey> boostrapping aqs1009-b (last new AQS Cassandra instance) [production]
09:31 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2004.codfw.wmnet [production]
09:31 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2003.codfw.wmnet [production]
08:56 <ema> cache_upload: upgrade to jessie 8.7 and reboot into kernel 4.4.2-3+wmf8 T155401 [production]
08:42 <gehel> drain shards from elastic200[5678] in preparation for reimage - T151326 [production]
08:18 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2004.codfw.wmnet [production]
08:18 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic2003.codfw.wmnet [production]
08:16 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2002.codfw.wmnet [production]
07:59 <marostegui> Adding 100G to the lv on dbstore1001 [production]
07:23 <marostegui> Restart MySQL db1095 and labsdb1009 for maintenance - T153743 [production]
03:08 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Feb 8 03:08:05 UTC 2017 (duration 5m 43s) [production]
03:02 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.11) (duration: 15m 32s) [production]
02:29 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.10) (duration: 07m 35s) [production]
01:02 <mutante> mw1294 - run puppet because it popped up in Icinga as failed - removes a bunch of /var/tmp/core/../rsvg-convert.*, all else normal [production]
00:56 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT [[gerrit:335732|Setting $wgPageAssessmentsSubprojects to true on beta cluster]] (housekeeping sync) (duration: 00m 40s) [production]
00:55 <mutante> mw1189 service hhvm restart [production]
00:55 <mutante> iridum - apache graceful'ed [production]
00:51 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:336466|Update footer logos on mobile site for various projects]] PART II T157476 (duration: 00m 41s) [production]
00:50 <thcipriani@tin> Synchronized static/images/mobile/copyright: SWAT: [[gerrit:336466|Update footer logos on mobile site for various projects]] PART I T157476 (duration: 00m 41s) [production]
00:16 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:334729|Deploy TextCat Improvements]] T149324 T142140 (duration: 00m 45s) [production]
2017-02-07 §
23:42 <mutante> carbon - stopping DHCP service (install* should be used) [production]
22:31 <otto@tin> Finished deploy [eventstreams/deploy@e86077c]: (no justification provided) (duration: 02m 26s) [production]
22:28 <otto@tin> Started deploy [eventstreams/deploy@e86077c]: (no justification provided) [production]
21:17 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 to 1.29.0-wmf.11 [production]
21:02 <eileen1> Update CiviCRM from e45da6dc2cfaa48da8807ab9a571810c119e3233 to 7b36996e87387bb4982cc6937dc8bcbc7952eaf2 [production]
21:01 <thcipriani@tin> Finished scap: testwiki to php-1.29.0-wmf.11 and rebuild l10n cache (duration: 51m 53s) [production]