3551-3600 of 10000 results (42ms)
2016-09-01 §
14:58 <moritzm> powered down several hosts for hardware maintenance (T142726): mw2099, mw2102, mw2117, mw2163-mw2199 [production]
14:42 <mobrovac> restbase deploy end of 9cca320 [production]
14:40 <moritzm> powered down several hosts for hardware maintenance (T142726): mw2087, mw2149-mw2151 [production]
14:39 <elukey> upgrading httpd/apache to 2.4.10-10+deb8u6+wmf2 on mw128[56] [production]
14:27 <mobrovac> restbase deploy start of 9cca320 [production]
14:11 <godog> wipe and reinitialize corrupted xfs on /dev/sdn1 on ms-be1016 [production]
13:53 <eileen> turned off queue for http://localhost:9000/job/GlobalCollect%20Recurring%20Donations/ in jenkins [production]
13:42 <elukey> upgrading httpd/apache to 2.4.10-10+deb8u6+wmf2 on mw128[78] [production]
13:41 <bblack> uploaded openssl-1.1.0-1+wmf1 to jessie-wikimedia/experimental [production]
13:39 <elukey> not upgrading mw130[01] since I'd need more info before proceeding [production]
13:34 <hashar@tin> Synchronized php-1.28.0-wmf.17/includes/page/WikiPage.php: T144484 (duration: 00m 49s) [production]
13:30 <hashar@tin> Synchronized php-1.28.0-wmf.17/includes/page/WikiPage.php: T144484 (duration: 00m 35s) [production]
13:16 <elukey> upgrading httpd/apache to 2.4.10-10+deb8u6+wmf2 on mw130[01].eqiad.wmnet [production]
13:01 <gehel@palladium> conftool action : set/pooled=yes; selector: name=elastic1047.eqiad.wmnet [production]
12:53 <ema@palladium> conftool action : set/pooled=yes; selector: cp4005.ulsfo.wmnet (tags: ['dc=ulsfo', 'cluster=cache_upload', 'service=varnish-be']) [production]
12:12 <gehel> rolling restart of ferm on elasticsearch eqiad cluster to account for moved servers - T143685 [production]
10:49 <moritzm> installing libidn security updates [production]
10:39 <godog> reboot ms-be1016, stuck again [production]
10:24 <hashar@tin> Synchronized docroot/noc/index.html: link to conftool and wikitech pages on https://noc.wikimedia.org/ (duration: 00m 47s) [production]
10:17 <gehel> repooled elastic104[456] - T144450 [production]
09:58 <jynus> adding marostegui to wmf and ops on wikitech LDAP [production]
09:57 <gehel@palladium> conftool action : set/pooled=inactive; selector: elastic1046.eqiad.wmnet [production]
09:57 <gehel@palladium> conftool action : set/pooled=inactive; selector: elastic1045.eqiad.wmnet [production]
09:56 <gehel@palladium> conftool action : set/pooled=inactive; selector: elastic1044.eqiad.wmnet [production]
09:51 <moritzm> reimaging mw2200-2203 to jessie [production]
09:37 <moritzm> reimaging mw2061-2064 to jessie [production]
09:35 <elukey> reimaging mw2167 -> mw2170 to Jessie [production]
09:24 <moritzm> reimaging mw2163-2166 to jessie [production]
09:06 <moritzm> installing postgres security updates on labsdb1004/1006/1007 [production]
09:04 <godog> reboot ms-be1016, stuck and nothing on console [production]
07:45 <moritzm> reimaging mw2116-2119 to jessie [production]
03:12 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Sep 1 03:12:34 UTC 2016 (duration 7m 14s) [production]
03:05 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.17) (duration: 17m 59s) [production]
02:30 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.16) (duration: 12m 21s) [production]
02:22 <bblack> ulsfo depool [production]
01:00 <Jeff_Green> reboot db1025 for kernel update [production]
01:00 <Jeff_Green> reboot db1025 for kernel update [production]
00:28 <eileen> CiviCRM upgrade from from d067c476da074afa70297c29e3d471743c110e3a to 0c6bf3813ee0f2e58d5948fc7c000cf20c114841 [production]
00:13 <eileen> fr campaigns disabled [production]
00:09 <eileen> stop Donations q consumer job on jenkins [production]
2016-08-31 §
23:53 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/307886/ (duration: 00m 48s) [production]
23:42 <maxsem@tin> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/268627/ (duration: 00m 47s) [production]
23:40 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/268627/ (duration: 00m 47s) [production]
23:34 <urandom> T143226: Clearing repair status: eqiad, rack 'a' nodes [production]
23:33 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: Updating logos, step 2 (duration: 00m 48s) [production]
23:31 <maxsem@tin> Synchronized static: Update logos, step 1 (duration: 00m 47s) [production]
23:20 <urandom> T143226: Clearing repair status: codfw, rack 'd' [production]
23:15 <maxsem@tin> Synchronized php-1.28.0-wmf.17/extensions/Kartographer: https://gerrit.wikimedia.org/r/#/c/307883/ (duration: 00m 49s) [production]
22:33 <gehel@palladium> conftool action : set/pooled=no; selector: name=elastic1047.eqiad.wmnet [production]
22:32 <gehel> depooling elastic1047 from LVS [production]