|
2016-09-01
§
|
| 14:11 |
<godog> |
wipe and reinitialize corrupted xfs on /dev/sdn1 on ms-be1016 |
[production] |
| 13:53 |
<eileen> |
turned off queue for http://localhost:9000/job/GlobalCollect%20Recurring%20Donations/ in jenkins |
[production] |
| 13:42 |
<elukey> |
upgrading httpd/apache to 2.4.10-10+deb8u6+wmf2 on mw128[78] |
[production] |
| 13:41 |
<bblack> |
uploaded openssl-1.1.0-1+wmf1 to jessie-wikimedia/experimental |
[production] |
| 13:39 |
<elukey> |
not upgrading mw130[01] since I'd need more info before proceeding |
[production] |
| 13:34 |
<hashar@tin> |
Synchronized php-1.28.0-wmf.17/includes/page/WikiPage.php: T144484 (duration: 00m 49s) |
[production] |
| 13:30 |
<hashar@tin> |
Synchronized php-1.28.0-wmf.17/includes/page/WikiPage.php: T144484 (duration: 00m 35s) |
[production] |
| 13:16 |
<elukey> |
upgrading httpd/apache to 2.4.10-10+deb8u6+wmf2 on mw130[01].eqiad.wmnet |
[production] |
| 13:01 |
<gehel@palladium> |
conftool action : set/pooled=yes; selector: name=elastic1047.eqiad.wmnet |
[production] |
| 12:53 |
<ema@palladium> |
conftool action : set/pooled=yes; selector: cp4005.ulsfo.wmnet (tags: ['dc=ulsfo', 'cluster=cache_upload', 'service=varnish-be']) |
[production] |
| 12:12 |
<gehel> |
rolling restart of ferm on elasticsearch eqiad cluster to account for moved servers - T143685 |
[production] |
| 10:49 |
<moritzm> |
installing libidn security updates |
[production] |
| 10:39 |
<godog> |
reboot ms-be1016, stuck again |
[production] |
| 10:24 |
<hashar@tin> |
Synchronized docroot/noc/index.html: link to conftool and wikitech pages on https://noc.wikimedia.org/ (duration: 00m 47s) |
[production] |
| 10:17 |
<gehel> |
repooled elastic104[456] - T144450 |
[production] |
| 09:58 |
<jynus> |
adding marostegui to wmf and ops on wikitech LDAP |
[production] |
| 09:57 |
<gehel@palladium> |
conftool action : set/pooled=inactive; selector: elastic1046.eqiad.wmnet |
[production] |
| 09:57 |
<gehel@palladium> |
conftool action : set/pooled=inactive; selector: elastic1045.eqiad.wmnet |
[production] |
| 09:56 |
<gehel@palladium> |
conftool action : set/pooled=inactive; selector: elastic1044.eqiad.wmnet |
[production] |
| 09:51 |
<moritzm> |
reimaging mw2200-2203 to jessie |
[production] |
| 09:37 |
<moritzm> |
reimaging mw2061-2064 to jessie |
[production] |
| 09:35 |
<elukey> |
reimaging mw2167 -> mw2170 to Jessie |
[production] |
| 09:24 |
<moritzm> |
reimaging mw2163-2166 to jessie |
[production] |
| 09:06 |
<moritzm> |
installing postgres security updates on labsdb1004/1006/1007 |
[production] |
| 09:04 |
<godog> |
reboot ms-be1016, stuck and nothing on console |
[production] |
| 07:45 |
<moritzm> |
reimaging mw2116-2119 to jessie |
[production] |
| 03:12 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Sep 1 03:12:34 UTC 2016 (duration 7m 14s) |
[production] |
| 03:05 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.17) (duration: 17m 59s) |
[production] |
| 02:30 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.16) (duration: 12m 21s) |
[production] |
| 02:22 |
<bblack> |
ulsfo depool |
[production] |
| 01:00 |
<Jeff_Green> |
reboot db1025 for kernel update |
[production] |
| 01:00 |
<Jeff_Green> |
reboot db1025 for kernel update |
[production] |
| 00:28 |
<eileen> |
CiviCRM upgrade from from d067c476da074afa70297c29e3d471743c110e3a to 0c6bf3813ee0f2e58d5948fc7c000cf20c114841 |
[production] |
| 00:13 |
<eileen> |
fr campaigns disabled |
[production] |
| 00:09 |
<eileen> |
stop Donations q consumer job on jenkins |
[production] |
|
2016-08-31
§
|
| 23:53 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/307886/ (duration: 00m 48s) |
[production] |
| 23:42 |
<maxsem@tin> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/268627/ (duration: 00m 47s) |
[production] |
| 23:40 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/268627/ (duration: 00m 47s) |
[production] |
| 23:34 |
<urandom> |
T143226: Clearing repair status: eqiad, rack 'a' nodes |
[production] |
| 23:33 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: Updating logos, step 2 (duration: 00m 48s) |
[production] |
| 23:31 |
<maxsem@tin> |
Synchronized static: Update logos, step 1 (duration: 00m 47s) |
[production] |
| 23:20 |
<urandom> |
T143226: Clearing repair status: codfw, rack 'd' |
[production] |
| 23:15 |
<maxsem@tin> |
Synchronized php-1.28.0-wmf.17/extensions/Kartographer: https://gerrit.wikimedia.org/r/#/c/307883/ (duration: 00m 49s) |
[production] |
| 22:33 |
<gehel@palladium> |
conftool action : set/pooled=no; selector: name=elastic1047.eqiad.wmnet |
[production] |
| 22:32 |
<gehel> |
depooling elastic1047 from LVS |
[production] |
| 22:17 |
<gehel> |
restarting elasticsearch on elastic1028 |
[production] |
| 22:12 |
<urandom> |
T143226: Clearing repair status: restbase2008.codfw.wmnet |
[production] |
| 22:02 |
<hashar> |
surge of since 31th 7:00 UTC : Retrying connection to search.svc.eqiad.wmnet |
[production] |
| 22:01 |
<urandom> |
T143226: Clearing repair status: restbase2004.codfw.wmnet |
[production] |
| 21:51 |
<urandom> |
T143226: Clearing repair status: restbase2003.codfw.wmnet |
[production] |