5901-5950 of 10000 results (37ms)
2017-01-18 ยง
18:28 <demon@tin> Synchronized multiversion/MWMultiVersion.php: minor cleanup (duration: 00m 48s) [production]
18:03 <madhuvishy> Rolling out https://gerrit.wikimedia.org/r/#/c/332735/ across labs instances T154336 [production]
17:54 <madhuvishy> Disabled (systemctl disable) nfs-export on labstore1001 and 1004 to prevent auto restart from bringing them back up T154336 [production]
17:42 <mobrovac> restbase deploying 3027682 [production]
17:39 <madhuvishy> Starting final sync of latest diff from labstore1001 to labstore-secondary T154336 [production]
17:38 <madhuvishy> Disabling puppet on labstore1001 and 1004 to make sure nfs exports are not overridden T154336 [production]
17:36 <madhuvishy> Exporting all misc shares from labstore1004 as RO T154336 [production]
17:30 <madhuvishy> Stopping nfs-exportd on labstore1004 T154336 [production]
17:28 <madhuvishy> Exported all misc exports as RO on labstore1001 T154336 [production]
17:25 <madhuvishy> Stopping nfs-exportd on labstore1001 T154336 [production]
17:13 <madhuvishy> Disabling puppet across labs instances with NFS (/home and/or /data/project) mounted for T154336 [production]
17:11 <madhuvishy> Silenced shinken, and icinga on labstore1001 for misc nfs migration T154336 [production]
15:45 <oblivian@puppetmaster1001> conftool action : set/pooled=inactive; selector: service=nginx,cluster=api_appserver,dc=eqiad,name=mw122[6-9].* [production]
15:45 <oblivian@puppetmaster1001> conftool action : set/pooled=inactive; selector: service=nginx,cluster=api_appserver,dc=eqiad,name=mw123[0-5].* [production]
15:41 <oblivian@puppetmaster1001> conftool action : set/weight=15; selector: service=apache2,cluster=api_appserver,dc=eqiad,name=mw1(1[8-9]|2[0-1]|22[0-5]).* [production]
15:24 <zeljkof> finished EU SWAT [production]
15:23 <zfilipin@tin> Synchronized php-1.29.0-wmf.7/maintenance/importImages.php: SWAT: [[gerrit:332766|maintenance/importImages: Dont sleep after the last upload]] (duration: 00m 41s) [production]
15:07 <hashar> tin.eqiad.wmnet : committed an uncommitted live hack for php-1.29.0-wmf.7/includes/AutoLoader.php by ostriches [production]
15:06 <zeljkof> extending EU SWAT until 332766 is deployed [production]
14:39 <zfilipin@tin> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:331946|Increase $wgHTTPImportTimeout to 50 seconds (T155209)]] (duration: 00m 39s) [production]
14:31 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:332721|Set wgDisableUserGroupExpiry to true on production, false on labs (T155605)]] (duration: 00m 40s) [production]
14:30 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:332721|Set wgDisableUserGroupExpiry to true on production, false on labs (T155605)]] (duration: 00m 40s) [production]
14:03 <moritzm> upgrading firejail on aqs cluster [production]
13:12 <moritzm> uploaded firejail 0.9.44.6 for jessie-wikimedia to carbon [production]
12:21 <marostegui> Enable gtid_domain_id on m3 - T149418 [production]
12:06 <moritzm> installing libio-socket-ssl-perl bugfix updates from jessie point release [production]
11:42 <moritzm> installing sed bugfix updates from jessie point release [production]
11:17 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2064 - T154097 (duration: 00m 39s) [production]
11:09 <moritzm> restarting mediawiki canary servers to pick up cairo and libpng updates [production]
10:38 <moritzm> installing libxml security updates [production]
10:38 <oblivian@puppetmaster1001> conftool action : set/pooled=no; selector: service=nginx,cluster=api_appserver,dc=eqiad,name=mw123[0-5].* [production]
10:11 <godog> pool ms-fe200[789] T152612 [production]
10:10 <marostegui> Restart mysql dbstore2001 to enable gtid_domain_id manually before deploying it on m3 - T149418 [production]
10:05 <marostegui> Remove partitions from enwiktionary.templatelinks on db2064 - T154097 [production]
10:05 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2064 - T154097 (duration: 00m 45s) [production]
09:56 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2063 - T154097 (duration: 00m 48s) [production]
09:40 <marostegui> Restart mysql dbstore2002 to enable gtid_domain_id manually before deploying it on m3 - T149418 [production]
08:51 <marostegui> Remove partitions from enwiktionary.templatelinks on db2063 - T154097 [production]
08:50 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2063 - T154097 (duration: 00m 39s) [production]
08:33 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2060 - T154031 (duration: 00m 40s) [production]
08:18 <marostegui> Compressing templatelinks tables on db1035 - T154465 [production]
08:16 <marostegui> Compressing templatelinks tables on db1038 - T154465 [production]
08:00 <_joe_> restarting pybal on lvs1003 [production]
07:56 <_joe_> restarting pybal on lvs1003 [production]
07:34 <oblivian@puppetmaster1001> conftool action : set/pooled=no; selector: service=nginx,cluster=api_appserver,dc=eqiad,name=mw122[6-9].* [production]
07:32 <_joe_> depooling mw1226-mw1235 from the https pool in eqiad, T152074 [production]
07:30 <oblivian@puppetmaster1001> conftool action : set/pooled=inactive; selector: service=nginx,cluster=api_appserver,dc=eqiad,name=mw12[7-9].* [production]
07:25 <marostegui> Restart MySQL dbstore2001 to apply InnoDB defaults [production]
03:05 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Jan 18 03:05:47 UTC 2017 (duration 5m 38s) [production]
03:00 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.8) (duration: 13m 22s) [production]