2151-2200 of 10000 results (58ms)
2017-10-02 §
08:46 <gehel@tin> Started deploy [tilerator/deploy@b02bd9a]: (no justification provided) [production]
08:46 <marostegui> Poweroff db2044 for HW maintenance - T174764 [production]
08:40 <marostegui> Stop MySQL on db2044 to get it ready to replace its mainboard - T174764 [production]
08:29 <Amir1> finished the cleanup of ores_classification table in wikidatawiki and starting the enwiki one (T159753) [production]
08:24 <jynus> stopping dbstore1001 for maintenance [production]
08:12 <marostegui> Optimize tables pagelinks and templatelinks on s5: db1100 (already depooled) - T174509 [production]
07:59 <marostegui> Drop now redundant indexes from pagelinks and templatelinks from s5 - T174509 [production]
07:57 <Amir1> starting a round of cleanup in ores_classification table in wikidatawiki [production]
07:41 <marostegui> Stop MySQL on db1036 as it is going to be decommissioned - https://phabricator.wikimedia.org/T176311 [production]
07:32 <marostegui> Optimize table pagelinks and templatelinks on s6: dbstore2001 - T174509 [production]
07:21 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2039 - T174509 (duration: 00m 46s) [production]
07:20 <marostegui> Optimize table pagelinks and templatelinks on s6: db2039 - T174509 [production]
07:10 <marostegui> Optimize table pagelinks and templatelinks on s1: db2034, db2055 db2062 - T174509 [production]
07:06 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2034, db2055 db2062 - T174509 (duration: 00m 46s) [production]
06:55 <_joe_> restarting a few API appservers with high cpu load [production]
06:19 <elukey> restart varnish backend on cp3040 [production]
06:10 <elukey> restart varnish backend on cp3033 [production]
06:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1036 from config files as it will be decommissioned - T176311 (duration: 00m 46s) [production]
06:07 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db1036 from config files as it will be decommissioned - T176311 (duration: 00m 48s) [production]
02:43 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Oct 2 02:43:33 UTC 2017 (duration 6m 39s) [production]
02:36 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.1) (duration: 08m 42s) [production]
2017-10-01 §
21:30 <madhuvishy> powercycling labvirt1015 [production]
18:58 <hashar> restarted Jenkins. Was stuck somehow [production]
13:50 <elukey> restart hhvm on mw1167 (jobrunner) - hhvm stuck, dump-debug in /tmp/hhvm.9624.bt. [production]
2017-09-30 §
20:54 <catrope@tin> Synchronized wmf-config/CommonSettings.php: Bump $wgResourceLoaderStorageVersion (T176884) (duration: 00m 47s) [production]
00:37 <ejegg> increased PayPal Express Checkout cURL timeout to 12 seconds [production]
2017-09-29 §
22:12 <ejegg> updated CiviCRM from 784756b4157517bf9639a67b8d0ddcb1db7c999d to 59e3e00ecbaa3557fd32dc49259a1ae12edf7414 [production]
21:19 <mutante> labstore2003/2004: closed idle screen sessions [production]
20:27 <mutante> mwlog1001, oxygen - closing unused screen session [production]
20:20 <mutante> install1002/install2002 - closing unused screen sessions (except a tail -f) [production]
20:11 <mutante> restbase2001 - closing screen sessions that weren't running anything anymore [production]
19:23 <ebernhardson> completed running cirrussearch category moves on commonswiki [production]
18:19 <catrope@tin> Synchronized php-1.31.0-wmf.1/includes/libs/CSSMin.php: T176884 (duration: 00m 47s) [production]
18:08 <chasemp> remove 'ToolLabs webservice - lighttpd on precise' catchpoint check for Catchpoint [production]
18:07 <chasemp> remove labsdb1002 checks on catchpoint (Toolforge) [production]
18:06 <chasemp> remove Labs puppetmaster eqiad catchpoint check (for Toolforge) [production]
18:06 <chasemp> remove grid-start-precise catchpoint check [production]
18:04 <chasemp> update catchpoing test for stream.wikimedia.org to watch https://stream.wikimedia.org/?doc [production]
17:00 <ebernhardson> kicking off extra job runners to process jobs moving commonswiki Category pages from general to content serach index [production]
16:37 <andrewbogott> re-imaging labvirt1017, 1018 in order to get it on the standard 4.4.0-81-generic kernel [production]
15:52 <andrewbogott> re-imaging labvirt1015 in order to get it on the standard 4.4.0-81-generic kernel [production]
13:21 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2070, db2069 and db2042 - T174509 (duration: 00m 47s) [production]
13:18 <Amir1> starting a round of cleanup in ores_classification table in enwiki (T159753) [production]
13:09 <elukey> depool mw1265 (hhvm 3.18.5) - disk filled up [production]
12:43 <bblack> removed numa=isolate sys entries manually (runtime + future boots) from cp4021 [production]
11:53 <bblack> cp4021: reboot for numa mode switch [production]
11:44 <elukey> re-enable job runner daemons on mw130[8,9] [production]
11:15 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2053 db2046 - T174509 (duration: 00m 48s) [production]
11:05 <elukey> precautionary stop of jobrunner/jobchron on the new mw130[8,9] - job queue size rapid increase investigation [production]
09:55 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1309.eqiad.wmnet [production]