101-150 of 10000 results (36ms)
2017-10-02 §
07:32 <marostegui> Optimize table pagelinks and templatelinks on s6: dbstore2001 - T174509 [production]
07:21 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2039 - T174509 (duration: 00m 46s) [production]
07:20 <marostegui> Optimize table pagelinks and templatelinks on s6: db2039 - T174509 [production]
07:10 <marostegui> Optimize table pagelinks and templatelinks on s1: db2034, db2055 db2062 - T174509 [production]
07:06 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2034, db2055 db2062 - T174509 (duration: 00m 46s) [production]
06:55 <_joe_> restarting a few API appservers with high cpu load [production]
06:19 <elukey> restart varnish backend on cp3040 [production]
06:10 <elukey> restart varnish backend on cp3033 [production]
06:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1036 from config files as it will be decommissioned - T176311 (duration: 00m 46s) [production]
06:07 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db1036 from config files as it will be decommissioned - T176311 (duration: 00m 48s) [production]
02:43 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Oct 2 02:43:33 UTC 2017 (duration 6m 39s) [production]
02:36 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.1) (duration: 08m 42s) [production]
2017-10-01 §
21:30 <madhuvishy> powercycling labvirt1015 [production]
18:58 <hashar> restarted Jenkins. Was stuck somehow [production]
13:50 <elukey> restart hhvm on mw1167 (jobrunner) - hhvm stuck, dump-debug in /tmp/hhvm.9624.bt. [production]
2017-09-30 §
20:54 <catrope@tin> Synchronized wmf-config/CommonSettings.php: Bump $wgResourceLoaderStorageVersion (T176884) (duration: 00m 47s) [production]
00:37 <ejegg> increased PayPal Express Checkout cURL timeout to 12 seconds [production]
2017-09-29 §
22:12 <ejegg> updated CiviCRM from 784756b4157517bf9639a67b8d0ddcb1db7c999d to 59e3e00ecbaa3557fd32dc49259a1ae12edf7414 [production]
21:19 <mutante> labstore2003/2004: closed idle screen sessions [production]
20:27 <mutante> mwlog1001, oxygen - closing unused screen session [production]
20:20 <mutante> install1002/install2002 - closing unused screen sessions (except a tail -f) [production]
20:11 <mutante> restbase2001 - closing screen sessions that weren't running anything anymore [production]
19:23 <ebernhardson> completed running cirrussearch category moves on commonswiki [production]
18:19 <catrope@tin> Synchronized php-1.31.0-wmf.1/includes/libs/CSSMin.php: T176884 (duration: 00m 47s) [production]
18:08 <chasemp> remove 'ToolLabs webservice - lighttpd on precise' catchpoint check for Catchpoint [production]
18:07 <chasemp> remove labsdb1002 checks on catchpoint (Toolforge) [production]
18:06 <chasemp> remove Labs puppetmaster eqiad catchpoint check (for Toolforge) [production]
18:06 <chasemp> remove grid-start-precise catchpoint check [production]
18:04 <chasemp> update catchpoing test for stream.wikimedia.org to watch https://stream.wikimedia.org/?doc [production]
17:00 <ebernhardson> kicking off extra job runners to process jobs moving commonswiki Category pages from general to content serach index [production]
16:37 <andrewbogott> re-imaging labvirt1017, 1018 in order to get it on the standard 4.4.0-81-generic kernel [production]
15:52 <andrewbogott> re-imaging labvirt1015 in order to get it on the standard 4.4.0-81-generic kernel [production]
13:21 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2070, db2069 and db2042 - T174509 (duration: 00m 47s) [production]
13:18 <Amir1> starting a round of cleanup in ores_classification table in enwiki (T159753) [production]
13:09 <elukey> depool mw1265 (hhvm 3.18.5) - disk filled up [production]
12:43 <bblack> removed numa=isolate sys entries manually (runtime + future boots) from cp4021 [production]
11:53 <bblack> cp4021: reboot for numa mode switch [production]
11:44 <elukey> re-enable job runner daemons on mw130[8,9] [production]
11:15 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2053 db2046 - T174509 (duration: 00m 48s) [production]
11:05 <elukey> precautionary stop of jobrunner/jobchron on the new mw130[8,9] - job queue size rapid increase investigation [production]
09:55 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw1309.eqiad.wmnet [production]
09:33 <ema> upgrade pybal to 1.14.0 on codfw primaries [production]
08:20 <ema> upgrade pybal to 1.14.0 on codfw secondaries [production]
05:53 <ema> cp4024 repooled T174891 [production]
05:20 <ema> powerup cp4024 T174891 [production]
00:26 <ejegg> updated fundraising tools from 69a96276fa8cd8f68aa1225ea48fff1a7c833101 to 6d4b6f388e64ff4dc9a6a501bc8339fc1294fe9f [production]
00:16 <ejegg> updated CiviCRM 213886998cad62a37aab5b214290b8431ab41199 to 784756b4157517bf9639a67b8d0ddcb1db7c999d [production]
00:07 <mutante> releases1001 - starting Jenkins setup wizard with generated admin pass [production]
00:05 <mutante> releases1001 - stopped puppet, manually fixing --prefix=/ci setting for jenkins process, killing it, removing init.d file, starting with systemd, jenkins now up T164030 [production]
2017-09-28 §
23:46 <awight@tin> Finished deploy [ores/deploy@42c5663]: Cause ORES service restart (duration: 00m 20s) [production]