1301-1350 of 10000 results (30ms)
2016-05-18 ยง
18:36 <csteipp@tin> Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 34s) [production]
18:35 <urandom> Starting restbase2008-a.codfw.wmnet : T95253 [production]
18:32 <urandom> Stopping restbase2008-a.codfw.wmnet and downgrading Cassandra to 2.1.13 : T95253 [production]
18:31 <urandom> Stopping failed bootstrap of restbase2008-b.codfw.wmnet : T95253 [production]
18:14 <csteipp> created oathauth_users in centralauth db [production]
17:45 <twentyafterfour@tin> Synchronized php-1.28.0-wmf.2/extensions/Renameuser/RenameuserSQL.php: (no message) (duration: 00m 38s) [production]
17:33 <moritzm> rolling restart of hhvm on mediawiki canaries in eqiad to pick up expat security update [production]
16:01 <thcipriani@tin> Synchronized php-1.28.0-wmf.2/includes/DefaultSettings.php: SWAT: [[gerrit:289438|Increase BotPasswordSessionProvider default priority]] (duration: 00m 26s) [production]
15:52 <bblack> restarting varnish frontends on cache_misc + cache_maps to clear cached X-Cache entries [production]
15:43 <thcipriani@tin> Synchronized php-1.28.0-wmf.2/extensions/CentralAuth/includes/CentralAuthHooks.php: SWAT: [[gerrit:289431|Fix central logout]] (duration: 00m 26s) [production]
15:32 <hashar> Deleted Nodepool snapshot images created around 14:30 apparently they havent been provisioned properly. Started nodepool again. Poke T135631 [production]
15:29 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:289413|Set $wgDisableAuthManager = true]] (duration: 00m 25s) [production]
15:18 <thcipriani@tin> Synchronized portals/prod/wikipedia.org/assets/js/index-1a803501de.js: SWAT: manual js sync for portals (duration: 00m 28s) [production]
15:14 <thcipriani@tin> Synchronized portals: (no message) (duration: 00m 31s) [production]
15:14 <thcipriani@tin> Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 30s) [production]
15:12 <hashar> Nodepool / labs instance issue filled as https://phabricator.wikimedia.org/T135631 [production]
15:11 <thcipriani@tin> Synchronized portals: (no message) (duration: 00m 32s) [production]
15:10 <thcipriani@tin> Synchronized portals/prod/wikipedia.org/assets: (no message) (duration: 00m 33s) [production]
15:10 <thcipriani> SWAT: running sync-portals for [[gerrit:289403|Updating footer on www.wikipedia.org portal]] [production]
15:09 <hashar> Stopping Nodepool on labnodepool1001 , it can't spawn instances [production]
15:02 <hashar> Zuul/Nodepool is out of instances. Looking [production]
14:15 <moritzm> rolling restart of hhvm in codfw to pick up expat security update [production]
13:57 <chasemp> downtime for dataset1001 puppet runs as T134896 causes failure (temporary for resize) [production]
13:55 <jynus> disabling puppet on all database masters to test replication monitoring change T133337 [production]
13:29 <chasemp> resize volume for nfs dumps per T134896 [production]
12:45 <gehel> elasticsearch eqiad - reducing high watermark to rebalance disk space [production]
11:41 <gehel> starting rolling restart of Elasticsearch codfw for Java update (T135499) [production]
11:41 <gehel> rolling restart of Elasticsearch equiad for Java update completed (T135499) [production]
11:17 <moritzm> install expat security updates [production]
10:41 <kart_> Updated cxserver to 700dac2 [production]
10:39 <mobrovac> zotero restarted it on sca100, was on 50% mem [production]
10:38 <mobrovac> zotero restarted it on sca1002, was on 50% mem and 100% cpu [production]
10:37 <kart_> Updating cxserver to 700dac2 [production]
09:35 <moritzm> installing jansson security updates [production]
09:01 <moritzm> installing libarchive security updates [production]
08:43 <moritzm> installing xerces-c security updates [production]
08:36 <jynus> performing schema change on s2 T130692 [production]
08:10 <gehel> starting rolling restart of Elasticsearch equiad fro Java update (T135499) [production]
07:04 <mobrovac> restbase deploy end of 75a94ee [production]
06:54 <mobrovac> restbase deploy start of 75a94ee [production]
06:38 <moritzm> restarted hhvm on mw1207 [production]
03:09 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed May 18 03:09:11 UTC 2016 (duration 9m 40s) [production]
02:59 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.2) (duration: 11m 15s) [production]
02:31 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.1) (duration: 11m 05s) [production]
01:51 <dereckson@tin> Finished scap: Echo: Bring back Echo email messages ([[Gerrit:289346]], for wmf1) (duration: 26m 30s) [production]
01:25 <dereckson@tin> Started scap: Echo: Bring back Echo email messages ([[Gerrit:289346]], for wmf1) [production]
01:03 <dereckson@tin> Finished scap: Echo: Bring back Echo email messages (duration: 50m 15s) [production]
00:12 <dereckson@tin> Started scap: Echo: Bring back Echo email messages [production]
00:09 <Dereckson> mwscript namespaceDupes.php jamwiki --fix: 4 pages to fix, 4 were resolvable. (T135479) [production]
00:07 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Add Puotal: namespace to jam.wikipedia (T135479) (duration: 00m 27s) [production]