751-800 of 10000 results (50ms)
2017-06-28 §
11:14 <elukey> stop eventlogging_sync on db1047 - alter tables running [production]
11:04 <jynus> restarting db2062's mysql [production]
10:52 <jynus> restarting db2072's mysql for testing of new config [production]
10:06 <hashar> Unblocked beta cluster jenkins job. Have been stalled for a while [releng]
09:05 <legoktm@tin> Synchronized php-1.30.0-wmf.7/includes/parser/ParserCache.php: Add debug logging for T168040 (duration: 00m 46s) [production]
08:46 <legoktm@tin> Synchronized php-1.30.0-wmf.6/includes/parser/ParserCache.php: Add debug logging for T168040 (duration: 00m 48s) [production]
07:49 <jynus> disable puppet on all database hosts for deployment of gerrit:361456 [production]
07:33 <marostegui> Re-enable event scheduler on dbstore2001 - T168354 [production]
07:01 <elukey> stop jobrunner/jobchron on mw130[4,5,6] and reboot them for kernel updates [production]
06:42 <elukey> stop jobrunner/jobchron on mw130[2,3] and reboot them for kernel updates [production]
06:37 <elukey> restart pdfrender.service on scb1003 - xpra race condition [production]
06:35 <elukey> executed sudo -u _graphite find /var/lib/carbon/whisper/eventstreams/rdkafka -type f -mtime +10 -delete on graphite1001 to free space [production]
06:34 <marostegui> Stop Replication in sync on db2033 and dbstore2001 (x1) - T168354 [production]
05:55 <marostegui> Temporarily disable event scheduler on dbstore2001 - https://phabricator.wikimedia.org/T168354 [production]
05:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove comments from db1033 status - T166208 (duration: 00m 47s) [production]
05:24 <marostegui> Stop MySQL and reboot db1034 for maintenance - T166208 [production]
03:05 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Jun 28 03:05:57 UTC 2017 (duration 7m 0s) [production]
02:58 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.7) (duration: 14m 50s) [production]
02:46 <eileen> Update civicrm from d558df2ca2a0218a5e4bb6e03105a14cec3f0b6d to e53d62193e51e839229c6aa78015ca0055ed8474 [production]
02:24 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.6) (duration: 07m 55s) [production]
01:43 <demon@tin> Synchronized README: profiling (duration: 00m 47s) [production]
2017-06-27 §
23:26 <demon@tin> Synchronized php-1.30.0-wmf.6/extensions/RelatedArticles/: Hygene and stuff (duration: 00m 46s) [production]
23:22 <bd808> Stopped webservice. lighttpd continually failing to start with error "child exited with status 2 /data/project/para/public_html/test.fcgi" [tools.para]
23:22 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: Only enable logging on enwiki for MobileFormatter#moveFirstParagraphBeforeInfobox (duration: 00m 46s) [production]
23:20 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: Removing wgMFContentNamespace (duration: 00m 46s) [production]
23:20 <bd808> Webservice in infinite restart loop. Investigating. [tools.para]
23:14 <demon@tin> Synchronized portals: (no justification provided) (duration: 00m 47s) [production]
23:13 <demon@tin> Synchronized portals/prod/wikipedia.org/assets: (no justification provided) (duration: 00m 47s) [production]
23:05 <demon@tin> Synchronized dblists/: ukwikimedia swapped from closed to deleted (duration: 00m 46s) [production]
22:58 <Amir1> cherry-picking gerrit:360891/3 [releng]
22:44 <demon@tin> Synchronized README: force co-master sync (duration: 00m 47s) [production]
22:42 <Amir1> cherry-picking gerrit:360891/2 [releng]
21:58 <bblack> pybal restarts on lvs4004,lvs4002 for misc@ulsfo [production]
21:58 <Amir1> mwscript extensions/Wikibase/repo/maintenance/changePropertyDataType.php --wiki wikidatawiki --new-data-type 'string' --property-id P34 [releng]
21:50 <bblack> removing cp4001-4 (cache_misc@ulsfo), except a few minor related alerts from race conditions [production]
21:32 <andrewbogott> moving all tools nodes to new puppetmaster, tools-puppetmaster-01.tools.eqiad.wmflabs [tools]
21:24 <bblack> cp1074: restart backend (mailbox lag) [production]
21:03 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 wikis to 1.30.0-wmf.7 refs T167536 [production]
20:46 <twentyafterfour@tin> Finished scap: sync 1.30.0-wmf.7 and promote to test wikis - refs T167536 (duration: 30m 44s) [production]
20:16 <twentyafterfour@tin> Started scap: sync 1.30.0-wmf.7 and promote to test wikis - refs T167536 [production]
18:41 <godog> switch thumbor back on with a fix for T168949 [production]
18:35 <godog> upgrade thumbor to 0.1.41 [production]
18:31 <hashar> Image snapshot-ci-jessie-1498587497 in wmflabs-eqiad is ready - T169004 [releng]
18:25 <gehel> reduce cluster_concurrent_rebalance to 8 and node_concurrent_recoveries to 4 on elasticsearch eqiad [production]
18:18 <hashar> Regenerating Jessie nodepool image to hopefulyl bring back hhvm-tidy package - T169004 [releng]
18:05 <hashar> Some CI jobs are broken with "tidy.so: cannot open shared object file: No such file or directory" see T169004 [production]
17:52 <twentyafterfour> branching 1.30.0-wmf.7 - T167536 [production]
17:44 <bblack> restart pybal on lvs4004 [production]
17:39 <Amir1> running mwscript extensions/Wikibase/repo/maintenance/changePropertyDataType.php --wiki wikidatawiki --new-data-type 'external-id' --property-id P34 [releng]
16:37 <mutante> releases1001 - setting boot parameters to network, rebooting [production]