2051-2100 of 10000 results (27ms)
2016-05-03 §
09:11 <gehel> restarting elasticsearch server elastic2003.codfw.wmnet (T110236) [production]
09:10 <moritzm> powercycled alsafi (stuck in KVM) [production]
09:08 <kart_> Update cxserver to 8a4254e [production]
08:18 <gehel> restarting elasticsearch server elastic2002.codfw.wmnet (T110236) [production]
08:05 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1040 after maintenance (duration: 00m 25s) [production]
07:06 <jynus> recovering torrus database @ netmon following T87815 [production]
02:34 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue May 3 02:34:45 UTC 2016 (duration 8m 36s) [production]
02:26 <awight> CentralNotice fundraising campaigns reenabled after CiviCRM maintenance [production]
02:26 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.22) (duration: 08m 40s) [production]
02:21 <mutante> ssh alsafi [production]
02:13 <eileen> Updating civicrm from f5e8f98d07a2280118b7153bc342bf52ee67edd5 to d32032965f2a45d24f1eaeb352eb6bfd6641753c [production]
02:05 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Remove obsolete https->http rewrite for IRC notifications (duration: 00m 28s) [production]
02:04 <catrope@tin> Synchronized wmf-config/InitialiseSettings.php: Remove obsolete ocwiki hack (duration: 00m 37s) [production]
01:54 <RoanKattouw> Killed ssh processes on tin that had been hanging for days [production]
01:53 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.21) (duration: 23019m 56s) [production]
01:53 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.21) (duration: 12941m 41s) [production]
01:53 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.22) (duration: 4303m 19s) [production]
01:40 <mutante> irc.wm.org - see T123729 if any questions [production]
01:39 <mutante> switching irc.wikimedia.org from old server argon to new server kraz. old server still running untouched as argon.wikimedia.org. no clients are kicked. appservers are sending RC to both. [production]
00:50 <krenair@tin> Synchronized wmf-config/interwiki.php: https://gerrit.wikimedia.org/r/286552 - interwiki cache update including jamwiki, horizon, and other things (duration: 00m 26s) [production]
00:41 <krenair@tin> Synchronized langlist: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) [production]
00:40 <krenair@tin> Synchronized static/images/project-logos: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) [production]
00:39 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 24s) [production]
00:38 <krenair@tin> rebuilt wikiversions.php and synchronized wikiversions files: create jamwiki - https://gerrit.wikimedia.org/r/286258 [production]
00:36 <krenair@tin> Synchronized dblists: create jamwiki - https://gerrit.wikimedia.org/r/286258 (duration: 00m 27s) [production]
00:12 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286534/ (duration: 00m 30s) [production]
2016-05-02 §
23:58 <krenair@tin> Finished scap: for https://gerrit.wikimedia.org/r/#/c/286535/ i18n changes (duration: 25m 57s) [production]
23:37 <ebernhardson> restart elastic2007, codfw cluster master, to resolve lingering issues after resolving frozen index race condition [production]
23:32 <krenair@tin> Started scap: for https://gerrit.wikimedia.org/r/#/c/286535/ i18n changes [production]
23:30 <krenair@tin> Synchronized php-1.27.0-wmf.22/extensions/Echo: https://gerrit.wikimedia.org/r/#/c/286535/ and https://gerrit.wikimedia.org/r/#/c/286532/ (duration: 00m 30s) [production]
23:10 <krenair@tin> Synchronized php-1.27.0-wmf.22/extensions/Flow/modules/flow/ui/widgets/editor/mw.flow.ui.EditorSwitcherWidget.js: https://gerrit.wikimedia.org/r/#/c/286527/ (duration: 00m 26s) [production]
22:56 <ebernhardson@tin> Synchronized php-1.27.0-wmf.22/extensions/CirrusSearch/: Cirrus: Stop auto-creating frozen index (duration: 00m 31s) [production]
22:56 <awight> CentralNotice fundraising campaigns disabled for CiviCRM outage [production]
22:52 <ebernhardson@tin> Synchronized wmf-config/CirrusSearch-production.php: Config setting to stop auto-creating frozen index in cirrus (duration: 00m 33s) [production]
22:18 <krenair@tin> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/286537/ (duration: 00m 42s) [production]
22:13 <cwd> updated crm from b386a6821c71310950ccdcdcf2616add727e1af4 to f5e8f98d07a2280118b7153bc342bf52ee67edd5 [production]
22:10 <papaul> restbase200[7-9]- signing puppet certs, salt-key, initial run [production]
21:26 <cscott> updated OCG to version b775e612520f9cd4acaea42226bcf34df07439f7 [production]
21:21 <cscott> starting OCG deploy (a little late) [production]
20:23 <gehel> restarting elasticsearch server elastic2001.codfw.wmnet (T110236) [production]
20:21 <gehel> starting rolling restart of elasticsearch codfw cluster to disable multicast (T110236) [production]
20:15 <subbu> finished deploying parsoid version 0a26f3a4 [production]
20:09 <subbu> synced code + restarted parsoid on wtp1001 as canary [production]
20:05 <subbu> starting deploy of parsoid version 0a26f3a4 [production]
19:27 <aaron@tin> Synchronized php-1.27.0-wmf.22/includes/filebackend/FileBackendMultiWrite.php: 63b2d7b2eae (duration: 00m 32s) [production]
19:17 <mutante> manually removing 2fa from my own wikitech account, adding it back .. [production]
18:24 <gehel> deploying latest WDQS version [production]
17:23 <robh> restbase2004 offline for next few hours for comparison work for new systems T132976 [production]
16:01 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/286286/ (duration: 00m 26s) [production]
15:53 <krenair@tin> Synchronized wikiversions-labs.json: https://gerrit.wikimedia.org/r/#/c/283689/ (duration: 00m 25s) [production]