9701-9750 of 10000 results (57ms)
2017-06-05 §
22:02 <bblack> cp1099 - varnish-backend-restart (mailbox lag) [production]
21:34 <bawolff> deployed patch for T165846 [production]
21:01 <reedy@tin> Synchronized wmf-config/CommonSettings.php: Run Pdf Processors in firejails T164145 T164000 (duration: 00m 40s) [production]
20:16 <subbu> updated parsoid to 141fc07d (T166655) [production]
20:10 <ssastry@tin> Finished deploy [parsoid/deploy@bb0613c]: Updating Parsoid to 141fc07d (duration: 07m 02s) [production]
20:03 <ssastry@tin> Started deploy [parsoid/deploy@bb0613c]: Updating Parsoid to 141fc07d [production]
18:52 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/357169/2 (duration: 00m 39s) [production]
18:43 <MaxSem> ran mwscript maintenance/namespaceDupes.php --wiki=etwiki --fix [production]
18:41 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/357025/2 (duration: 00m 39s) [production]
18:36 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/355594/2 (duration: 00m 39s) [production]
18:29 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/357186/2 (duration: 00m 42s) [production]
18:25 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/357026/2 (duration: 00m 38s) [production]
18:11 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/356437/4 (duration: 00m 40s) [production]
16:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1089 original weight - T166935 (duration: 00m 38s) [production]
16:19 <jynus> stopping db2037 and preparing for reimage [production]
15:16 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1089 weight - T166935 (duration: 00m 39s) [production]
15:03 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1089 weight - T166935 (duration: 00m 38s) [production]
14:45 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 with low weight - T166935 (duration: 00m 39s) [production]
13:47 <bblack> rebooting lvs1010 again [production]
13:27 <zeljkof> eu swat finished [production]
13:16 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:357128|Lift IP throttle for Wikimedia Chile editathon (T166788)]] (duration: 00m 39s) [production]
13:02 <bblack> rebooting lsv1010 (post-reinstall) [production]
12:54 <marostegui> Stop MySQL db1047 - T166452 [production]
09:06 <marostegui> Stop replication on db1070 for maintenance - T153743 [production]
08:10 <godog> swift eqiad-prod decom ms-be1009 / 10 / 11 - T166489 [production]
07:43 <marostegui> Stop labsdb1011 to take a backup - T153743 [production]
07:41 <jynus> stopping db2038 mysql and preparing for reimage [production]
07:15 <marostegui> Deploy alter table in s2 (codfw master) this will generate lag in codfw - T166205 [production]
06:20 <marostegui> Deploy alter table s4 - on labsdb1001 - T166206 [production]
06:15 <marostegui> Deploy alter table on s3 - db1069 - T166278 [production]
06:13 <marostegui> Deploy alter table on s4 - db1053 - T166206 [production]
06:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1053 - T166206 (duration: 00m 39s) [production]
05:58 <marostegui> Stop MySQL on db1095 to take a backup - T153743 [production]
05:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Add coments to db1089's current status (duration: 00m 39s) [production]
02:27 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon Jun 5 02:27:53 UTC 2017 (duration 6m 2s) [production]
02:21 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.2) (duration: 08m 14s) [production]
2017-06-04 §
10:31 <ema> mw2256 down, console stuck on 'Starti'. power cycled. [production]
02:23 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.2) (duration: 09m 12s) [production]
2017-06-03 §
05:20 <marostegui> Reboot db1089 - T166933 [production]
05:08 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1059 - it is broken (duration: 00m 41s) [production]
02:30 <l10nupdate@tin> ResourceLoader cache refresh completed at Sat Jun 3 02:30:27 UTC 2017 (duration 6m 24s) [production]
02:24 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.2) (duration: 07m 47s) [production]
00:04 <mutante> wikitech-static-iad: mv /etc/acme/cert/wikitech-static-iad-signed.csr /etc/acme/cert/wikitech-static-iad.chained.crt ; wikitech-static-ord: copy wiki logo: /srv/mediawiki/images# wget https://wikitech-static-iad.wikimedia.org/w/images/labswiki.png [production]
2017-06-02 §
23:53 <demon@tin> Synchronized wmf-config/throttle.php: pruning some old throttle exceptions (duration: 00m 40s) [production]
23:46 <mutante> wikitech-static-iad: edited acme_tiny.py to adjust URL to agreement PDF, to fix ""Provided agreement URL [https://letsencrypt.org/documents/LE-SA-v1.0.1-July-27-2015.pdf] does not match current agreement URL[https://letsencrypt.org/documents/LE-SA-v1.1.1-August-1-2016.pdf]" [production]
23:45 <mutante> wikitech-static-iad: create new cert for "iad" hostname, using acme-setup/acme-tiny: /usr/local/sbin# acme-setup -i "wikitech-static-iad" -s "wikitech-static-iad.wikimedia.org" ; python acme_tiny.py --account-key /etc/acme/acct/acct.key --csr /etc/acme/csr/wikitech-static-iad.pem --acme-dir /var/acme/challenge/ > /etc/acme/cert/wikitech-static-iad-signed.csr ; had to hack acme_tiny.py [production]
23:22 <mutante> wikitech-static-ord copied Lets-Encrypt intermediate certs from /usr/local/share/ca-certificates on old server [production]
23:19 <mutante> wikitech-static (iad): adjust Apache config to use wikitech-static-iad [production]
23:18 <mutante> wikitech-static-ord: installed package upgrades, installed vim, removing "ord" from Apache config after DNS change .. [production]
23:14 <mutante> maintenance on status.wikimedia.org and wikitech-static.wikimedia.org [production]