901-950 of 10000 results (49ms)
2018-09-26 §
07:47 <elukey> reboot an-master1002 as attempt to clear out some systemd@fsck alarms [production]
07:46 <godog> repair /dev/sdd1 on ms-be1043 - T199198 [production]
07:41 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2085:3311 (duration: 00m 56s) [production]
07:36 <banyek> stopping s2 replication on dbstore2002 (compressing tables) [production]
07:34 <godog> powercycle ms-be2030 - no console [production]
07:31 <jynus> restart db1115 [production]
07:29 <godog> repair /dev/sdh1 on ms-be2041 - T199198 [production]
07:28 <jynus> stoping mariadb at db1115 [production]
07:19 <volans> restarted ircecho on einsteinium "icinga-wm quit (Reason: Remote host closed the connection)" [production]
05:29 <marostegui> Deploy schema change on db2085:3311 [production]
05:28 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2085:3311 (duration: 00m 56s) [production]
05:20 <marostegui> Deploy schema change on s8 eqiad, this will generate lag - T203709 [production]
05:17 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088, db1098:3316 and db1098:3317 (duration: 01m 06s) [production]
04:17 <tstarling@deploy1001> Synchronized php-1.32.0-wmf.23/includes/specials/SpecialExport.php: enable export logging channel (attempt 2) (duration: 00m 51s) [production]
04:09 <tstarling@deploy1001> Synchronized php-1.32.0-wmf.23/includes/specials/SpecialExport.php: enable export logging channel (duration: 00m 55s) [production]
03:48 <eileen> process-control config revision is 3b785f0af4 - disable omniail repair job [production]
03:42 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.23/includes/page/ImageHistoryPseudoPager.php: T204796 - I17455fef0d8 (duration: 00m 58s) [production]
03:21 <tstarling@deploy1001> Synchronized wmf-config/InitialiseSettings.php: add export logging channel for g 461647 (duration: 00m 57s) [production]
03:06 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Wed Sep 26 03:06:46 UTC 2018 (duration 10m 54s) [production]
02:55 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.23) (duration: 05m 10s) [production]
02:32 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.22) (duration: 12m 42s) [production]
2018-09-25 §
23:59 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/GlobalPreferences/: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/GlobalPreferences/+/462822/ (duration: 00m 56s) [production]
23:53 <eileen> civicrm revision changed from ca49aed673 to 018ff6325f, config revision is e71b8fdbdf [production]
23:49 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/UploadWizard/: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/UploadWizard/+/462781/ (duration: 00m 56s) [production]
23:46 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.23/extensions/UploadWizard/: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/UploadWizard/+/462780/ (duration: 00m 56s) [production]
23:39 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.22/skins/MinervaNeue/: https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/MinervaNeue/+/462705/ (duration: 00m 57s) [production]
23:29 <maxsem@deploy1001> Synchronized wmf-config/WikibaseSearchSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/462347/ (duration: 00m 57s) [production]
22:55 <ppchelko@deploy1001> Finished deploy [restbase/deploy@0fa695e] (dev-cluster): Deployinng content negotiation to dev cluster for ab testing (duration: 02m 53s) [production]
22:52 <ppchelko@deploy1001> Started deploy [restbase/deploy@0fa695e] (dev-cluster): Deployinng content negotiation to dev cluster for ab testing [production]
19:17 <catrope@deploy1001> Synchronized php-1.32.0-wmf.23/extensions/ORES/maintenance/BackfillPageTriageQueue.php: I3f1ae92d8645 (duration: 00m 58s) [production]
17:49 <otto@deploy1001> Finished deploy [analytics/refinery@ce8f0b3]: Deploying refinery-source 0.0.75 for ConfigHelper Refine - T203804 (duration: 10m 22s) [production]
17:39 <otto@deploy1001> Started deploy [analytics/refinery@ce8f0b3]: Deploying refinery-source 0.0.75 for ConfigHelper Refine - T203804 [production]
17:12 <XioNoX> depool ulsfo for DC move [production]
16:59 <gehel> forcing puppet run on all elastic nodes (including logstash) to recover prometheus metric exporter [production]
15:14 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Turn off EducationProgram T188411 T125618 (duration: 00m 57s) [production]
15:02 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.32.0-wmf.23 [production]
14:50 <marostegui> Stop MySQL on db1098 s6 and s7 for upgrade [production]
14:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 (duration: 00m 57s) [production]
14:39 <zfilipin@deploy1001> Finished scap: testwiki to php-1.32.0-wmf.23 and rebuild l10n cache (duration: 20m 50s) [production]
14:38 <moritzm> rebooting mw1240-mw1258 for kernel security updates [production]
14:18 <zfilipin@deploy1001> Started scap: testwiki to php-1.32.0-wmf.23 and rebuild l10n cache [production]
14:15 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.19 [keeping static files] (duration: 01m 29s) [production]
14:12 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.18 (duration: 03m 02s) [production]
14:10 <marostegui> Upgrade db1088 [production]
14:05 <marostegui> Stop db1088 and db1098:3316 in sync [production]
14:03 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 (duration: 00m 50s) [production]
14:02 <zfilipin@deploy1001> Pruned MediaWiki: 1.32.0-wmf.16 (duration: 08m 27s) [production]
13:29 <marostegui> Deploy schema change on s2 eqiad - this might generate lag on s2 eqiad - T203709 [production]
13:13 <marostegui> Deploy schema change on s6 eqiad - this might generate lag on s6 eqiad - T203709 [production]
13:07 <marostegui> Deploy schema change on s5 eqiad - this might generate lag on s5 eqiad - T203709 [production]