151-200 of 10000 results (46ms)
2018-09-26 §
08:21 <moritzm> rebooting mw1250-mw1269 for kernel security updates [production]
08:17 <banyek> db1107 upgrade finished (T205288) [production]
08:15 <banyek> db1107 upgrade finished [production]
08:14 <hashar> Restarting CI Jenkins on contint1001 [production]
08:04 <elukey> stop eventlogging_sync on db1108 and the mysql kafka consumers on eventlog1002 as prep step for db1107 maintenance [production]
08:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1092, server crashed - T205514 (duration: 00m 56s) [production]
08:00 <banyek> donwtiming db1107 as upgrade (kernel & mariadb) [production]
07:50 <marostegui> Hard reset db1092, server crashed - T205514 [production]
07:48 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:462864|Set testwikidatawiki CacheEpoch to 2018-09-19]] T205330 (duration: 00m 56s) [production]
07:47 <elukey> reboot an-master1002 as attempt to clear out some systemd@fsck alarms [production]
07:46 <godog> repair /dev/sdd1 on ms-be1043 - T199198 [production]
07:41 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2085:3311 (duration: 00m 56s) [production]
07:36 <banyek> stopping s2 replication on dbstore2002 (compressing tables) [production]
07:34 <godog> powercycle ms-be2030 - no console [production]
07:31 <jynus> restart db1115 [production]
07:29 <godog> repair /dev/sdh1 on ms-be2041 - T199198 [production]
07:28 <jynus> stoping mariadb at db1115 [production]
07:19 <volans> restarted ircecho on einsteinium "icinga-wm quit (Reason: Remote host closed the connection)" [production]
05:29 <marostegui> Deploy schema change on db2085:3311 [production]
05:28 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2085:3311 (duration: 00m 56s) [production]
05:20 <marostegui> Deploy schema change on s8 eqiad, this will generate lag - T203709 [production]
05:17 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088, db1098:3316 and db1098:3317 (duration: 01m 06s) [production]
04:17 <tstarling@deploy1001> Synchronized php-1.32.0-wmf.23/includes/specials/SpecialExport.php: enable export logging channel (attempt 2) (duration: 00m 51s) [production]
04:09 <tstarling@deploy1001> Synchronized php-1.32.0-wmf.23/includes/specials/SpecialExport.php: enable export logging channel (duration: 00m 55s) [production]
03:48 <eileen> process-control config revision is 3b785f0af4 - disable omniail repair job [production]
03:42 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.23/includes/page/ImageHistoryPseudoPager.php: T204796 - I17455fef0d8 (duration: 00m 58s) [production]
03:21 <tstarling@deploy1001> Synchronized wmf-config/InitialiseSettings.php: add export logging channel for g 461647 (duration: 00m 57s) [production]
03:06 <l10nupdate@deploy1001> ResourceLoader cache refresh completed at Wed Sep 26 03:06:46 UTC 2018 (duration 10m 54s) [production]
02:55 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.23) (duration: 05m 10s) [production]
02:32 <l10nupdate@deploy1001> scap sync-l10n completed (1.32.0-wmf.22) (duration: 12m 42s) [production]
2018-09-25 §
23:59 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/GlobalPreferences/: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/GlobalPreferences/+/462822/ (duration: 00m 56s) [production]
23:53 <eileen> civicrm revision changed from ca49aed673 to 018ff6325f, config revision is e71b8fdbdf [production]
23:49 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.22/extensions/UploadWizard/: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/UploadWizard/+/462781/ (duration: 00m 56s) [production]
23:46 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.23/extensions/UploadWizard/: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/UploadWizard/+/462780/ (duration: 00m 56s) [production]
23:39 <maxsem@deploy1001> Synchronized php-1.32.0-wmf.22/skins/MinervaNeue/: https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/MinervaNeue/+/462705/ (duration: 00m 57s) [production]
23:29 <maxsem@deploy1001> Synchronized wmf-config/WikibaseSearchSettings.php: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/462347/ (duration: 00m 57s) [production]
22:55 <ppchelko@deploy1001> Finished deploy [restbase/deploy@0fa695e] (dev-cluster): Deployinng content negotiation to dev cluster for ab testing (duration: 02m 53s) [production]
22:52 <ppchelko@deploy1001> Started deploy [restbase/deploy@0fa695e] (dev-cluster): Deployinng content negotiation to dev cluster for ab testing [production]
19:17 <catrope@deploy1001> Synchronized php-1.32.0-wmf.23/extensions/ORES/maintenance/BackfillPageTriageQueue.php: I3f1ae92d8645 (duration: 00m 58s) [production]
17:49 <otto@deploy1001> Finished deploy [analytics/refinery@ce8f0b3]: Deploying refinery-source 0.0.75 for ConfigHelper Refine - T203804 (duration: 10m 22s) [production]
17:39 <otto@deploy1001> Started deploy [analytics/refinery@ce8f0b3]: Deploying refinery-source 0.0.75 for ConfigHelper Refine - T203804 [production]
17:12 <XioNoX> depool ulsfo for DC move [production]
16:59 <gehel> forcing puppet run on all elastic nodes (including logstash) to recover prometheus metric exporter [production]
15:14 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Turn off EducationProgram T188411 T125618 (duration: 00m 57s) [production]
15:02 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.32.0-wmf.23 [production]
14:50 <marostegui> Stop MySQL on db1098 s6 and s7 for upgrade [production]
14:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 (duration: 00m 57s) [production]
14:39 <zfilipin@deploy1001> Finished scap: testwiki to php-1.32.0-wmf.23 and rebuild l10n cache (duration: 20m 50s) [production]
14:38 <moritzm> rebooting mw1240-mw1258 for kernel security updates [production]
14:18 <zfilipin@deploy1001> Started scap: testwiki to php-1.32.0-wmf.23 and rebuild l10n cache [production]