551-600 of 10000 results (65ms)
2019-02-06 §
08:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1121 (duration: 00m 53s) [production]
07:51 <marostegui> Deploy schema change on db1121 - this will generate lag on s4 labs - also upgrade MySQL on db1121 T210713 [production]
07:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1121 (duration: 00m 54s) [production]
07:47 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103:3314 (duration: 00m 54s) [production]
07:19 <marostegui> Deploy schema change on wikitech T210713 [production]
07:14 <marostegui> Stop 's4' slave on dbstore1002 [production]
07:13 <marostegui> Deploy schema change on db1103:3314 (db1097:3314 was also done previously) - T210713 [production]
07:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 (duration: 00m 53s) [production]
07:09 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1097:3314 (duration: 00m 56s) [production]
06:29 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1097:3314 (duration: 01m 06s) [production]
04:39 <mutante> reloaded icinga service, cant find new check command definition [production]
03:13 <twentyafterfour@deploy1001> Finished scap: testwikis wikis to 1.33.0-wmf.16 refs T206670 (duration: 04m 18s) [production]
03:09 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.33.0-wmf.16 refs T206670 [production]
03:05 <mutante> actinium - gzipping and rotating some access logs [production]
03:01 <twentyafterfour@deploy1001> Synchronized scap/plugins/updateinterwikicache.py: (no justification provided) (duration: 00m 55s) [production]
02:47 <mutante> actinium - blocking a bad domain and restarting squid3 [production]
02:40 <twentyafterfour@deploy1001> Finished scap: sync and update localization for 1.33.0-wmf.16 (duration: 15m 50s) [production]
02:32 <XioNoX> push firewall rule to pfw3-eqiad - T215364 [production]
02:27 <mutante> actinium - apt-get clean for 8% more disk space after icinga alert [production]
02:25 <twentyafterfour@deploy1001> Started scap: sync and update localization for 1.33.0-wmf.16 [production]
02:16 <twentyafterfour@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.14 refs T206670 [production]
02:12 <eileen> civicrm revision changed from 6042acb363 to 613b388916, config revision is 306b4de48f [production]
02:02 <twentyafterfour@deploy1001> scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
01:22 <XioNoX> remove peering4/6 prefix-list from routers [production]
01:07 <XioNoX> add maintenance and rollback to junos operations class [production]
00:47 <twentyafterfour@deploy1001> Started scap: testwikis wikis to 1.33.0-wmf.16 refs T206670 [production]
00:33 <niharika29@deploy1001> Synchronized php-1.33.0-wmf.14/extensions/MobileFrontend/: EditorOverlay: captcha/abusefilter weren't being shown correctly T215101, T202374 (duration: 00m 50s) [production]
00:24 <niharika29@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Demystify Logstash debug level behavior (duration: 00m 51s) [production]
00:23 <niharika29@deploy1001> Synchronized wmf-config/logging.php: Demystify Logstash debug level behavior (duration: 00m 46s) [production]
00:18 <niharika29@deploy1001> Synchronized wmf-config/logging.php: Add PHP version to MW logs T215350 (duration: 00m 46s) [production]
00:16 <niharika29@deploy1001> Synchronized wmf-config/CommonSettings.php: Preserve Composer's include paths - T215126, T215224 (duration: 01m 40s) [production]
2019-02-05 §
18:56 <arlolra@deploy1001> Finished deploy [parsoid/deploy@a4acfa6]: (no justification provided) (duration: 02m 06s) [production]
18:53 <arlolra@deploy1001> Started deploy [parsoid/deploy@a4acfa6]: (no justification provided) [production]
18:39 <arlolra@deploy1001> Finished deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 (duration: 09m 54s) [production]
18:29 <arlolra@deploy1001> Started deploy [parsoid/deploy@a4acfa6]: Updating Parsoid to fb67a71 [production]
18:26 <bsitzmann@deploy1001> Finished deploy [mobileapps/deploy@2959e12]: Update mobileapps to 107c1b1 (T214714) (duration: 04m 43s) [production]
18:21 <bsitzmann@deploy1001> Started deploy [mobileapps/deploy@2959e12]: Update mobileapps to 107c1b1 (T214714) [production]
18:17 <mutante> contint1001/contint2001 -manually deleting crontab lines unpuppetized in gerrit:488019 (T209361) [production]
18:13 <Jeff_Green> authdns-update to deploy 7fee817fd3 [production]
17:22 <mutante> scandium - restart parsoid-vd service [production]
17:21 <mutante> scandium -- copy /srv/visualdiff/testrecude/testrun.ids from ruthenium to the same locatio [production]
15:15 <godog> force curator action 'replicas' to set older logstash indices to 1 replica - T213078 [production]
14:30 <marostegui> Deploy schema change on s4 codfw master with replication, lag will be generated on s4 codfw - T210713 [production]
14:26 <Jeff_Green> authdns-update for payments dev/testing hostname [production]
14:12 <marostegui> Deploy schema change on db1066 (s2 master) - T210713 [production]
14:05 <marostegui> Delete non used grants from dbstore1002: log, warehouse,project_illustration, cognate\_wiktionary, datasets - T212487 T210478 [production]
13:55 <godog> swift codfw-prod: add ms-be2047 - T209395 T209921 [production]
12:18 <addshore> swat done [production]
12:18 <addshore@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: Disable confirmation prompt on rollback by default T215019 (duration: 00m 47s) [production]
11:35 <moritzm> added firmware-enriched buster netboot image (T213546) [production]