1051-1100 of 1724 results (15ms)
|
2020-01-06
§
|
| 12:18 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562083|Don’t check constraints on P6685 statements (T227865)]] (duration: 00m 55s) |
[production] |
|
2019-12-16
§
|
| 07:13 |
<_joe_> |
restarting cpjobqueue on scb1001 to check if processing rate of recentChanges recovers T240518 |
[production] |
|
2019-12-11
§
|
| 19:24 |
<awight@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
| 12:38 |
<andrew-wmde@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-12-09
§
|
| 14:26 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:555941|Disable sanity check cirrus jobs for Wikidata (T239931 T229407)]] (duration: 00m 57s) |
[production] |
|
2019-12-05
§
|
| 19:15 |
<urbanecm@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-11-19
§
|
| 05:37 |
<eileen> |
process control - I reverted the above to check some stuff first |
[production] |
|
2019-11-14
§
|
| 13:37 |
<ladsgroup@deploy1001> |
scap failed: average error rate on 7/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-11-04
§
|
| 18:30 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@1ac26da]: add new user-selected puppet edit mode (duration: 03m 27s) |
[production] |
| 18:26 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@1ac26da]: add new user-selected puppet edit mode |
[production] |
|
2019-10-30
§
|
| 22:22 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@2d551d8]: Rolling out a currently-turned-off puppet edit mode (duration: 03m 15s) |
[production] |
| 22:19 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@2d551d8]: Rolling out a currently-turned-off puppet edit mode |
[production] |
| 20:17 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: WikimediaEditorTasks: Enable edit streaks on beta (duration: 01m 03s) |
[production] |
|
2019-10-29
§
|
| 20:43 |
<papaul> |
rebooting cp3056 for HW check |
[production] |
|
2019-10-25
§
|
| 12:34 |
<jynus> |
introducing new freshnesh check for bacula T234900 |
[production] |
|
2019-10-23
§
|
| 22:55 |
<brennen@deploy1001> |
Synchronized php-1.35.0-wmf.3/extensions/AbuseFilter: SWAT: [[gerrit:545620|Unbreak filter edit form (T236286)]] (duration: 01m 05s) |
[production] |
|
2019-10-22
§
|
| 13:38 |
<gehel> |
silencing LVS check for katotherian (we know there is an issue) - T236163 |
[production] |
| 10:14 |
<ema> |
puppetmaster1001: rm /var/run/confd-template/.kibana-ssl*.err to make confd icinga check happy T210411 |
[production] |
|
2019-10-21
§
|
| 07:06 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Pool non partitioned db1089 into s1 special slaves to check for slow queries T223151', diff saved to https://phabricator.wikimedia.org/P9406 and previous config saved to /var/cache/conftool/dbconfig/20191021-070655-marostegui.json |
[production] |
| 05:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Give weight 100 to db1130 on s5 to check for slow queries T223151', diff saved to https://phabricator.wikimedia.org/P9402 and previous config saved to /var/cache/conftool/dbconfig/20191021-055843-marostegui.json |
[production] |
|
2019-10-10
§
|
| 21:49 |
<jforrester@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Don't check to shard static config cache for HHVM any more (duration: 00m 50s) |
[production] |
| 21:48 |
<jforrester@deploy1001> |
Synchronized wmf-config/Wikibase.php: Don't check to shard wmgWBSharedCacheKey for HHVM any more (duration: 00m 51s) |
[production] |
|
2019-10-08
§
|
| 20:24 |
<mutante> |
labweb1001 - edit /srv/mediawiki/wmf-config/wikitech.php to and change "false" to "true" on line 52 to enable LDAP debug logging for T234996 |
[production] |
|
2019-09-25
§
|
| 07:51 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T233584 revert: [cirrus] temp disable sanity check (duration: 01m 05s) |
[production] |
| 05:06 |
<marostegui> |
Run a data check on labsdb1011 - T233766 |
[production] |
|
2019-09-24
§
|
| 12:20 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T233584 [cirrus] temp disable sanity check (duration: 00m 55s) |
[production] |
|
2019-09-23
§
|
| 16:29 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: 84afa44: Close bgwikinews, but allow sysops to edit (T233322; 2/2) (duration: 00m 56s) |
[production] |
| 16:27 |
<urbanecm@deploy1001> |
Synchronized dblists/closed.dblist: 84afa44: Close bgwikinews, but allow sysops to edit (T233322; 1/2) (duration: 00m 58s) |
[production] |
|
2019-09-18
§
|
| 20:40 |
<jforrester@deploy1001> |
scap failed: average error rate on 9/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-09-10
§
|
| 18:42 |
<herron> |
rolling out "Aggregate IPsec Tunnel Status” icinga check, please disregard for the time being if it alerts |
[production] |
| 14:48 |
<hashar@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-08-28
§
|
| 11:42 |
<mlitn@deploy1001> |
Synchronized php-1.34.0-wmf.20/extensions/WikibaseMediaInfo: [SDC] Check existence of objects before using it (duration: 00m 54s) |
[production] |
| 09:11 |
<mutante> |
miscweb2001 - edit /etc/apache2/ports.conf and replace port 444 with 443 again; a2dismod ssl; systemctl restart apache2; systemctl restart envoyproxy; now also has envoy listening on 443, matches miscweb1001 and manual hack removed (T210411) |
[production] |
|
2019-08-27
§
|
| 23:30 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.20/extensions/MobileFrontend/resources/dist/: SWAT: a109b25: Build assets reflecting edit change (duration: 00m 55s) |
[production] |
|
2019-08-07
§
|
| 16:34 |
<mobrovac@deploy1001> |
scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-07-28
§
|
| 15:13 |
<arturo> |
disable 1m load average check in icinga for labstore1007 for 24h |
[production] |
|
2019-07-24
§
|
| 07:21 |
<marostegui> |
Stop MySQL on db1117:3322 to check dbproxy1013 notifications - T202367 |
[production] |
|
2019-07-22
§
|
| 11:14 |
<awight@deploy1001> |
Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete, (remove labs customizations) (T225617, T226532)]] (duration: 00m 54s) |
[production] |
| 11:13 |
<awight@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete (T225617, T226532)]] (duration: 00m 56s) |
[production] |
|
2019-07-10
§
|
| 22:59 |
<jforrester@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-06-26
§
|
| 16:25 |
<urbanecm@deploy1001> |
scap failed: average error rate on 11/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
| 09:49 |
<_joe_> |
restarted php7.2-fpm on mwdebug1002, testing php-check-and-restart script |
[production] |
|
2019-06-24
§
|
| 16:13 |
<mobrovac@deploy1001> |
Synchronized rpc/RunSingleJob.php: RunSingleJob: check that only the database param is set and leave the rest to JobExecutor - T226109 (duration: 00m 55s) |
[production] |
|
2019-06-17
§
|
| 16:27 |
<jynus> |
starting data check on db2097+db2046, expect increase in read row rate T225378 |
[production] |
|
2019-06-14
§
|
| 15:56 |
<gehel> |
repooling wdqs1003, not catching up anyway (high edit load) |
[production] |
|
2019-06-06
§
|
| 11:55 |
<lucaswerkmeister-wmde@deploy1001> |
scap failed: average error rate on 8/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
|
2019-06-05
§
|
| 19:48 |
<marostegui> |
Check data consistency on db1091 against db1135 - T225060 |
[production] |
|
2019-06-03
§
|
| 13:44 |
<mholloway-shell@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: WikimediaEditorTasks: Drop caption edit counter unlock delay to 0 (duration: 00m 49s) |
[production] |
|
2019-05-29
§
|
| 22:50 |
<mutante> |
miscweb2001 - when first trying to git pull iegreview - still tries to resolve 'tin.eqiad.wmnet' which is long gone. fix is still to manually edit /srv/deployment/iegreview/iegreview-cache/cache/.git/config |
[production] |
| 14:32 |
<andrewbogott> |
powering off cloudcontrol1003 as one last check to see what explodes before I reimage it |
[production] |