1151-1200 of 1724 results (10ms)
2018-12-14 §
13:59 <marostegui> Enable notifications for db1095 (s3 lag check)- T211973 [production]
13:57 <marostegui> Enable notifications for db2068 (s7 lag check)- T211973 [production]
2018-12-13 §
12:12 <mobrovac@deploy1001> Finished deploy [restbase/deploy@55fcd4b]: Remove restbase200[1-6], ensure body.tfa exists for feed responses and disable Citoid check - T211070 T211871 T211411 (duration: 18m 59s) [production]
11:53 <mobrovac@deploy1001> Started deploy [restbase/deploy@55fcd4b]: Remove restbase200[1-6], ensure body.tfa exists for feed responses and disable Citoid check - T211070 T211871 T211411 [production]
2018-12-12 §
12:35 <arturo> T205969 icinga downtime load-avg check for labstore1007 until January (1 month) [production]
2018-12-07 §
11:09 <mobrovac@deploy1001> Finished deploy [citoid/deploy@269c9c7]: Add an explicit check for Zotero (duration: 06m 19s) [production]
11:03 <mobrovac@deploy1001> Started deploy [citoid/deploy@269c9c7]: Add an explicit check for Zotero [production]
10:58 <mobrovac@deploy1001> Finished deploy [citoid/deploy@6b36331]: Add an explicit check for Zotero (duration: 02m 42s) [production]
10:55 <mobrovac@deploy1001> Started deploy [citoid/deploy@6b36331]: Add an explicit check for Zotero [production]
2018-12-05 §
10:17 <arturo> T205969 icinga downtime the load avg check in labstore1007 for 1 week [production]
2018-11-30 §
00:39 <thcipriani@deploy1001> Synchronized php-1.33.0-wmf.6/includes/api/ApiBase.php: SWAT: [[gerrit:476409|Add stats for block errors on create/edit actions]] T201717 (duration: 00m 48s) [production]
2018-11-29 §
14:29 <hashar@deploy1001> scap failed: average error rate on 11/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-11-27 §
12:19 <mobrovac@deploy1001> Synchronized rpc/RunSingleJob.php: RunSingleJob: Check that JobExecutor has been loaded - T208922 (duration: 00m 47s) [production]
2018-11-26 §
19:24 <cmjohnson1> cloudvirt1019 is going down to check something for HPE [production]
2018-11-20 §
12:49 <zfilipin@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-11-15 §
20:22 <mholloway-shell@deploy1001> Finished deploy [kartotherian/deploy@UNKNOWN]: Fix: Loosen WDQS content-type header check to unbreak maps (T209471) (duration: 03m 55s) [production]
20:18 <mholloway-shell@deploy1001> Started deploy [kartotherian/deploy@UNKNOWN]: Fix: Loosen WDQS content-type header check to unbreak maps (T209471) [production]
20:15 <mholloway-shell@deploy1001> Finished deploy [kartotherian/deploy@48a1e83]: Fix: Loosen WDQS content-type header check to unbreak maps (T209471) (duration: 04m 26s) [production]
20:11 <mholloway-shell@deploy1001> Started deploy [kartotherian/deploy@48a1e83]: Fix: Loosen WDQS content-type header check to unbreak maps (T209471) [production]
12:56 <tarrow@deploy1001> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-10-30 §
12:17 <addshore@deploy1001> Synchronized wmf-config/Wikibase.php: Wikibase.php, check for 2 more wmg vars before using them (duration: 00m 47s) [production]
2018-10-29 §
14:52 <addshore@deploy1001> Synchronized wmf-config/Wikibase.php: Wikibase.php, check $wmgWBRepoSettingsSparqlEndpoint is set (duration: 00m 46s) [production]
2018-10-24 §
22:33 <bawolff@deploy1001> scap failed: average error rate on 8/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
17:03 <jforrester@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-10-23 §
21:47 <mutante> icinga1001 - replacing check_ping with check_fping as the standard host check command, for faster host checks (another tip from Nagios Tuning guide, still manual testing) (T202782) [production]
21:30 <mutante> icinga1001 - changing check_result_reaper_frequecy from 10 to 3, trying to lower average check latency. "allow faster check result processing -> requires more CPU" (T202782) [production]
2018-10-22 §
18:50 <jforrester@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-10-18 §
15:35 <twentyafterfour@deploy1001> scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
11:54 <mobrovac@deploy1001> Finished deploy [restbase/deploy@1041a02]: Disable onthisday check - T203588 (duration: 21m 23s) [production]
11:33 <mobrovac@deploy1001> Started deploy [restbase/deploy@1041a02]: Disable onthisday check - T203588 [production]
09:20 <banyek> enabling replication monitor check on pc1005 pc1006 pc2005 pc2006 (T206992) [production]
09:01 <banyek> enabling replication monitor check on pc1004 (T206992) [production]
08:56 <banyek> enabling replication monitor check on pc2004 (T206992) [production]
2018-10-15 §
11:26 <zfilipin@deploy1001> scap failed: average error rate on 4/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-10-09 §
21:50 <mutante> releases1001 - restarted jenkins (it went from 200 -> 503 -> 403) curl localhost:8080 works again after restart, icinga check still getting 403 now [production]
2018-10-03 §
19:14 <dduvall@deploy1001> scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
2018-10-02 §
11:41 <arturo> downtime labstore1007 load check in icinga for 1d [production]
2018-10-01 §
22:52 <ppchelko@deploy1001> Finished deploy [restbase/deploy@babfe80]: Don't log the request for transform failures, take 3, feeds check timeouts (duration: 06m 22s) [production]
22:46 <ppchelko@deploy1001> Started deploy [restbase/deploy@babfe80]: Don't log the request for transform failures, take 3, feeds check timeouts [production]
22:45 <ppchelko@deploy1001> Finished deploy [restbase/deploy@babfe80]: Don't log the request for transform failures, take 2, feeds check timeouts (duration: 03m 57s) [production]
22:41 <ppchelko@deploy1001> Started deploy [restbase/deploy@babfe80]: Don't log the request for transform failures, take 2, feeds check timeouts [production]
2018-09-24 §
18:44 <gjg@deploy1001> Synchronized wmf-config/throttle.php: [config] {{gerrit|462014}} New users on IP for edit-a-thon (October 11) ({{phab|T204829}}) (duration: 00m 49s) [production]
2018-09-20 §
18:45 <thcipriani@deploy1001> scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]
2018-09-06 §
17:45 <thcipriani@deploy1001> scap failed: average error rate on 6/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]
2018-09-05 §
08:52 <oblivian@puppetmaster1001> conftool action : edit; selector: name=ReadOnly,scope=codfw [production]
08:51 <oblivian@puppetmaster1001> conftool action : edit; selector: name=ReadOnly,scope=codfw [production]
2018-08-31 §
18:10 <jforrester@deploy1001> Synchronized php-1.32.0-wmf.19/includes/Title.php: Hot-deploy of I05eea553c58 to let users edit [[Copyright]] again (duration: 00m 50s) [production]
2018-08-27 §
11:16 <tgr@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:421124|Remove sitewide and user CSS/JS editing from old groups]] [[gerrit:421125|Enforce that interface-admin is the only group that can edit non-own CSS/JS]] (T190015) (duration: 00m 48s) [production]
11:15 <tgr@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:421124|Remove sitewide and user CSS/JS editing from old groups]] [[gerrit:421125|Enforce that interface-admin is the only group that can edit non-own CSS/JS]] (T190015) (duration: 00m 48s) [production]
2018-08-23 §
23:16 <reedy@deploy1001> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]