201-250 of 10000 results (24ms)
2020-11-09 §
09:56 <Urbanecm> Purge https://vote.wikimedia.org/wiki/Main_Page (T262689) [production]
09:54 <Urbanecm> Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session at mwmaint1002 (wiki=svwiki; T246539) [production]
09:52 <hashar> Restarting Gerrit on gerrit1001 and gerrit2001 in order to have the JVM to exit after OutOfMemory # T267517 [production]
09:50 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 7b0a81f4294dcedfd5736884900cb561de9a080e: Revert "Change votewiki language temporarily to fa for fawiki elections" (T262689) (duration: 01m 08s) [production]
09:37 <moritzm> installing libexif security updates [production]
09:06 <godog> enable thanos query-frontend on thanos-fe hosts - T261281 [production]
08:24 <XioNoX> configure traceoptions on pfw3-eqiad - T263833 [production]
08:11 <hashar> Restarting Gerrit on gerrit1001 and gerrit2001 [production]
07:58 <hashar> Restarted CI Jenkins on contint2001 for Java upgrade [production]
07:22 <matanya> Matanya set flags +AV on Mark7747 in #cvn-wp-hr [cvn]
07:17 <elukey> restart gerrit on gerrit2001 (OOM registered for two days ago, uptime from systemctl since a month ago, probably in a weird state) [production]
07:04 <Majavah> mark task 6 as approved and add cronjob for it [tools.majavah-bot]
07:00 <Majavah> removing multiple large log files [tools.majavah-bot]
01:35 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.14/tests/phpunit/maintenance/categoryChangesAsRdfTest.php: this was cherry-picked to make CI pass, pushing it out just for a clean staging dir (duration: 01m 06s) [production]
01:32 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.14/resources/src/mediawiki.api/upload.js: fixing UBN T266903 (duration: 01m 06s) [production]
01:30 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.14/resources/src/mediawiki.Upload.js: fixing UBN T266903 (duration: 01m 07s) [production]
01:29 <tstarling@deploy1001> sync-file aborted: fixing UBN T266903 (duration: 00m 01s) [production]
2020-11-08 §
23:08 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.16/resources/src/mediawiki.api/upload.js: fixing UBN T266903 (duration: 01m 06s) [production]
23:06 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.16/resources/src/mediawiki.Upload.js: fixing UBN T266903 (duration: 01m 35s) [production]
20:34 <cdanis> repool esams [production]
19:48 <cdanis@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
19:48 <cdanis@cumin1001> START - Cookbook sre.network.cf [production]
19:16 <cdanis> depool esams [production]
18:35 <cdanis@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
18:35 <cdanis@cumin1001> START - Cookbook sre.network.cf [production]
17:43 <wm-bot> <taavi> manually rotating log file update-train-blockers.out, it was 1.4M [tools.train-blockers]
06:31 <elukey> truncate huge log file on an-worker1103 for app id application_1601916545561_147041 [analytics]
2020-11-07 §
11:41 <Jayprakash12345> Deploying T267473 T267471 [tools.indic-wscontest]
10:37 <Jayprakash12345> Fixed T267465 in production [tools.indic-wscontest]
00:16 <dpifke> Cherry-picking https://gerrit.wikimedia.org/r/c/operations/puppet/+/639885 and https://gerrit.wikimedia.org/r/c/performance/arc-lamp/+/639886 in beta. Should only affect deployment-webperf12. [releng]
2020-11-06 §
23:44 <bstorm> toolsbeta k8s cluster fully upgraded to 1.17.13 T263284 [toolsbeta]
23:38 <dwisehaupt> frdata1001 upgraded to buster [production]
22:40 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@bfaac0f]: Update to master, primarily updates for ores weekly predictions handling (duration: 01m 08s) [production]
22:39 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@bfaac0f]: Update to master, primarily updates for ores weekly predictions handling [production]
22:29 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@dc63e7e]: Update to master, primarily updates for ores weekly predictions handling (duration: 00m 26s) [production]
22:29 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@dc63e7e]: Update to master, primarily updates for ores weekly predictions handling [production]
21:23 <bstorm> upgrading toolsbeta-test-k8s-control-1 to k8s 1.17.13 T263284 [toolsbeta]
20:57 <reedy@deploy1001> Synchronized php-1.36.0-wmf.16/skins/CologneBlue/: T267278 (duration: 01m 05s) [production]
20:56 <reedy@deploy1001> Synchronized php-1.36.0-wmf.14/skins/CologneBlue/: T267278 (duration: 01m 10s) [production]
20:07 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:05 <robh@cumin1001> START - Cookbook sre.hosts.downtime [production]
19:00 <mforns> launched backfilling of data quality stats for os_family_entropy_by_access_method [analytics]
18:54 <cwhite@cumin1001> conftool action : set/pooled=no; selector: name=mw1379.eqiad.wmnet [production]
17:02 <dwisehaupt> rolled out new thank_you_mail_send process_control scripts to utilize frmx hosts [production]
16:45 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]