2651-2700 of 10000 results (29ms)
2020-11-09 §
11:57 <jynus> restart dbstore1004 mariadb instances [production]
10:49 <ayounsi@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
10:46 <ayounsi@cumin1001> START - Cookbook sre.dns.netbox [production]
10:36 <XioNoX> add 185.15.56.240/29 IPs to relevant cloudsw interfaces - T265288 [production]
10:35 <effie> merging 638109 and roll restart ms-fe* hosts to pick up the change [production]
10:11 <XioNoX> renumber cloud-xlink1-eqiad [production]
09:56 <Urbanecm> Purge https://vote.wikimedia.org/wiki/Main_Page (T262689) [production]
09:54 <Urbanecm> Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session at mwmaint1002 (wiki=svwiki; T246539) [production]
09:52 <hashar> Restarting Gerrit on gerrit1001 and gerrit2001 in order to have the JVM to exit after OutOfMemory # T267517 [production]
09:50 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 7b0a81f4294dcedfd5736884900cb561de9a080e: Revert "Change votewiki language temporarily to fa for fawiki elections" (T262689) (duration: 01m 08s) [production]
09:37 <moritzm> installing libexif security updates [production]
09:06 <godog> enable thanos query-frontend on thanos-fe hosts - T261281 [production]
08:24 <XioNoX> configure traceoptions on pfw3-eqiad - T263833 [production]
08:11 <hashar> Restarting Gerrit on gerrit1001 and gerrit2001 [production]
07:58 <hashar> Restarted CI Jenkins on contint2001 for Java upgrade [production]
07:17 <elukey> restart gerrit on gerrit2001 (OOM registered for two days ago, uptime from systemctl since a month ago, probably in a weird state) [production]
01:35 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.14/tests/phpunit/maintenance/categoryChangesAsRdfTest.php: this was cherry-picked to make CI pass, pushing it out just for a clean staging dir (duration: 01m 06s) [production]
01:32 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.14/resources/src/mediawiki.api/upload.js: fixing UBN T266903 (duration: 01m 06s) [production]
01:30 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.14/resources/src/mediawiki.Upload.js: fixing UBN T266903 (duration: 01m 07s) [production]
01:29 <tstarling@deploy1001> sync-file aborted: fixing UBN T266903 (duration: 00m 01s) [production]
2020-11-08 §
23:08 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.16/resources/src/mediawiki.api/upload.js: fixing UBN T266903 (duration: 01m 06s) [production]
23:06 <tstarling@deploy1001> Synchronized php-1.36.0-wmf.16/resources/src/mediawiki.Upload.js: fixing UBN T266903 (duration: 01m 35s) [production]
20:34 <cdanis> repool esams [production]
19:48 <cdanis@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
19:48 <cdanis@cumin1001> START - Cookbook sre.network.cf [production]
19:16 <cdanis> depool esams [production]
18:35 <cdanis@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
18:35 <cdanis@cumin1001> START - Cookbook sre.network.cf [production]
2020-11-06 §
23:38 <dwisehaupt> frdata1001 upgraded to buster [production]
22:40 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@bfaac0f]: Update to master, primarily updates for ores weekly predictions handling (duration: 01m 08s) [production]
22:39 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@bfaac0f]: Update to master, primarily updates for ores weekly predictions handling [production]
22:29 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@dc63e7e]: Update to master, primarily updates for ores weekly predictions handling (duration: 00m 26s) [production]
22:29 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@dc63e7e]: Update to master, primarily updates for ores weekly predictions handling [production]
20:57 <reedy@deploy1001> Synchronized php-1.36.0-wmf.16/skins/CologneBlue/: T267278 (duration: 01m 05s) [production]
20:56 <reedy@deploy1001> Synchronized php-1.36.0-wmf.14/skins/CologneBlue/: T267278 (duration: 01m 10s) [production]
20:07 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
20:05 <robh@cumin1001> START - Cookbook sre.hosts.downtime [production]
18:54 <cwhite@cumin1001> conftool action : set/pooled=no; selector: name=mw1379.eqiad.wmnet [production]
17:02 <dwisehaupt> rolled out new thank_you_mail_send process_control scripts to utilize frmx hosts [production]
16:45 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:44 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:44 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:20 <hnowlan@puppetmaster1001> conftool action : set/pooled=yes:weight=10; selector: dc=codfw,cluster=maps,service=kartotherian,name=maps2005.codfw.wmnet [production]
14:46 <moritzm> installing wireshark security updates [production]
14:36 <hnowlan> resyncing database on maps1001 [production]
14:25 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:24 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime [production]