|
2020-11-09
§
|
| 13:49 |
<ayounsi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 13:44 |
<ayounsi@cumin1001> |
END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) |
[production] |
| 13:40 |
<ayounsi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 12:42 |
<arturo> |
restarted neutron l3 agent in cloudnet1003 bc it still had the old default route (T265288) |
[admin] |
| 12:41 |
<arturo> |
`root@cloudcontrol1005:~# neutron subnet-delete dcbb0f98-5e9d-4a93-8dfc-4e3ec3c44dcc` (T265288) |
[admin] |
| 12:40 |
<arturo> |
`root@cloudcontrol1005:~# neutron router-gateway-set --fixed-ip subnet_id=7c6bcc12-212f-44c2-9954-5c55002ee371,ip_address=185.15.56.244 cloudinstances2b-gw wan-transport-eqiad` (T265288) |
[admin] |
| 12:19 |
<arturo> |
subnet 185.1.5.56.240/29 has id 7c6bcc12-212f-44c2-9954-5c55002ee371 in neutron (T265288) |
[admin] |
| 12:19 |
<arturo> |
`root@cloudcontrol1005:~# neutron subnet-create --gateway 185.15.56.241 --name cloud-instances-transport1-b-eqiad1 --ip-version 4 --disable-dhcp wan-transport-eqiad 185.15.56.240/29` (T265288) |
[admin] |
| 12:15 |
<arturo> |
icinga-downtime toolschecker for 2h (T265288) |
[admin] |
| 12:13 |
<Urbanecm> |
urbanecm@mwmaint1002:~$ mwscript namespaceDupes.php --wiki=zhwikinews --fix --add-prefix=BROKEN # T266925 |
[production] |
| 12:10 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 11b8f6236d159962bdebccd6dcacb72e600ec6b5: Add wgNamespaceAliases for zhwikinews (T266925) (duration: 01m 06s) |
[production] |
| 12:05 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 87b3eede24fb407ddd226ad65817ab8adf44aeb8: Enable DiscussionTools as a beta feature on fiwiki (T265446) (duration: 01m 06s) |
[production] |
| 11:58 |
<moritzm> |
installing remaining openldap updates on stretch |
[production] |
| 11:57 |
<jynus> |
restart dbstore1004 mariadb instances |
[production] |
| 11:05 |
<Amir1> |
restart codesearch |
[codesearch] |
| 10:49 |
<ayounsi@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 10:46 |
<ayounsi@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 10:36 |
<XioNoX> |
add 185.15.56.240/29 IPs to relevant cloudsw interfaces - T265288 |
[production] |
| 10:35 |
<effie> |
merging 638109 and roll restart ms-fe* hosts to pick up the change |
[production] |
| 10:23 |
<arturo> |
added jmm (moritz) as user & projectadmin |
[cloudinfra] |
| 10:11 |
<XioNoX> |
renumber cloud-xlink1-eqiad |
[production] |
| 09:56 |
<Urbanecm> |
Purge https://vote.wikimedia.org/wiki/Main_Page (T262689) |
[production] |
| 09:54 |
<Urbanecm> |
Start of `mwscript extensions/AbuseFilter/maintenance/updateVarDumps.php --wiki=$wiki --print-orphaned-records-to=/tmp/urbanecm/$wiki-orphaned.log --progress-markers > $wiki.log` in a tmux session at mwmaint1002 (wiki=svwiki; T246539) |
[production] |
| 09:52 |
<hashar> |
Restarting Gerrit on gerrit1001 and gerrit2001 in order to have the JVM to exit after OutOfMemory # T267517 |
[production] |
| 09:50 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 7b0a81f4294dcedfd5736884900cb561de9a080e: Revert "Change votewiki language temporarily to fa for fawiki elections" (T262689) (duration: 01m 08s) |
[production] |
| 09:37 |
<moritzm> |
installing libexif security updates |
[production] |
| 09:06 |
<godog> |
enable thanos query-frontend on thanos-fe hosts - T261281 |
[production] |
| 08:24 |
<XioNoX> |
configure traceoptions on pfw3-eqiad - T263833 |
[production] |
| 08:11 |
<hashar> |
Restarting Gerrit on gerrit1001 and gerrit2001 |
[production] |
| 07:58 |
<hashar> |
Restarted CI Jenkins on contint2001 for Java upgrade |
[production] |
| 07:22 |
<matanya> |
Matanya set flags +AV on Mark7747 in #cvn-wp-hr |
[cvn] |
| 07:17 |
<elukey> |
restart gerrit on gerrit2001 (OOM registered for two days ago, uptime from systemctl since a month ago, probably in a weird state) |
[production] |
| 07:04 |
<Majavah> |
mark task 6 as approved and add cronjob for it |
[tools.majavah-bot] |
| 07:00 |
<Majavah> |
removing multiple large log files |
[tools.majavah-bot] |
| 01:35 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.14/tests/phpunit/maintenance/categoryChangesAsRdfTest.php: this was cherry-picked to make CI pass, pushing it out just for a clean staging dir (duration: 01m 06s) |
[production] |
| 01:32 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.14/resources/src/mediawiki.api/upload.js: fixing UBN T266903 (duration: 01m 06s) |
[production] |
| 01:30 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.14/resources/src/mediawiki.Upload.js: fixing UBN T266903 (duration: 01m 07s) |
[production] |
| 01:29 |
<tstarling@deploy1001> |
sync-file aborted: fixing UBN T266903 (duration: 00m 01s) |
[production] |
|
2020-11-08
§
|
| 23:08 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.16/resources/src/mediawiki.api/upload.js: fixing UBN T266903 (duration: 01m 06s) |
[production] |
| 23:06 |
<tstarling@deploy1001> |
Synchronized php-1.36.0-wmf.16/resources/src/mediawiki.Upload.js: fixing UBN T266903 (duration: 01m 35s) |
[production] |
| 20:34 |
<cdanis> |
repool esams |
[production] |
| 19:48 |
<cdanis@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 19:48 |
<cdanis@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 19:16 |
<cdanis> |
depool esams |
[production] |
| 18:35 |
<cdanis@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 18:35 |
<cdanis@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 17:43 |
<wm-bot> |
<taavi> manually rotating log file update-train-blockers.out, it was 1.4M |
[tools.train-blockers] |
| 06:31 |
<elukey> |
truncate huge log file on an-worker1103 for app id application_1601916545561_147041 |
[analytics] |