|
2022-01-07
ยง
|
| 22:08 |
<hauskatze> |
CVNBot9 load co.wiktionary wikt:co: |
[cvn] |
| 22:07 |
<eileen> |
config revision changed from 3df415c1 to ecf09aa0 - disable eoy email jobs |
[production] |
| 22:04 |
<hauskatze> |
CVNBot9 load ban.wikisource s:ban: |
[cvn] |
| 22:04 |
<hauskatze> |
CVNBot9 load ba.wikibooks b:ba: |
[cvn] |
| 20:16 |
<ottomata> |
altering hive table MobileWikiAppiOSUserHistory field event.device_level_enabled to string - T298721 |
[analytics] |
| 20:08 |
<urbanecm> |
Purge https://en.wikipedia.org/static/images/project-logos/{zhwikinews,zhwikinews-1.5x,zhwikinews-2x,zhwikinews-hans,zhwikinews-hans-1.5x,zhwikinews-hans-2x}.png via purgeList.php |
[production] |
| 19:49 |
<herron@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host apifeatureusage2001.codfw.wmnet |
[production] |
| 19:41 |
<herron@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host apifeatureusage1001.eqiad.wmnet |
[production] |
| 19:36 |
<pt1979@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host elastic2051.codfw.wmnet with OS bullseye |
[production] |
| 19:21 |
<herron@cumin1001> |
START - Cookbook sre.ganeti.makevm for new host apifeatureusage2001.codfw.wmnet |
[production] |
| 19:18 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.reimage for host elastic2051.codfw.wmnet with OS bullseye |
[production] |
| 19:16 |
<pt1979@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host elastic2051.codfw.wmnet with OS bullseye |
[production] |
| 19:11 |
<herron@cumin1001> |
START - Cookbook sre.ganeti.makevm for new host apifeatureusage1001.eqiad.wmnet |
[production] |
| 19:04 |
<balloons> |
restarted webservice. |
[tools.sal] |
| 19:02 |
<balloons> |
enable xff headers for wikiwho.wmflabs.org and wikiwho-api.wmcloud.org T298726 |
[wikiwho] |
| 18:29 |
<pt1979@cumin2002> |
START - Cookbook sre.hosts.reimage for host elastic2051.codfw.wmnet with OS bullseye |
[production] |
| 17:29 |
<btullis> |
deployed updated hive packages to an-test-worker100[1-3] and an-test-ui1001 |
[analytics] |
| 15:18 |
<taavi> |
reset email address for Ollie Shotton developer account per T298779 |
[production] |
| 15:08 |
<ottomata> |
creeating mediainfo-streaming-updater.mutation topics on kafka main-eqiad and main-codfw and setting retention to 30 days - T296470 |
[production] |
| 14:52 |
<btullis> |
root@aqs1014:~# jmap -dump:live,format=b,file=/srv/cassandra-b/tmp/aqs1014-b-dump202201071450.hprof 4468 |
[analytics] |
| 14:05 |
<ema> |
upgrade varnish on deployment-cache-text06 to 6.0.9 T298758 |
[production] |
| 12:19 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 12:18 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 12:18 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 12:17 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 12:14 |
<taavi@deploy1002> |
Synchronized php-1.38.0-wmf.16/extensions/ProofreadPage/modules/page: Backport: [[gerrit:751843|Makes sure $imgContHorizontal is always initialized (T298694)]] (duration: 00m 59s) |
[production] |
| 11:57 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 11:56 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 11:56 |
<taavi@deploy1002> |
Synchronized php-1.38.0-wmf.16/extensions/Flow: Backport: [[gerrit:752014|Revert "Use strict equality when safe to do so" (T298760)]] (duration: 01m 00s) |
[production] |
| 11:56 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: sync on pinkunicorn |
[production] |
| 11:54 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply on pinkunicorn |
[production] |
| 10:51 |
<hauskatze> |
Loaded alt.wikipedia to Group 4 (CVNBot9) - small wiki not monitored |
[cvn] |
| 10:40 |
<btullis@cumin1001> |
END (PASS) - Cookbook sre.aqs.roll-restart (exit_code=0) for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. |
[production] |
| 10:33 |
<btullis@cumin1001> |
START - Cookbook sre.aqs.roll-restart for AQS aqs cluster: Roll restart of all AQS's nodejs daemons. |
[production] |
| 07:27 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T297191)', diff saved to https://phabricator.wikimedia.org/P18413 and previous config saved to /var/cache/conftool/dbconfig/20220107-072742-marostegui.json |
[production] |
| 07:12 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P18412 and previous config saved to /var/cache/conftool/dbconfig/20220107-071237-marostegui.json |
[production] |
| 06:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316', diff saved to https://phabricator.wikimedia.org/P18411 and previous config saved to /var/cache/conftool/dbconfig/20220107-065733-marostegui.json |
[production] |
| 06:42 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repooling after maintenance db1098:3316 (T297191)', diff saved to https://phabricator.wikimedia.org/P18410 and previous config saved to /var/cache/conftool/dbconfig/20220107-064228-marostegui.json |
[production] |
| 06:41 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depooling db1098:3316 (T297191)', diff saved to https://phabricator.wikimedia.org/P18409 and previous config saved to /var/cache/conftool/dbconfig/20220107-064119-marostegui.json |
[production] |
| 06:41 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:41 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db1098.eqiad.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2141.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2124.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2124.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2117.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2117.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2114.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 6:00:00 on db2114.codfw.wmnet with reason: Maintenance |
[production] |
| 06:15 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2089.codfw.wmnet with reason: Maintenance |
[production] |