|
2020-01-06
§
|
| 14:32 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable WebAuthn everywhere (duration: 00m 54s) |
[production] |
| 14:31 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable WebAuthn everywhere (duration: 00m 57s) |
[production] |
| 13:56 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:54 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:45 |
<andrewbogott> |
restarting nova-api and nova-conductor on cloudcontrol1003 and 1004 |
[admin] |
| 13:35 |
<moritzm> |
reimaging mw2282 to validate correctness of apt::package_from_component for fresh installs |
[production] |
| 12:58 |
<Urbanecm> |
EU SWAT done |
[production] |
| 12:56 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 88c800c: Add basic transwiki sources for ltwiki (T241288) (duration: 00m 54s) |
[production] |
| 12:50 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: c44b4ff: Enable subpages for the main namespace on ge.wikimedia (T241329) (duration: 00m 55s) |
[production] |
| 12:46 |
<Urbanecm> |
mwscript namespaceDupes.php --wiki=napwikisource --fix (T231880) |
[production] |
| 12:45 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 864a2f8: Set Author and Author_talk aliases for Autore NS at napwikisource (T231880) (duration: 00m 55s) |
[production] |
| 12:43 |
<Urbanecm> |
mwscript namespaceDupes.php --wiki=zhwiktionary --fix (T241023) |
[production] |
| 12:41 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 0baf554: Add new namespace and aliases for zh.wiktionary (T241023) (duration: 00m 54s) |
[production] |
| 12:39 |
<urbanecm@deploy1001> |
sync-file aborted: SWAT: 0ac5032: Add throttle exception for Amical Wikimedia Workshop (T241705) (duration: 00m 01s) |
[production] |
| 12:39 |
<jakob@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'test' . |
[production] |
| 12:37 |
<urbanecm@deploy1001> |
Synchronized wmf-config/throttle.php: SWAT: 0ac5032: Add throttle exception for Amical Wikimedia Workshop (T241705) (duration: 00m 56s) |
[production] |
| 12:31 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562083|Don’t check constraints on P6685 statements]] Bypassing T236104 (duration: 00m 55s) |
[production] |
| 12:28 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.11/maintenance/rebuildLocalisationCache.php: SWAT: [[gerrit:560596|Add option to override storeClass in rebuildLocalisationCache (T105683 T99740)]] (duration: 00m 55s) |
[production] |
| 12:25 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:560341|Revert "Add a bit for forcing LC caching backend in cli mode"]] (duration: 00m 54s) |
[production] |
| 12:23 |
<jakob@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'test' . |
[production] |
| 12:18 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562083|Don’t check constraints on P6685 statements (T227865)]] (duration: 00m 55s) |
[production] |
| 12:15 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:562081|Set read new for item term store up to Q100K (T219123)]] (duration: 00m 55s) |
[production] |
| 12:07 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: [[gerrit:561286|Enable wgCiteResponsiveReferences on cswiki (T241304)]] (duration: 00m 56s) |
[production] |
| 11:42 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:562236| Bumping portals to master (T128546)]] (duration: 00m 55s) |
[production] |
| 11:41 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:562236| Bumping portals to master (T128546)]] (duration: 00m 55s) |
[production] |
| 10:56 |
<urbanecm@deploy1001> |
Synchronized private/PrivateSettings.php: Revert T227416 mitigations (duration: 01m 05s) |
[production] |
| 10:39 |
<moritzm> |
installing libbsd security updates |
[production] |
| 09:53 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:51 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:32 |
<moritzm> |
reimaging mw2282 to validate correctness of apt::package_from_component for fresh installs |
[production] |
| 07:37 |
<Amir1> |
ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=100 --sleep=2 --file=/tmp/1mio.lines (T219301) |
[production] |
| 03:53 |
<Amir1> |
ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=100 --sleep=2 --file=/tmp/100k.lines (T219301) |
[production] |
| 00:06 |
<effie> |
pool cp3065 T238305 |
[production] |
| 00:05 |
<jiji@cumin1001> |
conftool action : set/pooled=yes; selector: name=cp3065.esams.wmnet |
[production] |
|
2020-01-04
§
|
| 18:11 |
<bd808> |
Shutdown tools-worker-1029 |
[tools] |
| 18:10 |
<bd808> |
kubectl delete node tools-worker-1029.tools.eqiad.wmflabs |
[tools] |
| 18:06 |
<bd808> |
Removed tools-worker-1029.tools.eqiad.wmflabs from k8s::worker_hosts hiera in preparation for decom |
[tools] |
| 16:54 |
<bstorm_> |
moving VMs tools-worker-1012/1028/1005 from cloudvirt1024 to cloudvirt1003 due to hardware errors T241884 |
[tools] |
| 16:47 |
<bstorm_> |
moving VM tools-flannel-etcd-02 from cloudvirt1024 to cloudvirt1003 due to hardware errors T241884 |
[tools] |
| 16:34 |
<arturo> |
icinga downtime cloudvirt1024 for 2 months because hardware errors (T241884) |
[admin] |
| 16:34 |
<aborrero@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:34 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:34 |
<aborrero@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 16:34 |
<aborrero@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:16 |
<bd808> |
Draining tools-worker-10{05,12,28} due to hardware errors (T241884) |
[tools] |
| 16:13 |
<arturo> |
moving VM tools-sgewebgrid-lighttpd-0927 from cloudvirt1024 to cloudvirt1009 due to hardware errors (T241884) |
[tools] |
| 16:11 |
<arturo> |
moving VM tools-sgewebgrid-lighttpd-0926 from cloudvirt1024 to cloudvirt1009 due to hardware errors (T241884) |
[tools] |