Re: [Lava-users] lavacli cannot fetch big logs.

On Wed, 8 Jan 2020 at 08:18, Larry Shen larry.shen@nxp.com wrote:

Hi, there,

We have one job to do some stress test, the final log is about 270MB.

We use `lavacli -i production jobs logs --raw 30686` to fetch the log, it gives me next:

$ time lavacli -i production jobs logs --raw 30686

/usr/lib/python3/dist-packages/lavacli/__init__.py:101: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.

  config = yaml.load(f_conf.read())

Unable to call 'jobs.logs': <ProtocolError for http://larry.shen:xxx@xxx.nxp.com/RPC2: 500 ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))>



real    0m39.006s

user    0m0.989s

sys     0m0.191s

I check the gunicorn log, it give me:

[2020-01-08 08:11:12 +0000] [188] [CRITICAL] WORKER TIMEOUT (pid:11506)

Any suggestion?

you can try using API instead https://your.instance.url/api/v0.2/jobs/30686/logs

I just fetched 57MB log and it worked just fine. In the long run we can probably switch lavacli to use REST API.

milosz

---

Lava-users mailing list Lava-users@lists.lavasoftware.org https://lists.lavasoftware.org/mailman/listinfo/lava-users