Write error when executing a too big query

[melroy89]

When I try to import a too big list of multi line queries (eg. coming from a sql file).

It will crash:

{ Error: write EPIPE
at WriteWrap.afterWrite [as oncomplete] (net.js:835:14) errno: 'EPIPE', code: 'EPIPE', syscall: 'write', fatal: true }

Regards,
Melroy van den Berg

[melroy89]

with debug on true.

<ALL MY SQL STATEMENTS...>
COMMIT;

0 71 <== query#start(0,,2899185)
0 71 <== ed3c2c00032d2d204d7953514c205363726970742067656e657261746564206279204d7953514c20576f726b62656e63680a2d2d207672203138206d656920323031382030323a33343a343320434553540a2d2d204d6f64656c3a204e6577204d6f64656c2020202056657273696f6e3a20312e300a2d2d204d7953514c20576f726b62656e636820466f727761726420456e67696e656572696e670a0a53455420404f4c445f554e495155455f434845434b533d4040554e495155455f434845434b532c20554e495155455f434845434b533d303b0a53455420404f4c445f464f524549474e5f4b45595f434845434b533d4040464f524549474e5f4b45595f434845434b532c20464f524549474e5f4b45595f434845434b533d303b0a53455420404f4c445f53514c5f4d4f44453d404053514c5f4d4f44452c2053514c5f4d4f44453d27545241444954494f4e414c2c414c4c4f575f494e56414c49445f4441544553273b0a0a2d2d202d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d0a2d2d20536368656d61206572706a730a2d2d202d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d0a0a2d2d202d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d0a2d2d205461626c65206067726f7570600a2d2d202d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d0a435245415445205441424c45204946204e4f5420455849535453206067726f75706020280a20206067726f75705f69646020494e54204e4f54204e554c4c2c0a20206067726f75705f6e616d6560205641524348415228363029204e4f54204e554c4c2c0a20205052494d415259204b455920286067726f75705f69646029290a454e47494e45203d20496e6e6f44420a434f4d4d454e54203d2027412067656e6572616
.....
2d2d2d0a2d2d20466978204e554c4c206973737565207769746820656d707479206e616d657320286167682c207374757069642043535620696d706f727473290a2d2d202d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d2d0a0a5354415254205452414e53414354494f4e3b0a55504441544520606c6564676572602053455420606c65646765725f6e616d6560203d204e554c4c20574845524520606c65646765725f6e616d6560203d2027273b0a55504441544520606c65646765725f6d75746174696f6e602053455420606c65646765725f6d75746174696f6e5f6e616d6560203d204e554c4c20574845524520606c65646765725f6d75746174696f6e5f6e616d6560203d2027273b0a0a434f4d4d49543b0a
{ Error: write EPIPE
    at WriteWrap.afterWrite [as oncomplete] (net.js:835:14) errno: 'EPIPE', code: 'EPIPE', syscall: 'write', fatal: true }

[dougwilson]

Thanks for the report! We can take a look, can you include the data, script, and module version so we can reproduce the issue?

[melroy89]

Sure!

[dougwilson]

Thanks! Also Node.js version you're using may be relevant if you can include that.

[melroy89]

Aha.. I switched from mysql2 to mysql (still crashes tho). But could have a lead..

Error: write EPIPE
    at WriteWrap.afterWrite [as oncomplete] (net.js:835:14)
    --------------------
    at Protocol._enqueue (/my_project/node_modules/mysql/lib/protocol/Protocol.js:145:48)
    at Connection.query (/my_project/node_modules/mysql/lib/Connection.js:208:25)
    at my_script:37:16
    at FSReqWrap.readFileAfterClose [as oncomplete] (fs.js:422:3)

[dougwilson]

In case it helps as well, what EPIPE means is documented in Node.js https://nodejs.org/dist/latest-v10.x/docs/api/errors.html#errors_common_system_errors

[dougwilson]

EPIPE (Broken pipe): A write on a pipe, socket, or FIFO for which there is no process to read the data. Commonly encountered at the net and http layers, indicative that the remote side of the stream being written to has been closed.

It seems to indicate that the mysql server closed the connection?

[melroy89]

Or is the file closing while it tries to preform the query??
Sorry I didn't provide you all the info yet. But this is the script:
https://gitlab.melroy.org/snippets/15

[dougwilson]

So i removed the config thing since that is not provided and changed it to a local docker image. I then put in some SQL into the file and it ran the SQL fine for me. Maybe it depends on what is in that file?

[melroy89]

Please check the snippet again. I uploaded the sql file (DOWNLOAD FILE) :). This problem occurs only when the file is 'too big'.

More details:

• Node v10.1.0
• Mysql v2.15.0
• Mysql2 v1.5.3