Emscription 3.1.56 #198

NorrinRadd · 2024-04-05T11:31:31Z

This PR resolves #144

woodser · 2024-04-07T11:36:07Z

Thanks.

Running the sample code, I get this error:

Error [ReferenceError]: asyncifyStubs is not defined
    at LibraryUtils.deserializeError (/Users/woodser/git/monero-ts/dist/src/main/ts/common/LibraryUtils.js:253:106)
    at LibraryUtils.invokeWorker (/Users/woodser/git/monero-ts/dist/src/main/ts/common/LibraryUtils.js:242:26)
    at async MoneroWalletFullProxy.openWalletData (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:1843:5)
    at async MoneroWalletFull.openWalletData (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:1602:25)
    at async MoneroWalletFull.openWallet (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:144:20)
    at async TestUtils.getWalletFull (/Users/woodser/git/monero-ts/dist/src/test/utils/TestUtils.js:232:32)
    at async Context.<anonymous> (/Users/woodser/git/monero-ts/dist/src/test/TestSampleCode.js:32:20)
Worker error: ReferenceError: asyncifyStubs is not defined
    at /Users/woodser/git/monero-ts/dist/dist/monero_wallet_full.js:8:19712
    at Function.loadFullModule (/Users/woodser/git/monero-ts/src/main/ts/common/LibraryUtils.ts:109:70)
    at openWalletData (/Users/woodser/git/monero-ts/src/main/ts/wallet/MoneroWalletFull.ts:1616:37)
    at Function.openWallet (/Users/woodser/git/monero-ts/src/main/ts/wallet/MoneroWalletFull.ts:144:43)
    at apply (/Users/woodser/git/monero-ts/src/main/ts/common/MoneroWebWorker.ts:421:58)
    at self.onmessage (/Users/woodser/git/monero-ts/src/main/ts/common/MoneroWebWorker.ts:49:68)
    1) "before all" hook for "Sample code demonstration"

Which has a related issue which was recently fixed and closed, so hopefully it's in the next release of emscripten: emscripten-core/emscripten#21104 (comment)

woodser · 2024-04-07T11:46:03Z

Please remove the ./dist assets from the PR. Those can be updated and committed later.

… Disabling -Werror for now, until boost is updated or we vendor boost, or use system installed boost.

NorrinRadd · 2024-04-07T18:46:25Z

Please remove the ./dist assets from the PR. Those can be updated and committed later.

Done

NorrinRadd · 2024-04-09T15:11:50Z

Thanks.

Running the sample code, I get this error:

Error [ReferenceError]: asyncifyStubs is not defined
    at LibraryUtils.deserializeError (/Users/woodser/git/monero-ts/dist/src/main/ts/common/LibraryUtils.js:253:106)
    at LibraryUtils.invokeWorker (/Users/woodser/git/monero-ts/dist/src/main/ts/common/LibraryUtils.js:242:26)
    at async MoneroWalletFullProxy.openWalletData (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:1843:5)
    at async MoneroWalletFull.openWalletData (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:1602:25)
    at async MoneroWalletFull.openWallet (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:144:20)
    at async TestUtils.getWalletFull (/Users/woodser/git/monero-ts/dist/src/test/utils/TestUtils.js:232:32)
    at async Context.<anonymous> (/Users/woodser/git/monero-ts/dist/src/test/TestSampleCode.js:32:20)
Worker error: ReferenceError: asyncifyStubs is not defined
    at /Users/woodser/git/monero-ts/dist/dist/monero_wallet_full.js:8:19712
    at Function.loadFullModule (/Users/woodser/git/monero-ts/src/main/ts/common/LibraryUtils.ts:109:70)
    at openWalletData (/Users/woodser/git/monero-ts/src/main/ts/wallet/MoneroWalletFull.ts:1616:37)
    at Function.openWallet (/Users/woodser/git/monero-ts/src/main/ts/wallet/MoneroWalletFull.ts:144:43)
    at apply (/Users/woodser/git/monero-ts/src/main/ts/common/MoneroWebWorker.ts:421:58)
    at self.onmessage (/Users/woodser/git/monero-ts/src/main/ts/common/MoneroWebWorker.ts:49:68)
    1) "before all" hook for "Sample code demonstration"

Which has a related issue which was recently fixed and closed, so hopefully it's in the next release of emscripten: emscripten-core/emscripten#21104 (comment)

👍🏾 is this PR mergeable for now?

woodser · 2024-04-10T13:45:25Z

is this PR mergeable for now?

For now I'd rather wait to confirm it works in the next release than changing these values in the current release.

NorrinRadd · 2024-04-11T07:14:14Z

Thanks.

Running the sample code, I get this error:

Error [ReferenceError]: asyncifyStubs is not defined
    at LibraryUtils.deserializeError (/Users/woodser/git/monero-ts/dist/src/main/ts/common/LibraryUtils.js:253:106)
    at LibraryUtils.invokeWorker (/Users/woodser/git/monero-ts/dist/src/main/ts/common/LibraryUtils.js:242:26)
    at async MoneroWalletFullProxy.openWalletData (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:1843:5)
    at async MoneroWalletFull.openWalletData (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:1602:25)
    at async MoneroWalletFull.openWallet (/Users/woodser/git/monero-ts/dist/src/main/ts/wallet/MoneroWalletFull.js:144:20)
    at async TestUtils.getWalletFull (/Users/woodser/git/monero-ts/dist/src/test/utils/TestUtils.js:232:32)
    at async Context.<anonymous> (/Users/woodser/git/monero-ts/dist/src/test/TestSampleCode.js:32:20)
Worker error: ReferenceError: asyncifyStubs is not defined
    at /Users/woodser/git/monero-ts/dist/dist/monero_wallet_full.js:8:19712
    at Function.loadFullModule (/Users/woodser/git/monero-ts/src/main/ts/common/LibraryUtils.ts:109:70)
    at openWalletData (/Users/woodser/git/monero-ts/src/main/ts/wallet/MoneroWalletFull.ts:1616:37)
    at Function.openWallet (/Users/woodser/git/monero-ts/src/main/ts/wallet/MoneroWalletFull.ts:144:43)
    at apply (/Users/woodser/git/monero-ts/src/main/ts/common/MoneroWebWorker.ts:421:58)
    at self.onmessage (/Users/woodser/git/monero-ts/src/main/ts/common/MoneroWebWorker.ts:49:68)
    1) "before all" hook for "Sample code demonstration"

Which has a related issue which was recently fixed and closed, so hopefully it's in the next release of emscripten: emscripten-core/emscripten#21104 (comment)

3.1.57 is out, however there still seem to be some issues. It can build the distributable fine.
This is output from running npm test on the head of this pr branch.
https://gist.github.com/NorrinRadd/d7168dfff5c5293526dd38e12dd388b3

3.1.57 will complain about no thread support if run on the master branch.
3.1.10 runs tests fine on the master branch.
3.1.10 runs tests on the head of this branch fine also: https://gist.github.com/NorrinRadd/6c37d399b4918c8a3a765893b7dcacf1

woodser · 2024-04-11T11:20:59Z

I'm getting errors running with emscripten 3.1.57:

/Users/woodser/git/monero-ts/build/boost/include/boost/config/requires_threads.hpp:47:5: error: "Compiler threading support is not turned on. Please set the correct command line options for threading: -pthread (Linux), -pthreads (Solaris) or -mthreads (Mingw32)"
   47 | #   error "Compiler threading support is not turned on. Please set the correct command line options for threading: -pthread (Linux), -pthreads (Solaris) or -mthreads (Mingw32)"
      |     ^
In file included from /Users/woodser/git/monero-ts/external/monero-cpp/external/monero-project/src/crypto/crypto.cpp:37:
In file included from /Users/woodser/git/monero-ts/build/boost/include/boost/thread/mutex.hpp:12:
/Users/woodser/git/monero-ts/build/boost/include/boost/thread/detail/platform.hpp:71:9: error: "Sorry, no boost threads are available for this platform."
   71 | #       error "Sorry, no boost threads are available for this platform."
      |         ^
In file included from /Users/woodser/git/monero-ts/external/monero-cpp/external/monero-project/src/crypto/crypto.cpp:37:
/Users/woodser/git/monero-ts/build/boost/include/boost/thread/mutex.hpp:18:2: error: "Boost threads unavailable on this platform"
   18 | #error "Boost threads unavailable on this platform"
      |  ^

Be sure to delete all the build folders before building, and you should see the same error with ./bin/build_all.sh:

rm -rf ./build && rm -rf ./external/monero-cpp/external/boost-sdk && rm -rf ./external/monero-cpp/external/openssl-sdk

NorrinRadd · 2024-04-12T10:50:41Z

I'm getting errors running with emscripten 3.1.57:

/Users/woodser/git/monero-ts/build/boost/include/boost/config/requires_threads.hpp:47:5: error: "Compiler threading support is not turned on. Please set the correct command line options for threading: -pthread (Linux), -pthreads (Solaris) or -mthreads (Mingw32)"
   47 | #   error "Compiler threading support is not turned on. Please set the correct command line options for threading: -pthread (Linux), -pthreads (Solaris) or -mthreads (Mingw32)"
      |     ^
In file included from /Users/woodser/git/monero-ts/external/monero-cpp/external/monero-project/src/crypto/crypto.cpp:37:
In file included from /Users/woodser/git/monero-ts/build/boost/include/boost/thread/mutex.hpp:12:
/Users/woodser/git/monero-ts/build/boost/include/boost/thread/detail/platform.hpp:71:9: error: "Sorry, no boost threads are available for this platform."
   71 | #       error "Sorry, no boost threads are available for this platform."
      |         ^
In file included from /Users/woodser/git/monero-ts/external/monero-cpp/external/monero-project/src/crypto/crypto.cpp:37:
/Users/woodser/git/monero-ts/build/boost/include/boost/thread/mutex.hpp:18:2: error: "Boost threads unavailable on this platform"
   18 | #error "Boost threads unavailable on this platform"
      |  ^

Be sure to delete all the build folders before building, and you should see the same error with ./bin/build_all.sh:

rm -rf ./build && rm -rf ./external/monero-cpp/external/boost-sdk && rm -rf ./external/monero-cpp/external/openssl-sdk

that is what i get if I run on the master branch. I just ran that rm command and built again on this pr branch and it finished building fine. the new output of npm test is here: https://gist.github.com/NorrinRadd/0cb2b5d81aac0ac23ca751a448f7e385

woodser · 2024-04-12T13:21:30Z

Excellent, it's building for me too, so I must have done something wrong last time.

So two issues I'm seeing:

Running npm run test -- --grep "TEST MONERO UTILITIES" gives the error "TypeError: _LibraryUtils.default.getWasmModule(...)._free is not a function", which hopefully you can recreate.
Running "Sample code demonstration" in the browser gives error: "ReferenceError: SharedArrayBuffer is not defined". We want to keep the final output single threaded now to avoid these new requirements, until after the emscripten upgrade. I'm hoping this can merely be an emscripten linker flag until we turn it on.

NorrinRadd · 2024-04-17T13:51:47Z

So two issues I'm seeing:

1. Running `npm run test -- --grep "TEST MONERO UTILITIES"` gives the error "TypeError: _LibraryUtils.default.getWasmModule(...)._free is not a function", which hopefully you can recreate.

I just pushed a fix for this.

2. Running "Sample code demonstration" in the browser gives error: "ReferenceError: SharedArrayBuffer is not defined". We want to keep the final output single threaded now to avoid these new requirements, until after the emscripten upgrade. I'm hoping this can merely be an emscripten linker flag until we turn it on.

I cannot reproduce this. When I press the Sample Code button, nothing happens.

NorrinRadd · 2024-04-17T13:52:03Z

@woodser ^

woodser · 2024-04-19T10:47:40Z

npm run test -- --grep "TEST MONERO UTILITIES" is fixed with the malloc and free exports.

Running npm run test -- --grep "Sample code demonstration" fails with error "memory access out of bounds" in node.js and "SharedArrayBuffer is not defined" in the browser.

I think the first step is to ensure this test passes for you before any of these changes (i.e. based on master and with emscripten 3.1.10), so you have a successful baseline.

After that test is passing, you should be able to observe the errors by applying the changes in this PR and updating to the latest emscripten.

NorrinRadd added 5 commits April 7, 2024 19:44

Monero project seems to not contain this file any longer

062f21d

Demangling support was removed from emcripten, yet boost turns it on.…

9846c21

… Disabling -Werror for now, until boost is updated or we vendor boost, or use system installed boost.

Make monero-ts multi-threaded

3f2a071

Override within http_client_wasm is causing an error

cb24e37

Update monero-ts to support emscripten 3.1.56

492e4e6

NorrinRadd force-pushed the ss-emscription-3.1.56 branch from 56769eb to 492e4e6 Compare April 7, 2024 18:45

Export _malloc and _free functions to wasm

92a6aa4

NorrinRadd added 2 commits April 21, 2024 22:59

Allow shared memory buffer within test browser

6607e8a

Serve the web workers to the browser during tests

f540c86

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Emscription 3.1.56 #198

Emscription 3.1.56 #198

NorrinRadd commented Apr 5, 2024

woodser commented Apr 7, 2024 •

edited

woodser commented Apr 7, 2024

NorrinRadd commented Apr 7, 2024

NorrinRadd commented Apr 9, 2024

woodser commented Apr 10, 2024

NorrinRadd commented Apr 11, 2024 •

edited

woodser commented Apr 11, 2024

NorrinRadd commented Apr 12, 2024

woodser commented Apr 12, 2024 •

edited

NorrinRadd commented Apr 17, 2024

NorrinRadd commented Apr 17, 2024

woodser commented Apr 19, 2024

Emscription 3.1.56 #198

Are you sure you want to change the base?

Emscription 3.1.56 #198

Conversation

NorrinRadd commented Apr 5, 2024

woodser commented Apr 7, 2024 • edited

woodser commented Apr 7, 2024

NorrinRadd commented Apr 7, 2024

NorrinRadd commented Apr 9, 2024

woodser commented Apr 10, 2024

NorrinRadd commented Apr 11, 2024 • edited

woodser commented Apr 11, 2024

NorrinRadd commented Apr 12, 2024

woodser commented Apr 12, 2024 • edited

NorrinRadd commented Apr 17, 2024

NorrinRadd commented Apr 17, 2024

woodser commented Apr 19, 2024

woodser commented Apr 7, 2024 •

edited

NorrinRadd commented Apr 11, 2024 •

edited

woodser commented Apr 12, 2024 •

edited