Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stop filling home directory with garbage #578

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

koct9i
Copy link
Collaborator

@koct9i koct9i commented May 12, 2024

NBD tests creates temporary files in home directory even without executing tests.
This file name is used for socket - regular file isn't required.
Always place them in /tmp - stop filling home with garbage.

NBD tests creates temporary files in home directory even without executing tests.
This file name is used for socket - regular file isn't required.
Always place them in /tmp - stop filling home with garbage.
@Kontakter Kontakter requested a review from yalekseev May 12, 2024 18:21
@Kontakter Kontakter added the bug Something isn't working label May 12, 2024
@yalekseev
Copy link
Collaborator

Попробовал запустить патч, наткнулся на проблему из-за которой так не сделали с самого начала:

Падение теста выглядит так:

yuryalekseev@yuryalekseev-dev:~/arcadia$ ya make yt/yt/tests/integration/node/ -tAP -F=*TestNbdSquashFSLayers* --run-tagged-tests-on-yt
------- [YT] {debug, default-linux-x86_64} $(B)/yt/yt/tests/integration/node/bin/test-results/py3test/{meta.json ... ytest.report.trace} >> test_layers.py::TestNbdSquashFSLayers::test_squashfs_layer (yuryalekseev)
Test command err:
library/python/porto/api.py:252: DeprecationWarning: use Connect
yt/yt/tests/library/yt_env_setup.py:538: ResourceWarning: unclosed <socket.socket fd=9, family=1, type=1, proto=0, raddr=/run/portod.socket>
ResourceWarning: Enable tracemalloc to get the object allocation traceback
yt/python/yt/environment/yt_env.py:177: ResourceWarning: unclosed <socket.socket fd=9, family=1, type=1, proto=0, raddr=/run/portod.socket>
ResourceWarning: Enable tracemalloc to get the object allocation traceback
2024-05-17 10:50:14,124031	I	Api	Dynamic cache sticky group size enabled (PrimaryCellTag: 10, ConnectionId: 1d839370-97d1dc8d-b8f964c3-cd88d50c, ConnectionName: default)	yt-yt-tests-int		
2024-05-17 10:50:14,144217	I	RpcServer	RPC service registered (ServiceName: ObjectService, RealmId: 809450f-ffffffff-a0259-ffffffff, LocalServerId: 3db39f77-f838cea1-6e99a525-d3f6d94a)	yt-yt-tests-int		
2024-05-17 10:50:14,144265	I	RpcServer	RPC server started (LocalServerId: 3db39f77-f838cea1-6e99a525-d3f6d94a)	yt-yt-tests-int		
2024-05-17 10:50:14,161246	I	Api	Server address pool config changed (Addresses: [localhost:21236, localhost:2158, localhost:9706], PrimaryCellTag: 10, ConnectionId: 1d839370-97d1dc8d-b8f964c3-cd88d50c, ConnectionName: default)	yt-yt-tests-int		
2024-05-17 10:50:14,177392	I	Api	Dynamic cache sticky group size enabled (PrimaryCellTag: 10, ConnectionId: db4cd783-2c57a6f6-e04e92a0-73f66f12, ConnectionName: default)	yt-yt-tests-int		
2024-05-17 10:50:14,187592	I	RpcServer	RPC service registered (ServiceName: ObjectService, RealmId: 809450f-ffffffff-a0259-ffffffff, LocalServerId: dfb802a1-1b77d024-79000f6d-dc7e531)	yt-yt-tests-int		
2024-05-17 10:50:14,187620	I	RpcServer	RPC server started (LocalServerId: dfb802a1-1b77d024-79000f6d-dc7e531)	yt-yt-tests-int		
2024-05-17 10:50:14,197343	I	Api	Server address pool config changed (Addresses: [localhost:21236, localhost:2158, localhost:9706], PrimaryCellTag: 10, ConnectionId: db4cd783-2c57a6f6-e04e92a0-73f66f12, ConnectionName: default)	yt-yt-tests-int		
yt/yt/tests/integration/node/test_layers.py:1296: ResourceWarning: unclosed file <_io.BufferedReader name='layers/corrupted.tar.gz'>
  write_file("//tmp/corrupted_layer", open("layers/corrupted.tar.gz", "rb").read())
ResourceWarning: Enable tracemalloc to get the object allocation traceback
yt/yt/tests/integration/node/test_layers.py:1299: ResourceWarning: unclosed file <_io.BufferedReader name='layers/corrupted.tar.gz'>
  write_file("//tmp/corrupted_squashfs.img", open("layers/corrupted.tar.gz", "rb").read())
ResourceWarning: Enable tracemalloc to get the object allocation traceback
yt/yt/tests/integration/node/test_layers.py:1304: ResourceWarning: unclosed file <_io.BufferedReader name='layers/squashfs.img'>
  write_file("//tmp/squashfs.img", open("layers/squashfs.img", "rb").read())
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Check took 0.111060 seconds
Process run by command "/home/yuryalekseev/.ya/build/build_root/abej/00000c/yt/yt/tests/integration/node/bin/test-results/py3test/build/suid/bin/ytserver-node --pdeathsig 9 --config /home/yuryalekseev/.ya/build/build_root/abej/00000c/yt/yt/tests/integration/node/bin/test-results/py3test/yt_output/TestNbdSquashFSLayers/configs/node-0.yson --pdeathsig 15 --setsid" exited with code 134
yt/python/yt/environment/yt_env.py:1052: ResourceWarning: unclosed file <_io.TextIOWrapper name='/home/yuryalekseev/.ya/build/build_root/abej/00000c/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff/yt_stderrs/TestNbdSquashFSLayers/0/stderr.node' mode='r' encoding='UTF-8'>
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Node-0 stderr:

*** Fatal error ***
Failed to create Nbd volume c2dec116-bed9e9a7-a7104c-6f09bc05
    origin          localhost (pid 2, thread layer0, fid fffef0a808ee29fc)
    datetime        2024-05-17T07:50:36.587848Z

  Porto API error
      code            12001
      origin          localhost (pid 2, thread Porto:volume0, fid fffef0a808e38d58)
      datetime        2024-05-17T07:50:36.587056Z
      original_porto_error_code 1
      porto_error_message No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a
 (LocationId: layer0)
*** Aborting ***
uncaught exception:
    address -> 0x579f5655b10
    what() -> "Porto API error
    code            12001
    origin          localhost (pid 2, thread Porto:volume0, fid fffef0a808e38d58)
    datetime        2024-05-17T07:50:36.587056Z
    original_porto_error_code 1
    porto_error_message No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a
"
    type -> NYT::TErrorException
*** Aborted at 1715932236 (Unix time); Try "date -d @1715932236" if you are using GNU date ***
0x7fa842e67437 in ??? at ???:0
*** SIGABRT (Abort) (@0x2) received by PID 2 (FID 0xfffef0a808ee29fc TID 0x7fa7ed25f700) from PID 2 code 18446744073709551610 ***

ERR no page found read kernel-mode access
TRAPNO X86_TRAP_DE (Divide-by-zero)
R8 0x579f4edb000
R9 0x21
R10 0x8
R11 0x202
R12 0x0
R13 0x7fa7f35a640f
R14 0x7fa7ed25f9c0
R15 0x0
RDI 0x2
RSI 0x98
RBP 0x7fa7ec95bc40
RBX 0x7fa7ec95dcf0
RDX 0x6
RAX 0x0
RCX 0x7fa842e67438
RSP 0x7fa7ec95ba88
RIP 0x7fa842e67438
EFL 0x202
CSGSFS 0x2b000000000033
OLDMASK 0x0
CR2 0x0
 1. 0x7fa842e67437 in ??? at ???:0
 2. 0x7fa842e69039 in ??? at ???:0
 3. 0x000028909f9b in bt_terminate_handler() at /-S/contrib/libs/cxxsupp/libcxxrt/exception.cc:348
 4. 0x0000289075a5 in std::terminate() at /-S/contrib/libs/cxxsupp/libcxxrt/exception.cc:1636
 5. 0x0000283400cb in NYT::NLogging::TLogManager::TImpl::Enqueue(NYT::NLogging::TLogEvent&&) at /-S/yt/yt/core/logging/log_manager.cpp:623
 6. 0x00002833fed8 in NYT::NLogging::TLogManager::Enqueue(NYT::NLogging::TLogEvent&&) at /-S/yt/yt/core/logging/log_manager.cpp:1571
 7. 0x000028ee7c20 in NYT::NLogging::TLogger::Write(NYT::NLogging::TLogEvent&&) const at /-S/library/cpp/yt/logging/logger.cpp:210
 8. 0x00002835dfb2 in NYT::NLogging::NDetail::LogEventImpl(NYT::NLogging::TLoggingContext const&, NYT::NLogging::TLogger const&, NYT::NLogging::ELogLevel, TSourceLocation, NYT::TSharedRef) at /-S/library/cpp/yt/logging/logger-inl.h:288
 9. 0x0000399a8467 in NYT::NExecNode::TLayerLocation::DoCreateVolume(NYT::TGuid, NYT::NProfiling::TTagSet, NYT::NProfiling::TEventTimerGuard, NYT::NExecNode::TVolumeMeta&&, THashMap<TBasicString<char, std::__y1::char_traits<char>>, TBasicString<char, std::__y1::char_traits<char>>, THash<TBasicString<char, std::__y1::char_traits<char>>>, TEqualTo<TBasicString<char, std::__y1::char_traits<char>>>, std::__y1::allocator<TBasicString<char, std::__y1::char_traits<char>>>>&&) at /-S/yt/yt/server/node/exec_node/volume_manager.cpp:1243
10. 0x0000399a3cf4 in NYT::NExecNode::TLayerLocation::DoCreateNbdVolume(NYT::TGuid, NYT::NProfiling::TTagSet, NYT::NProfiling::TEventTimerGuard, NYT::NDataNode::TArtifactKey const&, NYT::TIntrusivePtr<NYT::NExecNode::TNbdConfig>) at /-S/yt/yt/server/node/exec_node/volume_manager.cpp:1288
11. 0x0000399a534d in auto NYT::NDetail::TMethodInvoker<NYT::NExecNode::TVolumeMeta (NYT::NExecNode::TLayerLocation::*)(NYT::TGuid, NYT::NProfiling::TTagSet, NYT::NProfiling::TEventTimerGuard, NYT::NDataNode::TArtifactKey const&, NYT::TIntrusivePtr<NYT::NExecNode::TNbdConfig>)>::operator()<NYT::NExecNode::TLayerLocation, NYT::TGuid const&, NYT::NProfiling::TTagSet const&, NYT::NProfiling::TEventTimerGuard, NYT::NDataNode::TArtifactKey const&, NYT::TIntrusivePtr<NYT::NExecNode::TNbdConfig> const&>(NYT::TIntrusivePtr<NYT::NExecNode::TLayerLocation> const&, NYT::TGuid const&, NYT::NProfiling::TTagSet const&, NYT::NProfiling::TEventTimerGuard&&, NYT::NDataNode::TArtifactKey const&, NYT::TIntrusivePtr<NYT::NExecNode::TNbdConfig> const&) const at /-S/yt/yt/core/actions/bind-inl.h:279
12. 0x0000399a517f in auto NYT::NDetail::TBindState<true, NYT::NDetail::TMethodInvoker<NYT::NExecNode::TVolumeMeta (NYT::NExecNode::TLayerLocation::*)(NYT::TGuid, NYT::NProfiling::TTagSet, NYT::NProfiling::TEventTimerGuard, NYT::NDataNode::TArtifactKey const&, NYT::TIntrusivePtr<NYT::NExecNode::TNbdConfig>)>, std::__y1::integer_sequence<unsigned long, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul>, NYT::TIntrusivePtr<NYT::NExecNode::TLayerLocation>, NYT::TGuid, NYT::NProfiling::TTagSet, NYT::NDetail::TPassedWrapper<NYT::NProfiling::TEventTimerGuard>, NYT::NDataNode::TArtifactKey, NYT::TIntrusivePtr<NYT::NExecNode::TNbdConfig>>::Run<>(NYT::NDetail::TBindStateBase*) at /-S/yt/yt/core/actions/bind-inl.h:589
13. 0x0000399b6440 in NYT::TCallback<NYT::NExecNode::TVolumeMeta ()>::operator()() const at /-S/yt/yt/core/actions/callback.h:234
14. 0x0000399b61e0 in void NYT::NDetail::TPromiseSetter<NYT::NExecNode::TVolumeMeta, NYT::NExecNode::TVolumeMeta ()>::Do<>(NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&, NYT::TCallback<NYT::NExecNode::TVolumeMeta ()> const&)::'lambda'()::operator()() const at /-S/yt/yt/core/actions/future-inl.h:716
15. 0x0000399b5ff8 in void NYT::NDetail::InterceptExceptions<NYT::NExecNode::TVolumeMeta, void NYT::NDetail::TPromiseSetter<NYT::NExecNode::TVolumeMeta, NYT::NExecNode::TVolumeMeta ()>::Do<>(NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&, NYT::TCallback<NYT::NExecNode::TVolumeMeta ()> const&)::'lambda'()>(NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&, void NYT::NDetail::TPromiseSetter<NYT::NExecNode::TVolumeMeta, NYT::NExecNode::TVolumeMeta ()>::Do<>(NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&, NYT::TCallback<NYT::NExecNode::TVolumeMeta ()> const&)::'lambda'() const&) at /-S/yt/yt/core/actions/future-inl.h:697
16. 0x0000399b548c in void NYT::NDetail::TPromiseSetter<NYT::NExecNode::TVolumeMeta, NYT::NExecNode::TVolumeMeta ()>::Do<>(NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&, NYT::TCallback<NYT::NExecNode::TVolumeMeta ()> const&) at /-S/yt/yt/core/actions/future-inl.h:713
17. 0x0000399b1897 in NYT::NDetail::TAsyncViaHelper<NYT::NExecNode::TVolumeMeta ()>::Inner(NYT::TExtendedCallback<NYT::NExecNode::TVolumeMeta ()> const&, NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&) at /-S/yt/yt/core/actions/future-inl.h:1572
18. 0x0000399b516b in auto NYT::NDetail::TBindState<false, void (*)(NYT::TExtendedCallback<NYT::NExecNode::TVolumeMeta ()> const&, NYT::TPromise<NYT::NExecNode::TVolumeMeta> const&), std::__y1::integer_sequence<unsigned long, 0ul, 1ul>, NYT::TExtendedCallback<NYT::NExecNode::TVolumeMeta ()>, NYT::TPromise<NYT::NExecNode::TVolumeMeta>>::Run<>(NYT::NDetail::TBindStateBase*) at /-S/yt/yt/core/actions/bind-inl.h:589
19. 0x00002834c4ed in NYT::TCallback<void ()>::operator()() const at /-S/yt/yt/core/actions/callback.h:234
20. 0x000029493c81 in NYT::NConcurrency::NDetail::RunInFiberContext(NYT::NConcurrency::TFiber*, NYT::TCallback<void ()>) at /-S/yt/yt/core/concurrency/fiber_scheduler_thread.cpp:840
21. 0x0000294934e7 in NYT::NConcurrency::NDetail::FiberTrampoline() at /-S/yt/yt/core/concurrency/fiber_scheduler_thread.cpp:452
22. 0x0000294acaa0 in NYT::NConcurrency::TFiber::DoRunNaked() at /-S/yt/yt/core/concurrency/fiber.cpp:432
23. 0x000028a9e255 in Run(void*) at /-S/util/system/context.cpp:47
24. 0x000028a9e231 in ContextTrampoLine at /-S/util/system/context.cpp:124
*** Marked memory regions of total size 0 MB as undumpable ***
*** Waiting for logger to shut down ***
*** Terminating ***
Killing pytest process
2024-05-17 10:50:55,348 WARNING library.python.cores: Core dump dir doesn't exist: /var/tmp/cores
Number of suites skipped by name: 3, by filter *TestNbdSquashFSLayers*

yt/yt/tests/integration/node/bin <py3test> [size:large] [tags: ya:external, ya:fat, ya:force_sandbox, ya:full_logs, ya:noretries, ya:relwithdebinfo, ya:sandbox_coverage, ya:sys_info, ya:yt]
------ sole chunk ran 3 tests (total:51.01s - setup:0.03s test:50.96s)
Test process was killed by SIGKILL signal. See logs for more info
Test wrapper's stderr tail:
YT::NConcurrency::NDetail::FiberTrampoline() at /-S/yt/yt/core/concurrency/fiber_scheduler_thread.cpp:452
22. 0x0000294acaa0 in NYT::NConcurrency::TFiber::DoRunNaked() at /-S/yt/yt/core/concurrency/fiber.cpp:432
23. 0x000028a9e255 in Run(void*) at /-S/util/system/context.cpp:47
24. 0x000028a9e231 in ContextTrampoLine at /-S/util/system/context.cpp:124
*** Marked memory regions of total size 0 MB as undumpable ***
*** Waiting for logger to shut down ***
*** Terminating ***
Killing pytest process
Download_script: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/yt_run_test/download.sh
Log: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/run_test.log
Logsdir: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff
Operation_logs: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/yt_run_test
Stderr: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff/stderr
[crashed] test_layers.py::TestNbdSquashFSLayers::test_squashfs_layer (yuryalekseev) [default-linux-x86_64-debug] (0.00s) Test crashed
Log: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff/test_layers.py.TestNbdSquashFSLayers.test_squashfs_layer.(yuryalekseev).log
Logsdir: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff
Operation_logs: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/yt_run_test
[not_launched] test_layers.py::TestNbdSquashFSLayers::test_corrupted_squashfs_layer (yuryalekseev) [default-linux-x86_64-debug] (0.00s)
Logsdir: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff
Operation_logs: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/yt_run_test
[not_launched] test_layers.py::TestNbdSquashFSLayers::test_corrupted_layer_with_squashfs_layer (yuryalekseev) [default-linux-x86_64-debug] (0.00s)
Logsdir: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/testing_out_stuff
Operation_logs: /home/yuryalekseev/arcadia/yt/yt/tests/integration/node/bin/test-results/py3test/yt_run_test
------ FAIL: 2 - NOT_LAUNCHED, 1 - CRASHED yt/yt/tests/integration/node/bin

Total 1 suite:
	1 - FAIL
Total 3 tests:
	2 - NOT_LAUNCHED
	1 - CRASHED
Failed
yuryalekseev@yuryalekseev-dev:~/arcadia$

Полезные ошибки в логах так:

2024-05-17 10:50:35,169410      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:35,272105      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:35,654679      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:35,765349      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:35,868499      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,006721      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,114997      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,274831      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,383329      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,485018      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,586976      E       Containers      Porto API call error (Error: Unknown, Command: CreateVolume, Message: No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a)      Porto:volume0   fffef0a808e38d58        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,587709      E       ExecNode        Failed to create volume (Tag: 87ed8ec-5493ae52-9a6c4331-9dbc41b8, Type: Nbd, VolumeId: c2dec116-bed9e9a7-a7104c-6f09bc05, LocationId: layer0)\nPorto API error\n    code            12001\n    origin          localhost (pid 2, thread Porto:volume0, fid fffef0a808e38d58)\n    datetime        2024-05-17T07:50:36.587056Z\n    original_porto_error_code 1\n    porto_error_message No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a\n layer0  fffef0a808ee29fc        94176c7f-74d586d6-27c31605-3cc50bf3
2024-05-17 10:50:36,588396      E       ExecNode        Volume manager disabled; terminating (LocationId: layer0)\nFailed to create Nbd volume c2dec116-bed9e9a7-a7104c-6f09bc05\n    origin          localhost (pid 2, thread layer0, fid fffef0a808ee29fc)\n    datetime        2024-05-17T07:50:36.587848Z\n\n  Porto API error\n      code            12001\n      origin          localhost (pid 2, thread Porto:volume0, fid fffef0a808e38d58)\n      datetime        2024-05-17T07:50:36.587056Z\n      original_porto_error_code 1\n      porto_error_message No such file or directory: Cannot open /place/db/iss3/volumes/ISS-AGENT_4T5yVSyAguO/yt/disk2/arnold-data/layers/volumes/5ac555d1-4e0eae47-58bae7d9-a6ce6ab8/mount/tmp/tmpvrsmu09a\n   layer0  fffef0a808ee29fc        94176c7f-74d586d6-27c31605-3cc50bf3
(END)

Связано это с этим биндом: https://github.com/ytsaurus/ytsaurus/blob/main/yt/yt/server/job_proxy/job_proxy.cpp#L1148.

Есть тикет в PORTO, чтобы это поправить.

@Kontakter
Copy link
Collaborator

@yalekseev – use English please.

Could we consider making this bind optional? And disable it in tests.

I hope that I understand the problem correctly.

@koct9i
Copy link
Collaborator Author

koct9i commented May 27, 2024

Playing dirty tricks with obscure binds isn't better than sticking socket into random unexpected directories, like "/tmp" or home. Inside container "/run" or "/dev" are more suited places for that.

It don't have to be rootfs - it is better to add separate tmpfs volume for such interconnections. Inside container it could be mounted as "/dev/something", and in host hypervisor already knows short direct path to it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants