Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Node identification behind tunnel is not possible #891

Open
estevopaz opened this issue May 16, 2023 · 12 comments
Open

Node identification behind tunnel is not possible #891

estevopaz opened this issue May 16, 2023 · 12 comments

Comments

@estevopaz
Copy link

If the server is behind an SSH tunnel, it's impossible to determine what node rendered the job:

"creator":"::ffff:127.0.0.1",
"updatedAt":"2023-05-16T14:00:56.321Z",
"createdAt":"2023-05-16T13:56:11.007Z",
"executor":"::ffff:127.0.0.1",
"startedAt":"2023-05-16T13:56:12.652Z",
"renderProgress":97,
"error":null,
"finishedAt":"2023-05-16T14:00:57.220Z",
"errorAt":null,
"jobCreator":"::ffff:127.0.0.1",
"jobExecutor":"::ffff:127.0.0.1"

This is very problematic when the cluster raises the number of nodes.
Would be possible just to send a custom identification from the client?
Just something like: nexrender-client --node-id "%IP%"
And store nodeId in the JSON?

@inlife
Copy link
Owner

inlife commented May 17, 2023

Hey @estevopaz

I like that you suggested the node-id parameter. We could extend this idea even further, outside of the scope of just IP addresses and a set of manual custom identifiers.

Ideally, if we would wish to identify our worker, we would set up an "--id" or a "--name" even (and I would actually go for the latter). And then that name would show up at the job definition on the server. It would also make sense to generate a name for cases, when it was not set and print it out in the console when the worker starts.
One question I do not have an answer to, is whether the name should be persisted after it was once generated, and if so, how to treat cases with multiple workers per single machine and their name persistence.

The IP should also be present and used, but most likely, we need to combine the name and IP into a single object on the server side. And, if possible, to get rid of duplicated keys "creator", "jobCreator", etc.

How do you think, would a structure like this work?

"updatedAt":"2023-05-16T14:00:56.321Z",
"createdAt":"2023-05-16T13:56:11.007Z",

"creator": {"name":"worker1", "host": "::ffff:127.0.0.1"},
"executor": {"name":"worker1", "host": "::ffff:127.0.0.1"},

"startedAt":"2023-05-16T13:56:12.652Z",
"finishedAt":"2023-05-16T14:00:57.220Z",

"renderProgress":97,
"error":null,
"errorAt":null,

Folks, @Thiago-Dantas @mohali-id, it would also be interesting to get your input on this since you both worked on this feature!

Thanks 🎉

@estevopaz
Copy link
Author

That would be a perfect solution, thanks.
About the persistence, IMHO it hasn't a good balance work-profit, but just my opinion.

Thanks Vladyslav.

@stale
Copy link

stale bot commented Jul 18, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix label Jul 18, 2023
@inlife inlife removed the wontfix label Jul 18, 2023
@stale
Copy link

stale bot commented Sep 16, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix label Sep 16, 2023
@stale stale bot closed this as completed Sep 29, 2023
@estevopaz
Copy link
Author

:'(

@inlife inlife reopened this Sep 29, 2023
@stale stale bot removed the wontfix label Sep 29, 2023
@inlife
Copy link
Owner

inlife commented Sep 29, 2023

stale bot does not know what he is doing! it's planned :)

@estevopaz
Copy link
Author

Thank you very much ;)

Copy link

stale bot commented Dec 2, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the Stale label Dec 2, 2023
@inlife inlife removed the Stale label Dec 3, 2023
Copy link

stale bot commented Feb 3, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the Stale label Feb 3, 2024
@stale stale bot closed this as completed Feb 13, 2024
@inlife inlife reopened this Feb 13, 2024
@stale stale bot removed the Stale label Feb 13, 2024
@inlife
Copy link
Owner

inlife commented Feb 25, 2024

@estevopaz workers now have --name argument which can be used to give a unique (or not) name to a worker

@estevopaz
Copy link
Author

Thank you very much, this is very useful for us.

Copy link

stale bot commented May 4, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the Stale label May 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants