Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[hue] Enable Hive on 1.5 and 2.0 images #979

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

DKbyo
Copy link

@DKbyo DKbyo commented Mar 18, 2022

Hive is not enabled on hue 4.8.0 due wrong interpreter name

  • Includes test case to validate hive interpreter in hue config using HUE REST API

Internal bug

b/225389567

hue/hue.sh Outdated Show resolved Hide resolved
@DKbyo DKbyo force-pushed the enable-hive branch 2 times, most recently from 006a875 to 981e6aa Compare March 23, 2022 15:17
hue/hue.sh Outdated Show resolved Hide resolved
hue/hue.sh Outdated Show resolved Hide resolved
hue/hue.sh Show resolved Hide resolved
hue/hue.sh Outdated Show resolved Hide resolved
hue/test_hue_with_hive.sh Outdated Show resolved Hide resolved
@medb
Copy link
Contributor

medb commented Apr 6, 2022

/gcbrun

hue/hue.sh Show resolved Hide resolved
@medb medb self-requested a review April 7, 2022 19:34
@medb medb changed the title Enable hive on hue 4.8.0 [hue] Enable Hive on 1.5 and 2.0 images Apr 7, 2022
@medb
Copy link
Contributor

medb commented Apr 8, 2022

Test fails with error:

FAILED (failures=1)
================================================================================
==================== Test output for //hue:test_hue (shard 1 of 3):
Running tests under Python 3.8.10: /usr/bin/python3
[ RUN      ] HueTestCase.test_hue('SINGLE', ['m'])
[  FAILED  ] HueTestCase.test_hue('SINGLE', ['m'])
======================================================================
FAIL: test_hue('SINGLE', ['m']) (__main__.HueTestCase)
test_hue('SINGLE', ['m']) (__main__.HueTestCase)
test_hue('SINGLE', ['m'])
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test
    test_method(self, *testcase_params)
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 47, in test_hue
    self.verify_instance("{}-{}".format(self.getClusterName(),
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 28, in verify_instance
    self._run_hue_test_script(instance_name)
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 32, in _run_hue_test_script
    self.upload_test_file(
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 226, in upload_test_file
    self.assert_command('gcloud compute scp {} {}: --zone={}'.format(
  File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 305, in assert_command
    self.assertEqual(
AssertionError: 1 != 0 : Failed to execute command:
gcloud compute scp /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue_with_hive.sh test-hue-single-1-5-20220407-220535-px68-m: --zone=us-central1-f
STDOUT:

STDERR:
/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue_with_hive.sh: No such file or directory
ERROR: (gcloud.beta.compute.scp) [/usr/bin/scp] exited with return code [1].

May you fix it? I think you can find in other tests how they reference test files, if this is the issue.

@DKbyo
Copy link
Author

DKbyo commented Apr 8, 2022

@medb

May you fix it? I think you can find in other tests how they reference test files, if this is the issue.

Done, fixed py_test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants