Discussion on Flaky Tests #6546

maany · 2024-03-12T13:17:39Z

maany
Mar 12, 2024
Collaborator

Initiating a discussion to compile a list of flaky tests encountered during development and CI runs across the autotests, integration-tests and vo-test frameworks. Flaky tests are those that fail inconsistently, often unrelated to code changes.

Please contribute any flaky tests you've encountered recently along with relevant CI or local run logs.

Let's pinpoint the issues causing flakiness to open corresponding tickets for resolution.

rdimaio · 2024-03-12T15:23:10Z

rdimaio
Mar 12, 2024
Collaborator

Relevant issues:

0 replies

jamesp-epcc · 2024-03-12T16:06:56Z

jamesp-epcc
Mar 12, 2024
Collaborator

Had test_download_pfn fail on 3.10 multi_vo, but succeeded on all other combinations here. Logs:

=================================== FAILURES ===================================
________________________ TestBinRucio.test_download_pfn ________________________
[gw2] linux -- Python 3.10.4 /opt/venv/bin/python
tests/test_bin_rucio.py:692: in test_download_pfn
    assert re.search('Total files.*1', out) is not None
E   AssertionError: assert None is not None
E    +  where None = <function search at 0x7f67175928c0>('Total files.*1', 'Completed in 2.3969 sec.\n')
E    +    where <function search at 0x7f67175928c0> = re.search
------------------------------ Captured log setup ------------------------------
DEBUG    urllib3.connectionpool:connectionpool.py:1019 Starting new HTTPS connection (1): localhost:443
DEBUG    urllib3.connectionpool:connectionpool.py:474 https://localhost:443 "POST /accountlimits/local/root/XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU HTTP/1.1" 201 7
DEBUG    urllib3.connectionpool:connectionpool.py:1019 Starting new HTTPS connection (1): localhost:443
DEBUG    urllib3.connectionpool:connectionpool.py:474 https://localhost:443 "POST /rses/XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU/attr/istape HTTP/1.1" 201 7
----------------------------- Captured stdout call -----------------------------
$> rucio upload --rse XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU --scope data13_hip /tmp/file_CWFWAAAZNX
 2024-03-11 12:28:45,010	INFO	Preparing upload for file file_CWFWAAAZNX
2024-03-11 12:28:45,071	INFO	Successfully added replica in Rucio catalogue at XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU
2024-03-11 12:28:45,227	INFO	Successfully added replication rule at XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU
2024-03-11 12:28:45,774	INFO	Trying upload with file to XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU
2024-03-11 12:28:45,781	INFO	Successful upload of temporary file. file://54f07aefada14331836aa403ba4ce4e2.cern.ch/tmp/rucio_rse/test_54f07aefada14331836aa403ba4ce4e2/data13_hip/bf/ee/file_CWFWAAAZNX.rucio.upload
2024-03-11 12:28:45,781	INFO	Successfully uploaded file file_CWFWAAAZNX

Completed in 2.3969 sec.
 2024-03-11 12:28:48,325	DEBUG	baseclient.py	No trace_host passed. Using rucio_host instead
2024-03-11 12:28:48,328	DEBUG	baseclient.py	No creds passed. Trying to get it from the config file.
2024-03-11 12:28:48,328	DEBUG	baseclient.py	HTTPS is required, but no ca_cert was passed. Trying to get it from X509_CERT_DIR.
2024-03-11 12:28:48,328	DEBUG	baseclient.py	HTTPS is required, but no ca_cert was passed and X509_CERT_DIR is not defined. Trying to get it from the config file.
2024-03-11 12:28:48,328	DEBUG	baseclient.py	No account passed. Trying to get it from the RUCIO_ACCOUNT environment variable or the config file.
2024-03-11 12:28:48,328	DEBUG	baseclient.py	No VO passed. Trying to get it from environment variable RUCIO_VO.
2024-03-11 12:28:48,328	DEBUG	baseclient.py	No VO found. Trying to get it from the config file.
2024-03-11 12:28:48,328	DEBUG	baseclient.py	got token from file
2024-03-11 12:28:48,402	INFO	Processing 1 item(s) for input
2024-03-11 12:28:48,403	DEBUG	downloadclient.py	Preparing PFN download of data13_hip:file_CWFWAAAZNX (file://54f07aefada14331836aa403ba4ce4e2.cern.ch/tmp/rucio_rse/test_54f07aefada14331836aa403ba4ce4e2/data13_hip/bf/ee/file_CWFWAAAZNX) from XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU
2024-03-11 12:28:48,403	INFO	Using main thread to download 1 file(s)
2024-03-11 12:28:48,403	DEBUG	downloadclient.py	Start processing queued downloads
2024-03-11 12:28:48,403	INFO	Preparing download of data13_hip:file_CWFWAAAZNX
2024-03-11 12:28:48,404	INFO	Trying to download with file and timeout of 360s from XNFRNY-BIN-RUCIO-BINRUCIO-DOWNLOAD-PFN-VTJFTU: data13_hip:file_CWFWAAAZNX 
2024-03-11 12:28:48,989	INFO	Using PFN: file://54f07aefada14331836aa403ba4ce4e2.cern.ch/tmp/rucio_rse/test_54f07aefada14331836aa403ba4ce4e2/data13_hip/bf/ee/file_CWFWAAAZNX
2024-03-11 12:28:48,990	DEBUG	downloadclient.py	Access to local destination denied.
Details: [Errno 2] No such file or directory: '/opt/rucio/data13_hip/file_CWFWAAAZNX.part'
2024-03-11 12:28:48,990	WARNING	Download attempt failed. Try 1/2
2024-03-11 12:28:49,849	DEBUG	downloadclient.py	Access to local destination denied.
Details: [Errno 2] No such file or directory: '/opt/rucio/data13_hip/file_CWFWAAAZNX.part'
2024-03-11 12:28:49,850	WARNING	Download attempt failed. Try 2/2
2024-03-11 12:28:50,717	ERROR	Failed to download file data13_hip:file_CWFWAAAZNX
2024-03-11 12:28:50,718	ERROR	None of the requested files have been downloaded.

------------------------------ Captured log call -------------------------------
DEBUG    urllib3.connectionpool:connectionpool.py:1019 Starting new HTTPS connection (1): localhost:443
DEBUG    urllib3.connectionpool:connectionpool.py:474 https://localhost:443 "POST /replicas/list HTTP/1.1" 200 None

Also saw test_multihop_receiver_on_failure fail in integration tests here. Logs:

=================================== FAILURES ===================================
_______________ test_multihop_receiver_on_failure[caches_mock0] ________________
[gw0] linux -- Python 3.9.18 /usr/bin/python
tests/test_conveyor.py:528: in test_multihop_receiver_on_failure
    request = __wait_for_state_transition(dst_rse_id=jump_rse_id, run_poller=False, **did)
tests/test_conveyor.py:88: in __wait_for_state_transition
    request = request_core.get_request_by_did(rse_id=dst_rse_id, scope=scope, name=name)
/usr/local/lib/python3.9/site-packages/rucio/core/monitor.py:419: in _wrapper
    return func(*args, **kwargs)
/usr/local/lib/python3.9/site-packages/rucio/common/utils.py:2177: in _wrapper
    return fn(*args, **kwargs)
/usr/local/lib/python3.9/site-packages/rucio/db/sqla/session.py:378: in new_funct
    return function(*args, session=session, **kwargs)
/usr/local/lib/python3.9/site-packages/rucio/core/request.py:1090: in get_request_by_did
    raise RequestNotFound(f'No request found for DID {scope}:{name} at RSE {rse_id}')
E   rucio.common.exception.RequestNotFound: A request for this DID and RSE does not exist.
E   Details: No request found for DID mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 at RSE 99db58e612314754b890bf56[82](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:83)24edf4
------------------------------ Captured log call -------------------------------
INFO     root:receiver.py:109 receiver starting
INFO     root:receiver.py:118 resolving broker dns alias: ['activemq']
INFO     root:receiver.py:125 brokers resolved to ['172.18.0.11']
INFO     root:receiver.py:127 checking authentication method
DEBUG    dogpile.lock:lock.py:135 value creation lock <dogpile.cache.region.CacheRegion._LockWrapper object at 0x7feb7cf1d3a0> acquired
DEBUG    dogpile.lock:lock.py:174 Calling creation function for previously expired value
DEBUG    dogpile.cache.region:region.py:865 Cache value generated in 0.000 seconds for key(s): "host_to_choose_choice['https://rucio:443']"
DEBUG    dogpile.lock:lock.py:182 Released creation lock
DEBUG    urllib3.connectionpool:connectionpool.py:291 Resetting dropped connection: rucio
INFO     root:receiver.py:144 setting up username/password authentication: 172.18.0.11
INFO     root:receiver.py:157 receiver started
DEBUG    root:logging.py:403 [0/1]: First heartbeat set
INFO     root:logging.py:403 [0/1]: connecting to 172.18.0.11
DEBUG    urllib3.connectionpool:connectionpool.py:474 https://rucio:443 "POST /replicas HTTP/1.1" 201 7
DEBUG    root:rule_grouping.py:1085 Creating ReplicaState.COPYING replica for mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 on 433fd8528f42445d9227b960523027c4
DEBUG    root:rule_grouping.py:1053 Creating REPLICATING Lock mock:433fd8528f42445d9227b960523027c4 on BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 for rule b65d8e6e70be4acc97b906271717afc2
DEBUG    root:request.py:284 queue requests
INFO     root:rule.py:3[83](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:84) Created rule b65d8e6e70be4acc97b906271717afc2 [0/1/0] with new algorithm for did mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 in state RuleState.REPLICATING
INFO     root:submitter.py:241 Following schemes filtered out: ['magnet']
DEBUG    root:submitter.py:250 Maximum time in queue for different activities: {'default': 168}
INFO     root:common.py:379 waiting for interrupts
DEBUG    root:logging.py:403 [0/1]: First heartbeat set
INFO     root:logging.py:403 [0/1]: started
DEBUG    root:logging.py:403 [0/1]: Starting next iteration
INFO     root:logging.py:403 [0/1]: Got 1 transfers for None in 0.011080393000156619 seconds
DEBUG    root:logging.py:403 [0/1]: Only 1 transfers for None which is less than bulk 100
INFO     root:logging.py:403 [0/1]: Heartbeat cleaned up
DEBUG    root:transfer.py:1222 2bd43ad36d9d43b7828736b16209d259(mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290): Working on 1 sources: XRD1:0:9999
INFO     root:transfer.py:1282 2bd43ad36d9d43b7828736b16209d259(mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290): 1 ordered sources: XRD1:0:0:14:1(multihop)
DEBUG    root:request.py:2[84](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:85) queue requests
DEBUG    root:common.py:373 2bd43ad36d9d43b7828736b16209d259: New request created for the transfer between src_rse=XRD1 and dst_rse=XRD4 : 038d6033247445fe8bcae28fac9c4e7c
DEBUG    root:logging.py:403 xrootd.Default: xrootd.lfns2pfns: lfns: {'scope': 'mock', 'name': 'BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290', 'path': None}
DEBUG    root:logging.py:403 xrootd.Default: xrootd.lfns2pfns: lfns: {'scope': 'mock', 'name': 'BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290', 'path': None}
INFO     root:common.py:2[85](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:86) 2bd43ad36d9d43b782[87](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:88)36b16209d259: Best path is multihop: XRD1--038d6033247445fe8bcae28fac9c4e7c->XRD3--2bd43ad36d9d43b7828736b16209d259->XRD4
DEBUG    root:fts3_plugins.py:55 Policy Algorithm [] not found, ignoring.
DEBUG    root:submitter.py:162 Starting to group transfers https://fts:8446
DEBUG    root:submitter.py:167 Starting to submit transfers for https://fts:8446
DEBUG    root:submitter.py:169 submitjob: transfers=['XRD1--038d6033247445fe8bcae28fac9c4e7c->XRD3', 'XRD3--2bd43ad36d9d43b7828736b16209d259->XRD4'], job_params={'account': root, 'verify_checksum': 'both', 'copy_pin_lifetime': None, 'bring_online': None, 'job_metadata': {'issuer': 'rucio', 'multi_sources': False, 'multihop': True}, 'overwrite': True, 'priority': 3, 'multihop': True, 's3alternate': True, 'max_time_in_queue': 168}
DEBUG    root:logging.py:403 xrootd.Default: xrootd.lfns2pfns: lfns: {'scope': 'mock', 'name': 'BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db1[88](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:89)04c4f4c8f80290'}
DEBUG    root:transfer.py:328 PREPARING REQUEST 038d6033247445fe8bcae28fac9c4e7c DID mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3[89](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:90)1bb2192f4db18804c4f4c8f802[90](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:91) TO SUBMITTING STATE PREVIOUS None FROM ['root://xrd1:1094//rucio/mock/53/3e/BFSRAF-conveyor-multihop_receiver_on_failure-file_a38[91](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:92)bb21[92](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:93)f4db18804c4f4c8f80290'] TO root://xrd3:1096//rucio/mock/53/3e/BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 USING https://fts:8446 
DEBUG    root:logging.py:403 xrootd.Default: xrootd.lfns2pfns: lfns: {'scope': 'mock', 'name': 'BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290'}
DEBUG    root:transfer.py:328 PREPARING REQUEST 2bd43ad36d9d43b7828736b16209d259 DID mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 TO SUBMITTING STATE PREVIOUS None FROM ['root://xrd3:1096//rucio/mock/53/3e/BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290'] TO root://xrd4:1097//rucio/mock/53/3e/BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 USING https://fts:8446 
DEBUG    root:common.py:432 About to submit job to https://fts:8446 with timeout None
DEBUG    urllib3.connectionpool:connectionpool.py:1019 Starting new HTTPS connection (1): fts:8446
DEBUG    urllib3.connectionpool:connectionpool.py:474 https://fts:8446 "POST /jobs HTTP/1.1" 200 50
DEBUG    root:common.py:459 Submit job 9ad16b3a-dd34-11ee-ac57-0242ac12000a to https://fts:8446 in 0.06039067400001841 seconds
INFO     root:transfer.py:417 Setting state(SUBMITTED), transfertool(fts3), external_host(https://fts:8446) and eid(9ad16b3a-dd34-11ee-ac57-0242ac12000a) for transfers: 038d6033247445fe8bcae28fac9c4e7c, 2bd43ad36d9d43b7828736b16209d259
DEBUG    root:transfer.py:422 COPYING REQUEST 038d6033247445fe8bcae28fac9c4e7c DID mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 USING https://fts:8446 with state(RequestState.SUBMITTED) with eid(9ad16b3a-dd34-11ee-ac57-0242ac12000a)
DEBUG    root:transfer.py:422 COPYING REQUEST 2bd43ad36d9d43b7828736b16209d259 DID mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 USING https://fts:8446 with state(RequestState.SUBMITTED) with eid(9ad16b3a-dd34-11ee-ac57-0242ac12000a)
DEBUG    root:transfer.py:4[94](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:95) Finished to register transfer state for 9ad16b3a-dd34-11ee-ac57-0242ac12000a
INFO     root:receiver.py:88 RECEIVED Transfer 9ad16b3a-dd34-11ee-ac57-0242ac12000a of mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 XRD1 --(038d6033247445fe8bcae28fac9c4e7c)-> XRD3
INFO     root:transfer.py:523 UPDATING REQUEST 038d6033247445fe8bcae28fac9c4e7c FOR Transfer 9ad16b3a-dd34-11ee-ac57-0242ac12000a of mock:BFSRAF-conveyor-multihop_receiver_on_failure-file_a3891bb2192f4db18804c4f4c8f80290 XRD1 --(038d6033247445fe8bcae28fac9c4e7c)-> XRD3 with changes: {'state': <RequestState.FAILED: 'F'>, 'external_id': '9ad16b3a-dd34-11ee-ac57-0242ac12000a', 'started_at': datetime.datetime(2024, 3, 8, 10, 14, 10, 184000), 'transferred_at': datetime.datetime(2024, 3, 8, 10, 14, 10, 883000), 'source_rse_id': '0cac739a1c5d46f29434[95](https://github.com/rucio/rucio/actions/runs/8201539801/job/22430654777?pr=6426#step:18:96)ac2b02bc35', 'err_msg': 'RequestErrMsg.TRANSFER_FAILED:Failed to stat file (No such file or directory)'}
INFO     root:logging.py:403 [0/1]: Heartbeat cleaned up

0 replies

bari12 · 2024-03-19T10:14:17Z

bari12
Mar 19, 2024
Maintainer

I had a couple of more failures of the pfn tests as well.
Hopefully these are fixed by #6543

0 replies

bari12 · 2024-03-21T10:06:51Z

bari12
Mar 21, 2024
Maintainer

Deadlock in test_preparer_ignore_availability (test (alma9, 3.10, autotest, multi_vo, postgres14, /opt/rucio/etc/multi_vo/tst))

==================================== ERRORS ====================================
_ ERROR at teardown of test_preparer_ignore_availability[file_config_mock{'conveyor': {'use_preparer': 'true'}}] _
[gw2] linux -- Python 3.10.4 /opt/venv/bin/python
../venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py:1969: in _exec_single_context
    self.dialect.do_execute(
../venv/lib/python3.10/site-packages/sqlalchemy/engine/default.py:922: in do_execute
    cursor.execute(statement, parameters)
E   psycopg2.errors.DeadlockDetected: deadlock detected
E   DETAIL:  Process 449 waits for ShareLock on transaction 18938; blocked by process 452.
E   Process 452 waits for ShareLock on transaction 18940; blocked by process 449.
E   HINT:  See server log for query details.
E   CONTEXT:  while deleting tuple (9,3) in relation "locks"

The above exception was the direct cause of the following exception:
lib/rucio/db/sqla/session.py:454: in new_funct
    result = function(*args, session=session, **kwargs)
tests/temp_factories.py:179: in _cleanup_db_deps
    cleanup_db_deps(
lib/rucio/db/sqla/session.py:468: in new_funct
    result = function(*args, session=session, **kwargs)
lib/rucio/tests/common_server.py:115: in cleanup_db_deps
    session.execute(stmt)
../venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py:2308: in execute
    return self._execute_internal(
../venv/lib/python3.10/site-packages/sqlalchemy/orm/session.py:2199: in _execute_internal
    result = conn.execute(
../venv/lib/python3.10/site-packages/sqlalchemy/engine/base.py:1416: in execute
    return meth(
INFO     root:rule.py:472 Created rule 03cfc9d4b2c344e581d266620218a68d [0/1/0] with new algorithm for did mock:file_1b45f9a8f58a4d18b145585f4fd17c83 in state RuleState.REPLICATING
DEBUG    root:logging.py:403 [0/1]: First heartbeat set
INFO     root:logging.py:403 [0/1]: started
DEBUG    root:logging.py:403 [0/1]: Starting next iteration
INFO     root:common.py:379 waiting for interrupts
DEBUG    root:logging.py:403 [0/1]: Heartbeat renewed
DEBUG    root:logging.py:403 [0/1]: Heartbeat renewed
WARNING  root:logging.py:403 [0/1]: multihop_rse_expression is not empty, but returned no RSEs
INFO     root:logging.py:403 [0/1]: Only 1 transfers, which is less than half of the bulk 100
INFO     root:logging.py:403 [0/1]: Heartbeat cleaned up
DEBUG    root:transfer.py:1224 f03fc7ae8297473280480c75be924e26(mock:file_1b45f9a8f58a4d18b145585f4fd17c83): Working on 1 sources: JPEMXT-CONVEYOR-PREPARER-IGNORE-AVAILABILITY-ZHEUXO:0:10
INFO     root:transfer.py:1284 f03fc7ae8297473280480c75be924e26(mock:file_1b45f9a8f58a4d18b145585f4fd17c83): 1 ordered sources: JPEMXT-CONVEYOR-PREPARER-IGNORE-AVAILABILITY-ZHEUXO:0:0:10:0
INFO     root:preparer.py:199 updated 1/100 requests, taking 0.029 seconds
=============================== warnings summary ===============================
../venv/lib/python3.10/site-packages/_pytest/config/__init__.py:735
../venv/lib/python3.10/site-packages/_pytest/config/__init__.py:735
../venv/lib/python3.10/site-packages/_pytest/config/__init__.py:735
../venv/lib/python3.10/site-packages/_pytest/config/__init__.py:735
  /opt/venv/lib/python3.10/site-packages/_pytest/config/__init__.py:735: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: xdist
    self.import_plugin(arg, consider_entry_points=True)

../venv/lib/python3.10/site-packages/magic/__init__.py:437
../venv/lib/python3.10/site-packages/magic/__init__.py:437
../venv/lib/python3.10/site-packages/magic/__init__.py:437
../venv/lib/python3.10/site-packages/magic/__init__.py:437
  /opt/venv/lib/python3.10/site-packages/magic/__init__.py:437: PendingDeprecationWarning: Using compatibility mode with libmagic's python binding. See https://github.com/ahupp/python-magic/blob/master/COMPAT.md for details.
    warnings.warn(

tests/test_abacus_account.py: 1 warning
tests/test_abacus_collection_replica.py: 2 warnings
tests/test_abacus_rse.py: 1 warning
tests/test_automatix.py: 1 warning
tests/test_conveyor_submitter.py: 6 warnings
tests/test_did.py: 2 warnings
tests/test_multi_vo.py: 1 warning
tests/test_rule.py: 4 warnings
tests/test_conveyor.py: 3 warnings
tests/test_download.py: 15 warnings
tests/test_replica.py: 2 warnings
tests/test_transfer.py: 2 warnings
tests/test_upload.py: 9 warnings
  /opt/venv/lib/python3.10/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
    warnings.warn(

tests/test_bb8.py::test_bb8_full_workflow[file_config_mock{'bb8': {'allowed_accounts': 'jdoe'}}]
  /opt/rucio/lib/rucio/daemons/bb8/common.py:407: SADeprecationWarning: The SelectBase.as_scalar() method is deprecated and will be removed in a future release.  Please refer to SelectBase.scalar_subquery(). (deprecated since: 1.4)
    .as_scalar()

tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/rucio/lib/rucio/core/request.py:2320: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(cumulated_children_subquery)

tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_per_free_volume[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/rucio/lib/rucio/core/request.py:2102: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(cumulated_volume_subquery)

tests/test_throttler.py::TestSimpleLimits::test_dest_per_act_fifo_release_all[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_dest_per_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_per_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_all_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestOverlappingLimits::test_source_dest_mixed_act[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/rucio/lib/rucio/core/request.py:2255: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(subquery)

tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_per_deadline[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/rucio/lib/rucio/core/request.py:2030: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(old_requests_subquery)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================```

0 replies

bari12 · 2024-04-09T08:31:39Z

bari12
Apr 9, 2024
Maintainer

Another one seen in Belle II VO tests

=================================== FAILURES ===================================
________________ test_judge_double_container_with_existing_rule ________________
[gw3] linux -- Python 3.9.18 /opt/venv/bin/python
tests/test_judge_evaluator.py:519: in test_judge_double_container_with_existing_rule
    re_evaluator(once=True, did_limit=None)
../venv/lib64/python3.9/site-packages/rucio/daemons/judge/evaluator.py:56: in re_evaluator
    run_daemon(
../venv/lib64/python3.9/site-packages/rucio/daemons/common.py:270: in run_daemon
    for _ in daemon():
../venv/lib64/python3.9/site-packages/rucio/daemons/common.py:215: in _generator
    result = run_once_fnc(heartbeat_handler=heartbeat_handler, activity=activity)
../venv/lib64/python3.9/site-packages/rucio/daemons/judge/evaluator.py:117: in run_once
    re_evaluate_did(scope=did.scope, name=did.name, rule_evaluation_action=did.rule_evaluation_action)
../venv/lib64/python3.9/site-packages/rucio/db/sqla/session.py:453: in new_funct
    result = function(*args, session=session, **kwargs)
../venv/lib64/python3.9/site-packages/rucio/core/rule.py:2081: in re_evaluate_did
    __evaluate_did_attach(did, session=session)
../venv/lib64/python3.9/site-packages/rucio/db/sqla/session.py:467: in new_funct
    result = function(*args, session=session, **kwargs)
../venv/lib64/python3.9/site-packages/rucio/core/rule.py:3793: in __evaluate_did_attach
    session.flush()
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/session.py:4312: in flush
    self._flush(objects)
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/session.py:4448: in _flush
    transaction.rollback(_capture_exception=True)
../venv/lib64/python3.9/site-packages/sqlalchemy/util/langhelpers.py:146: in __exit__
    raise exc_value.with_traceback(exc_tb)
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/session.py:4408: in _flush
    flush_context.execute()
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/unitofwork.py:466: in execute
    rec.execute(self)
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/unitofwork.py:642: in execute
    util.preloaded.orm_persistence.save_obj(
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/persistence.py:85: in save_obj
    _emit_update_statements(
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/persistence.py:943: in _emit_update_statements
    raise orm_exc.StaleDataError(
E   sqlalchemy.orm.exc.StaleDataError: UPDATE statement on table 'contents' expected to update 1 row(s); 0 were matched.
------------------------------ Captured log call -------------------------------
INFO     root:rule.py:471 Created rule 2997c032cd5840b584a01cb5e2142e0a [0/0/0] with new algorithm for did mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_418fb2b71d274f269e3c0a5dfd893f68 in state RuleState.OK
DEBUG    root:logging.py:402 [1/2]: First heartbeat set
INFO     root:logging.py:402 [1/2]: started
DEBUG    root:logging.py:402 [0/1]: Heartbeat renewed
DEBUG    root:logging.py:402 [0/1]: Starting next iteration
DEBUG    root:logging.py:402 [0/1]: index query time 0.003211 fetch size is 9 (0 blocked)
INFO     root:rule.py:3566 Re-Evaluating did mock:dataset_2f8ba5b044954c3ab280025f27699af2 for ATTACH
DEBUG    root:logging.py:402 [0/1]: evaluation of mock:dataset_2f8ba5b044954c3ab280025f27699af2 took 0.027590
INFO     root:rule.py:3566 Re-Evaluating did mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_493ccd1bf411433b96d70f183446f2dc/dataset_dda355d9ab684e1a8558250d61814841 for ATTACH
DEBUG    root:rule.py:4104 Creating locks and replicas for rule 2997c032cd5840b584a01cb5e2142e0a [0/0/0]
DEBUG    root:rule_grouping.py:1061 Creating OK Lock mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_e69ded2ea68b4b38aedd269bb876a061/dataset_c2d243601ac64ee399a161c5c715f6eb/file_6a94896ddcd74bdfab4bb6f732bb5dd5 on 25c6f088660b4cc2ad4ef50a7cd1082d for rule 2997c032cd5840b584a01cb5e2142e0a
DEBUG    root:rule.py:4132 Rule 2997c032cd5840b584a01cb5e2142e0a  [1/0/0] queued 0 transfers
DEBUG    root:request.py:285 queue requests
DEBUG    root:rule.py:4135 Finished creating locks and replicas for rule 2997c032cd5840b584a01cb5e2142e0a [1/0/0]
DEBUG    root:logging.py:402 [0/1]: evaluation of mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_493ccd1bf411433b96d70f183446f2dc/dataset_dda355d9ab684e1a8558250d61814841 took 0.048604
INFO     root:rule.py:3566 Re-Evaluating did mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_3efbc696e42846e8826184e6941dfd4e for ATTACH
DEBUG    root:rule.py:4104 Creating locks and replicas for rule 2997c032cd5840b584a01cb5e2142e0a [1/0/0]
DEBUG    root:rule.py:4132 Rule 2997c032cd5840b584a01cb5e2142e0a  [1/0/0] queued 0 transfers
DEBUG    root:request.py:285 queue requests
DEBUG    root:rule.py:4135 Finished creating locks and replicas for rule 2997c032cd5840b584a01cb5e2142e0a [1/0/0]
DEBUG    root:logging.py:402 [0/1]: evaluation of mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_3efbc696e42846e8826184e6941dfd4e took 0.212430
INFO     root:rule.py:3566 Re-Evaluating did mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_418fb2b71d274f269e3c0a5dfd893f68 for ATTACH
DEBUG    root:rule.py:4104 Creating locks and replicas for rule 2997c032cd5840b584a01cb5e2142e0a [1/0/0]
DEBUG    root:rule.py:4132 Rule 2997c032cd5840b584a01cb5e2142e0a  [1/0/0] queued 0 transfers
DEBUG    root:request.py:285 queue requests
DEBUG    root:rule.py:4135 Finished creating locks and replicas for rule 2997c032cd5840b584a01cb5e2142e0a [1/0/0]
DEBUG    root:logging.py:402 [0/1]: evaluation of mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_418fb2b71d274f269e3c0a5dfd893f68 took 0.024625
INFO     root:logging.py:402 [0/1]: Heartbeat cleaned up
DEBUG    root:logging.py:402 [0/1]: First heartbeat set
INFO     root:logging.py:402 [0/1]: started
DEBUG    root:logging.py:402 [0/1]: Heartbeat renewed
DEBUG    root:logging.py:402 [0/1]: Starting next iteration
DEBUG    root:logging.py:402 [0/1]: index query time 0.001150 fetch size is 3 (0 blocked)
INFO     root:rule.py:3405 Re-Evaluating did mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_418fb2b71d274f269e3c0a5dfd893f68 for DETACH
DEBUG    root:rule.py:3441 Removing locks for rule 2997c032cd5840b584a01cb5e2142e0a [1/0/0]
DEBUG    root:rule.py:4158 Deleting lock mock:/belle/YVDQDS-judge_evaluator-judge_double_container_with_existing_rule-/cont_e69ded2ea68b4b38aedd269bb876a061/dataset_c2d243601ac64ee399a161c5c715f6eb/file_6a94896ddcd74bdfab4bb6f732bb5dd5 for rule 2997c032cd5840b584a01cb5e2142e0a
    warnings.warn(

tests/test_abacus_collection_replica.py: 2 warnings
tests/test_did.py: 2 warnings
tests/test_rule.py: 4 warnings
tests/test_abacus_rse.py: 1 warning
tests/test_abacus_account.py: 1 warning
tests/test_replica.py: 2 warnings
  /opt/venv/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
    warnings.warn(

tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2325: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(cumulated_children_subquery)

tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_per_free_volume[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2107: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(cumulated_volume_subquery)

tests/test_throttler.py::TestSimpleLimits::test_dest_per_act_fifo_release_all[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_dest_per_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_per_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_all_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestOverlappingLimits::test_source_dest_mixed_act[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2260: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(subquery)

tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_per_deadline[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2035: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(old_requests_subquery)

tests/test_bb8.py::test_bb8_full_workflow[file_config_mock{'bb8': {'allowed_accounts': 'jdoe'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/daemons/bb8/common.py:398: SADeprecationWarning: The SelectBase.as_scalar() method is deprecated and will be removed in a future release.  Please refer to SelectBase.scalar_subquery(). (deprecated since: 1.4)
    select(func.count())

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
FAILED tests/test_judge_evaluator.py::test_judge_double_container_with_existing_rule

0 replies

bari12 · 2024-04-09T11:13:54Z

bari12
Apr 9, 2024
Maintainer

Another one in Belle II VO tests

=================================== FAILURES ===================================
________________ TestCore.test_delete_rule_and_cancel_transfers ________________
[gw1] linux -- Python 3.9.18 /opt/venv/bin/python
../venv/lib64/python3.9/site-packages/sqlalchemy/engine/base.py:1985: in _exec_single_context
    result = context._setup_result_proxy()
../venv/lib64/python3.9/site-packages/sqlalchemy/engine/default.py:1798: in _setup_result_proxy
    strategy = _cursor.BufferedRowCursorFetchStrategy(
../venv/lib64/python3.9/site-packages/sqlalchemy/engine/cursor.py:1187: in __init__
    self._rowbuffer = collections.deque(dbapi_cursor.fetchmany(1))
E   psycopg2.errors.LockNotAvailable: could not obtain lock on row in relation "replicas"

The above exception was the direct cause of the following exception:
../venv/lib64/python3.9/site-packages/rucio/db/sqla/session.py:453: in new_funct
    result = function(*args, session=session, **kwargs)
../venv/lib64/python3.9/site-packages/rucio/core/rule.py:425: in add_rule
    apply_rule(did, new_rule, [x['id'] for x in rses], [x['id'] for x in source_rses], rseselector, session=session)
../venv/lib64/python3.9/site-packages/rucio/db/sqla/session.py:467: in new_funct
    result = function(*args, session=session, **kwargs)
../venv/lib64/python3.9/site-packages/rucio/core/rule_grouping.py:1380: in apply_rule
    files, replicas = rucio.core.replica.get_and_lock_file_replicas_for_dataset(scope=ds_scope, name=ds_name, nowait=True, restrict_rses=rses,
../venv/lib64/python3.9/site-packages/rucio/db/sqla/session.py:467: in new_funct
    result = function(*args, session=session, **kwargs)
../venv/lib64/python3.9/site-packages/rucio/core/replica.py:2619: in get_and_lock_file_replicas_for_dataset
    for child_scope, child_name, bytes_, md5, adler32, replica in query.yield_per(1000):
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/query.py:2833: in __iter__
    result = self._iter()
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/query.py:2847: in _iter
    result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
../venv/lib64/python3.9/site-packages/sqlalchemy/orm/session.py:2308: in execute
DEBUG    root:rule_grouping.py:1061 Creating OK Lock mock:/belle/mock/cont_0d2279bf62ce4f6d8daec24ebeff045a/dataset_b4b34f1f88654b179b9ddfa18633682b/file_b235e6de74564c35a1af86442a5be099 on 2acd55d07f5e43688139058d1d55dd90 for rule 1473212094954338bbfc48f13f309ea3
DEBUG    root:rule_grouping.py:1099 Creating ReplicaState.COPYING replica for mock:/belle/mock/cont_0d2279bf62ce4f6d8daec24ebeff045a/dataset_b4b34f1f88654b179b9ddfa18633682b/file_b235e6de74564c35a1af86442a5be099 on 628a13c8629f42b19b29fe73aa2da0f2
DEBUG    root:rule_grouping.py:1067 Creating REPLICATING Lock mock:628a13c8629f42b19b29fe73aa2da0f2 on /belle/mock/cont_0d2279bf62ce4f6d8daec24ebeff045a/dataset_b4b34f1f88654b179b9ddfa18633682b/file_b235e6de74564c35a1af86442a5be099 for rule 1473212094954338bbfc48f13f309ea3
DEBUG    root:rule_grouping.py:1061 Creating OK Lock mock:/belle/mock/cont_4d2a22816b8c4fd5ba995a9dd106f07d/dataset_de775b0edbda4b73bc80c9da65697682/file_c84acc255d24402cad4d17e7d7faca47 on 2acd55d07f5e43688139058d1d55dd90 for rule 1473212094954338bbfc48f13f309ea3
DEBUG    root:rule_grouping.py:1099 Creating ReplicaState.COPYING replica for mock:/belle/mock/cont_4d2a22816b8c4fd5ba995a9dd106f07d/dataset_de775b0edbda4b73bc80c9da65697682/file_c84acc255d24402cad4d17e7d7faca47 on 628a13c8629f42b19b29fe73aa2da0f2
DEBUG    root:rule_grouping.py:1067 Creating REPLICATING Lock mock:628a13c8629f42b19b29fe73aa2da0f2 on /belle/mock/cont_4d2a22816b8c4fd5ba995a9dd106f07d/dataset_de775b0edbda4b73bc80c9da65697682/file_c84acc255d24402cad4d17e7d7faca47 for rule 1473212094954338bbfc48f13f309ea3
DEBUG    root:rule_grouping.py:1061 Creating OK Lock mock:/belle/mock/cont_c357f73c96444059b120b30cf31881a1/dataset_bb32555997df49bf878bd99f820900b9/file_ef0962f0847e4752babb03e7e12d5c09 on 2acd55d07f5e43688139058d1d55dd90 for rule 1473212094954338bbfc48f13f309ea3
DEBUG    root:rule_grouping.py:1099 Creating ReplicaState.COPYING replica for mock:/belle/mock/cont_c357f73c96444059b120b30cf31881a1/dataset_bb32555997df49bf878bd99f820900b9/file_ef0962f0847e4752babb03e7e12d5c09 on 0c3fd1ee6610441bb98f890597837ecb
DEBUG    root:rule_grouping.py:1067 Creating REPLICATING Lock mock:0c3fd1ee6610441bb98f890597837ecb on /belle/mock/cont_c357f73c96444059b120b30cf31881a1/dataset_bb32555997df49bf878bd99f820900b9/file_ef0962f0847e4752babb03e7e12d5c09 for rule 1473212094954338bbfc48f13f309ea3
DEBUG    root:request.py:285 queue requests
INFO     root:rule.py:471 Created rule 1473212094954338bbfc48f13f309ea3 [3/3/0] with new algorithm for did mock:/belle/TYMGJW-rule-Core-delete_rule_and_cancel_transfers-/cont_856c834bce054ed9bda599116ce0eb93/dataset_0a60e602e6954c1493f24e7eae0af782 in state RuleState.REPLICATING
=============================== warnings summary ===============================
../venv/lib64/python3.9/site-packages/_pytest/config/__init__.py:735
../venv/lib64/python3.9/site-packages/_pytest/config/__init__.py:735
../venv/lib64/python3.9/site-packages/_pytest/config/__init__.py:735
../venv/lib64/python3.9/site-packages/_pytest/config/__init__.py:735
  /opt/venv/lib64/python3.9/site-packages/_pytest/config/__init__.py:735: PytestAssertRewriteWarning: Module already imported so cannot be rewritten: xdist
    self.import_plugin(arg, consider_entry_points=True)

../venv/lib64/python3.9/site-packages/magic/__init__.py:437
../venv/lib64/python3.9/site-packages/magic/__init__.py:437
../venv/lib64/python3.9/site-packages/magic/__init__.py:437
../venv/lib64/python3.9/site-packages/magic/__init__.py:437
  /opt/venv/lib64/python3.9/site-packages/magic/__init__.py:437: PendingDeprecationWarning: Using compatibility mode with libmagic's python binding. See https://github.com/ahupp/python-magic/blob/master/COMPAT.md for details.
    warnings.warn(

tests/test_abacus_collection_replica.py: 2 warnings
tests/test_rule.py: 4 warnings
tests/test_abacus_rse.py: 1 warning
tests/test_abacus_account.py: 1 warning
tests/test_did.py: 2 warnings
tests/test_replica.py: 2 warnings
  /opt/venv/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
    warnings.warn(

tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2325: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(cumulated_children_subquery)

tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_grouped_fifo_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_per_free_volume[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2107: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(cumulated_volume_subquery)

tests/test_throttler.py::TestSimpleLimits::test_dest_per_act_fifo_release_all[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_dest_per_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_per_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_source_all_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestSimpleLimits::test_dest_all_act_fifo_release_subset[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestOverlappingLimits::test_source_dest_mixed_act[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2260: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(subquery)

tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_grouped_fifo[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
tests/test_throttler.py::TestRequestCoreRelease::test_release_waiting_requests_per_deadline[file_config_mock{'conveyor': {'use_preparer': 'true'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/core/request.py:2035: SAWarning: Coercing Subquery object into a select() for use in IN(); please pass a select() construct explicitly
    models.Request.id.in_(old_requests_subquery)

tests/test_bb8.py::test_bb8_full_workflow[file_config_mock{'bb8': {'allowed_accounts': 'jdoe'}}]
  /opt/venv/lib64/python3.9/site-packages/rucio/daemons/bb8/common.py:398: SADeprecationWarning: The SelectBase.as_scalar() method is deprecated and will be removed in a future release.  Please refer to SelectBase.scalar_subquery(). (deprecated since: 1.4)
    select(func.count())

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Discussion on Flaky Tests #6546

{{title}}

Replies: 6 comments

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Discussion on Flaky Tests #6546

maany Mar 12, 2024 Collaborator

Replies: 6 comments

rdimaio Mar 12, 2024 Collaborator

jamesp-epcc Mar 12, 2024 Collaborator

bari12 Mar 19, 2024 Maintainer

bari12 Mar 21, 2024 Maintainer

bari12 Apr 9, 2024 Maintainer

bari12 Apr 9, 2024 Maintainer

maany
Mar 12, 2024
Collaborator

rdimaio
Mar 12, 2024
Collaborator

jamesp-epcc
Mar 12, 2024
Collaborator

bari12
Mar 19, 2024
Maintainer

bari12
Mar 21, 2024
Maintainer

bari12
Apr 9, 2024
Maintainer

bari12
Apr 9, 2024
Maintainer