node is either not visible or not an HTMLElement / GetAttributes: rpc error: Could not find node with given id

[PierreBrisorgueil]

Hey, i found a strange behavior during my test for : #547

I may have misunderstood something.

node is either not visible or not an HTMLElement

LET doc = DOCUMENT('https://soundcloud.com/charts/top', { driver: "cdp" })

WAIT_ELEMENT(doc, '.chartTrack', 5000)

LET result = (
    FOR page IN PAGINATION(doc, '.loading')
        LIMIT 10
            SCROLL_ELEMENT(doc, '.loading')
            WAIT(1000)
            RETURN ""
)

LET tracks = ELEMENTS(doc, '.chartTrack')

FOR track IN tracks
    SCROLL_ELEMENT(track)
    WAIT(2000)
    CLICK(track, '.chartTrack__artworkPlayButton')
    WAIT(2000)
    RETURN {
        artist: TRIM(INNER_TEXT(track, '.chartTrack__details .chartTrack__username')),
        track: TRIM(INNER_TEXT(track, '.chartTrack__details .chartTrack__title'))
    }

GetAttributes: rpc error: Could not find node with given id
obtained on another site in the same way, load a list, then browse the elements, and click on it until you get to the invisible one. Discord Mp for example. Probably linked to #80

[ziflex]

Hey, thanks for reporting the issue!
Could you tell at what line are you getting the error?

[PierreBrisorgueil]

Failed to execute the query
node is either not visible or not an HTMLElement: CLICK(track,'.chartTrack__artworkPlayButton') at 18:4: FORtrackINtracksSCROLL_ELEMENT(track)WAIT(2000)CLICK(track,'.chartTrack__artworkPlayButton')WAIT(2000)RETURN{artist:TRIM(INNER_TEXT(track,'.chartTrack__details .chartTrack__username')),track:TRIM(INNER_TEXT(track,'.chartTrack__details .chartTrack__title'))} at 15:0

[ziflex]

You can use DO-WHILE loop to pre-load the entire page:

LET doc = DOCUMENT('https://soundcloud.com/charts/top', { driver: "cdp" })

LET endSelector = ''
LET listSelector = '.chartTracks ul'

WAIT_ELEMENT(doc, listSelector)

LET list = ELEMENT(doc, listSelector)
LET initialCount = ELEMENTS_COUNT(list, 'li')
LET lastItem = 50

LET preload = (
    FOR i DO WHILE !ELEMENT_EXISTS(doc, '.chartTracksEnd')
        LET initial = i > 0 ? SCROLL_BOTTOM(doc) && WAIT(500) && SCROLL_TOP(doc) && false : true

        RETURN NONE
)

WAIT_ELEMENT(list, FMT('li:nth-child({})', lastItem))

FOR track, i IN ELEMENTS(list, 'li')
    RETURN {
        num: i + 1,
        artist: TRIM(INNER_TEXT(track, '.chartTrack__details .chartTrack__username')),
        track: TRIM(INNER_TEXT(track, '.chartTrack__details .chartTrack__title'))
    }