Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in Pipeline execution: [OETLPipeline] 2024-01-08 12:38:55:086 SEVER ETL process has problem: [OETLProcessor] 2024-01-08 12:38:55:088 INFO END ETL PROCESSOR [OETLProcessor] #10055

Open
bartoalheiros opened this issue Jan 8, 2024 · 0 comments
Milestone

Comments

@bartoalheiros
Copy link

bartoalheiros commented Jan 8, 2024

Hi, everyone! I'm trying to upload a dataset on an OrientDB Instance. It has 41456 rows, but in such a time for uploading, I'm facing this error:

2024-01-08 12:38:50:573 INFO  Windows OS is detected, 262144 limit of open files will be set for the disk cache. [ONative]
2024-01-08 12:38:50:937 INFO  12836626432 B/12241 MB/11 GB of physical memory were detected on machine [ONative]
2024-01-08 12:38:50:937 INFO  Detected memory limit for current process is 12836626432 B/12241 MB/11 GB [ONative]
2024-01-08 12:38:50:938 INFO  JVM can use maximum 455MB of heap memory [OMemoryAndLocalPaginatedEnginesInitializer]
2024-01-08 12:38:50:939 INFO  Because OrientDB is running outside a container 2g of memory will be left unallocated according to the setting 'memory.leftToOS' not taking into account heap memory [OMemoryAndLocalPaginatedEnginesInitializer]
2024-01-08 12:38:50:940 INFO  OrientDB auto-config DISKCACHE=9,738MB (heap=455MB os=12,241MB) [orientechnologies]
2024-01-08 12:38:50:941 INFO  System is started under an effective user : `BartoAlheiros` [OEngineLocalPaginated]
2024-01-08 12:38:51:104 INFO  WAL maximum segment size is set to 7,202 MB [OrientDBEmbedded]
2024-01-08 12:38:51:643 INFO  Page size for WAL located in H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases\inep24 is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-01-08 12:38:51:833 INFO  DWL:inep24: block size = 4096 bytes, maximum segment size = 7202 MB [DoubleWriteLogGL]
2024-01-08 12:38:52:034 INFO  Storage 'plocal:H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases/inep24' is opened under OrientDB distribution : 3.2.19 (build c652e539f26ddbc167c93d4921c43993f3c6538c, branch UNKNOWN) [OLocalPaginatedStorage]
2024-01-08 12:38:52:298 INFO  Page size for WAL located in H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases\OSystem is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-01-08 12:38:52:370 INFO  {db=inep24} DWL:OSystem: block size = 4096 bytes, maximum segment size = 7202 MB [DoubleWriteLogGL]
2024-01-08 12:38:52:436 INFO  Storage 'plocal:H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases/OSystem' is opened under OrientDB distribution : 3.2.19 (build c652e539f26ddbc167c93d4921c43993f3c6538c, branch UNKNOWN) [OLocalPaginatedStorage]
2024-01-08 12:38:52:634 INFO  BEGIN ETL PROCESSOR [OETLProcessor]
2024-01-08 12:38:52:647 INFO  [file] Reading from file H:\microdados_censo_da_educacao_superior_2021\Microdados do Censo da Educação Superior 2021\dados\NordesteCursos.csv with encoding UTF-8 [OETLFileSource]

**2024-01-08 12:38:52:648 INFO  Started execution with 1 worker threads [OETLProcessor]
2024-01-08 12:38:53:648 INFO  + extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 1013ms [0 warnings, 0 errors] [OETLProcessor]
2024-01-08 12:38:54:655 INFO  + extracted 56 rows (55 rows/sec) - 56 rows -> loaded 56 vertices (55 vertices/sec) Total time: 2020ms [0 warnings, 0 errors] [OETLProcessor]
2024-01-08 12:38:55:085 SEVER {db=inep24} Error in Pipeline execution: [OETLPipeline]
2024-01-08 12:38:55:086 SEVER ETL process has problem:  [OETLProcessor]
2024-01-08 12:38:55:089 INFO  END ETL PROCESSOR [OETLProcessor]
2024-01-08 12:38:55:089 INFO  + extracted 388 rows (763 rows/sec) - 388 rows -> loaded 380 vertices (744 vertices/sec) Total time: 2455ms [0 warnings, 1 errors] [OETLProcessor]
2024-01-08 12:38:55:092 INFO  - shutdown storage: OSystem ... [OrientDBEmbedded]
2024-01-08 12:38:55:504 INFO  - shutdown storage: inep24 ... [OrientDBEmbedded]**

Does have someone any ideia why I'm seeying this error?

Any response would be very helpful.

Thank to you all, Happy New Year, friends!

@tglman tglman added this to the 3.2.x milestone Jan 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants