MUMPS required

[nawijn]

Dear all,

I am trying to run the implicit springback example, but get the following error message:

 ROOT: DBEND_44  RESTART: 0002
 NUMBER OF HMPP PROCESSES     1
 18/09/2022
 NC=       0 T= 9.6002E+02 DT= 8.0000E-02 ERR=  0.0% DM/M= 0.0000E+00
        8563 Fatal error: MUMPS required

     ERROR TERMINATION

I do however have MUMPS installed (both the standard and the openmpi version) and as far as I can tell the MUMPS libraries are on the dynamic linker path (so either in /usr/lib64 or in /usr/lib64/openmpi/lib).

If I am correct the starter/engine executables do not directly link to the MUMPS library so I am a bit lost on how to debug this further.

Any suggestions?

For the record, I am running OpenRadioss on a laptop running Fedora 36 workstation.

Kind regards,

Marco

l

[ehan08]

The instructions on how to build with the MUMPS static libs are available in
engine/CMake_Compilers/cmake_linux64_gf.txt

[laurent-altr]

Hi @nawijn,

We cannot use MUMPS with OpenRadioss yet: The binary we deliver are not linked with MUMPS.

Thank you,
Laurent

[dariodag83]

Hi @laurent-altr , in future, will OpenRADIOSS binary be delivered with MUMPS link?
Thanks in advance

[ehan08]

follow the instructions in engine/CMake_Compilers/cmake_linux64_gf.txt to compile all 3rd party utilities,
gcc/gfortran 9.3.1 + openmpi 4.1.4 with -prec=dp -static-link
-DWITH_LINEAR_ALGEBRA and some minor changes to the source files

The executable works for Implicit_spring-back with -np 4

For step 2:

• IMPLICIT COMPUTATION TERMINATED WITH TOTAL NONLINEAR ITERATIONS: 531
• TOTAL NUM. OF MATRIX FACTORIZATION AND PCG ITERATION: 0 264444

Why "TOTAL NUM. OF MATRIX FACTORIZATION" is "0"?

[elequiniou]

This example is using the iterative solver (PCG : preconditioned conjugate gradient) and not direct solver, so no factorization but iteration number.

[senpaibernd]

Is it possible to get a static linked version with mumps solver? I get different compiler errors on different systems when I follow the instructions in the cmake text file (version without MPI). I think it would be a good idea to include the implicit solver in general.

[senpaibernd]

That sounds great!

[senpaibernd]

I tried the additional arguments in the buildscript (I also noticed the changes in the file cmake_linux64_gf.txt): The dependent libraries (lapack, scalapack) compile without errors, but when compiling the engine I still get the same error.

[senpaibernd]

To get an idea what i did exactly, here is my step-by-step instruction:

Install WSL 2
Install Ubuntu 20 (22 with GCC 10 prodces a fortran compiler error which I cannot avoided at the moment)
Install packages:
   sudo apt-get update
   sudo apt-get upgrade
   sudo apt-get install build-essential gfortran cmake perl
   sudo apt-get install openmpi-bin libopenmpi-dev

wget https://download.open-mpi.org/release/open-mpi/v4.1/openmpi-4.1.2.tar.gz
tar -xvzf openmpi-4.1.2.tar.gz
cd openmpi-4.1.2
sudo ./configure --prefix=/opt/openmpi
sudo make
sudo make install

Download ZIP RADIOSS from https://github.com/OpenRadioss/OpenRadioss and unzip (or git clone)

Now, build engine with MUMPS and OpenMPI:
Create and enter the directory OpenRadioss/extlib/mumps
Download packages:
wget https://github.com/Reference-LAPACK/lapack/archive/refs/tags/v3.10.1.tar.gz
wget https://github.com/Reference-ScaLAPACK/scalapack/archive/refs/tags/v2.2.0.tar.gz
wget http://ftp.mcs.anl.gov/pub/petsc/externalpackages/MUMPS_5.5.1.tar.gz
Extract:
tar -xvzf (all packages)
Build:
lapack-dir:
make.inc.example --> make.inc
--> make
scalapack-dir:
SLmake.inc.example --> SLmake.inc
Modify:
BLASLIB       = /home/blind/OpenRadioss-main/extlib/mumps/lapack-3.10.1/librefblas.a
LAPACKLIB     = /home/blind/OpenRadioss-main/extlib/mumps/lapack-3.10.1/liblapack.a
--> make
mumps:
sudo apt-get install libmetis-dev libparmetis-dev libscotch-dev libptscotch-dev libatlas-base-dev openmpi-bin libopenmpi-dev liblapack-dev
Makefile.debian.PAR --> Makefile.inc
Modify:
LAPACK = /home/blind/OpenRadioss-main/extlib/mumps/lapack-3.10.1/liblapack.a
SCALAP  = /home/blind/OpenRadioss-main/extlib/mumps/scalapack-2.2.0/libscalapack.a /home/blind/OpenRadioss-main/extlib/mumps/lapack-3.10.1/librefblas.a
--> make

ENGINE:
Check before:
path_to_mumps/lib/libdmumps.a must exist
path_to_scalapack/libscalapack.a must exist
path_to_lapack/liblapack.a must exist
./build_script.sh -arch=linux64_gf -mpi=ompi –prec=dp –static-link -mumps_root=/home/blind/OpenRadioss-main/extlib/mumps/MUMPS_5.5.1 -scalapack_root=/home/blind/OpenRadioss-main/extlib/mumps/scalapack-2.2.0 -lapack_root=/home/blind/OpenRadioss-main/extlib/mumps/lapack-3.10.1

[laurent-altr]

Hi,
Is this still the error concerning Scotch?

If you want to build MUMPS with Scotch (or Metis/Parmetis) you also need to install those libraries: follow the instructions provided in the Makefile.inc provided by MUMPS (see#Begin orderings / #End orderings).

Note that these libraries are not mandatory: you can comment out references to Scotch, Metis etc. and keep only PORD (the default ordering method embedded with Mumps taht is working well for Radioss:

ORDERINGSF  = -Dpord
ORDERINGSC  = $(ORDERINGSF)
LORDERINGS = $(LPORD)
IORDERINGSC = $(IPORD)

[senpaibernd]

Great hint...i did not know that!
That was the missing, now it works!
Thanks!

[olosim]

Hi everyone

Thank you for posting all your hints. I've also got implicit working. Here are all the commands I used with Ubuntu-20.04, so that inexperienced Linux users can also get implicit working:

OpenRadioss Install Notes:
==========================
Date:   19 Aug 2023

Currently in order to be able to solve with implicit time integration one needs to compile OpenRadioss
with an implicit solver such as MUMPS. 

Install under Ubuntu-20.04:
---------------------------

# Install Packages:
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install build-essential gfortran cmake perl
sudo apt-get install openmpi-bin libopenmpi-dev
sudo apt-get install python3 python-is-python3 git-lfs
sudo apt-get install libatlas-base-dev liblapack-dev

# Install MPI:
cd /usr/local/
sudo su
wget https://download.open-mpi.org/release/open-mpi/v4.1/openmpi-4.1.2.tar.gz
tar -xvzf openmpi-4.1.2.tar.gz
cd openmpi-4.1.2
./configure --prefix=/opt/openmpi
make
make install

# Download OpenRadioss
cd /usr/local/
sudo su
wget https://github.com/OpenRadioss/OpenRadioss/archive/refs/tags/latest-20230728.tar.gz
tar -xvzf latest-20230728.tar.gz
cd OpenRadioss-latest-20230728 
cd extlib
mkdir mumps
cd mumps
wget https://github.com/Reference-LAPACK/lapack/archive/refs/tags/v3.10.1.tar.gz
wget https://github.com/Reference-ScaLAPACK/scalapack/archive/refs/tags/v2.2.0.tar.gz
wget http://ftp.mcs.anl.gov/pub/petsc/externalpackages/MUMPS_5.5.1.tar.gz
tar -xvzf v2.2.0.tar.gz 
tar -xvzf v3.10.1.tar.gz
tar -xvzf MUMPS_5.5.1.tar.gz
# Make LAPACK
cd lapack-3.10.1
mv make.inc.example make.inc
make
# Make SCALAPACK
cd /usr/local/OpenRadioss-latest-20230728/extlib/mumps
cd scalapack-2.2.0
mv SLmake.inc.example SLmake.inc
# Modify the following lines in SLmake.inc:
FC = /opt/openmpi/bin/mpif90
BLASLIB       = /usr/local/OpenRadioss-latest-20230728/extlib/mumps/lapack-3.10.1/librefblas.a
LAPACKLIB     = /usr/local/OpenRadioss-latest-20230728/extlib/mumps/lapack-3.10.1/liblapack.a
make
## Make MUMPS:
cd /usr/local/OpenRadioss-latest-20230728/extlib/mumps
cd MUMPS_5.5.1
cp Make.inc/Makefile.debian.PAR Makefile.inc
# Modify lines in Makefile.inc to the following:
ORDERINGSF  = -Dpord
ORDERINGSC  = $(ORDERINGSF)
LORDERINGS = $(LPORD)
IORDERINGSC = $(IPORD)
LAPACK = /usr/local/OpenRadioss-latest-20230728/extlib/mumps/lapack-3.10.1/liblapack.a
SCALAP = /usr/local/OpenRadioss-latest-20230728/extlib/mumps/scalapack-2.2.0/libscalapack.a /usr/local/OpenRadioss-latest-20230728/extlib/mumps/lapack-3.10.1/librefblas.a
make
## Build Engine:
# Following files must exist:
/usr/local/OpenRadioss-latest-20230728/extlib/mumps/MUMPS_5.5.1/lib/libdmumps.a
/usr/local/OpenRadioss-latest-20230728/extlib/mumps/scalapack-2.2.0/libscalapack.a
/usr/local/OpenRadioss-latest-20230728/extlib/mumps/lapack-3.10.1/liblapack.a
# Modify engine/build_script.sh by adding -DWITH_LINEAR_ALGEBRA=1 to the cmake command line arguments
# Modify engine/CMake_Compilers/cmake_linux64_gf.txt:
# 1. Remove -Dmentis flag
# 2. Change -Werror=array-bounds to -Warray-bounds

cd /usr/local/OpenRadioss-latest-20230728/engine
./build_script.sh -arch=linux64_gf -mpi=ompi -prec=dp -static-link -mumps_root=
/usr/local/OpenRadioss-latest-20230728/extlib/mumps/MUMPS_5.5.1 -scalapack_root=
/usr/local/OpenRadioss-latest-20230728/extlib/mumps/scalapack-2.2.0 -lapack_root=/usr/local/OpenRadioss-latest-20230728/extlib/mumps/lapack-3.10.1

## Build Starter:
# Modify starter/CMake_Compilers/cmake_linux64_gf.txt from -Werror=array-bounds to -Warray-bounds
cd /usr/local/OpenRadioss-latest-20230728/starter
./build_script.sh -arch=linux64_gf

## Install the OpenRadioss Job Submition GUI and create a desktop icon:
https://openradioss.atlassian.net/wiki/spaces/OPENRADIOSS/pages/58785793/Latest+gui+scripts
wget https://openradioss.atlassian.net/wiki/download/attachments/58785793/linux_scripts_mk3.tar.gz
tar -xvzf linux_scripts_mk3.tar.gz 
sudo apt-get install python3-tk

## Install the anim_to_vtk converter
cd /usr/local/OpenRadioss-latest-20230728/tools/anim_to_vtk/linux64
./build.bash

## Install the th_to_csv converter
cd /usr/local/OpenRadioss-latest-20230728/tools/th_to_csv/linux64
./build.bash

## Check if the implicit solver works:
cd /home/UserName/Documents
wget https://openradioss.atlassian.net/wiki/download/attachments/9502721/SpringBack.zip
unzip SpringBack.zip
cd /usr/local/OpenRadioss-latest-20230728/linux_scripts_mk3
python3 openradioss_run_script_for_linux_mpi_ps.py
# After the GUI opens select the following file:
/home/userName/Documents/Implicit_spring-back/DBEND_44_000.rad
# Enter 2 for -np and check the box anim to vtk and the box th to csv and click on the Add Job button.

[debugMake]

Hi,I got difficult compile errors about mumps when I followed your instruction. Somebody can help me?

cd src; make d
make[1]: Entering directory '/mnt/c/Users/LENOVO/OpenRadioss/OpenRadioss-latest-20230705/OpenRadioss-latest-20230705/extlib/mumps/MUMPS_5.5.1/src'
make ../lib/libmumps_common.a
make[2]: Entering directory '/mnt/c/Users/LENOVO/OpenRadioss/OpenRadioss-latest-20230705/OpenRadioss-latest-20230705/extlib/mumps/MUMPS_5.5.1/src'
mpif90 -O -fopenmp  -I. -I../include  -I/usr/include/scotch -Dpord -c ana_omp_m.F -o ana_omp_m.o
ana_omp_m.F:789:42:

  789 |         CALL MUMPS_QUICK_SORT_PHYS_L0( N, STEP(1), PHYS_L0_OMP(1),
      |                                          1
Error: Element of assumed-shape or pointer array passed to array dummy argument ‘step’ at (1)
ana_omp_m.F:789:51:

  789 |         CALL MUMPS_QUICK_SORT_PHYS_L0( N, STEP(1), PHYS_L0_OMP(1),
      |                                                   1
Error: Element of assumed-shape or pointer array passed to array dummy argument ‘intlist’ at (1)
ana_omp_m.F:837:43:

  837 |         CALL MUMPS_QUICK_SORT_IPOOL_PO( N, STEP(1),
      |                                           1
Error: Element of assumed-shape or pointer array passed to array dummy argument ‘step’ at (1)
ana_omp_m.F:838:18:

  838 |      &            IPOOL_A_L0_OMP(1), LEAF, 1, LEAF )
      |                  1
Error: Element of assumed-shape or pointer array passed to array dummy argument ‘intlist’ at (1)
make[2]: *** [Makefile:437: ana_omp_m.o] Error 1
make[2]: Leaving directory '/mnt/c/Users/LENOVO/OpenRadioss/OpenRadioss-latest-20230705/OpenRadioss-latest-20230705/extlib/mumps/MUMPS_5.5.1/src'
make[1]: *** [Makefile:17: libcommon] Error 2
make[1]: Leaving directory '/mnt/c/Users/LENOVO/OpenRadioss/OpenRadioss-latest-20230705/OpenRadioss-latest-20230705/extlib/mumps/MUMPS_5.5.1/src'
make: *** [Makefile:23: d] Error 2

[laurent-altr]

Hello @debugMake,

Recent versions of GCC/Fortran have transformed some warnings into errors, you may need to add the compiler option: -fallow-argument-mismatch in the Makefile.inc

Here is the script I use to download and build MUMPS with GCC11

Laurent

[debugMake]

Wow...amazing! It works well. Thanks~

[albenstein]

I'm following your steps, but I get error on engine compiling step like:

[100%] Linking Fortran executable engine_linux64_gf_ompi
/usr/bin/ld: cannot find -lgfortran
collect2: error: ld returned 1 exit status
make[2]: *** [CMakeFiles/engine_linux64_gf_ompi.dir/build.make:51362: engine_linux64_gf_ompi] Error 1
make[1]: *** [CMakeFiles/Makefile2:83: CMakeFiles/engine_linux64_gf_ompi.dir/all] Error 2
make: *** [Makefile:136: all] Error 2

[debugMake]

Hi everyone!
Is it possible to build for implicit solving for native Windows version? I'm using OneAPI to build OpenRadioss and link MUMPS. I tried to replace LAPACK and SCALAPACK library with MKL library. But I got link error....

mumps_common.lib(mumps_io_err.c.obj) : error LNK2019: 无法解析的外部符号 __imp_strdup，函数 mumps_io_sys_error 中引用了该符号
oldnames.lib(strdup.obi) : error LNK2001: 无法解析的外部符号 __imp_strdup
mumps_common.lib(mumps_io_basic.c.obj) : error LNK2019: 无法解析的外部符号 __imp_ferror，函数 mumps_io_do_write_block 中引用了该符号
oldnames.lib(strdup.obi) : error LNK2001: 无法解析的外部符号 __imp__strdup
engine_win64_impi.exe : fatal error LNK1120: 3 个无法解析的外部命令
ninja: build stopped: subcommand failed.

Any suggestions?
Best regards

[elequiniou]

Hi,
In practice, it should be doable once the MUMPS library is compiled to add it to link under Visual Studio for native Windows version, but this has not been tested yet and may require some further adjustments.
As an alternative, the workaround remains to use WSL2, please have a look to this other thread: https://github.com/orgs/OpenRadioss/discussions/1705

Best Regards,

Eric

[falinu]

Hi everyone!
I am trying to compile an implicit solver of version 20231118 in a WLS2 environment.
I compiled MUMPS, SCALAPACK, and LAPACK using this thread as a reference.
When compiling the engine, it stops with the following error. Does anyone know a solution?

/usr/local/OpenRadioss-latest-20231117/engine/source/implicit/imp_lanz.F:44:57:

   44 |      5                    SHIFT ,KCOND ,N_MAX ,FLM   ,F_X    ,
      |                                                         1
Error: Unused dummy argument ‘f_x’ at (1) [-Werror=unused-dummy-argument]
/usr/local/OpenRadioss-latest-20231117/engine/source/implicit/imp_lanz.F:51:54:

   51 |      H                    XI_C  ,R0    ,NDDLI_G,INTP_C,IRBE3  ,
      |                                                      1
Error: Unused dummy argument ‘intp_c’ at (1) [-Werror=unused-dummy-argument]
/usr/local/OpenRadioss-latest-20231117/engine/source/implicit/imp_lanz.F:51:47:

   51 |      H                    XI_C  ,R0    ,NDDLI_G,INTP_C,IRBE3  ,
      |                                               1
Error: Unused dummy argument ‘nddli_g’ at (1) [-Werror=unused-dummy-argument]
/usr/local/OpenRadioss-latest-20231117/engine/source/implicit/imp_lanz.F:39:36:

   39 |      1                    N     ,NNZ   ,IADK  ,JDIK  ,DIAG_K ,
      |                                    1
Error: Unused dummy argument ‘nnz’ at (1) [-Werror=unused-dummy-argument]
/usr/local/OpenRadioss-latest-20231117/engine/source/implicit/imp_lanz.F:51:35:

   51 |      H                    XI_C  ,R0    ,NDDLI_G,INTP_C,IRBE3  ,
      |                                   1
Error: Unused dummy argument ‘r0’ at (1) [-Werror=unused-dummy-argument]
f951: some warnings being treated as errors
make[2]: *** [CMakeFiles/engine_linux64_gf_ompi.dir/build.make:18780: CMakeFiles/engine_linux64_gf_ompi.dir/source/implicit/imp_lanz.F.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:83: CMakeFiles/engine_linux64_gf_ompi.dir/all] Error 2
make: *** [Makefile:136: all] Error 2

[falinu]

I tried several compilations and could not perform the implicit analysis except for one method.
WLS2 + ubuntu20.04 + gfortran >
　　　　Compile + Slove implicit analysis is OK
WLS2 + ubuntu22.04 + gfortran >
　　　 　Compile OK(Use"-Wunused-dummy-argument") ,But Slove implicit analysis is failure.
WLS2 + ubuntu22.04 + intel fortran2023.2 >
　　　　 Compile OK ,But Slove implicit Analysis is failure.

Report messages on failure.

************************************************************************
**                                                                    **
**                                                                    **
**                         OpenRadioss Engine                         **
**                                                                    **
**            Non-linear Finite Element Analysis Software             **
**                                                                    **
**                                                                    **
**                                                                    **
**              Linux 64 bits, Intel compiler, Intel MPI              **
**                                                                    **
**                                                                    **
**                                                                    **
**                                                                    **
************************************************************************
** OpenRadioss Software                                               **
** COPYRIGHT (C) 1986-2023 Altair Engineering, Inc.                   **
** Licensed under GNU Affero General Public License.                  **
** See License file.                                                  **
************************************************************************

 ROOT: data_cal  RESTART: 0001
 NUMBER OF HMPP PROCESSES     2
 23/11/2023

MESSAGE ID :         44

 ** ERROR: ABNORMAL END
      +=============================================================+
      |          Segmentation Violation                             |
      +=============================================================+
      | TRACE BACK:                                                |
     ERROR TERMINATION
Abort(3) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 3) - process 0

Use -notrap

************************************************************************
**                                                                    **`
**                                                                    **
**                         OpenRadioss Engine                         **
**                                                                    **
**            Non-linear Finite Element Analysis Software             **
**                                                                    **
**                                                                    **
**                                                                    **
**              Linux 64 bits, Intel compiler, Intel MPI              **
**                                                                    **
**                                                                    **
**                                                                    **
**                                                                    **
************************************************************************
** OpenRadioss Software                                               **
** COPYRIGHT (C) 1986-2023 Altair Engineering, Inc.                   **
** Licensed under GNU Affero General Public License.                  **
** See License file.                                                  **
************************************************************************

 ROOT: data_cal  RESTART: 0001
 NUMBER OF HMPP PROCESSES     2
 23/11/2023
forrtl: severe (174): SIGSEGV, segmentation fault occurred
Image              PC                Routine            Line        Source
libc.so.6          00007F9CED01A520  Unknown               Unknown  Unknown
engine_linux64_in  00000000048134C0  Unknown               Unknown  Unknown
engine_linux64_in  00000000017A8B13  resol                    8213  resol.F
engine_linux64_in  000000000180D004  resol_.t81596p.t8           0  resol_head.F
engine_linux64_in  0000000001809E2F  resol_head                189  resol_head.F
engine_linux64_in  000000000174C9E0  resol_head_.t1036           0  radioss2.F
engine_linux64_in  0000000001749329  radioss2                 2219  radioss2.F
engine_linux64_in  000000000172CEFB  radioss2_.t1183p.           0  radioss0.F
engine_linux64_in  000000000172CC5A  radioss0                   93  radioss0.F
engine_linux64_in  000000000172C5CB  radioss0_.void              0  radioss.F
engine_linux64_in  000000000172C5AB  radioss                    30  radioss.F
engine_linux64_in  000000000051889D  Unknown               Unknown  Unknown
libc.so.6          00007F9CED001D90  Unknown               Unknown  Unknown
libc.so.6          00007F9CED001E40  __libc_start_main     Unknown  Unknown
engine_linux64_in  00000000005187B5  Unknown               Unknown  Unknown
``

[Schwoertzig]

Hi @falinu ,
there may be a memory corruption which has not the same effect depending on the used compiler. This segmentation fault must be investigated. Could you provide the exact line from your source file resol.F:8213 ? Could you share the input file ?

[falinu]

Hi @Schwoertzig
The source files have not been changed.
I am not understand of lines in "resol.f" that are problematic.
Use source is latest-20231122

And send my Input set.
data_cal_0000.zip

[falinu]

I research revealed the following.
Forgive me if my English might be strange.

The results of using gdb to investigate input values,
The problem was that [MUMPS_PAR] was not initialized and going to the next step.
Initialization was being done at the following location,
but was moving to the next step even though the IF statement was satisfied.
IMPL_S=1
NEIG＝0

      IF (IMPL_S==1.OR.NEIG>0) THEN
#if defined(MYREAL8) && !defined(WITHOUT_LINALG)
         ALLOCATE (ELBUF_IMP(NGROUP))
         CALL ALLOC_ELBUF_IMP(ELBUF_TAB,ELBUF_IMP,NGROUP, IPARG)  
          IF (IMON>0) CALL STARTIME(34,1)
          IF (IMON>0) CALL STARTIME(31,1)
          L1 = 1+NIXS*NUMELS + NSVOIS*NIXS
          L2 = L1+6*NUMELS10
          L3 = L2+12*NUMELS20
          CALL IMP_SOL_INIT(
     1    GEO       ,NPBY      ,LPBY      ,ITAB      ,
     2    IPARI     ,IXS       ,IXQ       ,IXC       ,IXT       ,
     4    IXP       ,IXR       ,IXTG      ,IXTG1     ,IXS(L1)   ,
     5    IXS(L2)   ,IXS(L3)   ,IPARG     ,     
     6    ELBUF     ,NINT7     ,NBINTC    ,X         ,DMCP      ,
     7    FR_ELEM   ,IAD_ELEM  ,FR_I2M    ,IAD_I2M   ,
     8    NPRW      ,NUM_IMP1  ,NUM_IMPL  ,MONVOL    ,IGRSURF   ,
     9    FR_MV     ,IPM       ,IGEO      ,IAD_RBY   ,
     A    FR_RBY    ,SH4TREE   ,SH3TREE   ,IRBE3     ,LRBE3     ,
     B    FR_RBE3M  ,IAD_RBE3M ,IRBE2     ,LRBE2     ,IBFV      ,
     C    VEL       ,ELBUF_TAB ,IFRAME    ,INTBUF_TAB,
     D    NDDL0     ,NNZK0     ,IMPBUF_TAB)
          IF (IMON>0) CALL STOPTIME(31,1)
          IF (IMON>0) CALL STOPTIME(34,1)
C        
            NS_IMP=>IMPBUF_TAB%CAND_N 
            NE_IMP=>IMPBUF_TAB%CAND_E 
           IND_IMP=>IMPBUF_TAB%INDSUBT
               X_A=>X
                   FEXT_IMP=>IMPBUF_TAB%AC
                   R_IMP=>IMPBUF_TAB%R_IMP
           ALLOCATE(FAC_K(0), IPIV_K(0))
         IF (IMUMPSV >0.OR.(ISOLV==7.AND.NSPMD>1)) THEN
#if defined(MUMPS5) 
          CALL SPMD_MUMPS_INI(MUMPS_PAR, 1)
#else
          WRITE(6,*) __LINE__,"Fatal error: MUMPS required"
          CALL FLUSH(6)
          CALL ARRET(5)
#endif

OpenRadioss/engine/source/engine/resol.F

Line 2724 in ac4657c

IF (IMPL_S==1.OR.NEIG>0) THEN

Therefore, we determined that the necessary defines were not done at build time.

My understanding is that the following three things must be defined in order to use MUMPS.
1, MYREAL8
2, WITHOUT_LINALG
3, MUMPS5

There are two problems with "CMake_Compilers/cmake_linux64_intel.txt".

The problem1
Line 31 comes before line 101.

OpenRadioss/engine/CMake_Compilers/cmake_linux64_intel.txt

Line 31 in ac4657c

if ( NOT DEFINED WITH_LINEAR_ALGEBRA)

OpenRadioss/engine/CMake_Compilers/cmake_linux64_intel.txt

Line 101 in ac4657c

set(WITH_LINEAR_ALGEBRA "yes")

The problem2
flags are mixed up.（It is case-sensitive in cmake.）
mumps_flag
MUMPS_flags

OpenRadioss/engine/CMake_Compilers/cmake_linux64_intel.txt

Line 96 in ac4657c

set(mumps_flag "-Dpord -Dthr_all -DMUMPS5 -DAdd_")

OpenRadioss/engine/CMake_Compilers/cmake_linux64_intel.txt

Line 107 in ac4657c

set_source_files_properties( ${source_files} PROPERTIES COMPILE_FLAGS " ${opt_flag} ${precision_flag} ${Fortran} ${mpi_flag} ${MUMPS_flags} ${cppmach} ${cpprel}" )

Fixed two problems.
And Syntax could not be determined, so I did the following.

# Single / Double Precision
# -------------------------
#if (precision STREQUAL "sp")
#  set (precision_flag "-DMYREAL4")
#else (precision STREQUAL "sp")
  set (precision_flag "-DMYREAL8")
#endif (precision STREQUAL "sp")

I made three changes and compiled it, and it worked.
If possible, I would like to fix cmake_linux64_intel.txt, but who should I report it to?

[albenstein]

I'm following your steps, but I get error on engine compiling step like:

[100%] Linking Fortran executable engine_linux64_gf_ompi
/usr/bin/ld: cannot find -lgfortran
collect2: error: ld returned 1 exit status
make[2]: *** [CMakeFiles/engine_linux64_gf_ompi.dir/build.make:51362: engine_linux64_gf_ompi] Error 1
make[1]: *** [CMakeFiles/Makefile2:83: CMakeFiles/engine_linux64_gf_ompi.dir/all] Error 2
make: *** [Makefile:136: all] Error 2

[falinu]

I didn't ask because I expected you to tell me eventually, but next time, it is easier to get an answer if you mention the OS and compiler version in the first question.

Also, if there is an error in the MUMPS build, there is no point in going on without resolving that.

Rocky 8.9 is a relatively new OS, is GCC default 8.9?

I would like to try to create an environment, but are there any restrictions on the GCC version?

[albenstein]

On Rocky 8.9, default GCC is 8.5.0. You can run "yum install gcc gcc-gfortran".

[falinu]

Thank you.

[falinu]

I built in the following environment.
OS : Rocky Linux8.9
GCC : 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)

I confirm the build and analysis run and report back.

OpenRadioss Install Notes:
==========================
Date:   18 Jan 2024

Currently in order to be able to solve with implicit time integration one needs to compile OpenRadioss
with an implicit solver such as MUMPS. 

Install under Rocky Linux8.9
---------------------------

# Install Packages:
     sudo dnf update
     sudo dnf install gcc gcc-gfortran gcc-c++
     sudo dnf install make cmake python3.11
     sudo dnf install perl git-lfs wget

#Linking Python3 to Python:
sudo ln -s /usr/bin/python3 /usr/bin/python

# Install MPI:
#Working directory is
cd $HOME
wget https://download.open-mpi.org/release/open-mpi/v5.0/openmpi-5.0.0.tar.gz
tar -xvzf openmpi-5.0.0.tar.gz
cd openmpi-5.0.0
./configure --prefix=/opt/openmpi
make -j2
sudo make install


# Download OpenRadioss
cd $HOME
wget https://github.com/OpenRadioss/OpenRadioss/archive/refs/tags/latest-20240117.tar.gz
tar -xvzf latest-20240117.tar.gz
#rename
mv OpenRadioss-latest-20240117  OpenRadioss
cd OpenRadioss 

# Download mumps
cd extlib
mkdir mumps
cd mumps
wget https://github.com/Reference-LAPACK/lapack/archive/refs/tags/v3.11.0.tar.gz
wget https://github.com/Reference-ScaLAPACK/scalapack/archive/refs/tags/v2.2.0.tar.gz
wget http://ftp.mcs.anl.gov/pub/petsc/externalpackages/MUMPS_5.5.1.tar.gz
tar -xvzf v2.2.0.tar.gz 
tar -xvzf v3.11.0.tar.gz
tar -xvzf MUMPS_5.5.1.tar.gz

# Make LAPACK
cd lapack-3.11.0
mv make.inc.example make.inc
make -j2

# Make SCALAPACK
cd $HOME/OpenRadioss/extlib/mumps
cd scalapack-2.2.0
cp SLmake.inc.example SLmake.inc

# Modify the following lines in SLmake.inc:
line 29 and 30,31,32
FC = /opt/openmpi/bin/mpif90
CC = /opt/openmpi/bin/mpicc

line 57 and 58
BLASLIB       = ~/OpenRadioss/extlib/mumps/lapack-3.11.0/librefblas.a
LAPACKLIB     = ~/OpenRadioss/extlib/mumps/lapack-3.11.0/liblapack.a

make

## Make MUMPS:
cd $HOME/OpenRadioss/extlib/mumps
cd MUMPS_5.5.1
cp Make.inc/Makefile.debian.PAR Makefile.inc

# Modify lines in Makefile.inc to the following:
#line 31 
ORDERINGSF  = -Dpord

#line 34 36
LORDERINGS = $(LPORD)
IORDERINGSC = $(IPORD)

#line 50 51 52
CC = /opt/openmpi/bin/mpicc
FC = /opt/openmpi/bin/mpif90
FL = /opt/openmpi/bin/mpif90

#line 55 56
LAPACK = ~/OpenRadioss/extlib/mumps/lapack-3.11.0/liblapack.a
SCALAP = ~/OpenRadioss/extlib/mumps/scalapack-2.2.0/libscalapack.a

#line 65
LIBBLAS = ~/OpenRadioss/extlib/mumps/lapack-3.11.0/librefblas.a

make -j2 all

## Build Engine:
# Following files must exist:
~/OpenRadioss/extlib/mumps/MUMPS_5.5.1/lib/libdmumps.a
~/OpenRadioss/extlib/mumps/scalapack-2.2.0/libscalapack.a
~/OpenRadioss/extlib/mumps/lapack-3.10.1/liblapack.a

cd $HOME/OpenRadioss/engine/

# Modify lines in /CMake_Compilers/cmake_linux64_gf.txt to the following

#Remove -Dmentis flag(line 90)
set(mumps_flag "-Dpord -Dthr_all -DMUMPS5 -DAdd_")

#Build Engine
export PATH=$PATH:/opt/openmpi/bin
./build_script.sh -arch=linux64_gf -mpi=ompi -prec=dp -nt=2 -mumps_root=$HOME/OpenRadioss/extlib/mumps/MUMPS_5.5.1 -scalapack_root=$HOME/OpenRadioss/extlib/mumps/scalapack-2.2.0 -lapack_root=$HOME/OpenRadioss/extlib/mumps/lapack-3.11.0


## Build Starter:
cd $HOME/OpenRadioss/starter/
./build_script.sh -arch=linux64_gf -nt=2

[albenstein]

Dear falinu, thank you for your help. It's done, compiled.