Skip to content

Commit

Permalink
Merge pull request #13343 from easybuilders/4.4.x
Browse files Browse the repository at this point in the history
release EasyBuild v4.4.1
  • Loading branch information
migueldiascosta committed Jul 6, 2021
2 parents 794502e + d56ee04 commit 50d0761
Show file tree
Hide file tree
Showing 2,028 changed files with 33,083 additions and 11,517 deletions.
2 changes: 2 additions & 0 deletions .github/workflows/unit_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,8 @@ jobs:
fail-fast: false
steps:
- uses: actions/checkout@v2
with:
fetch-depth: 0 # Required for git merge-base to work

- name: Cache source files in /tmp/sources
id: cache-sources
Expand Down
87 changes: 86 additions & 1 deletion RELEASE_NOTES
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,95 @@ For more detailed information, please see the git log.

These release notes can also be consulted at https://docs.easybuild.io/en/latest/Release_notes.html.

The latest version of easybuild-easyconfig provides 12,266 easyconfig files, for 2,349 different software packages,
The latest version of easybuild-easyconfig provides 12,607 easyconfig files, for 2,388 different software packages,
incl. 36 different (compiler) toolchains.


v4.4.1 (July 6th 2021)
----------------------

update/bugfix release

- added example easyconfig files for 39 new software packages:
- AMPHORA2 (#13003), AOMP (#12909), CAMPARI (#13152), CSB (#12877), dijitso (#10719), DosageConvertor (#13278),
dSFMT (#12971), exiv2 (#13204), FEniCS (#10719), FreeFEM (#9902), futhark (#12921), futile (#12864),
gappa (#13186), GenomeWorks (#13083, #13092), gexiv2 (#13204), HAL (#13267), hipify-clang (#12961), inline (#12029),
libcint (#13214), LTR_retriever (#13125), mapDamage (#13172), MbedTLS (#13061), microctools (#13010),
Nektar++ (#12664), NINJA (#13125), OBITools3 (#12969), ont-fast5-api (#13033), OpenMM-PLUMED (#13268),
phototonic (#13241), PyFoam (#12675), RagTag (#13247), RcppGSL (#13172), RECON (#13123), RepeatScout (#13124),
retworkx (#13228), UCX-CUDA (#13260), unimap (#13247), Vala (#13204), WhatsHap (#12989)
- added additional easyconfigs for various supported software packages, including:
- Amber 20.11, BBMap 38.90, Beast 2.6.4, BLIS 3.0 (AMDo fork), Bonito 0.4.0, CellRanger-ARC 2.0.0,
CellRanger-ATAC 2.0.0, Check 0.15.2, CubeGUI 4.6, CubeLib 4.6, CubeWriter 4.6, cuDNN 8.2.1.32, CVXOPT 1.2.6,
DOLFIN 2019.1.0.post0, eggnog-mapper 2.1.4, ELPA 2021.05.001, FDS 6.7.6, FFC 2019.1.0.post0, FFmpeg 4.3.2,
FIAT 2019.1.0, flatbuffers 2.0.0, flatbuffers-python 2.0, FLTK 1.3.6, gc 8.0.4, GCC 8.4.0 + 9.4.0, GDAL 3.3.0,
Gdk-Pixbuf 2.42.6, geopy 2.1.0, Ghostscript 9.54.0, git 2.32.0, GitPython 3.1.18, GLFW 3.3.4, gmsh 4.8.4,
gnuplot 5.4.2, GnuTLS 3.7.2, Go 1.16.5, GObject-Introspection 1.68.0, gperftools 2.9.1, GraphicsMagick 1.3.36,
Graphviz 2.47.2, GSL 2.7, GTK+ 2.24.33, Guile 2.2.7, h5py 3.2.1, HarfBuzz 2.8.1, Horovod 0.22.0, Hypre 2.21.0,
ICU 69.1, ImageMagick 7.0.11-14, IOR 3.3.0, IPython 7.25.0, IRkernel 1.2, ispc 1.16.0, JupyterLab 3.0.16,
LDC 1.26.0, libcerf 1.17, libepoxy 1.5.8, libgd 2.3.1, libStatGen 1.0.15, libxc 5.1.5, LittleCMS 2.12,
LMfit 1.0.2, Lua 5.4.3, M4 1.4.19, MCR R2021a.3, medaka 1.4.3, Mercurial 5.8, minimap2 2.20, MMseqs2 13,
MrBayes 3.2.7, MUMPS 5.4.0, NCCL 2.9.9, netCDF 4.8.0, Nim 1.4.8, nodejs 14.17.0, Nsight-Compute 2021.2.0,
numba 0.53.1, NVHPC 21.5.eb, nvtop 1.2.1, Octave 6.2.0, OPARI2 2.0.6, openkim-models 20210128, OpenMPI 4.0.6,
OTF2 2.3, p11-kit 0.24.0, Pango 1.48.5, parallel 20210622, petsc4py 3.12.0, picard 2.25.5, Pillow 8.2.0,
PROJ 8.0.1, protobuf 3.17.3, protobuf-python 3.17.3, PSolver 1.8.3, PySCF 1.7.6, pyspoa 0.0.8, pytest-xdist 2.3.0,
PyTorch 1.9.0, PyYAML 5.4.1, Qhull 2020.2, Quandl 3.6.1, R 4.0.5 + R 4.1.0, Ragout 2.3, RE2 2021-06-01,
ReFrame 3.6.2, RepeatMasker 4.1.2, rgdal 1.5-23, RMBlast 2.11.0, Ruby 3.0.1, scikit-learn 0.24.2,
Score-P 7.0, Seurat 4.0.3, slepc4py 3.12.0, spoa 4.0.7, Subread 2.0.2, Subversion 1.14.1, SuiteSparse 5.10.1,
sympy 1.8, tensorboardX 2.2, TensorFlow 2.5.0, Tk 8.6.11, tmux 3.2a, torchtext 0.8.1, torchvision 0.9.1,
UDUNITS 2.2.28, UFL 2019.1.0, utf8proc 2.6.1, VEP 103.1, VMD 1.9.4a51, vsc-mympirun 5.2.6, XCFun 2.1.1,
Xvfb 1.20.11, Z3 4.8.11, ZeroMQ 4.3.4
- minor enhancements, including:
- update cuDNN 8.0.x easyconfigs with a download location (#12368)
- add extensions to recent R easyconfigs: GxEScanR (#13039), cSEM (#13208), cubelyr + broom.mixed (#13252),
grf (#13261), twang + xgboost (#13284), neuralnet (#13330)
- add check to easyconfigs test suite to ensure OpenSSL wrapper is used in easyconfigs using a recent toolchain (#13079)
- add gipaw to QuantumESPRESSO/6.7 (#13087)
- add checksum for aarch64 installation file for CUDAcore easyconfigs (#13014, #13097)
- add Perl dependency to makeinfo easyconfigs (#13166)
- set minimal OpenSSL version to 1.1.1 for OpenSSL v1.1 wrapper (#13188)
- add JIT support for CUDA 11 to PyTorch 1.7.1 (#13207)
- add 'ninja --version' as sanity check command in Ninja easyconfigs (#13222)
- code cleanup + improvements for easyconfigs test suite (#13257)
- various bug fixes, including:
- download sources via git for XGBoost 20171120 easyconfig due to use of submodules (#6880)
- add elfutils as build dependency for Clang 8.0.x and 9.0.1 (#13015) and Clang 11.0.1 (#13008) easyconfigs that have a CUDA dependency
- add missing CMake option to Geant4 v10.7.1 in order to actually use external CLHEP (#13019)
- add new checksum for mvabund extension to R v4.0.4 eaysconfigs (#13020, #13021)
- add patch to fix numpy test_ccompiler_opt in SciPy-bundle v2021.05 (#13042)
- add patch to fix installation of HDF 4.2.15 on aarch64 (#13059)
- make sure that MbedTLS' Makefile uses 'python' rather than 'python2' (#13061)
- fix checksum for snpEff 5.0 (#13062)
- fix source URL for LIBSVM 3.24 by downloading from GitHub (#13076)
- add preinstallopts for minimap2 to fix installation on aarch64 (#13080)
- add patch for GCC 10.2.0 to fix internal compiler error on aarch64 (#13086)
- switch to NCCL 2.8.3 built from source for CuPy, Horovod, libgpuarray, PyTorch and TensorFlow using fosscuda/2020b (#13103)
- add astor to dependencies of TensorFlow with 2019b (#13111) and 2020b (#13103, #13112) toolchains
- break cyclic dependency between groff, makeinfo and Perl by adding Perl-minimal and makeinfo-minimal easyconfigs (#13163-#13165)
- add missing rgdal dep to R-INLA (#13179)
- add patch to fix uniq operation in TensorFlow 2.4.1 (#13181)
- add Perl build dependency for PnetCDF 1.12.1 (#13183)
- disable own avx detection of libfabric v1.12.1 (#13215)
- add GCCcore-[1-9][0-9].x to test_dep_versions_per_toolchain_generation (#13243, #13249, #13251)
- add patch to fix installation of TensorFlow 2.0.x (#13248)
- add patch for recent GCCcore versions to fix compability with CUDA 11 (#13290)
- fix install step for glew (#13297)
- update Boost 1.74.0 easyconfigs to use tagged_layout rather than boost_multi_thread (#13300)
- avoid using PMIx from system instead of PMIx dependency specified via --with-pmix for OpenMPI 4.x (#13307)
- add patch for GCCcore 10.3.0 to prevent issues when compiling with nvcc (#13310)
- add patch for OpenMPI 4.0.x to fix building against (system) UCX version > 1.7 (#13329)
- fix build of manta 1.6.0 on top of Boost 1.74.0 (#13338)
- fix recent taxator-tk easyconfigs by adding (back) -DBoost_NO_BOOST_CMAKE=ON configure option (#13342)
- other changes:
- disable debuginfod for elfutils to minimize required dependencies (#13034)
- add bare Python 3.9.5 easyconfig and use that as builddep for LLVM 11.1.0 (#13035)
- remove misleading comment from Python >= 3.7 easyconfigs, libffi is now also required for Python itself (no longer bundled) (#13041)
- use new custom easyblock in torchvision easyconfigs (#13102)
- remove superflous TensorFlow patch (#13223)
- cleanup of easyconfigs for (bundles) of Python packages: remove default PYPI_SOURCE source URLs + use PythonBundle rather than Bundle easyblock (#13253, #13295, #13336)
- update README with instructions for MATLAB easyconfigs (#12597)


v4.4.0 (June 2nd 2021)
----------------------

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,6 @@ description = """lib3to2 is a set of fixers that are intended to backport code w

toolchain = {'name': 'foss', 'version': '2016b'}

source_urls = [PYPI_SOURCE]
sources = [SOURCE_ZIP]

dependencies = [('Python', '2.7.12')]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,6 @@ description = """lib3to2 is a set of fixers that are intended to backport code w

toolchain = {'name': 'intel', 'version': '2016b'}

source_urls = [PYPI_SOURCE]
sources = [SOURCE_ZIP]

dependencies = [('Python', '2.7.12')]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,6 @@ description = """lib3to2 is a set of fixers that are intended to backport code w

toolchain = {'name': 'intel', 'version': '2017a'}

source_urls = [PYPI_SOURCE]
sources = [SOURCE_ZIP]
checksums = ['fef50b2b881ef743f269946e1090b77567b71bb9a9ce64b7f8e699b562ff685c']

Expand Down
65 changes: 65 additions & 0 deletions easybuild/easyconfigs/a/ABINIT/ABINIT-9.4.1-foss-2020b.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
easyblock = 'ConfigureMake'

name = 'ABINIT'
version = '9.4.1'

homepage = 'https://www.abinit.org/'
description = """ABINIT is a package whose main program allows one to find the total energy,
charge density and electronic structure of systems made of electrons and nuclei (molecules
and periodic solids) within Density Functional Theory (DFT), using pseudopotentials and a
planewave or wavelet basis."""

toolchain = {'name': 'foss', 'version': '2020b'}
toolchainopts = {'usempi': True, 'pic': True}

source_urls = ['https://www.abinit.org/sites/default/files/packages/']
sources = [SOURCELOWER_TAR_GZ]
checksums = ['ec74133ef9d247cb6ad44c205675694919cf36d7f1682a9b85cae8bdecdc22a8']

builddependencies = [
('Python', '3.8.6'),
]
dependencies = [
('libxc', '4.3.4'),
('netCDF', '4.7.4'),
('netCDF-Fortran', '4.5.3'),
('HDF5', '1.10.7'),
('Wannier90', '3.1.0'),
]

# Needed due to changes in GCC10.
configopts = 'FCFLAGS="-fallow-argument-mismatch -ffree-line-length-none $FCFLAGS" '
configopts += 'FFLAGS="-fallow-argument-mismatch $FFLAGS" '

# Ensure MPI
configopts += '--with-mpi="yes" --enable-openmp="no" '
# configopts += ' FC="mpiifort" CC="mpiicc" CXX="mpiicpc" '

# BLAS/Lapack from OpenBLAS
configopts += '--with-linalg-flavor="openblas" LINALG_LIBS="${LIBLAPACK_MT}" '

# FFTW
configopts += '--with-fft-flavor=fftw3 FFTW3_LIBS="-L${EBROOTFFTW} -lfftw3f -lfftw3" '

# libxc support
configopts += '--with-libxc=${EBROOTLIBXC} '

# hdf5/netcdf4 support
configopts += '--with-netcdf="${EBROOTNETCDF}" '
configopts += '--with-netcdf-fortran="${EBROOTNETCDFMINFORTRAN}" '
configopts += '--with-hdf5="${EBROOTHDF5}" '

# Wannier90
configopts += '--with-wannier90="${EBROOTWANNIER90}" '
preconfigopts = 'export WANNIER90_LIBS="-L$EBROOTWANNIER90/lib -lwannier" && '

# 'make check' is just executing some basic unit tests.
# Also running 'make tests_v1' to have some basic validation
runtest = "check && make test_v1"

sanity_check_paths = {
'files': ['bin/%s' % x for x in ['abinit', 'aim', 'cut3d', 'conducti', 'mrgddb', 'mrgscr', 'optic']],
'dirs': ['lib/pkgconfig'],
}

moduleclass = 'chem'
Original file line number Diff line number Diff line change
Expand Up @@ -20,39 +20,30 @@ use_pip = True

exts_list = [
('memoized-property', '1.0.3', {
'source_urls': ['https://pypi.python.org/packages/source/m/memoized-property/'],
'checksums': ['4be4d0209944b9b9b678dae9d7e312249fe2e6fb8bdc9bdaa1da4de324f0fcf5'],
}),
('simplejson', '3.16.0', {
'source_urls': ['https://pypi.python.org/packages/source/s/simplejson/'],
'checksums': ['b1f329139ba647a9548aa05fb95d046b4a677643070dc2afc05fa2e975d09ca5'],
}),
('serializable', '0.1.1', {
'source_urls': ['https://pypi.python.org/packages/source/s/serializable/'],
'checksums': ['87f9fadbd0fba5c7951858d16ae9109afa4c96fd486e663419f3051f352a22d9'],
}),
('gtfparse', '1.2.0', {
'source_urls': ['https://pypi.python.org/packages/source/g/gtfparse/'],
'checksums': ['2f27aa2b87eb43d613edabf27f9c11147dc595c8683b440ac1d88e9acdb85873'],
}),
('typechecks', '0.1.0', {
'source_urls': ['https://pypi.python.org/packages/source/t/typechecks/'],
'checksums': ['7d801a6018f60d2a10aa3debc3af65f590c96c455de67159f39b9b183107c83b'],
}),
('appdirs', '1.4.3', {
'source_urls': ['https://pypi.python.org/packages/source/a/appdirs/'],
'checksums': ['9e5896d1372858f8dd3344faf4e5014d21849c756c8d5701f78f8a103b372d92'],
}),
('datacache', '1.1.5', {
'source_urls': ['https://pypi.python.org/packages/source/d/datacache/'],
'checksums': ['b2ca31b2b9d3803a49645ab4f5b30fdd0820e833a81a6952b4ec3a68c8ee24a7'],
}),
('pyensembl', '1.7.5', {
'source_urls': ['https://pypi.python.org/packages/source/p/pyensembl/'],
'checksums': ['378fb2ef7d2d5438b90514e7b616276d2a5e749d8cf150182401e12f35b999e4'],
}),
('agfusion', version, {
'source_urls': ['https://pypi.python.org/packages/source/a/agfusion/'],
'checksums': ['62733254ceaba970a018f16d36bfb1907e0505cc98eaf2dc49ee4938aaf4fd4d'],
}),
]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,6 @@ dependencies = [

use_pip = True

exts_default_options = {'source_urls': [PYPI_SOURCE]}

exts_list = [
('python-utils', '2.3.0', {
'modulename': 'python_utils',
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,51 @@
# Author: Jasper Grimm (UoY)

easyblock = 'Tarball'

name = 'AMPHORA2'
version = '20190730'
local_commit = '9fb9ce8'
local_raxmlsuffix = '-pthreads-avx2'
local_javasuffix = '-Java-%(javaver)s'
versionsuffix = local_javasuffix + local_raxmlsuffix

homepage = 'https://github.com/wu-lab-uva/AMPHORA2'
description = "An Automated Phylogenomic Inference Pipeline for Bacterial and Archaeal Sequences."

toolchain = {'name': 'gompi', 'version': '2020b'}

github_account = 'wu-lab-uva'
source_urls = [GITHUB_SOURCE]
sources = ['%s.tar.gz' % local_commit]
checksums = ['2d361fcc2b800c3daaf25692988af6105669cba2ff513aba82f36089beb2839f']

dependencies = [
('Perl', '5.32.0'),
('Java', '13', '', True),
('BioPerl', '1.7.8'),
('HMMER', '3.3.2'),
('EMBOSS', '6.6.0', local_javasuffix),
('RAxML', '8.2.12', local_raxmlsuffix),
]

local_scripts = ['%s.pl' % x for x in ['MarkerAlignTrim', 'MarkerScanner', 'Phylotyping']]
fix_perl_shebang_for = ['Scripts/*.pl']

# Exit with code 0 when running -Help
preinstall_cmd = "sed -i 's|die $usage if $help|if ($help) {print $usage; exit 0}|g' Scripts/*.pl && "
# Fix RAxML binary name
preinstall_cmd += "sed -i 's|raxmlHPC-PTHREADS|raxmlHPC%s|g' Scripts/Phylotyping.pl" % local_raxmlsuffix.upper()

sanity_check_paths = {
'files': ['Scripts/%s' % x for x in local_scripts],
'dirs': [],
}

sanity_check_commands = ["%s -Help" % x for x in local_scripts]

modextrapaths = {
'AMPHORA2_home': '',
'PATH': 'Scripts',
}

moduleclass = 'bio'
42 changes: 42 additions & 0 deletions easybuild/easyconfigs/a/AOMP/AOMP-13.0-2-GCCcore-10.2.0.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
##
# This file is an EasyBuild reciPY as per https://github.com/easybuilders/easybuild
#
# Authors:: Jorgen Nordmoen <jorgen.nordmoen@usit.uio.no>
# License:: GPLv2 or later, MIT, three-clause BSD.
# $Id$
##

name = 'AOMP'
version = '13.0-2'

homepage = 'https://github.com/ROCm-Developer-Tools/aomp'
description = "AMD fork of LLVM, setup for OpenMP offloading to Accelerators"

toolchain = {'name': 'GCCcore', 'version': '10.2.0'}

source_urls = ['https://github.com/ROCm-Developer-Tools/aomp/releases/download/rel_%(version)s/']
sources = ['aomp-%(version)s.tar.gz']
patches = ['AOMP-%(version)s_remove_hardcoded_paths.patch']
checksums = [
# aomp-13.0-2.tar.gz:
'0256a84aefcbf7c49112f068321b84e0620f4c43a9d490c64d820e40658e0d67',
# AOMP-13.0-2_remove_hardcoded_paths.patch:
'ec41ffcec63d079b6a73c93bea29e0b8d77ca7b059725aa1d47c334f7e476ff0',
]

builddependencies = [
('CMake', '3.18.4'),
('Perl', '5.32.0'),
('Python', '3.8.6'),
('elfutils', '0.183'),
('pkg-config', '0.29.2'),
]

dependencies = [
('binutils', '2.35'),
('libffi', '3.3'),
('ncurses', '6.2'),
('numactl', '2.0.13'),
]

moduleclass = 'compiler'
42 changes: 42 additions & 0 deletions easybuild/easyconfigs/a/AOMP/AOMP-13.0-2-gcccuda-2020a.eb
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
##
# This file is an EasyBuild reciPY as per https://github.com/easybuilders/easybuild
#
# Authors:: Jorgen Nordmoen <jorgen.nordmoen@usit.uio.no>
# License:: GPLv2 or later, MIT, three-clause BSD.
# $Id$
##

name = 'AOMP'
version = '13.0-2'

homepage = 'https://github.com/ROCm-Developer-Tools/aomp'
description = "AMD fork of LLVM, setup for OpenMP offloading to Accelerators"

toolchain = {'name': 'gcccuda', 'version': '2020a'}

source_urls = ['https://github.com/ROCm-Developer-Tools/aomp/releases/download/rel_%(version)s/']
sources = ['aomp-%(version)s.tar.gz']
patches = ['AOMP-%(version)s_remove_hardcoded_paths.patch']
checksums = [
# aomp-13.0-2.tar.gz:
'0256a84aefcbf7c49112f068321b84e0620f4c43a9d490c64d820e40658e0d67',
# AOMP-13.0-2_remove_hardcoded_paths.patch:
'ec41ffcec63d079b6a73c93bea29e0b8d77ca7b059725aa1d47c334f7e476ff0',
]

builddependencies = [
('CMake', '3.16.4'),
('Perl', '5.30.2'),
('Python', '3.8.2'),
('elfutils', '0.182'),
('pkg-config', '0.29.2'),
]

dependencies = [
('binutils', '2.34'),
('libffi', '3.3'),
('ncurses', '6.2'),
('numactl', '2.0.13'),
]

moduleclass = 'compiler'

0 comments on commit 50d0761

Please sign in to comment.