Skip to content

Cloudwrapper - job queue, logging & metrics for Amazon, Google and private cloud

License

Notifications You must be signed in to change notification settings

klokantech/cloudwrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

cloudwrapper

Wrappers around cloud services for Amazon, Google and private cloud.

Copyright: (C) 2016-2023 Klokan Technologies GmbH (https://www.klokantech.com/) & MapTiler AG (https://www.maptiler.com/)

Maintainer: Martin Mikita, martin.mikita@maptiler.com

Modules

  • Amazon cloud services:

    • s3: Amazon S3 storage.
    • sqs: Amazon SQS queues.
    • cwl: Amazon CloudWatch logs.
    • required packages:
      • boto==2.48.0
  • Google cloud services:

    • gce: Google Compute Engine instance metadata.

    • gcl: Google Cloud Logging.

    • gcm: Google Custom Metric (v2) DEPRECATED.

    • gcm3: Google Custom Metric (v3).

    • gcs: Google Cloud Storage.

    • gdm: Google Deployment Manager using API v2.

    • gps: Google PubSub using GCE Authentication.

    • gtq: Google Task Pull Queues.

    • required packages:

      • gcloud==0.18.3
      • gcloud_taskqueue==0.1.2
      • google-api-python-client==1.7.11
      • crc32c==2.1
      • oauth2client==4.1.3
      • PyYAML==5.1.2
      • requests==2.22.0
    • gcm3: Google Custom Metric (v3).

    • required packages:

      • google-cloud-monitoring==0.33.0
      • google-cloud-core==1.0.3
      • oauth2client==4.1.3
      • requests==2.22.0
  • BeansTalkd:

    • btq: BeansTalkd Queues.
    • required packages:
      • beanstalkc3==0.4.0
      • PyYAML==5.1.2
  • InfluxDB:

    • idm: Influx DB Metric.
    • idl: Influx DB Logging.
    • idb: Influx DB direct use (as SQL database).
    • required packages:
      • influxdb==3.0.0

Install

WARNING: Cloudwrapper uses new requests module, while old pip (from apt-get on Ubuntu 14.04, Debian 8) requires older requests module.

The URL link for the master (latest) version:

https://github.com/klokantech/cloudwrapper/archive/master.zip

Versions

The latest released versions:

  • v2.7 : https://github.com/klokantech/cloudwrapper/archive/v2.7.zip
  • v2.6 : https://github.com/klokantech/cloudwrapper/archive/v2.6.zip
  • v2.5 : https://github.com/klokantech/cloudwrapper/archive/v2.5.zip
  • v2.0 : https://github.com/klokantech/cloudwrapper/archive/v2.0.zip
  • v1.24 : https://github.com/klokantech/cloudwrapper/archive/v1.24.zip

The list of all released versions are in the Releases section of this repository. The link for older version has this format: https://github.com/klokantech/cloudwrapper/archive/vX.Y.zip, where vX.Y is the tag on this repository.

Python2

NOTE To be deprecated shortly. As of January 1st, 2020 no new bug reports, fixes, or changes will be made to Python 2, and Python 2 is no longer supported.

apt-get install python-setuptools
easy_install pip
pip install https://github.com/klokantech/cloudwrapper/archive/v2.7.zip

Python3

apt-get install python3-setuptools
easy_install3 pip
pip3 install https://github.com/klokantech/cloudwrapper/archive/v2.7.zip

Usage example

BeansTalkd Queues

Install required packages: pip install beanstalkc3==0.4.0 PyYAML==5.1.2

from cloudwrapper.btq import BtqConnection

btq = BtqConnection('172.17.0.2', 11300)  # host, port

q = btq.queue('test')  # get test queue object

print(q.qsize())  # print size of the queue test

About

Cloudwrapper - job queue, logging & metrics for Amazon, Google and private cloud

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages