AWS Batch data processing showcase using Docker on ECS Fargate with GitHub Actions CI/CD!
-
Updated
Jun 4, 2024 - Python
AWS Batch data processing showcase using Docker on ECS Fargate with GitHub Actions CI/CD!
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
This is a project demonstrating a scheduled web scrapping system in AWS to store the supermarket data into AWS hosted database for further analysis
Funnel is a toolkit for distributed task execution via a simple, standard API.
Serverless application to monitor an AWS Batch architecture through dashboards.
Executor plugin interfacing Covalent with AWS Batch
This project demonstrates an event-driven architecture for parallel web scraping and processing tasks using AWS services. The scraper job, running on AWS Batch, collects data from multiple web pages simultaneously and stores it in S3. The processing job, triggered by AWS EventBridge, efficiently processes the scraped data and updates Google-Sheet.
⛳️ PASS: Amazon Web Services Certified (AWS Certified) Machine Learning Specialty (MLS-C01) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.
Terraform module to create AWS Batch resources 🇺🇦
A project that demonstrates the use of AWS Batch to create IIIF tiles and manifests. It is used for VTDLP Derivative Service
This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.
An AWS CDK project enabling file transfer and management between Amazon EFS, AWS Batch, and S3.
AWS Batch - Docker Hub Public Image - CDK Typescript
Python tools and APIs for working with AWS
Building containers that run on AWS Lambda and AWS Batch
Add a description, image, and links to the aws-batch topic page so that developers can more easily learn about it.
To associate your repository with the aws-batch topic, visit your repo's landing page and select "manage topics."