This web analytics demo shows how to collect web logs with API Gateway and store them into S3 through Amazon Kinesis. Then this project shows how to analyze web logs with Amazon Athena.
-
Updated
May 2, 2024 - Python
#
kinesis-stream
Here are 119 public repositories matching this topic...
Utility code for AWS Services. Sample use case could be querying data from KDS. This project is open to receive contribution.
aws
aws-lambda
aws-s3
lambda-functions
kinesis-stream
aws-kinesis
aws-services
aws-utilities
document-db
-
Updated
May 3, 2024 - Python
A streaming data pipeline leveraging managed services from AWS & the serverless architecture
-
Updated
Apr 19, 2024 - Python
An end-to-end AWS data engineering pipeline that orchestrates data ingestion, processing, and storage using Kinesis, S3, Redshift, Lambda, DynamoDB
-
Updated
Apr 2, 2024 - Python
Scala based wrapper for Kinesis Consumer Library which exposes the stream as an Akka Streams Source
-
Updated
Mar 5, 2024 - Scala
Postgresql To Kinesis For Java
-
Updated
May 22, 2024 - Java
Creation of the almost-real time data processing pipeline for the Pintrest posts.
-
Updated
Jan 29, 2024 - Jupyter Notebook
Embracing Modern Data Solutions: Transitioning from Apache Flink to Redis and AWS Lambda with SQS and Kinesis
redis
aws
lambda
kinesis
redis-client
kinesis-firehose
kinesis-stream
redis-cache
cdk
aws-cdk
elasticcache
aws-cdk-typescript
-
Updated
Jan 27, 2024 - JavaScript
Projects and coding completed for Data Engineering immersive program at AiCore.
-
Updated
Mar 13, 2024 - Jupyter Notebook
Simple Stock analysis app which sends email when a certain threshold is reached
-
Updated
Dec 26, 2023 - Python
Kafka Connect Docker image containing AWS Kinesis and S3 plugins
-
Updated
Dec 11, 2023 - Makefile
A unified data pipeline that aggregates, refines, and analyses vast datasets, delivering real-time business intelligence and supporting data-driven decisions.
-
Updated
Nov 30, 2023 - Jupyter Notebook
This repository contains an End to End Real time 🕰️ Machine Learning Pipeline to predict star ⭐️ rating of product reviews. This project uses AWS Sagemaker, Kinesis, Lambda, S3, Redshift, Athena, and Step functions. Deployment of multiple models for AB testing and Bandit testing is also included.
nlp
docker
aws
lambda
streaming
real-time
deep-learning
athena
s3-bucket
embeddings
kinesis-firehose
kinesis-stream
ingestion
ab-testing
redshift
data-pipeline
multi-armed-bandit
sagemaker
bert-model
-
Updated
Nov 24, 2023 - Jupyter Notebook
-
Updated
Oct 28, 2023 - Python
Easy Amazon Kinesis load testing with Locust - a modern load testing framework
-
Updated
Oct 23, 2023 - TypeScript
A lightweight system to automatically scale Kinesis Data Streams up and down based on throughput.
-
Updated
Oct 17, 2023 - Go
Streaming data analysis using AWS tools such as Cloud9 to generate events in the cloud, using boto3 to send records to Kinesis Data Firehose to connect to the S3 bucket destination, saving files in .parquet format. With the help of Glue, a data catalog will be created to enable real-time querying of all records with Athena.
-
Updated
Oct 1, 2023 - Python
Code companion to AWS Compute Series on building a serverless backend for a streaming application. Questions? Contact @jbesw.
-
Updated
Sep 25, 2023 - JavaScript
Improve this page
Add a description, image, and links to the kinesis-stream topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the kinesis-stream topic, visit your repo's landing page and select "manage topics."