Skip to content
This repository has been archived by the owner on Nov 27, 2020. It is now read-only.
/ dummycsv Public archive

Fast and functional fake CSV datasets generator

Notifications You must be signed in to change notification settings

AverHLV/dummycsv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DummyCSV

DummyCSV - it`s a fake CSV datasets generator with schemas customization, complex column types and fast operations with large files. Uses Swagger UI for live interaction with REST API endpoints and celery for background tasks.

Swagger UI available on api/docs/. Credentials: admin / admin.

A Dataset with shapes 100000 x 10 and size ~100 MB was generated by ~10s and downloaded by ~14s.

Usage

  • CSV schemas can be created, viewed and edited via schemas namespace endpoints.
  • Creating sets triggers file generation.
  • Generated files (set has processed=true flag) can be downloaded by /sets/{id}/ endpoint.

Note: already generated files can be removed by heroku cycling or dyno restarting.