Added new features and bug fixes

1 - Added online/offline data processing in API-Server
2 - Removed Kafka
3 - Partially integrated mProv server

Bug Fixes

3.1.1

updated api server to add online and offline data processing

Bug Fixes

3.1

updated cc version

major structural changes

1 - Changed architecture to mainly rely on Spark data structure
2 - Lambda expression added to execute CC algorithms
3 - Graphing feature to plot your data
4 - Major/minor bug fixes

Bug fixes

Fixed some bugs related to store and retrieve streams

Configuration restructuring and modularization

1 - Restructured yml configuration file
2 - Easy to replace NoSQL backend (code modularization)
3 - Removed Cassandra/ScyllaDB support

Support AWS S3

1 - Now save_stream support directly ingested data to influxdb that could be visualized using Grafana
2 - Supports Amazon S3 storage
3 - Updated readme file
4 - Fixed https://md2korg.atlassian.net/browse/CC-596

Added features and fixed bugs

1 - CerebralCortex supports file-system as data-storage layer. This could be useful if you are running it on single node
2 - get_stream returns local time of a participant. Datatime object would have (-/+) of timezone hours. (https://md2korg.atlassian.net/browse/CC-483). If you set localtime=False, then please set the same localtime=False in save_stream (API change)
3 - Fixed Datetime object serialization while using json.dumps
4 - Fixed bug related to remove duplicates on storing data in HDFS (save_stream)
5 - Moved hdfs related methods to stream_handler module (improvement
6 - Set localtime=False (default value)
7 - Manually opening/closing files to avoid any "FileAlreadyColsed" errors
8 - Added system level test-cases
9 - Fixed a critical bug (https://md2korg.atlassian.net/browse/CC-536)
10 - Added caching feature to cache GPS and mobile app cat. data

Fixed Metadata Write and improved performance

1 - CC 2.2.0 doesn't write metadata (fixed)
2 - Improved HDFS write performance
3 - Fixed memory over usage/leak
4 - Added sort and remove duplicates on data retrieval
5 - MySQL start/end time bug is fixed
6 - Added test cases
7 - Added debug option in config to print errors on console

HDFS supported version

1 - Bug fixes and improved logging
2 - Performance improvements
3 - This is a stable version that can work with ScyllaDB/Cassandra/HDFS NoSQL data stores