Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Export experiment results #55

Open
5 of 6 tasks
litalmason opened this issue Dec 24, 2023 · 0 comments
Open
5 of 6 tasks

Export experiment results #55

litalmason opened this issue Dec 24, 2023 · 0 comments
Assignees
Labels
feature New feature
Milestone

Comments

@litalmason
Copy link
Collaborator

litalmason commented Dec 24, 2023

Description

Allow exporting Test Suite results, with all its 'Test-Runs', to a file.

  • Export results to JSON and/or CSV files to allow further analysis
  • Optional: Export results to PDF (Table, Graphs) for management reports, etc.

JSON example:

{ 
   "id": 1, 
   "name": "test1", 
   "description": "test1", 
   "start_time": "Thu, 14 Dec 2023 15:37:31 GMT", 
   "end_time": "Thu, 14 Dec 2023 15:38:39 GMT", 
   "environment_info": { 
     "codeRelease": "1.1.0", 
     "cpu": "RELACE_WITH_CPU", 
     "cpuArchitecture": "RELACE_WITH_CPU_ARCHITECTURE", 
     "cpuClockSpeed": "RELACE_WITH_CLOCK_SPEED", 
     "cpuCores": 0, 
     "nodeSize": "RELACE_WITH_NODE_SIZE", 
     "operatingSystem": "RELACE_WITH_OPERATING_SYSTEM", 
     "resourceName": "RELACE_WITH_RESOURCE_NAME" 
   }, 
  "testRuns": [ 
    { 
      "algorithm": "Algorithm1", 
      "iterations": 1000, 
      "messageSizeBytes": 1024, 
      "results":  
        { 
      "averageCPU": 25.5, 
      "averageMemory": 512, 
      "errorRate": 0.05, 
      "bytesThroughput": 2048000, 
      "messagesThroughput": 500, 
      "averageTLSHandshakeTime": 10.2 
	} 
    } 
   ... 
  ] 

Acceptance Criteria

  1. Export button in Qujata Portal
  2. Export to CSV file
  3. Export results as JSON file (optional for 1.1.0 milestone)
  4. Export results and graphs to PDF, in a similar format to their presentation on the UI, as a ready made report you can immediately share (nice to have for 1.1.0 milestone)
  5. Testing: ensure all fields are exported to CSV (native format is JSON), Titles are written in plain English, no issues with larger result files

Tasks

  • Saving Test Run results in db
  • Getting Test Run results from cAdvisor
  • New API to export data by test_suite_id (DB & Prometheus)
  • Query prometheus (CPU and memory, client and server) according to test run start/end time and aggregate to avg result
  • UI changes: add button to export data according to design
  • Add get API for test suites and test runs (one Test Suite includes 1 or more Test Runs)
@litalmason litalmason added the feature New feature label Dec 24, 2023
@litalmason litalmason added this to the 1.1.0 milestone Dec 24, 2023
@nganani nganani self-assigned this Jan 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature
Projects
Status: No status
Development

No branches or pull requests

2 participants