Wrong Average and Sum

[triposat]

My CSV File:

Code:

Output:

Why average is wrong ❌? And how to find the correct sum also?

The average should be: 3.5

[ashleydavis]

That's strange!

Can you please provide a copy of your code and data so I can try running it and see if I can find the bug.

[triposat]

// Import modules
const dataForge = require("data-forge");
require("data-forge-fs");

// Path to CSV file
const csvFilePath = "sample_file.csv";

// Load the CSV file into a data frame
const dataFrame = dataForge.readFileSync(csvFilePath).parseCSV();

console.log(dataFrame)

// Group the data by column 'product' and aggregate
const aggregatedData = dataFrame
    .groupBy((row) => row.product)
    .select((group) => ({
        product: group.first().product,
        count: group.count(),
        averagePrice: group.deflate((row) => row.price).average(),
        maxPrice: group.deflate((row) => row.price).max(),
        minPrice: group.deflate((row) => row.price).min(),
    }))
    .inflate();

// Display the aggregated data in the console
console.log(aggregatedData.toArray());

[ashleydavis]

Data as well pls.

[triposat]

date, product, price, quantity
01-03-2023,Apples,3,10
02-03-2023,Bananas,2,20
03-03-2023,Oranges,4,5
04-03-2023,Pineapples,6,15
05-03-2023,Strawberries,8,8
06-03-2023,Blueberries,7,12
09-03-2023,Grapes,9,5
10-03-2023,Kiwis,8,15
13-03-2023,Bananas,3,10
14-03-2023,Oranges,5,5
15-03-2023,Pineapples,7,15
16-03-2023,Strawberries,9,8
17-03-2023,Blueberries,8,12
20-03-2023,Grapes,10,5
21-03-2023,Kiwis,9,15
22-03-2023,Mangoes,12,12
23-03-2023,Papayas,6,20
24-03-2023,Bananas,3,10
25-03-2023,Oranges,5,5
26-03-2023,Pineapples,8,15
30-03-2023,Apples,4,10
31-03-2023,Grapes,10,5
01-04-2023,Kiwis,9,15
02-04-2023,Mangoes,12,12
03-04-2023,Papayas,6,20

[ashleydavis]

I think this is because the average function is being run on strings! You haven't parsed you CSV file correctly.

Here's what it looks like for me in Data-Forge Notebook, I've highlighted the code you must add that it shows the correct results:

[ashleydavis]

I've published a new version 1.10.0 that throws an exception if you try to use the maths functions on a series containing strings (or any type other than numbers).

This will ensure no else suffers this confusion.

Thanks so much for your contribution @triposat

[triposat]

One more issue - When I am running the below code for the same data, then why are columns so badly formatted, with titles not matching the columns.

// Import modules
const dataForge = require("data-forge");
require("data-forge-fs");

// Path to CSV file
const csvFilePath = "sample_file.csv";

// Load the CSV file into a data frame
const dataFrame = dataForge
  .readFileSync(csvFilePath)
  .parseCSV()
  .parseInts("price", "quantity");

// Group the data by column 'product' and count the values
const groupedData = dataFrame.groupBy((row) => row.product);

// Display grouped data
console.log(groupedData.toString());

Columns so badly formatted with titles not matching the columns:

[triposat]

Can anyone help me, please?

[triposat]

Can anyone help me, please?

[ashleydavis]

If you believe there is a bug please submit and an issue with example code.

If you'd like to contribute please fix the problem and submit a PR.