Close
Page 1 of 4 1234 LastLast
Results 1 to 10 of 40

Hybrid View

Previous Post Previous Post   Next Post Next Post
  1. #1
    QUITTER Irving's Avatar
    Join Date
    Nov 2008
    Location
    Denver, CO
    Posts
    46,527
    Blog Entries
    1

    Default Anyone using Google Drive spreadsheet ever caught a math error?

    I use Google Drive spreadsheets to track things. I'll have to look up the exact name, but it is basically the Google version of Microsoft Excel. Today I noticed that when it was summing a certain column of numbers, it was off by one cent. $.01. For the life of me I cannot figure out where the error is. Well, basically when it adds a number that ends in .51 to a number that ends in .11, it comes up with .63 instead of .62. I can't figure out why. At this point it really doesn't matter, and I don't have time right this second to try a bunch of tests, but I'm wondering if anyone has ever caught a program making a math error before.
    "There are no finger prints under water."

  2. #2
    Self Conscious About His "LOAD" 00tec's Avatar
    Join Date
    Sep 2011
    Location
    Aggieland, TX
    Posts
    4,275

    Default

    Just tested on mine and got the same result.

  3. #3
    Grand Master Know It All Sawin's Avatar
    Join Date
    Aug 2011
    Location
    144th & I25
    Posts
    3,922

    Default

    Millennials.
    Please leave any relevant feedback here:
    Sawin - Feedback thread.

  4. #4
    Machine Gunner mattiooo's Avatar
    Join Date
    May 2006
    Location
    Erie
    Posts
    1,308

    Default

    Sounds like a rounding result. Are the numbers longer than that and being rounded to 2 decimal places? Even though they display rounded, the full number is calculated in formulas.

    My Feedback

    Ultima Ratio Regum - the final argument of kings.



  5. #5
    QUITTER Irving's Avatar
    Join Date
    Nov 2008
    Location
    Denver, CO
    Posts
    46,527
    Blog Entries
    1

    Default

    Quote Originally Posted by 00tec View Post
    Just tested on mine and got the same result.
    Really, or are you just messing with me because my post is vague?

    Quote Originally Posted by mattiooo View Post
    Sounds like a rounding result. Are the numbers longer than that and being rounded to 2 decimal places? Even though they display rounded, the full number is calculated in formulas.
    I thought it might be that, but I checked the same columns in different months and those numbers all came out correct. In this specific case it is all currency, so rounding shouldn't be an issue. I thought it might have something to do with the fact that the entire column is generated by taking a percentage of a number in the prior column, and that was somehow causing a rounding error, but again, I tried the same columns in other months and everything is fine. Further, the column is broken down into weeks. When I add the week totals together, everything works out. When I have time later tonight I'll see if I can post some screen shots to give a more clear picture.
    "There are no finger prints under water."

  6. #6
    Machine Gunner mattiooo's Avatar
    Join Date
    May 2006
    Location
    Erie
    Posts
    1,308

    Default

    Quote Originally Posted by Irving View Post
    I thought it might be that, but I checked the same columns in different months and those numbers all came out correct. In this specific case it is all currency, so rounding shouldn't be an issue. I thought it might have something to do with the fact that the entire column is generated by taking a percentage of a number in the prior column, and that was somehow causing a rounding error, but again, I tried the same columns in other months and everything is fine. Further, the column is broken down into weeks. When I add the week totals together, everything works out. When I have time later tonight I'll see if I can post some screen shots to give a more clear picture.
    Currency by default rounds up to the nearest penny, so my guess would still be rounding - for example:

    If you took 43% of $97.37, the formula is 97.37 * .43 you would get 41.8691, but in a currency column, that would display as $41.87. However under that display is still 41.8691, and that is what is used in subsequent formulas.
    Without seeing actual numbers, it's hard for me to say if that is what is happening to you, but that seems what is most likely to me.

    One way you can check is to change the formatting of all the currency columns or rows to numbers.

    Hope that helps.

    My Feedback

    Ultima Ratio Regum - the final argument of kings.



  7. #7
    Looking Elsewhere
    Join Date
    Oct 2012
    Location
    The Peoples Republic (Boulder)
    Posts
    3,145

    Default

    Quote Originally Posted by mattiooo View Post
    Currency by default rounds up to the nearest penny, so my guess would still be rounding - for example:

    If you took 43% of $97.37, the formula is 97.37 * .43 you would get 41.8691, but in a currency column, that would display as $41.87. However under that display is still 41.8691, and that is what is used in subsequent formulas.
    Without seeing actual numbers, it's hard for me to say if that is what is happening to you, but that seems what is most likely to me.

    One way you can check is to change the formatting of all the currency columns or rows to numbers.

    Hope that helps.
    This.. it displays the result as a rounded number but the original number remains behind the scenes to be used in any additional formulas.

  8. #8
    Self Conscious About His "LOAD" 00tec's Avatar
    Join Date
    Sep 2011
    Location
    Aggieland, TX
    Posts
    4,275

    Default

    Really. Did it once, then I went to grab a screenshot and couldn't get it to do it again.

  9. #9
    QUITTER Irving's Avatar
    Join Date
    Nov 2008
    Location
    Denver, CO
    Posts
    46,527
    Blog Entries
    1

    Default

    Quote Originally Posted by 00tec View Post
    Really. Did it once, then I went to grab a screenshot and couldn't get it to do it again.
    I knew it! Turns out mankind is just as responsible for math errors as rising temperatures.
    "There are no finger prints under water."

  10. #10
    Machine Gunner RblDiver's Avatar
    Join Date
    Feb 2013
    Location
    Longmont
    Posts
    2,130

    Default

    Quote Originally Posted by Irving View Post
    I knew it! Turns out mankind is just as responsible for math errors as rising temperatures.
    I forget the exact values, but in the game Mass Effect 2, an AI character Legion explains that the difference between his group (the "True Geth") and a splinter group (the "Heretics") is that a calculation that his group evaluates as 0.051 is evaluated by their group as 0.052.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •