HackerNews Readings
40,000 HackerNews book recommendations identified using NLP and deep learning

Scroll down for comments...

The Hobbit

J. R. R. Tolkien

4.8 on Amazon

102 HN comments

Animal Farm: 1984

George Orwell and Christopher Hitchens

4.9 on Amazon

101 HN comments

Good to Great: Why Some Companies Make the Leap and Others Don't

Jim Collins

4.5 on Amazon

100 HN comments

How to Lie with Statistics

Darrell Huff and Irving Geis

4.5 on Amazon

99 HN comments

A Brief History of Time

Stephen Hawking

4.7 on Amazon

98 HN comments

The Bell Curve: Intelligence and Class Structure in American Life (A Free Press Paperbacks Book)

Richard J. Herrnstein and Charles Murray

4.7 on Amazon

98 HN comments

The Mom Test: How to Talk to Customers & Learn If Your Business Is a Good Idea When Everyone Is Lying to You

Rob Fitzpatrick and Robfitz Ltd

4.7 on Amazon

96 HN comments

Influence: The Psychology of Persuasion, Revised Edition

Robert B. Cialdini

4.6 on Amazon

95 HN comments

Man's Search for Meaning

Viktor E. Frankl , William J. Winslade, et al.

4.7 on Amazon

94 HN comments

The Federalist Papers

Alexander Hamilton and James Madison

4.6 on Amazon

93 HN comments

Calculus Made Easy

Silvanus P. Thompson and Martin Gardner

4.5 on Amazon

92 HN comments

The Mind Illuminated: A Complete Meditation Guide Integrating Buddhist Wisdom and Brain Science for Greater Mindfulness

John Yates , Matthew Immergut , et al.

4.7 on Amazon

92 HN comments

Superintelligence: Paths, Dangers, Strategies

Nick Bostrom, Napoleon Ryan, et al.

4.4 on Amazon

90 HN comments

On Writing: A Memoir of the Craft

Stephen King, Joe Hill, et al.

4.8 on Amazon

90 HN comments

Rework

Jason Fried and David Heinemeier Hansson

4.5 on Amazon

90 HN comments

Prev Page 6/180 Next
Sorted by relevance

tester756onMay 7, 2021

>Personally I wouldn't trust a stastical model from someone who advertises that they own the book "how to lie with statistics" and obviously used it

why?

wsc981onApr 17, 2017

There's a well-regarded book on this matter that I still hope to read someday "How To Lie With Statistics": https://en.m.wikipedia.org/wiki/How_to_Lie_with_Statistics

Ah, just discovered the book can be read for free online: https://archive.org/details/HowToLieWithStatistics

oriettaxxonMar 17, 2017

Darrell Huff, in his "How to Lie With Statistics" says 3-d charts should never be used, since you can easily lie with them (by rotating it, e.g,)

leephillipsonJuly 5, 2015

This senseless insistence on beginning the vertical axis at zero is repeated in Huff's popular book, How to Lie with Statistics, where he also claims that failing to adopt this rule results in "misleading" graphs.

btillyonFeb 19, 2021

Wonderful. We now have research to prove what has been well-known and obvious for many decades.

After all this exact form of misleading graph was one of the topics in the famous book How to Lie With Statistics written in 1954. And I don't think that the observation was new then.

DoreenMicheleonOct 1, 2018

There is an excellent book on such things that I highly recommend: How to lie with statistics

Problems like this are part of why we have sayings like:

Measure twice, cut once.

GIGO (Garbage in, garbage out)

Some saying about measuring to extreme precision, then "cutting with an axe."

wscottonOct 6, 2020

This matching one of the original claims in the "How to Lie with Statistics" book (1954).
Storks like roosting on chimney pots and larger houses have more chimneys and more children.

MzonOct 19, 2015

AKA "garbage in, garbage out." If you like this piece, you might also enjoy "How to lie with statistics." There appear to be free copies currently available online: http://www.bing.com/search?q=How+to+Lie+with+Statistics+PDF&...

grumpyautistonMay 7, 2021

Yep, and it's a suspect one at best. Personally I wouldn't trust a stastical model from someone who advertises that they own the book "how to lie with statistics" and obviously used it

wyconOct 2, 2014

Reading: How to Lie with Statistics - Darrell Huff

A very entertaining read: throughout the short book, Huff satirically likens abusers of statistics to criminals.

mrutsonMar 11, 2019

How to Lie with Statistics is such a great book. It's amazing how relevant it is seeing it's over 60 years old. The same lies that were being told then are being told today with statistics.

simion314onNov 27, 2019

Still OP is right, compare Tesla with similar car of price and age , there is a cool book "How to lie with statistics" that shows you how easy it is to manipulate with bad statistics though I am sure many Tesla fans spread this wrong statistics due to ignorance and not intentionally.

DoreenMicheleonMay 25, 2021

The mean is what is often meant by the term but not always. "How to lie with statistics" is a great book and I highly recommend it to anyone still confused by such terms -- or anyone who ever sees, say, ads.

"There are three kinds of lies: Lies, damn lies and statistics" -- Mark Twain

nathancahillonApr 14, 2014

I highly recommend reading "How to Lie with Statistics"[0]. Old but still very relevant.

[0] http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/039...

DoreenMicheleonFeb 14, 2019

I will recommend the book "How to lie with statistics." Problem solving starts with understanding what's important. This book goes into the ways that people routinely use numbers to mislead, whether intentionally or not, and how to suss out what actually matters.

dandareonSep 18, 2018

Oh no, the very first diagram with the Y axes from 50% to 70% is like from the How to Lie with Statistics book.

Sorry, I will not continue reading this article.

MzonOct 23, 2016

A couple of good books:

How to lie with statistics (Good intro to concepts, light on actual math)

The cartoon guide to statistics (the first chapter or two covers what I learned in my college Intro to Stats class -- the rest is over my head)

therealdrag0onMay 27, 2020

I just read the short book "How To Lie With Statistics" this year and it holds up incredibly well despite being nearly 70 years old!

smartmiconFeb 19, 2021

This is neither new nor surprising. I recommend the little book "How to lie with statistics" by Darrell Huff, first published 1954. Chapter 5, called "The Gee-Whiz Graph" dives into the matter of truncated bar graphs (among others).

mkettnonFeb 6, 2020

on my reading list so far:
D. Huff et al - How to Lie with Statistics
J. Ellenberg - How Not to Be Wrong: The Power of Mathematical Thinking

IIRC Bill Gates recommended them.

therealdrag0onDec 14, 2020

No offense but consider reading the book "How to Lie with Statistics". Very education about how these sorts of numbers can pain different pictures.

gumbyonFeb 3, 2018

How to Lie with Statistics by Darrell Huff. How much of what you read is really true?

billswiftonAug 2, 2009

I read Huff's "How to Lie with Statistics" a couple of decades ago. It's a real eye opener, as well as being a short, easy read.

scribuonJan 6, 2019

You mean like Huff's "How To Lie With Statistics"?

https://en.wikipedia.org/wiki/How_to_Lie_with_Statistics

sytelusonNov 27, 2012

Some of these seems to be outright lies (like implicitly labeling X axis for different data points) but other techniques are just well crafted data illusions and covered well in books such as How to Lie with Statistics http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/039...

partiallyproonOct 28, 2017

You don't fake your stats, you tell something true that is impressive unless you look under the hood of how the number was formulated. That's how you can get away with it legally. There's a famous old book called "How to Lie with Statistics" (it's on Bill Gates' must read list) that explains some methods companies use.

billswiftonMay 27, 2009

How to Lie with Statistics (http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/039...) is a short, enjoyable read. It doesn't tell you how to do statistics, but it gives some warning about common problems.

icantdrive55onJuly 2, 2017

1. I wish they included the raw numbers.

2. How to lie with statistics, by Darrel Huff.

3. I don't know if there's a real problem. Articles like this should be illegial.

4. Maybe not illegial, but have all studies/advertisements include the raw numbers too.

MzonDec 12, 2012

Maybe you should acquaint yourself with a book called "How to lie with statistics". In a biased environment, there are lots of ways to harm with innuendo (and similar) and then claim no such thing was intended while continuing to deepen the damage, often intentionally and maliciously, sometimes obliviously.

(But have an upvote. I am pretty sure your intent was to be supportive.)

jjgreenonOct 6, 2016

If the data is 3d, no objection. If the data is 2d then a 3d plot is redundant, usually ugly and prone to mislead (see "How to lie with statistics" and anything by Tufte).

MzonJune 23, 2017

Thanks. Upon skim, this looks sort of like an app-specific re-hash of "How to lie with statistics" (an excellent book, btw).

Personally, I am more interested in finding some sort of meaningful info on how to make money on games or apps at all. Yes, I know it can be done. I am interested in figuring out how it is done.

mrslaveonJuly 24, 2020

I appreciate that on HN this article may provoke intelligent conversation, but this article is smells a lot like a "top N things you need right now" blog post where everything is an Amazon affiliate link.

(Edit: I was wrong about affiliate links. Not deleting to publically self-shame.)

The real data science would be producing articles like this automatically, and with good SEO, to drive revenue.

The list is OK. I've studied ISL (and some of ESL). A friend really enjoyed Think Stats. Charles Wheelan's book is in the same vein as How To Lie With Statistics (Darrell Huff?) but in greater depth.

I started with R because that's what my team was mostly using when I got into this area. Hadley Wickham's free books are good too.

mooredsonOct 9, 2019

Also suggest reading "How to Lie With Statistics".

Classic, short book about fundamental stats concepts everyone should know.

therealdrag0onJune 8, 2020

Do you really think that's apples to apples comparison?

Perhaps consider reading "how to lie with statistics".

eitallyonMar 26, 2015

MFK Fisher's The Art of Eating. It's currently my favorite book. :)

I would actively point teenagers away from Atlas Shrugged. While it might be enlightening, and they might enjoy the story, it has the potential to be quite destructive if they interpret her philosophy of objectivism & egoism in a way that leads them to apply it to their own lives. I just don't think this is a good idea. Her other novels, whether The Fountainhead or We The Living aren't nearly so overbearing.

Another one: How To Lie with Statistics

spikelsonJan 26, 2014

As best I can tell Tufte thinks "data dumps" are the best kinds of visualizations: "Above all else show the data". Unlike salesman, campaigners or reporters Tufte doesn't think good data visualization is about getting a response from the viewer. He thinks we should show the data as best we can so that the viewer can learn from it. I like to think of this as the viewpoint of a scientist or researcher.

This is a rather extreme perspective and probably not effective in most situations where data visualization is used. The techniques used in the famous book "How to Lie with Statistics" are actually mostly about data visualization and are much more practical. This explains their popularity and that of tools that emphasize them like PowerPoint.

From Tufte's point of view we have a lemons market in data visualization: "bad" visualization drives out "good" visualization because it is more effective[1]. Editors, businessmen and politicians will always choose the visualization that empasises their point (i.e. distorts the underlying data). While they are happy with the results Tufte is dismayed.

[1] http://en.wikipedia.org/wiki/The_Market_for_Lemons

mrslaveonMar 22, 2021

Darrell Huff - How To Lie With Statistics[0]. And the first chapter or two of David Spiegelhalter - The Art of Statistics[1] has a good example of absolute vs relative rates/probabilities with respect to medicine. Pretty basic an important issue to understand.

[0] https://www.goodreads.com/book/show/51291.How_to_Lie_with_St...
[1] https://www.goodreads.com/book/show/43722897-the-art-of-stat...

yborisonOct 1, 2019

A very-related classic reading on this is a short-and-sweet

"How to Lie With Statistics"

https://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/03...

hancheonFeb 19, 2021

Absolutely! I am happy to note that the paper does in fact reference How to lie with statistics in the introduction:

> While discussions of misleading graphs are not new (e.g., Huff, 1954), empirical research on their assumed consequences is scattered across fields.

So on the surface, at least, this looks like just another paper belabouring the obvious.

greenyodaonApr 21, 2019

See also the classic book How to Lie with Statistics: https://en.wikipedia.org/wiki/How_to_Lie_with_Statistics

majormajoronFeb 15, 2021

This is what you say about something that looks like "good news" above:

> Serious question: How do we know any of this reporting is true?

> There's no data sources provided, no way to check follow up health (i'e. what if these people all dropped dead a week later), no way to prove the data isn't a complete fabrication, etc. Also, they make sure to use dynamic terms so we can't be sure these numbers have any valuable meaning at all (e.g. were Covid tests with drastically different cycle counts used?). Not to mention all of this reporting is praising a single vaccine producer in a billion dollar industry.

> I just read "How to Lie with Statistics" by Darrell Huff and this whole thing is the epitome of a manipulatable situation.

Combine the two and you no longer look "hey lets make sure people aren't lying to us," you just look like you have your own agenda.

So if you can lie with statistics, you can certainly lie even more with claimed anecdotes...

(The point of a vaccine is to trigger and train the immune system. The immune system revving up can cause symptoms of its own. If you get the fever of the immune system responding, without the lung damage cause you don't have the original actual virus, that's a huge win!)

ubermanonJan 22, 2021

I love how item 2:

2. How trust in media can be regained

presents a chart labeled:

Percentage of Americans who trust traditional media

that has a Y-Axis from 45% to 60% rather than 0% to 100% in order to magnify their claims.

I'm not saying there is no media trust issue in America, but using clearly biased charting techniques taken right out of the book "How to Lie with Statistics" (by Darrel Huff) is not the way to instill trust.

PietertjeonDec 23, 2015

I'll skip some mentioned already by others. Books I really enjoyed this year:

The Wright Brothers, David McCullough - wonderful book on the Wright Brothers, easy to read, shows that persistence and logic thinking pays out. 5/5

The autobiography of Malcom X, Malcolm X - Nice bio, a bit repetitive sometimes. 3/5

Atlas Shrugged, Ayn Rand - Although the book has more than 1200 pages it really kept me going. I read this book to get a better understanding of the ideology of some republicans. Fun read. 4.5/5

Freakonomics, Steven D. Levitt - Levitt studies all kind of different everyday questions using economics. 4/5, short, easy to read

Guantanamo Diary, Mohamedou Ould Slahi - Diary of a Guantanamo prisoner who has been imprisoned since 2002. The US has never charged him with a crime. Profound and disturbing. 5/5

No place to hide, Glenn Greenwald - Story on Edward Snowden, probably read by most of HN. Enjoyed it, that's it. 4/5

How to lie with statistics, Darrel Huff - Short book on statistics, easy to read and fun. 4/5

mooredsonOct 11, 2018

I read "How to lie with statistics" and had the exact same experience.

microtheriononMay 22, 2018

"Getting to Yes" and "Getting Past No".

"A Pattern Language" by Christopher Alexander.

"The No Asshole Rule".

"How to Lie with Statistics".

jacques_chesteronFeb 19, 2015

There's a whole chapter on mathematically troublesome graphics in How To Lie With Statistics.

greenyodaonFeb 7, 2014

Note: The article contains a link to a PDF version of the classic book How to Lie With Statistics:

https://archive.org/details/HowToLieWithStatistics

mathattackonNov 5, 2013

I like that he references Huff's "How to lie with statistics" in the first sentence of the intro. That was the book that came to mind when I saw the subject. Also reminds me of the Twain quote, "There are three types of lies: Lies, Damned Lies, and Statistics."

But despite this, statistics done well are very powerful.

MzonMar 15, 2016

I am glad it was noted. I don't really have time to read this (edit: and the comment by jacobolus saves me the effort). I have good empathy and social skills and innate math ability. My ex husband and our oldest son both suck at all three of those.

I think it is entirely fair to say that some oddball subgroup is skewing the results. It is no different from discussing mean, median and mode in real estate data.

Ever heard of the book "How to lie with statistics"?

xhedleyonMay 7, 2021

The book "how to lie with statistics" (1954) was written before tags like /s were invented. Referencing "how to lie with statistics" is an indicator that the author is trying to avoid common pitfalls in statistical reasoning.

I own an inherited blue Pelican paperbook copy from my pharmacist grandfather.

https://en.wikipedia.org/wiki/How_to_Lie_with_Statistics

DoreenMicheleonDec 9, 2017

I can't manage to read the whole thing. It starts from an assumption of guilt and corruption. It is looking for support for an accusation. Such an agenda does not make for good science.

Don't get me wrong. I would be very interested in finding real solutions for the tendency to see Blacks gunned down by the police. My assumption is this known trend is the driving force behind this piece.

I just think this is the wrong way to approach the problem space.

How to lie with statistics is an excellent book. I highly recommend it. It is a large factor in my decision to not bother to read this piece too thoroughly.

HarkinsonMar 28, 2018

This is blogspam ripping off this site and the link should be changed: http://www.wirepoints.com/illinois-state-pensions-overpromis...

The authors of this report are former employees of the Illinois Policy Institute: http://www.wirepoints.com/mark-glennon/ https://www.illinoispolicy.org/author/ilpoliski/

The Illinois Policy Institute is, politely, a conservative think tank: https://en.wikipedia.org/wiki/Illinois_Policy_Institute

The full report plays a lot of games to produce these striking, misleading graphs, like comparing yearly numbers with total values of all future pension liabilities at face value instead of any attempt at NPV. If you're curious to spot more, the 1993 edition of How to Lie With Statistics chapter 7 ("The Semi-Attached Figure") and 9 ("How to Statisticulate") are a lighthearted read.

MzonDec 6, 2015

When they were still in elementary school, I pulled my two sons out of school to homeschool them. My oldest hated math because of his negative school experiences. My only goal was to teach him "math is your friend." I eventually succeeded.

So it is possible to get past this, if you want.

I had my sons play math based games, read math books full of paragraphs and not problems, and so on. You might try engaging in math as recreation. Read books like "The Number Devil" and "Alice in Flatland" and "The cartoon guide to statistics" (or any cartoon guide book ever on any subject, because they are all basically awesome) and "How to lie with statistics."

Try to figure out what pieces make you stressed and look for a way to fix that piece of it. For example, if it is about dealing with people face to face, then email them an answer. Something like that can help break the pattern of stress and help you reboot your emotional relationship to the subject.

Best of luck.

DoreenMicheleonDec 2, 2019

Most people mean mean when saying average.

It stuck with me because it's a nutshell version of the book "How to lie with statistics" in a humorous and highly memorable form. Someone with one breast, one testicle and a little penis would be a bizarre statistical outlier for the human race, but "mathematically" speaking, it's an accurate description.

It speaks to a lot of common errors of logic and it's pithy.

wodenokotoonSep 22, 2020

Tim Harford is a defender of statistics and in the wake of releasing his new book he has been on a publicity tour of all your favourite maths channels on Youtube.

Particularly I recommend his visit on numberphile, where he gives a scathing critique of "How to Lie with Statistics"

[1] https://www.youtube.com/watch?v=-n-d1ApBTFw&t=3s

DoreenMicheleonSep 7, 2018

I will note that my framing comes directly from something I saw somewhere. So my understanding is that it was intended a certain way.

There's a great book called How to lie with statistics. It makes a lot of excellent points about how framing the same data differently can support different conclusions.

So, some thoughts:

Law makers who passed it may not have realized the average 65 year old would live another 12 years. They may have only known average life expectancy was 67.

Six years longer may not sound like much, but it's 50 percent longer. That can have significant repercussions.

MzonMar 8, 2017

What you describe is what the book "How to lie with statistics" covers in detail. It is a great read. I highly recommend it.

A lot of so-called facts are just blurbs intended to support someone's manipulative agenda. Sadly, this is even true of this article. Towards the end, it begins making ugly political commentary instead of sticking to psychological phenomenon.

The people who claim to have science on their side are often merely claiming to be intellectual elites and implying that anyone who disagrees with them is an idiot. It isn't scientific at all. So, it is unsurprising that it does not go over well with people who are basically being called stupid by people more interested in winning the argument themselves than in trying to have a meaningful discussion of good information.

MzonApr 1, 2014

I am vaguely reminded of a recent discussion* about negotiating with Steve Jobs where kind of the reverse point was made: The author was advised to make the number fit the scenario Steve claimed he wanted. The author did so, creatively, without lying.

A lot of people do not understand the substance behind the numbers and this leads to garbage in, garbage out. That's what this article is about: Understanding what's behind the numbers and not being fooled by them. The previous piece was also about understanding the substance and knowing how to work the numbers to make other people happy with the proposed deal.

A good read on similar topics: How to Lie with Statistics.

* https://news.ycombinator.com/item?id=7451018

MzonJuly 12, 2017

Well, I actually liked math and took kind of a lot of it in K-12. I was in my 30s before I knew there were actual applications for some of the things I memorized my way through without really understanding.

When I homeschooled my sons, I knew this approach would not work. My oldest has trouble with numbers, but he got a solid education in the concepts. He has a better grasp of things like GIGO than most folks. We also pursued a stats track (at their choice) rather than an algebra-geometry-trig track.

Stats is much more relevant to life for most people most of the time and there are very user-friendly books on the topic, like "How to lie with statistics." If you are struggling with this stuff, I highly recommend pursuing something like that.

hnnewguyonMay 14, 2015

>The scale on the first plot is a bit disingenuous

It isn't really disingenuous. It's become fashionable to claim that "all graphs should start at zero", but that's not necessarily how you display data. Here is Edward Tufte:

"In general, in a time-series, use a baseline that shows the data not the zero point. If the zero point reasonably occurs in plotting the data, fine. But don't spend a lot of empty vertical space trying to reach down to the zero point at the cost of hiding what is going on in the data line itself. (The book, How to Lie With Statistics, is wrong on this point.)"

He's talking about time-series in this case, but the point remains: you need to understand the data. Sometimes (as in this case, where the trend is important, not the magnitude of change) showing the "zero" point is irrelevant.

capnrefsmmatonJan 31, 2019

Those interested in How to Lie with Statistics may also enjoy Huff's other book, How to Lie with Smoking Statistics, commissioned by the tobacco industry in the 60s to fight the growing evidence that smoking causes cancer. It was never published, but I compiled the surviving manuscript and wrote about it: https://www.refsmmat.com/articles/smoking-statistics.html

defrostonFeb 8, 2013

If she hasn't done it already or else if she's forgotten it would be a good idea to sit in on a first year linear algebra and or statistics class.

Matlab (and/or numpy / sage / any of the "math" packages) work best performing operations on vectors and matrices of data (long strings of values / grids & cubes (&hyper cubes) of values ).

Expanding on the "little mathematics background" is more important than the "no matlab" issue, one follows from the other.

If she's headed into epidemiology and other such areas then make sure she's read "How To Lie With Statistics" at the very least.

dmlorenzettionDec 30, 2013

Check out "Physics for Future Presidents" by Richard Muller. It gives an overview of physics, emphasizing why the concepts are important in the modern world, rather than the math details.

If she's interested in biology, you might consider "Animals in Translation" by Temple Grandin. It's more about animals than about technology, but it touches on how understanding animals affects the low-tech systems that you use to handle them.

For interesting/easy intros to why some math skills are important, look at Darrell Huff's "How to Lie With Statistics" or John Allen Paulos' "Innumeracy" (or "A Mathematician Reads the Newspaper").

I haven't read any of them, but I hear Petroski's books recommended.

For a great short read that touches on architectural engineering, law, and ethics, look for Joe Morgenstern's "Fifty-Nine Story Crisis" which appeared in the New Yorker in May 1995. It's about how the structural engineer for the Citicorp tower realized its design was flawed, after the tower had been built and occupied. You can find it on the web.

Some of these are not overtly about "learn this technology", but to me they all sell the idea of technology and science as both central to our lives and interesting.

capoonOct 3, 2012

Weirdly enough the fact that this is a marketing campaign by Microsoft seems to be ignored when considering the numbers in the press release. There is also the curious omission of the percentage of people who found Bing to be “better” than Google.

Any reaction to Bing could have been a result of people being exposed to it for the first time not necessarily it being the “better” option. It also could be that people are having a positive impression simply because it’s not as bad as they imagined it would be, as indicated by this claim: “64% of people were surprised by the quality of Bing’s web search results.”.

Also there is the matter of the ridiculous disclaimer about the features being omitted in the side-by-side as if they aren't integral to the search experience, not to mention that seemingly all queries to Google appear to be originating from Seattle which degrades the quality of local queries by user located elsewhere.

On a related note I recommend reading the How to lie with statistics book, it's required reading especially when outlets copy/paste press releases:
http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/039...

valhallaonAug 14, 2015

"How To Lie With Statistics" by Darrell Huff. It's a pretty old book (1954). But it talks about the most common uses of statistics in everyday life (marketing reasearch and infographics showing extrapolating trends inaccurately) and how the results are often gathered carelessly. Here's a short review by Bill Gates: http://www.gatesnotes.com/Books/How-to-Lie-with-Statistics

DoreenMicheleonNov 9, 2020

How to Lie with Statistics and The Cartoon Guide to Statistics might interest you.

jb775onFeb 15, 2021

Serious question: How do we know any of this reporting is true?

There's no data sources provided, no way to check follow up health (i'e. what if these people all dropped dead a week later), no way to prove the data isn't a complete fabrication, etc. Also, they make sure to use dynamic terms so we can't be sure these numbers have any valuable meaning at all (e.g. were Covid tests with drastically different cycle counts used?). Not to mention all of this reporting is praising a single vaccine producer in a billion dollar industry.

I just read "How to Lie with Statistics" by Darrell Huff and this whole thing is the epitome of a manipulatable situation.

dangrsmindonFeb 26, 2007

This article could be a chapter in the book How to Lie with Statistics.

It is clearly a biased sample, listing only "successful" companies but not the much larger set of unsuccessful ones. The "exception" of Excite thrown in with 6 founders, IMO makes the author's intentions (conscious or unconscious) clear since one would expect some argument about whether Excite was really a success in the end.

Then there is the question of what constitutes a founder. This isn't always so easy to define. How many people founded IBM?

Despite Thomas Watson being listed as the "founder" of IBM, it is hard to even answer this question since IBM was formed out of the merger of three companies before it was even called IBM. (http://www.answers.com/topic/history-of-ibm)

Several responders pointed out correctly that the number of potential communications channels rises as the number of founders increases. And while that's clearly true, it is also true that more founders means more mouths to feed early in the company's development. And to run any business you need to learn to manage communication amongst your team.

Finally, one has to be careful not to confuse correlation with causation. Just because Microsoft was founded by two people, doesn't mean that was the primary reason for their success. It might also have had something to do with who the two people were after all. ;)

DoreenMicheleonFeb 26, 2020

Studies get created by people with their own biases. Historically, IQ tests were used to insist that people of color were inferior to whites, not because it's true but because it served the agenda of racist whites.

Social phenomenon are inherently hard to study in some kind of objective fashion. People will give the answers they know are expected of them in a world that is openly and unapologetically hostile to them.

"How to lie with statistics" is one of my favorite works. Two people with different points of view can look at the exact same data and reach completely different conclusions about what the data means.

Humans are incredibly prone to confirmation bias. Humans look for the data that supports their existing world view and hand wave off data that conflicts with it. This is a very well known phenomenon.

Edit in response to your edit:

We’ve had this discussion before months ago. We can just agree to disagree.

Sure. I don't recall discussing it with before and I didn't start this discussion. You did. You chose to reply to something I said here, knowing we've discussed it before and we don't agree.

So calls to "agree to disagree" sound a bit like I should just shut up and let you have the last word.

I'm not rebutting every single comment in the discussion of the article I wrote. If you didn't want to actually talk to me in specific, you absolutely didn't have to.

mcguireonSep 2, 2015

"New York University economist Paul Romer recently complained about how economists use math as a tool of rhetoric instead of a tool to understand the world."

It's possible to love numbers and still not be interested in empirical data. One thing you may notice about much raw economic data is that it was selected because (a) it was easy to collect, or (b) it gives "reasonable results" according to the accepted theory.

See also How To Lie With Statistics.

Acrobatic_RoadonJuly 9, 2021

This guy has read "How to lie with statistics".

nathancahillonJan 24, 2014

How does 365 data points give your conclusions any sort of statistical significance? Snapchat's numbers are allegedly over 30M, Facebook's are over 1.2B and Instagram's are 150M.

I suggest reading "How to Lie with Statistics"[1]

[1] http://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/039...

Edit: I guess that sounded a little harsh. No doubt, Snapchat's growth has been explosive and if this was just another blog-spam post about that fact, I'd let it be. But you're selling a statistical software! I'd expect better from people who know what they're doing. Also, "How to Lie with Statistics" is a really good book, should be required reading for anyone dealing with numbers. Did not mean that as an attack on your product.

cromulentonOct 24, 2010

Edward Tufte agrees with you:

Baselines

In general, in a time-series, use a baseline that shows the data not the zero point. If the zero point reasonably occurs in plotting the data, fine. But don't spend a lot of empty vertical space trying to reach down to the zero point at the cost of hiding what is going on in the data line itself. (The book, How to Lie With Statistics, is wrong on this point.)

For examples, all over the place, of absent zero points in time-series, take a look at any major scientific research publication. The scientists want to show their data, not zero.

The urge to contextualize the data is a good one, but context does not come from empty vertical space reaching down to zero, a number which does not even occur in a good many data sets. Instead, for context, show more data horizontally! .

-- Edward Tufte, October 18, 2001
http://www.edwardtufte.com/bboard/q-and-a-fetch-msg?msg_id=0...

briantakitaonJuly 19, 2021

A major investor & leader in healthcare that shall remain unnamed had a book "How to Lie with Statistics" in a public reading list. It's a good book & a quick read. Highly recommended.

It's interesting that it takes an editorial to make people suspicious of statistics, how statistics can be abused, & the conflicts of interests that many people who utilize statistics have. Sample bias needs to be treated as deliberate dishonesty rather than a simple mistake. These people who make these mistakes are professionals and should know better. Their code of conduct should penalize them harshly for making these sort of mistakes.

A strict code of conduct with harsh professional penalties are necessary to remove bad actors who hide behind subtle lies that have a major impact on public policy & public opinion. A slap on the wrist means it's always worthwhile to lie with statistics. A removal of license & banishment from the profession on the 1st or 2nd offense would quickly remove the bad actors. This code of conduct should also extend to the peer review process. If the peers pass bad statistics, the peers need to be held accountable as well.

IvyMikeonFeb 23, 2014

Those who have not read "How to Lie With Statistics" are doomed to reinvent it.

https://archive.org/details/HowToLieWithStatistics

habermanonOct 24, 2010

> The book, How to Lie With Statistics, is wrong on this point.

Ugh, the more I read of Tufte the less I like him. He loves to make blanket statements (like calling a point "wrong") in an authoritative way, and he's amassed enough adoring followers that people repeat his words like gospel instead of calling him on it.

It's valid to say that a non-zero-based scale shows the data better. But it's also completely valid to note that non-zero-based scales can be used in alarmist ways to make data extremely misleading.

I thought "The Visual Display of Quantitative Information" was terrible, and I went in really wanting to like it: http://www.amazon.com/review/R11NYC3OE3LBE

hyperbovineonFeb 11, 2012

While it's true that sport scouting has traditionally under-relied on data, I wouldn't be so quick write the entire profession off entirely in favor of spreadsheets. Statistics can certainly be made to lie (cf. the book, "How to lie with statistics"), and there are a lot of aspects of human performance that are difficult to quantify. Performance under pressure is the first thing that comes to mind--reliably sinking a buzzer-beating three-pointer is a harder and more valuable skill to possess than just being a good shooter from beyond the line. You could try to quantify "performance under pressure", but a good scout will pick that up intuitively and probably do a better job of it. As always, the truth lay somewhere in the middle; a combination of both data and human input seems to be the best course.

akg_67onAug 13, 2015

Based on the books mentioned in your post, I assume you are looking for light readings on statistics and probability. You might enjoy following books.

* Darrell Huff, Irving Geis How to Lie With Statistics

* Ian Ayres Super Crunchers Why Thinking-by-Numbers Is the New Way to Be Smart

* David Salsburg The Lady Tasting Tea How Statistics Revolutionized Science in the Twentieth Century

* Emanuel Deman, Models Behaving Badly

* Benoit Mandelbrot, Richard L. Hudson The Misbehavior of Markets A Fractal View of Financial Turbulence

* Nassim Taleb, Fooled by Randomness

MzonSep 28, 2015

A) I did say up front that I wondered what the other numbers are that Sam is not putting in the article -- the other half of the picture. I have, in fact, read "How to lie with statistics" and I am well aware we are being intentionally given a certain framing from a party with a vested interest.

B) However, I also lived in the bay area at one time, in Solano County, and was pursuing education with an eye towards going into some kind of urban planning related career. In fact, I founded and moderated a subforum for a time on the most successful urban planning forum around at that time. So I have some familiarity with how crazy prices were back then, before AirBnB was a gleam in anyone's eye. And also I have some familiarity with the various factors that go into forcing housing prices up. Saying AirBnB contributes to the problem is not crazy talk. But acting like they are the single most important factor meriting the passage of a bill intended to kill them off -- I want a tad more data than "But look at the crazy high local housing prices, man!" Because that falls far short of proving they are having that big of an effect.

C) Yeah, I am very familiar with the saying. I am well aware of how hard it is to be both profitable and ethical. So far, I have managed to be pretty ethical. I am also dirt poor. So I am a little tired of hearing that anyone making money is clearly The Devil. The fact that this is part of a pro AirBnB PR campaign does not ipso facto make it inherently evil. The other side is also engaging in a PR campaign, and they also have vested interest that you can put a dollar amount on. Sometimes, people are actually doing work they actually fucking believe in. Those people still need to EAT and put a roof over their head. I am so goddamn sick of the idea that all the good people are dead martyrs and, if you still draw breathe, you need to feel guilty about every single fucking thing you do to try to keep body and soul together.

lordnachoonNov 24, 2020

I have actually met medical doctors who believed in homeopathy. My point isn't that they wouldn't exist if things were taught properly.

For a start, schools could teach people about how we actually unravel truths from statistics. It's a bit unfortunate that one of the most famous books in the area is called "How to Lie with Statistics". But all those things you mention, did you learn them in school? No, you tend to learn the conclusions but not the reasoning behind.

dredmorbiusonOct 10, 2013

How to Lie With Statistics (1954) predates Tufte by quite a bit.

DoreenMicheleonFeb 10, 2020

I don't see any reason to believe that's the explanation. The counter example is programming which went in the opposite direction: It began as female dominated and was not deemed to be important and yadda and later became male dominated and now it is well paid and so forth.

So why didn't pay for programmers plummet when "supply doubled" because we added men to the equation?

I'm happy to entertain explanations like "Well, whether it is PC or not, everyone knows women end up doing the housework. So the reality is that men typically have more time, energy and mental focus to offer, so it's not unreasonable to think they will bring more to the table."

But please don't give me mathematical BS explanations that don't fit the data. I've had a class in statistics and I've read plenty of statistics books, including a great classic called "How to lie with statistics." Math doesn't really explain the gender based outcomes that have been well documented for decades at a minimum.

mechanical_fishonJune 5, 2008

On the original page, commenter Kim has a hypothesis:

Essentially, all results from Google Trends are normalized.... More and more non-technical people are using google and thus the percentage of searches for programming declines.

Sounds reasonable to me. These graphs don't even have units on the Y axis. They're useless without some idea of what they're measuring: absolute or relative numbers?

Somebody needs to read How to Lie With Statistics.

DanBConMar 10, 2012

I'm uncomfortable with naming a nation. Especially with the US cultural thing of "polish jokes". But the article needs a nonsensical bureaucratic system, and CCCP communism provides an excellent example.

I agree with you that a poor metric will do harm, and that there are plenty of examples in "western" manufacturing. (I used to work in electronic sub contract manufacturing, and I saw the nonsense that was ISO900x documentation.)

Going further, there are a few things which need new names.

"Mexican Bridge" - there's a four lane road bridge and politicians want to improve traffic flow so they remove the lines and paint more, turning it into a 6 lane bridge. That's a 50% increase in lanes, but now they are narrower and so there are more accidents. The politicians decide to go back to four lanes. That's a 33% reduction. Because they are politicians they call this a 50% - 33% = 17% increase. (This is from "How to lie with statistics", a great book with occasional uncomfortable language.)

"Chinese Whispers" - the childhood game where one child starts by whispering a sentence to her neighbour, who whispers it to his neighbour, etc, and then at the end of the chain you compare the original with the final sentence. I've heard this called "Broken Telephone"; but no-one (in the UK) knows what I mean when I call it that.

"Indian Giver" Louie CK does an excellent routine on this.

And then there are other things which are fine, but which some people think aren't: "Nitty Gritty" (nothing to do with slave trading ships) "Chinese wall" (in business, no racist connotation) etc.

pokoleoonMar 27, 2016

For more reading on the topic, I'd recommend "How to Lie with Statistics"[0]. It's a short read (144 pages), with mainly tongue-in-cheek instructions on how to mislead.

Most of the usual tricks ('drop the axes', percentage-points, etc) are there, but there are many other, less obvious tricks.

One of the cooler arguments in the book is that it's easy to lean on someone's implicit assumption of volume to modify their understanding.

If you inflate a 15% increase in house spending to look larger than it is, drawing pictures of houses that are 15% wider will make people intuit a 50%[1] increase, despite reading 15%. The author suggests that even if you're incredibly clear with the text surrounding the charts, people still use the charts to understand the scales of change.

[0] http://amzn.to/1RmCVmL (disclaimer: affiliate link)
[1] 1.15^3 ~= 1.5

kvcc01onJune 4, 2015

I work in quantitative finance and find that basic probability and statistics help a lot in this field. In fact, they are almost like prerequisites for hiring.

That said, I think everyone would benefit by reading a bit about these subjects, whether or not they’re developers. We seem to have a built-in tendency to underestimate the effect of randomness in life (see Fooled by Randomness and How to Lie with Statistics). To counteract that, I find statistical methods (e.g., hypothesis testing, confidence intervals, etc.) to be very useful tools to keep in mind. Having basic familiarity with such tools may not necessarily make us better programmers but it'll probably make us more rational decision makers in the general sense.

Kurtz79onMar 11, 2019

I was wondering as to why it was never published.

From the linked article:

"There are many possible explanations for the sudden demise of Huff’s book.
The industry realized in 1968 that it had a credibility problem: the public
was unlikely to trust a book funded and promoted by the Tobacco Institute.
Perhaps the campaign was shelved after Tiderock closed up shop. Perhaps it
was too late—some tobacco regulations had already been passed, others were
inevitable, and new tactics were needed. Or perhaps the thought of legal trouble made them retract their offer to advertise the book, making Macmillan kill
the project.
But Macmillan was on the brink of signing a contract with Huff. Did
they have second thoughts, or was Huff told to kill the project? Or were the
Tiderock consultants correct in their assessment that “this mass of verbiage
needs drastic editing” and was unpublishable without serious revision?
The Documents Library offers no clues. Only documents produced or
received by the industry are included, so any correspondence between Huff
and Macmillan may not appear. Andrew Gelman, professor of statistics at
Columbia University, reviewed the ethics of Huff’s involvement with the industry and suggested Huff could have intentionally killed the project to save
his own reputation, which would have been destroyed by his association with
tobacco.2 But just a few months before the book’s demise he had been fighting for a prestigious hardcover and better royalties.
Whatever the reasons, How to Lie with Smoking Statistics went unpublished, protecting its better-known sibling How to Lie with Statistics from guilt
by association."

Would the original book have commanded the same respect, if associated with another which would bascially be an example of what the first was meaning to expose?

throwawayswedeonJuly 13, 2021

Your comment starts with a disingenuous sentence, and continues to show a level of bitterness I've seen before in people who believe themselves to be more knowledgeable/experienced than their surroundings (or they actually are), but never got a chance (or so they believe).

I didn't claim to know everything there is to know about statistics and research in general, but I think I know enough to tell that this is not a study, but a marketing campaign for whatever this usehaystack thing is.

> First, they should have tried to poll around 400 people (and perhaps they did!),

If you had read the article, you would have known that that's not what they did.

> By typical polling standards (95% confidence interval, random sample from filtered population), we expect that 77-89% of UK software developers are actually burnt out. That is still three out of every four people in the industry!

Do I understand correctly that you've worked on this? That certainly explains the hostility, but nevertheless.

> we expect that 77-89% of UK software developers are actually burnt out.

That's not what the link/study says.

> That is still three out of every four people in the industry!

This is absolutely wrong, without a shred of a doubt.

I recommend that you read: How to lie with Statistics by Darrell Huff.

mechanical_fishonSep 9, 2008

A snapshot of my bookshelf's "math" section, which really hasn't changed much since I was in high school and hadn't taken calculus:

W.W. Sawyer, What is Calculus About? and Mathematician's Delight

Courant and Robbins, What is Mathematics?

Hogben, Mathematics for the Million

Steinhaus, Mathematical Snapshots

Ivars Peterson, The Mathematical Tourist

Davis and Hersh, The Mathematical Experience

Polya, How to Solve It

Huff, How to Lie With Statistics

McGervey, Probabilities in Everyday Life

Raymond Smullyan: The Lady or the Tiger, Alice in Puzzle-Land, others

Anything by Martin Gardner. I happen to have picked up Mathematical Magic Show and Mathematical Circus, but I'm sure there are many other collections.

I also recommend cryptography stuff. David Kahn's The Codebreakers is not really a math book, but it is awesome and it stars mathematicians, as does Simon Singh's The Code Book. You could read Schneier's Applied Cryptography.

This is HN, so I would be remiss if I didn't point out that you can learn a lot of fun and useful math by reading SICP, Knuth, or any good algorithms book.

If anybody out there knows a good, spirited statistics book addressed to someone who knows calculus, tell me. I keep planning to go through Fundamentals of Applied Probability Theory but I never get around to it; see "Related Resources" here:

http://ocw.mit.edu/OcwWeb/Electrical-Engineering-and-Compute...

Having said all of that: I have a Ph.D. in physics/EE, so I've got to tell you, if you haven't tried calculus you haven't lived. ;) I'm not sure how to go about learning calculus in a fun way for a mathematician -- I took fairly standard first- and second-year college courses in calculus and physics and learned it that way. The folks on Amazon seem kind of enthusiastic about Spivak:

http://www.amazon.com/Calculus-Michael-Spivak/dp/0914098918/...

drcubeonJan 25, 2013

If I recall correctly, this was the first lesson in Darrell Huff's "How to Lie With Statistics". Exploit the ambiguity in the word "average", which can mean median, mode, or mean at different times.

Not that I think you or the article is lying. But I think you are confused by the article's use of the word "average". To you, it means "mean". To the article, it means "median". If you had both used the word you meant, there wouldn't be an issue.

itcrowdonSep 11, 2019

If you want a college textbook, there are literally hundreds with titles similar to "introduction to probability and statistics" and you should choose the cheapest second hand book you can find (or that they have in your library). Content is mostly the same, of course the writing style will be different and some may be more appealing to you personally. Search engines are your friend for narrowing down your list.

For a popsci work, you could check out "how to lie with statistics", a classic.

https://en.m.wikipedia.org/wiki/How_to_Lie_with_Statistics

cpercivaonApr 5, 2009

This article should be subtitled "How to lie with statistics". The author is comparing absolute numbers of bank failures over time, and completely ignoring the fact that not all bank failures have the same impact. In particular, if a failed bank has 100 times as many customers, its failure will affect 100 times as many people -- and the failing banks of 2008/09 are much bigger than the failing thrifts of the 80s and 90s.

DoreenMicheleonFeb 29, 2020

Do you have a citation for the desert bloom?

It was something I saw in a print magazine a long time ago. I can't cite it.

It's easy to pull out a single phrase, like "never celebrated," and nitpick it. In comparison to the handwringing in the news at the time about the imminent global catastrophe we were facing, the success of getting it out out and averting the level of global atmospheric catastrophe that was expected wasn't really celebrated.

We did the same with Y2K. The world expected a financial meltdown. People were stockpiling guns and give years of flour in their basements and then it became "Gosh, I can't program my VCR."

We take success for granted. We don't celebrate that we have 7 billion people with long life expectancy and high standard of living compared to 200 years ago. Instead, we complain about overpopulation and global warming and how we are hurtling towards our doom.

"How to lie with statistics" is a terrific book about how we can take the same data and say different things with it. We tend to frame it quite negatively.

In the end, none of us is getting out of here alive. We're all just dancing on this Earth for a short while.

There are people literally trying to find ways to solve death and wondering if we can be frozen and brought back and so forth. We're never satisfied and there's some evidence that it's partly because we choose to focus on the negative and with 7 billion people there no shortage of bad news, but not because things are necessarily actually worse in absolute terms.

mechanical_fishonOct 13, 2008

Ignoring the window dressing about the health risks of extreme low-fat diets (which are real, and there's plenty of better writeups on them) this is an article about Vitamin D. And the question you have to ask when you see an article like this is: What's the groundwork-to-hysteria ratio? I see plenty of hysteria here, but no data. There's one cited reference to the scientific literature... but it's on a different subject.

There's nothing wrong with hypothesizing that (a) modern medical practices are leading to deficiencies in Vitamin D among certain populations and (b) Vitamin D deficiency is linked to autism. But the responsible next step is to get some good data, or at least link to some. It's not to write stuff like this:

Since the 1970's, our country has witnessed a 3000% increase in the sales of sunscreen products, alongside a 30% increase in deaths from melanoma[17]. Isn't it time to admit that sunscreen is not working?

This is a telling paragraph. It tells me that the author is prone to making mistakes straight out of Darrell Huff's How to Lie With Statistics: Clock A strikes midnight a few seconds before clock B; isn't it time to admit that A caused B to strike?

Autism seems to be one of those issues that really inspires the quack epidemiologist. When you combine it with the opportunity to lecture new mothers -- our culture's favorite vice -- the temptation becomes irresistable. But it's worth remembering that actual epidemiology is really hard. Diagnosing autism without bias is hard. Randomly sampling the population for autism is even harder. Even something relatively simple, like measuring Vitamin D levels in the blood, is tedious and expensive and difficult to do without bias. But just because anecdotes and handwaving are much easier doesn't make them more believable.

kriroonFeb 2, 2017

On a somewhat related note, I think it's interesting that there is data on how people perceive information but that isn't really taught in descriptive statistics (at least it wasn't at my university). I feel like data representation and charts/graphs should be more of a focus if the title of the class is descriptive statistics. I hadn't even heard about "How to Lie with Statistics" or "The Visual Display of Quantitative Information" before randomly finding them mentioned somewhere. I simply learned about some standard graphs without much explanation on why you use them or how they impact the understanding of the audience.

drallisononMar 27, 2017

Fooled by Randomness,first; and The Black Swan (2nd edition) second. These are books about statistics and decision theory. They might not meet some people's expectations about "non-technology" which usually means no equations and no mathematical reasoning. While not written by Taleb, How to Lie with Statistics by Darrell Huff makes a good introduction for Taleb's books.

dmlorenzettionFeb 11, 2011

For a while I helped out at a local high school, in a class on basic computer skills. The one thing I did that really seemed to engage the kids was an exercise drawn from the book on which this article is based-- Huff's "How to Lie With Statistics".

The exercise was to take a set of data and make two graphs, one demonstrating a point and the other demonstrating its opposite. I think the data had to do with student test scores over the years-- they had to prove that scores were going up, and that they were going down, by their choice of what to plot out of the dataset.

I really liked working with that book in the class. Its form factor makes it non-intimidating, not like a textbook. And I felt like the title added a frisson of transgression.

Built withby tracyhenry

.

Follow me on