a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment by deanSolecki
deanSolecki  ·  3431 days ago  ·  link  ·    ·  parent  ·  post: A Quick Puzzle to Test Your Problem Solving

I don't like this.

Not because I got it wrong, (which I did,) but because I can't imagine how I would have gotten it right.

It is very, very, difficult to narrow down to "the numbers must be ascending" because you have to EXCLUDE so many patterns first. Even if you set out under the impression that the rule was just that the numbers must increase, you'd have a lot of work to do to show that the collection of tests you'd chosen couldn't match any other pattern that WOULD discriminate against an increasing pattern that you simply hadn't tried yet.

In short, testing for "numbers have to go up" is very hard, so it is absurd to say that anyone has overlooked the simple answer; it was not a simple answer, it was a very difficult answer (to confirm.)





ooli  ·  3431 days ago  ·  link  ·  

The main question being: Did you craft a test with a wrong response?

Cause I didn't, and that the core of the experiment: 80% of people proposed an answer WITHOUT having a test with a "no" response.

If you overcome the confirmation bias and tested something and get a "no" you're a better thinker than 80% of us.

deanSolecki  ·  3431 days ago  ·  link  ·  

I think that your conclusion is wrong. If you make several tests that yield an answer consistent with your hypothesis, you think "what else could be a valid answer, given this?"

Your mind doesn't settle on "going up" because that would be very hard to test; you assume it could be something more complicated.

I bet if you were to do the example again, but change the rule to "The next number must be at least 100,000/99,999 of the previous answer" the same people that guessed "it must go up" would be satisfied with the answer they received from their feedback, despite the answer being wrong. This doesn't mean they are better thinkers, it means they thought of a simpler solution and were satisfied with the feedback they received in precisely the same way as those that thought of a more complicated solution and took the feedback as confirmation. In this case the "previously right" solution would also be wrong, however. In either case, it is very, very difficult to test. In the first case (must go up) the answer might seem intuitive, and so some people will hazard onto it, but in either case sufficient testing would be extensive.

This is rather an example of a very intentionally configured test that yields an intended outcome. I would bet that getting the answer right is inversely correlated with experience with mathematics.

Claidheamh  ·  3429 days ago  ·  link  ·  

You're making it out to be a lot more difficult than it actually is. What this test does is see if people try to get a "no" answer before actually making a guess. Like ooli said, the point is to see if you can overcome your confirmation bias. It's not so much important to actually get the answer right, as to not be afraid of making tests that are wrong, instead of just doing the ones that confirm your hypotheses.