Again when looking at this one, I found myself thinking, but what if I showed it material with a quote and data that's never been discussed online before, would it be able to make all those connections? My thinking is that *similar* things are in its training data, rather than that Claude is reasoning. I could be totally wrong. But I am always trying to test the limits of whatever looks "good", to see how well it would perform on something less expected.
Good catch re the mistakes in the data, but you do realize you're the one who made the catches, not Claude, right? I guess senior or grad students probably would catch something like that, but perhaps not younger students?
BTW, I assume you read the original article from which the chart is taken to see which arguments it gives, were they similar or uncritical? Were there response articles to it somewhere?
Again when looking at this one, I found myself thinking, but what if I showed it material with a quote and data that's never been discussed online before, would it be able to make all those connections? My thinking is that *similar* things are in its training data, rather than that Claude is reasoning. I could be totally wrong. But I am always trying to test the limits of whatever looks "good", to see how well it would perform on something less expected.
Good catch re the mistakes in the data, but you do realize you're the one who made the catches, not Claude, right? I guess senior or grad students probably would catch something like that, but perhaps not younger students?
BTW, I assume you read the original article from which the chart is taken to see which arguments it gives, were they similar or uncritical? Were there response articles to it somewhere?