I agree that there is a small warming trend just going by the numbers. But what about the historical context?
What about the historical context? This is not about thousands of years and the Earth in general, this is about mankind now and in the next dozens or hundreds if years. In my opinion, the only important questions are 1.) Will the temperatures continue to rise? If yes 2.) will that have a significant negative impact on mankind? And 3.) is there anything we can do to change it?
As soon as we can prove that for at least one of these questions the answer is "No" this stops to be a (political) issue. But until we have that proof we should do our utmost to find out.
On the other hand, I do agree that at the moment we should not take any drastic measures before we can be sure that there is at least a significant chance that these measures will have a noticeable positive impact.