Skip to main content

Consumer Reports Hammers Microsoft For Surface Reliability


Consumer Reports recommended the Microsoft Surface to laptop and tablet buyers, or at least they did until earlier today. That was the point where they dropped the bombshell that in their survey of laptop customers one in four Microsoft Surface customers reported seeing problems with their device in the second year of ownership.

Pretty damning statistics.

Now personally I've owned three Surfaces of different vintage, going back as far as the original Surface Pro, and I've never had a problem with any of them. However its important not to confuse anecdotal and statistical information, especially in a high profile announcement like this.

Microsoft strongly disputed the figures in a diplomatically worded response and suggested its own data shows that the Surface was one of the most reliable devices on the market over the last few years.

Who to believe?

This is a high profile piece of news and if Microsoft has faith in its own statistics it needs to demand Consumer Reports produce evidence of how this data was collected. What level of rigour was undertaken to ensure that reports of problems came from subscribers who actually owned a Surface, what the sample size was and what sort of issues were reported. After all, they very nature of a subscriber to Consumer Reports - like the UK's Which? service - is that they are older and non-technical, therefore more likely to be befuddled by errors which don't relate to hardware at all. At least some of the issues are listed as being 'touch screens weren't responsive enough' which suggests a level of perception being applied in the results. Does that make the whole report suspect? 

Consumer Reports has already demonstrated weak process in its testing and reporting of performance issues with the Touch Bar MacBook last year. Issues which weren't real and a result of user error.

So whilst I wouldn't dismiss this report out of hand, I'd also not accept it without some corroborating evidence either.

Comments

Popular posts from this blog

F1: Robert Kubica Impresses In Renault Test Run

The car may be old but its the performance of the driver that's the story here. Robert Kubica returned to F1, after a fashion, earlier this week with an extensive test run in a 2012 Lotus Renault F1 car at Valencia.
The age of the car and the circuit were likely determined by F1's current rules which ban testing, but the reason for Kubica being in the car is far more interesting. Considered by many to be a potential World Champion and certainly one of the fastest drivers of his generation, Kubica's F1 career seemed to be over after a 2011 crash whilst driving in the Rally of Andora. His Skoda Fabia was penetrated by a guardrail in the high speed accident partially severing his right arm.
Up until last year Kubica has been competing in rallying, with the expectation that the limited movement in his repaired arm would prohibit a return to single seater racing.
So this week's test is both interesting and confusing. Interesting because Kubica completed 115 laps of the ret…

F1: Robert Kubica's Williams Test Asks More Questions Than It Answers

Comparing driver's times at a tyre evaluation test like last week's Abu Dhabi event is difficult at the best of times, but when trying to assess the performance of a driver who has been out of the sport for six years, that difficulty level is raised even higher.
On the face of it Robert Kubica's test for Williams was a success. Fastest of the three Williams drivers present the headlines look promising. However, taking into consideration the different tyres used to set those times muddies the water considerably.
Kubica ran a three lap qualifying simulation on the new 'hyper-soft' tyre - which should have given him a two-second advantage. Correcting for tyres it would appear that Kubica was significantly slower than Sergei Sorotkin - who was on the harder 'soft' tyre - and marginally quicker than Lance Stroll, the team's only contracted driver.

Stroll's family fortune currently funds Williams, so there' no chance that he will be anywhere but in a…

Panos Panay's Defence Of Microsoft Surface Hardware Sounds Eerily Familiar

This weekend I went out with my ten year old daughter to select a laptop for her school year beginning in January. The schools requirements are quite specific, requiring a Windows 10 device, with a preference for a touchscreen and a stylus. She chose a Surface Pro, after trying a large number of different options. Having seen the way I use my own Surface Pro - and tried it herself there was only ever going to be two options - and the other was a Surface Laptop.
I tell you this so that you understand I am a buyer of Microsoft's products through choice, not compulsion. I'm on my third Surface device now. 
So when Panos Panay dismissed reports of the death of the Surface hardware line, I was very interested to see exactly how strong these denials were. Especially how they reflect what has gone before. To whit: Windows 10 Mobile.
Panay claimed that Microsoft is in hardware for the long haul. Almost exactly mirroring the words of Terry Myerson, when he claimed Windows Mobile was g…