5 Reasons Why Smartphone "Speed Tests" Are Fundamentally Flawed

Поделиться
HTML-код
  • Опубликовано: 19 сен 2018
  • I often hear that so-called "Speed Tests" are a better way to judge the performance of a smartphone, because they are more "real life" or "real world." However, the basic ideas behind Speed Tests are unsound. Here are 5 reasons why these tests are fundamentally flawed.
    Introduction to Android app development: www.dgitacademy.com
    Let Me Explain T-shirt: teespring.com/gary-explains-let-me-explain-2
    Twitter: twitter.com/garyexplains
    Instagram: instagram.com/garyexplains/
    #garyexplains

Комментарии • 1 699

  • Sourav Goswami
    Sourav Goswami 5 дней назад

    If you do compare iphone with an Android, keep in mind that even the programming language is different! From lower level perspective, the kernel is different.

  • dooms cr
    dooms cr 8 дней назад

    Finally a tech youtuber i can watch in peace. All the others tech reviewers doing the same shit over and over again.

  • Yusuf Imran
    Yusuf Imran 9 дней назад

    Great insights as always. Gary really explains 😇

  • ירין בן אבו
    ירין בן אבו 11 дней назад

    Hi Gary
    Im sorry but "attack youtubers” its wrong. Your explanation just show the people the true behind the scene. Some youtubers arent objective with their videos and misslead the public to pay a lot of money what's made them eventually disappointed with their choices [Sometime].

  • Anas Khalil
    Anas Khalil 19 дней назад +1

    This is my favorite video on youtube

  • Alex K
    Alex K 23 дня назад

    What would you recommend for an accurate speed test method?

    • Gary Explains
      Gary Explains  23 дня назад +1

      LOL, try this ru-clip.net/video/0dsQiw-G8O8/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE.html

  • Tech Pegasus
    Tech Pegasus 25 дней назад +1

    Gary do a speed test g between mediatek helio p70 and snapdragon 660

  • Sundar Balaji
    Sundar Balaji Месяц назад

    Wowww, very well explained with proper analogy Gary. It's simply awesome

  • sextionmirror
    sextionmirror Месяц назад

    Gary, Can you explain about touch latency between ios and android please .I want to know .

  • Ian S.
    Ian S. Месяц назад

    I don't care about this "not science" speech, all I know and care is that I'm using my apps way faster on my iPhone than in any other android phone.

  • sextionmirror
    sextionmirror Месяц назад

    Your video should be get more view and destroy wrong logics about many test of youtubers.You preserve more subscribers.

  • Alex S
    Alex S Месяц назад +1

    What's the point of owning a fast smartphone if you don't watch this video with it?

  • Bigby Wolf
    Bigby Wolf Месяц назад

    Loved it? Enjoyed it? I WATCHED EVERY SECOND OF IT!
    Speed tests are "app opening test" im shooting this everywhere!

  • Bigby Wolf
    Bigby Wolf Месяц назад

    I AM SO SO GLAD THAT SOMEONE IS FINALLY TALKING ABOUT THIS. EXPLAINING THIS IN THE COMMENTS JUST OPENS UP HUGE GATES TO CRITICISM AND HATE

  • Kobby Sintim-Arthur
    Kobby Sintim-Arthur 2 месяца назад

    I love this! Very legit points. Great job Gary!

  • Sahil Mehta
    Sahil Mehta 2 месяца назад +1

    Phonebuff should probably delete his channel now ..

  • zed piecce
    zed piecce 2 месяца назад

    I normal go for phone because it's can run my prefer emulators at 30fps minimum (ppsspp, damonps2 pro and dolphin) very well.... That why I follow snapdragon series for hardware and android for OS.....thirdly the price and battery time..... I am not concern about screen and security stuff, just emulator gaming.....otherwise I go for small Nokia phone......thank to snapdragon 845 in pocophone f1....... And android support

  • Kherzie Andrei Andal
    Kherzie Andrei Andal 2 месяца назад

    You deserve more subscribers

    • Kherzie Andrei Andal
      Kherzie Andrei Andal 2 месяца назад

      +Gary Explains Wow! I didn't expect you to reply :)) Anyway thanks for replying :D

    • Gary Explains
      Gary Explains  2 месяца назад +1

      I agree!!! 😀

  • Rollie Bautista
    Rollie Bautista 2 месяца назад +1

    Haha that the reality very nice explanation...☝️ more power for your channel sr Gary

  • royrobsn
    royrobsn 2 месяца назад

    Oh my Good i was sooo long waiting for a Man how understand how a Handy Works.. Keep on going!! and by the way, the stress test you have cratet is better than any test i have ever seen on playstore, it would be verry intressting to see your test running every step for 5-10 minutes, so the throtteling factor comes realy out.. I think that could complete chance the result again.. Best greats from Austria..

  • Jinosh Philip
    Jinosh Philip 2 месяца назад

    Gary
    You should expand your speed test to iOS as well !

    • Gary Explains
      Gary Explains  2 месяца назад

      Please see the FAQ. The link is in the description.

  • Mike Fedyk
    Mike Fedyk 3 месяца назад

    As someone with decades of experience as a sysadmin, all I can say is duh, finally and thank you.

  • DemiImp
    DemiImp 3 месяца назад

    To be fair, benchmarking programs are also flawed.
    Just not nearly as flawed as the app launching speed tests.

  • walter park
    walter park 3 месяца назад

    Terrific!
    Of course you should support meaningful tests and disillusion people about empty comparisons.
    Thanks!
    This is credible education. I like it.

    • Gary Explains
      Gary Explains  3 месяца назад

      I guess you haven't heard of Speed Test G!!! garyexplains.com/faq

  • Adarsh Adk
    Adarsh Adk 3 месяца назад +1

    I never thought like like this,thanks for proving me that I was wrong , Man you are brilliant :) good luck gary !

  • Abhishek Asthana
    Abhishek Asthana 3 месяца назад

    you pedantic ass, it doesn't matter. ultimately what I care about it how fast Twitter and RU-clip load on my phone. the tests are perfect for me. go lecture in a university to CS majors. they probably care about this under the hood nonsense

  • Jean Grullón
    Jean Grullón 3 месяца назад

    Benchmarks are less related to day to day feel than app loading time comparisons are scientific.

  • Dom Esp
    Dom Esp 3 месяца назад

    That means Apple kicks ass!!

  • azrul nizam
    azrul nizam 3 месяца назад

    Tq Mr. Professor.

  • Jarkko Niemi
    Jarkko Niemi 3 месяца назад

    Sounds like that the most accurate test would be something like that:
    * We use program what simulates real phone use, and it works on IOS and Android phones.
    * It does virtual touches to screen.
    * We script one day of phone-use.
    * Any phone moving must be done on automated way, for example navigation app use, by putting phone to Drone, and Drone has scripted path how it goes.
    * We repeat test ... lets say 99 times. Then we use Average and/or Main for results.

    • Gary Explains
      Gary Explains  3 месяца назад +2

      Good luck turning that nightmare into a RU-clip video!!! :-)

  • Louis-Philippe Duval
    Louis-Philippe Duval 3 месяца назад

    If some people legitimately believe that these "speed test" are accurate, they are literally brain dead.

  • Manoj Hegde
    Manoj Hegde 3 месяца назад

    Gary i am very curious on Google apps that comes with every Android. that is Google play services and Google play store. i see these apps slow down phones. please through some light. and even make tutorial on how Google play service work and what happens if i stop its update process for Google play services and Google play store .. appreciate your hard work

  • Darren Holden
    Darren Holden 3 месяца назад

    A definite thumbs up. Excellent work.

  • karthikeyan M.V
    karthikeyan M.V 3 месяца назад

    Speed test is still relevant . I had phone with decent processor but it took 15 seconds to load contacts app. Then I realized something is wrong with flash memory .Then I tested with androbench. It gave around 10mbps read speed . 😥. That phone is not useable anymore

  • Hitesh
    Hitesh 3 месяца назад

    Hey Gary. Amazing video as usual!
    I was wondering about Substratum overlays. Does it affect performance of the device? If it does and I know it does but if you can make a video about overlays, it would be great. Thanks.

  • Kyle Alexander
    Kyle Alexander 4 месяца назад

    it took me a while to realise on my own how dumb speedtests are but Gary really put the nail in the coffin. Thank you for this.

  • Smart Potato
    Smart Potato 4 месяца назад

    True that

  • aryan ambastha
    aryan ambastha 4 месяца назад

    And David Rahimi makes shit ton of money doing these speedtest videos! Let's Expose him!

  • Niidea1986
    Niidea1986 4 месяца назад

    I unsubscribed to most mobile tech channels but I think I will resubs to this one :)

  • TripleAceAAA
    TripleAceAAA 4 месяца назад

    Maybe. But I notice Apple is faster for the most part. So the benchmarks are higher for Apple and I notice Apple smoother and faster. So to me it adds up

  • where is my wall
    where is my wall 4 месяца назад

    i like this channel ..

  • Asaur Rahman
    Asaur Rahman 4 месяца назад

    Gary thank you once again

  • Asaur Rahman
    Asaur Rahman 4 месяца назад

    And what if someone moves the application s to the external sd card and show that it's a slower loading time?🤔Terrible!

  • Asaur Rahman
    Asaur Rahman 4 месяца назад

    this is an eye opener

  • Rocelo Becera
    Rocelo Becera 4 месяца назад

    Right on point Gary! Thanks!

  • MIC MUTED
    MIC MUTED 4 месяца назад

    Show some framerate, frame time, temperature, battery graphs and samples of the test running

    • MIC MUTED
      MIC MUTED 4 месяца назад

      It would give us a better idea of the real world performance of a pine if reviewers / speed testers showed them

    • MIC MUTED
      MIC MUTED 4 месяца назад

      +Gary Explains just saying that if someone could make software like msi afterburner and other data collection apps for mobile. It would be nice

    • Gary Explains
      Gary Explains  4 месяца назад

      Are you asking me to show those? On what tests?

  • anand kulshrestha
    anand kulshrestha 4 месяца назад

    ah i am slow but i am happy with it.

  • maen Alnjadat
    maen Alnjadat 4 месяца назад

    Great explanations from really scientific professional
    My question is what is related by where we can find high quality of apps as possible?
    Which operating system loads more details and frame rate of apps like games ios or Android?
    Thank you

  • Mateusz Kirow
    Mateusz Kirow 4 месяца назад

    I personaly think some reason could be busted. Rebooted phone/same clear phone It couldt be tested on cellular data (from the same bts, in night/when traffic is lowest) in perspective of a couple of days. Test in the same app, the same page like "shop xyz" then "shop xyz search: phone X" etc. It should give us comparative results. Mabye i'm wrong.

  • John Moon
    John Moon 4 месяца назад

    Look at the clips he makes. He's here to educate others, help us to understand things better.
    Others are just doing it to get clicks and subs, get richer so they can buy their 3rd house or 2nd Ferrari.
    Thats the difference. Sadly, many people out there think 'millions of subs = most reliable source'.

  • Supercell Coc
    Supercell Coc 4 месяца назад

    It's "user experience"
    Speedtests channels need to change their video title to testing ux for both phones or something like that.

  • Matthew Pool
    Matthew Pool 4 месяца назад

    Best pull quote: "That's not science! That's just nonsense!" Excellent video. 😁

  • Jjsm Felisilda
    Jjsm Felisilda 4 месяца назад

    This is just the best explanation ever... Keep it up Gary ☺

  • Aakash Jhaveri
    Aakash Jhaveri 4 месяца назад

    170 youtubers watched this video

  • Sam Fullbuster
    Sam Fullbuster 4 месяца назад +3

    OnePlus fans are so dumb I swear. Just because the phone opens an app half a second faster. I used the onplus 6 it wasnt as good as some other flagships in gameplay experience. Thanks for the video man. Hope it goes viral.

  • Anitt Bhatnagar
    Anitt Bhatnagar 4 месяца назад

    Nailed it.....

  • Alex Priego
    Alex Priego 4 месяца назад

    Great Obi-Wan....spoken you have. And amazed us you have. Thanks for the video. Always enjoy your smart professional opinions

  • Steve, TheDailyShaver
    Steve, TheDailyShaver 4 месяца назад

    GARY RUINS EVERYTHING ;))

  • A B
    A B 4 месяца назад

    At the core of it you’re not testing like for like but at the level of abstractions of the common user it’s perfectly appropriate.

  • Tim Wambari
    Tim Wambari 4 месяца назад

    Preach Brother! Preach! Well said :-)

  • Med Msd
    Med Msd 4 месяца назад

    You are right about most of it but honestly a gaming test is testing the frame rate which is a real life test with the same quality (ios and android might be different in quality)
    and for ram management I dont really care if the apps are different if the android version is better then good for android users but if you watched several videos that shows overall the ram management on oneplus 6 for instance is better then IOS or android phones then it sure gives you an idea about real life (I dont care if it is because 8gb or they had optimization) those factors you are talking about like network latency or different content are for my opinion have minimal impact and the more videos you watch the more these factors will be insignificant.

  • Atlantic Picture
    Atlantic Picture 4 месяца назад +1

    Thought you're going to also mention that these "tests" usually start with the idea that *a person is able to touch 2 or more devices w 2 or more fingers at identical time*

  • Khairil Ashraf samsudin
    Khairil Ashraf samsudin 4 месяца назад

    In Gary we trust, another great video!

  • Reymond Gopog
    Reymond Gopog 4 месяца назад

    This by far my favourite video of the year. Today I stopped watching "speed test" video and stopped wasting a few minutes of my life time watching nonsense speed test video. Thank you Gary. You got yourself a subscriber today.

  • Captain Storm
    Captain Storm 4 месяца назад

    Thanks Gary

  • john watson
    john watson 4 месяца назад +1

    please keep making these videos, these things are really important to know 🤟🤟🤟🤟

  • mя υηѕтσρραвιє
    mя υηѕтσρραвιє 4 месяца назад +1

    Mr Garry explains you are just amazing your videos are amazing 👌👌👌

  • Dennis Deveaux
    Dennis Deveaux 4 месяца назад +1

    Been sharing this every time someone shares speed tests between the Pixel 3 & iPhone XS.
    There's enough little issues with the Pixel 3, but showing it in a speed test is not a fair test as you explain

  • Rajkamal S
    Rajkamal S 4 месяца назад

    I swear that the evidence that I shall give, shall be the truth, the whole truth and nothing but the truth. Gary Sims

  • Rajkamal S
    Rajkamal S 4 месяца назад

    You look a bit frustrated about this topic!

  • MIND NOVA
    MIND NOVA 4 месяца назад +1

    More excuses.

  • Abhishek Soni
    Abhishek Soni 4 месяца назад

    yes but people does't know that things

  • trevor da veiga
    trevor da veiga 5 месяцев назад

    For all those people who think they know tech just by watching youtube videos, gray Sims has explained what performance testing is in a very kind lovely way and shows his credibility.

  • Srishti Bhagat
    Srishti Bhagat 5 месяцев назад

    Sir

  • Lu Silk
    Lu Silk 5 месяцев назад +1

    Enough said thanks 👨

  • Hector Rodriguez
    Hector Rodriguez 5 месяцев назад

    I watched two of your videos and I subscribed to your channel. Very very good content and information.

  • DK Nex
    DK Nex 5 месяцев назад +1

    Technical Legend

  • Steps Ahead IT Services
    Steps Ahead IT Services 5 месяцев назад

    I love the video, the only thing I don’t like is that when you are ramped up, you don’t finish the senteces with. Ya’ dumb c@nt$! Only that would make this video 200% better.

    • Gary Explains
      Gary Explains  5 месяцев назад

      So you think that things with profanity are better... interesting...

  • David Zindr
    David Zindr 5 месяцев назад

    This changes everything lol
    Well done great eye opener.

  • Benny Ong
    Benny Ong 5 месяцев назад

    Thank you Gary. Finally a sane person.

  • Lovepreet singh
    Lovepreet singh 5 месяцев назад

    Well explained

  • Hirens
    Hirens 5 месяцев назад +1

    Keep up the good work sir! Don't give up!
    I am happy that you made this video and explained to the internet so accurately all this stuff.

  • Azlan Musa
    Azlan Musa 5 месяцев назад

    @C4ETech Please see this!

  • common Trixie t Cebo
    common Trixie t Cebo 5 месяцев назад

    love the way you explain bro

  • Colby Landwehr
    Colby Landwehr 5 месяцев назад

    Speed tests measure the most important metric for consumers. Time; how much of my time is this going to take me? Most people who watch speed tests probably don’t care about the tech, they do care about their time.
    Edit: a character

    • Gary Explains
      Gary Explains  5 месяцев назад +2

      Surely how quickly an app works is a better measure of time? It can load quickly and run like a pig and then I waste time waiting for the app, even though it loaded quickly.

  • Rahul pramanik
    Rahul pramanik 5 месяцев назад

    *Now if i take two phones of same year where one is with sd 845 and another with sd450 and take a game (suppose PUBG) having same cache in both **phones.Now** will both phones load the game in same time as you are telling speed test doesn't test the cpu and gpu ????*

    • Gary Explains
      Gary Explains  5 месяцев назад

      So, yes loading times don't test the GPU and the GPU is a major component in a SoC. As for load times between the SD845 and the SD450, I didn't say that overall performance doesn't influence loading time, of course it does, but you can't measure or ascertain the overall performance by using loading time. That is what my whole video is about.

    • Rahul pramanik
      Rahul pramanik 5 месяцев назад

      +Gary Explains i know that playing games actually tests both cpu and gpu....but in case of loading apps both processor should load the apps in same time according to you with the criteria of my previous comment. Isn't it?

    • Gary Explains
      Gary Explains  5 месяцев назад

      So you took the best and worse that Qualcomm has to offer, not a good idea to try to prove your point. What about this scenario, two processors that have the same number of cores, the same core designs, the same frequencies and the same levels of cache. BUT, one has a better GPU. Two phones with these processors will LOAD the game in roughly the same time-frame, but one will PLAY the game much better. A REAL WORLD test is actually using an app or playing a game, not just starting it.

  • Mahdi Benhannan
    Mahdi Benhannan 5 месяцев назад +1

    He literally tagged those supposed tech youtubers doing speeds tests as mere commentators.

  • Frank HunInvader
    Frank HunInvader 5 месяцев назад

    Finally, although I have been saying it. Anyone who owns a PC for example, try loading a game set on low detail, vs high detail, guess which one is gonna load faster? Now, in smartphone apps, we don't select the detail settings, it's the app that built-in function to know what phone/processor/memory you got and the app decides how much detail and special effects gonna be used.
    If you never do gaming, you don't need the fastest CPU in reality. What you need is efficiency and optimization.
    Buy a phone you like, use it for a week and see how it works for your life style, whether you get enough battery life; fits in your hands; takes the photos you like; has features you find convenient, that other phones don't have. If you like it keep it, if you don't return it.
    Also stay away from making decisions on whether you have read others said, that one OS is worse than the other.

  • Sergiu Sprintar
    Sergiu Sprintar 5 месяцев назад

    good thing we got that nifty feature called: clear caash memory...
    ps: people don't trust benchmark because some one those are fixed or "bought".
    Just like some reviewers are payed by some companies to push one view over another.
    noticed a lot while searching for sony phones reviews, a lot of reviewers are pushing samsung hard, funny enough, just samsung, not huawei, not apple, not oppo, one plus or others, but "but samsung s9 is better, but saming xxxx but smasung xxxxxx".
    So yes, that's why benchmarks are not trusted by the population, we expect them to lie

  • Taanoliqe Somali
    Taanoliqe Somali 5 месяцев назад

    Well done Gary

  • VTEC- KUN
    VTEC- KUN 5 месяцев назад

    From the flash to the main memory. So from the RAM into the (Hard Drive) or SSD? I'm so lost right now..........

    • Tommi
      Tommi 4 месяца назад

      Main memory is RAM and flash would be "secondary memory", so the opposite of what you said. The path data takes is: Flash (HDD, SSD, etc) -> Main memory (RAM) -> Processor

  • Rishabh Sidana
    Rishabh Sidana 5 месяцев назад

    Thanks Gary for this amazing video and you really aware us about how technology work in real life and they show us in these comparisons video.
    I also request you to can you make a video about the developer options.

  • nonshatter7
    nonshatter7 5 месяцев назад +1

    I had to subscribe after this. I had no choice. It's just too good, there's just too much sense.

  • Arslan Zia
    Arslan Zia 5 месяцев назад

    Thank you for clearing a misconception. I love your Garry explains videos, and I've learned a lot from these.

  • Όμηρος Αμπατζής
    Όμηρος Αμπατζής 5 месяцев назад

    Of course the methodology is wrong but at the end of the day this is exactly what users do and care the most ,in my eyes these are user experience tests and i take them under consideration

    • Tommi
      Tommi 4 месяца назад

      He did talk about that though, will the loading time of an app change your user experience more than a laggy app? He used in-app performance as the main example of a user experience test, and i think that we can all agree that it would impact our experience more than 2 extra milliseconds opening an app.

  • JUMP23MΔN
    JUMP23MΔN 5 месяцев назад

    Gary dropping the knowledge bomb 🤯 💣💯

  • karthick udhaya
    karthick udhaya 5 месяцев назад

    Then u itself say which is the best mobile to buy in 2018

  • Dr Heisenberg
    Dr Heisenberg 5 месяцев назад

    What the h... Why dislikes for this video? Did Gary hurt your empty brain youtubers? Jeez

  • Dr Heisenberg
    Dr Heisenberg 5 месяцев назад

    This is BRILLIANT. GOD BLESS i found this channel

  • Sebastian Börner
    Sebastian Börner 5 месяцев назад +2

    I choose to ignore your explanation as long as my OnePlus 6 wins all of the speed tests.