1. Attachments are working again! Check out this thread for more details and to report any other bugs.

Featured IIHS automation safeguard ratings: only TSS 3.0 rated acceptable, Tesla and most others get an F

Discussion in 'Prius, Hybrid, EV and Alt-Fuel News' started by Gokhan, Mar 12, 2024.

  1. Isaac Zachary

    Isaac Zachary Senior Member

    Joined:
    Jan 20, 2018
    1,986
    933
    1
    Location:
    USA
    Vehicle:
    Other Hybrid
    Model:
    N/A
    Ok. But the blame can also be attributed to poor street designs. People drive faster a lot of times because it feels like the right thing to do, which is what you feel when you're on a big wide open street. Make streets cramped and windy, and people will automatically feel like driving slower even without speed bumps. But put a 15mph sign on a continuous 50ft or 60ft wide or wider street and people will naturally speed. Take the parking elsewhere, make it just wide enough for vehicles to fit, don't make streets straight, get rid of double and triple lanes unless completely removed from neighborhood areas.

    You can also add removing points of intersection into that safety equation. If every street had a median right down the middle then you wouldn't have people turning left through oncoming traffic (which also adds to not paying attention to pedestrians) in order to get to a business or driveway. Add roundabouts so people have an easier way of turning around and coming back to those businesses on the other side of the street.

    Roundabouts also slow down traffic before they come together, minimizing the chances of a high-speed collision, unlike 2way stop signs and street lights that have oncoming traffic flying through thinking nobody is going to pull out in front of them. You can also run a stop sign or a red light, but it's much more difficult to run a roundabout.

    And yes, a lot of this I am suggesting for neighborhood streets too. The more cramped and windy, the slower people will go. It should be a law to put a median in the middle of every street.
     
  2. Mr.Vanvandenburg

    Mr.Vanvandenburg Senior Member

    Joined:
    Mar 15, 2007
    1,223
    457
    0
    Vehicle:
    2020 Prius Prime
    Model:
    Limited
    I haven’t tried dashboard dining yet and am not much of a groomer. I comb my hair once in the morning.
     
  3. Tideland Prius

    Tideland Prius Moderator of the North
    Staff Member

    Joined:
    Oct 2, 2004
    45,024
    16,242
    41
    Location:
    Canada
    Vehicle:
    Other Non-Hybrid
    Model:
    N/A
    Yeah but it’s not the same system. It doesn’t have LiDAR like Teammate has. You can’t equate the two.
     
  4. hill

    hill High Fiber Member

    Joined:
    Jun 23, 2005
    20,172
    8,353
    54
    Location:
    Montana & Nashville, TN
    Vehicle:
    2018 Chevy Volt
    Model:
    Premium
    Not unless you're deliberately trying to skew the comparison
     
  5. Gokhan

    Gokhan Senior Member

    Joined:
    Oct 5, 2008
    4,958
    1,949
    0
    Location:
    Paramount CA
    Vehicle:
    2021 Prius Prime
    Model:
    Limited
    The ratings are for the safeguards, not for lidar vs. radar etc. Having or not having a lidar should have no effect on the available safeguards.
     
  6. Trollbait

    Trollbait It's a D&D thing

    Joined:
    Feb 7, 2006
    22,447
    11,760
    0
    Location:
    eastern Pennsylvania
    Vehicle:
    Other Non-Hybrid
    But the difference goes beyond having lidar. Teammate sounds like Tesla's FSP in function. You got to spend $115k on a LS 500h to get it.

    Then the IIHS tested multiple systems from the same manufacturer with them getting different rankings. The Lexus Dynamic Radar Cruise Control with Lane Tracing Assist (LSS+ 3.0) got lower safeguard ratings; it's below the median on that list.
     
  7. sylvaing

    sylvaing Senior Member

    Joined:
    Jul 15, 2023
    1,185
    495
    0
    Location:
    Canada
    Vehicle:
    2017 Prius Prime
    Model:
    Plug-in Base
    Yes, and European NCAP has rated the 2022 Model Y and Model S having the best Safety Assist (what ADAS is based upon) at 98%. It's the highest for the years 2023, 2022, 2021 and 2020.

    Euro NCAP | Latest Safety Ratings

    (On a phone, view in Landscape and sort by the last field - Safety Assist).
     
  8. Gokhan

    Gokhan Senior Member

    Joined:
    Oct 5, 2008
    4,958
    1,949
    0
    Location:
    Paramount CA
    Vehicle:
    2021 Prius Prime
    Model:
    Limited
    Again, as I explained to @Tideland Prius, the safeguards have nothing to do with the functionality of the systems or how advanced they are.

    Lexus DRCC with LTA is TSS 2.0, not TSS 3.0. It did not have the safeguards of TSS 3.0, which is why it got poor ratings.

    They haven't tested TSS 3.0, but I am pretty sure that it would score even higher than the currently top-rated Lexus teammate with advanced drive, as TSS 3.0 is built on nothing but safeguards.

    In my opinion, Toyota sets the standard on driving automation—everyone else follows or else is left behind.
     
    #28 Gokhan, Mar 13, 2024
    Last edited: Mar 13, 2024
  9. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,661
    15,661
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    I just finished "Safeguards for Partial Driving Automation Test Protocol and Rating Guidelines" Version I, March 2024. Overall, a good first draft but I've annotated my hardcopy with these concerns:
    • "Core rating" pp3 - no mention of time limits used within the document that range from 5 to 30 seconds. We really need to see what time ranges mean in scoring.
    • "geofenced fenced" pp4 - weakly covered and no mention of defective maps.
    • "normal or default" pp5 - Tesla has three degrees of Automated Emergency Braking, Late, Medium, and Early. This is used to tune out or increase false braking. An omission.
    • "grade 90 cheesecloth" pp7 - now I know how to make my 'Spiderman' goggles to use at night. They had correctly identified sunglasses as a defeat device in daylight.
    • "5, 10 sec" pp13-14 - repeat of pp3 problem as no time scale justification or rational.
    • "keeps both hands" pp15 - NO, single hand driving is OK. No mention of hands on wheel detection mechanism.
    • "picks up the [cell phone sized, rjw] block" pp17 - no discussion of hands free cell phone operation or relocation but not use.
    • "Automated lane change" pp19 - writing style changed but legit as Tesla "minimize lane change" is not working.
    • "Test 8a, 8b" pp19-20 - roughly describes behavior in traffic jam or work zone moderated operation. Poor retationship to common traffic problems.
    • "Cooperative steering" pp 21-22 - requires manual only operation with no accounting for Tesla having automated lane shifting. BIAS
    • "repeated attempts" pp23 - Nag facist, too strict.
    • "deactivating AEB" pp25 - Tesla has three mode, late, average, early, which are used to minimize false braking. Ignorance of Tesla AutoPilot and Full Self Driving.
    • "monitor driver body, head, and hands" pp27 - no mention of variable steering torque.
    • "a system lockout" pp28 - no mention of duration measured in time, trip, or weeks. Nag facist.
    • "Automated lane change . . . ACC auto-resume" pp29 - automated lane changes to stay on route, minimize passing lane hogging, and passing slower traffic is necessary.
    I give IIHS an "A" for having a reasonably well written standard testing document. There are a few areas we disagree or they are wrong (i.e., traffic jams and work zones.) More clarity on the time limits is needed. As a version 1 standard, a good step forward over the usual crap reviews. My biggest take away, I really like the cheesecloth defeat device or 'Spiderman goggles."

    Bob Wilson
     
    Gokhan likes this.
  10. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,661
    15,661
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Late thought, editing a document has something to mark up. But omitted in "Safeguards for Partial Driving Automation" are these:
    • Phantom braking - often caused by defective navigation maps that override the posted speed limit. These can cause sudden speed decreases. But to test it, you need a defective map which is not a trivial problem. Call it the silent killer. They can also be induced by the Automatic Emergency Brake system reacting to cross traffic stopped at an intersecting road.
    • Hands free phone - mechanical operation of a cell phone is mitigated by "hands free" operation. This should be evaluated and scored in the test.
    • Merge and exit lanes - typically caused by absence of lane divider lines or dashed lines, this can cause the car to "split the difference" in worst cases, appear to drive toward the far corner ditch.
    • STOP, YIELD, TRAFFIC LIGHTS - an obvious omission.
    • Geofenced vs not - the ratio of geofenced miles versus not fenced should be scored. The higher the ratio, the better the score.
    I have five years of AutoPilot and approaching two years of Full Self Driving experience. So I have some insights to what was not in Version 1.

    FYI, the list of omitted tests might change the scores. Regardless, I've already voted with my wallet.

    Bob Wilson
     
    #30 bwilson4web, Mar 13, 2024
    Last edited: Mar 13, 2024
  11. Trollbait

    Trollbait It's a D&D thing

    Joined:
    Feb 7, 2006
    22,447
    11,760
    0
    Location:
    eastern Pennsylvania
    Vehicle:
    Other Non-Hybrid
    LSS+ 3.0 came out in 2021 for the 2022 NX. The IIHS tested the systems on the 2022 to 2024 LS, which the Lexus site lists as having LSS+ 3.0. Lexus Safety Technology | Lexus.com

    Perhaps TSS+ and LSS+ three have different levels of safeguards. You can't take that to assume TSS+ 3.0 has the same ones as the Lexus Teammate, which has greater ADAS capabilities than TSS+ 3.0.
     
  12. sylvaing

    sylvaing Senior Member

    Joined:
    Jul 15, 2023
    1,185
    495
    0
    Location:
    Canada
    Vehicle:
    2017 Prius Prime
    Model:
    Plug-in Base
    Interesting, NCAP gave the Lexus NS a Safety Assist rating of just 91%, lower than what the Model Y and Model S got for the same year (98%).

    Official Lexus NX 2022 safety rating

    Official Tesla Model S 2022 safety rating

    Official Tesla Model Y 2022 safety rating
     
  13. sylvaing

    sylvaing Senior Member

    Joined:
    Jul 15, 2023
    1,185
    495
    0
    Location:
    Canada
    Vehicle:
    2017 Prius Prime
    Model:
    Plug-in Base
    It should also be pointed that they tested Tesla's Autopilots 2023.7.10, which is way before Tesla Over the Air updated the Autopilot and FSD stacks to NHTSA requirements in 2023.44.x. It monitors drivers attentiveness way more now and will give you "strikes" if it has to disengage because of driver's negligence. After five suck strikes, AP disables for a week for anyone driving the vehicle. I'm currently sitting at zero strike because I don't abuse the system.
     
  14. Leadfoot J. McCoalroller

    Leadfoot J. McCoalroller Senior Member

    Joined:
    May 12, 2018
    7,427
    6,913
    1
    Location:
    Pennsylvania
    Vehicle:
    2018 Prius c
    Model:
    Two
    I've been reading a bit more about the Lexus Teammate, the only system that scored anything other than poorly.

    It seems to have a pretty long list of features, more than I've heard anyone mention in relation to the features available in any Prius.

    Can you clarify what you mean by "tested as Lexus teammate?"

    From what I've been reading, it's simply not the same as Toyota's TSS 3.0. A lot is shared, there is obvious overlap... but they aren't identical.
     
    hill likes this.
  15. Trollbait

    Trollbait It's a D&D thing

    Joined:
    Feb 7, 2006
    22,447
    11,760
    0
    Location:
    eastern Pennsylvania
    Vehicle:
    Other Non-Hybrid
    Prii with Traffic Jam Assist may come close to Teammate. That installs a set of driver monitoring cameras that aren't part of the base TSS+ 3.0.
    The IIHS wants the ADAS to disengage for the rest of the trip after after one strike. If a system doesn't do that, it fails that part of the test. I understand they need a testable metric. It is just some of these requirements tests don't really apply. We should all be wearing seatbelts, but how is that a safeguard to proper use of ADAS? I would like to know the reasoning for them, and any evidence for selecting the criteria they did.

    I do think having this rating a good idea. It is as important as how the ADAS works. Just a shame many reports are acting like it reports the latter.
     
    #35 Trollbait, Mar 13, 2024
    Last edited: Mar 13, 2024
  16. hill

    hill High Fiber Member

    Joined:
    Jun 23, 2005
    20,172
    8,353
    54
    Location:
    Montana & Nashville, TN
    Vehicle:
    2018 Chevy Volt
    Model:
    Premium
    maybe you don't
    maybe you do .....

    Screenshot_2024-03-13-11-50-42-29_680d03679600f7af0b4c700c6b270fe7.jpg


    .
     
    bwilson4web likes this.
  17. sylvaing

    sylvaing Senior Member

    Joined:
    Jul 15, 2023
    1,185
    495
    0
    Location:
    Canada
    Vehicle:
    2017 Prius Prime
    Model:
    Plug-in Base
    I can't vet for FSD but Autopilot will disengage for the remainder of the trip. It's been like that since at least 2021. You have to stop and park before you can re-engage it, that's assuming you haven't reached that five strikes (new since 2023.44.x) because then, you won't be able to re-engage Autopilot for a week.
     
  18. Leadfoot J. McCoalroller

    Leadfoot J. McCoalroller Senior Member

    Joined:
    May 12, 2018
    7,427
    6,913
    1
    Location:
    Pennsylvania
    Vehicle:
    2018 Prius c
    Model:
    Two
    Seems even rarer of a situation.

    The current Lexus LS is available with different safety packages in different trims, and I've found a claim that they only sold 107 cars with the full Teammate system in 2023. Haven't found a good confirmation of that though.

    Just an interesting twist on the test results. Only one system didn't fail badly, and that particular system is only rolling around in a very few cars.

    Would be statistically embarrassing for any of them to have an upsy-daisy.
     
  19. sylvaing

    sylvaing Senior Member

    Joined:
    Jul 15, 2023
    1,185
    495
    0
    Location:
    Canada
    Vehicle:
    2017 Prius Prime
    Model:
    Plug-in Base
    Lol, plain sunglasses is enough. I think Ford or GM have IR camera that sees through sunglasses and at night but Teslas don't.
     
  20. Trollbait

    Trollbait It's a D&D thing

    Joined:
    Feb 7, 2006
    22,447
    11,760
    0
    Location:
    eastern Pennsylvania
    Vehicle:
    Other Non-Hybrid
    Well, Teammate is only available with the LS hybrid, which is $115k, or around $30k more than the non-hybrid. Not surprising there isn't many around.