General AI Performance Discrepancy Reports (No Discussion)

Discussion in 'Automobilista 2 - General Discussion' started by Renato Simioni, Sep 14, 2023.

  1. Manfredk2

    Manfredk2 New Member

    Joined:
    Dec 1, 2021
    Messages:
    19
    Likes Received:
    11
    Baseline Strength: 100/Medium Aggression
    Car Used: Formula Trainer (both)
    Track: Silverstone national
    Session: Quali/Race

    AI slow in general with both cars. I can easily overtake them in turns and straights - being more than 1 sec faster than them
     
  2. mmertens

    mmertens Old school racer

    Joined:
    Sep 19, 2022
    Messages:
    149
    Likes Received:
    181
    Bathurst 83
    F1 1991
    100% medium aggression
    AI brake too early on first corner, after the long straight in the beginning of the lap and on the last corner too. Generally AI is a bit too fast over twisty section.
     
  3. mmertens

    mmertens Old school racer

    Joined:
    Sep 19, 2022
    Messages:
    149
    Likes Received:
    181
    Stock car 86
    Brasilia
    100% medium aggression
    On wet conditions they are too slow, I took pole and 2nd place was more than 6sec (!) slower.
     
  4. Dicra

    Dicra Local Gamepad Ambassador AMS2 Club Member

    Joined:
    May 1, 2020
    Messages:
    1,302
    Likes Received:
    880
    I'm not particularly sure the supposed "benchmark for calibration" - F-UltimateG2 around Barcelona - is actually calibrated too well. Especially in the 3rd sector the AI just behaves very off compared to the player.

    I've raced them at 112 strength, which may be a little below my baseline, but it's hard to tell because they're quite far off to what I'm doing.

    They tend to be too slow compared to me at the apex of T1, then be a tiny bit slower on the exit of T4, take a slightly different line through T7/8 (braking deeper and accelerating more slowly - this is actually a common theme for these corners across all classes; it's not egregious though), and then we arrive at Sector 3 where the biggest discrepancies happen.

    The AI miss the apex of T10 slightly, which allows the player to consistently get up their inside. They are also significantly slower than the player on apex. However, then they get an insane launch out of this corner which gains them 3-4 tenths on exit so the discrepancies more or less even out. They proceed to lose most of that time around T12, where they again carry significantly less apex speed. Then, they gain a lot of time again because of a very good launch out of T12 suspiciously similar to the one out of T10.

    It should also be noted that the F-Ultimate G2 in particular is also too slow in these slow-ish long corners on other tracks, notably Luffield at Silverstone and Dunlop at the Nürburgring GP.

    It is strangely one of the not so brilliant experiences for AI calibration, which is why I'm not at all sure it's a good benchmark for anything.

    See this video at 6:10 for further impressions on their driving. I will note I had to change the setup for this one because my car kept scraping the floor in the last corner, which led to me raising ride height by 2 for the front and by 3 for the rear. I also put clutches to "4" to have less trouble with the rear.

     
    • Agree Agree x 1
    • Informative Informative x 1
  5. pr07

    pr07 Member

    Joined:
    Dec 13, 2023
    Messages:
    52
    Likes Received:
    19
    I was about to report this now, the only thing I experienced (in 112 difficulty too) that you didn't mention was that they were significantly quicker than me through the final corner, especially on the exit. Also, I had massive issues with my left-front tyre overheating and consequently wearing very quickly, that tyre specifically (I was using softs, matching the AI's) barely lasted 10 laps, while some of the AI did over 20 lap stints without any issue in the test races I did.
    I also did a few races with GT3 Gen2s there, and, in those, they not only do basically the same things mentioned earlier, but also take a very weird line through T9, carrying way too much speed in the entry and massively losing in the exit, and break too early into T10.
    This was all on 1.5.5.5 .
     
    • Agree Agree x 1
  6. Dicra

    Dicra Local Gamepad Ambassador AMS2 Club Member

    Joined:
    May 1, 2020
    Messages:
    1,302
    Likes Received:
    880
    Their tire wear compared to player seems completely off for this class, yes. 12-13 laps are the maximum that can be done without significant compromises on cornering speed, whereas AI can push full throttle and seem to have no issues going double the distance. Same thing happens at Silverstone, 20 laps for me, easy 29 for the AI.

    That final corner thing is caused by your car scraping the bottom of the track. It's not an AI calibration issue, it's a default setup issue for this one and can be fixed by raising rear ride height, as described in my post above.
     
  7. Renato Simioni

    Renato Simioni Administrator Staff Member

    Joined:
    Feb 14, 2016
    Messages:
    4,804
    Likes Received:
    44,496
    There is a calibration pass for the F-Ultimate Gen2 in the latest build, it should be noted however the benchmark is for overall lap time performance as you´re always going to have minor differences corner to corner just as individual players will have variations amongst themselves. I´ve noticed from your videos before for ex. that you are a really late braker, sometimes to the detriment of your exit speed so unsurprisingly you tend to have a lot of notes about early braking AIs parallel to ones about AI ganing a lot of time on the exit, which can be and often is two sides of the same coin :) I´d assume there´s a lot there inherent to the controller type as no matter how skilled one is it´s always going to be tricky to be optimal on throttle management with a gamepad, which might favour a more fast in / slow out style instead.

    I am the opposite, and since AI in AMS2 is heavily shaped if not completely defined by my own way of driving they will end up being a bit out of sync with your own style. Then again my driving style is also heavily influenced by what is more suitable for the AI themselves, as if we were to mould them around a late braking style for ex there would be tons of complaints about how rammy the AI is :)

    It´s an imperfect methodology to be sure and inevitably any one-size-to-fit-all solution is going to have minor discrepancies built in, which is why I say we´re not looking to getting them spot on just yet, rather ironing out all the bigger discrepancies so we can then shift focus to more micro stuff - eventually AI themselves will have a little variation in driving styles and we could even entertain the idea of introducing some adaptive AI feature - but we can only consider that when we have an all-around solid baseline.

    As for tire wear, that´s another area of compromising as the AI only has one compound whereas you as player have three - their soft compound is thus a bit OP in terms of durability but that´s for the sake of not making them sitting ducks when harder compounds are the better choices. Here too is a case of getting a simplified baseline on the ballpark before we add further variables in the form of additional AI compounds.

    In better news, v1.5.5.6 removes many of the legacy speed boosts we had in layouts you´ve been reporting on so AI shouldn´t be as far out of reach in some of those corners as they were in v1.5.5.5.
     
    Last edited: Feb 14, 2024
    • Informative Informative x 8
    • Like Like x 6
  8. TomLehockySVK

    TomLehockySVK Well-Known Member

    Joined:
    Aug 7, 2022
    Messages:
    828
    Likes Received:
    1,241
    The current frustrations i have when it comes to AI reports is when i see people comment "The AI just crashes me out" without even putting up a video showing the incident, and that just seems to give Reiza the idea of AI having to be dialed down and give as much space to the player as possible and beyond, when we have the aggression sliders which should be a simple way of adjusting that parameter.

    It also confuses me as to what the expectation of some people even is when racing AI - to never EVER be hit by them ever ? Is that not unrealistic to never be in a collision with other drivers ? I don't envy Reiza for having to dig through all these conflicting reports and then trying to make sense of it. Like my two cents are the AI is not aggressive enough.
     
    • Like Like x 5
    • Agree Agree x 1
  9. Renato Simioni

    Renato Simioni Administrator Staff Member

    Joined:
    Feb 14, 2016
    Messages:
    4,804
    Likes Received:
    44,496
    While it is indeed paramount to give as much info as possible with the reports (and video documentation like you and Dicra have been providing can be especially useful) it’s not like changes are typically made without us validating the report first. Keep in mind myself and some others in the team spend every bit as much time in-game as the most hardcore users , often more :) which is not to say we don’t have our blind spots - I for instance was for the longest time oblivious to how poor some of the AI pit strategy decisions were because most of the time Im doing short races bouncing from combo to combo to check as many of them in as little time as possible and obviously that’s not conductive to checking on potential AI pit strategy issues - but we are in tune enough to know when reports are worth following up on :)
     
    • Like Like x 7
    • Informative Informative x 2
  10. Eduardo Santis Torres

    Eduardo Santis Torres Member

    Joined:
    Aug 2, 2023
    Messages:
    72
    Likes Received:
    86
    The AI is much faster on the Nordschleife than on the Nürburgring, both modern and classic.
     
    Last edited: Feb 14, 2024
  11. Mazdaspeed

    Mazdaspeed Well-Known Member AMS2 Club Member

    Joined:
    Aug 25, 2022
    Messages:
    1,245
    Likes Received:
    639
    I posted this on the Beta thread, but this one seems to be the official one for this reports so will repost here.

    59 lap race at Watkins Glens Long with the F-RetroG2, 110%AI, high aggression, Lotus 79

    The tire wear in the F-RetroG2 is pretty unfair for the player compared to the AI, my fronts where completely gone (as in completely black in the hud and with horrible understeer) by lap 30 on a very cool 76°F track temperature, the rears had about 1/4 left. Some of the AI managed to do the whole 59 laps without pitting and managed to do very competitive laps towards the end. Some pitted, though I cant really confirm if it was for tires or they had some sort of mechanical issue, but at least the winner (Spector) did one stop and managed to win, so I assume he only changed tires. If so, that was pretty nice to see some AI being able to finish the race without changing tires and others having to do so. Still the wear rate for the player is too high for this class, only some super tire saving would have made it possible to maybe finish the race, but I doubt it.

    On a side note from another test, on a wet/damp track with slick tires in the HitechG1 and RetroG3,the AI are simply too fast on acceleration and fast corners, on medium and low speed corners its fine, until the exit. But due to their OP grip out of corners, its impossible to keep up without crashing or losing control. I dont mind the puddles much, most appear on the inside of corners so I just avoid them and the AI do slow down quite a bit, but their acceleration is too OP.
     
    • Informative Informative x 6
  12. Renato Simioni

    Renato Simioni Administrator Staff Member

    Joined:
    Feb 14, 2016
    Messages:
    4,804
    Likes Received:
    44,496
    I added an adjustment to the Retros´ AI wear rates following your report in time for the latest release build (not yet in beta), it´s probably not quite enough but should bridge that gap a bit.

    Work on tire wear / degradation for player and AI is top of the list for the new cycle so hopefully we can iron out most of these persisting discrepancies.
     
    • Like Like x 8
    • Informative Informative x 1
  13. TomLehockySVK

    TomLehockySVK Well-Known Member

    Joined:
    Aug 7, 2022
    Messages:
    828
    Likes Received:
    1,241
    Formula Reiza
    Hockenheim (full modern layout)
    112 difficulty / medium aggression
    AI drivers still cut turn 1 and at the moment they don't get any penalties for doing so.
    20240215151238_1.jpg
     
    • Informative Informative x 4
  14. pr07

    pr07 Member

    Joined:
    Dec 13, 2023
    Messages:
    52
    Likes Received:
    19
    So, after the changes to Silverstone in the last update, I did a few tests with F-Ultimate Gen2, GT3 Gen2 and LMDh cars there.
    [​IMG]
    Surprisingly to me, I had only one issue common across all classes: They miss the apex at Aintree, which, in most classes (GT3 Gen2 and LMDh in this case), forces the AI to lift to avoid going off track, making them quite slow on the Wellington Straight.

    With the F-Ultimate Gen2, they:
    - Brake a little bit early into Village and The Loop;
    - Have insane traction coming out of The Loop;
    - Are really slow mid-corner through Luffield;
    - Carry insane speed on Copse, (they gain 0.5-1s there) but weirdly only on the first 2 laps of the race, I'm not sure if it's a me problem;

    With the GT3 Gen2 (the best class I've tested on this track):
    - Unnecessarily lift on Farm, where you can go flat out;
    - As mentioned before, they lift through Aintree due to missing the apex;
    - Carry a little bit too much speed through Beckets and Chapel, gaining roughly 0.2-0.4s there;
    - Are slow through the final corner, after the Club Chicane, they probably lift through there, where it's not necessary;

    And with the LMDh, that definitely need a lot of calibration:
    - They brake too much through Abbey, and lift on Farm;
    - Get even more insane traction out of The Loop than the F-Ultimate Gen2, but lose it all immediately by lifting on Aintree;
    - Carry way too much speed through Copse, Maggots, Beckets and Chapel (gain 0.5-1s);
    - Are very slow through the final corner, like the GT3 Gen2, but much worse.
     
    • Informative Informative x 3
  15. ChasteWand

    ChasteWand Member

    Joined:
    Feb 9, 2021
    Messages:
    45
    Likes Received:
    17
    Le Mans de la Sarthe AI very slow on entry to pitlane after chicane. GT3 Gen 2, not driven anything else there yet...
     
    • Informative Informative x 2
  16. Alain Fry

    Alain Fry Well-Known Member AMS2 Club Member

    Joined:
    Sep 11, 2017
    Messages:
    291
    Likes Received:
    786
    Formula V10 Gen 2 is too slow overall

    Testing the Formula V10 Gen 2 at Interlagos 1993 and Silverstone 2001 with AI at 120, i can tell you the AI are too slow from 2 seconds per lap to 4 seconds per lap against the human i am. (2 seconds being the fastest AI ; 4 being the slowest).

    That happened in both tracks. I asked my good friend @Dicra and he confirmed to me that the FV10 Gen 2 is too slow everywhere, even at 120 strength. It's just more noticeable at some tracks.

    So this is what i call a performance discrepancy.
     
    • Like Like x 1
    • Informative Informative x 1
  17. Wolke

    Wolke New Member

    Joined:
    Apr 2, 2020
    Messages:
    3
    Likes Received:
    0
    Road America
    LMDh way to slow
    100% low aggression 1:53s-1:54s
    120% low aggression 1:49:9 best

    fast human sprint race 1:49:0, my sprint race pace 1:50:x,. hotlap best 1:47:8
    mix some GTE in and watch them snuffle in the trunk. The GTEs do not keep distance to each other, looks very weird
     
    • Agree Agree x 1
    • Informative Informative x 1
  18. bobbie424242

    bobbie424242 Well-Known Member AMS2 Club Member

    Joined:
    Jul 31, 2017
    Messages:
    1,057
    Likes Received:
    498
    RX cars AI is dead slow in non-RX tracks. My baseline calibrated on Barcelona/Stock car 2023 is 105. I used 107 at Hockenheim Short A and Ibarra (screenshots below after 3 or so laps) and I am multiple seconds faster. It's very obvious they are way too slow. They take curbs at snail pace.
    These cars are very fun to throw around on non-RX tracks so I'd really like to see it improved.
    I understand these cars must be a nightmare to calibrate for good performance, as they do not handle like regular racing cars and a human player can push these crazy fast in curbs.

    20240218190846_1.jpg
    20240218191539_1.jpg
     
    Last edited: Feb 19, 2024
    • Like Like x 1
    • Informative Informative x 1
  19. Mazdaspeed

    Mazdaspeed Well-Known Member AMS2 Club Member

    Joined:
    Aug 25, 2022
    Messages:
    1,245
    Likes Received:
    639
    Baseline Strength: 110/High Aggression
    Car Used: F-VintageG1 (probably G2 as well, but need to test it properly)
    Track: Spielberg 74
    Session: Quali/Race

    So I know I have been persistent in this issue, but the Vintages are one of my favorite cars and this issue makes it impossible to enjoy any race longer than 30 minutes with them. Its actually 2 problems here, first they are overall just too slow for the respective difficulty, I am far from an alien driver but still can get pole comfortably on most tracks after 5 laps or so at maximum 120% difficulty.

    The second is what I have reported before, the fuel weight not affecting the player as much as the AI, I lose a second , while the AI lose 3 seconds, so it makes long races a cakewalk and impossible to lose, no matter the difficulty. Below the qualy results and the pace difference after 2 laps, at 120% difficulty.

    Automobilista 2 Beta 2_18_2024 4_59_44 PM-min.png Automobilista 2 Beta 2_18_2024 5_04_44 PM-min.png
     
    • Agree Agree x 1
    • Informative Informative x 1
  20. Richirichi

    Richirichi Member

    Joined:
    Apr 29, 2021
    Messages:
    53
    Likes Received:
    17
    Track: Hockenheimring 1988
    F1 Classic Gen 3
    AI Difficulty: 117
    Aggression: Medium
    Laps: 20
    Weather: sunny

    The AI here are pretty woeful & extremely slow. They’re painfully slow on the long straights and at the start, offering no resistance & are overtaken with ridiculous ease. Starting in Pos. 4, I managed to overtake all those in front, after the first straight, & was already 2.5 seconds ahead after the first chicane; it was as if the AI were lacking their turbos, or had engine problems, they were that slow, at diff: 117!!! The AI also cannot handle the first chicane, & wipeout regularly, causing mass collisions. I’ve had some excellent experiences with the AI in AMS2; but the combi’ classic F1 (Gen 3) at the Hockenheimring 88, is dire. I’ve also tried the other classic F1 gens at this track, & they’re all very slow at the start/straights. Typically the MP4/5B reached approx 330 km/h at hockenheim back in 1990 on the straights, with the others around 320-25 km/h, qualifying in 1:40.198 (Senna). The AI struggles to reach 300 km/h. I hope this can be looked into, as the classic F1 cars are just awesome, as are the tracks. But in this state, this combi’ Hockenheim 88/classic F1 is not raceable.
     
    • Informative Informative x 1

Share This Page