Testing Directive Feedback: Premium Conversationalist limit increase

Discussion in 'Player Test Environment (QA Server) Feedback' started by Ravalox, Jun 3, 2023.

  1. Ravalox

    Ravalox Chief Cook and Bottle Washer Moderator SOTA Developer

    Messages:
    1,731
    Likes Received:
    4,954
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Dallas, TX
    Please log your test results and impressions for the Conversationalist testing directive here.

    Looking for conversation loading times for both 20K and 60K versions.
    If no delay for either, please post "No Delay" for each.

    PLEASE be sure to use the /devbug feature on QA and paste the template in here. (you DO NOT need to fill it out, I need the computer specs info from it)

    NOTE: this feedback thread is for the testing directive posted HERE.
     
    Last edited: Jun 4, 2023
  2. Barugon

    Barugon Avatar

    Messages:
    15,679
    Likes Received:
    24,293
    Trophy Points:
    153
    Gender:
    Male
    2k really sucks.
     
  3. Ravalox

    Ravalox Chief Cook and Bottle Washer Moderator SOTA Developer

    Messages:
    1,731
    Likes Received:
    4,954
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Dallas, TX
    This thread is specifically for feedback on loading times for the testing directive conversationalists. The introductory conversationalists are not included in the testing.
     
    Anpu likes this.
  4. Lained

    Lained Avatar

    Messages:
    2,786
    Likes Received:
    4,772
    Trophy Points:
    165
    Location:
    Yeovil, England
    @Ravalox Barugon is responding to the typo in the first post above, it should read 20k.
     
    Anpu likes this.
  5. Barugon

    Barugon Avatar

    Messages:
    15,679
    Likes Received:
    24,293
    Trophy Points:
    153
    Gender:
    Male
    Crafted conversationalists only allow 2000 characters of script.
     
  6. Lained

    Lained Avatar

    Messages:
    2,786
    Likes Received:
    4,772
    Trophy Points:
    165
    Location:
    Yeovil, England
    Performed a few tests, all similar times even with another avatar in the scene.

    20k: 01.27 seconds
    60k: 03.34 seconds

    delta: 02.07 seconds.

    User Specs:
    OS: Windows 10 (10.0.0) 64bit
    CPU: Intel(R) Core(TM) i5-6400 CPU @ 2.70GHz (4) System RAM: 16284
    GPU: NVIDIA GeForce GTX 1060 6GB GPU RAM: 6052
    SotA.QA.Win.64.1502.Date.06.03.23
    Area: Fishing_Expedition
    Area Display Name: Fishing Expedition
    Loc: (70.9, 2.1, 20.5)
    Debug: RmlzaGluZ19FeHBlZGl0aW9ufHwoNzAuOTM3LCAyLjA1NSwgMjAuNDY4KXwoMCwgLTAuOTkxLCAwLCAtMC4xMzUpfDE2NS44MDA2fDMyLjc4NzMzfDcuMDAzNzY3

    Connect Speed: 61.0 Mbps / 14.7 Mbps
     
    Anpu likes this.
  7. Anpu

    Anpu Avatar

    Messages:
    7,944
    Likes Received:
    9,015
    Trophy Points:
    153
    Location:
    Hemut
    06/04/2023 08:52
    User Specs:
    OS: Windows 10 (10.0.0) 64bit
    CPU: Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz (8) System RAM: 16303
    GPU: NVIDIA GeForce GTX 1080 GPU RAM: 8072
    SotA.QA.Win.64.1502.Date.06.03.23
    Area: Fishing_Expedition

    Video Card: Nvidia Drivers 528.02

    Testing method: In Windows press Window key and G. Click Capture option. Record a video. Use a phone stopwatch timer. At the second you observe the dialogue UI loading start timer. When you finally observe text in the dialogue UI stop timer.

    20K Character Inky Script:
    Text appears around 1.5 seconds.

    60K Character Inky Script:
    Text appears around 1.8 seconds.

     
    Last edited: Jun 4, 2023
  8. Scanphor

    Scanphor Avatar

    Messages:
    553
    Likes Received:
    977
    Trophy Points:
    63
    20k about 0.5s, 60k 1.8s

    CPU: 11th Gen Intel(R) Core(TM) i5-11600K @ 3.90GHz (12) System RAM: 32635
    GPU: NVIDIA GeForce RTX 3080 GPU RAM: 10067

    Game on a 980 Pro M2 SSD
     
    Anpu likes this.
  9. Ravalox

    Ravalox Chief Cook and Bottle Washer Moderator SOTA Developer

    Messages:
    1,731
    Likes Received:
    4,954
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Dallas, TX
    Gotcha, ok thanks updated the post, it wasn't clear that was the case :O
     
    Anpu and Lained like this.
  10. Ravalox

    Ravalox Chief Cook and Bottle Washer Moderator SOTA Developer

    Messages:
    1,731
    Likes Received:
    4,954
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Dallas, TX
    For completeness here's my results:

    06/04/2023 16:09
    User Specs:
    OS: Windows 10 (10.0.0) 64bit
    CPU: Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz (12) System RAM: 65451
    GPU: NVIDIA GeForce GTX 1080 GPU RAM: 8079
    SotA.QA.Win.64.1502.Date.06.03.23
    Area: Fishing_Expedition
    Area Display Name: Fishing Expedition
    Loc: (70.3, 2.1, 20.8)
    Debug: RmlzaGluZ19FeHBlZGl0aW9ufHwoNzAuMjgyLCAyLjA1NSwgMjAuNzYyKXwoMCwgLTAuOTY5LCAwLCAtMC4yNDYpfDE1Mi4yNTIxfDM4Ljg2MzY2fDEzLjcyOTk0

    20K. 0.750
    60K. 1.250

    Thanks to everyone so far for testing! Hoping to see some tests on older machines too. 4th Gen Intel would be interesting to see and a Mac or two :)
    Unity is more CPU bound than GPU, and it looks like that may be showing here. The newer/higher grade CPU, the delta numbers shrink (so far).

    results are promising!
     
    Anpu likes this.
  11. Jakkal

    Jakkal Bug Hunter

    Messages:
    383
    Likes Received:
    491
    Trophy Points:
    43
    20k vs 60k Latency test measured from the click on conversationalist

    20k 1.4 seconds
    60k 2.6 seconds

    As for the inky in game load editor, other than loading I never use that editor. Might be worth doing a poll to see if players need / use it. All my inky scripts are created using a plain text editor (notepad++) due to personal preference.

    System Specs: (from Canada)
    OS: Windows 10 (10.0.0) 64bit
    CPU: Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz (8) System RAM: 19346
    GPU: Intel(R) HD Graphics 4600 GPU RAM: 1136
    SotA.QA.Win.64.1502.Date.06.03.23
    Area: Fishing_Expedition
    Area Display Name: Fishing Expedition
    Loc: (71.4, 2.1, 19.6)
    Debug: RmlzaGluZ19FeHBlZGl0aW9ufHwoNzEuNDE0LCAyLjA1NSwgMTkuNjAxKXwoMCwgLTAuOTk4LCAwLCAwLjA2Myl8MTg3LjIyNDJ8MTB8Mg==
     
    Last edited: Jun 4, 2023
    Anpu likes this.
  12. ConjurerDragon

    ConjurerDragon Avatar

    Messages:
    1,637
    Likes Received:
    977
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Rhineland-Palatinate
    There is an ingame editor for inky? I only saw that one can upload a ready script from harddisk but found no way to actually type in something ingame.
     
  13. Alley Oop

    Alley Oop Bug Hunter Bug Moderator

    Messages:
    15,679
    Likes Received:
    19,463
    Trophy Points:
    153
    there is not. just a display.
     
    Anpu likes this.
  14. Anpu

    Anpu Avatar

    Messages:
    7,944
    Likes Received:
    9,015
    Trophy Points:
    153
    Location:
    Hemut
    Check the Ink NPC Dialogue Composition forum. Look at the top of the page for some useful links.
     
  15. Scanphor

    Scanphor Avatar

    Messages:
    553
    Likes Received:
    977
    Trophy Points:
    63
    Notepad++ best editor imo
     
    vulcanjedi likes this.
  16. Ravalox

    Ravalox Chief Cook and Bottle Washer Moderator SOTA Developer

    Messages:
    1,731
    Likes Received:
    4,954
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Dallas, TX
    On the Editor topic...

    I agree Notepad++ is like the best editor on the face of the planet :)
    If someone is new to Inky scripting, definitely recommend using their editor since you can run the script and do debugging right there. Download that here. (please note that SotA may not support all aspects of Inky. Conversationalist documentation will be added/updated to the Player Instructions documentation after the Premium conversationalists are updated on the live server.

    Keep in mind that we do not intend to add an in game editor. This is best left to the Inky Editor since we would not be able to do any better than they have for syntax checking and operational debug testing.

    Other feature updates being considered:

    The UI will be changing, at this time, we plan to display up to 256 characters of the loaded script. We will recommend that the players set the first line of the script as a comment to use as an identifier (IE: Name/Purpose, Version#/Date made, etc).
    In addition the plan is to add better functionality to the Conversationalist UI (this is pending programming review, so not a promise):

    * The ability to remove a script (reset or clear the Conversationalist's programming)
    * Export a script from the conversationalist (into the player's local NPC folder - with ability to name the file). [Once a script is assigned to a conversationalist, the script is uploaded and stored on the server, so this would be just in case the player lost the script source]

    Other general notes:

    * The "Basic Conversationalists" with a 2K (2,000) character limit are not intended to be used for more complex scripting and are not being targeted for a character limit increase in ratio with the "Advanced" / "Premium" version.

    I am currently putting together a listing (internally) of all the conversationalists and their source (Crafting/Pledge/Crown Store). I believe that the model for the crafted versions of the Conversationalists are not also available with the larger character count in the store. I will look into correcting this as well.
     
  17. Gwendolyn Obscuro

    Gwendolyn Obscuro Bug Hunter

    Messages:
    594
    Likes Received:
    1,142
    Trophy Points:
    63
    Not sure how you guys can start and stop a stopwatch that quick lol. Tried it a few times and couldn't get any consistent numbers but:

    20K: no delay (did not see 'loading' message at all)
    60k: 'loading' message displayed somewhere between 1 and 1.5 seconds


    User Specs:
    OS: Windows 10 (10.0.0) 64bit
    CPU: Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz (8) System RAM: 16252
    GPU: NVIDIA GeForce GTX 1050 Ti GPU RAM: 4061
    SotA.QA.Win.64.1502.Date.06.03.23
    Area: Fishing_Expedition
    Area Display Name: Fishing Expedition
    Loc: (71.2, 2.1, 21.3)
    Debug: RmlzaGluZ19FeHBlZGl0aW9ufHwoNzEuMTc2LCAyLjA1NSwgMjEuMzQ3KXwoMCwgLTAuOTk1LCAwLCAtMC4xMDMpfDE2MS4yNTg1fDE4LjkyNDY0fDMuOTcxNzM2
     
  18. Anpu

    Anpu Avatar

    Messages:
    7,944
    Likes Received:
    9,015
    Trophy Points:
    153
    Location:
    Hemut
    I could not do this in game, it was too fast for me. I had to take a video and THEN use a stopwatch to time between these differences.
     
  19. Jakkal

    Jakkal Bug Hunter

    Messages:
    383
    Likes Received:
    491
    Trophy Points:
    43
    I used 2 hands. 1 to start the conversationalist and 1 to start the stopwatch timer. Click both at the same time. Then click to stop. I doubt it matters much within roughly 0.5 seconds leeway of the actual time. Its probably more if the load takes a significant time like over 5 or 10 seconds that it becomes an issue. I'm not a dev though so it'll be up to Ravalox and the team what load times are acceptable.

    One advantage of longer scripts is players can create content translated to multiple languages. Especially if we get the ability to know a players language preference as a loadable variable. Something to add to the wishlist.
     
  20. Ravalox

    Ravalox Chief Cook and Bottle Washer Moderator SOTA Developer

    Messages:
    1,731
    Likes Received:
    4,954
    Trophy Points:
    125
    Gender:
    Male
    Location:
    Dallas, TX
    Jakkal's correct. If the same process is used for both tests (no matter what method is used) the difference between the two will be close enough to see if there is a significant delay with a much larger payload.

    So far the results show a 1 to 2 second delay is acceptable.
     
    Anpu and Scanphor like this.