Noodalls input lag testing (unique method - games/controllers/etc) (updated last two years worth!)

There seems to have been a bit of activity on my twitter recently regarding SFVAE input lag. I thought I might type out some thoughts on it here, rather than in short little Twitter sentences.

iBananaKiller tested the input lag first, and posted about it on Reddit stating that it was about 4F. This was obviously quite a reduction from what we had seen previously (5.3 by his own tests).

As per iBananaKiller’s own posts, Displaylag also tested, and found no change from previous versions.

Now, iBananaKiller uses a method relying on visualising the button press, which obviously attracted a lot of criticism. The problem as I see it and he made without much success is that even if you take a pesimistic approach to how early the button is pressed, his results would still be noticeably faster than display lags.

So assuming both testing methods are acceptable, how can they both be so different and also correct.

I was overseas when a lot of this was happening, but when I got a chance to test, the results I posted were these.

Now, if you don’t know how to read my report card format, please watch this first.

What is interesting is that most games would look something like this,

You can see that normally the results will be going down one column, and at at threshold they will flick across to the next column (i.e. when the command comes too late in the frame to make it in time, and ends up on the next frame.)

Compare this to SFV’s result. Initially this appears to be happening, with most results occuring in 4F and then some in 5F. Then it goes to six frames. Then it goes down to 3F and back to 4F.

Now, if all you saw were the 4-5F results you would get results similar to displaylag’s.

If all you saw were the 3-4F results, you would get results similar to iBananaKiller’s.

The point being, the input lag for SFV is quite inconsistent. I believe this happens to some extent with T7, and suggests that it may be a UE4 issue. I did not demonstrate this on my latest test for T7, however given displaylag’s input numbers are lower than mine (and should be higher by the nature of the differences in testing process) I would believe it is still there.

This is actually fairly frustrating for input lag testing. What I and presumably most people want is a hard and fast number which after a single test (with ~100 repetitions for my setup) gives a meaningful result. The way that the results have come out for SFV does not provide this.

… The point being, the input lag for SFV is quite inconsistent. …

If it were really “inconsistent”, we would not expect things to be nearly so clean. It still steps up like a staircase - the ‘wrap around’ is just strange.

Been doing lots of testing, but haven’t updated this thread in a while. And then people ask for results from a previous test and it takes me ages to find it, so I thought I would update this thread. Been testing PSX and PS2 recently (and other systems as well) so will compile those here.

All tested with Brook Retro controller. Also JP-NTSC. All original copies of the games.

PSX/PS2
Shin Contra 42ms

SFZ2’ in Street Fighter Collection Turbo 8 43ms

Rockman X4 43ms

Street Fighter Collection SSF2T Turbo 4 49.57ms

Tekken 3 via Arcade History 58ms

Tekken 4 58ms

Tekken 2 58ms

Tekken 1 58ms

Guilty Gear 58ms

Guilty Gear XX #R 59ms

Guilty Gear Accent Core 59ms

Soul Calibur 2 59ms

Soul Calibur 3 59ms

Dead or Alive 59ms

Dead or Alive 2 HC 59ms

Street Fighter 3 Third Strike 59ms

Street Fighter the Movie 60ms

Dead or Alive 2 74ms

Rockman 2 75ms

Tekken 5 76ms

Tekken 3 76ms

Virtua Fighter 5 Evo 76ms

Hyper Street Fighter 2 Turbo 4 77.6ms

Tekken Tag Tournament 90ms

SWITCH tested wtih Brook UFB latest Firmware
Super Mario Bros 47ms

MM11 demo 73ms

USF2 82ms

Megaman 2 116ms

SNES
SF2T 10* 26ms

Rockman X 26ms

Contra 3 27ms

Street Fighter 2 41ms

Super Mario World 41ms

Final Fight 42-43ms

https://twitter.com/noodalls/status/1183295558393290753
https://twitter.com/noodalls/status/1183292468109774849

SNES CLASSIC
Contra 3 47ms

Street Fighter 2 Turbo 10* 51ms

Megaman X 62ms

NES
Super Mario Bros 3 24ms

Super Mario Bros 26ms

Rockman 2 26ms

Punchout 42ms

NES CLASSIC
Super Mario Bros 62ms

MegaMan 2 63ms

MegaDrive Mini
Castevania 87ms

Sonic 2 103ms

PS4
UNIB:Latest 42ms

Blazblue Cross Tag Battle 43ms

Sonic Mania 58ms

Contra 3 in Contra Collection 58ms

SFAC.SF3III 60ms no difference between filters

Blade Strangers 60ms

Blazing Chrome 60ms

Fighting EX Layer 67ms

Megaman 2 69ms

Street Fighter V patch 3.09 70ms

SFAC SSF2T (speed 4) 74ms

Tekken 7 3.0 patch 74ms

Mortal Kombat 11 74ms

Skullgirls 74ms

DragonBall FighterZ 75ms

Fantasy Strike 84ms

Megaman 11 demo 88ms

Marvel vs Capcom Infinite 89ms

Omen of Sorrow Demo 89ms

River City Girls 89ms

Soul Calibur 6 90ms

Injustice 2 92ms (including testing supersampling)

SNK Heroines 92ms

Street Fighter V 1.00 96-105ms

Rockman X4 107ms

Megadrive collection Sonic 2 117ms

Dead or Alive 6 120ms

Tekken 7 1.00 120ms

MegaMan X 123ms

Final Fight 135ms

Power Rangers 138ms

Contra Rogue Corps 234ms

PS3
Hardcorps uprising 43ms

HDRemix 76ms

Final Fight 94ms

X1
MM11 demo 62ms

Samurai shodown 69ms

Soul Calibur VI 87ms

Samurai Shodown Demo 122ms