At AWS we had some tests which involved adding stuff to DynamoDB. Since it's eventually consistent, sometimes the tests would fail because some assertions wouldn't be true until some time later. Of course we tried to make them succeed every time with retries, but we didn't want the tests to take forever either.
So, it was expected that the tests would fail once in a while. Maybe there could be a better way to handle this, but what would happen is if that test failed we would just check the data manually, waiting for it to come up.
So, it was expected that the tests would fail once in a while. Maybe there could be a better way to handle this, but what would happen is if that test failed we would just check the data manually, waiting for it to come up.