My WAW acted the same way when she thought I was seeing someone else, even though she's in an A.
It's not so much a jealousy feeling on his part as it is a feeling of rejection because the affair is much more desireable when he thinks he can cheat and still have you as a backup option. But don't get ahead of yourself and start to date to make him jealous or he might grow closer to the OW and try to rub the A in your face to seem more desirable and put the taboo back into the A.
You can go out and still have fun being attractive and sexy but watch out for a few hail mary attempts on his part to keep you in the wings. And by that it could be anything from jealousy attempts, anger to get you to stop, grief and tears caused by guilt on his part, and the biggest being some reassurance that you are still his wife or still love him without any return investment on his part. Stick to your "maybe"s and "idk"s when that happens.
These little signs you're seeing are good signs. Baby steps really do add up to giant leaps.
