If you consider time dilation strictly within special relativity, there is neither spacetime curvature nor acceleration. If B moves past A, then in the restframe of A, B is moving a distance ΔxB, between, say, two flags at rest relative to A, in a time ΔtB. B passing each of the flags is an event in spacetime. In the restframe of B, the flags are moving and passing B one after the other, at a temporal distance Δ˜tB, with a spatial distance of the two events (not of the flags as such) of Δ˜xB=0. This yields
(cΔtB)2−(ΔxB)2=(cΔ˜tB)2
meaning that Δ˜tB ist smaller than ΔtB. So, one might be tempted to say, at least loosely speaking, that B is aging more slowly. But this way of loosely speaking is the source of confusion. A is moving relative to B, so just as well A should be aging more slowly, right? But note that the above setup is not symmetrical. We considered the time (and space) intervals between two events defined by B passing two flags at rest relative to A. The corresponding setup, with the roles of A and B switched, would have A passing two flags at rest relative to B.
The time intervals considered above (and the corresponding time intervals if the roles of A and B are switched) are the respective time intervals between the events defined by B passing the flags at rest relative to A (A passing the flags at rest relative to B) as observed by A and B in each case. These time intervals are really, physically different; this difference is not apparent or a delusion.
As a side note, as to the statement "observes the other aging slower": The actual visual impression of an observer is a more complicated issue, as the visual impression depends on the light from the observed object reaching the observer's eye at any given instant. This involves taking into account light travel time between object and observer.
Considering spacetime curvature: For an observer travelling on a trajectory Xa(s), with s a parameter of the trajectory and 0≤a≤3, the proper time τ of the observer is obtained via
(dτds)2=gab(s)dXadsdXbds
with gab the spacetime metric. Apply this to two trajectories, one for A, one for B, which are such that A and B meet twice along the trajectories. The proper times ΔτA and ΔτB between the two encounters will, in general, not be equal.
As a special case of the above, you could consider an inertial frame (laboratory) in which A is at rest. B is moving along a circle in this laboratory, repeatedly passing A. Evidently, this situation is not symmetrical between A and B. A will find B to age more slowly (each time B passes A, the two can compare clocks they have with them). B can attribute this difference to his motion relative to A, or to the "gravitational" time dilation caused by the centrifugal force B experiences.