The neutron transport equation is usually solved against a stationary background medium. When the background material is moving, the transport equation will need to be modified. Solving the transport equation with moving material is quite complicated, especially for the curved coordinate system because of the double angular redistributions. In this study, the discretization method of the simplified transport equation considering the moving-material effect is implemented in three-dimensional cylindrical geometry. Directly solving this modified transport equation with the standard solution technique is problematic since the advection term introduced by moving material may render the transport solver numerically unstable. The speed ratio λ is defined for stability analysis. A forced-stable method is proposed in this study to achieve good numerical stability for any material speeds and time-step sizes. The accuracy of this new method is verified using manufactured solutions. Steady numerical results demonstrate that the effects introduced by background motion cannot be neglected as the material speed starts to approach one-tenth of the neutron speed. Moreover, transient analysis indicates that the moving background has a considerable impact on the criticality of a system.