Previous attempts to integrate Neural Radiance Fields (NeRF) into Simultaneous Localization and Mapping (SLAM) framework either rely on the assumption of static scenes or treat dynamic objects as outliers. However, most of real-world scenarios is dynamic. In this paper, we propose a time-varying representation to track and reconstruct the dynamic scenes. Firstly, two processes, tracking process and mapping process, are simultaneously maintained in our system. For tracking process, the entire input images are uniformly sampled, then progressively trained in a self-supervised paradigm. For mapping process, we leverage motion masks to differentiate dynamic objects and static backgrounds, and we apply distinct sampling strategies for these two types of areas. Secondly, the parameters optimization for both processes are made up by two stages, the first stage associates time with 3D positions to convert the deformation field to the canonical field. And the second stage associates time with 3D positions in canonical field to obtain colors and Signed Distance Function (SDF). Lastly, we propose a novel key-frame selection strategy based on the overlapping rate. We evaluate our approach on two synthetic datasets and a real-world dataset. And the experiment results validate that our method is more effective when compared to existing state-of-the-art dynamic mapping methods.