[Fix] Fix `Config` cannot parse base config when there is `.` in tmp path (#856)

* [Fix] Fix config cannot parse tmp path like

* Add comments

* Add comments

* Apply suggestions from code review

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>