It might mean fall since the leaves in fall are yellow and that's how it symbolizes in nature. It might also mean that since fall is also represented as the waning of one's years and that the speaker is old and is approaching his last days, but the decision to choose the roads will affect him deeply.
Hope this helps.