One should not delay in consulting the fertility specialist. There are various reasons in the support of this response. There are few health issues which somehow affect the fertility and can become severe with the passage of time, if doesn't took into consideration.
One of the commonly spread issue is Tuberculosis. TB also effects the fertility. With the delay in consulting a specialist you are not just increasing the Tuberculosis but also increasing the challenges in conceiving.
It's always recommended to take a second opinion with the experts.