It’s probably not doing any serious damage, but it’s unusual that the synchroes should be worn as is suggested. Make sure you’re fully disengaging the clutch when you shift and try shifting a little ...