Bronco Wrestler -
My own two cents, for what it's worth, is that you should absolutely go for it. I'm only three years out of college, but I could have told you even at the midpoint of my freshman year at Baker that I had made a mistake in not pursuing wrestling in college. For the longest time, I dwelled on it as if it was going to be the biggest regret I'd ever have in my life.
I don't know how things would have worked out at all had I gone on to wrestle. I don't know if it would have been fun, if I would have found any sort of success, or even if I would have ended up being some throwing dummy for an All-American. What I do know is that for a long time the questions that remain unanswered kept making my heart beat faster and faster whenever I thought about them. Two guys that I hammered my senior year in high school went on to be DII national qualifiers. What if?
The point is, give it a shot. You can always transfer, leave the team, etc. You can't go back in time and correct the error.
Best of luck in whatever you choose to do.