A former Taskmaster contestant has said his car show won't be back for a second series.