Well, in November it would be more convenient to go by train, there are direct trains from Milan to Brig. Weather can be very unpleasant in Switzerland in November and winter tyres are definitely recommended.
The trains remain in service between Täsch and Zermatt during the day and will be replaced by buses late in the evening:
Due to planned construction work, buses will run instead of trains on connections from Täsch from 22.30 to 01.00 hrs.
See the Info link I posted the above.