The only downside to having more swap space than you will actually use, is the disk space you will be reserving for it cannot be used for application or system data.