Fix plugins incompatible issue in upgrade test