Put two two-layer boards together and you get a very thick three layer board, not a four layer board. Three two-layer boards gives you a way too thick four layer board.
You could put a mylar sheet between them though and get what you are trying to get, along with some extraneous capacitance.