I will discuss the level two Zhu algebra for the Heisenberg vertex operator algebra and techniques used in determining its structure. I will also discuss more general results helpful in determining generators and relations for higher level Zhu algebras, and in particular, will provide an example to clarify the necessity of an extra condition required in the definition of higher level Zhu algebras. (Joint with Katrina Barron.)