Keys, queries, and values are all vectors from the LLMs. RoPE [66] entails the rotation of the question and vital representations at an angle proportional for their complete positions of the tokens within the input sequence. Obtained improvements on ToT in quite a few strategies. Firstly