L2ashobby

@l2ashobby.bsky.social

26 Followers 51 Following

Learning about machine learning

Formulas for LoRA: W_{updated} = W + \Delta W, \Delta W \approx AB, W_{updated} = W + AB
flow chart diagram showing SARSA, top, vs Q-learning, bottom, where on-policy SARSA's next action is used to update Q-values, while Q-learning's next action is instead sampled from a behavior policy. Q-learning uses a target policy to find the best action, which is used to update Q-values instead.