For the last few years I've spent a lot of time working on bandits. Csaba and I recently completed a new book on bandits that is published by Cambridge University Press. You can download the online version of the book for free here. I also have a set of notes on bandit convex optimisation, which is available here. Please let me know if you find any mistakes or have suggestions for improvement.