O2 is pure oxygen, which - as I mentioned - needs extreme cold to exist in its solid form (unless under extreme pressure).
What is used in most lithium ion cell cathodes is lithium cobalt oxide (LiCoO2), which is a solid, and which releases O2 - as a gas - when heated.
But oxygen doesn’t burn. It is the electrolyte that oxidizes (burns).