I’d highly recommend Les Jardins d’Epicure in Bray-et-Lu. They let you keep your bicycles in the room or can store them for you in a secure area.
It’s a beautiful hotel and luxurious for the price. When I stayed there this year for my London to Paris bike ride it only cost me 110 euros for the night. The swimming pool and sauna were amazing after having cycled all the way from London to get there!